[2025-10-03T17:00:02.516810] [INFO ] [MAIN ] Using last completed trading day: 2025-10-03 [2025-10-03T17:00:02.713976] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-03T17:00:02.714241] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-03T17:00:02.917500] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-03T17:00:02.918300] [WARN ] [STATE ] State set to: RUNNING [2025-10-03T17:00:02.918399] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-03T17:00:02.918453] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-03T17:00:02.918556] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-03T17:00:02.918678] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-03T17:00:04.495037] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-03T17:00:04.495227] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-03T17:00:04.495456] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-03T17:00:04.496621] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-03T17:00:04.496713] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-03T17:00:04.496754] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-03T17:00:04.496812] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-03T17:00:04.496846] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-03T17:00:04.496913] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-03T17:00:04.497286] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-03T17:00:04.497323] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-03T17:00:04.497476] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-03T17:00:04.497509] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-03T17:00:04.497542] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-03T17:00:04.497575] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-03T17:00:04.522602] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-03T17:00:04.547939] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-03T17:00:04.548031] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-03T17:00:04.548079] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-03T17:00:04.548110] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-03T17:00:04.548163] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-03T17:00:04.548507] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-03T17:00:04.548542] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-03T17:00:04.548573] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-10-03T17:00:04.548601] [INFO ] [MAIN ] Running in parallel mode [2025-10-03T17:00:04.548854] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-10-03T17:00:05.212593] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.344988] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.353694] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-03T17:00:05.351053] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.370449] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-03T17:00:05.399690] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-03T17:00:05.416287] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-03T17:00:05.440190] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.440339] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-03T17:00:05.440698] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-03T17:00:05.440621] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-03T17:00:05.440786] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-03T17:00:05.452363] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-03T17:00:05.476505] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-03T17:00:05.505565] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-03T17:00:05.524099] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-03T17:00:06.080963] [DEBUG] [LOCAL ] AA: Loaded 54005 existing records from primary storage. [2025-10-03T17:00:06.088018] [DEBUG] [LOCAL ] A: Loaded 51103 existing records from primary storage. [2025-10-03T17:00:06.188348] [INFO ] [MAIN ] AA: Loaded 54005 existing records. [2025-10-03T17:00:06.162314] [INFO ] [MAIN ] A: Loaded 51103 existing records. [2025-10-03T17:00:06.337038] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:06.390527] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-03T17:00:06.649155] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:06.661569] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-03T17:00:06.762121] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:06.811687] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-03T17:00:06.827388] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-03T17:00:06.835804] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:06.836154] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-03T17:00:06.836294] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-03T17:00:06.837624] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-03T17:00:06.837710] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-03T17:00:06.842963] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-03T17:00:06.913403] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-03T17:00:06.908032] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:00:06.956618] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-03T17:00:07.009180] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:00:07.055028] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-03T17:00:07.098153] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:00:07.126331] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-03T17:00:07.138304] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-03T17:00:07.178111] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-03T17:00:07.216104] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-03T17:00:07.299541] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 48m 37s. Rate: 21.8 symbols/min [2025-10-03T17:00:07.374924] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:00:07.519086] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-03T17:00:07.806983] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:07.874277] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-03T17:00:07.893402] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:07.918581] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:07.920864] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-03T17:00:07.993349] [DEBUG] [LOCAL ] AAP: Loaded 52300 existing records from primary storage. [2025-10-03T17:00:07.993855] [INFO ] [MAIN ] AAP: Loaded 52300 existing records. [2025-10-03T17:00:08.102191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T17:00:08.104010] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-03T17:00:08.185425] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:08.185747] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-03T17:00:08.185810] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-03T17:00:08.187023] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-03T17:00:08.187088] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-03T17:00:08.561929] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:08.562439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-03T17:00:08.607858] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T17:00:08.609268] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-03T17:00:08.923039] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-03T17:00:08.924177] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-03T17:00:09.547340] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T17:00:09.549499] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-03T17:00:09.740802] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T17:00:09.751260] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-03T17:00:09.933727] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-03T17:00:09.934867] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-03T17:00:10.171473] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:00:10.184206] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-03T17:00:10.188490] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-03T17:00:10.189761] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-03T17:00:10.491487] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-03T17:00:10.503047] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-03T17:00:10.518918] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T17:00:10.519890] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-03T17:00:10.781804] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-03T17:00:10.783006] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-03T17:00:11.033494] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T17:00:11.034554] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-03T17:00:11.283699] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:00:11.294776] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-03T17:00:11.410450] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T17:00:11.411261] [INFO ] [REMOTE ] AAM: Full fetch complete (947 records). [2025-10-03T17:00:11.411340] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-03T17:00:11.618469] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-03T17:00:11.618746] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:11.618823] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:11.618907] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-03T17:00:11.618980] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-03T17:00:11.619029] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-03T17:00:11.619082] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-03T17:00:11.619168] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AAM took 7.0s. Estimated remaining: 2h 19m 31s. Rate: 17.0 symbols/min [2025-10-03T17:00:11.805203] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:11.849330] [DEBUG] [LOCAL ] AAT: Loaded 30621 existing records from primary storage. [2025-10-03T17:00:11.849625] [INFO ] [MAIN ] AAT: Loaded 30621 existing records. [2025-10-03T17:00:12.052546] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:12.052853] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-03T17:00:12.052918] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-03T17:00:12.054006] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-03T17:00:12.054077] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-03T17:00:12.474171] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:12.474778] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-03T17:00:12.510068] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T17:00:12.521431] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-03T17:00:12.636147] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-03T17:00:12.649225] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-03T17:00:13.501839] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T17:00:13.509118] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-03T17:00:13.654727] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-03T17:00:13.670559] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-03T17:00:14.168351] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:00:14.180909] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-03T17:00:14.212767] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:00:14.224155] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-03T17:00:15.220509] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:00:15.232689] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-03T17:00:15.417914] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:00:15.423968] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-03T17:00:16.364991] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T17:00:16.378313] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-03T17:00:16.396272] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:00:16.403447] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-03T17:00:16.697203] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-03T17:00:16.709772] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-03T17:00:17.621152] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-03T17:00:17.636936] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-03T17:00:17.684383] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:00:17.691384] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-03T17:00:18.220734] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:00:18.234139] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-03T17:00:18.416957] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:00:18.428998] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-03T17:00:19.191495] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:00:19.202800] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-03T17:00:19.510501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:00:19.529037] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-03T17:00:19.808518] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:00:19.827436] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-03T17:00:20.059908] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:00:20.079520] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-03T17:00:20.462453] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:00:20.473373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-03T17:00:20.899571] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T17:00:20.911169] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-03T17:00:21.698754] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:00:21.713691] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-03T17:00:21.779886] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:00:21.793433] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:00:21.791967] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-03T17:00:21.809865] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-03T17:00:22.426042] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:00:22.439763] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-03T17:00:23.009909] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:00:23.018583] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-03T17:00:23.309148] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:00:23.324015] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-03T17:00:23.673581] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:00:23.687001] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-03T17:00:23.843342] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:00:23.857838] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-03T17:00:24.314864] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:00:24.324002] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-03T17:00:25.191258] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:00:25.206371] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-03T17:00:25.275832] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:00:25.289061] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-03T17:00:25.366923] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:00:25.381631] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-03T17:00:25.588179] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:00:25.596472] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-03T17:00:26.711264] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:00:26.713343] [INFO ] [REMOTE ] AAT: Full fetch complete (42823 records). [2025-10-03T17:00:26.713577] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-03T17:00:26.989159] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:00:27.058748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:00:27.084241] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-03T17:00:27.119927] [INFO ] [REMOTE ] A: Full fetch complete (73141 records). [2025-10-03T17:00:27.120375] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-03T17:00:27.358795] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-03T17:00:27.359142] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-03T17:00:27.365573] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-03T17:00:27.401465] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-03T17:00:27.550691] [DEBUG] [LOCAL ] AAT: Trimmed 42823 records to 30838 (keeping 200 days of data) [2025-10-03T17:00:27.568379] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T17:00:27.646377] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-03T17:00:27.887173] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-03T17:00:27.887294] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-03T17:00:27.888760] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-03T17:00:27.889181] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-03T17:00:27.894599] [DEBUG] [LOCAL ] A: Trimmed 73141 records to 51488 (keeping 200 days of data) [2025-10-03T17:00:28.127686] [DEBUG] [LOCAL ] AAT: Primary data saved (30838 records). [2025-10-03T17:00:28.128536] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-03T17:00:28.128925] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. AAT took 16.5s. Estimated remaining: 5h 10m 5s. Rate: 7.6 symbols/min [2025-10-03T17:00:28.368011] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:28.435368] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-03T17:00:28.444138] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-03T17:00:28.471077] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-03T17:00:28.471963] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-03T17:00:28.476009] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-03T17:00:28.479937] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-03T17:00:28.617213] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:00:28.643828] [INFO ] [REMOTE ] AAP: Full fetch complete (75014 records). [2025-10-03T17:00:28.664330] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-03T17:00:29.229176] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:29.292554] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-03T17:00:29.524355] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-03T17:00:29.526936] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-03T17:00:29.528335] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-03T17:00:29.528770] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-03T17:00:29.533857] [DEBUG] [LOCAL ] AAP: Trimmed 75014 records to 52648 (keeping 200 days of data) [2025-10-03T17:00:29.535170] [DEBUG] [LOCAL ] A: Primary data saved (51488 records). [2025-10-03T17:00:29.535702] [INFO ] [MAIN ] A: Full history saved. [2025-10-03T17:00:29.536526] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. A took 25.0s. Estimated remaining: 4h 6m 20s. Rate: 9.6 symbols/min [2025-10-03T17:00:29.649844] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:00:29.711254] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-03T17:00:29.740278] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:00:29.752370] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T17:00:29.764924] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-03T17:00:29.780945] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:00:29.813165] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-10-03T17:00:29.848268] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-03T17:00:29.848418] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-03T17:00:29.857289] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-03T17:00:29.856094] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:29.858128] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-03T17:00:29.863798] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-03T17:00:29.877751] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 19m 41s. Rate: 11.8 symbols/min [2025-10-03T17:00:30.271571] [DEBUG] [LOCAL ] AB: Loaded 27632 existing records from primary storage. [2025-10-03T17:00:30.314680] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:30.352109] [INFO ] [MAIN ] AB: Loaded 27632 existing records. [2025-10-03T17:00:30.759438] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-03T17:00:30.782465] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-03T17:00:30.788720] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-03T17:00:30.789237] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-03T17:00:30.787471] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:30.790957] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-03T17:00:30.792501] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-03T17:00:30.806877] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-03T17:00:30.807516] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-03T17:00:30.919819] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54395 (keeping 200 days of data) [2025-10-03T17:00:31.127608] [DEBUG] [LOCAL ] ABBV: Loaded 54074 existing records from primary storage. [2025-10-03T17:00:31.220369] [INFO ] [MAIN ] ABBV: Loaded 54074 existing records. [2025-10-03T17:00:31.716377] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:31.747366] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-03T17:00:31.757846] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-03T17:00:31.765202] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:31.767582] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-03T17:00:31.768605] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-03T17:00:31.769568] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-03T17:00:32.222795] [DEBUG] [LOCAL ] AAP: Primary data saved (52648 records). [2025-10-03T17:00:32.255637] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-03T17:00:32.279737] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAP took 24.9s. Estimated remaining: 3h 2m 6s. Rate: 13.0 symbols/min [2025-10-03T17:00:32.378329] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:32.393537] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-03T17:00:32.633015] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:32.677154] [DEBUG] [LOCAL ] AA: Primary data saved (54395 records). [2025-10-03T17:00:32.677321] [INFO ] [MAIN ] AA: Full history saved. [2025-10-03T17:00:32.677782] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AA took 28.1s. Estimated remaining: 2h 38m 16s. Rate: 14.9 symbols/min [2025-10-03T17:00:32.690988] [DEBUG] [LOCAL ] ABCB: Loaded 30713 existing records from primary storage. [2025-10-03T17:00:32.746178] [INFO ] [MAIN ] ABCB: Loaded 30713 existing records. [2025-10-03T17:00:33.030984] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:33.111625] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:33.112480] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-03T17:00:33.112673] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-03T17:00:33.113545] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-03T17:00:33.113628] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-03T17:00:33.273791] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:00:33.337875] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-03T17:00:33.458273] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-03T17:00:33.484249] [INFO ] [MAIN ] ABEV: Loaded 53668 existing records. [2025-10-03T17:00:33.723725] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:33.729941] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-03T17:00:33.810858] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:33.811115] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-03T17:00:33.811165] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-03T17:00:33.812291] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-03T17:00:33.812357] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-03T17:00:34.236761] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:34.237353] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-03T17:00:34.554048] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:00:34.571082] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-03T17:00:34.820212] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:00:34.829613] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-03T17:00:34.888591] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:00:34.899112] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-03T17:00:35.903701] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:00:35.913745] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-03T17:00:35.990467] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:00:36.002342] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-03T17:00:36.104474] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:00:36.116776] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-03T17:00:36.377082] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:00:36.386899] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-03T17:00:36.795045] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T17:00:36.802046] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-03T17:00:37.661904] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:00:37.673083] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-03T17:00:37.865221] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:00:37.876252] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-03T17:00:37.960568] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:00:37.972198] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-03T17:00:37.995438] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T17:00:38.003976] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-03T17:00:38.965038] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T17:00:38.978060] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-03T17:00:39.005763] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:00:39.014669] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-03T17:00:39.310246] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:00:39.319172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-03T17:00:39.624849] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:00:39.636758] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-03T17:00:40.179083] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T17:00:40.186236] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-03T17:00:40.427407] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:00:40.434890] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-03T17:00:40.920267] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:00:40.932515] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-03T17:00:41.298026] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:00:41.304409] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-03T17:00:41.638429] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T17:00:41.650890] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-03T17:00:41.697190] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T17:00:41.703923] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-03T17:00:42.215131] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:00:42.222966] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-03T17:00:42.367781] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:00:42.379774] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-03T17:00:43.085810] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:00:43.094899] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-03T17:00:43.151736] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T17:00:43.157543] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-03T17:00:43.879885] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:00:43.892142] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-03T17:00:44.034844] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:00:44.047505] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-03T17:00:44.066882] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:00:44.075219] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-03T17:00:44.415612] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T17:00:44.424089] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-03T17:00:44.998620] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:00:45.000444] [INFO ] [REMOTE ] AB: Full fetch complete (45529 records). [2025-10-03T17:00:45.000574] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-03T17:00:45.447620] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-03T17:00:45.448201] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-03T17:00:45.448985] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-03T17:00:45.449161] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-03T17:00:45.450411] [DEBUG] [LOCAL ] AB: Trimmed 45529 records to 27775 (keeping 200 days of data) [2025-10-03T17:00:45.677556] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T17:00:45.695553] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-03T17:00:45.706583] [DEBUG] [LOCAL ] AB: Primary data saved (27775 records). [2025-10-03T17:00:45.706889] [INFO ] [MAIN ] AB: Full history saved. [2025-10-03T17:00:45.707115] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AB took 16.2s. Estimated remaining: 3h 22m 32s. Rate: 11.7 symbols/min [2025-10-03T17:00:45.916282] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:00:45.983200] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-03T17:00:46.017330] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:00:46.051456] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:46.053720] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-03T17:00:46.078606] [DEBUG] [LOCAL ] ABG: Loaded 18742 existing records from primary storage. [2025-10-03T17:00:46.079139] [INFO ] [MAIN ] ABG: Loaded 18742 existing records. [2025-10-03T17:00:46.299802] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:46.300043] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-03T17:00:46.300096] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-03T17:00:46.300461] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-03T17:00:46.300540] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-03T17:00:46.692708] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:46.693079] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-03T17:00:47.121334] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:00:47.123237] [INFO ] [REMOTE ] ABCB: Full fetch complete (44533 records). [2025-10-03T17:00:47.123394] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-03T17:00:47.645114] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-03T17:00:47.645597] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-03T17:00:47.646846] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-03T17:00:47.646951] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-03T17:00:47.648736] [DEBUG] [LOCAL ] ABCB: Trimmed 44533 records to 30916 (keeping 200 days of data) [2025-10-03T17:00:47.715704] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:00:47.721357] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-03T17:00:47.892535] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T17:00:47.909908] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-03T17:00:47.928220] [DEBUG] [LOCAL ] ABCB: Primary data saved (30916 records). [2025-10-03T17:00:47.928396] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-03T17:00:47.933905] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. ABCB took 15.6s. Estimated remaining: 3h 9m 41s. Rate: 12.4 symbols/min [2025-10-03T17:00:48.110957] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:00:48.165790] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-03T17:00:48.185909] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:48.187037] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-03T17:00:48.187103] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-03T17:00:48.187232] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-03T17:00:48.187279] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-03T17:00:48.187323] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-03T17:00:48.187358] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-03T17:00:48.605081] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:48.605459] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-03T17:00:48.813468] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:00:48.818499] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-03T17:00:49.780089] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:00:49.796525] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-03T17:00:49.851261] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:00:49.863928] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-03T17:00:49.920425] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:00:49.930066] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-03T17:00:49.941719] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:00:49.946323] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-03T17:00:51.073814] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T17:00:51.080009] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-03T17:00:51.110308] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:00:51.118150] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-03T17:00:51.276422] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T17:00:51.289135] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-03T17:00:51.935797] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:00:51.949019] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-03T17:00:51.972167] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:00:51.979913] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-03T17:00:52.020128] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T17:00:52.026852] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-03T17:00:52.916555] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T17:00:52.920582] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-03T17:00:53.405167] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:00:53.413291] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-03T17:00:53.420091] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-03T17:00:53.423005] [INFO ] [REMOTE ] ABEV: Full fetch complete (77215 records). [2025-10-03T17:00:53.423123] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-03T17:00:53.636770] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:00:53.721066] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-10-03T17:00:53.739421] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-03T17:00:53.782072] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:00:53.787197] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:53.792565] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:53.803700] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-03T17:00:53.815420] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T17:00:53.815703] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-03T17:00:53.830165] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-03T17:00:53.851936] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-03T17:00:53.846759] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-03T17:00:53.878382] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 24.0s. Estimated remaining: 3h 14m 2s. Rate: 12.2 symbols/min [2025-10-03T17:00:54.022375] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-03T17:00:54.045746] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-03T17:00:54.050685] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-03T17:00:54.051131] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-03T17:00:54.138222] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:54.114872] [DEBUG] [LOCAL ] ABEV: Trimmed 77215 records to 54058 (keeping 200 days of data) [2025-10-03T17:00:54.309319] [DEBUG] [LOCAL ] ABR: Loaded 52372 existing records from primary storage. [2025-10-03T17:00:54.366525] [INFO ] [MAIN ] ABR: Loaded 52372 existing records. [2025-10-03T17:00:54.633717] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:54.635414] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-03T17:00:54.639160] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-03T17:00:54.646993] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-03T17:00:54.648458] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-03T17:00:54.899133] [DEBUG] [LOCAL ] ABEV: Primary data saved (54058 records). [2025-10-03T17:00:54.932805] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-03T17:00:54.970312] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABEV took 22.3s. Estimated remaining: 3h 0m 13s. Rate: 13.1 symbols/min [2025-10-03T17:00:55.290339] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:00:55.352834] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:55.376224] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-03T17:00:55.363717] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-03T17:00:55.433336] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:55.437018] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T17:00:55.446107] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-03T17:00:55.515926] [DEBUG] [LOCAL ] ABT: Loaded 54010 existing records from primary storage. [2025-10-03T17:00:55.516283] [INFO ] [MAIN ] ABT: Loaded 54010 existing records. [2025-10-03T17:00:55.727115] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:55.727376] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-03T17:00:55.727433] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-03T17:00:55.728727] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-03T17:00:55.728797] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-03T17:00:56.130206] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:56.130577] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-03T17:00:56.288543] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:00:56.294293] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-03T17:00:56.393712] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:00:56.400060] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-03T17:00:57.226429] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T17:00:57.231108] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-03T17:00:57.378399] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:00:57.390280] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-03T17:00:57.803588] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:00:57.804960] [INFO ] [REMOTE ] ABG: Full fetch complete (26497 records). [2025-10-03T17:00:57.805060] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-03T17:00:57.805537] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:00:57.805625] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:57.805722] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:57.805825] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-03T17:00:57.805913] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-03T17:00:57.805983] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-03T17:00:57.806570] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-03T17:00:57.806706] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABG took 12.1s. Estimated remaining: 2h 54m 25s. Rate: 13.5 symbols/min [2025-10-03T17:00:57.979926] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:00:58.007526] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:00:58.022222] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-03T17:00:58.078881] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:58.081168] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-03T17:00:58.106216] [DEBUG] [LOCAL ] ACA: Loaded 23486 existing records from primary storage. [2025-10-03T17:00:58.106507] [INFO ] [MAIN ] ACA: Loaded 23486 existing records. [2025-10-03T17:00:58.313335] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:58.313592] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-03T17:00:58.313664] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-03T17:00:58.314107] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-03T17:00:58.314165] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-03T17:00:58.749713] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:58.750374] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-03T17:00:58.823553] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:00:58.834831] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-03T17:00:59.376301] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T17:00:59.388681] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-03T17:00:59.551076] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T17:00:59.556197] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-03T17:01:00.102569] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T17:01:00.116521] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-03T17:01:00.252019] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T17:01:00.258144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-03T17:01:00.665473] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:01:00.676912] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-03T17:01:00.706164] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T17:01:00.714034] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-03T17:01:01.293235] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:01:01.299275] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-03T17:01:01.628841] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:01:01.645458] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-03T17:01:02.247103] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:01:02.258134] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-03T17:01:02.360525] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:01:02.368485] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-03T17:01:02.481333] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:01:02.494137] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-03T17:01:03.239739] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:01:03.253250] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-03T17:01:03.460938] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:01:03.463901] [INFO ] [REMOTE ] ABM: Full fetch complete (44981 records). [2025-10-03T17:01:03.464054] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-03T17:01:03.859810] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T17:01:03.917513] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-03T17:01:03.980618] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-03T17:01:03.980882] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-03T17:01:03.981941] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-03T17:01:03.982102] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-03T17:01:03.984324] [DEBUG] [LOCAL ] ABM: Trimmed 44981 records to 32469 (keeping 200 days of data) [2025-10-03T17:01:04.151035] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:01:04.177117] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-03T17:01:04.274593] [DEBUG] [LOCAL ] ABM: Primary data saved (32469 records). [2025-10-03T17:01:04.274814] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-03T17:01:04.274909] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABM took 16.3s. Estimated remaining: 3h 0m 29s. Rate: 13.1 symbols/min [2025-10-03T17:01:04.473728] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:04.528082] [DEBUG] [LOCAL ] ACCO: Loaded 37574 existing records from primary storage. [2025-10-03T17:01:04.528473] [INFO ] [MAIN ] ACCO: Loaded 37574 existing records. [2025-10-03T17:01:04.737368] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:04.741980] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-03T17:01:04.742103] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-03T17:01:04.742417] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-03T17:01:04.742484] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-03T17:01:05.114279] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:01:05.196279] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:05.192316] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-03T17:01:05.212606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-03T17:01:05.219407] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T17:01:05.232285] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-03T17:01:05.807116] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:01:05.820165] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-03T17:01:05.922453] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:01:05.928686] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-03T17:01:06.651972] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:01:06.660606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-03T17:01:06.947772] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T17:01:06.953977] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-03T17:01:07.255055] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T17:01:07.268397] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-03T17:01:07.385706] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:01:07.397316] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-03T17:01:08.036910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:01:08.045094] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-03T17:01:08.173550] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T17:01:08.179862] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-03T17:01:09.049708] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T17:01:09.078598] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T17:01:09.079423] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-03T17:01:09.086726] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-03T17:01:09.316388] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:01:09.387226] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:01:09.590727] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-03T17:01:10.067383] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:01:10.069021] [INFO ] [REMOTE ] ACA: Full fetch complete (34375 records). [2025-10-03T17:01:10.069113] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-03T17:01:10.405319] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-03T17:01:10.533766] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-03T17:01:10.533868] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-03T17:01:10.534284] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-03T17:01:10.534370] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-03T17:01:10.535719] [DEBUG] [LOCAL ] ACA: Trimmed 34375 records to 23677 (keeping 200 days of data) [2025-10-03T17:01:10.694181] [DEBUG] [LOCAL ] ACA: Primary data saved (23677 records). [2025-10-03T17:01:10.694437] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-03T17:01:10.694549] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ACA took 12.9s. Estimated remaining: 3h 5m 31s. Rate: 12.7 symbols/min [2025-10-03T17:01:10.896403] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:10.896744] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-03T17:01:10.896822] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-03T17:01:10.897023] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-03T17:01:10.897071] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-03T17:01:10.897117] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-03T17:01:10.897154] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-03T17:01:11.224506] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T17:01:11.287727] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-03T17:01:11.360782] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:11.887374] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:01:11.990724] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-03T17:01:12.699136] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:01:12.790725] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-03T17:01:13.047042] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T17:01:13.564360] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (4.48 seconds). [2025-10-03T17:01:13.590682] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-03T17:01:14.063902] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:01:14.390708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-03T17:01:15.190711] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-03T17:01:15.609875] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T17:01:15.657810] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T17:01:15.990678] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-03T17:01:16.126563] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T17:01:16.790706] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-03T17:01:17.508351] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T17:01:17.590701] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-03T17:01:17.913194] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:01:18.390742] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-03T17:01:19.118789] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T17:01:19.190765] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-03T17:01:19.624939] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:01:19.990724] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-03T17:01:20.476180] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T17:01:20.790735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-03T17:01:21.131997] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:01:21.135457] [INFO ] [REMOTE ] ABR: Full fetch complete (75255 records). [2025-10-03T17:01:21.135689] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-03T17:01:21.596407] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-03T17:01:21.630360] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-03T17:01:21.630460] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-03T17:01:21.631407] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-03T17:01:21.631499] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-03T17:01:21.633690] [DEBUG] [LOCAL ] ABR: Trimmed 75255 records to 52754 (keeping 200 days of data) [2025-10-03T17:01:21.987608] [DEBUG] [LOCAL ] ABR: Primary data saved (52754 records). [2025-10-03T17:01:21.987824] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-03T17:01:21.987938] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 28.1s. Estimated remaining: 3h 22m 38s. Rate: 11.6 symbols/min [2025-10-03T17:01:22.186703] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:22.249764] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-03T17:01:22.250161] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-10-03T17:01:22.393274] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:01:22.392404] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-03T17:01:22.449787] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-03T17:01:22.477501] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-03T17:01:22.477098] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:22.478196] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-03T17:01:22.478396] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-03T17:01:22.484450] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-03T17:01:22.531631] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-03T17:01:23.378146] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:23.403441] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-03T17:01:23.400989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-03T17:01:23.404506] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-03T17:01:23.406001] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-03T17:01:23.406806] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-03T17:01:23.408543] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T17:01:23.419880] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 54400 (keeping 200 days of data) [2025-10-03T17:01:23.816031] [DEBUG] [LOCAL ] ABT: Primary data saved (54400 records). [2025-10-03T17:01:23.816179] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-03T17:01:23.816271] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 28.8s. Estimated remaining: 3h 14m 22s. Rate: 12.1 symbols/min [2025-10-03T17:01:24.017804] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-03T17:01:24.023336] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:24.048397] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:01:24.119184] [DEBUG] [LOCAL ] ACI: Loaded 53643 existing records from primary storage. [2025-10-03T17:01:24.119538] [INFO ] [MAIN ] ACI: Loaded 53643 existing records. [2025-10-03T17:01:24.379477] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:24.379983] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-03T17:01:24.380035] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-03T17:01:24.380468] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-03T17:01:24.380532] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-03T17:01:24.803773] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-03T17:01:24.811729] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:25.089133] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T17:01:25.590724] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-03T17:01:25.999309] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:01:26.146752] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-03T17:01:26.390836] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-03T17:01:27.166745] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T17:01:27.190701] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-03T17:01:27.560805] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T17:01:27.564362] [INFO ] [REMOTE ] ACCO: Full fetch complete (54021 records). [2025-10-03T17:01:27.564528] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-03T17:01:27.995683] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-03T17:01:28.024784] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-03T17:01:28.024880] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-03T17:01:28.025472] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-03T17:01:28.025525] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-03T17:01:28.027019] [DEBUG] [LOCAL ] ACCO: Trimmed 54021 records to 37807 (keeping 200 days of data) [2025-10-03T17:01:28.271569] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T17:01:28.283231] [DEBUG] [LOCAL ] ACCO: Primary data saved (37807 records). [2025-10-03T17:01:28.283387] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-03T17:01:28.285075] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 24.0s. Estimated remaining: 3h 13m 10s. Rate: 12.2 symbols/min [2025-10-03T17:01:28.476554] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:28.559222] [DEBUG] [LOCAL ] ACM: Loaded 43361 existing records from primary storage. [2025-10-03T17:01:28.559571] [INFO ] [MAIN ] ACM: Loaded 43361 existing records. [2025-10-03T17:01:28.768041] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:28.768353] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-03T17:01:28.768418] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-03T17:01:28.769540] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-03T17:01:28.769608] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-03T17:01:28.795859] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-03T17:01:29.184254] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:29.590734] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-03T17:01:30.098757] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T17:01:30.180114] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:01:30.390726] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-03T17:01:30.725050] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:01:31.190708] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-03T17:01:31.847544] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:01:31.990722] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-03T17:01:32.485131] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T17:01:32.790735] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-03T17:01:33.590721] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-03T17:01:34.174025] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:01:34.390729] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-03T17:01:34.697227] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-03T17:01:34.794550] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T17:01:35.190716] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-03T17:01:35.478877] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:01:35.990730] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-03T17:01:36.790735] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-03T17:01:37.590683] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-03T17:01:37.633055] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:01:37.955709] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-03T17:01:38.178743] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:01:38.245689] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:01:38.247284] [INFO ] [REMOTE ] ACEL: Full fetch complete (38565 records). [2025-10-03T17:01:38.247369] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-03T17:01:38.248200] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:01:38.248295] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:01:38.248342] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:01:38.248384] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-03T17:01:38.248447] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-03T17:01:38.248489] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-03T17:01:38.248530] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-10-03T17:01:38.248603] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 27.6s. Estimated remaining: 3h 24m 3s. Rate: 11.5 symbols/min [2025-10-03T17:01:38.404172] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-03T17:01:38.443754] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:38.509699] [DEBUG] [LOCAL ] ACN: Loaded 53816 existing records from primary storage. [2025-10-03T17:01:38.510187] [INFO ] [MAIN ] ACN: Loaded 53816 existing records. [2025-10-03T17:01:38.713904] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:38.714147] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-03T17:01:38.714198] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-03T17:01:38.715212] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-03T17:01:38.715279] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-03T17:01:39.130632] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:39.190707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-03T17:01:39.785477] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T17:01:39.990742] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-03T17:01:40.546321] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:01:40.790722] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-03T17:01:41.524257] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:01:41.590725] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-03T17:01:42.390703] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-03T17:01:42.600940] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:01:43.190702] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-03T17:01:43.990670] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-03T17:01:44.066160] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:01:44.206401] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-03T17:01:44.790742] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-03T17:01:45.015830] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:01:45.532808] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:01:45.590707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-03T17:01:46.362498] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:01:46.390691] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-03T17:01:47.169427] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:01:47.190639] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-03T17:01:47.990682] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-03T17:01:48.074500] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:01:48.790713] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-03T17:01:49.100775] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:01:49.590752] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-03T17:01:50.390751] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-03T17:01:50.708180] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:01:50.771964] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-03T17:01:50.967464] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:01:51.190771] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-03T17:01:51.747637] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T17:01:51.990728] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-03T17:01:52.790726] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-03T17:01:53.061290] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:01:53.590716] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-03T17:01:54.228711] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:01:54.390744] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-03T17:01:54.464743] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-03T17:01:55.190740] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-03T17:01:55.206673] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:01:55.211782] [INFO ] [REMOTE ] ACI: Full fetch complete (77045 records). [2025-10-03T17:01:55.211934] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-03T17:01:55.676567] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-03T17:01:55.676704] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-03T17:01:55.677719] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-03T17:01:55.677934] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-03T17:01:55.679952] [DEBUG] [LOCAL ] ACI: Trimmed 77045 records to 54030 (keeping 200 days of data) [2025-10-03T17:01:55.924054] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:01:55.928302] [INFO ] [REMOTE ] ACM: Full fetch complete (62801 records). [2025-10-03T17:01:55.928917] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-03T17:01:55.996168] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-03T17:01:56.432530] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-03T17:01:56.433131] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-03T17:01:56.435105] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-03T17:01:56.436356] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-03T17:01:56.445193] [DEBUG] [LOCAL ] ACM: Trimmed 62801 records to 43665 (keeping 200 days of data) [2025-10-03T17:01:56.840973] [DEBUG] [LOCAL ] ACM: Primary data saved (43665 records). [2025-10-03T17:01:56.841950] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-03T17:01:56.843935] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACM took 28.6s. Estimated remaining: 3h 51m 35s. Rate: 10.2 symbols/min [2025-10-03T17:01:56.971218] [DEBUG] [LOCAL ] ACI: Primary data saved (54030 records). [2025-10-03T17:01:56.977150] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-03T17:01:56.984698] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACI took 33.2s. Estimated remaining: 3h 40m 11s. Rate: 10.7 symbols/min [2025-10-03T17:01:57.134322] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:57.251013] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:57.274480] [DEBUG] [LOCAL ] ACR: Loaded 5990 existing records from primary storage. [2025-10-03T17:01:57.274776] [INFO ] [MAIN ] ACR: Loaded 5990 existing records. [2025-10-03T17:01:57.412281] [DEBUG] [LOCAL ] ACP: Loaded 31272 existing records from primary storage. [2025-10-03T17:01:57.412922] [INFO ] [MAIN ] ACP: Loaded 31272 existing records. [2025-10-03T17:01:57.593968] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:57.621943] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-03T17:01:57.627004] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-03T17:01:57.627368] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-03T17:01:57.638120] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-03T17:01:57.804928] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:57.810735] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-03T17:01:57.842371] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-03T17:01:57.871475] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-03T17:01:57.916115] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-03T17:01:58.498912] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:58.516246] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-03T17:01:58.624117] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (3.43 seconds). [2025-10-03T17:01:58.686876] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:58.687570] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-03T17:01:58.689425] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-03T17:01:58.731239] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-03T17:01:59.190699] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-03T17:01:59.343010] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T17:01:59.990776] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-03T17:02:00.069234] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:02:00.625691] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T17:02:00.790928] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-03T17:02:00.888881] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:02:01.451029] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T17:02:01.549864] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-03T17:02:01.590637] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-03T17:02:02.390694] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-03T17:02:03.076798] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T17:02:03.156333] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:02:03.190734] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-03T17:02:03.990711] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-03T17:02:04.539413] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:02:04.790743] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-03T17:02:05.590740] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-03T17:02:05.917065] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-03T17:02:06.292868] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T17:02:06.338230] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T17:02:06.390694] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-03T17:02:07.190711] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-03T17:02:07.327319] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:02:07.990689] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-03T17:02:08.458409] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T17:02:08.790727] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-03T17:02:09.161993] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T17:02:09.404158] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-03T17:02:09.406522] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-03T17:02:09.406716] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-03T17:02:09.407805] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:02:09.407928] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:02:09.412863] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:02:09.413354] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-03T17:02:09.413717] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-03T17:02:09.413818] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-03T17:02:09.414107] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-03T17:02:09.414456] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACHR took 47.4s. Estimated remaining: 3h 52m 47s. Rate: 10.1 symbols/min [2025-10-03T17:02:09.592824] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-03T17:02:09.623856] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:09.665232] [DEBUG] [LOCAL ] ACRE: Loaded 33897 existing records from primary storage. [2025-10-03T17:02:09.665588] [INFO ] [MAIN ] ACRE: Loaded 33897 existing records. [2025-10-03T17:02:09.873343] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:09.873597] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-03T17:02:09.873673] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-03T17:02:09.874808] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-03T17:02:09.874884] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-03T17:02:10.296680] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:10.390706] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-03T17:02:11.003335] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:02:11.190712] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-03T17:02:11.725831] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:02:11.945022] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:02:11.990736] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-03T17:02:12.790743] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-03T17:02:13.362236] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:02:13.363399] [INFO ] [REMOTE ] ACR: Full fetch complete (8592 records). [2025-10-03T17:02:13.363533] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-03T17:02:13.601928] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-03T17:02:13.845472] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-03T17:02:13.845604] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-03T17:02:13.845961] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-03T17:02:13.846088] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-03T17:02:13.847298] [DEBUG] [LOCAL ] ACR: Trimmed 8592 records to 6006 (keeping 200 days of data) [2025-10-03T17:02:13.926929] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T17:02:13.945120] [DEBUG] [LOCAL ] ACR: Primary data saved (6006 records). [2025-10-03T17:02:13.945560] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-03T17:02:13.945742] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACR took 16.9s. Estimated remaining: 3h 50m 10s. Rate: 10.2 symbols/min [2025-10-03T17:02:14.151210] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:14.161166] [DEBUG] [LOCAL ] ACV: Loaded 7383 existing records from primary storage. [2025-10-03T17:02:14.161478] [INFO ] [MAIN ] ACV: Loaded 7383 existing records. [2025-10-03T17:02:14.363025] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:14.363312] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-03T17:02:14.363391] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-03T17:02:14.363744] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-03T17:02:14.363812] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-03T17:02:14.399410] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-03T17:02:14.773874] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:15.061673] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:02:15.190713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-03T17:02:15.990706] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-03T17:02:16.391904] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T17:02:16.636938] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T17:02:16.706485] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T17:02:16.790724] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-03T17:02:17.590724] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-03T17:02:18.191845] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T17:02:18.256056] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T17:02:18.390736] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-03T17:02:19.190729] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-03T17:02:19.576271] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T17:02:19.990695] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-03T17:02:20.300285] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:02:20.676182] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:02:20.790747] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-03T17:02:21.590741] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-03T17:02:22.385382] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:02:22.394584] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-03T17:02:23.190712] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-03T17:02:23.804248] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T17:02:23.842704] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T17:02:23.990747] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-03T17:02:24.264909] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:02:24.782860] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:02:24.790607] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-03T17:02:25.385604] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T17:02:25.590735] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-03T17:02:26.390701] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-03T17:02:26.690340] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:02:27.190718] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-03T17:02:27.990961] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-03T17:02:27.992634] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T17:02:28.455871] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:02:28.790725] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-03T17:02:29.295853] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T17:02:29.590696] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-03T17:02:30.167227] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:02:30.390684] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-03T17:02:30.861286] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:02:31.190716] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-03T17:02:31.647168] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:02:31.990738] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-03T17:02:32.160258] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:02:32.790725] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-03T17:02:32.936920] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:02:33.590712] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-03T17:02:34.051553] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T17:02:34.390741] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-03T17:02:34.694738] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T17:02:34.699002] [INFO ] [REMOTE ] ACN: Full fetch complete (77140 records). [2025-10-03T17:02:34.699150] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-03T17:02:35.179139] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-03T17:02:35.179323] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-03T17:02:35.180263] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-03T17:02:35.180347] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-03T17:02:35.182924] [DEBUG] [LOCAL ] ACN: Trimmed 77140 records to 54205 (keeping 200 days of data) [2025-10-03T17:02:35.248536] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-03T17:02:35.545975] [DEBUG] [LOCAL ] ACN: Primary data saved (54205 records). [2025-10-03T17:02:35.546120] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-03T17:02:35.548024] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACN took 57.3s. Estimated remaining: 4h 16m 48s. Rate: 9.1 symbols/min [2025-10-03T17:02:35.760670] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:35.776892] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:02:35.836548] [DEBUG] [LOCAL ] ACVA: Loaded 49607 existing records from primary storage. [2025-10-03T17:02:35.837023] [INFO ] [MAIN ] ACVA: Loaded 49607 existing records. [2025-10-03T17:02:35.997775] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-03T17:02:36.036077] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:36.036538] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-03T17:02:36.036605] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-03T17:02:36.037889] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-03T17:02:36.038368] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-03T17:02:36.317879] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:02:36.353609] [INFO ] [REMOTE ] ACP: Full fetch complete (47230 records). [2025-10-03T17:02:36.357117] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-03T17:02:36.576356] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:36.795776] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-03T17:02:36.873559] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-03T17:02:36.873694] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-03T17:02:36.875003] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-03T17:02:36.875072] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-03T17:02:36.876407] [DEBUG] [LOCAL ] ACP: Trimmed 47230 records to 31458 (keeping 200 days of data) [2025-10-03T17:02:37.079592] [DEBUG] [LOCAL ] ACP: Primary data saved (31458 records). [2025-10-03T17:02:37.079902] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-03T17:02:37.080059] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 40.2s. Estimated remaining: 4h 8m 30s. Rate: 9.4 symbols/min [2025-10-03T17:02:37.200956] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:02:37.244848] [INFO ] [REMOTE ] ACRE: Full fetch complete (50670 records). [2025-10-03T17:02:37.257878] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-03T17:02:37.277930] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:37.327015] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-03T17:02:37.349625] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-03T17:02:37.368038] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-03T17:02:37.394262] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-03T17:02:37.397843] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-03T17:02:37.398274] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-03T17:02:37.598214] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-03T17:02:38.212256] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-03T17:02:38.211821] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:38.212505] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-03T17:02:38.213490] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-03T17:02:38.213716] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-03T17:02:38.215469] [DEBUG] [LOCAL ] ACRE: Trimmed 50670 records to 34079 (keeping 200 days of data) [2025-10-03T17:02:38.345127] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:02:38.391746] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-03T17:02:38.469058] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T17:02:38.491707] [DEBUG] [LOCAL ] ACRE: Primary data saved (34079 records). [2025-10-03T17:02:38.491860] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-03T17:02:38.491971] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACRE took 29.1s. Estimated remaining: 4h 0m 40s. Rate: 9.7 symbols/min [2025-10-03T17:02:38.686324] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:02:38.686150] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:38.686679] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-03T17:02:38.686768] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-03T17:02:38.686965] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:02:38.686857] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-03T17:02:38.687222] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-03T17:02:38.687446] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:02:38.687716] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-03T17:02:38.687554] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-03T17:02:38.688023] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-03T17:02:38.688116] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-03T17:02:38.687926] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-03T17:02:38.688310] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-03T17:02:38.688629] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-03T17:02:38.688761] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. AD took 1.6s. Estimated remaining: 3h 51m 36s. Rate: 10.1 symbols/min [2025-10-03T17:02:38.689060] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-03T17:02:39.074148] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:39.192679] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-03T17:02:39.296048] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:39.306788] [DEBUG] [LOCAL ] ADCT: Loaded 34861 existing records from primary storage. [2025-10-03T17:02:39.307040] [INFO ] [MAIN ] ADCT: Loaded 34861 existing records. [2025-10-03T17:02:39.494958] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:39.495270] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-03T17:02:39.495330] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-03T17:02:39.497101] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-03T17:02:39.497167] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-03T17:02:39.876400] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:39.990759] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-03T17:02:40.668622] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:02:40.685033] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T17:02:40.790706] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-03T17:02:41.590777] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-03T17:02:42.390743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-03T17:02:42.419977] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:02:42.511354] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T17:02:43.190750] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-03T17:02:43.996815] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-03T17:02:44.003527] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:02:44.677959] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:02:44.774284] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:02:44.775846] [INFO ] [REMOTE ] ACV: Full fetch complete (10152 records). [2025-10-03T17:02:44.775936] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-03T17:02:44.799399] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-03T17:02:45.178879] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-03T17:02:45.178963] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-03T17:02:45.179170] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-03T17:02:45.179213] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-03T17:02:45.179864] [DEBUG] [LOCAL ] ACV: Trimmed 10152 records to 7512 (keeping 200 days of data) [2025-10-03T17:02:45.228103] [DEBUG] [LOCAL ] ACV: Primary data saved (7512 records). [2025-10-03T17:02:45.228261] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-03T17:02:45.228360] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACV took 31.3s. Estimated remaining: 3h 52m 23s. Rate: 10.1 symbols/min [2025-10-03T17:02:45.419317] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:45.477460] [DEBUG] [LOCAL ] ADM: Loaded 53777 existing records from primary storage. [2025-10-03T17:02:45.477916] [INFO ] [MAIN ] ADM: Loaded 53777 existing records. [2025-10-03T17:02:45.593215] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-03T17:02:45.683920] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:45.684283] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-03T17:02:45.684381] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-03T17:02:45.686175] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-03T17:02:45.686240] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-03T17:02:46.095125] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:46.121242] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:02:46.390716] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-03T17:02:47.077677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T17:02:47.190677] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-03T17:02:47.329086] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T17:02:47.990696] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-03T17:02:48.790683] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-03T17:02:48.874608] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T17:02:49.351253] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:02:49.590745] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-03T17:02:50.351243] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:02:50.390723] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-03T17:02:50.987333] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:02:51.190632] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-03T17:02:51.389685] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T17:02:51.990696] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-03T17:02:52.790737] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-03T17:02:52.947895] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:02:52.987436] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T17:02:53.590698] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-03T17:02:54.390772] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-03T17:02:54.619980] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:02:55.190743] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-03T17:02:55.258943] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T17:02:55.990718] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-03T17:02:56.326677] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T17:02:56.373805] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:02:56.790747] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-03T17:02:57.337189] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:02:57.590772] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-03T17:02:58.390670] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-03T17:02:58.427910] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:02:59.120023] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:02:59.190682] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-03T17:02:59.724869] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:02:59.990714] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-03T17:03:00.790711] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-03T17:03:01.524090] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-03T17:03:01.595811] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-03T17:03:01.610318] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:03:01.821238] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T17:03:02.390716] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-03T17:03:03.078783] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:03:03.190696] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-03T17:03:03.957145] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:03:03.990704] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-03T17:03:04.739572] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:03:04.790706] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-03T17:03:05.590699] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-03T17:03:05.784883] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:03:06.390727] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-03T17:03:06.570133] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:03:07.094699] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:03:07.098149] [INFO ] [REMOTE ] ADC: Full fetch complete (66312 records). [2025-10-03T17:03:07.098381] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-03T17:03:07.195942] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-03T17:03:07.548814] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-03T17:03:07.548916] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-03T17:03:07.549582] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-03T17:03:07.549630] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-03T17:03:07.551442] [DEBUG] [LOCAL ] ADC: Trimmed 66312 records to 46854 (keeping 200 days of data) [2025-10-03T17:03:07.869217] [DEBUG] [LOCAL ] ADC: Primary data saved (46854 records). [2025-10-03T17:03:07.869374] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-03T17:03:07.869477] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ADC took 29.4s. Estimated remaining: 4h 15m 33s. Rate: 9.2 symbols/min [2025-10-03T17:03:07.993766] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-03T17:03:08.078693] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:08.127101] [DEBUG] [LOCAL ] ADNT: Loaded 47495 existing records from primary storage. [2025-10-03T17:03:08.127491] [INFO ] [MAIN ] ADNT: Loaded 47495 existing records. [2025-10-03T17:03:08.334675] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:08.335292] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-03T17:03:08.335396] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-03T17:03:08.337030] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-03T17:03:08.337109] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-03T17:03:08.660883] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T17:03:08.806436] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-03T17:03:08.813306] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:08.909057] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:03:09.214224] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:03:09.590712] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-03T17:03:10.390672] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-03T17:03:10.689363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T17:03:10.964021] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:03:11.190726] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-03T17:03:11.992296] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-03T17:03:11.998852] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:03:12.790737] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-03T17:03:12.819868] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:03:12.822712] [INFO ] [REMOTE ] ACVA: Full fetch complete (70422 records). [2025-10-03T17:03:12.822883] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-03T17:03:13.286185] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-03T17:03:13.286298] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-03T17:03:13.287097] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-03T17:03:13.287166] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-03T17:03:13.288826] [DEBUG] [LOCAL ] ACVA: Trimmed 70422 records to 49976 (keeping 200 days of data) [2025-10-03T17:03:13.589953] [DEBUG] [LOCAL ] ACVA: Primary data saved (49976 records). [2025-10-03T17:03:13.590107] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-03T17:03:13.590244] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 38.0s. Estimated remaining: 4h 14m 20s. Rate: 9.2 symbols/min [2025-10-03T17:03:13.624606] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-03T17:03:13.785489] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:13.839235] [DEBUG] [LOCAL ] ADT: Loaded 53842 existing records from primary storage. [2025-10-03T17:03:13.839587] [INFO ] [MAIN ] ADT: Loaded 53842 existing records. [2025-10-03T17:03:14.040720] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:14.041237] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-03T17:03:14.041303] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-03T17:03:14.042604] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-03T17:03:14.042695] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-03T17:03:14.504018] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:14.521605] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-03T17:03:14.538231] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:03:14.549955] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T17:03:15.190704] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-03T17:03:15.219923] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:03:15.990692] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-03T17:03:16.118119] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:03:16.753138] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:03:16.790627] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-03T17:03:16.957469] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:03:16.960830] [INFO ] [REMOTE ] ADCT: Full fetch complete (51442 records). [2025-10-03T17:03:16.961014] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-03T17:03:17.410676] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-03T17:03:17.411055] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-03T17:03:17.411773] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-03T17:03:17.411849] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-03T17:03:17.413222] [DEBUG] [LOCAL ] ADCT: Trimmed 51442 records to 35209 (keeping 200 days of data) [2025-10-03T17:03:17.611908] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-03T17:03:17.644175] [DEBUG] [LOCAL ] ADCT: Primary data saved (35209 records). [2025-10-03T17:03:17.644370] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-03T17:03:17.646571] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 39.0s. Estimated remaining: 4h 11m 2s. Rate: 9.3 symbols/min [2025-10-03T17:03:17.892222] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:17.932016] [DEBUG] [LOCAL ] ADX: Loaded 27720 existing records from primary storage. [2025-10-03T17:03:17.932361] [INFO ] [MAIN ] ADX: Loaded 27720 existing records. [2025-10-03T17:03:18.157689] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:18.158116] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-03T17:03:18.158219] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-03T17:03:18.158905] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-03T17:03:18.159048] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-03T17:03:18.397419] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-03T17:03:18.535864] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:03:18.624428] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:19.190743] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-03T17:03:19.437591] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T17:03:19.841024] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:03:19.990740] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-03T17:03:20.689172] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:03:20.693339] [INFO ] [REMOTE ] ADM: Full fetch complete (77242 records). [2025-10-03T17:03:20.693526] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-03T17:03:20.796120] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-03T17:03:21.203231] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-03T17:03:21.203446] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-03T17:03:21.204341] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-03T17:03:21.204454] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-03T17:03:21.206330] [DEBUG] [LOCAL ] ADM: Trimmed 77242 records to 54167 (keeping 200 days of data) [2025-10-03T17:03:21.338547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T17:03:21.592804] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-03T17:03:21.596216] [DEBUG] [LOCAL ] ADM: Primary data saved (54167 records). [2025-10-03T17:03:21.596311] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-03T17:03:21.597617] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADM took 36.4s. Estimated remaining: 4h 7m 48s. Rate: 9.4 symbols/min [2025-10-03T17:03:21.787894] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:21.842184] [DEBUG] [LOCAL ] AEE: Loaded 50446 existing records from primary storage. [2025-10-03T17:03:21.842516] [INFO ] [MAIN ] AEE: Loaded 50446 existing records. [2025-10-03T17:03:22.063789] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:22.064039] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-03T17:03:22.064102] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-03T17:03:22.064400] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-03T17:03:22.064464] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-03T17:03:22.393279] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-03T17:03:22.484947] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:22.518167] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:03:23.191924] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-03T17:03:23.195082] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:03:23.712004] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:03:23.990704] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-03T17:03:24.790755] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-03T17:03:25.033225] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:03:25.563497] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:03:25.590627] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-03T17:03:25.809135] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:03:26.390776] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-03T17:03:26.948890] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:03:27.190727] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-03T17:03:27.812565] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:03:27.990754] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-03T17:03:28.705958] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:03:28.790746] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-03T17:03:29.580468] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:03:29.591211] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-03T17:03:30.138047] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:03:30.390722] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-03T17:03:31.018114] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:03:31.190734] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-03T17:03:31.990669] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-03T17:03:32.380248] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:03:32.790731] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-03T17:03:33.031771] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:03:33.590667] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-03T17:03:33.708812] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:03:34.111321] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:03:34.390743] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-03T17:03:35.180750] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:03:35.192369] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-03T17:03:35.990750] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-03T17:03:36.256369] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T17:03:36.479544] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:03:36.790740] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-03T17:03:37.590683] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-03T17:03:37.677696] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:03:38.357970] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:03:38.390626] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-03T17:03:39.198250] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-03T17:03:39.206469] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T17:03:39.996629] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-03T17:03:40.003427] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:03:40.159099] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T17:03:40.790768] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-03T17:03:41.590698] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-03T17:03:41.800394] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T17:03:41.966280] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:03:42.390769] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-03T17:03:43.191982] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:03:43.192077] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-03T17:03:43.703368] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T17:03:43.990754] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-03T17:03:44.371886] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T17:03:44.374695] [INFO ] [REMOTE ] ADNT: Full fetch complete (67945 records). [2025-10-03T17:03:44.374885] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-03T17:03:44.776595] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-03T17:03:44.776752] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-03T17:03:44.777800] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-03T17:03:44.777875] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-03T17:03:44.780087] [DEBUG] [LOCAL ] ADNT: Trimmed 67945 records to 47831 (keeping 200 days of data) [2025-10-03T17:03:44.836151] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-03T17:03:45.088171] [DEBUG] [LOCAL ] ADNT: Primary data saved (47831 records). [2025-10-03T17:03:45.088391] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-03T17:03:45.088526] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADNT took 37.2s. Estimated remaining: 4h 28m 33s. Rate: 8.7 symbols/min [2025-10-03T17:03:45.316880] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:45.334715] [DEBUG] [LOCAL ] AEFC: Loaded 8541 existing records from primary storage. [2025-10-03T17:03:45.335031] [INFO ] [MAIN ] AEFC: Loaded 8541 existing records. [2025-10-03T17:03:45.546455] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:45.546888] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-03T17:03:45.546965] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-03T17:03:45.547771] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-03T17:03:45.547836] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-03T17:03:45.603143] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-03T17:03:45.927253] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:45.986233] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:03:46.390677] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-03T17:03:46.748517] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:03:46.808337] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:03:47.190683] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-03T17:03:47.201165] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:03:47.990673] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-03T17:03:48.390836] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T17:03:48.790729] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-03T17:03:49.142290] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:03:49.590698] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-03T17:03:50.164835] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:03:50.167746] [INFO ] [REMOTE ] AEE: Full fetch complete (72655 records). [2025-10-03T17:03:50.167914] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-03T17:03:50.399036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-03T17:03:50.562881] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:03:50.595966] [INFO ] [REMOTE ] ADX: Full fetch complete (41964 records). [2025-10-03T17:03:50.604018] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-03T17:03:50.717034] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-03T17:03:50.738101] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-03T17:03:50.757896] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-03T17:03:50.769539] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-03T17:03:50.833530] [DEBUG] [LOCAL ] AEE: Trimmed 72655 records to 50827 (keeping 200 days of data) [2025-10-03T17:03:51.108863] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T17:03:51.196379] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-03T17:03:51.193254] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-03T17:03:51.198232] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-03T17:03:51.201574] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-03T17:03:51.201975] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-03T17:03:51.207942] [DEBUG] [LOCAL ] ADX: Trimmed 41964 records to 27928 (keeping 200 days of data) [2025-10-03T17:03:51.596969] [DEBUG] [LOCAL ] AEE: Primary data saved (50827 records). [2025-10-03T17:03:51.598076] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-03T17:03:51.599701] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. AEE took 30.0s. Estimated remaining: 4h 27m 59s. Rate: 8.7 symbols/min [2025-10-03T17:03:51.759742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:03:51.818579] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:51.821488] [DEBUG] [LOCAL ] ADX: Primary data saved (27928 records). [2025-10-03T17:03:51.821676] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-03T17:03:51.821822] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 34.2s. Estimated remaining: 4h 20m 15s. Rate: 9.0 symbols/min [2025-10-03T17:03:51.993599] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-03T17:03:52.028895] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:52.070705] [DEBUG] [LOCAL ] AEG: Loaded 49924 existing records from primary storage. [2025-10-03T17:03:52.071171] [INFO ] [MAIN ] AEG: Loaded 49924 existing records. [2025-10-03T17:03:52.291973] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:52.292449] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-03T17:03:52.307373] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-03T17:03:52.309257] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-03T17:03:52.309360] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-03T17:03:52.359591] [DEBUG] [LOCAL ] AEM: Loaded 53853 existing records from primary storage. [2025-10-03T17:03:52.395311] [INFO ] [MAIN ] AEM: Loaded 53853 existing records. [2025-10-03T17:03:52.801016] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-03T17:03:52.993461] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:52.995236] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-03T17:03:53.013955] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-03T17:03:53.022343] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:53.023215] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-03T17:03:53.023374] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-03T17:03:53.441820] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:53.590706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-03T17:03:53.648544] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T17:03:53.847467] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:03:54.390701] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-03T17:03:54.967376] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:03:55.190706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-03T17:03:55.990678] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-03T17:03:56.238385] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T17:03:56.544722] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T17:03:56.647077] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:03:56.790740] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-03T17:03:57.590740] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-03T17:03:57.992797] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T17:03:58.161477] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:03:58.390699] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-03T17:03:59.190747] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-03T17:03:59.774228] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:03:59.812581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T17:03:59.815698] [INFO ] [REMOTE ] ADT: Full fetch complete (77190 records). [2025-10-03T17:03:59.816023] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-03T17:03:59.991739] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-03T17:04:00.258286] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-03T17:04:00.258382] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-03T17:04:00.259333] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-03T17:04:00.259433] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-03T17:04:00.261452] [DEBUG] [LOCAL ] ADT: Trimmed 77190 records to 54224 (keeping 200 days of data) [2025-10-03T17:04:00.611016] [DEBUG] [LOCAL ] ADT: Primary data saved (54224 records). [2025-10-03T17:04:00.611185] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-03T17:04:00.611328] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADT took 47.0s. Estimated remaining: 4h 22m 29s. Rate: 8.9 symbols/min [2025-10-03T17:04:00.792145] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-03T17:04:00.794018] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:00.851518] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-10-03T17:04:00.851946] [INFO ] [MAIN ] AEO: Loaded 53947 existing records. [2025-10-03T17:04:01.043153] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:01.043380] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-03T17:04:01.043432] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-03T17:04:01.043884] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-03T17:04:01.043947] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-03T17:04:01.447826] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:01.515571] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:04:01.590692] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-03T17:04:02.055943] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T17:04:02.152442] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:04:02.390714] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-03T17:04:03.190757] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-03T17:04:03.792707] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:04:03.990712] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-03T17:04:04.601698] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:04:04.602774] [INFO ] [REMOTE ] AEFC: Full fetch complete (12071 records). [2025-10-03T17:04:04.602850] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-03T17:04:04.797816] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-03T17:04:05.033075] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:04:05.084031] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-03T17:04:05.084686] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-03T17:04:05.085218] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-03T17:04:05.085299] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-03T17:04:05.086702] [DEBUG] [LOCAL ] AEFC: Trimmed 12071 records to 8584 (keeping 200 days of data) [2025-10-03T17:04:05.143964] [DEBUG] [LOCAL ] AEFC: Primary data saved (8584 records). [2025-10-03T17:04:05.144182] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-03T17:04:05.144323] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEFC took 20.1s. Estimated remaining: 4h 19m 59s. Rate: 9.0 symbols/min [2025-10-03T17:04:05.328729] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:05.390915] [DEBUG] [LOCAL ] AER: Loaded 48702 existing records from primary storage. [2025-10-03T17:04:05.391397] [INFO ] [MAIN ] AER: Loaded 48702 existing records. [2025-10-03T17:04:05.577930] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:05.578261] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-03T17:04:05.578318] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-03T17:04:05.578808] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-03T17:04:05.578884] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-03T17:04:05.595869] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-03T17:04:05.994104] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:06.390786] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-03T17:04:06.711617] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:04:07.190742] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-03T17:04:07.488519] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:04:07.714120] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:04:07.990763] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-03T17:04:08.802297] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-03T17:04:08.861027] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:04:09.590690] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-03T17:04:09.756175] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T17:04:10.390794] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-03T17:04:10.644135] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:04:11.122429] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:04:11.190751] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-03T17:04:11.859731] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T17:04:11.990745] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-03T17:04:12.790780] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-03T17:04:12.902185] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:04:13.590737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-03T17:04:13.746321] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:04:14.390685] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-03T17:04:14.580911] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:04:15.190681] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-03T17:04:15.677410] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T17:04:15.990726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-03T17:04:16.212272] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T17:04:16.790676] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-03T17:04:16.999056] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:04:17.590719] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-03T17:04:17.973508] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T17:04:18.390757] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-03T17:04:18.828540] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:04:19.190707] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-03T17:04:19.490934] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:04:19.790927] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:04:19.990738] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-03T17:04:20.790712] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-03T17:04:21.315693] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:04:21.590906] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-03T17:04:21.971061] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T17:04:22.122816] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:04:22.125689] [INFO ] [REMOTE ] AEG: Full fetch complete (70337 records). [2025-10-03T17:04:22.125813] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-03T17:04:22.402892] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-03T17:04:22.552158] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-03T17:04:22.552310] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-03T17:04:22.553322] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-03T17:04:22.553403] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-03T17:04:22.555917] [DEBUG] [LOCAL ] AEG: Trimmed 70337 records to 50249 (keeping 200 days of data) [2025-10-03T17:04:22.875615] [DEBUG] [LOCAL ] AEG: Primary data saved (50249 records). [2025-10-03T17:04:22.875862] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-03T17:04:22.877377] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEG took 31.3s. Estimated remaining: 4h 31m 29s. Rate: 8.6 symbols/min [2025-10-03T17:04:23.190753] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-03T17:04:23.243749] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:04:23.990731] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-03T17:04:24.535014] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-03T17:04:24.790788] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-03T17:04:25.057829] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:04:25.346212] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:04:25.590716] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-03T17:04:26.390750] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-03T17:04:26.436937] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:04:27.190798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-03T17:04:27.282659] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:04:27.990752] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-03T17:04:28.386571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:04:28.790677] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-03T17:04:29.195133] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:04:29.590728] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-03T17:04:29.669746] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:04:30.390919] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-03T17:04:30.771366] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T17:04:31.196110] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-03T17:04:31.211154] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:04:31.493054] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T17:04:31.990749] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-03T17:04:32.790740] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-03T17:04:33.176269] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T17:04:33.590771] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-03T17:04:34.032669] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:04:34.278576] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T17:04:34.283161] [INFO ] [REMOTE ] AER: Full fetch complete (69622 records). [2025-10-03T17:04:34.283550] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-03T17:04:34.395870] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-03T17:04:34.762750] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-03T17:04:34.762882] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-03T17:04:34.763766] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-03T17:04:34.763861] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-03T17:04:34.765559] [DEBUG] [LOCAL ] AER: Trimmed 69622 records to 49029 (keeping 200 days of data) [2025-10-03T17:04:35.105515] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T17:04:35.116260] [DEBUG] [LOCAL ] AER: Primary data saved (49029 records). [2025-10-03T17:04:35.116723] [INFO ] [MAIN ] AER: Full history saved. [2025-10-03T17:04:35.118493] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AER took 30.0s. Estimated remaining: 4h 36m 44s. Rate: 8.4 symbols/min [2025-10-03T17:04:35.118724] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-10-03T17:04:35.119368] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-03T17:04:35.576199] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-03T17:04:35.576343] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-03T17:04:35.577364] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-03T17:04:35.577441] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-03T17:04:35.580168] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 54337 (keeping 200 days of data) [2025-10-03T17:04:35.947631] [DEBUG] [LOCAL ] AEO: Primary data saved (54337 records). [2025-10-03T17:04:35.947955] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-03T17:04:35.948152] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEO took 35.3s. Estimated remaining: 4h 30m 21s. Rate: 8.6 symbols/min [2025-10-03T17:04:36.003876] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T17:04:36.007149] [INFO ] [REMOTE ] AEM: Full fetch complete (77164 records). [2025-10-03T17:04:36.007324] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-03T17:04:36.442915] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-03T17:04:36.443067] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-03T17:04:36.444256] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-03T17:04:36.444365] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-03T17:04:36.447408] [DEBUG] [LOCAL ] AEM: Trimmed 77164 records to 54239 (keeping 200 days of data) [2025-10-03T17:04:36.874190] [DEBUG] [LOCAL ] AEM: Primary data saved (54239 records). [2025-10-03T17:04:36.874428] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-03T17:04:36.874576] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEM took 45.1s. Estimated remaining: 4h 24m 23s. Rate: 8.8 symbols/min [2025-10-03T17:04:37.487428] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.564159] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-03T17:04:37.658058] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.664025] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-03T17:04:37.717333] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-03T17:04:37.715665] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.717737] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-03T17:04:37.722050] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-03T17:04:37.721253] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.722203] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-03T17:04:37.882007] [DEBUG] [LOCAL ] AFB: Loaded 11470 existing records from primary storage. [2025-10-03T17:04:37.912524] [INFO ] [MAIN ] AFB: Loaded 11470 existing records. [2025-10-03T17:04:38.155223] [DEBUG] [LOCAL ] AESI: Loaded 49859 existing records from primary storage. [2025-10-03T17:04:38.283769] [INFO ] [MAIN ] AESI: Loaded 49859 existing records. [2025-10-03T17:04:38.380921] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.241301] [DEBUG] [LOCAL ] AES: Loaded 54060 existing records from primary storage. [2025-10-03T17:04:38.402499] [INFO ] [MAIN ] AES: Loaded 54060 existing records. [2025-10-03T17:04:38.436217] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.455948] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-03T17:04:38.589795] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-03T17:04:38.589712] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:38.667384] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-03T17:04:38.654001] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-03T17:04:38.952811] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:04:38.957270] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.933066] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.968130] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.968732] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-03T17:04:38.974107] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.968628] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-03T17:04:38.979514] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:04:39.000015] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-03T17:04:39.000131] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-03T17:04:38.984761] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-03T17:04:39.000177] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-03T17:04:39.071570] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-03T17:04:39.071721] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:04:39.155772] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-03T17:04:39.111779] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-03T17:04:39.210011] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-03T17:04:39.225737] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-03T17:04:39.266792] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-03T17:04:39.323407] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AEXA took 2.4s. Estimated remaining: 4h 20m 9s. Rate: 9.0 symbols/min [2025-10-03T17:04:39.877364] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:40.045376] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.094795] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-03T17:04:40.111155] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.137919] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-03T17:04:40.321626] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.337238] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-03T17:04:40.338972] [DEBUG] [LOCAL ] AFG: Loaded 32624 existing records from primary storage. [2025-10-03T17:04:40.339233] [INFO ] [MAIN ] AFG: Loaded 32624 existing records. [2025-10-03T17:04:40.520685] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:40.521029] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-03T17:04:40.521109] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-03T17:04:40.522275] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-03T17:04:40.522341] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-03T17:04:40.883477] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.883904] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-03T17:04:41.262002] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:04:41.265191] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-03T17:04:41.966108] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:04:41.973752] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-03T17:04:42.018597] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T17:04:42.032052] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-03T17:04:42.076916] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:04:42.080158] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-03T17:04:42.179250] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T17:04:42.390735] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-03T17:04:42.736556] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T17:04:43.190732] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-03T17:04:43.270511] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:04:43.304717] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:04:43.663891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T17:04:43.990745] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-03T17:04:44.117570] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:04:44.790748] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-03T17:04:45.292846] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:04:45.590736] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-03T17:04:46.390714] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-03T17:04:46.499624] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T17:04:46.722974] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T17:04:47.190734] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-03T17:04:47.525187] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T17:04:47.990729] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-03T17:04:48.018694] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T17:04:48.790747] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-03T17:04:49.410443] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:04:49.562525] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T17:04:49.590621] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-03T17:04:50.390633] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-03T17:04:50.872215] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T17:04:51.190733] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-03T17:04:51.990693] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-03T17:04:52.175772] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:04:52.188266] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T17:04:52.790765] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-03T17:04:53.405480] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:04:53.590719] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-03T17:04:54.390689] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-03T17:04:54.452451] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:04:55.190684] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-03T17:04:55.494724] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:04:55.531692] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T17:04:55.990712] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-03T17:04:56.790738] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-03T17:04:56.929695] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:04:57.181065] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T17:04:57.590732] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-03T17:04:57.623540] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T17:04:58.390742] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-03T17:04:58.895683] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:04:59.190765] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-03T17:04:59.990764] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-03T17:05:00.245195] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:05:00.300996] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:05:00.790769] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-03T17:05:01.590638] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-03T17:05:01.604793] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:05:01.773439] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T17:05:02.390724] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-03T17:05:03.190739] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-03T17:05:03.716993] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:05:03.718975] [INFO ] [REMOTE ] AFG: Full fetch complete (46042 records). [2025-10-03T17:05:03.719090] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-03T17:05:03.997027] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-03T17:05:04.056952] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-03T17:05:04.194952] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-03T17:05:04.195072] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-03T17:05:04.195729] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-03T17:05:04.195801] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-03T17:05:04.197186] [DEBUG] [LOCAL ] AFG: Trimmed 46042 records to 32819 (keeping 200 days of data) [2025-10-03T17:05:04.421820] [DEBUG] [LOCAL ] AFG: Primary data saved (32819 records). [2025-10-03T17:05:04.421987] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-03T17:05:04.422099] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFG took 25.0s. Estimated remaining: 4h 37m 2s. Rate: 8.4 symbols/min [2025-10-03T17:05:04.611331] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:04.617359] [DEBUG] [LOCAL ] AFGB: Loaded 2357 existing records from primary storage. [2025-10-03T17:05:04.617669] [INFO ] [MAIN ] AFGB: Loaded 2357 existing records. [2025-10-03T17:05:04.795201] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-03T17:05:04.830618] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:04.832088] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-03T17:05:04.832315] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-03T17:05:04.832628] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-03T17:05:04.832740] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-03T17:05:04.885224] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T17:05:04.925285] [INFO ] [REMOTE ] AFB: Full fetch complete (16785 records). [2025-10-03T17:05:04.954411] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-03T17:05:05.327927] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-03T17:05:05.619180] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-03T17:05:05.635295] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:05.718228] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-03T17:05:05.718312] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-03T17:05:05.718565] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-03T17:05:05.718606] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-03T17:05:05.719193] [DEBUG] [LOCAL ] AFB: Trimmed 16785 records to 11614 (keeping 200 days of data) [2025-10-03T17:05:05.790637] [DEBUG] [LOCAL ] AFB: Primary data saved (11614 records). [2025-10-03T17:05:05.790835] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-03T17:05:05.790932] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AFB took 28.9s. Estimated remaining: 4h 31m 42s. Rate: 8.6 symbols/min [2025-10-03T17:05:05.987698] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:05.992265] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-03T17:05:05.992464] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-03T17:05:06.199919] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:06.200198] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-03T17:05:06.200249] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-03T17:05:06.200463] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-03T17:05:06.200523] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-03T17:05:06.406692] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-03T17:05:06.628917] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:06.678823] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T17:05:07.111015] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T17:05:07.190687] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-03T17:05:07.632987] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:05:07.990689] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-03T17:05:08.466437] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:05:08.790708] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-03T17:05:09.063431] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:05:09.543344] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:05:09.590717] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-03T17:05:10.390723] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-03T17:05:11.190673] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-03T17:05:11.392077] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:05:11.711403] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T17:05:11.935270] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T17:05:11.990709] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-03T17:05:12.790704] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-03T17:05:13.253872] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T17:05:13.590730] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-03T17:05:13.745034] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T17:05:13.748368] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-03T17:05:13.748535] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-03T17:05:14.094069] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-03T17:05:14.208688] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-03T17:05:14.208794] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-03T17:05:14.210690] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-03T17:05:14.210795] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-03T17:05:14.216496] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54450 (keeping 200 days of data) [2025-10-03T17:05:14.401184] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-03T17:05:14.566315] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-10-03T17:05:14.566477] [INFO ] [MAIN ] AES: Full history saved. [2025-10-03T17:05:14.566614] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AES took 37.7s. Estimated remaining: 4h 33m 9s. Rate: 8.5 symbols/min [2025-10-03T17:05:14.759077] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:14.762867] [DEBUG] [LOCAL ] AFGD: Loaded 1827 existing records from primary storage. [2025-10-03T17:05:14.763023] [INFO ] [MAIN ] AFGD: Loaded 1827 existing records. [2025-10-03T17:05:14.888525] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T17:05:14.967033] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:14.967277] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-03T17:05:14.967326] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-03T17:05:14.967538] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-03T17:05:14.967597] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-03T17:05:15.195853] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-03T17:05:15.364553] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:15.876343] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T17:05:15.990727] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-03T17:05:16.531077] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:05:16.790696] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-03T17:05:17.305749] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T17:05:17.590689] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-03T17:05:18.331705] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T17:05:18.390723] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-03T17:05:18.827378] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T17:05:19.190737] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-03T17:05:19.635512] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T17:05:19.990740] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-03T17:05:20.491774] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T17:05:20.790743] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-03T17:05:21.209726] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T17:05:21.590738] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-03T17:05:22.109231] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:22.390719] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-03T17:05:22.960244] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T17:05:23.190725] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-03T17:05:23.623807] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:05:23.990714] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-03T17:05:24.363449] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T17:05:24.790734] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-03T17:05:25.266380] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T17:05:25.590718] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-03T17:05:25.894083] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-03T17:05:26.390739] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-03T17:05:26.805697] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T17:05:26.806505] [INFO ] [REMOTE ] AFGC: Full fetch complete (3734 records). [2025-10-03T17:05:26.806575] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-03T17:05:27.203357] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-03T17:05:27.212423] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-03T17:05:27.212517] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-03T17:05:27.212725] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-03T17:05:27.212790] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-03T17:05:27.213174] [DEBUG] [LOCAL ] AFGC: Trimmed 3734 records to 2568 (keeping 200 days of data) [2025-10-03T17:05:27.230798] [DEBUG] [LOCAL ] AFGC: Primary data saved (2568 records). [2025-10-03T17:05:27.230933] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-03T17:05:27.231022] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFGC took 21.4s. Estimated remaining: 4h 37m 52s. Rate: 8.4 symbols/min [2025-10-03T17:05:27.430712] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:27.437457] [DEBUG] [LOCAL ] AFGE: Loaded 2467 existing records from primary storage. [2025-10-03T17:05:27.437732] [INFO ] [MAIN ] AFGE: Loaded 2467 existing records. [2025-10-03T17:05:27.676601] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:27.676889] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-03T17:05:27.676945] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-03T17:05:27.677111] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-03T17:05:27.677171] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-03T17:05:27.813087] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:05:27.995952] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-03T17:05:28.103453] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:28.790714] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-03T17:05:29.385857] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T17:05:29.590695] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-03T17:05:30.030598] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T17:05:30.031423] [INFO ] [REMOTE ] AFGB: Full fetch complete (3667 records). [2025-10-03T17:05:30.031495] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-03T17:05:30.031900] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:05:30.031992] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:05:30.032077] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:05:30.032154] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-03T17:05:30.032251] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-03T17:05:30.032298] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-03T17:05:30.032602] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-03T17:05:30.032723] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 25.6s. Estimated remaining: 4h 34m 4s. Rate: 8.5 symbols/min [2025-10-03T17:05:30.224668] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:30.261304] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-03T17:05:30.334682] [DEBUG] [LOCAL ] AFL: Loaded 53536 existing records from primary storage. [2025-10-03T17:05:30.335127] [INFO ] [MAIN ] AFL: Loaded 53536 existing records. [2025-10-03T17:05:30.395863] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-03T17:05:30.541173] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:30.541409] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-03T17:05:30.541460] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-03T17:05:30.541843] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-03T17:05:30.541907] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-03T17:05:30.954832] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:31.190735] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-03T17:05:31.956415] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:05:31.963060] [INFO ] [REMOTE ] AESI: Full fetch complete (70535 records). [2025-10-03T17:05:31.963212] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-03T17:05:31.998023] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-03T17:05:32.397265] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-03T17:05:32.397365] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-03T17:05:32.398133] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-03T17:05:32.398207] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-03T17:05:32.399899] [DEBUG] [LOCAL ] AESI: Trimmed 70535 records to 50229 (keeping 200 days of data) [2025-10-03T17:05:32.738877] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T17:05:32.758672] [DEBUG] [LOCAL ] AESI: Primary data saved (50229 records). [2025-10-03T17:05:32.758918] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-03T17:05:32.759112] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AESI took 55.9s. Estimated remaining: 4h 30m 22s. Rate: 8.6 symbols/min [2025-10-03T17:05:32.801940] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-03T17:05:32.982168] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:33.018705] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:05:33.078214] [DEBUG] [LOCAL ] AG: Loaded 54032 existing records from primary storage. [2025-10-03T17:05:33.078559] [INFO ] [MAIN ] AG: Loaded 54032 existing records. [2025-10-03T17:05:33.263464] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:05:33.287713] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:33.289684] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-03T17:05:33.289776] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-03T17:05:33.291439] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-03T17:05:33.291528] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-03T17:05:33.595753] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-03T17:05:33.694073] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:34.048242] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T17:05:34.390731] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-03T17:05:34.891971] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T17:05:35.190710] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-03T17:05:35.634050] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:05:35.990690] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-03T17:05:36.790699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-03T17:05:37.277045] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T17:05:37.590695] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-03T17:05:37.696871] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:05:38.390712] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-03T17:05:39.190631] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-03T17:05:39.546083] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T17:05:39.561773] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T17:05:39.890552] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:05:39.990710] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-03T17:05:40.790723] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-03T17:05:41.313929] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:41.590638] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-03T17:05:41.687055] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T17:05:42.390690] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-03T17:05:43.190747] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-03T17:05:43.200553] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T17:05:43.909878] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-03T17:05:43.990689] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-03T17:05:44.790635] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-03T17:05:44.881371] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:05:45.296977] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-03T17:05:45.590704] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-03T17:05:45.705788] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:05:46.005341] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T17:05:46.390710] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-03T17:05:47.190682] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-03T17:05:47.664625] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:05:47.990677] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-03T17:05:48.207806] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:05:48.464575] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T17:05:48.790627] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-03T17:05:49.590719] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-03T17:05:50.390699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-03T17:05:50.470801] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:05:50.819918] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T17:05:50.820623] [INFO ] [REMOTE ] AFGD: Full fetch complete (3112 records). [2025-10-03T17:05:50.820722] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-03T17:05:51.197334] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-03T17:05:51.295447] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-03T17:05:51.295804] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-03T17:05:51.296089] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-03T17:05:51.296180] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-03T17:05:51.296895] [DEBUG] [LOCAL ] AFGD: Trimmed 3112 records to 1836 (keeping 200 days of data) [2025-10-03T17:05:51.309966] [DEBUG] [LOCAL ] AFGD: Primary data saved (1836 records). [2025-10-03T17:05:51.310052] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-03T17:05:51.310201] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 36.7s. Estimated remaining: 4h 39m 35s. Rate: 8.3 symbols/min [2025-10-03T17:05:51.511730] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:51.550956] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:05:51.602247] [DEBUG] [LOCAL ] AGCO: Loaded 42677 existing records from primary storage. [2025-10-03T17:05:51.602559] [INFO ] [MAIN ] AGCO: Loaded 42677 existing records. [2025-10-03T17:05:51.713074] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:51.798670] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:51.798951] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-03T17:05:51.799012] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-03T17:05:51.799512] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-03T17:05:51.799574] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-03T17:05:52.020366] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-03T17:05:52.251841] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:52.790695] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-03T17:05:53.590731] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-03T17:05:54.243324] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T17:05:54.390735] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-03T17:05:54.521788] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:05:55.190691] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-03T17:05:55.441668] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T17:05:55.990743] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-03T17:05:56.295209] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:05:56.495110] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T17:05:56.604504] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:05:56.790720] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-03T17:05:57.374353] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T17:05:57.590683] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-03T17:05:58.020571] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:05:58.390720] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-03T17:05:59.190740] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-03T17:05:59.556959] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T17:05:59.557754] [INFO ] [REMOTE ] AFGE: Full fetch complete (3479 records). [2025-10-03T17:05:59.557831] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-03T17:05:59.974100] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-03T17:05:59.974215] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-03T17:05:59.974667] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-03T17:05:59.983017] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-03T17:05:59.999935] [DEBUG] [LOCAL ] AFGE: Trimmed 3479 records to 2471 (keeping 200 days of data) [2025-10-03T17:05:59.996396] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-03T17:06:00.004924] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:06:00.037171] [DEBUG] [LOCAL ] AFGE: Primary data saved (2471 records). [2025-10-03T17:06:00.038152] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-03T17:06:00.038262] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 32.8s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-03T17:06:00.247013] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:00.272523] [DEBUG] [LOCAL ] AGD: Loaded 18158 existing records from primary storage. [2025-10-03T17:06:00.272870] [INFO ] [MAIN ] AGD: Loaded 18158 existing records. [2025-10-03T17:06:00.484232] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:00.484500] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-03T17:06:00.484550] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-03T17:06:00.485019] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-03T17:06:00.485081] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-03T17:06:00.796710] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-03T17:06:00.889951] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:01.590719] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-03T17:06:02.369395] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-03T17:06:02.390614] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-03T17:06:02.797466] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T17:06:02.838724] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:06:03.190695] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-03T17:06:03.990706] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-03T17:06:04.257054] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T17:06:04.551455] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T17:06:04.790729] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-03T17:06:05.590730] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-03T17:06:05.803322] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:06:06.390731] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-03T17:06:07.101626] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-03T17:06:07.114535] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:06:07.190729] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-03T17:06:07.633388] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T17:06:07.964885] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T17:06:07.990720] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-03T17:06:08.790703] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-03T17:06:09.248792] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T17:06:09.590725] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-03T17:06:10.262421] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:06:10.265427] [INFO ] [REMOTE ] AFL: Full fetch complete (76913 records). [2025-10-03T17:06:10.265557] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-03T17:06:10.395824] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-03T17:06:10.653456] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:06:10.765494] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-03T17:06:10.765593] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-03T17:06:10.766489] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-03T17:06:10.766560] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-03T17:06:10.771489] [DEBUG] [LOCAL ] AFL: Trimmed 76913 records to 53923 (keeping 200 days of data) [2025-10-03T17:06:11.129803] [DEBUG] [LOCAL ] AFL: Primary data saved (53923 records). [2025-10-03T17:06:11.129975] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-03T17:06:11.131560] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AFL took 41.1s. Estimated remaining: 4h 43m 29s. Rate: 8.2 symbols/min [2025-10-03T17:06:11.199491] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-03T17:06:11.317119] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:11.317329] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-03T17:06:11.317371] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-03T17:06:11.317512] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-03T17:06:11.317583] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-03T17:06:11.317662] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-03T17:06:11.317741] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-03T17:06:11.701961] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:11.990635] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-03T17:06:12.224212] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T17:06:12.248501] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:06:12.790707] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-03T17:06:13.590638] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-03T17:06:13.914298] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T17:06:13.945182] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:06:14.390724] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-03T17:06:15.067133] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:06:15.190706] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-03T17:06:15.417427] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T17:06:15.990708] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-03T17:06:16.790717] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-03T17:06:17.558144] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:06:17.598480] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-03T17:06:17.602128] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:06:17.654810] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-03T17:06:18.390714] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-03T17:06:19.081701] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:06:19.190635] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-03T17:06:19.405034] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T17:06:19.990718] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-03T17:06:20.790744] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-03T17:06:21.006485] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T17:06:21.172993] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T17:06:21.590677] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-03T17:06:21.616853] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T17:06:21.618157] [INFO ] [REMOTE ] AGD: Full fetch complete (25510 records). [2025-10-03T17:06:21.618240] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-03T17:06:21.618860] [FATAL] [VALIDATOR ] AGD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:06:21.618949] [FATAL] [MAIN ] AGD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:06:21.618997] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:06:21.619049] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-03T17:06:21.619111] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-03T17:06:21.619156] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-10-03T17:06:21.619459] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-10-03T17:06:21.619569] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AGD took 21.6s. Estimated remaining: 4h 45m 46s. Rate: 8.1 symbols/min [2025-10-03T17:06:21.809106] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:21.877182] [DEBUG] [LOCAL ] AGL: Loaded 52833 existing records from primary storage. [2025-10-03T17:06:21.877664] [INFO ] [MAIN ] AGL: Loaded 52833 existing records. [2025-10-03T17:06:22.077085] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:22.077316] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-03T17:06:22.077365] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-03T17:06:22.078014] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-03T17:06:22.078092] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-03T17:06:22.396106] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-03T17:06:22.546024] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:23.190698] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-03T17:06:23.445873] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:06:23.449013] [INFO ] [REMOTE ] AG: Full fetch complete (77607 records). [2025-10-03T17:06:23.449168] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-03T17:06:23.901526] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-03T17:06:23.901759] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-03T17:06:23.902600] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-03T17:06:23.902715] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-03T17:06:23.904806] [DEBUG] [LOCAL ] AG: Trimmed 77607 records to 54422 (keeping 200 days of data) [2025-10-03T17:06:23.998024] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-03T17:06:24.039631] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:06:24.287566] [DEBUG] [LOCAL ] AG: Primary data saved (54422 records). [2025-10-03T17:06:24.287748] [INFO ] [MAIN ] AG: Full history saved. [2025-10-03T17:06:24.287846] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AG took 51.5s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-03T17:06:24.478707] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:24.491821] [DEBUG] [LOCAL ] AGM: Loaded 10296 existing records from primary storage. [2025-10-03T17:06:24.492097] [INFO ] [MAIN ] AGM: Loaded 10296 existing records. [2025-10-03T17:06:24.687361] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:24.687595] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-03T17:06:24.687668] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-03T17:06:24.687961] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-03T17:06:24.688182] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-03T17:06:24.793682] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-03T17:06:25.098362] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:25.133830] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:06:25.590716] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-03T17:06:25.730991] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:06:26.183368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:06:26.187468] [INFO ] [REMOTE ] AGCO: Full fetch complete (61874 records). [2025-10-03T17:06:26.187628] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-03T17:06:26.396861] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-03T17:06:26.603007] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-03T17:06:26.603108] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-03T17:06:26.603778] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-03T17:06:26.603846] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-03T17:06:26.605346] [DEBUG] [LOCAL ] AGCO: Trimmed 61874 records to 42995 (keeping 200 days of data) [2025-10-03T17:06:26.891337] [DEBUG] [LOCAL ] AGCO: Primary data saved (42995 records). [2025-10-03T17:06:26.891499] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-03T17:06:26.892940] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGCO took 35.6s. Estimated remaining: 4h 38m 35s. Rate: 8.3 symbols/min [2025-10-03T17:06:27.087998] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:27.152039] [DEBUG] [LOCAL ] AGO: Loaded 28176 existing records from primary storage. [2025-10-03T17:06:27.154431] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T17:06:27.154987] [INFO ] [MAIN ] AGO: Loaded 28176 existing records. [2025-10-03T17:06:27.202494] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-03T17:06:27.372941] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:27.373177] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-03T17:06:27.373227] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-03T17:06:27.373872] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-03T17:06:27.373936] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-03T17:06:27.762476] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:27.990700] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-03T17:06:28.098109] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T17:06:28.102546] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:06:28.790664] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-03T17:06:28.880107] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:06:29.337245] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-03T17:06:29.590685] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-03T17:06:30.305871] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:06:30.390708] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-03T17:06:31.083722] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T17:06:31.190693] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-03T17:06:31.990697] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-03T17:06:32.785132] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T17:06:32.795603] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-03T17:06:32.837206] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T17:06:33.458598] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T17:06:33.590686] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-03T17:06:34.369269] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:06:34.390639] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-03T17:06:35.146795] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:06:35.190695] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-03T17:06:35.996605] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-03T17:06:35.997530] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:06:36.790715] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-03T17:06:37.573034] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:06:37.590682] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-03T17:06:37.985637] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:06:38.390699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-03T17:06:38.657156] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:06:39.190707] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-03T17:06:39.990638] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-03T17:06:40.477718] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:06:40.749712] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:06:40.790639] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-03T17:06:40.974559] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:06:41.590708] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-03T17:06:42.037219] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:06:42.390689] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-03T17:06:43.197721] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-03T17:06:43.223004] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T17:06:43.990694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-03T17:06:44.121074] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:06:44.276444] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:06:44.277831] [INFO ] [REMOTE ] AGM: Full fetch complete (12887 records). [2025-10-03T17:06:44.277924] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-03T17:06:44.702823] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-03T17:06:44.702933] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-03T17:06:44.703203] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-03T17:06:44.703254] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-03T17:06:44.703988] [DEBUG] [LOCAL ] AGM: Trimmed 12887 records to 10383 (keeping 200 days of data) [2025-10-03T17:06:44.778582] [DEBUG] [LOCAL ] AGM: Primary data saved (10383 records). [2025-10-03T17:06:44.778758] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-03T17:06:44.778877] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 20.5s. Estimated remaining: 4h 46m 5s. Rate: 8.1 symbols/min [2025-10-03T17:06:44.795820] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-03T17:06:44.991282] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:45.027611] [DEBUG] [LOCAL ] AGRO: Loaded 33687 existing records from primary storage. [2025-10-03T17:06:45.027958] [INFO ] [MAIN ] AGRO: Loaded 33687 existing records. [2025-10-03T17:06:45.238540] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:45.239093] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-03T17:06:45.239224] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-03T17:06:45.239771] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-03T17:06:45.239860] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-03T17:06:45.495022] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:06:45.597037] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-03T17:06:45.823577] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:46.390692] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-03T17:06:46.522759] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:06:46.922577] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T17:06:47.190707] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-03T17:06:47.838783] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:06:47.990717] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-03T17:06:48.790703] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-03T17:06:49.130929] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:06:49.590699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-03T17:06:49.874368] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T17:06:49.935883] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:06:50.390690] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-03T17:06:51.190682] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-03T17:06:51.459057] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:06:51.541751] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T17:06:51.990718] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-03T17:06:52.795960] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-03T17:06:52.817476] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:06:53.581433] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:06:53.590610] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-03T17:06:54.164129] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:06:54.325027] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:06:54.390738] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-03T17:06:55.190726] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-03T17:06:55.227500] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:06:55.229711] [INFO ] [REMOTE ] AGO: Full fetch complete (39418 records). [2025-10-03T17:06:55.229851] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-03T17:06:55.650981] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-03T17:06:55.651091] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-03T17:06:55.651613] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-03T17:06:55.651705] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-03T17:06:55.653120] [DEBUG] [LOCAL ] AGO: Trimmed 39418 records to 28380 (keeping 200 days of data) [2025-10-03T17:06:55.839034] [DEBUG] [LOCAL ] AGO: Primary data saved (28380 records). [2025-10-03T17:06:55.839183] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-03T17:06:55.839283] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGO took 28.9s. Estimated remaining: 4h 48m 32s. Rate: 8.0 symbols/min [2025-10-03T17:06:55.996187] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-03T17:06:56.024952] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:56.065409] [DEBUG] [LOCAL ] AGX: Loaded 33402 existing records from primary storage. [2025-10-03T17:06:56.065744] [INFO ] [MAIN ] AGX: Loaded 33402 existing records. [2025-10-03T17:06:56.265286] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:56.265527] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-03T17:06:56.265591] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-03T17:06:56.266094] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-03T17:06:56.266157] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-03T17:06:56.658919] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:56.781010] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:06:56.791967] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-03T17:06:57.590693] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-03T17:06:57.800749] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:06:58.267472] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:06:58.390714] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-03T17:06:59.047583] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T17:06:59.050534] [INFO ] [REMOTE ] AGL: Full fetch complete (75547 records). [2025-10-03T17:06:59.050709] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-03T17:06:59.195873] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-03T17:06:59.526706] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-03T17:06:59.526919] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-03T17:06:59.527789] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-03T17:06:59.527880] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-03T17:06:59.529721] [DEBUG] [LOCAL ] AGL: Trimmed 75547 records to 53221 (keeping 200 days of data) [2025-10-03T17:06:59.844685] [DEBUG] [LOCAL ] AGL: Primary data saved (53221 records). [2025-10-03T17:06:59.844857] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-03T17:06:59.845001] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGL took 38.2s. Estimated remaining: 4h 46m 1s. Rate: 8.1 symbols/min [2025-10-03T17:07:00.004719] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-03T17:07:00.085197] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:00.131023] [DEBUG] [LOCAL ] AHH: Loaded 41379 existing records from primary storage. [2025-10-03T17:07:00.131365] [INFO ] [MAIN ] AHH: Loaded 41379 existing records. [2025-10-03T17:07:00.262490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T17:07:00.306029] [INFO ] [REMOTE ] AGI: Full fetch complete (76837 records). [2025-10-03T17:07:00.323137] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-03T17:07:00.348718] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:00.426246] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-03T17:07:00.438549] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-03T17:07:00.470832] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-03T17:07:00.481387] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-03T17:07:01.213693] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-03T17:07:01.253702] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-03T17:07:01.259276] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-03T17:07:01.283305] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:01.283587] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-03T17:07:01.284240] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-03T17:07:01.295514] [DEBUG] [LOCAL ] AGI: Trimmed 76837 records to 54194 (keeping 200 days of data) [2025-10-03T17:07:01.313440] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T17:07:01.592956] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-03T17:07:01.693615] [DEBUG] [LOCAL ] AGI: Primary data saved (54194 records). [2025-10-03T17:07:01.693868] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-03T17:07:01.694006] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGI took 50.6s. Estimated remaining: 4h 42m 7s. Rate: 8.2 symbols/min [2025-10-03T17:07:01.909018] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:01.909254] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-03T17:07:01.909400] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-03T17:07:01.909599] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-03T17:07:01.909702] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-03T17:07:01.909777] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-03T17:07:01.909841] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-03T17:07:02.287506] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-03T17:07:02.357872] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:02.390636] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-03T17:07:02.563916] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:07:02.564327] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-03T17:07:02.564428] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:02.564489] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-03T17:07:02.564576] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:02.564678] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-03T17:07:02.564795] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-03T17:07:02.564866] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-03T17:07:02.564935] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-03T17:07:02.565018] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AHL took 0.9s. Estimated remaining: 4h 37m 43s. Rate: 8.3 symbols/min [2025-10-03T17:07:02.752866] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:02.813209] [DEBUG] [LOCAL ] AHR: Loaded 49515 existing records from primary storage. [2025-10-03T17:07:02.813604] [INFO ] [MAIN ] AHR: Loaded 49515 existing records. [2025-10-03T17:07:03.013438] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:03.013676] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-03T17:07:03.013755] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-03T17:07:03.014341] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-03T17:07:03.014402] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-03T17:07:03.190801] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-03T17:07:03.416719] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:03.471705] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:07:03.624533] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T17:07:03.990717] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-03T17:07:04.412388] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:07:04.790765] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-03T17:07:05.386102] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:07:05.590701] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-03T17:07:06.317494] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:07:06.390726] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-03T17:07:06.701999] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:07:07.190746] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-03T17:07:07.413950] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:07:07.990700] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-03T17:07:08.501488] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T17:07:08.790700] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-03T17:07:08.946577] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T17:07:09.590692] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-03T17:07:10.390673] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-03T17:07:10.414852] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:07:10.709297] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:07:11.190765] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-03T17:07:11.910053] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:07:11.990714] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-03T17:07:12.368805] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:07:12.790708] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-03T17:07:13.550717] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T17:07:13.590714] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-03T17:07:14.316840] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:07:14.390681] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-03T17:07:14.743702] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T17:07:15.190720] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-03T17:07:15.990667] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-03T17:07:16.066596] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:07:16.671037] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:07:16.790688] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-03T17:07:17.590745] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-03T17:07:17.898495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:07:18.368910] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T17:07:18.390632] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-03T17:07:18.536750] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:07:19.190737] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-03T17:07:19.903164] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:07:19.990744] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-03T17:07:20.790668] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-03T17:07:20.825532] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:07:21.322948] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:07:21.590672] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-03T17:07:21.923626] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:07:21.925592] [INFO ] [REMOTE ] AGRO: Full fetch complete (49605 records). [2025-10-03T17:07:21.925747] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-03T17:07:22.335738] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-03T17:07:22.335833] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-03T17:07:22.336379] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-03T17:07:22.336424] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-03T17:07:22.337622] [DEBUG] [LOCAL ] AGRO: Trimmed 49605 records to 33939 (keeping 200 days of data) [2025-10-03T17:07:22.394709] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-03T17:07:22.550395] [DEBUG] [LOCAL ] AGRO: Primary data saved (33939 records). [2025-10-03T17:07:22.550535] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-03T17:07:22.551289] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AGRO took 37.8s. Estimated remaining: 4h 45m 56s. Rate: 8.1 symbols/min [2025-10-03T17:07:22.750479] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:22.775406] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:07:22.786882] [DEBUG] [LOCAL ] AHT: Loaded 6188 existing records from primary storage. [2025-10-03T17:07:22.787161] [INFO ] [MAIN ] AHT: Loaded 6188 existing records. [2025-10-03T17:07:22.977881] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:22.978148] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-03T17:07:22.978197] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-03T17:07:22.978418] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-03T17:07:22.978477] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-03T17:07:23.195911] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-03T17:07:23.368426] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:23.916370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T17:07:23.990719] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-03T17:07:24.534473] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:07:24.536343] [INFO ] [REMOTE ] AGX: Full fetch complete (48806 records). [2025-10-03T17:07:24.536440] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-03T17:07:24.798606] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-03T17:07:24.809784] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:07:24.970118] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-03T17:07:24.970247] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-03T17:07:24.970906] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-03T17:07:24.970984] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-03T17:07:24.972290] [DEBUG] [LOCAL ] AGX: Trimmed 48806 records to 33569 (keeping 200 days of data) [2025-10-03T17:07:25.197342] [DEBUG] [LOCAL ] AGX: Primary data saved (33569 records). [2025-10-03T17:07:25.197501] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-03T17:07:25.198936] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AGX took 29.4s. Estimated remaining: 4h 42m 45s. Rate: 8.2 symbols/min [2025-10-03T17:07:25.380218] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:25.438419] [DEBUG] [LOCAL ] AI: Loaded 54140 existing records from primary storage. [2025-10-03T17:07:25.438878] [INFO ] [MAIN ] AI: Loaded 54140 existing records. [2025-10-03T17:07:25.598385] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-03T17:07:25.631341] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:25.631765] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-03T17:07:25.631820] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-03T17:07:25.632181] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-03T17:07:25.632241] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-03T17:07:26.022543] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:26.277926] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T17:07:26.330369] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T17:07:26.390701] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-03T17:07:27.076106] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:07:27.190714] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-03T17:07:27.990693] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-03T17:07:28.748257] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T17:07:28.790740] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-03T17:07:29.566807] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:07:29.599231] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-03T17:07:29.606018] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T17:07:30.390718] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-03T17:07:31.190729] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-03T17:07:31.868820] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:07:31.882110] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:07:31.990713] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-03T17:07:32.221214] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-03T17:07:32.790698] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-03T17:07:33.590689] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-03T17:07:33.687776] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:07:33.842566] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:07:34.302067] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T17:07:34.390703] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-03T17:07:35.190705] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-03T17:07:35.522805] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:07:35.525018] [INFO ] [REMOTE ] AHH: Full fetch complete (60168 records). [2025-10-03T17:07:35.525140] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-03T17:07:35.940374] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-03T17:07:35.940462] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-03T17:07:35.941108] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-03T17:07:35.941175] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-03T17:07:35.942426] [DEBUG] [LOCAL ] AHH: Trimmed 60168 records to 41619 (keeping 200 days of data) [2025-10-03T17:07:35.995632] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-03T17:07:36.193022] [DEBUG] [LOCAL ] AHH: Primary data saved (41619 records). [2025-10-03T17:07:36.193153] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-03T17:07:36.193239] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AHH took 36.3s. Estimated remaining: 4h 44m 56s. Rate: 8.1 symbols/min [2025-10-03T17:07:36.375286] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:36.429906] [DEBUG] [LOCAL ] AIG: Loaded 53862 existing records from primary storage. [2025-10-03T17:07:36.430294] [INFO ] [MAIN ] AIG: Loaded 53862 existing records. [2025-10-03T17:07:36.638287] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:36.638554] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-03T17:07:36.638624] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-03T17:07:36.639217] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-03T17:07:36.639277] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-03T17:07:36.766037] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T17:07:36.802325] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-03T17:07:37.040603] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:37.571591] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T17:07:37.595789] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-03T17:07:37.613516] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T17:07:38.390709] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-03T17:07:39.200052] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-03T17:07:39.205986] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:07:39.990692] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-03T17:07:40.467808] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T17:07:40.790711] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-03T17:07:40.857800] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:07:41.374306] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:07:41.590698] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-03T17:07:42.326855] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T17:07:42.390675] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-03T17:07:42.966612] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T17:07:43.190689] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-03T17:07:43.632325] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T17:07:43.990706] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-03T17:07:44.544301] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T17:07:44.648171] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:07:44.790713] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-03T17:07:45.590684] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-03T17:07:46.143487] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:07:46.146193] [INFO ] [REMOTE ] AHR: Full fetch complete (70795 records). [2025-10-03T17:07:46.146323] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-03T17:07:46.395876] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-03T17:07:46.578028] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-03T17:07:46.578141] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-03T17:07:46.578930] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-03T17:07:46.579018] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-03T17:07:46.580781] [DEBUG] [LOCAL ] AHR: Trimmed 70795 records to 49849 (keeping 200 days of data) [2025-10-03T17:07:46.905268] [DEBUG] [LOCAL ] AHR: Primary data saved (49849 records). [2025-10-03T17:07:46.905417] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-03T17:07:46.905526] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHR took 44.3s. Estimated remaining: 4h 46m 52s. Rate: 8.0 symbols/min [2025-10-03T17:07:47.089696] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:47.089944] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-03T17:07:47.089992] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-03T17:07:47.090107] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-03T17:07:47.090151] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-03T17:07:47.090195] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-03T17:07:47.090233] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-03T17:07:47.194311] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-03T17:07:47.182169] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:07:47.209609] [INFO ] [REMOTE ] AHT: Full fetch complete (9310 records). [2025-10-03T17:07:47.230576] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-03T17:07:47.765624] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:47.927291] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-03T17:07:47.927458] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-03T17:07:47.927816] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-03T17:07:47.927895] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-03T17:07:47.928778] [DEBUG] [LOCAL ] AHT: Trimmed 9310 records to 6250 (keeping 200 days of data) [2025-10-03T17:07:47.991192] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-03T17:07:47.998940] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-03T17:07:48.019700] [DEBUG] [LOCAL ] AHT: Primary data saved (6250 records). [2025-10-03T17:07:48.020414] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-03T17:07:48.020628] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AHT took 25.5s. Estimated remaining: 4h 42m 52s. Rate: 8.2 symbols/min [2025-10-03T17:07:48.186023] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:07:48.210005] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-03T17:07:48.212630] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:48.212757] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:48.212985] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-03T17:07:48.213862] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:48.213956] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-03T17:07:48.214040] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-03T17:07:48.214083] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-03T17:07:48.214126] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-03T17:07:48.214186] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AII took 1.3s. Estimated remaining: 4h 38m 26s. Rate: 8.3 symbols/min [2025-10-03T17:07:48.437500] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:48.438771] [DEBUG] [LOCAL ] AIN: Loaded 24750 existing records from primary storage. [2025-10-03T17:07:48.439632] [INFO ] [MAIN ] AIN: Loaded 24750 existing records. [2025-10-03T17:07:48.568909] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-03T17:07:48.569497] [INFO ] [MAIN ] AIO: Loaded 13422 existing records. [2025-10-03T17:07:48.730624] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:48.744456] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-03T17:07:48.744681] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-03T17:07:48.775636] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-03T17:07:48.775883] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-03T17:07:48.810515] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-03T17:07:48.965709] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:48.994513] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-03T17:07:48.999855] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-03T17:07:49.033570] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-03T17:07:49.067907] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-03T17:07:49.433032] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-03T17:07:49.551168] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:49.595765] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-03T17:07:49.724337] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:50.390624] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-03T17:07:50.465516] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:07:51.184932] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-03T17:07:51.196404] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-03T17:07:51.602839] [DEBUG] [REMOTE ] AIO: Error fetching primary data for 2024-12: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-03T17:07:51.603009] [WARN ] [REMOTE ] AIO: No data returned for month 2024-12 [2025-10-03T17:07:51.603086] [FATAL] [REMOTE ] AIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:51.603132] [FATAL] [MAIN ] AIO: Failed to fetch primary data. [2025-10-03T17:07:51.603195] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:51.603276] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-03T17:07:51.603344] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-03T17:07:51.603385] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-10-03T17:07:51.603748] [DEBUG] [LOCAL ] AIO: Deleted derivative data file. [2025-10-03T17:07:51.603824] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AIO took 3.4s. Estimated remaining: 4h 36m 2s. Rate: 8.4 symbols/min [2025-10-03T17:07:51.794599] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:51.823426] [DEBUG] [LOCAL ] AIR: Loaded 28562 existing records from primary storage. [2025-10-03T17:07:51.823871] [INFO ] [MAIN ] AIR: Loaded 28562 existing records. [2025-10-03T17:07:51.991293] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-03T17:07:52.026035] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:52.027609] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-03T17:07:52.027774] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-03T17:07:52.029359] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-03T17:07:52.029429] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-03T17:07:52.483221] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:52.485833] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T17:07:52.790704] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-03T17:07:53.094189] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T17:07:53.590694] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-03T17:07:54.390709] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-03T17:07:54.639228] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:07:55.135232] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-03T17:07:55.190748] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-03T17:07:55.990722] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-03T17:07:56.109281] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:07:56.242616] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:07:56.790728] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-03T17:07:57.590633] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-03T17:07:57.889916] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T17:07:58.251725] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-03T17:07:58.390708] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-03T17:07:59.190706] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-03T17:07:59.519598] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:07:59.990743] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-03T17:08:00.015627] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T17:08:00.790742] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-03T17:08:01.568379] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-10-03T17:08:01.599380] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:08:01.599504] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-03T17:08:02.390736] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-03T17:08:03.190715] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-03T17:08:03.293451] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:08:03.419860] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:08:03.479870] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-03T17:08:03.990693] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-03T17:08:04.790675] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-03T17:08:05.174976] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:08:05.590695] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-03T17:08:05.703893] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-03T17:08:06.390745] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-03T17:08:06.491568] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:08:06.755343] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T17:08:07.190729] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-03T17:08:07.528375] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:08:07.990730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-03T17:08:08.776238] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:08:08.790627] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-03T17:08:09.590679] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-03T17:08:09.991426] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T17:08:09.994198] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-03T17:08:09.994385] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-03T17:08:10.404601] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-03T17:08:10.434510] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-03T17:08:10.434619] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-03T17:08:10.435570] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-03T17:08:10.435726] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-03T17:08:10.437826] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54530 (keeping 200 days of data) [2025-10-03T17:08:10.562149] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T17:08:10.826625] [DEBUG] [LOCAL ] AI: Primary data saved (54530 records). [2025-10-03T17:08:10.826851] [INFO ] [MAIN ] AI: Full history saved. [2025-10-03T17:08:10.828276] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AI took 45.6s. Estimated remaining: 4h 42m 56s. Rate: 8.1 symbols/min [2025-10-03T17:08:11.039623] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:11.041682] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:08:11.077056] [DEBUG] [LOCAL ] AIT: Loaded 27668 existing records from primary storage. [2025-10-03T17:08:11.077339] [INFO ] [MAIN ] AIT: Loaded 27668 existing records. [2025-10-03T17:08:11.195849] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-03T17:08:11.274555] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:11.274934] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-03T17:08:11.274999] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-03T17:08:11.275978] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-03T17:08:11.276040] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-03T17:08:11.770546] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:08:11.776866] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:11.990739] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-03T17:08:12.280636] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T17:08:12.790666] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-03T17:08:12.989853] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:08:13.590677] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-03T17:08:13.814540] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:08:14.390712] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-03T17:08:14.682325] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:08:14.684092] [INFO ] [REMOTE ] AIN: Full fetch complete (33530 records). [2025-10-03T17:08:14.684177] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-03T17:08:15.094179] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-03T17:08:15.094310] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-03T17:08:15.094908] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-03T17:08:15.095026] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-03T17:08:15.096167] [DEBUG] [LOCAL ] AIN: Trimmed 33530 records to 24987 (keeping 200 days of data) [2025-10-03T17:08:15.194073] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-03T17:08:15.267633] [DEBUG] [LOCAL ] AIN: Primary data saved (24987 records). [2025-10-03T17:08:15.267899] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-03T17:08:15.273229] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIN took 27.3s. Estimated remaining: 4h 41m 8s. Rate: 8.2 symbols/min [2025-10-03T17:08:15.330189] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:08:15.490370] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:15.490578] [DEBUG] [LOCAL ] AIV: No existing data file found in primary storage. [2025-10-03T17:08:15.490618] [WARN ] [MAIN ] AIV: No existing data found, performing full refresh instead. [2025-10-03T17:08:15.490804] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-03T17:08:15.490858] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-03T17:08:15.490915] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-10-03T17:08:15.490952] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-03T17:08:15.920099] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:15.990680] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-03T17:08:16.416153] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T17:08:16.790730] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-03T17:08:17.428074] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:08:17.590683] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-03T17:08:17.851579] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T17:08:18.390695] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-03T17:08:18.920106] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:08:18.922347] [INFO ] [REMOTE ] AIG: Full fetch complete (76991 records). [2025-10-03T17:08:18.922462] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-03T17:08:18.925883] [FATAL] [VALIDATOR ] AIG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:08:18.925973] [FATAL] [MAIN ] AIG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:08:18.926018] [WARN ] [MAIN ] AIG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:08:18.926116] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-03T17:08:18.926206] [DEBUG] [LOCAL ] AIG: No primary data file found to delete. [2025-10-03T17:08:18.926290] [INFO ] [LOCAL ] AIG: Starting deletion of derivative data. [2025-10-03T17:08:18.926526] [DEBUG] [LOCAL ] AIG: Deleted derivative data file. [2025-10-03T17:08:18.926621] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIG took 42.7s. Estimated remaining: 4h 38m 56s. Rate: 8.3 symbols/min [2025-10-03T17:08:19.119393] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:19.157426] [DEBUG] [LOCAL ] AIZ: Loaded 30062 existing records from primary storage. [2025-10-03T17:08:19.157799] [INFO ] [MAIN ] AIZ: Loaded 30062 existing records. [2025-10-03T17:08:19.196155] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-03T17:08:19.362011] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:19.362242] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-03T17:08:19.362305] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-03T17:08:19.362763] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-03T17:08:19.362824] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-03T17:08:19.781453] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:19.796161] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:08:19.990692] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-03T17:08:20.275201] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:08:20.790746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-03T17:08:21.461500] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:08:21.590741] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-03T17:08:22.175448] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:08:22.390719] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-03T17:08:22.789560] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:08:23.190735] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-03T17:08:23.754237] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:08:23.990707] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-03T17:08:24.627588] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:08:24.790736] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-03T17:08:25.057090] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:08:25.590688] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-03T17:08:25.893090] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:08:26.390738] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-03T17:08:26.729515] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:08:26.732137] [INFO ] [REMOTE ] AIR: Full fetch complete (38938 records). [2025-10-03T17:08:26.732260] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-03T17:08:26.732969] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:08:26.733069] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:08:26.733115] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:08:26.733157] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-03T17:08:26.733226] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-03T17:08:26.733266] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-03T17:08:26.733465] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-03T17:08:26.733604] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIR took 35.1s. Estimated remaining: 4h 39m 7s. Rate: 8.2 symbols/min [2025-10-03T17:08:26.935364] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:26.942558] [DEBUG] [LOCAL ] AIZN: Loaded 4082 existing records from primary storage. [2025-10-03T17:08:26.942784] [INFO ] [MAIN ] AIZN: Loaded 4082 existing records. [2025-10-03T17:08:27.132457] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:27.132707] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-03T17:08:27.132766] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-03T17:08:27.133026] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-03T17:08:27.133154] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-03T17:08:27.198500] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-03T17:08:27.537019] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:27.556707] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:08:27.990685] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-03T17:08:28.605428] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:08:28.790706] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-03T17:08:29.271728] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T17:08:29.461627] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:08:29.590699] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-03T17:08:30.390695] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-03T17:08:30.673874] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T17:08:31.009794] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:08:31.190689] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-03T17:08:31.990685] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-03T17:08:32.506190] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:08:32.790707] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-03T17:08:33.522511] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:08:33.590707] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-03T17:08:34.135964] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:08:34.390677] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-03T17:08:34.822457] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T17:08:35.190637] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-03T17:08:35.333907] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T17:08:35.627864] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T17:08:35.990686] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-03T17:08:36.565930] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T17:08:36.790681] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-03T17:08:37.374185] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T17:08:37.590859] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-03T17:08:38.390684] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-03T17:08:39.052493] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:08:39.190636] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-03T17:08:39.358807] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:08:39.820167] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T17:08:39.990702] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-03T17:08:40.585569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T17:08:40.790716] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-03T17:08:41.590700] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-03T17:08:42.107364] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:08:42.390630] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-03T17:08:42.499714] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:08:42.950422] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T17:08:43.190705] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-03T17:08:43.990730] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-03T17:08:44.318053] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:08:44.320107] [INFO ] [REMOTE ] AIZ: Full fetch complete (42937 records). [2025-10-03T17:08:44.320232] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-03T17:08:44.781274] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-03T17:08:44.781422] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-03T17:08:44.782411] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-03T17:08:44.782513] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-03T17:08:44.793858] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-03T17:08:44.798590] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:08:44.804811] [DEBUG] [LOCAL ] AIZ: Trimmed 42937 records to 30255 (keeping 200 days of data) [2025-10-03T17:08:45.005821] [DEBUG] [LOCAL ] AIZ: Primary data saved (30255 records). [2025-10-03T17:08:45.005995] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-03T17:08:45.006092] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIZ took 26.1s. Estimated remaining: 4h 45m 1s. Rate: 8.1 symbols/min [2025-10-03T17:08:45.189766] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:45.195770] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T17:08:45.243908] [DEBUG] [LOCAL ] AJG: Loaded 47189 existing records from primary storage. [2025-10-03T17:08:45.244329] [INFO ] [MAIN ] AJG: Loaded 47189 existing records. [2025-10-03T17:08:45.430849] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:45.431120] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-03T17:08:45.431172] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-03T17:08:45.432803] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-03T17:08:45.432868] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-03T17:08:45.601087] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-03T17:08:45.825795] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:46.243674] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T17:08:46.390742] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-03T17:08:47.190727] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-03T17:08:47.490855] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T17:08:47.494151] [INFO ] [REMOTE ] AIT: Full fetch complete (39365 records). [2025-10-03T17:08:47.494448] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-03T17:08:47.997331] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-03T17:08:47.996125] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-03T17:08:47.997572] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-03T17:08:47.998497] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-03T17:08:47.999825] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-03T17:08:48.002083] [DEBUG] [LOCAL ] AIT: Trimmed 39365 records to 27793 (keeping 200 days of data) [2025-10-03T17:08:48.253761] [DEBUG] [LOCAL ] AIT: Primary data saved (27793 records). [2025-10-03T17:08:48.253926] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-03T17:08:48.254074] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIT took 37.4s. Estimated remaining: 4h 42m 38s. Rate: 8.1 symbols/min [2025-10-03T17:08:48.495169] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:48.496632] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-03T17:08:48.496729] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-03T17:08:48.496852] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-03T17:08:48.496898] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-03T17:08:48.496943] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-03T17:08:48.496979] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-03T17:08:48.591303] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T17:08:48.622399] [INFO ] [REMOTE ] AIZN: Full fetch complete (5918 records). [2025-10-03T17:08:48.635809] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-03T17:08:48.797896] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-03T17:08:49.313940] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:49.385488] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-03T17:08:49.385621] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-03T17:08:49.386022] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-03T17:08:49.386105] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-03T17:08:49.386811] [DEBUG] [LOCAL ] AIZN: Trimmed 5918 records to 4108 (keeping 200 days of data) [2025-10-03T17:08:49.444787] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T17:08:49.458961] [DEBUG] [LOCAL ] AIZN: Primary data saved (4108 records). [2025-10-03T17:08:49.459124] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-03T17:08:49.459221] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIZN took 22.7s. Estimated remaining: 4h 39m 13s. Rate: 8.2 symbols/min [2025-10-03T17:08:49.595794] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-03T17:08:49.646061] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:49.693615] [DEBUG] [LOCAL ] AKR: Loaded 46065 existing records from primary storage. [2025-10-03T17:08:49.693999] [INFO ] [MAIN ] AKR: Loaded 46065 existing records. [2025-10-03T17:08:49.880057] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:49.880355] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-03T17:08:49.880418] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-03T17:08:49.884172] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-03T17:08:49.884249] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-03T17:08:50.280780] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:50.309787] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:08:50.390718] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-03T17:08:51.190732] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-03T17:08:51.382008] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T17:08:51.563606] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:08:51.990695] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-03T17:08:52.790689] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-03T17:08:52.963142] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:08:53.065944] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T17:08:53.258761] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T17:08:53.590681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-03T17:08:54.039174] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:08:54.390752] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-03T17:08:55.190729] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-03T17:08:55.840254] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:08:55.990705] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-03T17:08:56.245167] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T17:08:56.461172] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T17:08:56.790705] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-03T17:08:57.590674] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-03T17:08:58.031239] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:08:58.390729] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-03T17:08:58.456388] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:08:59.190734] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-03T17:08:59.853258] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:08:59.990724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-03T17:09:00.485774] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-03T17:09:00.517339] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T17:09:00.790704] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-03T17:09:01.590681] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-03T17:09:02.390730] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-03T17:09:02.601045] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:09:03.190670] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-03T17:09:03.346189] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:09:03.990719] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-03T17:09:04.234428] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:09:04.437501] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:09:04.440258] [INFO ] [REMOTE ] AIV: Full fetch complete (59929 records). [2025-10-03T17:09:04.440397] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-03T17:09:04.792406] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-03T17:09:04.895631] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-03T17:09:04.895763] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-03T17:09:04.896482] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-03T17:09:04.896546] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-03T17:09:04.898325] [DEBUG] [LOCAL ] AIV: Trimmed 59929 records to 41125 (keeping 200 days of data) [2025-10-03T17:09:05.140611] [DEBUG] [LOCAL ] AIV: Primary data saved (41125 records). [2025-10-03T17:09:05.140773] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-03T17:09:05.140879] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIV took 49.9s. Estimated remaining: 4h 43m 30s. Rate: 8.1 symbols/min [2025-10-03T17:09:05.344144] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:05.406354] [DEBUG] [LOCAL ] AL: Loaded 44640 existing records from primary storage. [2025-10-03T17:09:05.406944] [INFO ] [MAIN ] AL: Loaded 44640 existing records. [2025-10-03T17:09:05.593334] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-03T17:09:05.643560] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:05.649267] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-03T17:09:05.662428] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-03T17:09:05.666132] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-03T17:09:05.666237] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-03T17:09:05.667701] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T17:09:06.070737] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:06.367386] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T17:09:06.390628] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-03T17:09:06.506324] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:09:06.870739] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T17:09:07.190694] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-03T17:09:07.990695] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-03T17:09:08.309723] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-03T17:09:08.796440] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-03T17:09:08.799564] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:09:09.132680] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-03T17:09:09.590680] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-03T17:09:09.931144] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T17:09:10.390732] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-03T17:09:10.802257] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T17:09:10.802994] [INFO ] [REMOTE ] AKA: Full fetch complete (2406 records). [2025-10-03T17:09:10.803071] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-03T17:09:11.000674] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T17:09:11.000943] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:09:11.001010] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:09:11.001055] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-03T17:09:11.001173] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-03T17:09:11.001236] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-03T17:09:11.001285] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-03T17:09:11.001387] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AKA took 22.7s. Estimated remaining: 4h 42m 35s. Rate: 8.1 symbols/min [2025-10-03T17:09:11.179348] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:11.190719] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-03T17:09:11.243610] [DEBUG] [LOCAL ] ALB: Loaded 53622 existing records from primary storage. [2025-10-03T17:09:11.244003] [INFO ] [MAIN ] ALB: Loaded 53622 existing records. [2025-10-03T17:09:11.438755] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:11.438990] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-03T17:09:11.439040] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-03T17:09:11.439629] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-03T17:09:11.439728] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-03T17:09:11.844700] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:11.990733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-03T17:09:12.530721] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:09:12.790720] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-03T17:09:13.590733] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-03T17:09:13.916247] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:09:14.072349] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T17:09:14.390731] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-03T17:09:15.190685] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-03T17:09:15.344772] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T17:09:15.552122] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T17:09:15.990705] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-03T17:09:16.695926] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:09:16.790713] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-03T17:09:17.596801] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-03T17:09:17.603264] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:09:17.914712] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:09:18.390745] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-03T17:09:19.195807] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-03T17:09:19.215719] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T17:09:19.990687] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-03T17:09:20.056769] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:09:20.790704] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-03T17:09:20.874525] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:09:21.237467] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:09:21.590764] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-03T17:09:22.390635] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-03T17:09:22.503171] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:09:23.102414] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:09:23.190698] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-03T17:09:23.821239] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T17:09:23.990688] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-03T17:09:24.623897] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:09:24.626426] [INFO ] [REMOTE ] AJG: Full fetch complete (69444 records). [2025-10-03T17:09:24.626599] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-03T17:09:24.795847] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-03T17:09:25.067827] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-03T17:09:25.067918] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-03T17:09:25.068703] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-03T17:09:25.068775] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-03T17:09:25.070401] [DEBUG] [LOCAL ] AJG: Trimmed 69444 records to 47485 (keeping 200 days of data) [2025-10-03T17:09:25.390767] [DEBUG] [LOCAL ] AJG: Primary data saved (47485 records). [2025-10-03T17:09:25.390994] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-03T17:09:25.391128] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AJG took 40.4s. Estimated remaining: 4h 46m 2s. Rate: 8.0 symbols/min [2025-10-03T17:09:25.591137] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-03T17:09:25.591023] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:25.592336] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-03T17:09:25.592422] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-03T17:09:25.592615] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-03T17:09:25.592701] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-03T17:09:25.592799] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-03T17:09:25.592854] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-03T17:09:25.822919] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:09:26.068512] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:26.197633] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T17:09:26.390688] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-03T17:09:27.190673] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-03T17:09:27.394525] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:09:27.443234] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:09:27.990694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-03T17:09:28.795732] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-03T17:09:28.812933] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:09:29.190027] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:09:29.590680] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-03T17:09:30.390628] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-03T17:09:30.680859] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:09:31.143360] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T17:09:31.190675] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-03T17:09:31.653906] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:09:31.656406] [INFO ] [REMOTE ] AKR: Full fetch complete (65502 records). [2025-10-03T17:09:31.656522] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-03T17:09:31.995724] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-03T17:09:32.089312] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-03T17:09:32.089404] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-03T17:09:32.090055] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-03T17:09:32.090119] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-03T17:09:32.091484] [DEBUG] [LOCAL ] AKR: Trimmed 65502 records to 46431 (keeping 200 days of data) [2025-10-03T17:09:32.388099] [DEBUG] [LOCAL ] AKR: Primary data saved (46431 records). [2025-10-03T17:09:32.388285] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-03T17:09:32.388430] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AKR took 42.9s. Estimated remaining: 4h 45m 40s. Rate: 8.0 symbols/min [2025-10-03T17:09:32.536145] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:09:32.630499] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:32.671607] [DEBUG] [LOCAL ] ALE: Loaded 30960 existing records from primary storage. [2025-10-03T17:09:32.671960] [INFO ] [MAIN ] ALE: Loaded 30960 existing records. [2025-10-03T17:09:32.795717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-03T17:09:32.865699] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:32.866310] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-03T17:09:32.866370] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-03T17:09:32.866750] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-03T17:09:32.866824] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-03T17:09:33.275538] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:33.591740] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-03T17:09:33.595084] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:09:34.390717] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-03T17:09:34.637426] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:09:34.866896] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T17:09:35.190758] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-03T17:09:35.990764] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-03T17:09:36.064167] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:09:36.790695] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-03T17:09:36.937941] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:09:37.287223] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:09:37.590699] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-03T17:09:38.390690] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-03T17:09:38.476376] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:09:38.686502] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:09:39.190727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-03T17:09:39.990775] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-03T17:09:40.336252] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T17:09:40.542097] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-03T17:09:40.790722] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-03T17:09:41.475247] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T17:09:41.478720] [INFO ] [REMOTE ] AL: Full fetch complete (62761 records). [2025-10-03T17:09:41.478910] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-03T17:09:41.596213] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-03T17:09:41.908939] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-03T17:09:41.909043] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-03T17:09:41.909816] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-03T17:09:41.909892] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-03T17:09:41.911499] [DEBUG] [LOCAL ] AL: Trimmed 62761 records to 44986 (keeping 200 days of data) [2025-10-03T17:09:42.203722] [DEBUG] [LOCAL ] AL: Primary data saved (44986 records). [2025-10-03T17:09:42.203870] [INFO ] [MAIN ] AL: Full history saved. [2025-10-03T17:09:42.207220] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AL took 37.1s. Estimated remaining: 4h 46m 42s. Rate: 8.0 symbols/min [2025-10-03T17:09:42.390685] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-03T17:09:42.643358] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:09:42.960962] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:09:43.190710] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-03T17:09:43.990701] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-03T17:09:44.099227] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:09:44.378155] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:09:44.790736] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-03T17:09:45.590710] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-03T17:09:45.815857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:09:46.390752] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-03T17:09:46.910888] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:09:47.131091] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T17:09:47.190632] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-03T17:09:47.990724] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-03T17:09:48.128155] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:09:48.790763] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-03T17:09:49.423246] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T17:09:49.461013] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:09:49.590734] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-03T17:09:50.390638] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-03T17:09:50.493163] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:09:51.190723] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-03T17:09:51.372411] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:09:51.990700] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-03T17:09:52.150004] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T17:09:52.790727] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-03T17:09:52.998713] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:09:53.434906] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:09:53.590721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-03T17:09:54.390736] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-03T17:09:54.679480] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T17:09:54.682106] [INFO ] [REMOTE ] ALB: Full fetch complete (76855 records). [2025-10-03T17:09:54.682231] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-03T17:09:54.831432] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:09:54.862999] [INFO ] [REMOTE ] ALC: Full fetch complete (73041 records). [2025-10-03T17:09:54.893744] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-03T17:09:55.371746] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-03T17:09:55.371882] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-03T17:09:55.399287] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-03T17:09:55.428683] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-03T17:09:55.490204] [DEBUG] [LOCAL ] ALB: Trimmed 76855 records to 54012 (keeping 200 days of data) [2025-10-03T17:09:55.594858] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-03T17:09:55.594952] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-03T17:09:55.595751] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-03T17:09:55.595820] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-03T17:09:55.665705] [DEBUG] [LOCAL ] ALC: Trimmed 73041 records to 51600 (keeping 200 days of data) [2025-10-03T17:09:55.691910] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:09:55.696207] [INFO ] [REMOTE ] ALE: Full fetch complete (43110 records). [2025-10-03T17:09:55.697882] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-03T17:09:56.343227] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-03T17:09:56.343936] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-03T17:09:56.356263] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-03T17:09:56.384192] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-03T17:09:56.451809] [DEBUG] [LOCAL ] ALE: Trimmed 43110 records to 31333 (keeping 200 days of data) [2025-10-03T17:09:56.801707] [DEBUG] [LOCAL ] ALC: Primary data saved (51600 records). [2025-10-03T17:09:56.802725] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-03T17:09:56.803469] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALC took 31.4s. Estimated remaining: 4h 50m 3s. Rate: 7.9 symbols/min [2025-10-03T17:09:56.916264] [DEBUG] [LOCAL ] ALE: Primary data saved (31333 records). [2025-10-03T17:09:56.911889] [DEBUG] [LOCAL ] ALB: Primary data saved (54012 records). [2025-10-03T17:09:56.916440] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-03T17:09:56.916563] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALE took 24.5s. Estimated remaining: 4h 46m 19s. Rate: 8.0 symbols/min [2025-10-03T17:09:56.916703] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-03T17:09:56.919498] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALB took 45.9s. Estimated remaining: 4h 42m 37s. Rate: 8.1 symbols/min [2025-10-03T17:09:57.478467] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.582034] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.654712] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.686580] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.696724] [DEBUG] [LOCAL ] ALG: Loaded 10293 existing records from primary storage. [2025-10-03T17:09:57.697047] [INFO ] [MAIN ] ALG: Loaded 10293 existing records. [2025-10-03T17:09:57.957588] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:57.989979] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-03T17:09:57.992029] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-03T17:09:57.992798] [DEBUG] [LOCAL ] ALIT: Loaded 53155 existing records from primary storage. [2025-10-03T17:09:57.991797] [DEBUG] [LOCAL ] ALEX: Loaded 31342 existing records from primary storage. [2025-10-03T17:09:57.993299] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-03T17:09:57.993708] [INFO ] [MAIN ] ALIT: Loaded 53155 existing records. [2025-10-03T17:09:57.993834] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-03T17:09:57.999387] [INFO ] [MAIN ] ALEX: Loaded 31342 existing records. [2025-10-03T17:09:58.300523] [DEBUG] [LOCAL ] ALK: Loaded 53444 existing records from primary storage. [2025-10-03T17:09:58.368230] [INFO ] [MAIN ] ALK: Loaded 53444 existing records. [2025-10-03T17:09:58.620128] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:58.748937] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:58.776794] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-03T17:09:58.768954] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-03T17:09:58.803708] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-03T17:09:58.825181] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-03T17:09:58.873568] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-03T17:09:58.888115] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-03T17:09:58.916849] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-03T17:09:58.946993] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-03T17:09:58.941702] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:59.043317] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-03T17:09:59.119466] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-03T17:09:59.226157] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-03T17:09:59.269215] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-03T17:09:59.296547] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:59.359350] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-03T17:10:00.213881] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.264065] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.275150] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-03T17:10:00.277434] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-03T17:10:00.398715] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.401489] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-03T17:10:00.401092] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T17:10:00.406777] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-03T17:10:01.380610] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:10:01.384868] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-03T17:10:02.056719] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:10:02.054823] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:10:02.083778] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-03T17:10:02.087001] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T17:10:02.087583] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-03T17:10:02.091124] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-03T17:10:02.255936] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:10:02.390763] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-03T17:10:03.174117] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:10:03.190627] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-03T17:10:03.270416] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T17:10:03.550637] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:10:03.990673] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-03T17:10:04.124910] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:10:04.144516] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T17:10:04.790729] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-03T17:10:05.540592] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:10:05.590637] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-03T17:10:06.172943] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T17:10:06.390702] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-03T17:10:07.190671] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-03T17:10:07.291132] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T17:10:07.331811] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T17:10:07.990701] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-03T17:10:08.790670] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-03T17:10:08.929353] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T17:10:09.014503] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T17:10:09.590728] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-03T17:10:09.922121] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T17:10:10.390734] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-03T17:10:11.013667] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:10:11.190733] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-03T17:10:11.990678] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-03T17:10:12.134870] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:10:12.160588] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T17:10:12.790746] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-03T17:10:13.348677] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T17:10:13.590722] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-03T17:10:14.390795] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-03T17:10:14.649804] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-03T17:10:15.132491] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:10:15.190735] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-03T17:10:15.909460] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T17:10:15.910558] [INFO ] [REMOTE ] ALG: Full fetch complete (15887 records). [2025-10-03T17:10:15.910711] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-03T17:10:15.996277] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-03T17:10:16.315990] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-03T17:10:16.316183] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-03T17:10:16.316689] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-03T17:10:16.316758] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-03T17:10:16.317392] [DEBUG] [LOCAL ] ALG: Trimmed 15887 records to 10359 (keeping 200 days of data) [2025-10-03T17:10:16.393685] [DEBUG] [LOCAL ] ALG: Primary data saved (10359 records). [2025-10-03T17:10:16.393911] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-03T17:10:16.394027] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 19.5s. Estimated remaining: 4h 48m 10s. Rate: 7.9 symbols/min [2025-10-03T17:10:16.588436] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:16.628079] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:10:16.691309] [DEBUG] [LOCAL ] ALL: Loaded 50411 existing records from primary storage. [2025-10-03T17:10:16.691799] [INFO ] [MAIN ] ALL: Loaded 50411 existing records. [2025-10-03T17:10:16.795966] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-03T17:10:16.908313] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:16.908738] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-03T17:10:16.908802] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-03T17:10:16.909326] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-03T17:10:16.909389] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-03T17:10:17.331047] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:17.453419] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:10:17.590773] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-03T17:10:18.390780] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-03T17:10:18.720682] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T17:10:19.190772] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-03T17:10:19.278913] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:10:19.867149] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:10:19.990761] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-03T17:10:20.686113] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:10:20.790715] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-03T17:10:21.590753] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-03T17:10:21.852534] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T17:10:22.266340] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:10:22.390712] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-03T17:10:22.588216] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:10:23.190716] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-03T17:10:24.003246] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-03T17:10:24.006971] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:10:24.790673] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-03T17:10:24.940205] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:10:25.590722] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-03T17:10:25.713183] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:10:25.761137] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:10:26.390720] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-03T17:10:27.190743] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-03T17:10:27.496861] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:10:27.561427] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:10:27.990738] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-03T17:10:28.790720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-03T17:10:28.943861] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:10:29.590731] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-03T17:10:29.900806] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:10:30.305871] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:10:30.312551] [INFO ] [REMOTE ] ALIT: Full fetch complete (76432 records). [2025-10-03T17:10:30.313007] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-03T17:10:30.395817] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-03T17:10:30.764402] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T17:10:30.794446] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-03T17:10:30.794575] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-03T17:10:30.795481] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-03T17:10:30.795803] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-03T17:10:30.798515] [DEBUG] [LOCAL ] ALIT: Trimmed 76432 records to 53540 (keeping 200 days of data) [2025-10-03T17:10:31.127966] [DEBUG] [LOCAL ] ALIT: Primary data saved (53540 records). [2025-10-03T17:10:31.128152] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-03T17:10:31.129242] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALIT took 34.2s. Estimated remaining: 4h 51m 23s. Rate: 7.9 symbols/min [2025-10-03T17:10:31.201977] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-03T17:10:31.329254] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:31.389814] [DEBUG] [LOCAL ] ALLE: Loaded 45033 existing records from primary storage. [2025-10-03T17:10:31.390170] [INFO ] [MAIN ] ALLE: Loaded 45033 existing records. [2025-10-03T17:10:31.600002] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:31.601693] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-03T17:10:31.601770] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-03T17:10:31.602898] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-03T17:10:31.602961] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-03T17:10:31.995507] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-03T17:10:32.019935] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:32.307219] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:10:32.363861] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T17:10:32.790810] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-03T17:10:33.590744] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-03T17:10:33.861232] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:10:34.390739] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-03T17:10:34.534035] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T17:10:34.536128] [INFO ] [REMOTE ] ALEX: Full fetch complete (44626 records). [2025-10-03T17:10:34.536248] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-03T17:10:34.930597] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T17:10:35.042214] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-03T17:10:35.042307] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-03T17:10:35.042854] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-03T17:10:35.042923] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-03T17:10:35.044087] [DEBUG] [LOCAL ] ALEX: Trimmed 44626 records to 31583 (keeping 200 days of data) [2025-10-03T17:10:35.218962] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-03T17:10:35.264706] [DEBUG] [LOCAL ] ALEX: Primary data saved (31583 records). [2025-10-03T17:10:35.264870] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-03T17:10:35.264959] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALEX took 38.3s. Estimated remaining: 4h 49m 39s. Rate: 7.9 symbols/min [2025-10-03T17:10:35.456031] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:35.521668] [DEBUG] [LOCAL ] ALLY: Loaded 53605 existing records from primary storage. [2025-10-03T17:10:35.522097] [INFO ] [MAIN ] ALLY: Loaded 53605 existing records. [2025-10-03T17:10:35.728266] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:35.728592] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-03T17:10:35.728690] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-03T17:10:35.729140] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-03T17:10:35.729203] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-03T17:10:35.995872] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-03T17:10:36.132481] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:10:36.137209] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:36.143410] [INFO ] [REMOTE ] ALK: Full fetch complete (76834 records). [2025-10-03T17:10:36.143561] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-03T17:10:36.584586] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-03T17:10:36.584743] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-03T17:10:36.585632] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-03T17:10:36.585744] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-03T17:10:36.587453] [DEBUG] [LOCAL ] ALK: Trimmed 76834 records to 53834 (keeping 200 days of data) [2025-10-03T17:10:36.809962] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-03T17:10:36.950859] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:10:36.977695] [DEBUG] [LOCAL ] ALK: Primary data saved (53834 records). [2025-10-03T17:10:36.977867] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-03T17:10:36.979491] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 40.1s. Estimated remaining: 4h 46m 51s. Rate: 8.0 symbols/min [2025-10-03T17:10:37.160192] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:37.211125] [DEBUG] [LOCAL ] ALSN: Loaded 43607 existing records from primary storage. [2025-10-03T17:10:37.211504] [INFO ] [MAIN ] ALSN: Loaded 43607 existing records. [2025-10-03T17:10:37.414955] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:37.415221] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-03T17:10:37.415286] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-03T17:10:37.415761] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-03T17:10:37.415836] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-03T17:10:37.602588] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-03T17:10:37.854059] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:37.893233] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T17:10:38.390629] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-03T17:10:38.743965] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:10:39.190636] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-03T17:10:39.266904] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:10:39.723352] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:10:39.990707] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-03T17:10:40.790743] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-03T17:10:41.022889] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T17:10:41.590674] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-03T17:10:41.722216] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:10:42.403483] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-03T17:10:42.411968] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:10:43.017754] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:10:43.190744] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-03T17:10:43.990757] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-03T17:10:44.199125] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:10:44.790775] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-03T17:10:44.820980] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:10:45.135615] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T17:10:45.590730] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-03T17:10:46.351602] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:10:46.358455] [INFO ] [REMOTE ] ALL: Full fetch complete (72402 records). [2025-10-03T17:10:46.358588] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-03T17:10:46.395915] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-03T17:10:46.760636] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-03T17:10:46.760791] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-03T17:10:46.761818] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-03T17:10:46.761894] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-03T17:10:46.763967] [DEBUG] [LOCAL ] ALL: Trimmed 72402 records to 50729 (keeping 200 days of data) [2025-10-03T17:10:47.118903] [DEBUG] [LOCAL ] ALL: Primary data saved (50729 records). [2025-10-03T17:10:47.119167] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-03T17:10:47.119310] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 30.7s. Estimated remaining: 4h 47m 54s. Rate: 7.9 symbols/min [2025-10-03T17:10:47.195806] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-03T17:10:47.300015] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:47.334057] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:10:47.364425] [DEBUG] [LOCAL ] ALTG: Loaded 23685 existing records from primary storage. [2025-10-03T17:10:47.364800] [INFO ] [MAIN ] ALTG: Loaded 23685 existing records. [2025-10-03T17:10:47.547926] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:47.548254] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-03T17:10:47.548310] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-03T17:10:47.548579] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-03T17:10:47.548667] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-03T17:10:47.917266] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:47.990749] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-03T17:10:48.258875] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T17:10:48.498450] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:10:48.790735] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-03T17:10:49.203321] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:10:49.590716] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-03T17:10:50.390633] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-03T17:10:50.480953] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:10:51.081699] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:10:51.162686] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:10:51.190677] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-03T17:10:51.990703] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-03T17:10:52.798958] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-03T17:10:52.802361] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T17:10:52.855134] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:10:53.590735] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-03T17:10:54.319040] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T17:10:54.390694] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-03T17:10:54.813736] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T17:10:55.190703] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-03T17:10:55.923188] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:10:55.990742] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-03T17:10:56.280798] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:10:56.790703] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-03T17:10:57.590719] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-03T17:10:58.396383] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-03T17:10:58.425030] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-03T17:10:58.454777] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:10:59.190717] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-03T17:10:59.990728] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-03T17:11:00.656838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:11:00.790726] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-03T17:11:00.895238] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (3.30 seconds). [2025-10-03T17:11:01.590635] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-03T17:11:01.746680] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (3.35 seconds). [2025-10-03T17:11:01.766016] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T17:11:02.085702] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:11:02.390717] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-03T17:11:03.190745] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-03T17:11:03.328586] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:11:03.340386] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:11:03.990707] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-03T17:11:04.790695] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-03T17:11:05.053371] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:11:05.467541] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T17:11:05.592342] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-03T17:11:05.594776] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:11:06.390695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-03T17:11:06.976438] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:11:07.190721] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-03T17:11:07.942589] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:11:07.990693] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-03T17:11:08.759045] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T17:11:08.790729] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-03T17:11:09.049502] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:11:09.590739] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-03T17:11:10.010719] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T17:11:10.390695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-03T17:11:11.190729] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-03T17:11:11.766900] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T17:11:11.769257] [INFO ] [REMOTE ] ALLE: Full fetch complete (64741 records). [2025-10-03T17:11:11.769392] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-03T17:11:11.996562] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-03T17:11:12.069275] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:11:12.110744] [INFO ] [REMOTE ] ALSN: Full fetch complete (62181 records). [2025-10-03T17:11:12.121959] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-03T17:11:12.337209] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-03T17:11:12.342806] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-03T17:11:12.343714] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-03T17:11:12.348970] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-03T17:11:12.430091] [DEBUG] [LOCAL ] ALLE: Trimmed 64741 records to 45291 (keeping 200 days of data) [2025-10-03T17:11:12.913286] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-03T17:11:12.913838] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-03T17:11:12.914879] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-03T17:11:12.941023] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-03T17:11:12.964908] [DEBUG] [LOCAL ] ALSN: Trimmed 62181 records to 43927 (keeping 200 days of data) [2025-10-03T17:11:13.125698] [DEBUG] [LOCAL ] ALLE: Primary data saved (45291 records). [2025-10-03T17:11:13.127200] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-03T17:11:13.128856] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLE took 42.0s. Estimated remaining: 4h 55m 56s. Rate: 7.7 symbols/min [2025-10-03T17:11:13.205553] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T17:11:13.239816] [INFO ] [REMOTE ] ALTG: Full fetch complete (33678 records). [2025-10-03T17:11:13.259990] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-03T17:11:13.362516] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:13.473812] [DEBUG] [LOCAL ] ALUR: Loaded 10816 existing records from primary storage. [2025-10-03T17:11:13.497926] [INFO ] [MAIN ] ALUR: Loaded 10816 existing records. [2025-10-03T17:11:14.029526] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:14.041886] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-03T17:11:14.042538] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-03T17:11:14.085219] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-03T17:11:14.096614] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-03T17:11:14.212036] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-03T17:11:14.222708] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-03T17:11:14.234354] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-03T17:11:14.271063] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-03T17:11:14.296884] [DEBUG] [LOCAL ] ALTG: Trimmed 33678 records to 23811 (keeping 200 days of data) [2025-10-03T17:11:14.515335] [DEBUG] [LOCAL ] ALSN: Primary data saved (43927 records). [2025-10-03T17:11:14.535393] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-03T17:11:14.594382] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALSN took 37.6s. Estimated remaining: 4h 53m 3s. Rate: 7.8 symbols/min [2025-10-03T17:11:14.630945] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-03T17:11:14.802305] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-03T17:11:14.993314] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:14.989881] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:14.996411] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-03T17:11:15.038589] [DEBUG] [LOCAL ] ALTG: Primary data saved (23811 records). [2025-10-03T17:11:15.038884] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-03T17:11:15.039038] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALTG took 27.9s. Estimated remaining: 4h 49m 47s. Rate: 7.9 symbols/min [2025-10-03T17:11:15.221703] [DEBUG] [LOCAL ] ALV: Loaded 42666 existing records from primary storage. [2025-10-03T17:11:15.248818] [INFO ] [MAIN ] ALV: Loaded 42666 existing records. [2025-10-03T17:11:15.342905] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:15.441019] [DEBUG] [LOCAL ] ALX: Loaded 6303 existing records from primary storage. [2025-10-03T17:11:15.452864] [INFO ] [MAIN ] ALX: Loaded 6303 existing records. [2025-10-03T17:11:15.523741] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:15.568458] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-03T17:11:15.568579] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-03T17:11:15.604404] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-03T17:11:15.604554] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-03T17:11:15.811849] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:15.856466] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-03T17:11:15.869245] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-03T17:11:15.889250] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-03T17:11:15.951681] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-03T17:11:16.283058] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:16.362335] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-03T17:11:16.540404] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:11:16.579171] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-03T17:11:16.583474] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:16.584272] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-03T17:11:16.624925] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:11:16.790711] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-03T17:11:17.175338] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T17:11:17.590745] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-03T17:11:17.713096] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T17:11:17.766934] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:11:17.976714] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T17:11:18.185011] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:11:18.188554] [INFO ] [REMOTE ] ALLY: Full fetch complete (76924 records). [2025-10-03T17:11:18.188790] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-03T17:11:18.391963] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-03T17:11:18.632876] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-03T17:11:18.632961] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-03T17:11:18.633728] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-03T17:11:18.633838] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-03T17:11:18.635505] [DEBUG] [LOCAL ] ALLY: Trimmed 76924 records to 53994 (keeping 200 days of data) [2025-10-03T17:11:18.984923] [DEBUG] [LOCAL ] ALLY: Primary data saved (53994 records). [2025-10-03T17:11:18.985304] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-03T17:11:18.986880] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALLY took 43.7s. Estimated remaining: 4h 48m 5s. Rate: 7.9 symbols/min [2025-10-03T17:11:19.183171] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:19.190678] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-03T17:11:19.242095] [DEBUG] [LOCAL ] AM: Loaded 52439 existing records from primary storage. [2025-10-03T17:11:19.242454] [INFO ] [MAIN ] AM: Loaded 52439 existing records. [2025-10-03T17:11:19.451366] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:19.451854] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-03T17:11:19.451963] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-03T17:11:19.457701] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-03T17:11:19.464533] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-03T17:11:19.465742] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:11:19.870573] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:19.990684] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-03T17:11:20.423045] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T17:11:20.790718] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-03T17:11:21.590741] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-03T17:11:21.844927] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:11:21.911139] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T17:11:22.159219] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:11:22.390727] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-03T17:11:23.190710] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-03T17:11:23.980175] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T17:11:23.990617] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-03T17:11:24.137486] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T17:11:24.790739] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-03T17:11:24.998927] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:11:25.590734] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-03T17:11:26.063680] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T17:11:26.322427] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:11:26.390730] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-03T17:11:27.190715] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-03T17:11:27.376459] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:11:27.990772] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-03T17:11:28.526540] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:11:28.790759] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-03T17:11:29.105162] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:11:29.590719] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-03T17:11:30.390759] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-03T17:11:30.537270] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:11:30.975380] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T17:11:31.032722] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T17:11:31.190722] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-03T17:11:31.990752] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-03T17:11:32.171825] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:11:32.790727] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-03T17:11:33.434631] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T17:11:33.590705] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-03T17:11:33.833341] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:11:34.390730] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-03T17:11:34.857773] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:11:35.168304] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:11:35.190675] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-03T17:11:35.943618] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T17:11:35.990723] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-03T17:11:36.790736] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-03T17:11:37.596889] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-03T17:11:37.623827] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:11:38.359519] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:11:38.389070] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:11:38.397786] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-03T17:11:39.190724] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-03T17:11:39.292449] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:11:39.990729] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-03T17:11:40.595930] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T17:11:40.790703] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-03T17:11:40.940767] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:11:41.319268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:11:41.320774] [INFO ] [REMOTE ] ALUR: Full fetch complete (20216 records). [2025-10-03T17:11:41.320874] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-03T17:11:41.596780] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-03T17:11:41.787115] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-03T17:11:41.787221] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-03T17:11:41.787708] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-03T17:11:41.787778] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-03T17:11:41.788590] [DEBUG] [LOCAL ] ALUR: Trimmed 20216 records to 10863 (keeping 200 days of data) [2025-10-03T17:11:41.854294] [DEBUG] [LOCAL ] ALUR: Primary data saved (10863 records). [2025-10-03T17:11:41.854465] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-03T17:11:41.854577] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALUR took 28.7s. Estimated remaining: 4h 54m 25s. Rate: 7.7 symbols/min [2025-10-03T17:11:42.061181] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:42.061457] [DEBUG] [LOCAL ] AMBC: No existing data file found in primary storage. [2025-10-03T17:11:42.061541] [WARN ] [MAIN ] AMBC: No existing data found, performing full refresh instead. [2025-10-03T17:11:42.061736] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-03T17:11:42.061791] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-03T17:11:42.061838] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-10-03T17:11:42.061875] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-03T17:11:42.396217] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-03T17:11:42.436806] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:11:42.462212] [INFO ] [REMOTE ] ALX: Full fetch complete (7188 records). [2025-10-03T17:11:42.482266] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-03T17:11:42.844624] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:43.198562] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-03T17:11:43.250941] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-03T17:11:43.251040] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-03T17:11:43.251269] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-03T17:11:43.251313] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-03T17:11:43.251980] [DEBUG] [LOCAL ] ALX: Trimmed 7188 records to 6349 (keeping 200 days of data) [2025-10-03T17:11:43.299807] [DEBUG] [LOCAL ] ALX: Primary data saved (6349 records). [2025-10-03T17:11:43.300020] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-03T17:11:43.300377] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALX took 28.3s. Estimated remaining: 4h 51m 40s. Rate: 7.8 symbols/min [2025-10-03T17:11:43.515903] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:43.563383] [DEBUG] [LOCAL ] AMBP: Loaded 45246 existing records from primary storage. [2025-10-03T17:11:43.563850] [INFO ] [MAIN ] AMBP: Loaded 45246 existing records. [2025-10-03T17:11:43.764810] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:43.765210] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-03T17:11:43.765342] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-03T17:11:43.765728] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-03T17:11:43.765787] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-03T17:11:43.997073] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-03T17:11:44.120596] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T17:11:44.201297] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:44.584873] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T17:11:44.790740] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-03T17:11:45.412748] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:11:45.590719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-03T17:11:46.351252] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:11:46.390680] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-03T17:11:46.431035] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T17:11:47.190757] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-03T17:11:47.896182] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:11:47.990733] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-03T17:11:48.452557] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:11:48.790727] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-03T17:11:49.451359] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:11:49.590735] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-03T17:11:50.370747] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T17:11:50.390637] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-03T17:11:51.190681] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-03T17:11:51.264014] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:11:51.483044] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T17:11:51.990728] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-03T17:11:52.478229] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:11:52.480451] [INFO ] [REMOTE ] ALV: Full fetch complete (61769 records). [2025-10-03T17:11:52.480585] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-03T17:11:52.795881] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-03T17:11:52.918780] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-03T17:11:52.918878] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-03T17:11:52.919536] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-03T17:11:52.919605] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-03T17:11:52.921167] [DEBUG] [LOCAL ] ALV: Trimmed 61769 records to 42942 (keeping 200 days of data) [2025-10-03T17:11:53.215756] [DEBUG] [LOCAL ] ALV: Primary data saved (42942 records). [2025-10-03T17:11:53.215908] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-03T17:11:53.216015] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALV took 38.6s. Estimated remaining: 4h 52m 27s. Rate: 7.8 symbols/min [2025-10-03T17:11:53.416523] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:53.416800] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-03T17:11:53.416911] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-03T17:11:53.417031] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-03T17:11:53.417074] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-03T17:11:53.417119] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-03T17:11:53.417152] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-03T17:11:53.593034] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-03T17:11:53.830708] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:53.862914] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:11:53.922430] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:11:54.390704] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-03T17:11:55.190664] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-03T17:11:55.265341] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:11:55.377073] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:11:55.377393] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-03T17:11:55.377508] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:11:55.377578] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-03T17:11:55.377664] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:11:55.377743] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-03T17:11:55.377818] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-03T17:11:55.377859] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-03T17:11:55.377900] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-03T17:11:55.377950] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBQ took 2.2s. Estimated remaining: 4h 50m 4s. Rate: 7.8 symbols/min [2025-10-03T17:11:55.559187] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:55.629132] [DEBUG] [LOCAL ] AMC: Loaded 54150 existing records from primary storage. [2025-10-03T17:11:55.629502] [INFO ] [MAIN ] AMC: Loaded 54150 existing records. [2025-10-03T17:11:55.836882] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:55.837151] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-03T17:11:55.837202] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-03T17:11:55.837814] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-03T17:11:55.837874] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-03T17:11:56.004201] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-03T17:11:56.291237] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:56.321836] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T17:11:56.790714] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-03T17:11:57.590689] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-03T17:11:57.657857] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:11:58.178439] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:11:58.390711] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-03T17:11:59.190638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-03T17:11:59.315673] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:11:59.997741] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-03T17:12:00.020101] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:12:00.790688] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-03T17:12:01.590737] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-03T17:12:01.677609] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T17:12:01.807048] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:12:02.160725] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:12:02.390725] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-03T17:12:02.875055] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:12:02.877805] [INFO ] [REMOTE ] AM: Full fetch complete (75587 records). [2025-10-03T17:12:02.877966] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-03T17:12:03.195903] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-03T17:12:03.334437] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-03T17:12:03.334563] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-03T17:12:03.335419] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-03T17:12:03.335490] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-03T17:12:03.337278] [DEBUG] [LOCAL ] AM: Trimmed 75587 records to 52803 (keeping 200 days of data) [2025-10-03T17:12:03.680840] [DEBUG] [LOCAL ] AM: Primary data saved (52803 records). [2025-10-03T17:12:03.681022] [INFO ] [MAIN ] AM: Full history saved. [2025-10-03T17:12:03.684230] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AM took 44.7s. Estimated remaining: 4h 50m 12s. Rate: 7.8 symbols/min [2025-10-03T17:12:03.888056] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:03.915346] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T17:12:03.978790] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-03T17:12:03.979166] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-10-03T17:12:03.995809] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-03T17:12:04.184736] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:04.185008] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-03T17:12:04.185058] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-03T17:12:04.185680] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-03T17:12:04.185742] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-03T17:12:04.578722] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:04.790695] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-03T17:12:05.597941] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-03T17:12:05.621926] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T17:12:05.665271] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-03T17:12:06.272228] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:12:06.390685] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-03T17:12:07.190634] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-03T17:12:07.266752] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:12:07.973698] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:12:07.990607] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-03T17:12:08.790724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-03T17:12:09.431388] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:12:09.535590] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T17:12:09.590633] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-03T17:12:09.847755] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:12:10.390727] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-03T17:12:11.190724] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-03T17:12:11.588726] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:12:11.591438] [INFO ] [REMOTE ] AMBC: Full fetch complete (51336 records). [2025-10-03T17:12:11.591556] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-03T17:12:11.999728] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-03T17:12:12.038320] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-03T17:12:12.038875] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-03T17:12:12.039550] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-03T17:12:12.039756] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-03T17:12:12.041317] [DEBUG] [LOCAL ] AMBC: Trimmed 51336 records to 37179 (keeping 200 days of data) [2025-10-03T17:12:12.184953] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-03T17:12:12.309036] [DEBUG] [LOCAL ] AMBC: Primary data saved (37179 records). [2025-10-03T17:12:12.309194] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-03T17:12:12.309274] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AMBC took 30.5s. Estimated remaining: 4h 50m 28s. Rate: 7.8 symbols/min [2025-10-03T17:12:12.493853] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:12.558102] [DEBUG] [LOCAL ] AME: Loaded 48837 existing records from primary storage. [2025-10-03T17:12:12.558559] [INFO ] [MAIN ] AME: Loaded 48837 existing records. [2025-10-03T17:12:12.760536] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:12.760897] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-03T17:12:12.760960] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-03T17:12:12.761365] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-03T17:12:12.761425] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-03T17:12:12.794611] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-03T17:12:13.191272] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:13.207418] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T17:12:13.233214] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:12:13.235328] [INFO ] [REMOTE ] AMBP: Full fetch complete (65612 records). [2025-10-03T17:12:13.235437] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-03T17:12:13.603165] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-03T17:12:13.666000] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-03T17:12:13.666092] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-03T17:12:13.666843] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-03T17:12:13.666912] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-03T17:12:13.670202] [DEBUG] [LOCAL ] AMBP: Trimmed 65612 records to 45523 (keeping 200 days of data) [2025-10-03T17:12:13.952586] [DEBUG] [LOCAL ] AMBP: Primary data saved (45523 records). [2025-10-03T17:12:13.952764] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-03T17:12:13.952881] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 30.7s. Estimated remaining: 4h 47m 58s. Rate: 7.9 symbols/min [2025-10-03T17:12:14.187031] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:14.212528] [DEBUG] [LOCAL ] AMG: Loaded 20522 existing records from primary storage. [2025-10-03T17:12:14.212876] [INFO ] [MAIN ] AMG: Loaded 20522 existing records. [2025-10-03T17:12:14.395681] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-03T17:12:14.420214] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:14.420710] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-03T17:12:14.420773] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-03T17:12:14.421029] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-03T17:12:14.421089] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-03T17:12:14.802576] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:15.190637] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-03T17:12:15.312164] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-03T17:12:15.465270] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T17:12:15.990624] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-03T17:12:16.110629] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:12:16.150851] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:12:16.790686] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-03T17:12:17.590742] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-03T17:12:18.390630] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-03T17:12:18.519533] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-03T17:12:18.565849] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:12:18.698429] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:12:19.190725] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-03T17:12:19.990718] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-03T17:12:20.281527] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:12:20.790692] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-03T17:12:20.889886] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T17:12:21.590727] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-03T17:12:22.231212] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:12:22.390669] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-03T17:12:22.489115] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-03T17:12:22.513905] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:12:23.190695] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-03T17:12:23.990743] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-03T17:12:24.549585] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T17:12:24.790708] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-03T17:12:25.179291] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T17:12:25.511963] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:12:25.590699] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-03T17:12:26.236967] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:12:26.390696] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-03T17:12:26.845785] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T17:12:27.190739] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-03T17:12:27.990699] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-03T17:12:28.336236] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T17:12:28.528803] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T17:12:28.790742] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-03T17:12:29.590705] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-03T17:12:29.714083] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:12:29.898689] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:12:30.390710] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-03T17:12:31.190734] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-03T17:12:31.354556] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:12:31.990710] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-03T17:12:32.578102] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T17:12:32.790737] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-03T17:12:33.031816] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:12:33.555517] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:12:33.590697] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-03T17:12:34.390745] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-03T17:12:35.050699] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T17:12:35.054084] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-03T17:12:35.054301] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-03T17:12:35.192501] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-03T17:12:35.553908] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-03T17:12:35.554030] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-03T17:12:35.554989] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-03T17:12:35.555181] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-03T17:12:35.557117] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 54540 (keeping 200 days of data) [2025-10-03T17:12:35.684171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T17:12:35.857722] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:12:35.965930] [DEBUG] [LOCAL ] AMC: Primary data saved (54540 records). [2025-10-03T17:12:35.966086] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-03T17:12:35.968160] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMC took 40.6s. Estimated remaining: 4h 53m 28s. Rate: 7.7 symbols/min [2025-10-03T17:12:36.002330] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-03T17:12:36.168673] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:36.228298] [DEBUG] [LOCAL ] AMH: Loaded 52100 existing records from primary storage. [2025-10-03T17:12:36.228723] [INFO ] [MAIN ] AMH: Loaded 52100 existing records. [2025-10-03T17:12:36.415118] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:12:36.459098] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:36.465567] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-03T17:12:36.465698] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-03T17:12:36.466296] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-03T17:12:36.466358] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-03T17:12:36.795857] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-03T17:12:36.874047] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:37.590629] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-03T17:12:37.882458] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T17:12:37.885482] [INFO ] [REMOTE ] AMCR: Full fetch complete (77679 records). [2025-10-03T17:12:37.885635] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-03T17:12:38.258934] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:12:38.372940] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-03T17:12:38.373092] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-03T17:12:38.373918] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-03T17:12:38.373989] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-03T17:12:38.375806] [DEBUG] [LOCAL ] AMCR: Trimmed 77679 records to 54449 (keeping 200 days of data) [2025-10-03T17:12:38.433769] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-03T17:12:38.727037] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-10-03T17:12:38.727226] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-03T17:12:38.728031] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AMCR took 35.0s. Estimated remaining: 4h 51m 25s. Rate: 7.8 symbols/min [2025-10-03T17:12:38.905591] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:38.950022] [DEBUG] [LOCAL ] AMN: Loaded 42097 existing records from primary storage. [2025-10-03T17:12:38.950323] [INFO ] [MAIN ] AMN: Loaded 42097 existing records. [2025-10-03T17:12:39.144823] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:39.145168] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-03T17:12:39.145287] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-03T17:12:39.146011] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-03T17:12:39.146131] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-03T17:12:39.193089] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-03T17:12:39.317883] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:12:39.581047] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:39.934810] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:12:39.990716] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-03T17:12:40.082336] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:12:40.790727] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-03T17:12:41.590630] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-03T17:12:41.780619] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T17:12:42.005342] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:12:42.390707] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-03T17:12:42.602080] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:12:42.603683] [INFO ] [REMOTE ] AMG: Full fetch complete (29901 records). [2025-10-03T17:12:42.603765] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-03T17:12:43.020432] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-03T17:12:43.020627] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-03T17:12:43.021763] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-03T17:12:43.021843] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-03T17:12:43.022871] [DEBUG] [LOCAL ] AMG: Trimmed 29901 records to 20722 (keeping 200 days of data) [2025-10-03T17:12:43.159803] [DEBUG] [LOCAL ] AMG: Primary data saved (20722 records). [2025-10-03T17:12:43.159960] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-03T17:12:43.160183] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMG took 29.2s. Estimated remaining: 4h 50m 2s. Rate: 7.8 symbols/min [2025-10-03T17:12:43.202353] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-03T17:12:43.405907] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:43.448467] [DEBUG] [LOCAL ] AMP: Loaded 32439 existing records from primary storage. [2025-10-03T17:12:43.448863] [INFO ] [MAIN ] AMP: Loaded 32439 existing records. [2025-10-03T17:12:43.670102] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:43.670744] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-03T17:12:43.670935] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-03T17:12:43.678817] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-03T17:12:43.693358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:12:43.692535] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-03T17:12:43.998713] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-03T17:12:44.107272] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:44.790635] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-03T17:12:44.982240] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:12:45.590683] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-03T17:12:45.781193] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:12:46.227867] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:12:46.390711] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-03T17:12:47.066913] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:12:47.190701] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-03T17:12:47.990639] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-03T17:12:48.025224] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:12:48.625812] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:12:48.790701] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-03T17:12:49.590730] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-03T17:12:49.720152] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:12:50.294704] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:12:50.390715] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-03T17:12:51.190727] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-03T17:12:51.221505] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T17:12:51.990692] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-03T17:12:52.138258] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:12:52.726574] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:12:52.729280] [INFO ] [REMOTE ] AME: Full fetch complete (69879 records). [2025-10-03T17:12:52.729417] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-03T17:12:52.802970] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-03T17:12:53.151173] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-03T17:12:53.151260] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-03T17:12:53.152011] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-03T17:12:53.152081] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-03T17:12:53.154020] [DEBUG] [LOCAL ] AME: Trimmed 69879 records to 49208 (keeping 200 days of data) [2025-10-03T17:12:53.488416] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:12:53.515738] [DEBUG] [LOCAL ] AME: Primary data saved (49208 records). [2025-10-03T17:12:53.515903] [INFO ] [MAIN ] AME: Full history saved. [2025-10-03T17:12:53.517098] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AME took 41.2s. Estimated remaining: 4h 50m 56s. Rate: 7.8 symbols/min [2025-10-03T17:12:53.595748] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-03T17:12:53.709202] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:53.770569] [DEBUG] [LOCAL ] AMPX: Loaded 52687 existing records from primary storage. [2025-10-03T17:12:53.770958] [INFO ] [MAIN ] AMPX: Loaded 52687 existing records. [2025-10-03T17:12:53.966229] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:53.966476] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-03T17:12:53.966525] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-03T17:12:53.967005] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-03T17:12:53.967067] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-03T17:12:54.394196] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:54.391963] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-03T17:12:54.477265] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:12:54.981074] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T17:12:55.190715] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-03T17:12:55.895539] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:12:55.990706] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-03T17:12:56.790686] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-03T17:12:57.209634] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T17:12:57.273801] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T17:12:57.590714] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-03T17:12:58.390712] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-03T17:12:58.434395] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:12:58.533148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T17:12:59.190704] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-03T17:12:59.990729] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-03T17:13:00.790732] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-03T17:13:00.840425] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:13:01.247400] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-03T17:13:01.590741] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-03T17:13:02.237073] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:13:02.390706] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-03T17:13:03.015124] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:13:03.190733] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-03T17:13:03.995764] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-03T17:13:04.016169] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (4.03 seconds). [2025-10-03T17:13:04.054004] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:13:04.790671] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-03T17:13:05.027192] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:13:05.590688] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-03T17:13:05.974497] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T17:13:06.390706] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-03T17:13:07.190704] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-03T17:13:07.588621] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-03T17:13:07.990729] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-03T17:13:08.139030] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:13:08.395639] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:13:08.481191] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-03T17:13:08.790724] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-03T17:13:09.419336] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:13:09.590690] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-03T17:13:10.390710] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-03T17:13:10.527888] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:13:10.918218] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:13:10.920069] [INFO ] [REMOTE ] AMP: Full fetch complete (47657 records). [2025-10-03T17:13:10.920161] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-03T17:13:11.198622] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-03T17:13:11.337405] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-03T17:13:11.337595] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-03T17:13:11.338239] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-03T17:13:11.338313] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-03T17:13:11.339679] [DEBUG] [LOCAL ] AMP: Trimmed 47657 records to 32637 (keeping 200 days of data) [2025-10-03T17:13:11.553714] [DEBUG] [LOCAL ] AMP: Primary data saved (32637 records). [2025-10-03T17:13:11.553879] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-03T17:13:11.553969] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMP took 28.4s. Estimated remaining: 4h 54m 40s. Rate: 7.7 symbols/min [2025-10-03T17:13:11.738997] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:11.780579] [DEBUG] [LOCAL ] AMPY: Loaded 38186 existing records from primary storage. [2025-10-03T17:13:11.780905] [INFO ] [MAIN ] AMPY: Loaded 38186 existing records. [2025-10-03T17:13:11.972414] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:11.972919] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-03T17:13:11.973001] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-03T17:13:11.973602] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-03T17:13:11.973709] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-03T17:13:11.996305] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-03T17:13:12.117029] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:13:12.419080] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:12.739977] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:13:12.790586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-03T17:13:13.590684] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-03T17:13:13.721161] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T17:13:13.726116] [INFO ] [REMOTE ] AMH: Full fetch complete (74800 records). [2025-10-03T17:13:13.726368] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-03T17:13:14.162376] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-03T17:13:14.165148] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-03T17:13:14.169376] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-03T17:13:14.169837] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-03T17:13:14.169744] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:13:14.173775] [DEBUG] [LOCAL ] AMH: Trimmed 74800 records to 52479 (keeping 200 days of data) [2025-10-03T17:13:14.174592] [INFO ] [REMOTE ] AMN: Full fetch complete (60449 records). [2025-10-03T17:13:14.174779] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-03T17:13:14.394941] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-03T17:13:14.745508] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-03T17:13:14.748010] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-03T17:13:14.752213] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-03T17:13:14.752526] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-03T17:13:14.845637] [DEBUG] [LOCAL ] AMN: Trimmed 60449 records to 42418 (keeping 200 days of data) [2025-10-03T17:13:14.959067] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:13:15.191685] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-03T17:13:15.203428] [DEBUG] [LOCAL ] AMH: Primary data saved (52479 records). [2025-10-03T17:13:15.207839] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-03T17:13:15.209331] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMH took 39.2s. Estimated remaining: 4h 53m 1s. Rate: 7.7 symbols/min [2025-10-03T17:13:15.412867] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:15.433985] [DEBUG] [LOCAL ] AMN: Primary data saved (42418 records). [2025-10-03T17:13:15.434160] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-03T17:13:15.434857] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMN took 36.7s. Estimated remaining: 4h 50m 7s. Rate: 7.8 symbols/min [2025-10-03T17:13:15.648622] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:15.649869] [DEBUG] [LOCAL ] AMR: Loaded 29181 existing records from primary storage. [2025-10-03T17:13:15.650799] [INFO ] [MAIN ] AMR: Loaded 29181 existing records. [2025-10-03T17:13:15.861342] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:15.873297] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-03T17:13:15.873445] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-03T17:13:15.874331] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-03T17:13:15.874294] [DEBUG] [LOCAL ] AMRC: Loaded 38431 existing records from primary storage. [2025-10-03T17:13:15.874439] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-03T17:13:15.920364] [INFO ] [MAIN ] AMRC: Loaded 38431 existing records. [2025-10-03T17:13:16.393229] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:16.420167] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-03T17:13:16.420806] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-03T17:13:16.421492] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-03T17:13:16.421589] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-03T17:13:16.569125] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:16.611635] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-03T17:13:16.785042] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:13:16.802733] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T17:13:16.844489] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-03T17:13:16.999952] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:17.590638] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-03T17:13:17.868033] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T17:13:17.952135] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:13:18.390726] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-03T17:13:18.962274] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:13:19.190696] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-03T17:13:19.639449] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:13:19.990730] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-03T17:13:20.790702] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-03T17:13:21.299387] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T17:13:21.516579] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T17:13:21.590730] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-03T17:13:22.390738] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-03T17:13:22.776322] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:13:23.190704] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-03T17:13:23.833447] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:13:23.990700] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-03T17:13:24.790683] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-03T17:13:25.040207] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:13:25.590683] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-03T17:13:26.272798] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T17:13:26.390692] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-03T17:13:26.520768] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T17:13:26.750791] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-10-03T17:13:27.190693] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-03T17:13:27.889244] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:13:27.990748] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-03T17:13:28.630804] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:13:28.790751] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-03T17:13:29.590735] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-03T17:13:29.656303] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:13:30.040024] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:13:30.390704] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-03T17:13:31.116413] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T17:13:31.190728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-03T17:13:31.665865] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:13:31.990738] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-03T17:13:32.654479] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:13:32.790736] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-03T17:13:33.161901] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:13:33.590635] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-03T17:13:34.068495] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:13:34.390733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-03T17:13:34.890751] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:13:35.190718] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-03T17:13:35.734048] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:13:35.990716] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-03T17:13:36.627546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:13:36.790689] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-03T17:13:37.216589] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:13:37.590718] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-03T17:13:38.359504] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:13:38.390632] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-03T17:13:39.153812] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:13:39.190733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-03T17:13:39.990718] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-03T17:13:40.040729] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T17:13:40.537450] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:13:40.539445] [INFO ] [REMOTE ] AMR: Full fetch complete (40217 records). [2025-10-03T17:13:40.539540] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-03T17:13:40.795836] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-03T17:13:40.994874] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-03T17:13:40.996871] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-03T17:13:40.997491] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-03T17:13:40.997611] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-03T17:13:40.996753] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (21.81 seconds). [2025-10-03T17:13:41.010479] [DEBUG] [LOCAL ] AMR: Trimmed 40217 records to 29401 (keeping 200 days of data) [2025-10-03T17:13:41.200288] [DEBUG] [LOCAL ] AMR: Primary data saved (29401 records). [2025-10-03T17:13:41.200454] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-03T17:13:41.200567] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMR took 26.0s. Estimated remaining: 4h 56m 34s. Rate: 7.6 symbols/min [2025-10-03T17:13:41.384949] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:41.385144] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-03T17:13:41.385217] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-03T17:13:41.385342] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-03T17:13:41.385388] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-03T17:13:41.385433] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-03T17:13:41.385467] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-03T17:13:41.599376] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-03T17:13:41.642358] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T17:13:41.689488] [INFO ] [REMOTE ] AMPY: Full fetch complete (51661 records). [2025-10-03T17:13:41.715853] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-03T17:13:41.930269] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:42.231159] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-03T17:13:42.231345] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-03T17:13:42.232066] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-03T17:13:42.232152] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-03T17:13:42.233542] [DEBUG] [LOCAL ] AMPY: Trimmed 51661 records to 38558 (keeping 200 days of data) [2025-10-03T17:13:42.319464] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:13:42.331880] [INFO ] [REMOTE ] AMRC: Full fetch complete (53220 records). [2025-10-03T17:13:42.336585] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-03T17:13:42.397011] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-03T17:13:42.673873] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:13:42.700612] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-03T17:13:42.718276] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:13:42.718735] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-03T17:13:42.750750] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:13:42.759759] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-03T17:13:42.789522] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-03T17:13:42.804871] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-03T17:13:42.808988] [DEBUG] [LOCAL ] AMPY: Primary data saved (38558 records). [2025-10-03T17:13:42.814366] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-03T17:13:42.819632] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-03T17:13:42.830086] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMRZ took 1.6s. Estimated remaining: 4h 54m 11s. Rate: 7.7 symbols/min [2025-10-03T17:13:42.868096] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMPY took 31.3s. Estimated remaining: 4h 51m 18s. Rate: 7.8 symbols/min [2025-10-03T17:13:43.001070] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-03T17:13:43.077218] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-03T17:13:43.102637] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-03T17:13:43.147399] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-03T17:13:43.274637] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:43.299211] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:43.300178] [DEBUG] [LOCAL ] AMRC: Trimmed 53220 records to 38763 (keeping 200 days of data) [2025-10-03T17:13:43.412335] [DEBUG] [LOCAL ] AMTB: Loaded 20465 existing records from primary storage. [2025-10-03T17:13:43.415235] [INFO ] [MAIN ] AMTB: Loaded 20465 existing records. [2025-10-03T17:13:43.646850] [DEBUG] [LOCAL ] AMT: Loaded 52808 existing records from primary storage. [2025-10-03T17:13:43.680193] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:43.681712] [INFO ] [MAIN ] AMT: Loaded 52808 existing records. [2025-10-03T17:13:43.681593] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-03T17:13:43.722253] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-03T17:13:43.765338] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-03T17:13:43.781959] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-03T17:13:44.015285] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:44.032454] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-03T17:13:44.057191] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-03T17:13:44.155367] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-03T17:13:44.161326] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-03T17:13:44.704164] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:44.716313] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-03T17:13:44.796760] [DEBUG] [LOCAL ] AMRC: Primary data saved (38763 records). [2025-10-03T17:13:44.804728] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-03T17:13:44.847076] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMRC took 29.4s. Estimated remaining: 4h 49m 9s. Rate: 7.8 symbols/min [2025-10-03T17:13:44.918473] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-03T17:13:45.001962] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:45.018151] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-03T17:13:45.052894] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-03T17:13:45.155968] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:45.162748] [DEBUG] [LOCAL ] AMTD: Loaded 3668 existing records from primary storage. [2025-10-03T17:13:45.162997] [INFO ] [MAIN ] AMTD: Loaded 3668 existing records. [2025-10-03T17:13:45.364174] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:45.364461] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-03T17:13:45.364513] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-03T17:13:45.364770] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-03T17:13:45.364833] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-03T17:13:45.762836] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:45.763249] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-03T17:13:45.980771] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:13:46.390713] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-03T17:13:46.676143] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T17:13:47.190677] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-03T17:13:47.280027] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T17:13:47.317360] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T17:13:47.365403] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:13:47.791959] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T17:13:47.990701] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-03T17:13:48.576727] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:13:48.790682] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-03T17:13:49.278700] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:13:49.590706] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-03T17:13:50.390633] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-03T17:13:50.711055] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:13:50.840399] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T17:13:51.190726] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-03T17:13:51.677773] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:13:51.990710] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-03T17:13:52.621197] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:13:52.790705] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-03T17:13:53.590683] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-03T17:13:53.813813] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:13:54.390719] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-03T17:13:55.190708] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-03T17:13:55.410164] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T17:13:55.516051] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:13:55.990737] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-03T17:13:56.790665] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-03T17:13:56.866594] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:13:57.516165] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T17:13:57.590679] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-03T17:13:58.390721] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-03T17:13:58.425045] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:13:58.610586] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T17:13:59.190716] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-03T17:13:59.774012] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:13:59.990717] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-03T17:14:00.360324] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T17:14:00.363624] [INFO ] [REMOTE ] AMPX: Full fetch complete (74763 records). [2025-10-03T17:14:00.363801] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-03T17:14:00.704406] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T17:14:00.803029] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-03T17:14:00.807626] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-03T17:14:00.808494] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-03T17:14:00.809354] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-03T17:14:00.809532] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-03T17:14:00.811533] [DEBUG] [LOCAL ] AMPX: Trimmed 74763 records to 53077 (keeping 200 days of data) [2025-10-03T17:14:01.127766] [DEBUG] [LOCAL ] AMPX: Primary data saved (53077 records). [2025-10-03T17:14:01.127938] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-03T17:14:01.128152] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMPX took 1m 8s. Estimated remaining: 4h 52m 2s. Rate: 7.7 symbols/min [2025-10-03T17:14:01.314151] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:01.365997] [DEBUG] [LOCAL ] AMTM: Loaded 51033 existing records from primary storage. [2025-10-03T17:14:01.366385] [INFO ] [MAIN ] AMTM: Loaded 51033 existing records. [2025-10-03T17:14:01.565109] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:01.565335] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-03T17:14:01.565387] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-03T17:14:01.565700] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-03T17:14:01.565787] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-03T17:14:01.598930] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-03T17:14:02.001432] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:02.053064] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:14:02.219425] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:14:02.390687] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-03T17:14:02.966775] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T17:14:02.967668] [INFO ] [REMOTE ] AMTD: Full fetch complete (5580 records). [2025-10-03T17:14:02.967745] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-03T17:14:03.195853] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-03T17:14:03.359073] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-03T17:14:03.359164] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-03T17:14:03.359368] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-03T17:14:03.359439] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-03T17:14:03.359936] [DEBUG] [LOCAL ] AMTD: Trimmed 5580 records to 3698 (keeping 200 days of data) [2025-10-03T17:14:03.381718] [DEBUG] [LOCAL ] AMTD: Primary data saved (3698 records). [2025-10-03T17:14:03.381841] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-03T17:14:03.381945] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMTD took 18.5s. Estimated remaining: 4h 50m 0s. Rate: 7.8 symbols/min [2025-10-03T17:14:03.583403] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:03.594217] [DEBUG] [LOCAL ] AMWL: Loaded 8926 existing records from primary storage. [2025-10-03T17:14:03.594451] [INFO ] [MAIN ] AMWL: Loaded 8926 existing records. [2025-10-03T17:14:03.778881] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:03.779125] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-03T17:14:03.779173] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-03T17:14:03.779379] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-03T17:14:03.779437] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-03T17:14:03.996841] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-03T17:14:04.179270] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:04.272837] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T17:14:04.790684] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-03T17:14:05.590676] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-03T17:14:05.921587] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T17:14:06.390634] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-03T17:14:06.556718] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:14:06.646305] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:14:07.190688] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-03T17:14:07.990701] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-03T17:14:08.271602] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:14:08.273281] [INFO ] [REMOTE ] AMTB: Full fetch complete (29921 records). [2025-10-03T17:14:08.273377] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-03T17:14:08.496020] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T17:14:08.765357] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-03T17:14:08.765472] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-03T17:14:08.765993] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-03T17:14:08.766059] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-03T17:14:08.767472] [DEBUG] [LOCAL ] AMTB: Trimmed 29921 records to 20620 (keeping 200 days of data) [2025-10-03T17:14:08.823009] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-03T17:14:08.908141] [DEBUG] [LOCAL ] AMTB: Primary data saved (20620 records). [2025-10-03T17:14:08.908337] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-03T17:14:08.908475] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMTB took 26.0s. Estimated remaining: 4h 49m 8s. Rate: 7.8 symbols/min [2025-10-03T17:14:09.122614] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:09.132041] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:14:09.184487] [DEBUG] [LOCAL ] AMX: Loaded 49493 existing records from primary storage. [2025-10-03T17:14:09.184911] [INFO ] [MAIN ] AMX: Loaded 49493 existing records. [2025-10-03T17:14:09.376661] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:09.376898] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-03T17:14:09.376951] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-03T17:14:09.377524] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-03T17:14:09.377585] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-03T17:14:09.595932] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-03T17:14:09.779628] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:10.390673] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-03T17:14:10.591492] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:14:10.635119] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:14:11.190718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-03T17:14:11.990715] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-03T17:14:12.054184] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T17:14:12.144798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:14:12.790741] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-03T17:14:13.590634] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-03T17:14:13.788226] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:14:14.329929] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:14:14.390723] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-03T17:14:15.190687] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-03T17:14:15.226409] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:14:15.990729] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-03T17:14:16.007171] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T17:14:16.112011] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:14:16.790701] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-03T17:14:17.590870] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-03T17:14:17.958586] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T17:14:18.232488] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:14:18.317766] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T17:14:18.390638] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-03T17:14:19.190718] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-03T17:14:19.990696] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-03T17:14:20.117889] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:14:20.790748] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-03T17:14:20.858415] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:14:21.590723] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-03T17:14:21.903428] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:14:21.923977] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:14:22.390695] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-03T17:14:22.972737] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:14:23.122315] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:14:23.190720] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-03T17:14:23.990733] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-03T17:14:24.790638] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-03T17:14:24.799718] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:14:25.287776] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T17:14:25.590695] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-03T17:14:26.390621] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-03T17:14:26.510266] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:14:27.190630] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-03T17:14:27.370588] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:14:27.704725] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T17:14:27.990661] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-03T17:14:28.186359] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T17:14:28.189363] [INFO ] [REMOTE ] AMT: Full fetch complete (76016 records). [2025-10-03T17:14:28.189531] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-03T17:14:28.658924] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-03T17:14:28.659115] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-03T17:14:28.660019] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-03T17:14:28.660116] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-03T17:14:28.661912] [DEBUG] [LOCAL ] AMT: Trimmed 76016 records to 53193 (keeping 200 days of data) [2025-10-03T17:14:28.792177] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-03T17:14:29.029813] [DEBUG] [LOCAL ] AMT: Primary data saved (53193 records). [2025-10-03T17:14:29.029964] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-03T17:14:29.031347] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMT took 46.2s. Estimated remaining: 4h 53m 13s. Rate: 7.7 symbols/min [2025-10-03T17:14:29.238030] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:29.238427] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-03T17:14:29.238486] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-03T17:14:29.238612] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-03T17:14:29.238688] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-03T17:14:29.238751] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-03T17:14:29.238787] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-03T17:14:29.603215] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-03T17:14:29.661417] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:29.666210] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T17:14:29.858106] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:14:30.390690] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-03T17:14:31.170144] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:14:31.171562] [INFO ] [REMOTE ] AMWL: Full fetch complete (14144 records). [2025-10-03T17:14:31.171777] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-03T17:14:31.196880] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-03T17:14:31.627409] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-03T17:14:31.650922] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-03T17:14:31.651309] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-03T17:14:31.651674] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-03T17:14:31.654587] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T17:14:31.670351] [DEBUG] [LOCAL ] AMWL: Trimmed 14144 records to 9067 (keeping 200 days of data) [2025-10-03T17:14:31.725664] [DEBUG] [LOCAL ] AMWL: Primary data saved (9067 records). [2025-10-03T17:14:31.725822] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-03T17:14:31.725910] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMWL took 28.3s. Estimated remaining: 4h 51m 23s. Rate: 7.7 symbols/min [2025-10-03T17:14:31.908281] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:31.966575] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-03T17:14:31.967006] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-10-03T17:14:31.999408] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-03T17:14:32.165300] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:32.165565] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-03T17:14:32.165617] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-03T17:14:32.166238] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-03T17:14:32.166303] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-03T17:14:32.571176] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:32.790740] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-03T17:14:33.040024] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T17:14:33.578066] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T17:14:33.590626] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-03T17:14:34.390667] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-03T17:14:34.500298] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:14:34.652239] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T17:14:35.190730] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-03T17:14:35.990729] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-03T17:14:36.050476] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T17:14:36.606373] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T17:14:36.790735] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-03T17:14:37.590638] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-03T17:14:38.082855] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:14:38.390740] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-03T17:14:38.562148] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T17:14:38.565145] [INFO ] [REMOTE ] AMTM: Full fetch complete (73997 records). [2025-10-03T17:14:38.565315] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-03T17:14:39.016448] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-03T17:14:39.016576] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-03T17:14:39.017538] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-03T17:14:39.017671] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-03T17:14:39.019919] [DEBUG] [LOCAL ] AMTM: Trimmed 73997 records to 51421 (keeping 200 days of data) [2025-10-03T17:14:39.142144] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:14:39.232930] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-03T17:14:39.390532] [DEBUG] [LOCAL ] AMTM: Primary data saved (51421 records). [2025-10-03T17:14:39.390714] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-03T17:14:39.393549] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMTM took 38.3s. Estimated remaining: 4h 51m 14s. Rate: 7.7 symbols/min [2025-10-03T17:14:39.579045] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:39.579226] [DEBUG] [LOCAL ] ANF: No existing data file found in primary storage. [2025-10-03T17:14:39.579267] [WARN ] [MAIN ] ANF: No existing data found, performing full refresh instead. [2025-10-03T17:14:39.579388] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-03T17:14:39.579432] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-03T17:14:39.579476] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-03T17:14:39.579512] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-03T17:14:39.985447] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:40.000094] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-03T17:14:40.021216] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T17:14:40.790708] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-03T17:14:40.822505] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:14:41.590737] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-03T17:14:42.117587] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T17:14:42.390698] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-03T17:14:42.836670] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T17:14:42.992013] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:14:43.190734] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-03T17:14:43.990670] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-03T17:14:44.405345] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T17:14:44.619435] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:14:44.790737] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-03T17:14:45.534499] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:14:45.590681] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-03T17:14:46.037403] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T17:14:46.390704] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-03T17:14:47.190710] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-03T17:14:47.728297] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T17:14:47.990734] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-03T17:14:48.080407] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:14:48.349012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:14:48.351453] [INFO ] [REMOTE ] AMX: Full fetch complete (70766 records). [2025-10-03T17:14:48.351573] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-03T17:14:48.786896] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-03T17:14:48.786990] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-03T17:14:48.787762] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-03T17:14:48.787831] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-03T17:14:48.790700] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-03T17:14:48.791746] [DEBUG] [LOCAL ] AMX: Trimmed 70766 records to 49863 (keeping 200 days of data) [2025-10-03T17:14:49.109304] [DEBUG] [LOCAL ] AMX: Primary data saved (49863 records). [2025-10-03T17:14:49.109456] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-03T17:14:49.109559] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AMX took 40.2s. Estimated remaining: 4h 51m 45s. Rate: 7.7 symbols/min [2025-10-03T17:14:49.294701] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:49.294933] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-03T17:14:49.294991] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-03T17:14:49.295143] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-03T17:14:49.295188] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-03T17:14:49.295234] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-03T17:14:49.295275] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-03T17:14:49.601492] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-03T17:14:49.688823] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:49.833420] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T17:14:49.989309] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-03T17:14:50.390697] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-03T17:14:51.190696] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-03T17:14:51.485926] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T17:14:51.591573] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:14:51.990704] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-03T17:14:52.790695] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-03T17:14:53.597910] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-03T17:14:53.627736] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-03T17:14:53.660950] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T17:14:53.834559] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:14:53.834915] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-03T17:14:53.835027] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:14:53.835095] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-03T17:14:53.835164] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:14:53.835236] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-03T17:14:53.835303] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-03T17:14:53.835340] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-03T17:14:53.835432] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-03T17:14:53.835553] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. ANGX took 4.7s. Estimated remaining: 4h 50m 38s. Rate: 7.8 symbols/min [2025-10-03T17:14:54.031774] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:54.073610] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T17:14:54.092713] [DEBUG] [LOCAL ] ANRO: Loaded 18833 existing records from primary storage. [2025-10-03T17:14:54.092997] [INFO ] [MAIN ] ANRO: Loaded 18833 existing records. [2025-10-03T17:14:54.280856] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:54.281093] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-03T17:14:54.281144] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-03T17:14:54.281521] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-03T17:14:54.281582] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-03T17:14:54.399459] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-03T17:14:54.674616] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:55.190707] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-03T17:14:55.990704] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-03T17:14:56.153152] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:14:56.335424] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:14:56.337250] [INFO ] [REMOTE ] AN: Full fetch complete (47483 records). [2025-10-03T17:14:56.337342] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-03T17:14:56.753837] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-03T17:14:56.753935] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-03T17:14:56.754506] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-03T17:14:56.754555] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-03T17:14:56.755891] [DEBUG] [LOCAL ] AN: Trimmed 47483 records to 32323 (keeping 200 days of data) [2025-10-03T17:14:56.817941] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-03T17:14:56.968199] [DEBUG] [LOCAL ] AN: Primary data saved (32323 records). [2025-10-03T17:14:56.968361] [INFO ] [MAIN ] AN: Full history saved. [2025-10-03T17:14:56.968441] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. AN took 27.9s. Estimated remaining: 4h 49m 1s. Rate: 7.8 symbols/min [2025-10-03T17:14:57.202475] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:57.225456] [DEBUG] [LOCAL ] ANVS: Loaded 23369 existing records from primary storage. [2025-10-03T17:14:57.225892] [INFO ] [MAIN ] ANVS: Loaded 23369 existing records. [2025-10-03T17:14:57.416031] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:14:57.447125] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:57.447374] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-03T17:14:57.447431] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-03T17:14:57.447706] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-03T17:14:57.447772] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-03T17:14:57.595833] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-03T17:14:57.835034] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:58.390719] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-03T17:14:58.619541] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:14:58.974569] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T17:14:59.190707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-03T17:14:59.906234] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T17:14:59.990671] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-03T17:15:00.302767] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:15:00.790749] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-03T17:15:01.375491] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:15:01.590729] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-03T17:15:02.390697] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-03T17:15:03.120697] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:15:03.193956] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-03T17:15:03.201730] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T17:15:03.300090] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:15:03.990701] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-03T17:15:04.790726] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-03T17:15:05.486398] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-03T17:15:05.590694] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-03T17:15:05.923033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:15:06.390682] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-03T17:15:06.535806] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-03T17:15:07.141286] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:15:07.190734] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-03T17:15:07.365633] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T17:15:07.990744] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-03T17:15:08.790720] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-03T17:15:09.169076] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T17:15:09.306624] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:15:09.590703] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-03T17:15:10.039034] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:15:10.390740] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-03T17:15:11.190770] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-03T17:15:11.324334] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:15:11.598245] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:15:11.787089] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T17:15:11.990744] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-03T17:15:12.790728] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-03T17:15:13.168436] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:15:13.590719] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-03T17:15:14.390753] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-03T17:15:14.414480] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:15:14.418284] [INFO ] [REMOTE ] ANF: Full fetch complete (75603 records). [2025-10-03T17:15:14.418522] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-03T17:15:14.879099] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-03T17:15:14.879221] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-03T17:15:14.880133] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-03T17:15:14.880250] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-03T17:15:14.882013] [DEBUG] [LOCAL ] ANF: Trimmed 75603 records to 52869 (keeping 200 days of data) [2025-10-03T17:15:15.006446] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:15:15.205068] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-03T17:15:15.255302] [DEBUG] [LOCAL ] ANF: Primary data saved (52869 records). [2025-10-03T17:15:15.255454] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-03T17:15:15.255533] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. ANF took 35.9s. Estimated remaining: 4h 52m 17s. Rate: 7.7 symbols/min [2025-10-03T17:15:15.990732] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-03T17:15:16.453959] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:15:16.685413] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T17:15:16.790686] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-03T17:15:16.949985] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T17:15:17.590734] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-03T17:15:18.390739] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-03T17:15:18.718786] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:15:18.814055] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T17:15:19.190717] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-03T17:15:19.393425] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:15:19.990711] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-03T17:15:20.588564] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T17:15:20.590012] [INFO ] [REMOTE ] ANRO: Full fetch complete (28975 records). [2025-10-03T17:15:20.590175] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-03T17:15:20.590913] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:15:20.591022] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:15:20.591109] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:15:20.591198] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-03T17:15:20.591277] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-03T17:15:20.591326] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-03T17:15:20.591739] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-03T17:15:20.591930] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANRO took 26.8s. Estimated remaining: 4h 51m 22s. Rate: 7.7 symbols/min [2025-10-03T17:15:20.790715] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-03T17:15:21.636480] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-03T17:15:21.652043] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-03T17:15:21.929720] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:15:22.390701] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-03T17:15:23.360531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:15:23.362217] [INFO ] [REMOTE ] ANVS: Full fetch complete (36333 records). [2025-10-03T17:15:23.362311] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-03T17:15:23.802065] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-03T17:15:23.802162] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-03T17:15:23.802630] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-03T17:15:23.802724] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-03T17:15:23.803801] [DEBUG] [LOCAL ] ANVS: Trimmed 36333 records to 23555 (keeping 200 days of data) [2025-10-03T17:15:23.924172] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T17:15:23.928850] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-03T17:15:23.931784] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-03T17:15:24.124582] [DEBUG] [LOCAL ] ANVS: Primary data saved (23555 records). [2025-10-03T17:15:24.155786] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-03T17:15:24.176611] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANVS took 27.2s. Estimated remaining: 4h 49m 56s. Rate: 7.8 symbols/min [2025-10-03T17:15:24.392572] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-03T17:15:24.392687] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-03T17:15:24.393488] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-03T17:15:24.393554] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-03T17:15:24.395232] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54546 (keeping 200 days of data) [2025-10-03T17:15:24.743429] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-03T17:15:24.743584] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-03T17:15:24.743696] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANET took 53.0s. Estimated remaining: 4h 47m 34s. Rate: 7.8 symbols/min [2025-10-03T17:15:25.416832] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.512124] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-03T17:15:25.518919] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.509253] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.512419] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-03T17:15:25.540081] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-03T17:15:25.540306] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-03T17:15:25.542810] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-03T17:15:25.542894] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-03T17:15:25.542545] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.688284] [DEBUG] [LOCAL ] AOMR: Loaded 16644 existing records from primary storage. [2025-10-03T17:15:25.689329] [INFO ] [MAIN ] AOMR: Loaded 16644 existing records. [2025-10-03T17:15:25.854075] [DEBUG] [LOCAL ] AOD: Loaded 30406 existing records from primary storage. [2025-10-03T17:15:25.977459] [DEBUG] [LOCAL ] AON: Loaded 45726 existing records from primary storage. [2025-10-03T17:15:25.981898] [INFO ] [MAIN ] AOD: Loaded 30406 existing records. [2025-10-03T17:15:26.101940] [INFO ] [MAIN ] AON: Loaded 45726 existing records. [2025-10-03T17:15:26.273880] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.382923] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.416729] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-03T17:15:26.498719] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:26.480285] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-03T17:15:26.536105] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-03T17:15:26.536675] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-03T17:15:26.661024] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.830107] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.841159] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-03T17:15:26.840855] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.847232] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-03T17:15:26.847547] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-03T17:15:26.847437] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.858703] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:15:26.863930] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-03T17:15:26.904133] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-03T17:15:26.925051] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-03T17:15:26.975928] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:15:27.021515] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-03T17:15:27.021583] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-03T17:15:27.073623] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:15:27.130742] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-03T17:15:27.244405] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-03T17:15:27.270444] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-03T17:15:27.333984] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-03T17:15:27.415052] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOMD took 2.7s. Estimated remaining: 4h 45m 53s. Rate: 7.9 symbols/min [2025-10-03T17:15:27.608939] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:27.701627] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-03T17:15:27.950101] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:27.997502] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-03T17:15:28.160076] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:28.164843] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-03T17:15:28.164492] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:28.165806] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-03T17:15:28.165865] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-03T17:15:28.165982] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-03T17:15:28.166027] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-03T17:15:28.166070] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-03T17:15:28.166104] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-03T17:15:28.562124] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:28.563012] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-03T17:15:28.868571] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:15:28.871879] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-03T17:15:29.406805] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T17:15:29.415384] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-03T17:15:29.493591] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:15:29.510064] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T17:15:29.511875] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-03T17:15:29.590747] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-03T17:15:29.896453] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:15:30.389071] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T17:15:30.395286] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-03T17:15:30.505801] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:15:30.772712] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:15:31.190711] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-03T17:15:31.990707] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-03T17:15:32.127046] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:15:32.417979] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:15:32.790682] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-03T17:15:33.122765] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T17:15:33.590757] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-03T17:15:34.183206] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:15:34.390723] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-03T17:15:35.190706] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-03T17:15:35.224205] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:15:35.333248] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:15:35.990730] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-03T17:15:36.503372] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:15:36.790675] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-03T17:15:37.025028] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:15:37.590734] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-03T17:15:38.043916] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T17:15:38.390735] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-03T17:15:38.622868] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:15:39.190752] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-03T17:15:39.710221] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T17:15:39.756810] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:15:39.990718] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-03T17:15:40.790730] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-03T17:15:41.590740] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-03T17:15:41.906344] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T17:15:41.956937] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:15:42.387537] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T17:15:42.390895] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-03T17:15:43.191155] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-03T17:15:43.595097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:15:43.990724] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-03T17:15:44.790720] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-03T17:15:45.179005] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:15:45.233755] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:15:45.375191] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:15:45.590719] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-03T17:15:46.390735] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-03T17:15:46.983484] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T17:15:47.182237] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:15:47.183437] [INFO ] [REMOTE ] AOMR: Full fetch complete (23218 records). [2025-10-03T17:15:47.183569] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-03T17:15:47.195827] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-03T17:15:47.596413] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-03T17:15:47.596782] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-03T17:15:47.597239] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-03T17:15:47.597307] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-03T17:15:47.599340] [DEBUG] [LOCAL ] AOMR: Trimmed 23218 records to 16719 (keeping 200 days of data) [2025-10-03T17:15:47.711607] [DEBUG] [LOCAL ] AOMR: Primary data saved (16719 records). [2025-10-03T17:15:47.711798] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-03T17:15:47.711944] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AOMR took 23.0s. Estimated remaining: 4h 49m 39s. Rate: 7.8 symbols/min [2025-10-03T17:15:47.900455] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:47.950078] [DEBUG] [LOCAL ] AOS: Loaded 49194 existing records from primary storage. [2025-10-03T17:15:47.950468] [INFO ] [MAIN ] AOS: Loaded 49194 existing records. [2025-10-03T17:15:47.995890] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-03T17:15:48.142896] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:48.143209] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-03T17:15:48.143267] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-03T17:15:48.144082] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-03T17:15:48.144145] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-03T17:15:48.533283] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:48.790631] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-03T17:15:48.996700] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:15:49.253016] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T17:15:49.590739] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-03T17:15:50.390698] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-03T17:15:50.668526] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:15:50.772670] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:15:51.190690] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-03T17:15:51.532022] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:15:51.990749] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-03T17:15:52.790704] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-03T17:15:52.966116] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:15:53.366524] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:15:53.590690] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-03T17:15:53.832226] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:15:54.390688] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-03T17:15:55.190682] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-03T17:15:55.243521] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:15:55.990680] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-03T17:15:56.208668] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:15:56.611450] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:15:56.790740] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-03T17:15:57.390706] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:15:57.590716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-03T17:15:57.919793] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:15:58.390707] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-03T17:15:58.656470] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:15:58.658876] [INFO ] [REMOTE ] AORT: Full fetch complete (41997 records). [2025-10-03T17:15:58.659047] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-03T17:15:59.141750] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-03T17:15:59.141911] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-03T17:15:59.142465] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-03T17:15:59.142531] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-03T17:15:59.143965] [DEBUG] [LOCAL ] AORT: Trimmed 41997 records to 29872 (keeping 200 days of data) [2025-10-03T17:15:59.194433] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-03T17:15:59.328113] [DEBUG] [LOCAL ] AORT: Primary data saved (29872 records). [2025-10-03T17:15:59.328260] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-03T17:15:59.328335] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AORT took 31.8s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-03T17:15:59.514143] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:59.525936] [DEBUG] [LOCAL ] AP: Loaded 7211 existing records from primary storage. [2025-10-03T17:15:59.526152] [INFO ] [MAIN ] AP: Loaded 7211 existing records. [2025-10-03T17:15:59.717246] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:59.717451] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-03T17:15:59.717500] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-03T17:15:59.717768] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-03T17:15:59.717861] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-03T17:15:59.998113] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-03T17:16:00.123788] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:00.164886] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T17:16:00.436223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:16:00.438279] [INFO ] [REMOTE ] AOD: Full fetch complete (44307 records). [2025-10-03T17:16:00.438365] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-03T17:16:00.795764] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-03T17:16:00.885818] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-03T17:16:00.885900] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-03T17:16:00.886407] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-03T17:16:00.886470] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-03T17:16:00.887481] [DEBUG] [LOCAL ] AOD: Trimmed 44307 records to 30678 (keeping 200 days of data) [2025-10-03T17:16:01.086863] [DEBUG] [LOCAL ] AOD: Primary data saved (30678 records). [2025-10-03T17:16:01.087009] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-03T17:16:01.087109] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AOD took 36.3s. Estimated remaining: 4h 48m 46s. Rate: 7.8 symbols/min [2025-10-03T17:16:01.266471] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:01.306855] [DEBUG] [LOCAL ] APAM: Loaded 36350 existing records from primary storage. [2025-10-03T17:16:01.307692] [INFO ] [MAIN ] APAM: Loaded 36350 existing records. [2025-10-03T17:16:01.512998] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:01.513300] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-03T17:16:01.513426] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-03T17:16:01.513894] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-03T17:16:01.513965] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-03T17:16:01.601471] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-03T17:16:01.865763] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T17:16:02.037436] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:02.067131] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T17:16:02.390689] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-03T17:16:02.850476] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:16:03.114195] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T17:16:03.190741] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-03T17:16:03.843608] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:16:03.990689] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-03T17:16:04.790665] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-03T17:16:05.240577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:16:05.375802] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T17:16:05.590739] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-03T17:16:06.176076] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T17:16:06.390698] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-03T17:16:07.190714] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-03T17:16:07.749715] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:16:07.990714] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-03T17:16:08.619434] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:16:08.790720] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-03T17:16:09.369961] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T17:16:09.590738] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-03T17:16:10.202181] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T17:16:10.390713] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-03T17:16:11.122512] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T17:16:11.190633] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-03T17:16:11.435820] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:16:11.990706] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-03T17:16:12.594689] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:16:12.790703] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-03T17:16:13.516670] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:16:13.590726] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-03T17:16:13.916720] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:16:14.390724] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-03T17:16:14.940795] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:16:14.943118] [INFO ] [REMOTE ] AON: Full fetch complete (64693 records). [2025-10-03T17:16:14.943221] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-03T17:16:15.199960] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-03T17:16:15.394782] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-03T17:16:15.402728] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-03T17:16:15.403672] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-03T17:16:15.404153] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T17:16:15.404359] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-03T17:16:15.409059] [DEBUG] [LOCAL ] AON: Trimmed 64693 records to 45997 (keeping 200 days of data) [2025-10-03T17:16:15.720174] [DEBUG] [LOCAL ] AON: Primary data saved (45997 records). [2025-10-03T17:16:15.720321] [INFO ] [MAIN ] AON: Full history saved. [2025-10-03T17:16:15.721571] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 51.0s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-03T17:16:15.910001] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:15.957828] [DEBUG] [LOCAL ] APD: Loaded 45731 existing records from primary storage. [2025-10-03T17:16:15.958226] [INFO ] [MAIN ] APD: Loaded 45731 existing records. [2025-10-03T17:16:15.995829] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-03T17:16:16.170375] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:16.170636] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-03T17:16:16.170725] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-03T17:16:16.170989] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-03T17:16:16.171050] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-03T17:16:16.572337] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:16.772671] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:16:16.801689] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-03T17:16:16.808042] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T17:16:17.590738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-03T17:16:18.334892] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:16:18.390693] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-03T17:16:18.537305] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:16:18.983952] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T17:16:18.984985] [INFO ] [REMOTE ] AP: Full fetch complete (8951 records). [2025-10-03T17:16:18.985068] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-03T17:16:19.200027] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-03T17:16:19.412380] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-03T17:16:19.412466] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-03T17:16:19.412728] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-03T17:16:19.412794] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-03T17:16:19.413446] [DEBUG] [LOCAL ] AP: Trimmed 8951 records to 7267 (keeping 200 days of data) [2025-10-03T17:16:19.457297] [DEBUG] [LOCAL ] AP: Primary data saved (7267 records). [2025-10-03T17:16:19.457471] [INFO ] [MAIN ] AP: Full history saved. [2025-10-03T17:16:19.457571] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AP took 20.1s. Estimated remaining: 4h 49m 23s. Rate: 7.8 symbols/min [2025-10-03T17:16:19.687624] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:19.752406] [DEBUG] [LOCAL ] APG: Loaded 50572 existing records from primary storage. [2025-10-03T17:16:19.752858] [INFO ] [MAIN ] APG: Loaded 50572 existing records. [2025-10-03T17:16:19.951945] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:19.952192] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-03T17:16:19.952241] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-03T17:16:19.952508] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-03T17:16:19.952569] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-03T17:16:19.999154] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-03T17:16:20.361076] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:20.790702] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-03T17:16:20.967260] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:16:21.366819] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:16:21.369362] [INFO ] [REMOTE ] AOS: Full fetch complete (70617 records). [2025-10-03T17:16:21.369491] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-03T17:16:21.595926] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-03T17:16:21.813792] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-03T17:16:21.813898] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-03T17:16:21.814707] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-03T17:16:21.814853] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-03T17:16:21.816721] [DEBUG] [LOCAL ] AOS: Trimmed 70617 records to 49496 (keeping 200 days of data) [2025-10-03T17:16:22.227435] [DEBUG] [LOCAL ] AOS: Primary data saved (49496 records). [2025-10-03T17:16:22.227717] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-03T17:16:22.227880] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. AOS took 34.5s. Estimated remaining: 4h 47m 47s. Rate: 7.8 symbols/min [2025-10-03T17:16:22.402585] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-03T17:16:22.528838] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:22.606423] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:16:22.654195] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-03T17:16:22.654760] [INFO ] [MAIN ] APH: Loaded 54081 existing records. [2025-10-03T17:16:22.890134] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:22.890407] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-03T17:16:22.890458] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-03T17:16:22.890712] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-03T17:16:22.890784] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-03T17:16:23.195815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-03T17:16:23.351789] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:23.385120] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:16:23.990726] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-03T17:16:24.064448] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T17:16:24.523113] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:16:24.790701] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-03T17:16:25.378749] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T17:16:25.590707] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-03T17:16:26.390631] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-03T17:16:26.649234] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T17:16:26.940079] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:16:27.190686] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-03T17:16:27.990728] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-03T17:16:28.145311] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:16:28.601407] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:16:28.790751] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-03T17:16:29.590726] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-03T17:16:29.664206] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:16:30.288423] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:16:30.390689] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-03T17:16:31.190709] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-03T17:16:31.711327] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:16:31.990717] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-03T17:16:32.054525] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:16:32.672444] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T17:16:32.790713] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-03T17:16:33.565392] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T17:16:33.590634] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-03T17:16:34.364414] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:16:34.390701] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-03T17:16:35.083720] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:16:35.190706] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-03T17:16:35.990760] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-03T17:16:36.025795] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:16:36.543433] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T17:16:36.790718] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-03T17:16:37.590690] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-03T17:16:38.173084] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T17:16:38.390710] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-03T17:16:38.524262] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:16:38.913790] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:16:39.190698] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-03T17:16:39.990707] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-03T17:16:40.030038] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:16:40.790715] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-03T17:16:40.939739] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:16:41.005413] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T17:16:41.590727] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-03T17:16:42.390706] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-03T17:16:42.678415] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T17:16:43.204674] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-03T17:16:43.213461] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:16:43.630605] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:16:43.632794] [INFO ] [REMOTE ] APAM: Full fetch complete (51814 records). [2025-10-03T17:16:43.633015] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-03T17:16:43.999718] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-03T17:16:44.063278] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-03T17:16:44.063411] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-03T17:16:44.064180] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-03T17:16:44.064260] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-03T17:16:44.065688] [DEBUG] [LOCAL ] APAM: Trimmed 51814 records to 36607 (keeping 200 days of data) [2025-10-03T17:16:44.295149] [DEBUG] [LOCAL ] APAM: Primary data saved (36607 records). [2025-10-03T17:16:44.295310] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-03T17:16:44.296379] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APAM took 43.2s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-03T17:16:44.485759] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:44.486004] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-03T17:16:44.486064] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-03T17:16:44.486229] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-03T17:16:44.486285] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-03T17:16:44.486329] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-03T17:16:44.486362] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-03T17:16:44.795890] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-03T17:16:44.927117] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:45.395185] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-03T17:16:45.590636] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-03T17:16:45.937240] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T17:16:46.390683] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-03T17:16:46.603328] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T17:16:47.180707] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:16:47.192198] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-03T17:16:47.992889] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-03T17:16:47.995718] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:16:48.471515] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:16:48.790699] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-03T17:16:49.590743] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-03T17:16:50.249235] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T17:16:50.390718] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-03T17:16:50.525001] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:16:50.847178] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:16:50.850627] [INFO ] [REMOTE ] APG: Full fetch complete (71734 records). [2025-10-03T17:16:50.850817] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-03T17:16:51.196608] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-03T17:16:51.315692] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-03T17:16:51.315812] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-03T17:16:51.316704] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-03T17:16:51.316772] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-03T17:16:51.318383] [DEBUG] [LOCAL ] APG: Trimmed 71734 records to 50954 (keeping 200 days of data) [2025-10-03T17:16:51.637340] [DEBUG] [LOCAL ] APG: Primary data saved (50954 records). [2025-10-03T17:16:51.637499] [INFO ] [MAIN ] APG: Full history saved. [2025-10-03T17:16:51.637691] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. APG took 32.2s. Estimated remaining: 4h 51m 35s. Rate: 7.7 symbols/min [2025-10-03T17:16:51.821502] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:51.884797] [DEBUG] [LOCAL ] APO: Loaded 53773 existing records from primary storage. [2025-10-03T17:16:51.885180] [INFO ] [MAIN ] APO: Loaded 53773 existing records. [2025-10-03T17:16:51.992031] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-03T17:16:52.075567] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:52.075813] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-03T17:16:52.075866] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-03T17:16:52.076893] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-03T17:16:52.076957] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-03T17:16:52.383930] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T17:16:52.403577] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-03T17:16:52.439829] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-03T17:16:52.472271] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:52.800974] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-03T17:16:52.948148] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-03T17:16:52.948286] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-03T17:16:52.949462] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-03T17:16:52.949606] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-03T17:16:52.976497] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T17:16:52.987191] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 54471 (keeping 200 days of data) [2025-10-03T17:16:53.364887] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:16:53.397260] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-03T17:16:53.397429] [INFO ] [MAIN ] APH: Full history saved. [2025-10-03T17:16:53.397521] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APH took 31.2s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-03T17:16:53.589106] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:53.589277] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-03T17:16:53.589360] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-03T17:16:53.589484] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-03T17:16:53.589540] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-03T17:16:53.589584] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-03T17:16:53.589618] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-03T17:16:53.601468] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-03T17:16:53.972506] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:54.390705] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-03T17:16:54.929522] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T17:16:55.190630] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-03T17:16:55.416179] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:16:55.842499] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:16:55.990715] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-03T17:16:56.586074] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:16:56.790698] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-03T17:16:57.085416] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:16:57.087593] [INFO ] [REMOTE ] APD: Full fetch complete (66482 records). [2025-10-03T17:16:57.087726] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-03T17:16:57.088733] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:16:57.088824] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:16:57.088873] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:16:57.088958] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-03T17:16:57.089040] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-03T17:16:57.089093] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-10-03T17:16:57.089497] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-10-03T17:16:57.090549] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APD took 41.4s. Estimated remaining: 4h 48m 26s. Rate: 7.8 symbols/min [2025-10-03T17:16:57.282085] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:57.338080] [DEBUG] [LOCAL ] APTV: Loaded 52472 existing records from primary storage. [2025-10-03T17:16:57.338500] [INFO ] [MAIN ] APTV: Loaded 52472 existing records. [2025-10-03T17:16:57.542383] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:57.542624] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-03T17:16:57.542722] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-03T17:16:57.544438] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-03T17:16:57.544503] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-03T17:16:57.592086] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-03T17:16:57.755577] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:16:57.948566] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:58.390725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-03T17:16:59.190685] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-03T17:16:59.439421] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:16:59.859223] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T17:16:59.990742] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-03T17:17:00.326195] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T17:17:00.757104] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:17:00.790712] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-03T17:17:01.590725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-03T17:17:02.390702] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-03T17:17:02.716595] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:17:02.855273] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-03T17:17:03.190724] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-03T17:17:03.407277] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:17:03.990747] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-03T17:17:04.790732] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-03T17:17:05.432217] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:17:05.590728] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-03T17:17:05.716636] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:17:06.390710] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-03T17:17:06.782094] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:17:07.004846] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T17:17:07.190672] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-03T17:17:07.339291] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:17:07.990705] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-03T17:17:08.258933] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:17:08.790738] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-03T17:17:09.576440] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:17:09.590611] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-03T17:17:10.390684] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-03T17:17:10.523140] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T17:17:11.148424] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:17:11.190695] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-03T17:17:11.563296] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T17:17:11.790222] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T17:17:11.990731] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-03T17:17:12.596482] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:17:12.790736] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-03T17:17:12.899579] [DEBUG] [REMOTE ] APLE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T17:17:12.899960] [WARN ] [REMOTE ] APLE: No data returned for month 2025-08 [2025-10-03T17:17:12.900069] [FATAL] [REMOTE ] APLE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:17:12.900221] [FATAL] [MAIN ] APLE: Failed to fetch primary data. [2025-10-03T17:17:12.900302] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:17:12.900378] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-03T17:17:12.900451] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-03T17:17:12.900492] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-03T17:17:12.900555] [DEBUG] [LOCAL ] APLE: No derivative data file found to delete. [2025-10-03T17:17:12.900708] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APLE took 28.6s. Estimated remaining: 4h 50m 35s. Rate: 7.7 symbols/min [2025-10-03T17:17:13.100043] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:13.160867] [DEBUG] [LOCAL ] AQN: Loaded 52288 existing records from primary storage. [2025-10-03T17:17:13.161233] [INFO ] [MAIN ] AQN: Loaded 52288 existing records. [2025-10-03T17:17:13.353598] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:13.353857] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-03T17:17:13.353911] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-03T17:17:13.355552] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-03T17:17:13.355618] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-03T17:17:13.595898] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-03T17:17:13.776172] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:14.390713] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-03T17:17:15.190738] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-03T17:17:15.481752] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:17:15.990729] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-03T17:17:16.250299] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T17:17:16.790738] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-03T17:17:17.097886] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T17:17:17.277622] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-03T17:17:17.590623] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-03T17:17:17.797288] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:17:18.390731] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-03T17:17:19.190621] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-03T17:17:19.334749] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T17:17:19.335755] [INFO ] [REMOTE ] APOS: Full fetch complete (10440 records). [2025-10-03T17:17:19.335830] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-03T17:17:19.663073] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T17:17:19.784128] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-03T17:17:19.784231] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-03T17:17:19.784542] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-03T17:17:19.784587] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-03T17:17:19.785136] [DEBUG] [LOCAL ] APOS: Trimmed 10440 records to 7664 (keeping 200 days of data) [2025-10-03T17:17:19.834989] [DEBUG] [LOCAL ] APOS: Primary data saved (7664 records). [2025-10-03T17:17:19.835143] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-03T17:17:19.835251] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APOS took 26.4s. Estimated remaining: 4h 50m 13s. Rate: 7.7 symbols/min [2025-10-03T17:17:20.017004] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-03T17:17:20.059493] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:20.067110] [DEBUG] [LOCAL ] AQNB: Loaded 4183 existing records from primary storage. [2025-10-03T17:17:20.067284] [INFO ] [MAIN ] AQNB: Loaded 4183 existing records. [2025-10-03T17:17:20.265800] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:20.266039] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-03T17:17:20.266089] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-03T17:17:20.266418] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-03T17:17:20.266481] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-03T17:17:20.657946] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:20.790713] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-03T17:17:21.041098] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:17:21.590737] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-03T17:17:22.026182] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:17:22.201355] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:17:22.390727] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-03T17:17:23.180451] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T17:17:23.190627] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-03T17:17:23.320350] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:17:23.990721] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-03T17:17:24.790730] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-03T17:17:24.972449] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:17:25.281839] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T17:17:25.590740] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-03T17:17:25.929758] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T17:17:26.390725] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-03T17:17:26.823701] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:17:27.190706] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-03T17:17:27.481674] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T17:17:27.761341] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:17:27.990712] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-03T17:17:28.695841] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T17:17:28.790717] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-03T17:17:29.590743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-03T17:17:30.193026] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T17:17:30.390746] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-03T17:17:30.694617] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:17:31.190727] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-03T17:17:31.990689] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-03T17:17:32.137684] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:17:32.790724] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-03T17:17:33.070107] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:17:33.585905] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:17:33.596860] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-03T17:17:34.390688] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-03T17:17:34.535448] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:17:34.538105] [INFO ] [REMOTE ] APO: Full fetch complete (76902 records). [2025-10-03T17:17:34.538221] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-03T17:17:34.539196] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:17:34.539295] [FATAL] [MAIN ] APO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:17:34.539341] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:17:34.539384] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-03T17:17:34.539445] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-03T17:17:34.539482] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-10-03T17:17:34.539745] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-10-03T17:17:34.539864] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APO took 42.9s. Estimated remaining: 4h 52m 1s. Rate: 7.7 symbols/min [2025-10-03T17:17:34.735005] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:34.730840] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:17:34.797762] [DEBUG] [LOCAL ] AR: Loaded 53973 existing records from primary storage. [2025-10-03T17:17:34.798191] [INFO ] [MAIN ] AR: Loaded 53973 existing records. [2025-10-03T17:17:34.994252] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:34.994496] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-03T17:17:34.994547] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-03T17:17:34.995792] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-03T17:17:34.995853] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-03T17:17:35.200186] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-03T17:17:35.389918] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:35.990699] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-03T17:17:36.563953] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T17:17:36.733364] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-03T17:17:36.790742] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-03T17:17:36.962725] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T17:17:37.264788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T17:17:37.590729] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-03T17:17:38.390808] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-03T17:17:39.190687] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-03T17:17:39.527755] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:17:39.909990] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:17:39.913002] [INFO ] [REMOTE ] APTV: Full fetch complete (75915 records). [2025-10-03T17:17:39.913155] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-03T17:17:39.995803] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-03T17:17:40.356818] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-03T17:17:40.356956] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-03T17:17:40.357911] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-03T17:17:40.358045] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-03T17:17:40.359795] [DEBUG] [LOCAL ] APTV: Trimmed 75915 records to 52852 (keeping 200 days of data) [2025-10-03T17:17:40.460197] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T17:17:40.698340] [DEBUG] [LOCAL ] APTV: Primary data saved (52852 records). [2025-10-03T17:17:40.698491] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-03T17:17:40.699228] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. APTV took 43.6s. Estimated remaining: 4h 51m 25s. Rate: 7.7 symbols/min [2025-10-03T17:17:40.795748] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-03T17:17:40.896253] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:40.942455] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:17:40.988859] [DEBUG] [LOCAL ] ARCO: Loaded 44724 existing records from primary storage. [2025-10-03T17:17:40.989206] [INFO ] [MAIN ] ARCO: Loaded 44724 existing records. [2025-10-03T17:17:41.183882] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:41.184101] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-03T17:17:41.184152] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-03T17:17:41.184408] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-03T17:17:41.184468] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-03T17:17:41.584862] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:41.590688] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-03T17:17:42.390724] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-03T17:17:42.684600] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T17:17:43.190678] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-03T17:17:43.249504] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:17:43.955818] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:17:43.990735] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-03T17:17:44.694194] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:17:44.695105] [INFO ] [REMOTE ] AQNB: Full fetch complete (5690 records). [2025-10-03T17:17:44.695213] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-03T17:17:44.793748] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-03T17:17:45.050390] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T17:17:45.140233] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-03T17:17:45.140320] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-03T17:17:45.140486] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-03T17:17:45.140530] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-03T17:17:45.141091] [DEBUG] [LOCAL ] AQNB: Trimmed 5690 records to 4198 (keeping 200 days of data) [2025-10-03T17:17:45.169425] [DEBUG] [LOCAL ] AQNB: Primary data saved (4198 records). [2025-10-03T17:17:45.169575] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-03T17:17:45.169708] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. AQNB took 25.3s. Estimated remaining: 4h 50m 22s. Rate: 7.7 symbols/min [2025-10-03T17:17:45.349291] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:45.371356] [DEBUG] [LOCAL ] ARDC: Loaded 14882 existing records from primary storage. [2025-10-03T17:17:45.371615] [INFO ] [MAIN ] ARDC: Loaded 14882 existing records. [2025-10-03T17:17:45.567049] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:45.567266] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-03T17:17:45.567320] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-03T17:17:45.567578] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-03T17:17:45.567639] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-03T17:17:45.603440] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-03T17:17:45.976810] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:46.390758] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-03T17:17:46.611120] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T17:17:47.145762] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:17:47.149170] [INFO ] [REMOTE ] AQN: Full fetch complete (74928 records). [2025-10-03T17:17:47.149346] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-03T17:17:47.150333] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:17:47.150485] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:17:47.150549] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:17:47.150634] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-03T17:17:47.150760] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-03T17:17:47.150828] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-03T17:17:47.151297] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-03T17:17:47.152016] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. AQN took 34.3s. Estimated remaining: 4h 48m 40s. Rate: 7.7 symbols/min [2025-10-03T17:17:47.198510] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-03T17:17:47.353872] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:47.355143] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:17:47.394946] [DEBUG] [LOCAL ] ARDT: Loaded 27847 existing records from primary storage. [2025-10-03T17:17:47.395273] [INFO ] [MAIN ] ARDT: Loaded 27847 existing records. [2025-10-03T17:17:47.585803] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:47.586046] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-03T17:17:47.586117] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-03T17:17:47.586387] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-03T17:17:47.586446] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-03T17:17:47.971479] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:47.990674] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-03T17:17:48.790634] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-03T17:17:49.087865] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:17:49.250694] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:17:49.590739] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-03T17:17:50.390630] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-03T17:17:50.431257] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:17:50.449544] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T17:17:51.190690] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-03T17:17:51.990671] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-03T17:17:52.128131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:17:52.507058] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:17:52.790697] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-03T17:17:53.590711] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-03T17:17:53.684755] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:17:53.741503] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:17:54.390702] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-03T17:17:55.190683] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-03T17:17:55.558801] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T17:17:55.799342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:17:55.990765] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-03T17:17:56.533460] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T17:17:56.790677] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-03T17:17:56.908318] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:17:57.590766] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-03T17:17:58.390736] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-03T17:17:58.467821] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:17:58.492435] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T17:17:59.190765] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-03T17:17:59.990693] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-03T17:18:00.134825] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:18:00.183297] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:18:00.790770] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-03T17:18:01.590715] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-03T17:18:01.899598] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:18:02.064137] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T17:18:02.390745] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-03T17:18:02.455552] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T17:18:03.190713] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-03T17:18:03.524966] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:18:03.990771] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-03T17:18:04.790739] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-03T17:18:05.089290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:18:05.118765] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:18:05.590750] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-03T17:18:06.390729] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-03T17:18:06.899778] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T17:18:07.146932] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:18:07.190732] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-03T17:18:07.711156] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:18:07.990738] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-03T17:18:08.200830] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:18:08.790703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-03T17:18:09.590684] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-03T17:18:09.830937] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T17:18:10.077080] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T17:18:10.390633] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-03T17:18:10.843628] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T17:18:11.190697] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-03T17:18:11.990685] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-03T17:18:12.095595] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T17:18:12.100073] [INFO ] [REMOTE ] AR: Full fetch complete (77541 records). [2025-10-03T17:18:12.100198] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-03T17:18:12.542503] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-03T17:18:12.542620] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-03T17:18:12.543729] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-03T17:18:12.543867] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-03T17:18:12.560482] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:18:12.568039] [DEBUG] [LOCAL ] AR: Trimmed 77541 records to 54363 (keeping 200 days of data) [2025-10-03T17:18:12.790780] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-03T17:18:12.907406] [DEBUG] [LOCAL ] AR: Primary data saved (54363 records). [2025-10-03T17:18:12.907585] [INFO ] [MAIN ] AR: Full history saved. [2025-10-03T17:18:12.907755] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 38.4s. Estimated remaining: 4h 53m 23s. Rate: 7.6 symbols/min [2025-10-03T17:18:13.039974] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:18:13.116407] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:13.166818] [DEBUG] [LOCAL ] ARE: Loaded 51001 existing records from primary storage. [2025-10-03T17:18:13.167169] [INFO ] [MAIN ] ARE: Loaded 51001 existing records. [2025-10-03T17:18:13.354763] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:13.354998] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-03T17:18:13.355069] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-03T17:18:13.355327] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-03T17:18:13.355389] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-03T17:18:13.597154] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-03T17:18:13.734834] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:13.833597] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:18:13.835539] [INFO ] [REMOTE ] ARDT: Full fetch complete (41396 records). [2025-10-03T17:18:13.835632] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-03T17:18:14.241673] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-03T17:18:14.241769] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-03T17:18:14.242329] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-03T17:18:14.242393] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-03T17:18:14.243515] [DEBUG] [LOCAL ] ARDT: Trimmed 41396 records to 28156 (keeping 200 days of data) [2025-10-03T17:18:14.393827] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-03T17:18:14.429078] [DEBUG] [LOCAL ] ARDT: Primary data saved (28156 records). [2025-10-03T17:18:14.429215] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-03T17:18:14.429307] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDT took 27.3s. Estimated remaining: 4h 51m 33s. Rate: 7.7 symbols/min [2025-10-03T17:18:14.642879] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:14.654603] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:18:14.715787] [DEBUG] [LOCAL ] ARES: Loaded 49934 existing records from primary storage. [2025-10-03T17:18:14.716204] [INFO ] [MAIN ] ARES: Loaded 49934 existing records. [2025-10-03T17:18:14.912612] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:14.912921] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-03T17:18:14.912997] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-03T17:18:14.913253] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-03T17:18:14.913315] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-03T17:18:15.195799] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-03T17:18:15.318192] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:15.990667] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-03T17:18:16.164946] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T17:18:16.743220] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:18:16.790690] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-03T17:18:16.851199] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:18:16.852557] [INFO ] [REMOTE ] ARDC: Full fetch complete (20806 records). [2025-10-03T17:18:16.852661] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-03T17:18:17.263209] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-03T17:18:17.263288] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-03T17:18:17.263594] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-03T17:18:17.263635] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-03T17:18:17.264259] [DEBUG] [LOCAL ] ARDC: Trimmed 20806 records to 15051 (keeping 200 days of data) [2025-10-03T17:18:17.368602] [DEBUG] [LOCAL ] ARDC: Primary data saved (15051 records). [2025-10-03T17:18:17.368958] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-03T17:18:17.369078] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARDC took 32.2s. Estimated remaining: 4h 50m 7s. Rate: 7.7 symbols/min [2025-10-03T17:18:17.561675] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:17.590736] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-03T17:18:17.609521] [DEBUG] [LOCAL ] ARI: Loaded 43834 existing records from primary storage. [2025-10-03T17:18:17.609887] [INFO ] [MAIN ] ARI: Loaded 43834 existing records. [2025-10-03T17:18:17.810856] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:17.811104] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-03T17:18:17.811164] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-03T17:18:17.811490] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-03T17:18:17.811553] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-03T17:18:18.225824] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:18.390724] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-03T17:18:18.481414] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:18:19.190693] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-03T17:18:19.404231] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:18:19.990737] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-03T17:18:20.216913] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:18:20.790754] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-03T17:18:20.830217] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:18:21.595851] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-03T17:18:21.599275] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:18:22.390683] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-03T17:18:22.500872] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:18:23.173370] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:18:23.190608] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-03T17:18:23.845200] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:18:23.990693] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-03T17:18:24.445720] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:18:24.448414] [INFO ] [REMOTE ] ARCO: Full fetch complete (65379 records). [2025-10-03T17:18:24.448770] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-03T17:18:24.795769] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-03T17:18:24.884248] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-03T17:18:24.884345] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-03T17:18:24.885076] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-03T17:18:24.885149] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-03T17:18:24.886616] [DEBUG] [LOCAL ] ARCO: Trimmed 65379 records to 44983 (keeping 200 days of data) [2025-10-03T17:18:25.165096] [DEBUG] [LOCAL ] ARCO: Primary data saved (44983 records). [2025-10-03T17:18:25.165243] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-03T17:18:25.165905] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARCO took 44.5s. Estimated remaining: 4h 49m 59s. Rate: 7.7 symbols/min [2025-10-03T17:18:25.395945] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:25.396274] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-10-03T17:18:25.396351] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-10-03T17:18:25.396742] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-03T17:18:25.396848] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-03T17:18:25.397035] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-03T17:18:25.397094] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-03T17:18:25.592248] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-03T17:18:25.655708] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:18:25.829460] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:26.390910] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-03T17:18:26.593725] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:18:27.190633] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-03T17:18:27.298466] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:18:27.753940] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:18:27.990710] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-03T17:18:28.790707] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-03T17:18:29.228718] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:18:29.285679] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:18:29.590692] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-03T17:18:30.204586] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:18:30.390733] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-03T17:18:31.190639] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-03T17:18:31.668932] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T17:18:31.763100] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:18:31.990700] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-03T17:18:32.790706] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-03T17:18:32.833439] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:18:33.590696] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-03T17:18:33.855180] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T17:18:34.392527] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-03T17:18:34.395278] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:18:35.190745] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-03T17:18:35.431396] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T17:18:35.988562] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:18:35.991996] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-03T17:18:36.790671] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-03T17:18:36.880305] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T17:18:37.590744] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-03T17:18:37.846099] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T17:18:38.390744] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-03T17:18:38.510105] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:18:39.190742] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-03T17:18:39.456272] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:18:39.990623] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-03T17:18:40.269062] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:18:40.790691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-03T17:18:40.881909] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:18:41.590677] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-03T17:18:41.734751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:18:42.390731] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-03T17:18:42.461585] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:18:43.143317] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:18:43.190700] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-03T17:18:43.886613] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:18:43.990720] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-03T17:18:44.421690] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:18:44.424394] [INFO ] [REMOTE ] ARE: Full fetch complete (72649 records). [2025-10-03T17:18:44.424520] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-03T17:18:44.797229] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-03T17:18:44.861749] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-03T17:18:44.861842] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-03T17:18:44.862666] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-03T17:18:44.862750] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-03T17:18:44.864339] [DEBUG] [LOCAL ] ARE: Trimmed 72649 records to 51371 (keeping 200 days of data) [2025-10-03T17:18:45.197179] [DEBUG] [LOCAL ] ARE: Primary data saved (51371 records). [2025-10-03T17:18:45.197355] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-03T17:18:45.197479] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 32.3s. Estimated remaining: 4h 53m 3s. Rate: 7.6 symbols/min [2025-10-03T17:18:45.394934] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:45.439749] [DEBUG] [LOCAL ] ARLO: Loaded 44159 existing records from primary storage. [2025-10-03T17:18:45.440103] [INFO ] [MAIN ] ARLO: Loaded 44159 existing records. [2025-10-03T17:18:45.616521] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-03T17:18:45.675894] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:45.680829] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-03T17:18:45.680943] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-03T17:18:45.681372] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-03T17:18:45.684693] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:18:45.684909] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-03T17:18:46.092749] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:46.390711] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-03T17:18:46.475440] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:18:47.195891] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-03T17:18:47.203826] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:18:47.871285] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:18:47.990697] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-03T17:18:48.775307] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:18:48.790703] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-03T17:18:49.145729] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:18:49.148301] [INFO ] [REMOTE ] ARI: Full fetch complete (62849 records). [2025-10-03T17:18:49.148475] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-03T17:18:49.573433] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-03T17:18:49.573524] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-03T17:18:49.574207] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-03T17:18:49.574275] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-03T17:18:49.575787] [DEBUG] [LOCAL ] ARI: Trimmed 62849 records to 44168 (keeping 200 days of data) [2025-10-03T17:18:49.635733] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-03T17:18:49.864422] [DEBUG] [LOCAL ] ARI: Primary data saved (44168 records). [2025-10-03T17:18:49.864582] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-03T17:18:49.864738] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARI took 32.5s. Estimated remaining: 4h 52m 5s. Rate: 7.6 symbols/min [2025-10-03T17:18:50.049518] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:50.101586] [DEBUG] [LOCAL ] ARMK: Loaded 50699 existing records from primary storage. [2025-10-03T17:18:50.101984] [INFO ] [MAIN ] ARMK: Loaded 50699 existing records. [2025-10-03T17:18:50.295639] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:50.295942] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-03T17:18:50.295991] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-03T17:18:50.296505] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-03T17:18:50.296566] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-03T17:18:50.398494] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-03T17:18:50.657586] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T17:18:50.741309] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:51.190729] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-03T17:18:51.471364] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:18:51.990662] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-03T17:18:52.068264] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:18:52.790729] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-03T17:18:52.950679] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T17:18:53.254165] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:18:53.590718] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-03T17:18:53.901795] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:18:54.390736] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-03T17:18:55.190697] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-03T17:18:55.335384] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:18:55.856399] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:18:55.990726] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-03T17:18:56.361850] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:18:56.790701] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-03T17:18:57.524095] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:18:57.526791] [INFO ] [REMOTE ] ARES: Full fetch complete (70800 records). [2025-10-03T17:18:57.526902] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-03T17:18:57.601427] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-03T17:18:57.968973] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-03T17:18:57.969090] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-03T17:18:57.969993] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-03T17:18:57.970174] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-03T17:18:57.973001] [DEBUG] [LOCAL ] ARES: Trimmed 70800 records to 50322 (keeping 200 days of data) [2025-10-03T17:18:58.228467] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:18:58.341483] [DEBUG] [LOCAL ] ARES: Primary data saved (50322 records). [2025-10-03T17:18:58.341660] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-03T17:18:58.342712] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARES took 43.9s. Estimated remaining: 4h 52m 7s. Rate: 7.6 symbols/min [2025-10-03T17:18:58.401199] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-03T17:18:58.533277] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:58.590492] [DEBUG] [LOCAL ] AROC: Loaded 49327 existing records from primary storage. [2025-10-03T17:18:58.590890] [INFO ] [MAIN ] AROC: Loaded 49327 existing records. [2025-10-03T17:18:58.796234] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:58.796466] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-03T17:18:58.796516] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-03T17:18:58.797437] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-03T17:18:58.797508] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-03T17:18:59.185210] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:59.190613] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-03T17:18:59.327934] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:18:59.738749] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:18:59.741127] [INFO ] [REMOTE ] ARIS: Full fetch complete (60359 records). [2025-10-03T17:18:59.741239] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-03T17:18:59.742069] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:18:59.742178] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:18:59.742259] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:18:59.742380] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-03T17:18:59.742480] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-03T17:18:59.742531] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-10-03T17:18:59.742577] [DEBUG] [LOCAL ] ARIS: No derivative data file found to delete. [2025-10-03T17:18:59.742693] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARIS took 34.6s. Estimated remaining: 4h 50m 19s. Rate: 7.7 symbols/min [2025-10-03T17:18:59.927416] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:59.990876] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-03T17:18:59.995811] [DEBUG] [LOCAL ] ARR: Loaded 52419 existing records from primary storage. [2025-10-03T17:18:59.996315] [INFO ] [MAIN ] ARR: Loaded 52419 existing records. [2025-10-03T17:19:00.200992] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:00.201278] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-03T17:19:00.201341] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-03T17:19:00.201816] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-03T17:19:00.201878] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-03T17:19:00.577156] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:00.790679] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-03T17:19:01.040831] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:19:01.590733] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-03T17:19:01.898367] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:19:02.390639] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-03T17:19:02.567721] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:19:03.190713] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-03T17:19:03.422389] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:19:03.632317] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T17:19:03.990734] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-03T17:19:04.790724] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-03T17:19:04.996002] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T17:19:05.595839] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-03T17:19:05.620240] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T17:19:06.390731] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-03T17:19:06.695282] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:19:07.043683] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:19:07.190713] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-03T17:19:07.684125] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:19:07.990723] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-03T17:19:08.790720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-03T17:19:09.099664] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:19:09.498632] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:19:09.590681] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-03T17:19:10.390676] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-03T17:19:10.452727] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:19:11.180352] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:19:11.190631] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-03T17:19:11.990699] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-03T17:19:12.034109] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:19:12.790696] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-03T17:19:13.087741] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:19:13.590680] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-03T17:19:13.718756] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:19:14.390677] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-03T17:19:14.813893] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T17:19:14.897922] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:19:15.190719] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-03T17:19:15.990716] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-03T17:19:16.326106] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T17:19:16.790743] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-03T17:19:16.990156] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:19:17.534887] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:19:17.590919] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-03T17:19:18.390690] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-03T17:19:18.601819] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T17:19:19.042015] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:19:19.044402] [INFO ] [REMOTE ] ARLO: Full fetch complete (62888 records). [2025-10-03T17:19:19.044509] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-03T17:19:19.198158] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-03T17:19:19.461820] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-03T17:19:19.461929] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-03T17:19:19.462632] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-03T17:19:19.462731] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-03T17:19:19.464254] [DEBUG] [LOCAL ] ARLO: Trimmed 62888 records to 44465 (keeping 200 days of data) [2025-10-03T17:19:19.736328] [DEBUG] [LOCAL ] ARLO: Primary data saved (44465 records). [2025-10-03T17:19:19.736456] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-03T17:19:19.736557] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARLO took 34.5s. Estimated remaining: 4h 53m 17s. Rate: 7.6 symbols/min [2025-10-03T17:19:19.938330] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:19.974365] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T17:19:19.991713] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-03T17:19:20.033557] [DEBUG] [LOCAL ] ARW: Loaded 33339 existing records from primary storage. [2025-10-03T17:19:20.033954] [INFO ] [MAIN ] ARW: Loaded 33339 existing records. [2025-10-03T17:19:20.227711] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:20.227955] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-03T17:19:20.228065] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-03T17:19:20.228865] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-03T17:19:20.228930] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-03T17:19:20.619608] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:20.790695] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-03T17:19:21.000214] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T17:19:21.360092] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T17:19:21.590747] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-03T17:19:21.751096] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:19:22.390694] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-03T17:19:23.172892] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:19:23.190620] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-03T17:19:23.854755] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:19:23.990698] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-03T17:19:24.790670] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-03T17:19:24.830441] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:19:25.590725] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-03T17:19:26.008611] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:19:26.042806] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:19:26.390720] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-03T17:19:26.930780] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T17:19:27.190698] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-03T17:19:27.990723] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-03T17:19:28.421756] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:19:28.532954] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:19:28.535603] [INFO ] [REMOTE ] AROC: Full fetch complete (70890 records). [2025-10-03T17:19:28.535795] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-03T17:19:28.797544] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-03T17:19:28.987776] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-03T17:19:28.987913] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-03T17:19:28.989152] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-03T17:19:28.989387] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-03T17:19:29.012006] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T17:19:29.020539] [DEBUG] [LOCAL ] AROC: Trimmed 70890 records to 49675 (keeping 200 days of data) [2025-10-03T17:19:29.335106] [DEBUG] [LOCAL ] AROC: Primary data saved (49675 records). [2025-10-03T17:19:29.335261] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-03T17:19:29.336371] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. AROC took 31.0s. Estimated remaining: 4h 53m 34s. Rate: 7.6 symbols/min [2025-10-03T17:19:29.529403] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:29.529602] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-03T17:19:29.529664] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-03T17:19:29.529814] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-03T17:19:29.529862] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-03T17:19:29.529906] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-03T17:19:29.529940] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-03T17:19:29.599404] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-03T17:19:29.927482] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:30.390719] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-03T17:19:30.577446] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:19:30.577790] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-03T17:19:30.577912] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:19:30.578052] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-03T17:19:30.578140] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:19:30.578245] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-03T17:19:30.578346] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-03T17:19:30.578403] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-03T17:19:30.578465] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-03T17:19:30.578534] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. ARX took 1.2s. Estimated remaining: 4h 51m 46s. Rate: 7.6 symbols/min [2025-10-03T17:19:30.707957] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T17:19:30.749088] [INFO ] [REMOTE ] ARMK: Full fetch complete (72605 records). [2025-10-03T17:19:30.786369] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:30.784854] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-03T17:19:31.194141] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-03T17:19:31.221934] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:19:31.177145] [DEBUG] [LOCAL ] AS: Loaded 53472 existing records from primary storage. [2025-10-03T17:19:31.291272] [INFO ] [MAIN ] AS: Loaded 53472 existing records. [2025-10-03T17:19:31.328441] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-03T17:19:31.364676] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-03T17:19:31.377865] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-03T17:19:31.404036] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-03T17:19:31.495892] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:31.489817] [DEBUG] [LOCAL ] ARMK: Trimmed 72605 records to 51071 (keeping 200 days of data) [2025-10-03T17:19:31.496194] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-03T17:19:31.496466] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-03T17:19:31.497711] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-03T17:19:31.497781] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-03T17:19:32.033105] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-03T17:19:32.131462] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:32.237794] [DEBUG] [LOCAL ] ARMK: Primary data saved (51071 records). [2025-10-03T17:19:32.237989] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-03T17:19:32.238135] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARMK took 42.4s. Estimated remaining: 4h 50m 6s. Rate: 7.7 symbols/min [2025-10-03T17:19:32.432160] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:32.452186] [DEBUG] [LOCAL ] ASA: Loaded 14321 existing records from primary storage. [2025-10-03T17:19:32.452529] [INFO ] [MAIN ] ASA: Loaded 14321 existing records. [2025-10-03T17:19:32.657071] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:32.657320] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-03T17:19:32.657371] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-03T17:19:32.657840] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-03T17:19:32.657903] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-03T17:19:32.795932] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-03T17:19:33.041308] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:33.267367] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:19:33.590711] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-03T17:19:33.826347] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:19:34.390704] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-03T17:19:34.767220] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T17:19:35.190684] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-03T17:19:35.266930] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:19:35.270870] [INFO ] [REMOTE ] ARR: Full fetch complete (75248 records). [2025-10-03T17:19:35.271061] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-03T17:19:35.726941] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-03T17:19:35.727103] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-03T17:19:35.727951] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-03T17:19:35.728058] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-03T17:19:35.729621] [DEBUG] [LOCAL ] ARR: Trimmed 75248 records to 52803 (keeping 200 days of data) [2025-10-03T17:19:35.865202] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:19:35.993013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-03T17:19:36.113506] [DEBUG] [LOCAL ] ARR: Primary data saved (52803 records). [2025-10-03T17:19:36.113708] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-03T17:19:36.114526] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. ARR took 36.4s. Estimated remaining: 4h 48m 59s. Rate: 7.7 symbols/min [2025-10-03T17:19:36.306507] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:36.369502] [DEBUG] [LOCAL ] ASAN: Loaded 53110 existing records from primary storage. [2025-10-03T17:19:36.369891] [INFO ] [MAIN ] ASAN: Loaded 53110 existing records. [2025-10-03T17:19:36.555705] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:36.555939] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-03T17:19:36.555989] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-03T17:19:36.557187] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-03T17:19:36.557253] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-03T17:19:36.795885] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-03T17:19:37.015050] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:37.104354] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T17:19:37.440498] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T17:19:37.590695] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-03T17:19:38.390730] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-03T17:19:39.190714] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-03T17:19:39.863578] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-10-03T17:19:39.990693] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-03T17:19:40.044257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T17:19:40.790765] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-03T17:19:41.106279] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (3.52 seconds). [2025-10-03T17:19:41.188634] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:19:41.268100] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T17:19:41.354246] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T17:19:41.590688] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-03T17:19:42.390686] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-03T17:19:42.430221] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T17:19:43.190691] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-03T17:19:43.845074] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T17:19:43.990677] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-03T17:19:44.790699] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-03T17:19:44.958385] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T17:19:45.319867] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:19:45.590714] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-03T17:19:45.851444] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:19:46.390691] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-03T17:19:46.788285] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:19:46.790260] [INFO ] [REMOTE ] ARW: Full fetch complete (48015 records). [2025-10-03T17:19:46.790355] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-03T17:19:47.192447] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-03T17:19:47.209830] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-03T17:19:47.209892] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-03T17:19:47.210461] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-03T17:19:47.210509] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-03T17:19:47.211618] [DEBUG] [LOCAL ] ARW: Trimmed 48015 records to 33549 (keeping 200 days of data) [2025-10-03T17:19:47.408352] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:19:47.432356] [DEBUG] [LOCAL ] ARW: Primary data saved (33549 records). [2025-10-03T17:19:47.432514] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-03T17:19:47.432629] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARW took 27.7s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-03T17:19:47.617055] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:47.666533] [DEBUG] [LOCAL ] ASB: Loaded 49883 existing records from primary storage. [2025-10-03T17:19:47.666891] [INFO ] [MAIN ] ASB: Loaded 49883 existing records. [2025-10-03T17:19:47.858170] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:47.858431] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-03T17:19:47.858507] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-03T17:19:47.859851] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-03T17:19:47.859920] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-03T17:19:47.995723] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-03T17:19:48.248500] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:48.790701] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-03T17:19:49.590742] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-03T17:19:50.036335] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-03T17:19:50.060257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T17:19:50.390693] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-03T17:19:51.026234] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T17:19:51.190709] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-03T17:19:51.990713] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-03T17:19:52.091898] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-03T17:19:52.092219] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:19:52.189459] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:19:52.790730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-03T17:19:53.590698] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-03T17:19:53.729471] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T17:19:54.390621] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-03T17:19:54.441168] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:19:54.594727] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:19:55.190730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-03T17:19:55.939214] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:19:55.990726] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-03T17:19:56.790730] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-03T17:19:57.018024] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:19:57.590702] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-03T17:19:57.745239] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:19:58.390698] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-03T17:19:58.549861] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:19:58.727410] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:19:59.190717] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-03T17:19:59.990707] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-03T17:20:00.387557] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:20:00.389027] [INFO ] [REMOTE ] ASA: Full fetch complete (19021 records). [2025-10-03T17:20:00.389150] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-03T17:20:00.803731] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-03T17:20:00.816182] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-03T17:20:00.817385] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-03T17:20:00.817824] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-03T17:20:00.817921] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-03T17:20:00.819213] [DEBUG] [LOCAL ] ASA: Trimmed 19021 records to 14433 (keeping 200 days of data) [2025-10-03T17:20:00.915621] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-03T17:20:00.951482] [DEBUG] [LOCAL ] ASA: Primary data saved (14433 records). [2025-10-03T17:20:00.951676] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-03T17:20:00.951785] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ASA took 28.7s. Estimated remaining: 4h 50m 58s. Rate: 7.6 symbols/min [2025-10-03T17:20:01.145069] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:01.151202] [DEBUG] [LOCAL ] ASBA: Loaded 3476 existing records from primary storage. [2025-10-03T17:20:01.151441] [INFO ] [MAIN ] ASBA: Loaded 3476 existing records. [2025-10-03T17:20:01.382331] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:01.382616] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-03T17:20:01.382732] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-03T17:20:01.383024] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-03T17:20:01.383108] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-03T17:20:01.590903] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-03T17:20:01.824580] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:01.864197] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T17:20:02.390626] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-03T17:20:02.496345] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:20:03.190734] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-03T17:20:03.630766] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:20:03.944749] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:20:03.990709] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-03T17:20:04.722508] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:20:04.790705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-03T17:20:04.931998] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:20:05.590697] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-03T17:20:06.238994] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:20:06.390628] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-03T17:20:06.593384] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:20:07.190694] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-03T17:20:07.779116] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:20:07.990688] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-03T17:20:08.051536] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T17:20:08.790709] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-03T17:20:09.358849] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:20:09.590745] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-03T17:20:09.839887] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T17:20:10.390705] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-03T17:20:11.190670] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-03T17:20:11.313785] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:20:11.990707] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-03T17:20:12.033272] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:20:12.038188] [INFO ] [REMOTE ] AS: Full fetch complete (76550 records). [2025-10-03T17:20:12.038435] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-03T17:20:12.502850] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-03T17:20:12.502956] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-03T17:20:12.503851] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-03T17:20:12.503927] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-03T17:20:12.505731] [DEBUG] [LOCAL ] AS: Trimmed 76550 records to 53862 (keeping 200 days of data) [2025-10-03T17:20:12.808054] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-03T17:20:12.860596] [DEBUG] [LOCAL ] AS: Primary data saved (53862 records). [2025-10-03T17:20:12.860748] [INFO ] [MAIN ] AS: Full history saved. [2025-10-03T17:20:12.860839] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. AS took 42.3s. Estimated remaining: 4h 51m 49s. Rate: 7.6 symbols/min [2025-10-03T17:20:13.059990] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:13.098571] [DEBUG] [LOCAL ] ASC: Loaded 37698 existing records from primary storage. [2025-10-03T17:20:13.099123] [INFO ] [MAIN ] ASC: Loaded 37698 existing records. [2025-10-03T17:20:13.298132] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:13.299052] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-03T17:20:13.299147] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-03T17:20:13.320527] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-03T17:20:13.326041] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-03T17:20:13.388877] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T17:20:13.442394] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T17:20:13.595779] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-03T17:20:13.734741] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:20:13.859614] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:14.143599] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T17:20:14.390732] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-03T17:20:15.190702] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-03T17:20:15.990675] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-03T17:20:16.238624] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:20:16.790633] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-03T17:20:17.215903] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:20:17.452941] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T17:20:17.594264] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-03T17:20:17.600668] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T17:20:18.390745] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-03T17:20:19.137280] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:20:19.190711] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-03T17:20:19.995782] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-03T17:20:20.019426] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:20:20.769276] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T17:20:20.771953] [INFO ] [REMOTE ] ASB: Full fetch complete (71693 records). [2025-10-03T17:20:20.772259] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-03T17:20:20.795767] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-03T17:20:21.207563] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-03T17:20:21.207810] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-03T17:20:21.208786] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-03T17:20:21.208993] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-03T17:20:21.210606] [DEBUG] [LOCAL ] ASB: Trimmed 71693 records to 50265 (keeping 200 days of data) [2025-10-03T17:20:21.468190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T17:20:21.529728] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:20:21.577012] [DEBUG] [LOCAL ] ASB: Primary data saved (50265 records). [2025-10-03T17:20:21.577167] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-03T17:20:21.577256] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. ASB took 34.1s. Estimated remaining: 4h 51m 53s. Rate: 7.6 symbols/min [2025-10-03T17:20:21.599939] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-03T17:20:21.786864] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:21.808475] [DEBUG] [LOCAL ] ASG: Loaded 19972 existing records from primary storage. [2025-10-03T17:20:21.808908] [INFO ] [MAIN ] ASG: Loaded 19972 existing records. [2025-10-03T17:20:22.003000] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:22.003303] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-03T17:20:22.003379] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-03T17:20:22.004095] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-03T17:20:22.004157] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-03T17:20:22.322285] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:20:22.401352] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-03T17:20:22.407186] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:22.879608] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T17:20:23.190724] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-03T17:20:23.776599] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T17:20:23.777380] [INFO ] [REMOTE ] ASBA: Full fetch complete (5241 records). [2025-10-03T17:20:23.777471] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-03T17:20:23.995864] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-03T17:20:24.179850] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-03T17:20:24.180003] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-03T17:20:24.180215] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-03T17:20:24.180280] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-03T17:20:24.180699] [DEBUG] [LOCAL ] ASBA: Trimmed 5241 records to 3492 (keeping 200 days of data) [2025-10-03T17:20:24.204274] [DEBUG] [LOCAL ] ASBA: Primary data saved (3492 records). [2025-10-03T17:20:24.204377] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-03T17:20:24.204479] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 23.3s. Estimated remaining: 4h 50m 29s. Rate: 7.6 symbols/min [2025-10-03T17:20:24.387468] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:24.413716] [DEBUG] [LOCAL ] ASGI: Loaded 22922 existing records from primary storage. [2025-10-03T17:20:24.414003] [INFO ] [MAIN ] ASGI: Loaded 22922 existing records. [2025-10-03T17:20:24.603210] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:24.603471] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-03T17:20:24.603521] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-03T17:20:24.604158] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-03T17:20:24.604222] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-03T17:20:24.792689] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-03T17:20:24.994271] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:25.590713] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-03T17:20:25.865164] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T17:20:25.868191] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-03T17:20:25.868344] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-03T17:20:26.313102] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-03T17:20:26.313454] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-03T17:20:26.314410] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-03T17:20:26.314493] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-03T17:20:26.316342] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 53500 (keeping 200 days of data) [2025-10-03T17:20:26.405914] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-03T17:20:26.580879] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:20:26.612963] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:20:26.732096] [DEBUG] [LOCAL ] ASAN: Primary data saved (53500 records). [2025-10-03T17:20:26.732253] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-03T17:20:26.733069] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASAN took 50.6s. Estimated remaining: 4h 49m 6s. Rate: 7.7 symbols/min [2025-10-03T17:20:26.925028] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:26.925241] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-10-03T17:20:26.925298] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-10-03T17:20:26.925419] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-03T17:20:26.925485] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-03T17:20:26.925552] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-03T17:20:26.925593] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-03T17:20:27.200408] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-03T17:20:27.341422] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:27.727109] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:20:27.990716] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-03T17:20:28.680304] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:20:28.790745] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-03T17:20:29.084320] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:20:29.590736] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-03T17:20:30.090834] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:20:30.390698] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-03T17:20:30.682904] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T17:20:31.190726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-03T17:20:31.886834] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:20:31.990707] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-03T17:20:32.185776] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T17:20:32.790691] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-03T17:20:33.445266] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:20:33.590702] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-03T17:20:33.842429] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:20:34.390692] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-03T17:20:35.154623] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:20:35.190711] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-03T17:20:35.465434] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:20:35.990738] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-03T17:20:36.729211] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:20:36.790693] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-03T17:20:37.224232] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:20:37.590691] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-03T17:20:37.990070] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:20:38.390691] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-03T17:20:38.818189] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:20:39.190693] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-03T17:20:39.291197] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-03T17:20:39.990672] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-03T17:20:40.218510] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:20:40.790632] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-03T17:20:41.095871] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:20:41.590693] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-03T17:20:42.390690] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-03T17:20:42.504155] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:20:42.723169] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:20:43.190695] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-03T17:20:43.867217] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:20:43.990687] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-03T17:20:44.257695] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:20:44.790700] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-03T17:20:45.185270] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T17:20:45.590638] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-03T17:20:45.899637] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:20:46.390720] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-03T17:20:46.594679] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:20:47.190704] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-03T17:20:47.990715] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-03T17:20:48.101883] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:20:48.185068] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T17:20:48.790699] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-03T17:20:49.019491] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:20:49.590702] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-03T17:20:50.005887] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:20:50.390728] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-03T17:20:50.976101] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:20:51.190721] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-03T17:20:51.456415] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:20:51.990692] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-03T17:20:52.040697] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:20:52.042100] [INFO ] [REMOTE ] ASG: Full fetch complete (31252 records). [2025-10-03T17:20:52.042190] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-03T17:20:52.471964] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-03T17:20:52.472060] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-03T17:20:52.472591] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-03T17:20:52.472707] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-03T17:20:52.473767] [DEBUG] [LOCAL ] ASG: Trimmed 31252 records to 20131 (keeping 200 days of data) [2025-10-03T17:20:52.604010] [DEBUG] [LOCAL ] ASG: Primary data saved (20131 records). [2025-10-03T17:20:52.604158] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-03T17:20:52.604279] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASG took 31.0s. Estimated remaining: 4h 53m 12s. Rate: 7.5 symbols/min [2025-10-03T17:20:52.790726] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-03T17:20:53.231928] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:20:53.234118] [INFO ] [REMOTE ] ASC: Full fetch complete (56600 records). [2025-10-03T17:20:53.234461] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-03T17:20:53.595832] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-03T17:20:53.686095] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-03T17:20:53.686181] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-03T17:20:53.686825] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-03T17:20:53.686893] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-03T17:20:53.690266] [DEBUG] [LOCAL ] ASC: Trimmed 56600 records to 37981 (keeping 200 days of data) [2025-10-03T17:20:53.933554] [DEBUG] [LOCAL ] ASC: Primary data saved (37981 records). [2025-10-03T17:20:53.933743] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-03T17:20:53.934480] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 41.1s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-03T17:20:54.339624] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:20:54.390739] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-03T17:20:54.724301] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:20:55.190747] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-03T17:20:55.626606] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T17:20:55.990679] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-03T17:20:56.206764] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T17:20:56.209175] [INFO ] [REMOTE ] ASGI: Full fetch complete (33645 records). [2025-10-03T17:20:56.209305] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-03T17:20:56.628297] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-03T17:20:56.628386] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-03T17:20:56.628834] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-03T17:20:56.628899] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-03T17:20:56.629850] [DEBUG] [LOCAL ] ASGI: Trimmed 33645 records to 23076 (keeping 200 days of data) [2025-10-03T17:20:56.774106] [DEBUG] [LOCAL ] ASGI: Primary data saved (23076 records). [2025-10-03T17:20:56.774237] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-03T17:20:56.774322] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASGI took 32.6s. Estimated remaining: 4h 50m 13s. Rate: 7.6 symbols/min [2025-10-03T17:20:57.307382] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:20:57.317567] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-03T17:20:58.462345] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:20:58.464855] [INFO ] [REMOTE ] ASGN: Full fetch complete (52466 records). [2025-10-03T17:20:58.464998] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-03T17:20:58.910092] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-03T17:20:58.910179] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-03T17:20:58.910837] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-03T17:20:58.910914] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-03T17:20:58.912223] [DEBUG] [LOCAL ] ASGN: Trimmed 52466 records to 36722 (keeping 200 days of data) [2025-10-03T17:20:59.138900] [DEBUG] [LOCAL ] ASGN: Primary data saved (36722 records). [2025-10-03T17:20:59.139053] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-03T17:20:59.139153] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGN took 32.4s. Estimated remaining: 4h 48m 49s. Rate: 7.7 symbols/min [2025-10-03T17:20:59.837343] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.891568] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.935229] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.937396] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.948898] [DEBUG] [LOCAL ] ASR: Loaded 9377 existing records from primary storage. [2025-10-03T17:20:59.949305] [INFO ] [MAIN ] ASR: Loaded 9377 existing records. [2025-10-03T17:21:00.078489] [DEBUG] [LOCAL ] ASIX: Loaded 22820 existing records from primary storage. [2025-10-03T17:21:00.095426] [INFO ] [MAIN ] ASIX: Loaded 22820 existing records. [2025-10-03T17:21:00.172554] [DEBUG] [LOCAL ] ASH: Loaded 38041 existing records from primary storage. [2025-10-03T17:21:00.214557] [INFO ] [MAIN ] ASH: Loaded 38041 existing records. [2025-10-03T17:21:00.358739] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:00.423519] [DEBUG] [LOCAL ] ASPN: Loaded 49942 existing records from primary storage. [2025-10-03T17:21:00.401528] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-03T17:21:00.474362] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-03T17:21:00.469878] [INFO ] [MAIN ] ASPN: Loaded 49942 existing records. [2025-10-03T17:21:00.527662] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-03T17:21:00.565220] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-03T17:21:00.583496] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:00.732899] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-03T17:21:00.764338] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-03T17:21:00.859287] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-03T17:21:00.880051] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-03T17:21:00.901515] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:01.027777] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-03T17:21:01.102713] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-03T17:21:01.200741] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:01.219608] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-03T17:21:01.219990] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-03T17:21:01.219890] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-03T17:21:01.263832] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-03T17:21:01.269146] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-03T17:21:01.302702] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-03T17:21:02.437400] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.525477] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-03T17:21:02.656058] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.738468] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-03T17:21:02.959097] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.980408] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-03T17:21:02.980137] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.980718] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-03T17:21:03.547740] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:21:03.550332] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-03T17:21:03.883684] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T17:21:03.887736] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-03T17:21:04.028809] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:21:04.031035] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-03T17:21:04.121612] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:21:04.129787] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-03T17:21:04.526095] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:21:04.537599] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-03T17:21:04.584397] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T17:21:04.763235] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T17:21:04.790711] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-03T17:21:05.211360] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:21:05.436796] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:21:05.590724] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-03T17:21:05.960370] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T17:21:06.390716] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-03T17:21:06.577178] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T17:21:07.190729] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-03T17:21:07.990714] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-03T17:21:08.216923] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:21:08.522312] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:21:08.716876] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:21:08.790731] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-03T17:21:09.590713] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-03T17:21:10.335737] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:21:10.390723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-03T17:21:10.656828] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:21:10.943611] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:21:11.190740] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-03T17:21:11.990735] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-03T17:21:12.324500] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:21:12.759941] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T17:21:12.790696] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-03T17:21:13.590673] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-03T17:21:13.723424] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T17:21:14.390694] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-03T17:21:15.190637] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-03T17:21:15.441202] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:21:15.488796] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:21:15.990708] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-03T17:21:16.096240] [DEBUG] [REMOTE ] ASIX: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T17:21:16.096545] [WARN ] [REMOTE ] ASIX: No data returned for month 2025-07 [2025-10-03T17:21:16.096691] [FATAL] [REMOTE ] ASIX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:21:16.096833] [FATAL] [MAIN ] ASIX: Failed to fetch primary data. [2025-10-03T17:21:16.096925] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:21:16.097022] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-03T17:21:16.097110] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-03T17:21:16.097152] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-10-03T17:21:16.097507] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-10-03T17:21:16.097598] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASIX took 17.0s. Estimated remaining: 4h 50m 46s. Rate: 7.6 symbols/min [2025-10-03T17:21:16.279190] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:16.279363] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-10-03T17:21:16.279403] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-10-03T17:21:16.279522] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-03T17:21:16.279566] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-03T17:21:16.279609] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-03T17:21:16.279666] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-03T17:21:16.679042] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:16.790762] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-03T17:21:16.836768] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T17:21:17.590707] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-03T17:21:18.347808] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T17:21:18.390723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-03T17:21:18.596095] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:21:19.165767] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:21:19.190617] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-03T17:21:19.990739] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-03T17:21:20.027555] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T17:21:20.790723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-03T17:21:21.486719] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:21:21.487699] [INFO ] [REMOTE ] ASR: Full fetch complete (12475 records). [2025-10-03T17:21:21.487800] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-03T17:21:21.595882] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-03T17:21:21.707027] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:21:21.977295] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-03T17:21:21.977376] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-03T17:21:21.977675] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-03T17:21:21.977740] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-03T17:21:21.978287] [DEBUG] [LOCAL ] ASR: Trimmed 12475 records to 9420 (keeping 200 days of data) [2025-10-03T17:21:22.045340] [DEBUG] [LOCAL ] ASR: Primary data saved (9420 records). [2025-10-03T17:21:22.045541] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-03T17:21:22.045679] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASR took 22.9s. Estimated remaining: 4h 50m 12s. Rate: 7.6 symbols/min [2025-10-03T17:21:22.252739] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:22.300431] [DEBUG] [LOCAL ] ATEN: Loaded 39637 existing records from primary storage. [2025-10-03T17:21:22.300903] [INFO ] [MAIN ] ATEN: Loaded 39637 existing records. [2025-10-03T17:21:22.395860] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-03T17:21:22.507989] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:22.508233] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-03T17:21:22.508284] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-03T17:21:22.508715] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-03T17:21:22.508775] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-03T17:21:22.893872] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:23.190714] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-03T17:21:23.625287] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-03T17:21:23.821433] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:21:23.990727] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-03T17:21:24.745940] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:21:24.790686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-03T17:21:25.590637] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-03T17:21:25.866033] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T17:21:26.255829] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:21:26.390697] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-03T17:21:27.155251] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T17:21:27.190699] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-03T17:21:27.796543] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:21:27.990694] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-03T17:21:28.790687] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-03T17:21:29.034101] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:21:29.590715] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-03T17:21:29.740398] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:21:30.119252] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:21:30.390695] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-03T17:21:30.785745] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:21:31.190702] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-03T17:21:31.746812] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T17:21:31.990708] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-03T17:21:32.790707] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-03T17:21:33.175045] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-03T17:21:33.497092] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:21:33.590725] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-03T17:21:34.072720] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:21:34.075219] [INFO ] [REMOTE ] ASH: Full fetch complete (55144 records). [2025-10-03T17:21:34.075383] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-03T17:21:34.396411] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-03T17:21:34.510705] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-03T17:21:34.510806] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-03T17:21:34.511417] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-03T17:21:34.511467] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-03T17:21:34.512778] [DEBUG] [LOCAL ] ASH: Trimmed 55144 records to 38329 (keeping 200 days of data) [2025-10-03T17:21:34.763888] [DEBUG] [LOCAL ] ASH: Primary data saved (38329 records). [2025-10-03T17:21:34.764073] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-03T17:21:34.764175] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASH took 35.6s. Estimated remaining: 4h 51m 9s. Rate: 7.6 symbols/min [2025-10-03T17:21:34.952745] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:34.987997] [DEBUG] [LOCAL ] ATGE: Loaded 31630 existing records from primary storage. [2025-10-03T17:21:34.988319] [INFO ] [MAIN ] ATGE: Loaded 31630 existing records. [2025-10-03T17:21:35.183260] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:35.183457] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-03T17:21:35.183505] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-03T17:21:35.184086] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-03T17:21:35.184146] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-03T17:21:35.195728] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-03T17:21:35.529770] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:21:35.613307] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:35.990684] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-03T17:21:36.117841] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:21:36.790698] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-03T17:21:37.110330] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:21:37.312430] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:21:37.590722] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-03T17:21:38.390696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-03T17:21:38.708922] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:21:38.768903] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:21:39.190713] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-03T17:21:39.990688] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-03T17:21:40.238797] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T17:21:40.285080] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T17:21:40.790681] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-03T17:21:41.391471] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:21:41.590709] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-03T17:21:42.400185] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-03T17:21:42.425097] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:21:43.031163] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:21:43.190719] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-03T17:21:43.640019] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T17:21:43.990715] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-03T17:21:44.631270] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T17:21:44.790734] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-03T17:21:45.449196] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T17:21:45.590726] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-03T17:21:45.948236] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T17:21:46.390732] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-03T17:21:47.086286] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:21:47.190737] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-03T17:21:47.990746] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-03T17:21:48.511779] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T17:21:48.571997] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:21:48.790719] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-03T17:21:49.590695] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-03T17:21:49.663371] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:21:50.193724] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T17:21:50.196592] [INFO ] [REMOTE ] ASPN: Full fetch complete (72343 records). [2025-10-03T17:21:50.196757] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-03T17:21:50.399523] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-03T17:21:50.644724] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-03T17:21:50.644828] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-03T17:21:50.645637] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-03T17:21:50.645774] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-03T17:21:50.647347] [DEBUG] [LOCAL ] ASPN: Trimmed 72343 records to 50328 (keeping 200 days of data) [2025-10-03T17:21:50.929968] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:21:50.948453] [INFO ] [REMOTE ] ATEN: Full fetch complete (57400 records). [2025-10-03T17:21:50.949475] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-03T17:21:51.199130] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-03T17:21:51.323382] [DEBUG] [LOCAL ] ASPN: Primary data saved (50328 records). [2025-10-03T17:21:51.333881] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-03T17:21:51.346788] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASPN took 52.2s. Estimated remaining: 4h 52m 58s. Rate: 7.5 symbols/min [2025-10-03T17:21:51.522787] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-03T17:21:51.525889] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-03T17:21:51.526861] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-03T17:21:51.526954] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-03T17:21:51.602492] [DEBUG] [LOCAL ] ATEN: Trimmed 57400 records to 39883 (keeping 200 days of data) [2025-10-03T17:21:51.607428] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:51.740978] [DEBUG] [LOCAL ] ATHM: Loaded 32341 existing records from primary storage. [2025-10-03T17:21:51.742138] [INFO ] [MAIN ] ATHM: Loaded 32341 existing records. [2025-10-03T17:21:51.960809] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:51.962431] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-03T17:21:51.963113] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-03T17:21:51.966692] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-03T17:21:51.966788] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-03T17:21:52.490287] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:52.491491] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-03T17:21:52.532853] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:21:52.580576] [DEBUG] [LOCAL ] ATEN: Primary data saved (39883 records). [2025-10-03T17:21:52.580756] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-03T17:21:52.581499] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ATEN took 30.5s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-03T17:21:52.720381] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:21:52.795946] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-03T17:21:52.799138] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:52.810471] [DEBUG] [LOCAL ] ATHS: Loaded 6987 existing records from primary storage. [2025-10-03T17:21:52.810733] [INFO ] [MAIN ] ATHS: Loaded 6987 existing records. [2025-10-03T17:21:53.004480] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:53.004769] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-03T17:21:53.004868] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-03T17:21:53.005165] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-03T17:21:53.005227] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-03T17:21:53.391464] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:53.590753] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-03T17:21:54.095355] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:21:54.207889] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T17:21:54.390738] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-03T17:21:55.190666] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-03T17:21:55.542185] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:21:55.571628] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:21:55.990693] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-03T17:21:56.102059] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T17:21:56.790746] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-03T17:21:57.590701] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-03T17:21:57.674861] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:21:57.677425] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:21:57.683186] [INFO ] [REMOTE ] ATGE: Full fetch complete (46339 records). [2025-10-03T17:21:57.690104] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-03T17:21:58.137326] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-03T17:21:58.137415] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-03T17:21:58.137990] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-03T17:21:58.138083] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-03T17:21:58.139308] [DEBUG] [LOCAL ] ATGE: Trimmed 46339 records to 31813 (keeping 200 days of data) [2025-10-03T17:21:58.343037] [DEBUG] [LOCAL ] ATGE: Primary data saved (31813 records). [2025-10-03T17:21:58.343230] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-03T17:21:58.343358] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ATGE took 23.6s. Estimated remaining: 4h 50m 43s. Rate: 7.6 symbols/min [2025-10-03T17:21:58.395807] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-03T17:21:58.539496] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:58.592071] [DEBUG] [LOCAL ] ATI: Loaded 51863 existing records from primary storage. [2025-10-03T17:21:58.592514] [INFO ] [MAIN ] ATI: Loaded 51863 existing records. [2025-10-03T17:21:58.795236] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:58.795553] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-03T17:21:58.795611] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-03T17:21:58.795956] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-03T17:21:58.796015] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-03T17:21:59.118813] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T17:21:59.193912] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-03T17:21:59.239208] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:59.241563] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:21:59.990715] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-03T17:22:00.790729] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-03T17:22:01.134553] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T17:22:01.137616] [INFO ] [REMOTE ] ASX: Full fetch complete (76590 records). [2025-10-03T17:22:01.137778] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-03T17:22:01.601316] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-03T17:22:01.597070] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-03T17:22:01.601452] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-03T17:22:01.603339] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-03T17:22:01.603690] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-03T17:22:01.632265] [DEBUG] [LOCAL ] ASX: Trimmed 76590 records to 53615 (keeping 200 days of data) [2025-10-03T17:22:01.632124] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:22:01.997286] [DEBUG] [LOCAL ] ASX: Primary data saved (53615 records). [2025-10-03T17:22:01.997443] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-03T17:22:01.997542] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ASX took 45.9s. Estimated remaining: 4h 49m 39s. Rate: 7.6 symbols/min [2025-10-03T17:22:02.195856] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:02.242873] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:22:02.289425] [DEBUG] [LOCAL ] ATKR: Loaded 35963 existing records from primary storage. [2025-10-03T17:22:02.289765] [INFO ] [MAIN ] ATKR: Loaded 35963 existing records. [2025-10-03T17:22:02.402307] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-03T17:22:02.424620] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:22:02.499673] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:02.499957] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-03T17:22:02.500019] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-03T17:22:02.500825] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-03T17:22:02.500887] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-03T17:22:02.886132] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:03.190725] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-03T17:22:03.990688] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-03T17:22:04.175395] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:22:04.579164] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:22:04.790736] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-03T17:22:04.825269] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T17:22:05.590747] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-03T17:22:06.131429] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:22:06.390714] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-03T17:22:07.078486] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:22:07.190723] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-03T17:22:07.913856] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:22:07.990690] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-03T17:22:08.790661] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-03T17:22:08.823685] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:22:09.261300] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T17:22:09.590730] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-03T17:22:09.814429] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:22:10.390721] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-03T17:22:11.031682] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:22:11.190723] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-03T17:22:11.588865] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:22:11.990727] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-03T17:22:12.790720] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-03T17:22:12.850740] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T17:22:13.151750] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:22:13.590705] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-03T17:22:14.237840] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:22:14.281955] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:22:14.390755] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-03T17:22:15.190739] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-03T17:22:15.727247] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T17:22:15.990696] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-03T17:22:16.358372] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:22:16.790691] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-03T17:22:16.890016] [DEBUG] [REMOTE ] ATI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-03T17:22:16.890324] [WARN ] [REMOTE ] ATI: No data returned for month 2025-06 [2025-10-03T17:22:16.890413] [FATAL] [REMOTE ] ATI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:22:16.890557] [FATAL] [MAIN ] ATI: Failed to fetch primary data. [2025-10-03T17:22:16.890625] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:22:16.890724] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-03T17:22:16.890790] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-03T17:22:16.890835] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-10-03T17:22:16.891073] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-10-03T17:22:16.891158] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATI took 18.5s. Estimated remaining: 4h 51m 3s. Rate: 7.6 symbols/min [2025-10-03T17:22:17.084171] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:17.124891] [DEBUG] [LOCAL ] ATMU: Loaded 39581 existing records from primary storage. [2025-10-03T17:22:17.125202] [INFO ] [MAIN ] ATMU: Loaded 39581 existing records. [2025-10-03T17:22:17.343522] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:17.355213] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-03T17:22:17.355330] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-03T17:22:17.357277] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-03T17:22:17.357186] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T17:22:17.357501] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-03T17:22:17.595771] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-03T17:22:17.760707] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:18.080527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T17:22:18.390705] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-03T17:22:19.190691] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-03T17:22:19.619946] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:22:19.918429] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:22:19.990691] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-03T17:22:20.790696] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-03T17:22:21.347554] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T17:22:21.590721] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-03T17:22:21.920028] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T17:22:22.337032] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:22:22.390707] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-03T17:22:23.190776] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-03T17:22:23.835107] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:22:23.970236] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:22:23.990725] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-03T17:22:24.615104] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:22:24.790718] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-03T17:22:25.590730] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-03T17:22:26.200045] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:22:26.203304] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:22:26.203488] [INFO ] [REMOTE ] ATHS: Full fetch complete (9913 records). [2025-10-03T17:22:26.211518] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-03T17:22:26.406065] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-03T17:22:26.688407] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-03T17:22:26.688520] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-03T17:22:26.688906] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-03T17:22:26.688975] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-03T17:22:26.690138] [DEBUG] [LOCAL ] ATHS: Trimmed 9913 records to 7008 (keeping 200 days of data) [2025-10-03T17:22:26.738750] [DEBUG] [LOCAL ] ATHS: Primary data saved (7008 records). [2025-10-03T17:22:26.738971] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-03T17:22:26.739116] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHS took 34.2s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-03T17:22:26.927562] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:26.981212] [DEBUG] [LOCAL ] ATO: Loaded 42177 existing records from primary storage. [2025-10-03T17:22:26.981687] [INFO ] [MAIN ] ATO: Loaded 42177 existing records. [2025-10-03T17:22:27.171484] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:27.171828] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-03T17:22:27.171885] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-03T17:22:27.172983] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-03T17:22:27.173048] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-03T17:22:27.195941] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-03T17:22:27.591091] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:27.771577] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:22:27.990714] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-03T17:22:28.620327] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:22:28.766145] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:22:28.768363] [INFO ] [REMOTE ] ATHM: Full fetch complete (50938 records). [2025-10-03T17:22:28.768479] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-03T17:22:28.795962] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-03T17:22:29.173928] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-03T17:22:29.174058] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-03T17:22:29.175128] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-03T17:22:29.175203] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-03T17:22:29.176722] [DEBUG] [LOCAL ] ATHM: Trimmed 50938 records to 32487 (keeping 200 days of data) [2025-10-03T17:22:29.370660] [DEBUG] [LOCAL ] ATHM: Primary data saved (32487 records). [2025-10-03T17:22:29.370862] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-03T17:22:29.370980] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATHM took 38.0s. Estimated remaining: 4h 50m 4s. Rate: 7.6 symbols/min [2025-10-03T17:22:29.560508] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:29.595133] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-03T17:22:29.596006] [DEBUG] [LOCAL ] ATR: Loaded 30648 existing records from primary storage. [2025-10-03T17:22:29.597351] [INFO ] [MAIN ] ATR: Loaded 30648 existing records. [2025-10-03T17:22:29.800881] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:29.801102] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-03T17:22:29.801151] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-03T17:22:29.802074] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-03T17:22:29.802136] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-03T17:22:30.200172] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:30.224448] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:22:30.390711] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-03T17:22:31.190706] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-03T17:22:31.297170] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T17:22:31.732182] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:22:31.990693] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-03T17:22:32.790688] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-03T17:22:32.835317] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:22:33.275999] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T17:22:33.590696] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-03T17:22:34.183966] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:22:34.390687] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-03T17:22:35.190691] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-03T17:22:35.230367] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T17:22:35.316160] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:22:35.990690] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-03T17:22:36.746530] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T17:22:36.790711] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-03T17:22:36.895872] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:22:37.590713] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-03T17:22:38.113418] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:22:38.390690] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-03T17:22:38.829073] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:22:39.190721] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-03T17:22:39.639495] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T17:22:39.990729] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-03T17:22:40.485566] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T17:22:40.790701] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-03T17:22:41.590811] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-03T17:22:41.638445] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:22:42.295598] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:22:42.390715] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-03T17:22:42.874096] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:22:42.876371] [INFO ] [REMOTE ] ATKR: Full fetch complete (53781 records). [2025-10-03T17:22:42.876465] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-03T17:22:43.195767] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-03T17:22:43.311429] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-03T17:22:43.311519] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-03T17:22:43.312104] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-03T17:22:43.312169] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-03T17:22:43.313367] [DEBUG] [LOCAL ] ATKR: Trimmed 53781 records to 36223 (keeping 200 days of data) [2025-10-03T17:22:43.540818] [DEBUG] [LOCAL ] ATKR: Primary data saved (36223 records). [2025-10-03T17:22:43.540974] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-03T17:22:43.542223] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATKR took 41.5s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-03T17:22:43.729951] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:43.751878] [DEBUG] [LOCAL ] ATS: Loaded 17921 existing records from primary storage. [2025-10-03T17:22:43.752141] [INFO ] [MAIN ] ATS: Loaded 17921 existing records. [2025-10-03T17:22:43.954034] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:43.954266] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-03T17:22:43.954316] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-03T17:22:43.954807] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-03T17:22:43.954868] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-03T17:22:44.005199] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-03T17:22:44.369527] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:44.504397] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T17:22:44.790710] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-03T17:22:45.074626] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T17:22:45.590720] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-03T17:22:45.875668] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:22:45.927815] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:22:46.390732] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-03T17:22:47.190663] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-03T17:22:47.313397] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:22:47.379094] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T17:22:47.990700] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-03T17:22:48.401209] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:22:48.791180] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-03T17:22:49.269841] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:22:49.590730] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-03T17:22:50.390707] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-03T17:22:50.448079] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T17:22:50.521402] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:22:51.190907] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-03T17:22:51.633795] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:22:51.636669] [INFO ] [REMOTE ] ATMU: Full fetch complete (56834 records). [2025-10-03T17:22:51.636870] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-03T17:22:51.999029] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-03T17:22:52.060950] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-03T17:22:52.061038] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-03T17:22:52.061636] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-03T17:22:52.061732] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-03T17:22:52.064152] [DEBUG] [LOCAL ] ATMU: Trimmed 56834 records to 39950 (keeping 200 days of data) [2025-10-03T17:22:52.326978] [DEBUG] [LOCAL ] ATMU: Primary data saved (39950 records). [2025-10-03T17:22:52.327160] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-03T17:22:52.327307] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 35.4s. Estimated remaining: 4h 51m 19s. Rate: 7.5 symbols/min [2025-10-03T17:22:52.511524] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:52.557265] [DEBUG] [LOCAL ] ATUS: Loaded 49646 existing records from primary storage. [2025-10-03T17:22:52.557622] [INFO ] [MAIN ] ATUS: Loaded 49646 existing records. [2025-10-03T17:22:52.751165] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:52.751421] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-03T17:22:52.751474] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-03T17:22:52.752359] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-03T17:22:52.752426] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-03T17:22:52.797360] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-03T17:22:53.132081] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:53.590749] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-03T17:23:07.214052] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (14.42 seconds). [2025-10-03T17:23:07.223512] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-03T17:23:07.693456] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (15.69 seconds). [2025-10-03T17:23:07.700374] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-03T17:23:08.572209] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:23:08.581831] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-03T17:23:08.796718] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:23:08.802871] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-03T17:23:09.635499] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (18.44 seconds). [2025-10-03T17:23:09.643506] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-03T17:23:09.765271] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:23:09.770019] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-03T17:23:10.273298] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:23:10.282777] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-03T17:23:10.746751] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T17:23:10.751322] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-03T17:23:11.153579] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (17.56 seconds). [2025-10-03T17:23:11.164027] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-03T17:23:11.530467] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:23:11.535882] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-03T17:23:11.608544] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:23:11.610936] [INFO ] [REMOTE ] ATO: Full fetch complete (60510 records). [2025-10-03T17:23:11.611034] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-03T17:23:12.067597] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-03T17:23:12.067721] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-03T17:23:12.068476] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-03T17:23:12.068543] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-03T17:23:12.069967] [DEBUG] [LOCAL ] ATO: Trimmed 60510 records to 42462 (keeping 200 days of data) [2025-10-03T17:23:12.365274] [DEBUG] [LOCAL ] ATO: Primary data saved (42462 records). [2025-10-03T17:23:12.365452] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-03T17:23:12.366250] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATO took 45.6s. Estimated remaining: 4h 53m 44s. Rate: 7.5 symbols/min [2025-10-03T17:23:12.559092] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:12.572125] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T17:23:12.577922] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-03T17:23:12.663930] [DEBUG] [LOCAL ] AU: Loaded 53383 existing records from primary storage. [2025-10-03T17:23:12.667706] [INFO ] [MAIN ] AU: Loaded 53383 existing records. [2025-10-03T17:23:12.668610] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T17:23:12.755771] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-03T17:23:12.882297] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:12.882516] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-03T17:23:12.882566] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-03T17:23:12.883760] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-03T17:23:12.883823] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-03T17:23:13.315840] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:13.316553] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-03T17:23:13.327320] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:23:13.350361] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-03T17:23:13.354241] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (3.71 seconds). [2025-10-03T17:23:13.363560] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-03T17:23:14.090779] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T17:23:14.102874] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-03T17:23:14.254682] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:23:14.258347] [INFO ] [REMOTE ] ATS: Full fetch complete (25684 records). [2025-10-03T17:23:14.258441] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-03T17:23:14.558154] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:23:14.620954] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-03T17:23:14.734580] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-03T17:23:14.734700] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-03T17:23:14.735109] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-03T17:23:14.735166] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-03T17:23:14.736057] [DEBUG] [LOCAL ] ATS: Trimmed 25684 records to 18034 (keeping 200 days of data) [2025-10-03T17:23:14.844369] [DEBUG] [LOCAL ] ATS: Primary data saved (18034 records). [2025-10-03T17:23:14.844520] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-03T17:23:14.844615] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATS took 31.3s. Estimated remaining: 4h 52m 26s. Rate: 7.5 symbols/min [2025-10-03T17:23:15.086096] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:15.135629] [DEBUG] [LOCAL ] AUB: Loaded 46648 existing records from primary storage. [2025-10-03T17:23:15.136008] [INFO ] [MAIN ] AUB: Loaded 46648 existing records. [2025-10-03T17:23:15.338014] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:15.338574] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-03T17:23:15.338766] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-03T17:23:15.340137] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-03T17:23:15.340204] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-03T17:23:15.620813] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-03T17:23:15.684509] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-03T17:23:15.747385] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:23:15.780775] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:23:15.773230] [INFO ] [REMOTE ] ATR: Full fetch complete (43436 records). [2025-10-03T17:23:15.781021] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-03T17:23:15.830305] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:15.832133] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-03T17:23:15.831229] [FATAL] [VALIDATOR ] ATR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:23:15.832461] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-03T17:23:15.832636] [FATAL] [MAIN ] ATR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:23:15.834205] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:23:15.834284] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-03T17:23:15.834428] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-03T17:23:15.834523] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-03T17:23:15.834874] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-03T17:23:15.835025] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATR took 46.5s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-03T17:23:16.020878] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:16.027399] [DEBUG] [LOCAL ] AUNA: Loaded 4958 existing records from primary storage. [2025-10-03T17:23:16.027566] [INFO ] [MAIN ] AUNA: Loaded 4958 existing records. [2025-10-03T17:23:16.218550] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:16.218831] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-03T17:23:16.218882] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-03T17:23:16.219192] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-03T17:23:16.219251] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-03T17:23:16.604061] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:16.604413] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-03T17:23:17.309938] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:23:17.312039] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-03T17:23:17.519590] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:23:17.532047] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-03T17:23:17.572205] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:23:17.581044] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-03T17:23:17.620133] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T17:23:17.633181] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-03T17:23:18.139789] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:23:18.142393] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-03T17:23:18.733940] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:23:18.736117] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-03T17:23:19.211753] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T17:23:19.213993] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-03T17:23:19.241180] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:23:19.251426] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-03T17:23:19.484102] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T17:23:19.496511] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-03T17:23:19.582070] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-03T17:23:19.593030] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-03T17:23:19.866139] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:23:19.869720] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-03T17:23:20.452275] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T17:23:20.454232] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-03T17:23:20.646468] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:23:20.790750] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-03T17:23:21.217019] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:23:21.247047] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:23:21.590708] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-03T17:23:21.739322] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T17:23:22.218059] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T17:23:22.390712] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-03T17:23:22.481381] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T17:23:23.190694] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-03T17:23:23.990732] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-03T17:23:24.582975] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-03T17:23:24.790692] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-03T17:23:25.138607] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T17:23:25.590710] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-03T17:23:25.754916] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:23:26.390698] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-03T17:23:26.451365] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T17:23:26.857955] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T17:23:27.190707] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-03T17:23:27.997911] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-03T17:23:28.020760] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:23:28.790633] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-03T17:23:28.850137] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T17:23:29.058970] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:23:29.590883] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-03T17:23:29.901258] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:23:30.083720] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T17:23:30.084719] [INFO ] [REMOTE ] AUNA: Full fetch complete (7751 records). [2025-10-03T17:23:30.084795] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-03T17:23:30.395785] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-03T17:23:30.512795] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-03T17:23:30.512874] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-03T17:23:30.513082] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-03T17:23:30.513123] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-03T17:23:30.513569] [DEBUG] [LOCAL ] AUNA: Trimmed 7751 records to 5004 (keeping 200 days of data) [2025-10-03T17:23:30.543076] [DEBUG] [LOCAL ] AUNA: Primary data saved (5004 records). [2025-10-03T17:23:30.543200] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-03T17:23:30.543286] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. AUNA took 14.7s. Estimated remaining: 4h 52m 7s. Rate: 7.5 symbols/min [2025-10-03T17:23:30.740288] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:30.791728] [DEBUG] [LOCAL ] AVA: Loaded 39686 existing records from primary storage. [2025-10-03T17:23:30.792178] [INFO ] [MAIN ] AVA: Loaded 39686 existing records. [2025-10-03T17:23:30.998148] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:30.998928] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-03T17:23:30.998988] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-03T17:23:31.000456] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-03T17:23:31.000520] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-03T17:23:31.194795] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-03T17:23:31.394189] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:31.858960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T17:23:31.861739] [INFO ] [REMOTE ] ATUS: Full fetch complete (71016 records). [2025-10-03T17:23:31.861859] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-03T17:23:31.995727] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-03T17:23:32.298264] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-03T17:23:32.298356] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-03T17:23:32.299128] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-03T17:23:32.299200] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-03T17:23:32.300840] [DEBUG] [LOCAL ] ATUS: Trimmed 71016 records to 49993 (keeping 200 days of data) [2025-10-03T17:23:32.606133] [DEBUG] [LOCAL ] ATUS: Primary data saved (49993 records). [2025-10-03T17:23:32.606283] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-03T17:23:32.606442] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. ATUS took 40.3s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-03T17:23:32.793617] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-03T17:23:32.794951] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:32.807296] [DEBUG] [LOCAL ] AVAL: Loaded 8795 existing records from primary storage. [2025-10-03T17:23:32.807511] [INFO ] [MAIN ] AVAL: Loaded 8795 existing records. [2025-10-03T17:23:33.007473] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:33.007968] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-03T17:23:33.008253] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-03T17:23:33.008522] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-03T17:23:33.008585] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-03T17:23:33.434411] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:33.505050] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-03T17:23:33.503327] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:23:33.590700] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-03T17:23:34.390689] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-03T17:23:34.664348] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:23:35.190629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-03T17:23:35.215169] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:23:35.621359] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:23:35.990721] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-03T17:23:36.790634] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-03T17:23:36.829744] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:23:37.439591] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:23:37.590706] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-03T17:23:37.617051] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:23:38.390710] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-03T17:23:39.031202] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:23:39.190680] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-03T17:23:39.317579] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:23:39.990710] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-03T17:23:40.790634] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-03T17:23:41.320273] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:23:41.590703] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-03T17:23:41.663266] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:23:42.385239] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:23:42.394535] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-03T17:23:43.190736] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-03T17:23:43.282883] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T17:23:43.554061] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T17:23:43.556931] [INFO ] [REMOTE ] AU: Full fetch complete (76283 records). [2025-10-03T17:23:43.557110] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-03T17:23:43.985478] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-03T17:23:43.985596] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-03T17:23:43.986408] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-03T17:23:43.986477] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-03T17:23:43.988072] [DEBUG] [LOCAL ] AU: Trimmed 76283 records to 53773 (keeping 200 days of data) [2025-10-03T17:23:44.042696] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-03T17:23:44.335822] [DEBUG] [LOCAL ] AU: Primary data saved (53773 records). [2025-10-03T17:23:44.335978] [INFO ] [MAIN ] AU: Full history saved. [2025-10-03T17:23:44.337085] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AU took 32.0s. Estimated remaining: 4h 51m 24s. Rate: 7.5 symbols/min [2025-10-03T17:23:44.527914] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:44.574148] [DEBUG] [LOCAL ] AVB: Loaded 42269 existing records from primary storage. [2025-10-03T17:23:44.574470] [INFO ] [MAIN ] AVB: Loaded 42269 existing records. [2025-10-03T17:23:44.783469] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:44.783962] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-03T17:23:44.784091] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-03T17:23:44.784791] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-03T17:23:44.785054] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-03T17:23:44.830291] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-03T17:23:44.918236] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:23:45.230625] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:45.590795] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-03T17:23:45.677984] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:23:45.789205] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:23:46.390696] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-03T17:23:47.188323] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:23:47.197010] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-03T17:23:47.766408] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:23:47.905252] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T17:23:47.990783] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-03T17:23:48.644695] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T17:23:48.790705] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-03T17:23:49.590737] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-03T17:23:50.269893] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:23:50.390736] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-03T17:23:50.676068] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T17:23:51.190748] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-03T17:23:51.207949] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:23:51.990759] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-03T17:23:52.709916] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:23:52.739294] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:23:52.790700] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-03T17:23:53.590741] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-03T17:23:54.331499] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:23:54.390628] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-03T17:23:55.135899] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:23:55.190676] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-03T17:23:55.946591] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:23:55.990693] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-03T17:23:56.350186] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:23:56.352814] [INFO ] [REMOTE ] AUB: Full fetch complete (65777 records). [2025-10-03T17:23:56.352949] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-03T17:23:56.798604] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-03T17:23:56.846997] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-03T17:23:56.847167] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-03T17:23:56.848250] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-03T17:23:56.848329] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-03T17:23:56.850752] [DEBUG] [LOCAL ] AUB: Trimmed 65777 records to 46979 (keeping 200 days of data) [2025-10-03T17:23:57.222332] [DEBUG] [LOCAL ] AUB: Primary data saved (46979 records). [2025-10-03T17:23:57.222534] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-03T17:23:57.223797] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUB took 42.4s. Estimated remaining: 4h 52m 16s. Rate: 7.5 symbols/min [2025-10-03T17:23:57.500162] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:57.500572] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-03T17:23:57.500676] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-03T17:23:57.500866] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-03T17:23:57.501080] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-03T17:23:57.501218] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-03T17:23:57.501298] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-03T17:23:57.643914] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-03T17:23:57.702841] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:23:57.761190] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T17:23:58.117952] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:58.390735] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-03T17:23:59.045451] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:23:59.046822] [INFO ] [REMOTE ] AVAL: Full fetch complete (14751 records). [2025-10-03T17:23:59.046899] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-03T17:23:59.195822] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-03T17:23:59.492466] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-03T17:23:59.492678] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-03T17:23:59.493054] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-03T17:23:59.493183] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-03T17:23:59.494369] [DEBUG] [LOCAL ] AVAL: Trimmed 14751 records to 8914 (keeping 200 days of data) [2025-10-03T17:23:59.574046] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:23:59.595603] [DEBUG] [LOCAL ] AVAL: Primary data saved (8914 records). [2025-10-03T17:23:59.595789] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-03T17:23:59.595902] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AVAL took 27.0s. Estimated remaining: 4h 50m 60s. Rate: 7.5 symbols/min [2025-10-03T17:23:59.794236] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:59.820557] [DEBUG] [LOCAL ] AVD: Loaded 22716 existing records from primary storage. [2025-10-03T17:23:59.820870] [INFO ] [MAIN ] AVD: Loaded 22716 existing records. [2025-10-03T17:24:00.002712] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-03T17:24:00.026384] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:00.027988] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-03T17:24:00.028078] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-03T17:24:00.028912] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-03T17:24:00.029045] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-03T17:24:00.330289] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:24:00.365906] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-03T17:24:00.380117] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:24:00.391147] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-03T17:24:00.406705] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:24:00.406869] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-03T17:24:00.436908] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-03T17:24:00.448958] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-03T17:24:00.472830] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:00.473410] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-03T17:24:00.473744] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVBC took 3.2s. Estimated remaining: 4h 49m 26s. Rate: 7.6 symbols/min [2025-10-03T17:24:00.686873] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:00.693045] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:24:00.696155] [INFO ] [REMOTE ] AVA: Full fetch complete (55794 records). [2025-10-03T17:24:00.696274] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-03T17:24:00.795788] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-03T17:24:00.889245] [DEBUG] [LOCAL ] AVK: Loaded 18153 existing records from primary storage. [2025-10-03T17:24:00.927367] [INFO ] [MAIN ] AVK: Loaded 18153 existing records. [2025-10-03T17:24:01.346519] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-03T17:24:01.343402] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:01.346787] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-03T17:24:01.346871] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-03T17:24:01.347913] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-03T17:24:01.348001] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-03T17:24:01.346925] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-03T17:24:01.348485] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-03T17:24:01.348852] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-03T17:24:01.458624] [DEBUG] [LOCAL ] AVA: Trimmed 55794 records to 39939 (keeping 200 days of data) [2025-10-03T17:24:01.599681] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-03T17:24:01.919852] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:02.072337] [DEBUG] [LOCAL ] AVA: Primary data saved (39939 records). [2025-10-03T17:24:02.072613] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-03T17:24:02.072792] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVA took 31.5s. Estimated remaining: 4h 48m 2s. Rate: 7.6 symbols/min [2025-10-03T17:24:02.189407] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T17:24:02.282520] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:02.322041] [DEBUG] [LOCAL ] AVNS: Loaded 33967 existing records from primary storage. [2025-10-03T17:24:02.322350] [INFO ] [MAIN ] AVNS: Loaded 33967 existing records. [2025-10-03T17:24:02.395800] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-03T17:24:02.524501] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:02.524783] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-03T17:24:02.524837] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-03T17:24:02.525249] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-03T17:24:02.525339] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-03T17:24:02.972443] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:03.180409] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T17:24:03.190976] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-03T17:24:03.426617] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T17:24:03.990697] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-03T17:24:04.572275] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:24:04.790714] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-03T17:24:05.079462] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:24:05.466746] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T17:24:05.590734] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-03T17:24:06.390721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-03T17:24:06.924105] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T17:24:07.190707] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-03T17:24:07.807725] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:24:07.990722] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-03T17:24:08.163253] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:24:08.790714] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-03T17:24:09.357578] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:24:09.590740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-03T17:24:09.828663] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:24:10.390721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-03T17:24:10.725436] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:24:11.190685] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-03T17:24:11.504987] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:24:11.990723] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-03T17:24:12.790676] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-03T17:24:12.817864] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:24:13.246266] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:24:13.590723] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-03T17:24:13.945075] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:24:14.390741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-03T17:24:14.789335] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:24:15.190699] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-03T17:24:15.991876] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-03T17:24:15.999145] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:24:16.605531] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:24:16.657601] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:24:16.790706] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-03T17:24:17.590730] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-03T17:24:17.837324] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:24:18.390687] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-03T17:24:19.055414] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:24:19.190694] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-03T17:24:19.990709] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-03T17:24:20.055626] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:24:20.505621] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:24:20.790690] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-03T17:24:20.969298] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:24:21.590709] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-03T17:24:22.390676] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-03T17:24:22.732611] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T17:24:22.861728] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:24:23.190693] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-03T17:24:23.605026] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T17:24:23.990688] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-03T17:24:24.789788] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T17:24:24.799711] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-03T17:24:24.848544] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:24:25.590717] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-03T17:24:25.995201] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:24:26.390706] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-03T17:24:26.917835] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:24:26.920616] [INFO ] [REMOTE ] AVB: Full fetch complete (58701 records). [2025-10-03T17:24:26.920753] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-03T17:24:27.196109] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-03T17:24:27.359143] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-03T17:24:27.359455] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-03T17:24:27.360680] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-03T17:24:27.360770] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-03T17:24:27.378001] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:24:27.384572] [DEBUG] [LOCAL ] AVB: Trimmed 58701 records to 42525 (keeping 200 days of data) [2025-10-03T17:24:27.671485] [DEBUG] [LOCAL ] AVB: Primary data saved (42525 records). [2025-10-03T17:24:27.671620] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-03T17:24:27.672374] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVB took 43.3s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-03T17:24:27.874331] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:27.923352] [DEBUG] [LOCAL ] AVNT: Loaded 39453 existing records from primary storage. [2025-10-03T17:24:27.923736] [INFO ] [MAIN ] AVNT: Loaded 39453 existing records. [2025-10-03T17:24:27.995815] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-03T17:24:28.129713] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:28.129950] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-03T17:24:28.129999] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-03T17:24:28.130428] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-03T17:24:28.130487] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-03T17:24:28.479169] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:24:28.543254] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:28.790752] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-03T17:24:29.590701] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-03T17:24:29.946397] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:24:30.001070] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:24:30.390736] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-03T17:24:31.190681] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-03T17:24:31.258561] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:24:31.460138] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T17:24:31.854965] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:24:31.857177] [INFO ] [REMOTE ] AVK: Full fetch complete (26847 records). [2025-10-03T17:24:31.857473] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-03T17:24:31.995895] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-03T17:24:32.312196] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-03T17:24:32.312328] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-03T17:24:32.312781] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-03T17:24:32.312846] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-03T17:24:32.314458] [DEBUG] [LOCAL ] AVK: Trimmed 26847 records to 18373 (keeping 200 days of data) [2025-10-03T17:24:32.439911] [DEBUG] [LOCAL ] AVK: Primary data saved (18373 records). [2025-10-03T17:24:32.440078] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-03T17:24:32.440184] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVK took 32.0s. Estimated remaining: 4h 50m 39s. Rate: 7.5 symbols/min [2025-10-03T17:24:32.640528] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:32.702819] [DEBUG] [LOCAL ] AVTR: Loaded 53952 existing records from primary storage. [2025-10-03T17:24:32.703182] [INFO ] [MAIN ] AVTR: Loaded 53952 existing records. [2025-10-03T17:24:32.798234] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-03T17:24:32.834925] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:24:32.880818] [INFO ] [REMOTE ] AVD: Full fetch complete (33598 records). [2025-10-03T17:24:32.893338] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-03T17:24:32.949244] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:33.006467] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-03T17:24:33.026081] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-03T17:24:33.050596] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-03T17:24:33.053857] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-03T17:24:33.591585] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-03T17:24:33.802012] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-03T17:24:33.825931] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:33.826020] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-03T17:24:33.826674] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-03T17:24:33.826759] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-03T17:24:33.828014] [DEBUG] [LOCAL ] AVD: Trimmed 33598 records to 22804 (keeping 200 days of data) [2025-10-03T17:24:33.966412] [DEBUG] [LOCAL ] AVD: Primary data saved (22804 records). [2025-10-03T17:24:33.966567] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-03T17:24:33.966686] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVD took 34.4s. Estimated remaining: 4h 49m 15s. Rate: 7.6 symbols/min [2025-10-03T17:24:34.113332] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T17:24:34.143865] [INFO ] [REMOTE ] AVNS: Full fetch complete (48364 records). [2025-10-03T17:24:34.157204] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-03T17:24:34.181510] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:34.405479] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-03T17:24:34.518864] [DEBUG] [LOCAL ] AVY: Loaded 37777 existing records from primary storage. [2025-10-03T17:24:34.533133] [INFO ] [MAIN ] AVY: Loaded 37777 existing records. [2025-10-03T17:24:34.880546] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:34.880961] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-03T17:24:34.881220] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-03T17:24:34.881410] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-03T17:24:34.881758] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-03T17:24:34.882793] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-03T17:24:34.882981] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-03T17:24:34.883352] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-03T17:24:34.883454] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-03T17:24:34.965442] [DEBUG] [LOCAL ] AVNS: Trimmed 48364 records to 34232 (keeping 200 days of data) [2025-10-03T17:24:35.379378] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T17:24:35.468915] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-03T17:24:35.522290] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:35.569016] [DEBUG] [LOCAL ] AVNS: Primary data saved (34232 records). [2025-10-03T17:24:35.569160] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-03T17:24:35.569251] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVNS took 33.5s. Estimated remaining: 4h 47m 53s. Rate: 7.6 symbols/min [2025-10-03T17:24:35.767605] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:35.796977] [DEBUG] [LOCAL ] AWF: Loaded 24560 existing records from primary storage. [2025-10-03T17:24:35.797279] [INFO ] [MAIN ] AWF: Loaded 24560 existing records. [2025-10-03T17:24:35.991674] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-03T17:24:36.008482] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:36.010137] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-03T17:24:36.010195] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-03T17:24:36.010506] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-03T17:24:36.010566] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-03T17:24:36.435915] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:36.470501] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-03T17:24:36.540407] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:24:36.790684] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-03T17:24:37.211807] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:24:37.590716] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-03T17:24:38.189515] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:24:38.390692] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-03T17:24:38.991750] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:24:39.190734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-03T17:24:39.871495] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:24:39.990731] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-03T17:24:40.669595] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:24:40.790679] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-03T17:24:41.596932] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-03T17:24:41.617236] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T17:24:42.402320] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-03T17:24:42.408261] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:24:42.745766] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:24:43.190725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-03T17:24:43.658317] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:24:43.990726] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-03T17:24:44.621225] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:24:44.790745] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-03T17:24:45.590723] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-03T17:24:45.734005] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T17:24:45.764222] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:24:46.390706] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-03T17:24:47.181501] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:24:47.191390] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-03T17:24:47.365748] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T17:24:47.990731] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-03T17:24:48.790673] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-03T17:24:49.129737] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:24:49.330667] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:24:49.590737] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-03T17:24:50.257290] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:24:50.390744] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-03T17:24:50.929031] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:24:51.190741] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-03T17:24:51.696194] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:24:51.990703] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-03T17:24:52.576849] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T17:24:52.790862] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-03T17:24:53.590727] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-03T17:24:53.750234] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T17:24:53.785098] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T17:24:54.390739] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-03T17:24:55.017597] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:24:55.190721] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-03T17:24:55.940669] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:24:55.978666] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:24:55.990604] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-03T17:24:56.790693] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-03T17:24:57.087411] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T17:24:57.590725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-03T17:24:58.053390] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:24:58.058089] [INFO ] [REMOTE ] AVNT: Full fetch complete (56497 records). [2025-10-03T17:24:58.058288] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-03T17:24:58.395874] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-03T17:24:58.520882] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-03T17:24:58.520983] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-03T17:24:58.521713] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-03T17:24:58.521785] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-03T17:24:58.523243] [DEBUG] [LOCAL ] AVNT: Trimmed 56497 records to 39711 (keeping 200 days of data) [2025-10-03T17:24:58.783003] [DEBUG] [LOCAL ] AVNT: Primary data saved (39711 records). [2025-10-03T17:24:58.783163] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-03T17:24:58.783988] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVNT took 31.1s. Estimated remaining: 4h 50m 43s. Rate: 7.5 symbols/min [2025-10-03T17:24:58.973933] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:58.974323] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-03T17:24:58.974451] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-03T17:24:58.974741] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-03T17:24:58.974852] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-03T17:24:58.974959] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-03T17:24:58.975024] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-03T17:24:59.121067] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:24:59.192878] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-03T17:24:59.426312] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:59.884131] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T17:24:59.990741] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-03T17:25:00.790695] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-03T17:25:00.916713] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:25:01.253560] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:25:01.590921] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-03T17:25:02.270632] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:25:02.390721] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-03T17:25:03.138093] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:25:03.190708] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-03T17:25:03.617073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:25:03.990700] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-03T17:25:04.689442] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:25:04.790690] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-03T17:25:05.590690] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-03T17:25:05.798990] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T17:25:06.244314] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:25:06.390685] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-03T17:25:06.566428] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:25:06.568198] [INFO ] [REMOTE ] AWF: Full fetch complete (36190 records). [2025-10-03T17:25:06.568323] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-03T17:25:07.001464] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-03T17:25:07.001582] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-03T17:25:07.002182] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-03T17:25:07.002246] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-03T17:25:07.003410] [DEBUG] [LOCAL ] AWF: Trimmed 36190 records to 24788 (keeping 200 days of data) [2025-10-03T17:25:07.166121] [DEBUG] [LOCAL ] AWF: Primary data saved (24788 records). [2025-10-03T17:25:07.166269] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-03T17:25:07.166365] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AWF took 31.6s. Estimated remaining: 4h 50m 40s. Rate: 7.5 symbols/min [2025-10-03T17:25:07.201529] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-03T17:25:07.366457] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:07.418227] [DEBUG] [LOCAL ] AWK: Loaded 49037 existing records from primary storage. [2025-10-03T17:25:07.418637] [INFO ] [MAIN ] AWK: Loaded 49037 existing records. [2025-10-03T17:25:07.564530] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T17:25:07.668605] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:07.668887] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-03T17:25:07.668944] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-03T17:25:07.669469] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-03T17:25:07.669539] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-03T17:25:07.997227] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-03T17:25:08.088603] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:08.462227] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:25:08.464496] [INFO ] [REMOTE ] AVY: Full fetch complete (56356 records). [2025-10-03T17:25:08.464634] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-03T17:25:08.798210] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-03T17:25:08.906231] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-03T17:25:08.906328] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-03T17:25:08.907055] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-03T17:25:08.907147] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-03T17:25:08.908512] [DEBUG] [LOCAL ] AVY: Trimmed 56356 records to 38061 (keeping 200 days of data) [2025-10-03T17:25:09.169357] [DEBUG] [LOCAL ] AVY: Primary data saved (38061 records). [2025-10-03T17:25:09.169593] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-03T17:25:09.169747] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AVY took 35.2s. Estimated remaining: 4h 49m 23s. Rate: 7.5 symbols/min [2025-10-03T17:25:09.365987] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:09.389949] [DEBUG] [LOCAL ] AWP: Loaded 21611 existing records from primary storage. [2025-10-03T17:25:09.390231] [INFO ] [MAIN ] AWP: Loaded 21611 existing records. [2025-10-03T17:25:09.606276] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:09.606474] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-03T17:25:09.608483] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-03T17:25:09.608552] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-03T17:25:09.608905] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-03T17:25:09.608968] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-03T17:25:10.065813] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:10.111242] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T17:25:10.119048] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T17:25:10.390685] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-03T17:25:11.136241] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:25:11.190689] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-03T17:25:11.990683] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-03T17:25:12.236488] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:25:12.255102] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:25:12.257818] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-10-03T17:25:12.258112] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-03T17:25:12.701762] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-03T17:25:12.701863] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-03T17:25:12.702733] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-03T17:25:12.702804] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-03T17:25:12.704484] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 54342 (keeping 200 days of data) [2025-10-03T17:25:12.795951] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-03T17:25:13.071947] [DEBUG] [LOCAL ] AVTR: Primary data saved (54342 records). [2025-10-03T17:25:13.072568] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-03T17:25:13.073994] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AVTR took 40.6s. Estimated remaining: 4h 48m 28s. Rate: 7.6 symbols/min [2025-10-03T17:25:13.272082] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:13.297252] [DEBUG] [LOCAL ] AWR: Loaded 22776 existing records from primary storage. [2025-10-03T17:25:13.297532] [INFO ] [MAIN ] AWR: Loaded 22776 existing records. [2025-10-03T17:25:13.490395] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:13.490782] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-03T17:25:13.490855] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-03T17:25:13.491175] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-03T17:25:13.491234] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-03T17:25:13.602821] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-03T17:25:13.904483] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:13.919595] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T17:25:13.951080] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T17:25:14.390688] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-03T17:25:14.942573] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:25:15.190693] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-03T17:25:15.842208] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:25:15.990708] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-03T17:25:16.619508] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:25:16.790703] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-03T17:25:17.590698] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-03T17:25:17.822107] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:25:17.874888] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:25:18.390668] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-03T17:25:18.712777] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T17:25:19.190698] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-03T17:25:19.990685] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-03T17:25:20.130706] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:25:20.341823] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:25:20.790633] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-03T17:25:21.167059] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T17:25:21.590680] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-03T17:25:21.876350] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T17:25:22.390675] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-03T17:25:22.557978] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:25:23.190717] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-03T17:25:23.544098] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:25:23.990732] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-03T17:25:24.443362] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T17:25:24.790676] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-03T17:25:25.026710] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:25:25.509264] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:25:25.590625] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-03T17:25:26.390671] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-03T17:25:26.710545] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T17:25:27.190729] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-03T17:25:27.990635] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-03T17:25:28.262847] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:25:28.291018] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:25:28.790740] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-03T17:25:29.037999] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:25:29.590717] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-03T17:25:29.624924] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T17:25:30.390720] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-03T17:25:30.926467] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:25:31.190725] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-03T17:25:31.851034] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:25:31.990691] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-03T17:25:32.298166] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:25:32.790753] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-03T17:25:33.566521] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:25:33.590678] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-03T17:25:33.770509] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T17:25:34.390729] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-03T17:25:35.190778] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-03T17:25:35.219835] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:25:35.249440] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:25:35.990622] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-03T17:25:36.321716] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T17:25:36.790776] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-03T17:25:36.851762] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:25:36.854066] [INFO ] [REMOTE ] AWI: Full fetch complete (35608 records). [2025-10-03T17:25:36.854189] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-03T17:25:37.283335] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-03T17:25:37.283443] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-03T17:25:37.284019] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-03T17:25:37.284087] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-03T17:25:37.286531] [DEBUG] [LOCAL ] AWI: Trimmed 35608 records to 25738 (keeping 200 days of data) [2025-10-03T17:25:37.478626] [DEBUG] [LOCAL ] AWI: Primary data saved (25738 records). [2025-10-03T17:25:37.478816] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-03T17:25:37.478942] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AWI took 38.7s. Estimated remaining: 4h 51m 28s. Rate: 7.5 symbols/min [2025-10-03T17:25:37.595890] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-03T17:25:37.681968] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:37.713016] [DEBUG] [LOCAL ] AX: Loaded 28542 existing records from primary storage. [2025-10-03T17:25:37.713322] [INFO ] [MAIN ] AX: Loaded 28542 existing records. [2025-10-03T17:25:37.932755] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:25:37.939883] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:37.946041] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-03T17:25:37.946557] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-03T17:25:37.946971] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-03T17:25:37.947035] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-03T17:25:38.334816] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:38.390736] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-03T17:25:39.192260] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-03T17:25:39.195550] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:25:39.282791] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:25:39.990693] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-03T17:25:40.528432] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:25:40.790638] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-03T17:25:41.100020] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:25:41.590742] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-03T17:25:42.154103] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:25:42.390778] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-03T17:25:42.548591] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:25:42.550860] [INFO ] [REMOTE ] AWR: Full fetch complete (32203 records). [2025-10-03T17:25:42.551014] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-03T17:25:43.094475] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-03T17:25:43.094594] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-03T17:25:43.095111] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-03T17:25:43.095179] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-03T17:25:43.096260] [DEBUG] [LOCAL ] AWR: Trimmed 32203 records to 22954 (keeping 200 days of data) [2025-10-03T17:25:43.196307] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-03T17:25:43.256156] [DEBUG] [LOCAL ] AWR: Primary data saved (22954 records). [2025-10-03T17:25:43.256306] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-03T17:25:43.256397] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWR took 30.2s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-03T17:25:43.442066] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:43.496689] [DEBUG] [LOCAL ] AXL: Loaded 50866 existing records from primary storage. [2025-10-03T17:25:43.497034] [INFO ] [MAIN ] AXL: Loaded 50866 existing records. [2025-10-03T17:25:43.706449] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:43.707352] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-03T17:25:43.708740] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-03T17:25:43.708571] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:25:43.716197] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-03T17:25:43.716301] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-03T17:25:43.995885] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-03T17:25:44.100206] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:44.740552] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:25:44.790747] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-03T17:25:45.537017] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T17:25:45.590719] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-03T17:25:46.390696] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-03T17:25:46.545376] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:25:46.629339] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T17:25:47.190736] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-03T17:25:47.470068] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:25:47.472198] [INFO ] [REMOTE ] AWK: Full fetch complete (70325 records). [2025-10-03T17:25:47.472333] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-03T17:25:47.473424] [FATAL] [VALIDATOR ] AWK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:25:47.473531] [FATAL] [MAIN ] AWK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:25:47.473584] [WARN ] [MAIN ] AWK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:25:47.473718] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-03T17:25:47.473807] [DEBUG] [LOCAL ] AWK: No primary data file found to delete. [2025-10-03T17:25:47.473875] [INFO ] [LOCAL ] AWK: Starting deletion of derivative data. [2025-10-03T17:25:47.474293] [DEBUG] [LOCAL ] AWK: Deleted derivative data file. [2025-10-03T17:25:47.474414] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWK took 40.3s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-03T17:25:47.670738] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:47.737248] [DEBUG] [LOCAL ] AXP: Loaded 53579 existing records from primary storage. [2025-10-03T17:25:47.737713] [INFO ] [MAIN ] AXP: Loaded 53579 existing records. [2025-10-03T17:25:47.937956] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:47.938212] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-03T17:25:47.938265] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-03T17:25:47.938916] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-03T17:25:47.938978] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-03T17:25:47.999828] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-03T17:25:48.264461] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:25:48.287286] [INFO ] [REMOTE ] AWP: Full fetch complete (32245 records). [2025-10-03T17:25:48.313568] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-03T17:25:48.354535] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:48.786186] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-03T17:25:48.786308] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-03T17:25:48.786802] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-03T17:25:48.786868] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-03T17:25:48.787790] [DEBUG] [LOCAL ] AWP: Trimmed 32245 records to 21755 (keeping 200 days of data) [2025-10-03T17:25:48.790693] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-03T17:25:48.926580] [DEBUG] [LOCAL ] AWP: Primary data saved (21755 records). [2025-10-03T17:25:48.926747] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-03T17:25:48.926873] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWP took 39.8s. Estimated remaining: 4h 48m 43s. Rate: 7.5 symbols/min [2025-10-03T17:25:49.124277] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:49.124476] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-03T17:25:49.124516] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-03T17:25:49.124633] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-03T17:25:49.124715] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-03T17:25:49.124767] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-03T17:25:49.124831] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-03T17:25:49.578216] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:49.590638] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-03T17:25:49.668946] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:25:50.390633] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-03T17:25:50.712143] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T17:25:50.915510] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T17:25:51.190730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-03T17:25:51.948106] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T17:25:51.990719] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-03T17:25:52.790686] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-03T17:25:53.111511] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:25:53.284084] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-03T17:25:53.551936] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T17:25:53.590745] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-03T17:25:54.255495] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:25:54.390724] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-03T17:25:55.190707] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-03T17:25:55.990695] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-03T17:25:56.366969] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:25:56.465824] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T17:25:56.790694] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-03T17:25:57.468217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:25:57.590685] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-03T17:25:58.400674] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-03T17:25:58.407155] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:25:58.964912] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T17:25:59.141038] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:25:59.190690] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-03T17:25:59.990701] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-03T17:26:00.790708] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-03T17:26:01.310592] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:26:01.308573] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-03T17:26:01.590722] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-03T17:26:01.670992] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:26:02.390705] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-03T17:26:02.939971] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:26:02.958816] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T17:26:03.190697] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-03T17:26:03.813814] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T17:26:03.990709] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-03T17:26:04.790736] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-03T17:26:05.590741] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-03T17:26:06.193227] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T17:26:06.390710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-03T17:26:06.435942] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T17:26:06.481980] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T17:26:07.190701] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-03T17:26:07.598319] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:26:07.781916] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T17:26:07.990704] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-03T17:26:08.790710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-03T17:26:09.319193] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:26:09.590709] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-03T17:26:09.825830] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:26:09.827769] [INFO ] [REMOTE ] AX: Full fetch complete (42676 records). [2025-10-03T17:26:09.827876] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-03T17:26:10.255436] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-03T17:26:10.255524] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-03T17:26:10.256064] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-03T17:26:10.256129] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-03T17:26:10.257191] [DEBUG] [LOCAL ] AX: Trimmed 42676 records to 28727 (keeping 200 days of data) [2025-10-03T17:26:10.391163] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-03T17:26:10.457554] [DEBUG] [LOCAL ] AX: Primary data saved (28727 records). [2025-10-03T17:26:10.457749] [INFO ] [MAIN ] AX: Full history saved. [2025-10-03T17:26:10.457854] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AX took 33.0s. Estimated remaining: 4h 51m 6s. Rate: 7.5 symbols/min [2025-10-03T17:26:10.647603] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:10.693856] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-03T17:26:10.694186] [INFO ] [MAIN ] AXS: Loaded 38703 existing records. [2025-10-03T17:26:10.884951] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:10.886973] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-03T17:26:10.887030] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-03T17:26:10.887553] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-03T17:26:10.887624] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-03T17:26:10.999699] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:26:11.195078] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-03T17:26:11.224546] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:26:11.342121] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:11.990694] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-03T17:26:12.790699] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-03T17:26:13.054008] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T17:26:13.138628] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-03T17:26:13.590733] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-03T17:26:13.865449] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:26:14.390692] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-03T17:26:14.904511] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T17:26:14.905322] [INFO ] [REMOTE ] AXR: Full fetch complete (4803 records). [2025-10-03T17:26:14.905399] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-03T17:26:15.197449] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-03T17:26:15.337074] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-03T17:26:15.337152] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-03T17:26:15.337304] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-03T17:26:15.337345] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-03T17:26:15.337747] [DEBUG] [LOCAL ] AXR: Trimmed 4803 records to 3061 (keeping 200 days of data) [2025-10-03T17:26:15.356287] [DEBUG] [LOCAL ] AXR: Primary data saved (3061 records). [2025-10-03T17:26:15.356380] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-03T17:26:15.356450] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 26.4s. Estimated remaining: 4h 50m 23s. Rate: 7.5 symbols/min [2025-10-03T17:26:15.547069] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:15.609336] [DEBUG] [LOCAL ] AXTA: Loaded 52453 existing records from primary storage. [2025-10-03T17:26:15.610033] [INFO ] [MAIN ] AXTA: Loaded 52453 existing records. [2025-10-03T17:26:15.827441] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:15.827950] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-03T17:26:15.828130] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-03T17:26:15.842124] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-03T17:26:15.850897] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-03T17:26:15.930022] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T17:26:15.992742] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-03T17:26:16.275210] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:16.790696] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-03T17:26:17.031008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-03T17:26:17.033950] [INFO ] [REMOTE ] AXL: Full fetch complete (72702 records). [2025-10-03T17:26:17.034165] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-03T17:26:17.482665] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-03T17:26:17.482859] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-03T17:26:17.483991] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-03T17:26:17.484062] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-03T17:26:17.485535] [DEBUG] [LOCAL ] AXL: Trimmed 72702 records to 51239 (keeping 200 days of data) [2025-10-03T17:26:17.590673] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-03T17:26:17.738135] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:26:17.826213] [DEBUG] [LOCAL ] AXL: Primary data saved (51239 records). [2025-10-03T17:26:17.826371] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-03T17:26:17.827347] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXL took 34.6s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-03T17:26:18.390628] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-03T17:26:18.578303] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T17:26:19.190735] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-03T17:26:19.294299] [DEBUG] [REMOTE ] AXTA: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T17:26:19.294599] [WARN ] [REMOTE ] AXTA: No data returned for month 2025-01 [2025-10-03T17:26:19.294724] [FATAL] [REMOTE ] AXTA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:26:19.294807] [FATAL] [MAIN ] AXTA: Failed to fetch primary data. [2025-10-03T17:26:19.294870] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:26:19.294943] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-03T17:26:19.295008] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-03T17:26:19.295046] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-10-03T17:26:19.295440] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-10-03T17:26:19.295527] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AXTA took 3.9s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:26:19.562933] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T17:26:19.927578] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:26:19.990702] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-03T17:26:20.790703] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-03T17:26:21.071575] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T17:26:21.590779] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-03T17:26:22.940684] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-03T17:26:22.953699] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-03T17:26:22.985453] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:26:23.190747] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-03T17:26:24.326793] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T17:26:24.335947] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-03T17:26:24.959624] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T17:26:24.962463] [INFO ] [REMOTE ] AXP: Full fetch complete (76928 records). [2025-10-03T17:26:24.962628] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-03T17:26:25.397836] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-03T17:26:25.397990] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-03T17:26:25.398887] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-03T17:26:25.399012] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-03T17:26:25.414289] [DEBUG] [LOCAL ] AXP: Trimmed 76928 records to 53964 (keeping 200 days of data) [2025-10-03T17:26:25.428103] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:26:25.501974] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-03T17:26:25.792264] [DEBUG] [LOCAL ] AXP: Primary data saved (53964 records). [2025-10-03T17:26:25.792403] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-03T17:26:25.792508] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXP took 38.3s. Estimated remaining: 4h 47m 31s. Rate: 7.6 symbols/min [2025-10-03T17:26:27.026251] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T17:26:27.035268] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-03T17:26:28.588524] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:26:28.598329] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-03T17:26:30.127137] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T17:26:30.136458] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-03T17:26:31.651941] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T17:26:31.661825] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-03T17:26:32.909100] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:26:32.911825] [INFO ] [REMOTE ] AXS: Full fetch complete (55730 records). [2025-10-03T17:26:32.911939] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-03T17:26:33.323183] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-03T17:26:33.323262] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-03T17:26:33.323853] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-03T17:26:33.323917] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-03T17:26:33.325098] [DEBUG] [LOCAL ] AXS: Trimmed 55730 records to 38977 (keeping 200 days of data) [2025-10-03T17:26:33.576907] [DEBUG] [LOCAL ] AXS: Primary data saved (38977 records). [2025-10-03T17:26:33.577071] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-03T17:26:33.577781] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXS took 23.1s. Estimated remaining: 4h 47m 21s. Rate: 7.6 symbols/min [2025-10-03T17:26:34.254678] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.362542] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.386559] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.387146] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-03T17:26:34.366590] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.387448] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-03T17:26:34.388629] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-03T17:26:34.388716] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-03T17:26:34.388768] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-03T17:26:34.388803] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-03T17:26:34.487929] [DEBUG] [LOCAL ] AZO: Loaded 11370 existing records from primary storage. [2025-10-03T17:26:34.533391] [INFO ] [MAIN ] AZO: Loaded 11370 existing records. [2025-10-03T17:26:34.602568] [DEBUG] [LOCAL ] AZZ: Loaded 22158 existing records from primary storage. [2025-10-03T17:26:34.671382] [DEBUG] [LOCAL ] AYI: Loaded 25458 existing records from primary storage. [2025-10-03T17:26:34.708307] [INFO ] [MAIN ] AYI: Loaded 25458 existing records. [2025-10-03T17:26:34.692576] [INFO ] [MAIN ] AZZ: Loaded 22158 existing records. [2025-10-03T17:26:35.189172] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.262678] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.315784] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-03T17:26:35.463937] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:35.469169] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-03T17:26:35.470107] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-03T17:26:35.470198] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-03T17:26:35.473607] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.531149] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.547336] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.583848] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-03T17:26:35.552730] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.589258] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-03T17:26:35.616280] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-03T17:26:35.616210] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-03T17:26:35.626841] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-03T17:26:35.626982] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-03T17:26:36.452003] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.468866] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-03T17:26:36.752007] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.769056] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-03T17:26:36.798279] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.798951] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-03T17:26:36.826087] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T17:26:36.834280] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-03T17:26:37.451636] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T17:26:37.455305] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-03T17:26:38.035392] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:26:38.040469] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-03T17:26:38.117847] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:26:38.119396] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T17:26:38.125015] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-03T17:26:38.133427] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-03T17:26:38.267175] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:26:38.270043] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-03T17:26:38.320994] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:26:38.321377] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-03T17:26:38.321473] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:26:38.321558] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-03T17:26:38.321609] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:26:38.321724] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-03T17:26:38.321802] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-03T17:26:38.321841] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-03T17:26:38.321897] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-03T17:26:38.321980] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. B took 4.7s. Estimated remaining: 4h 46m 38s. Rate: 7.6 symbols/min [2025-10-03T17:26:38.512159] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:38.576511] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-03T17:26:38.576929] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-03T17:26:38.778150] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:38.778444] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-03T17:26:38.778680] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-03T17:26:38.778957] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-03T17:26:38.779028] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-03T17:26:38.903361] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T17:26:38.916684] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-03T17:26:39.197472] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:39.203582] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-03T17:26:39.216730] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:26:39.224173] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-03T17:26:39.247114] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:26:39.254727] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-03T17:26:39.852112] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:26:39.990748] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-03T17:26:40.360935] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T17:26:40.445857] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:26:40.790720] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-03T17:26:40.844954] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T17:26:41.558335] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:26:41.590638] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-03T17:26:41.667689] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T17:26:42.390691] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-03T17:26:43.190699] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-03T17:26:43.675686] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:26:43.948717] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-03T17:26:43.990623] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-03T17:26:44.196181] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:26:44.790695] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-03T17:26:45.590739] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-03T17:26:45.780413] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:26:46.390631] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-03T17:26:46.439856] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-03T17:26:46.617813] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:26:47.190711] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-03T17:26:47.990692] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-03T17:26:48.228826] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:26:48.325981] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T17:26:48.790724] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-03T17:26:49.338501] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T17:26:49.590686] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-03T17:26:50.390723] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-03T17:26:50.493483] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-03T17:26:50.722362] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:26:51.190728] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-03T17:26:51.596675] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:26:51.990733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-03T17:26:52.132168] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T17:26:52.790721] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-03T17:26:53.019632] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T17:26:53.485739] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:26:53.486802] [INFO ] [REMOTE ] AZO: Full fetch complete (16154 records). [2025-10-03T17:26:53.486876] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-03T17:26:53.595803] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-03T17:26:53.926473] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-03T17:26:53.926552] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-03T17:26:53.926851] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-03T17:26:53.926912] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-03T17:26:53.927494] [DEBUG] [LOCAL ] AZO: Trimmed 16154 records to 11424 (keeping 200 days of data) [2025-10-03T17:26:54.007149] [DEBUG] [LOCAL ] AZO: Primary data saved (11424 records). [2025-10-03T17:26:54.007289] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-03T17:26:54.007374] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AZO took 20.4s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:26:54.201671] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:54.261095] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-03T17:26:54.261435] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-03T17:26:54.395769] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-03T17:26:54.473546] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:54.473850] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-03T17:26:54.473926] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-03T17:26:54.474247] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-03T17:26:54.474308] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-03T17:26:54.881688] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:55.190735] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-03T17:26:55.785325] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T17:26:55.990707] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-03T17:26:56.279212] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-03T17:26:56.790694] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-03T17:26:57.012565] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:26:57.590725] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-03T17:26:57.702738] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-03T17:26:58.390631] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-03T17:26:58.460210] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:26:59.117205] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T17:26:59.190750] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-03T17:26:59.990673] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-03T17:27:00.195570] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:27:00.790678] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-03T17:27:01.184717] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-03T17:27:01.590732] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-03T17:27:01.723768] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:27:01.725285] [INFO ] [REMOTE ] AZZ: Full fetch complete (30787 records). [2025-10-03T17:27:01.725367] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-03T17:27:01.726235] [FATAL] [VALIDATOR ] AZZ: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:01.726328] [FATAL] [MAIN ] AZZ: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:01.726396] [WARN ] [MAIN ] AZZ: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:01.726486] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-03T17:27:01.726569] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-10-03T17:27:01.726620] [INFO ] [LOCAL ] AZZ: Starting deletion of derivative data. [2025-10-03T17:27:01.727292] [DEBUG] [LOCAL ] AZZ: Deleted derivative data file. [2025-10-03T17:27:01.727421] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AZZ took 28.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-03T17:27:01.940173] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:01.993668] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-03T17:27:01.994023] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-03T17:27:02.185815] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:02.186082] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-03T17:27:02.186134] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-03T17:27:02.186423] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-03T17:27:02.186486] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-03T17:27:02.395995] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-03T17:27:02.592143] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:02.625608] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-03T17:27:02.826313] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T17:27:03.190691] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-03T17:27:03.990700] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-03T17:27:04.790745] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-03T17:27:05.057912] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:27:05.115213] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-03T17:27:05.235203] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T17:27:05.590681] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-03T17:27:06.390691] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-03T17:27:07.190743] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-03T17:27:07.435751] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-03T17:27:07.990672] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-03T17:27:08.010225] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-03T17:27:08.302145] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:27:08.494856] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T17:27:08.790687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-03T17:27:09.590692] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-03T17:27:10.391985] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-03T17:27:10.390679] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-03T17:27:11.198417] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-03T17:27:11.220756] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T17:27:11.473563] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:27:11.475317] [INFO ] [REMOTE ] AYI: Full fetch complete (36964 records). [2025-10-03T17:27:11.475402] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-03T17:27:11.476144] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:11.476233] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:11.476279] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:11.476319] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-03T17:27:11.476377] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-03T17:27:11.476423] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-10-03T17:27:11.476862] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-10-03T17:27:11.476982] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AYI took 37.9s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:27:11.685777] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:11.752018] [DEBUG] [LOCAL ] BAH: Loaded 52055 existing records from primary storage. [2025-10-03T17:27:11.752405] [INFO ] [MAIN ] BAH: Loaded 52055 existing records. [2025-10-03T17:27:11.962242] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:11.962601] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-03T17:27:11.962688] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-03T17:27:11.963024] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-03T17:27:11.963093] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-03T17:27:11.996010] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-03T17:27:12.387521] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:12.421516] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-03T17:27:12.790687] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-03T17:27:13.487671] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-03T17:27:13.590679] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-03T17:27:14.390632] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-03T17:27:14.783858] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-03T17:27:14.898993] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T17:27:14.901314] [INFO ] [REMOTE ] BA: Full fetch complete (77534 records). [2025-10-03T17:27:14.901428] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-03T17:27:14.902309] [FATAL] [VALIDATOR ] BA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:14.902424] [FATAL] [MAIN ] BA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:14.902470] [WARN ] [MAIN ] BA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:14.902542] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-03T17:27:14.902624] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-03T17:27:14.902713] [INFO ] [LOCAL ] BA: Starting deletion of derivative data. [2025-10-03T17:27:14.903027] [DEBUG] [LOCAL ] BA: Deleted derivative data file. [2025-10-03T17:27:14.903581] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. BA took 36.6s. Estimated remaining: 4h 46m 58s. Rate: 7.5 symbols/min [2025-10-03T17:27:15.089682] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:15.134543] [DEBUG] [LOCAL ] BAK: Loaded 39471 existing records from primary storage. [2025-10-03T17:27:15.134908] [INFO ] [MAIN ] BAK: Loaded 39471 existing records. [2025-10-03T17:27:15.204522] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-03T17:27:15.329732] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:15.329985] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-03T17:27:15.330057] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-03T17:27:15.330376] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-03T17:27:15.330439] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-03T17:27:15.714708] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:15.990635] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-03T17:27:16.068446] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T17:27:16.125156] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-03T17:27:16.790705] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-03T17:27:17.590723] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-03T17:27:17.700007] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-03T17:27:17.867220] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:27:18.390690] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-03T17:27:19.190670] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-03T17:27:19.275799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:27:19.387151] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T17:27:19.512834] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:27:19.990728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-03T17:27:20.790732] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-03T17:27:21.349516] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T17:27:21.590728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-03T17:27:22.201010] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-10-03T17:27:22.390722] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-03T17:27:22.453626] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T17:27:23.058720] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T17:27:23.190730] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-03T17:27:23.990741] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-03T17:27:24.790633] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-03T17:27:24.865517] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:27:25.115772] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-03T17:27:25.415078] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:27:25.590725] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-03T17:27:26.390731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-03T17:27:27.024562] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:27:27.109848] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T17:27:27.190700] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-03T17:27:27.990681] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-03T17:27:28.276712] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:27:28.542117] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:27:28.790688] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-03T17:27:29.590706] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-03T17:27:30.390706] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-03T17:27:30.469186] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:27:30.783935] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-03T17:27:31.195757] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-03T17:27:31.216617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:27:31.990711] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-03T17:27:32.664595] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-03T17:27:32.790718] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-03T17:27:33.583251] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:27:33.591775] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-03T17:27:33.878346] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-03T17:27:33.881294] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-03T17:27:33.881481] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-03T17:27:34.342564] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-03T17:27:34.342682] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-03T17:27:34.343463] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-03T17:27:34.343510] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-03T17:27:34.345156] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-10-03T17:27:34.406529] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-03T17:27:34.618800] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:27:34.749669] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-03T17:27:34.749867] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-03T17:27:34.749978] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BABA took 40.7s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-03T17:27:34.935441] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:34.987410] [DEBUG] [LOCAL ] BALL: Loaded 52177 existing records from primary storage. [2025-10-03T17:27:34.987787] [INFO ] [MAIN ] BALL: Loaded 52177 existing records. [2025-10-03T17:27:35.192236] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-03T17:27:35.196521] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:35.197877] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-03T17:27:35.197932] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-03T17:27:35.198316] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-03T17:27:35.198376] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-03T17:27:35.612301] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:35.887351] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:27:35.990635] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-03T17:27:36.464349] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-03T17:27:36.790744] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-03T17:27:37.130413] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:27:37.523203] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:27:37.590724] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-03T17:27:37.957374] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T17:27:37.962954] [INFO ] [REMOTE ] BAK: Full fetch complete (57149 records). [2025-10-03T17:27:37.963184] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-03T17:27:38.395797] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-03T17:27:38.473763] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-03T17:27:38.473846] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-03T17:27:38.474506] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-03T17:27:38.474552] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-03T17:27:38.476147] [DEBUG] [LOCAL ] BAK: Trimmed 57149 records to 39773 (keeping 200 days of data) [2025-10-03T17:27:38.713871] [DEBUG] [LOCAL ] BAK: Primary data saved (39773 records). [2025-10-03T17:27:38.714629] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-03T17:27:38.715559] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAK took 23.8s. Estimated remaining: 4h 48m 5s. Rate: 7.5 symbols/min [2025-10-03T17:27:38.911117] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:38.911285] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-03T17:27:38.911324] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-03T17:27:38.911438] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-03T17:27:38.911481] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-03T17:27:38.911525] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-03T17:27:38.911560] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-03T17:27:39.200570] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-03T17:27:39.311235] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:39.377462] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T17:27:39.990698] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-03T17:27:40.200404] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T17:27:40.790755] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-03T17:27:41.359336] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:27:41.590754] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-03T17:27:41.671625] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T17:27:42.048483] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:27:42.390668] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-03T17:27:42.765610] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:27:43.190699] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-03T17:27:43.990724] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-03T17:27:44.730727] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-03T17:27:44.790725] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-03T17:27:44.909098] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:27:45.566272] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T17:27:45.570020] [INFO ] [REMOTE ] BAH: Full fetch complete (74841 records). [2025-10-03T17:27:45.570260] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-03T17:27:45.596070] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-03T17:27:46.125146] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-03T17:27:46.125250] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-03T17:27:46.126065] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-03T17:27:46.126136] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-03T17:27:46.127821] [DEBUG] [LOCAL ] BAH: Trimmed 74841 records to 52444 (keeping 200 days of data) [2025-10-03T17:27:46.391035] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-03T17:27:46.475888] [DEBUG] [LOCAL ] BAH: Primary data saved (52444 records). [2025-10-03T17:27:46.476041] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-03T17:27:46.478630] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BAH took 35.0s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:27:46.680042] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:46.737785] [DEBUG] [LOCAL ] BAM: Loaded 52385 existing records from primary storage. [2025-10-03T17:27:46.738230] [INFO ] [MAIN ] BAM: Loaded 52385 existing records. [2025-10-03T17:27:46.943328] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:46.943807] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-03T17:27:46.943929] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-03T17:27:46.944225] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-03T17:27:46.944290] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-03T17:27:47.071110] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-03T17:27:47.096048] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-03T17:27:47.140722] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-03T17:27:47.180688] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T17:27:47.297695] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-03T17:27:47.567927] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:47.862603] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-03T17:27:47.862725] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-03T17:27:47.863550] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-03T17:27:47.863598] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-03T17:27:47.865300] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-10-03T17:27:47.985271] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:27:47.990607] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-03T17:27:48.231459] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-03T17:27:48.231613] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-03T17:27:48.231729] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BAC took 46.5s. Estimated remaining: 4h 46m 42s. Rate: 7.5 symbols/min [2025-10-03T17:27:48.423574] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:48.461627] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:27:48.480329] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:27:48.525031] [DEBUG] [LOCAL ] BANC: Loaded 51623 existing records from primary storage. [2025-10-03T17:27:48.525423] [INFO ] [MAIN ] BANC: Loaded 51623 existing records. [2025-10-03T17:27:48.719950] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:48.720215] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-03T17:27:48.720306] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-03T17:27:48.720540] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-03T17:27:48.720600] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-03T17:27:48.795797] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-03T17:27:49.108717] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:49.441778] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:27:49.590632] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-03T17:27:50.390704] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-03T17:27:51.190706] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-03T17:27:51.304867] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:27:51.990717] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-03T17:27:52.429917] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T17:27:52.790698] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-03T17:27:52.894319] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T17:27:53.438235] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:27:53.590695] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-03T17:27:54.390735] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-03T17:27:54.464126] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:27:55.190708] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-03T17:27:55.418860] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:27:55.990686] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-03T17:27:56.055910] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:27:56.500369] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T17:27:56.790722] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-03T17:27:57.542902] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:27:57.590727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-03T17:27:58.390698] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-03T17:27:58.514552] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:27:59.190632] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-03T17:27:59.463296] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:27:59.736027] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:27:59.990700] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-03T17:28:00.139805] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:28:00.790757] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-03T17:28:01.590676] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-03T17:28:01.684530] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:28:02.390633] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-03T17:28:02.894953] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T17:28:03.185512] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:28:03.190600] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-03T17:28:03.396895] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:28:03.990708] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-03T17:28:04.047320] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:28:04.790700] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-03T17:28:05.325319] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T17:28:05.590740] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-03T17:28:05.663344] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:28:06.390694] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-03T17:28:07.190692] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-03T17:28:07.427900] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:28:07.934795] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:28:07.990665] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-03T17:28:08.790683] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-03T17:28:08.988336] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:28:09.519017] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:28:09.560154] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:28:09.590637] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-03T17:28:10.390685] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-03T17:28:11.190694] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-03T17:28:11.384539] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:28:11.976300] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:28:11.977482] [INFO ] [REMOTE ] BALY: Full fetch complete (16836 records). [2025-10-03T17:28:11.977562] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-03T17:28:11.995745] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-03T17:28:12.160546] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T17:28:12.236243] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T17:28:12.236606] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:28:12.236701] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:28:12.236776] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-03T17:28:12.236846] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-03T17:28:12.236885] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-03T17:28:12.236958] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-03T17:28:12.237049] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BALY took 33.5s. Estimated remaining: 4h 49m 19s. Rate: 7.5 symbols/min [2025-10-03T17:28:12.421527] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:12.462945] [DEBUG] [LOCAL ] BAP: Loaded 26325 existing records from primary storage. [2025-10-03T17:28:12.463237] [INFO ] [MAIN ] BAP: Loaded 26325 existing records. [2025-10-03T17:28:12.653888] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:12.654122] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-03T17:28:12.654173] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-03T17:28:12.654417] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-03T17:28:12.654475] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-03T17:28:12.798866] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-03T17:28:13.032441] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:13.590668] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-03T17:28:13.746046] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T17:28:13.748955] [INFO ] [REMOTE ] BAM: Full fetch complete (74396 records). [2025-10-03T17:28:13.749094] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-03T17:28:14.235243] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-03T17:28:14.235356] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-03T17:28:14.236205] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-03T17:28:14.236272] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-03T17:28:14.237821] [DEBUG] [LOCAL ] BAM: Trimmed 74396 records to 52767 (keeping 200 days of data) [2025-10-03T17:28:14.423617] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-03T17:28:14.489036] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:28:14.493519] [INFO ] [REMOTE ] BALL: Full fetch complete (75365 records). [2025-10-03T17:28:14.494145] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-03T17:28:15.057708] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-03T17:28:15.058476] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-03T17:28:15.060116] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-03T17:28:15.060530] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-03T17:28:15.067554] [DEBUG] [LOCAL ] BALL: Trimmed 75365 records to 52561 (keeping 200 days of data) [2025-10-03T17:28:15.182261] [DEBUG] [LOCAL ] BAM: Primary data saved (52767 records). [2025-10-03T17:28:15.212444] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-03T17:28:15.216758] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T17:28:15.215009] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BAM took 28.7s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-03T17:28:15.231259] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-03T17:28:15.547604] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:15.664256] [DEBUG] [LOCAL ] BARK: Loaded 38304 existing records from primary storage. [2025-10-03T17:28:15.667843] [INFO ] [MAIN ] BARK: Loaded 38304 existing records. [2025-10-03T17:28:15.802426] [DEBUG] [LOCAL ] BALL: Primary data saved (52561 records). [2025-10-03T17:28:15.818580] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-03T17:28:15.822442] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BALL took 41.1s. Estimated remaining: 4h 46m 56s. Rate: 7.5 symbols/min [2025-10-03T17:28:16.018838] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:16.033664] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-03T17:28:16.038976] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-03T17:28:16.044355] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-03T17:28:16.049572] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-03T17:28:16.163695] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:16.224672] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-10-03T17:28:16.256696] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-10-03T17:28:16.313823] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-03T17:28:16.325391] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-03T17:28:16.402722] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-03T17:28:16.426791] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-03T17:28:16.549433] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:28:16.667063] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-03T17:28:16.729527] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:16.742063] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:28:16.797469] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-03T17:28:17.018776] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:17.590621] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-03T17:28:17.988631] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:28:18.390942] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-03T17:28:18.390867] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:28:19.190722] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-03T17:28:19.369173] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:28:19.604457] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:28:19.990700] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-03T17:28:20.448661] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T17:28:20.790735] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-03T17:28:21.464736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:28:21.590720] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-03T17:28:22.390639] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-03T17:28:22.546865] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:28:22.587333] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T17:28:23.190721] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-03T17:28:23.990711] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-03T17:28:24.061802] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:28:24.683375] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T17:28:24.790697] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-03T17:28:25.590668] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-03T17:28:25.834758] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:28:26.159208] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:28:26.390718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-03T17:28:26.679714] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:28:27.190689] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-03T17:28:27.990717] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-03T17:28:28.201904] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:28:28.531536] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:28:28.790722] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-03T17:28:29.590719] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-03T17:28:29.619247] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:28:29.621978] [INFO ] [REMOTE ] BANC: Full fetch complete (74291 records). [2025-10-03T17:28:29.622088] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-03T17:28:30.062798] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-03T17:28:30.062975] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-03T17:28:30.078934] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-03T17:28:30.079674] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-03T17:28:30.080517] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:28:30.088453] [DEBUG] [LOCAL ] BANC: Trimmed 74291 records to 52011 (keeping 200 days of data) [2025-10-03T17:28:30.397160] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-03T17:28:30.422214] [DEBUG] [LOCAL ] BANC: Primary data saved (52011 records). [2025-10-03T17:28:30.422353] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-03T17:28:30.422439] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BANC took 42.2s. Estimated remaining: 4h 47m 55s. Rate: 7.5 symbols/min [2025-10-03T17:28:30.607457] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:30.659681] [DEBUG] [LOCAL ] BB: Loaded 53320 existing records from primary storage. [2025-10-03T17:28:30.660035] [INFO ] [MAIN ] BB: Loaded 53320 existing records. [2025-10-03T17:28:30.857815] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:30.858463] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-03T17:28:30.858579] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-03T17:28:30.858965] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-03T17:28:30.859035] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-03T17:28:31.161914] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:28:31.197159] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-03T17:28:31.293184] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:31.596350] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:28:31.990691] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-03T17:28:32.790682] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-03T17:28:33.048973] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:28:33.191162] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:28:33.590747] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-03T17:28:34.390755] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-03T17:28:34.456142] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:28:34.712385] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T17:28:35.190734] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-03T17:28:35.990718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-03T17:28:36.552837] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:28:36.713789] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:28:36.790724] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-03T17:28:37.005961] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T17:28:37.007810] [INFO ] [REMOTE ] BAP: Full fetch complete (37690 records). [2025-10-03T17:28:37.007957] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-03T17:28:37.610751] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-03T17:28:37.614257] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-03T17:28:37.615634] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-03T17:28:37.616689] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-03T17:28:37.616853] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-03T17:28:37.618727] [DEBUG] [LOCAL ] BAP: Trimmed 37690 records to 26537 (keeping 200 days of data) [2025-10-03T17:28:37.866639] [DEBUG] [LOCAL ] BAP: Primary data saved (26537 records). [2025-10-03T17:28:37.866867] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-03T17:28:37.866988] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 25.6s. Estimated remaining: 4h 47m 41s. Rate: 7.5 symbols/min [2025-10-03T17:28:38.145259] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:38.224581] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-03T17:28:38.225412] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-03T17:28:38.392300] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-03T17:28:38.487831] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:38.488347] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-03T17:28:38.488443] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-03T17:28:38.488898] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-03T17:28:38.488964] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-03T17:28:38.659416] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:28:38.946679] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:39.190687] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-03T17:28:39.409966] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:28:39.607202] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:28:39.990703] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-03T17:28:40.790760] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-03T17:28:41.590718] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-03T17:28:41.838519] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-03T17:28:41.892617] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T17:28:42.032697] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:28:42.390722] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-03T17:28:42.970110] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:28:43.190734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-03T17:28:43.990635] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-03T17:28:44.328172] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:28:44.790713] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-03T17:28:45.186177] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T17:28:45.590734] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-03T17:28:45.994868] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:28:46.390631] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-03T17:28:46.717782] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T17:28:46.742190] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T17:28:46.744336] [INFO ] [REMOTE ] BARK: Full fetch complete (56252 records). [2025-10-03T17:28:46.744455] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-03T17:28:47.151669] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-03T17:28:47.151785] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-03T17:28:47.152384] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-03T17:28:47.152428] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-03T17:28:47.153759] [DEBUG] [LOCAL ] BARK: Trimmed 56252 records to 38579 (keeping 200 days of data) [2025-10-03T17:28:47.201541] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-03T17:28:47.383882] [DEBUG] [LOCAL ] BARK: Primary data saved (38579 records). [2025-10-03T17:28:47.384035] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-03T17:28:47.384887] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BARK took 32.2s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-03T17:28:47.565790] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:47.616296] [DEBUG] [LOCAL ] BBAR: Loaded 41882 existing records from primary storage. [2025-10-03T17:28:47.616711] [INFO ] [MAIN ] BBAR: Loaded 41882 existing records. [2025-10-03T17:28:47.811718] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:47.812007] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-03T17:28:47.812064] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-03T17:28:47.812364] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-03T17:28:47.812425] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-03T17:28:48.008865] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-03T17:28:48.200517] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:48.344434] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T17:28:48.540098] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T17:28:48.790726] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-03T17:28:49.590734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-03T17:28:50.392530] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T17:28:50.390669] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-03T17:28:50.501543] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:28:51.190695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-03T17:28:51.285335] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:28:51.917332] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:28:51.923588] [INFO ] [REMOTE ] BAX: Full fetch complete (77442 records). [2025-10-03T17:28:51.923800] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-03T17:28:51.995812] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-03T17:28:52.355441] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-03T17:28:52.355535] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-03T17:28:52.356487] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-03T17:28:52.356560] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-03T17:28:52.358270] [DEBUG] [LOCAL ] BAX: Trimmed 77442 records to 54272 (keeping 200 days of data) [2025-10-03T17:28:52.707164] [DEBUG] [LOCAL ] BAX: Primary data saved (54272 records). [2025-10-03T17:28:52.707329] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-03T17:28:52.707442] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BAX took 36.9s. Estimated remaining: 4h 47m 14s. Rate: 7.5 symbols/min [2025-10-03T17:28:52.806028] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-03T17:28:52.896807] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:52.947956] [DEBUG] [LOCAL ] BBD: Loaded 53587 existing records from primary storage. [2025-10-03T17:28:52.948328] [INFO ] [MAIN ] BBD: Loaded 53587 existing records. [2025-10-03T17:28:53.133165] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:53.133441] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-03T17:28:53.133489] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-03T17:28:53.135285] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-03T17:28:53.135347] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-03T17:28:53.517201] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:53.590629] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-03T17:28:53.776939] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-03T17:28:54.042228] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T17:28:54.390700] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-03T17:28:54.533779] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:28:55.190687] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-03T17:28:55.586269] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:28:55.990690] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-03T17:28:56.223380] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:28:56.583586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:28:56.790704] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-03T17:28:57.590698] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-03T17:28:58.390705] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-03T17:28:58.539090] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-03T17:28:58.623622] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:28:58.983008] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:28:59.190739] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-03T17:28:59.662499] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T17:28:59.990698] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-03T17:29:00.790706] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-03T17:29:01.096738] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:29:01.590636] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-03T17:29:01.910598] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:29:02.390679] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-03T17:29:02.429233] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:29:03.190731] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-03T17:29:03.650697] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-03T17:29:03.653635] [INFO ] [REMOTE ] BB: Full fetch complete (76998 records). [2025-10-03T17:29:03.653820] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-03T17:29:03.998682] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-03T17:29:04.140225] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-03T17:29:04.140417] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-03T17:29:04.141355] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-03T17:29:04.141482] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-03T17:29:04.143851] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:29:04.155558] [DEBUG] [LOCAL ] BB: Trimmed 76998 records to 53710 (keeping 200 days of data) [2025-10-03T17:29:04.485089] [DEBUG] [LOCAL ] BB: Primary data saved (53710 records). [2025-10-03T17:29:04.485260] [INFO ] [MAIN ] BB: Full history saved. [2025-10-03T17:29:04.485385] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BB took 34.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-03T17:29:04.673004] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:04.673172] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-10-03T17:29:04.673210] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-10-03T17:29:04.673333] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-03T17:29:04.673377] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-03T17:29:04.673420] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-03T17:29:04.673454] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-03T17:29:04.795780] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-03T17:29:05.074256] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:05.590726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-03T17:29:05.932303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:29:06.391725] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-03T17:29:06.410033] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-10-03T17:29:06.448441] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:29:07.131301] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:29:07.190688] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-03T17:29:07.990633] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-03T17:29:08.107349] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:29:08.729943] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:29:08.790684] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-03T17:29:09.029015] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:29:09.590683] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-03T17:29:10.344857] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:29:10.390638] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-03T17:29:10.485967] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:29:11.190686] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-03T17:29:11.990730] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-03T17:29:12.614229] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T17:29:12.723970] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-03T17:29:12.790705] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-03T17:29:13.375562] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:29:13.590722] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-03T17:29:14.285167] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T17:29:14.390709] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-03T17:29:15.190776] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-03T17:29:15.990667] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-03T17:29:16.095968] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:29:16.514876] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-03T17:29:16.719577] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:29:16.790726] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-03T17:29:17.049879] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T17:29:17.590729] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-03T17:29:18.390681] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-03T17:29:18.701847] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T17:29:18.770234] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T17:29:18.772860] [INFO ] [REMOTE ] BBAR: Full fetch complete (61020 records). [2025-10-03T17:29:18.773011] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-03T17:29:19.194872] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-03T17:29:19.195738] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-03T17:29:19.196774] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-03T17:29:19.197711] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-03T17:29:19.197958] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-03T17:29:19.200182] [DEBUG] [LOCAL ] BBAR: Trimmed 61020 records to 42223 (keeping 200 days of data) [2025-10-03T17:29:19.481815] [DEBUG] [LOCAL ] BBAR: Primary data saved (42223 records). [2025-10-03T17:29:19.481963] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-03T17:29:19.482068] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BBAR took 32.1s. Estimated remaining: 4h 48m 44s. Rate: 7.5 symbols/min [2025-10-03T17:29:19.712253] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:19.712513] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-03T17:29:19.712722] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-03T17:29:19.712966] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-03T17:29:19.713170] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-03T17:29:19.713352] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-03T17:29:19.713410] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-03T17:29:19.869095] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:29:19.996440] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-03T17:29:20.172139] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:20.790709] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-03T17:29:20.998236] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T17:29:21.264613] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:29:21.590629] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-03T17:29:21.669957] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T17:29:22.390708] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-03T17:29:23.190722] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-03T17:29:23.683820] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T17:29:23.889446] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T17:29:23.990722] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-03T17:29:24.702848] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T17:29:24.704846] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:29:24.790726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-03T17:29:25.590700] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-03T17:29:26.121034] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:29:26.390728] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-03T17:29:27.190741] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-03T17:29:27.675852] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:29:27.678348] [INFO ] [REMOTE ] BBDC: Full fetch complete (48637 records). [2025-10-03T17:29:27.678506] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-03T17:29:27.817799] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T17:29:27.995837] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-03T17:29:28.189845] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-03T17:29:28.189957] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-03T17:29:28.190815] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-03T17:29:28.190940] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-03T17:29:28.192560] [DEBUG] [LOCAL ] BBDC: Trimmed 48637 records to 33442 (keeping 200 days of data) [2025-10-03T17:29:28.317238] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-03T17:29:28.447505] [DEBUG] [LOCAL ] BBDC: Primary data saved (33442 records). [2025-10-03T17:29:28.447754] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-03T17:29:28.447850] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBDC took 24.0s. Estimated remaining: 4h 48m 45s. Rate: 7.4 symbols/min [2025-10-03T17:29:28.633403] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:28.654407] [DEBUG] [LOCAL ] BBN: Loaded 18177 existing records from primary storage. [2025-10-03T17:29:28.654740] [INFO ] [MAIN ] BBN: Loaded 18177 existing records. [2025-10-03T17:29:28.804299] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-03T17:29:28.852355] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:28.852612] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-03T17:29:28.852698] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-03T17:29:28.853623] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-03T17:29:28.853712] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-03T17:29:29.243825] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:29.377473] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:29:29.590682] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-03T17:29:29.660052] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T17:29:29.663852] [INFO ] [REMOTE ] BBD: Full fetch complete (77113 records). [2025-10-03T17:29:29.664045] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-03T17:29:30.176702] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-03T17:29:30.176842] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-03T17:29:30.178387] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-03T17:29:30.178485] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-03T17:29:30.180738] [DEBUG] [LOCAL ] BBD: Trimmed 77113 records to 53976 (keeping 200 days of data) [2025-10-03T17:29:30.323937] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T17:29:30.445383] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-03T17:29:30.665632] [DEBUG] [LOCAL ] BBD: Primary data saved (53976 records). [2025-10-03T17:29:30.665852] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-03T17:29:30.665959] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBD took 38.0s. Estimated remaining: 4h 47m 40s. Rate: 7.5 symbols/min [2025-10-03T17:29:30.904370] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:30.904556] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-03T17:29:30.904599] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-03T17:29:30.904750] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-03T17:29:30.904798] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-03T17:29:30.904871] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-03T17:29:30.904920] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-03T17:29:31.200340] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-03T17:29:31.333571] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:31.854716] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T17:29:31.980504] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:29:31.990618] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-03T17:29:32.614117] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:29:32.790726] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-03T17:29:33.590727] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-03T17:29:34.390753] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-03T17:29:34.937613] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T17:29:35.042862] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T17:29:35.190729] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-03T17:29:35.303394] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-03T17:29:35.306418] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-03T17:29:35.306535] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-03T17:29:35.501513] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:29:35.559631] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-03T17:29:35.596337] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:29:35.609402] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-03T17:29:35.638918] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:29:35.639104] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-03T17:29:35.639566] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-03T17:29:35.650291] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-03T17:29:35.671203] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-03T17:29:35.693998] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBT took 5.0s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-03T17:29:35.782492] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-03T17:29:35.829053] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-03T17:29:35.842418] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-03T17:29:35.849405] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-03T17:29:35.944909] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-03T17:29:35.948603] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:35.949318] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-03T17:29:35.949414] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-03T17:29:35.949605] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-03T17:29:35.949993] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-03T17:29:35.950147] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-03T17:29:35.950214] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-03T17:29:36.031399] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-03T17:29:36.475587] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:36.699185] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-03T17:29:36.699345] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-03T17:29:36.699916] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBAI took 58.8s. Estimated remaining: 4h 45m 47s. Rate: 7.5 symbols/min [2025-10-03T17:29:36.795829] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-03T17:29:36.895031] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:36.895310] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-03T17:29:36.895366] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-03T17:29:36.895480] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-03T17:29:36.895524] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-03T17:29:36.895567] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-03T17:29:36.895601] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-03T17:29:37.231210] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T17:29:37.330869] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:37.546679] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:29:37.590710] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-03T17:29:38.147227] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T17:29:38.390747] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-03T17:29:39.190683] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-03T17:29:39.449878] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:29:39.990680] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-03T17:29:40.057265] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:29:40.790745] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-03T17:29:41.041742] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:29:41.397900] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:29:41.590730] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-03T17:29:42.214822] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:29:42.390721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-03T17:29:42.938187] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T17:29:43.190741] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-03T17:29:43.990702] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-03T17:29:44.173469] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T17:29:44.519884] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:29:44.790730] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-03T17:29:45.590636] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-03T17:29:45.972594] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:29:46.146422] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:29:46.390720] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-03T17:29:47.192235] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-03T17:29:47.194051] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:29:47.990675] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-03T17:29:48.131272] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:29:48.515561] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T17:29:48.516499] [INFO ] [REMOTE ] BBDO: Full fetch complete (7653 records). [2025-10-03T17:29:48.516603] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-03T17:29:48.795758] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-03T17:29:48.918436] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-03T17:29:48.918525] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-03T17:29:48.918760] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-03T17:29:48.918825] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-03T17:29:48.919327] [DEBUG] [LOCAL ] BBDO: Trimmed 7653 records to 5032 (keeping 200 days of data) [2025-10-03T17:29:48.953808] [DEBUG] [LOCAL ] BBDO: Primary data saved (5032 records). [2025-10-03T17:29:48.953973] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-03T17:29:48.954062] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBDO took 29.5s. Estimated remaining: 4h 46m 20s. Rate: 7.5 symbols/min [2025-10-03T17:29:49.162303] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:49.221376] [DEBUG] [LOCAL ] BBVA: Loaded 49642 existing records from primary storage. [2025-10-03T17:29:49.221780] [INFO ] [MAIN ] BBVA: Loaded 49642 existing records. [2025-10-03T17:29:49.416940] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:49.417166] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-03T17:29:49.417216] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-03T17:29:49.417897] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-03T17:29:49.417963] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-03T17:29:49.601385] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-03T17:29:49.814760] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:49.842512] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:29:50.390679] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-03T17:29:50.755120] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T17:29:50.880094] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:29:51.190683] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-03T17:29:51.623477] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T17:29:51.990697] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-03T17:29:52.790673] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-03T17:29:53.101237] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:29:53.494915] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T17:29:53.590703] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-03T17:29:54.390721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-03T17:29:55.012558] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T17:29:55.190674] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-03T17:29:55.364616] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:29:55.990697] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-03T17:29:56.005792] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T17:29:56.720491] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:29:56.790725] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-03T17:29:57.590723] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-03T17:29:57.901301] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T17:29:58.259766] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T17:29:58.260902] [INFO ] [REMOTE ] BBU: Full fetch complete (6767 records). [2025-10-03T17:29:58.260975] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-03T17:29:58.395866] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-03T17:29:58.695508] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-03T17:29:58.695589] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-03T17:29:58.695838] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-03T17:29:58.695916] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-03T17:29:58.696508] [DEBUG] [LOCAL ] BBU: Trimmed 6767 records to 4913 (keeping 200 days of data) [2025-10-03T17:29:58.729211] [DEBUG] [LOCAL ] BBU: Primary data saved (4913 records). [2025-10-03T17:29:58.729345] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-03T17:29:58.729426] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBU took 23.0s. Estimated remaining: 4h 46m 29s. Rate: 7.5 symbols/min [2025-10-03T17:29:58.928167] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:58.956199] [DEBUG] [LOCAL ] BBW: Loaded 26905 existing records from primary storage. [2025-10-03T17:29:58.956472] [INFO ] [MAIN ] BBW: Loaded 26905 existing records. [2025-10-03T17:29:59.158103] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:59.158323] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-03T17:29:59.158373] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-03T17:29:59.158620] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-03T17:29:59.158703] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-03T17:29:59.195751] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-03T17:29:59.550395] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:29:59.588685] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:59.990680] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-03T17:30:00.790688] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-03T17:30:00.964983] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:30:01.293424] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:30:01.590731] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-03T17:30:02.390705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-03T17:30:02.964333] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-03T17:30:02.965900] [INFO ] [REMOTE ] BBN: Full fetch complete (26356 records). [2025-10-03T17:30:02.965980] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-03T17:30:02.966468] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:02.966560] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:02.966628] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:02.966721] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-03T17:30:02.966804] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-03T17:30:02.966876] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-03T17:30:02.967301] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-03T17:30:02.967441] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBN took 34.5s. Estimated remaining: 4h 45m 45s. Rate: 7.5 symbols/min [2025-10-03T17:30:03.164837] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:03.199225] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-03T17:30:03.225861] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-10-03T17:30:03.226234] [INFO ] [MAIN ] BBWI: Loaded 53970 existing records. [2025-10-03T17:30:03.426224] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:03.426547] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-03T17:30:03.426749] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-03T17:30:03.436854] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-03T17:30:03.454180] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-03T17:30:03.461619] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:30:03.884230] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:03.900628] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:30:03.990605] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-03T17:30:04.074118] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:30:04.790692] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-03T17:30:05.200321] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:30:05.590697] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-03T17:30:05.648485] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:30:06.390731] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-03T17:30:06.654191] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:30:07.190708] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-03T17:30:07.990618] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-03T17:30:08.197158] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:30:08.571528] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T17:30:08.790718] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-03T17:30:09.590692] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-03T17:30:10.011025] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:30:10.343372] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:30:10.390695] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-03T17:30:10.494497] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T17:30:11.190709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-03T17:30:11.830290] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T17:30:11.990751] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-03T17:30:12.790636] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-03T17:30:13.112081] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:30:13.236889] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T17:30:13.362099] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T17:30:13.590688] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-03T17:30:14.390730] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-03T17:30:14.595897] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:30:14.597294] [INFO ] [REMOTE ] BBUC: Full fetch complete (18245 records). [2025-10-03T17:30:14.597370] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-03T17:30:15.000134] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-03T17:30:15.000229] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-03T17:30:15.000563] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-03T17:30:15.000610] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-03T17:30:15.001322] [DEBUG] [LOCAL ] BBUC: Trimmed 18245 records to 13645 (keeping 200 days of data) [2025-10-03T17:30:15.106492] [DEBUG] [LOCAL ] BBUC: Primary data saved (13645 records). [2025-10-03T17:30:15.106676] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-03T17:30:15.106848] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBUC took 38.4s. Estimated remaining: 4h 46m 16s. Rate: 7.5 symbols/min [2025-10-03T17:30:15.195818] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-03T17:30:15.298164] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:15.366258] [DEBUG] [LOCAL ] BBY: Loaded 53854 existing records from primary storage. [2025-10-03T17:30:15.366601] [INFO ] [MAIN ] BBY: Loaded 53854 existing records. [2025-10-03T17:30:15.561450] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:15.561743] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-03T17:30:15.561823] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-03T17:30:15.562173] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-03T17:30:15.562234] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-03T17:30:15.953413] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:15.990676] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-03T17:30:16.118834] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:30:16.790729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-03T17:30:17.314250] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:30:17.590677] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-03T17:30:17.689613] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:30:18.390718] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-03T17:30:18.477740] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T17:30:19.001707] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:30:19.190735] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-03T17:30:19.990715] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-03T17:30:20.413690] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:30:20.790721] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-03T17:30:20.941503] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T17:30:21.438532] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:30:21.590739] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-03T17:30:22.281471] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T17:30:22.390729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-03T17:30:22.821187] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:30:22.823322] [INFO ] [REMOTE ] BBW: Full fetch complete (39012 records). [2025-10-03T17:30:22.823467] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-03T17:30:22.824115] [FATAL] [VALIDATOR ] BBW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:22.824206] [FATAL] [MAIN ] BBW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:22.824253] [WARN ] [MAIN ] BBW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:22.824302] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-03T17:30:22.824363] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-03T17:30:22.824403] [INFO ] [LOCAL ] BBW: Starting deletion of derivative data. [2025-10-03T17:30:22.824773] [DEBUG] [LOCAL ] BBW: Deleted derivative data file. [2025-10-03T17:30:22.824886] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBW took 24.1s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-03T17:30:23.022858] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:23.076408] [DEBUG] [LOCAL ] BC: Loaded 44455 existing records from primary storage. [2025-10-03T17:30:23.076800] [INFO ] [MAIN ] BC: Loaded 44455 existing records. [2025-10-03T17:30:23.195747] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-03T17:30:23.281069] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:23.281374] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-03T17:30:23.281463] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-03T17:30:23.281962] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-03T17:30:23.282023] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-03T17:30:23.712323] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:23.990673] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-03T17:30:24.252825] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T17:30:24.790718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-03T17:30:24.871362] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:30:25.590748] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-03T17:30:25.723153] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:30:26.381323] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:30:26.393123] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-03T17:30:26.920309] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:30:27.190726] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-03T17:30:27.990683] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-03T17:30:28.028678] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T17:30:28.790771] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-03T17:30:29.179198] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:30:29.295973] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T17:30:29.590746] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-03T17:30:30.390759] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-03T17:30:30.734310] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:30:31.195869] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-03T17:30:31.216439] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:30:31.678795] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:30:31.680797] [INFO ] [REMOTE ] BBVA: Full fetch complete (71253 records). [2025-10-03T17:30:31.680919] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-03T17:30:31.681932] [FATAL] [VALIDATOR ] BBVA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:31.682032] [FATAL] [MAIN ] BBVA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:31.682080] [WARN ] [MAIN ] BBVA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:31.682153] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-03T17:30:31.682247] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-03T17:30:31.682305] [INFO ] [LOCAL ] BBVA: Starting deletion of derivative data. [2025-10-03T17:30:31.682594] [DEBUG] [LOCAL ] BBVA: Deleted derivative data file. [2025-10-03T17:30:31.683811] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBVA took 42.7s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-03T17:30:31.869151] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:31.869384] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-10-03T17:30:31.869442] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-10-03T17:30:31.869561] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-03T17:30:31.869696] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-03T17:30:31.869769] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-03T17:30:31.869807] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-03T17:30:31.996806] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-03T17:30:32.326585] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:32.790755] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-03T17:30:32.793279] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:30:33.590632] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-03T17:30:34.025980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T17:30:34.390719] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-03T17:30:34.505206] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:30:35.190727] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-03T17:30:35.270840] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:30:35.910846] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:30:35.990696] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-03T17:30:36.790671] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-03T17:30:37.125099] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T17:30:37.595956] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-03T17:30:37.611516] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:30:37.907169] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:30:38.390732] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-03T17:30:39.012024] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:30:39.190737] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-03T17:30:39.890420] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:30:39.990761] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-03T17:30:40.627772] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T17:30:40.790727] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-03T17:30:41.590771] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-03T17:30:41.819578] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T17:30:42.113535] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:30:42.390699] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-03T17:30:43.190636] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-03T17:30:43.497940] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:30:43.802351] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:30:43.990695] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-03T17:30:44.584037] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:30:44.588172] [INFO ] [REMOTE ] BBY: Full fetch complete (77237 records). [2025-10-03T17:30:44.588410] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-03T17:30:44.794157] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-03T17:30:45.034814] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-03T17:30:45.034910] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-03T17:30:45.035851] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-03T17:30:45.035934] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-03T17:30:45.037856] [DEBUG] [LOCAL ] BBY: Trimmed 77237 records to 54237 (keeping 200 days of data) [2025-10-03T17:30:45.394024] [DEBUG] [LOCAL ] BBY: Primary data saved (54237 records). [2025-10-03T17:30:45.394309] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-03T17:30:45.395856] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBY took 30.3s. Estimated remaining: 4h 46m 51s. Rate: 7.5 symbols/min [2025-10-03T17:30:45.580549] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:45.590695] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-03T17:30:45.618077] [DEBUG] [LOCAL ] BCC: Loaded 28408 existing records from primary storage. [2025-10-03T17:30:45.618440] [INFO ] [MAIN ] BCC: Loaded 28408 existing records. [2025-10-03T17:30:45.836416] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:45.836937] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-03T17:30:45.837108] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-03T17:30:45.837494] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-03T17:30:45.837562] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-03T17:30:46.199827] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-03T17:30:46.312537] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:46.390715] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-03T17:30:46.440056] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:30:47.190706] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-03T17:30:47.262054] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:30:47.990770] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-03T17:30:47.991157] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:30:47.995062] [INFO ] [REMOTE ] BBWI: Full fetch complete (77433 records). [2025-10-03T17:30:47.995219] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-03T17:30:48.446345] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-03T17:30:48.446439] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-03T17:30:48.447420] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-03T17:30:48.465469] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-03T17:30:48.470105] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:30:48.479301] [DEBUG] [LOCAL ] BBWI: Trimmed 77433 records to 54360 (keeping 200 days of data) [2025-10-03T17:30:48.807813] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-03T17:30:48.836028] [DEBUG] [LOCAL ] BBWI: Primary data saved (54360 records). [2025-10-03T17:30:48.836195] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-03T17:30:48.836316] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BBWI took 45.9s. Estimated remaining: 4h 45m 60s. Rate: 7.5 symbols/min [2025-10-03T17:30:49.021549] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:49.076823] [DEBUG] [LOCAL ] BCE: Loaded 52641 existing records from primary storage. [2025-10-03T17:30:49.077240] [INFO ] [MAIN ] BCE: Loaded 52641 existing records. [2025-10-03T17:30:49.280205] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:49.280567] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-03T17:30:49.280633] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-03T17:30:49.280939] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-03T17:30:49.280998] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-03T17:30:49.592915] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-03T17:30:49.695398] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:49.728418] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:30:50.329033] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:30:50.390705] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-03T17:30:50.913423] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:30:51.190714] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-03T17:30:51.990735] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-03T17:30:52.210812] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:30:52.790709] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-03T17:30:52.820262] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:30:52.856078] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:30:53.590684] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-03T17:30:54.390724] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-03T17:30:54.775560] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:30:55.092801] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T17:30:55.190698] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-03T17:30:55.839300] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:30:55.990702] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-03T17:30:56.529713] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T17:30:56.790695] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-03T17:30:57.190732] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T17:30:57.590698] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-03T17:30:58.345188] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:30:58.390721] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-03T17:30:58.533478] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T17:30:59.190689] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-03T17:30:59.652019] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:30:59.990687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-03T17:31:00.395681] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:31:00.790696] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-03T17:31:01.590717] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-03T17:31:01.715781] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:31:02.390693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-03T17:31:02.493530] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:31:02.850229] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:31:03.190733] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-03T17:31:03.990731] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-03T17:31:04.521959] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:31:04.790686] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-03T17:31:04.844422] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-03T17:31:05.324493] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:31:05.326633] [INFO ] [REMOTE ] BCAT: Full fetch complete (50123 records). [2025-10-03T17:31:05.326770] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-03T17:31:05.599764] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-03T17:31:05.826114] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-03T17:31:05.826207] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-03T17:31:05.826913] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-03T17:31:05.826979] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-03T17:31:05.828180] [DEBUG] [LOCAL ] BCAT: Trimmed 50123 records to 34696 (keeping 200 days of data) [2025-10-03T17:31:06.056823] [DEBUG] [LOCAL ] BCAT: Primary data saved (34696 records). [2025-10-03T17:31:06.056973] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-03T17:31:06.057058] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BCAT took 34.4s. Estimated remaining: 4h 47m 17s. Rate: 7.4 symbols/min [2025-10-03T17:31:06.257823] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:06.279098] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T17:31:06.315005] [DEBUG] [LOCAL ] BCH: Loaded 29843 existing records from primary storage. [2025-10-03T17:31:06.315450] [INFO ] [MAIN ] BCH: Loaded 29843 existing records. [2025-10-03T17:31:06.401739] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-03T17:31:06.524053] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:06.524297] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-03T17:31:06.524349] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-03T17:31:06.524705] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-03T17:31:06.524784] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-03T17:31:06.930144] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:06.943534] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:31:06.945763] [INFO ] [REMOTE ] BC: Full fetch complete (63785 records). [2025-10-03T17:31:06.945894] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-03T17:31:07.198015] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-03T17:31:07.401829] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-03T17:31:07.401915] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-03T17:31:07.402624] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-03T17:31:07.402709] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-03T17:31:07.404216] [DEBUG] [LOCAL ] BC: Trimmed 63785 records to 44767 (keeping 200 days of data) [2025-10-03T17:31:07.703015] [DEBUG] [LOCAL ] BC: Primary data saved (44767 records). [2025-10-03T17:31:07.703153] [INFO ] [MAIN ] BC: Full history saved. [2025-10-03T17:31:07.703266] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BC took 44.9s. Estimated remaining: 4h 46m 10s. Rate: 7.5 symbols/min [2025-10-03T17:31:07.898951] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:07.931182] [DEBUG] [LOCAL ] BCO: Loaded 26183 existing records from primary storage. [2025-10-03T17:31:07.931462] [INFO ] [MAIN ] BCO: Loaded 26183 existing records. [2025-10-03T17:31:07.995803] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-03T17:31:08.145921] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:08.146402] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-03T17:31:08.146535] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-03T17:31:08.146997] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-03T17:31:08.147126] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-03T17:31:08.363247] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:31:08.645502] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:08.647544] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:31:08.790720] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-03T17:31:09.442071] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:31:09.590718] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-03T17:31:10.390707] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-03T17:31:10.535679] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:31:10.674512] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:31:11.190687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-03T17:31:11.483276] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:31:11.485285] [INFO ] [REMOTE ] BCC: Full fetch complete (40790 records). [2025-10-03T17:31:11.485391] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-03T17:31:11.915505] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-03T17:31:11.915600] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-03T17:31:11.916202] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-03T17:31:11.916291] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-03T17:31:11.917776] [DEBUG] [LOCAL ] BCC: Trimmed 40790 records to 28698 (keeping 200 days of data) [2025-10-03T17:31:11.996904] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-03T17:31:12.116693] [DEBUG] [LOCAL ] BCC: Primary data saved (28698 records). [2025-10-03T17:31:12.116838] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-03T17:31:12.116927] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BCC took 26.7s. Estimated remaining: 4h 45m 29s. Rate: 7.5 symbols/min [2025-10-03T17:31:12.306784] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:12.367522] [DEBUG] [LOCAL ] BCS: Loaded 53841 existing records from primary storage. [2025-10-03T17:31:12.367928] [INFO ] [MAIN ] BCS: Loaded 53841 existing records. [2025-10-03T17:31:12.555855] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:12.556070] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-03T17:31:12.556120] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-03T17:31:12.556570] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-03T17:31:12.556630] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-03T17:31:12.801022] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-03T17:31:12.975806] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:13.007980] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:31:13.208378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:31:13.590689] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-03T17:31:14.133072] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:31:14.390693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-03T17:31:15.190722] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-03T17:31:15.655237] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T17:31:15.713221] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T17:31:15.990916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-03T17:31:16.029986] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T17:31:16.790735] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-03T17:31:17.590673] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-03T17:31:17.825858] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:31:18.390736] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-03T17:31:18.613134] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:31:18.769858] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T17:31:19.190680] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-03T17:31:19.538135] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:31:19.990724] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-03T17:31:20.532785] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T17:31:20.790711] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-03T17:31:21.590719] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-03T17:31:21.729831] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:31:22.390726] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-03T17:31:22.829084] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:31:22.934531] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T17:31:23.190693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-03T17:31:23.615828] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:31:23.990686] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-03T17:31:24.790697] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-03T17:31:24.861090] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T17:31:24.863975] [INFO ] [REMOTE ] BCE: Full fetch complete (75992 records). [2025-10-03T17:31:24.864145] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-03T17:31:25.298832] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-03T17:31:25.298987] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-03T17:31:25.299890] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-03T17:31:25.299978] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-03T17:31:25.301781] [DEBUG] [LOCAL ] BCE: Trimmed 75992 records to 52991 (keeping 200 days of data) [2025-10-03T17:31:25.436182] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:31:25.617964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-03T17:31:25.666584] [DEBUG] [LOCAL ] BCE: Primary data saved (52991 records). [2025-10-03T17:31:25.666762] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-03T17:31:25.666857] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCE took 36.8s. Estimated remaining: 4h 46m 11s. Rate: 7.5 symbols/min [2025-10-03T17:31:25.880267] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:25.909721] [DEBUG] [LOCAL ] BCSF: Loaded 27982 existing records from primary storage. [2025-10-03T17:31:25.910000] [INFO ] [MAIN ] BCSF: Loaded 27982 existing records. [2025-10-03T17:31:26.106721] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:26.106979] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-03T17:31:26.107037] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-03T17:31:26.107515] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-03T17:31:26.107576] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-03T17:31:26.395862] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-03T17:31:26.490709] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:26.861603] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-03T17:31:27.013188] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:31:27.190727] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-03T17:31:27.990721] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-03T17:31:28.051202] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:31:28.374856] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T17:31:28.790717] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-03T17:31:29.395900] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T17:31:29.590719] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-03T17:31:30.390628] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-03T17:31:30.697231] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:31:30.957330] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T17:31:31.190721] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-03T17:31:31.703490] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:31:31.990745] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-03T17:31:32.171278] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:31:32.175625] [INFO ] [REMOTE ] BCH: Full fetch complete (40935 records). [2025-10-03T17:31:32.175848] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-03T17:31:32.705532] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-03T17:31:32.705712] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-03T17:31:32.706629] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-03T17:31:32.706749] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-03T17:31:32.708480] [DEBUG] [LOCAL ] BCH: Trimmed 40935 records to 30138 (keeping 200 days of data) [2025-10-03T17:31:32.814537] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-03T17:31:32.922830] [DEBUG] [LOCAL ] BCH: Primary data saved (30138 records). [2025-10-03T17:31:32.922995] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-03T17:31:32.923091] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCH took 26.9s. Estimated remaining: 4h 45m 56s. Rate: 7.5 symbols/min [2025-10-03T17:31:33.141437] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:31:33.146250] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:33.175471] [DEBUG] [LOCAL ] BCX: Loaded 21876 existing records from primary storage. [2025-10-03T17:31:33.175803] [INFO ] [MAIN ] BCX: Loaded 21876 existing records. [2025-10-03T17:31:33.381602] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:33.381902] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-03T17:31:33.381961] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-03T17:31:33.382228] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-03T17:31:33.382289] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-03T17:31:33.596292] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-03T17:31:33.809048] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:34.390706] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-03T17:31:34.733389] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:31:35.182882] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:31:35.190609] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-03T17:31:35.874210] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:31:35.990715] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-03T17:31:36.530751] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:31:36.790704] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-03T17:31:37.389267] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:31:37.590716] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-03T17:31:37.934818] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:31:38.390708] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-03T17:31:38.851585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T17:31:39.190755] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-03T17:31:39.588975] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:31:39.855603] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T17:31:39.991035] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-03T17:31:40.790744] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-03T17:31:41.205507] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T17:31:41.590711] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-03T17:31:41.863031] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:31:42.390731] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-03T17:31:43.190776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-03T17:31:43.561001] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T17:31:43.591904] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:31:43.990709] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-03T17:31:44.397349] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:31:44.790691] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-03T17:31:45.590725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-03T17:31:45.824062] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:31:46.195843] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:31:46.390734] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-03T17:31:46.882230] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T17:31:47.190670] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-03T17:31:47.531715] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:31:47.990694] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-03T17:31:48.790668] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-03T17:31:48.869126] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:31:48.871067] [INFO ] [REMOTE ] BCSF: Full fetch complete (38569 records). [2025-10-03T17:31:48.871158] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-03T17:31:49.304166] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-03T17:31:49.304308] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-03T17:31:49.305023] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-03T17:31:49.305262] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-03T17:31:49.338281] [DEBUG] [LOCAL ] BCSF: Trimmed 38569 records to 28192 (keeping 200 days of data) [2025-10-03T17:31:49.340717] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T17:31:49.536686] [DEBUG] [LOCAL ] BCSF: Primary data saved (28192 records). [2025-10-03T17:31:49.536832] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-03T17:31:49.536980] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCSF took 23.9s. Estimated remaining: 4h 47m 6s. Rate: 7.4 symbols/min [2025-10-03T17:31:49.596382] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-03T17:31:49.737576] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:49.737861] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-10-03T17:31:49.737921] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-10-03T17:31:49.738035] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-03T17:31:49.738115] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-03T17:31:49.738177] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-03T17:31:49.738226] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-03T17:31:50.089004] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T17:31:50.160480] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:50.390697] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-03T17:31:51.190693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-03T17:31:51.395927] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:31:51.560979] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T17:31:51.990620] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-03T17:31:52.159263] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:31:52.160875] [INFO ] [REMOTE ] BCO: Full fetch complete (36634 records). [2025-10-03T17:31:52.160978] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-03T17:31:52.596962] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-03T17:31:52.597071] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-03T17:31:52.597622] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-03T17:31:52.597713] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-03T17:31:52.598681] [DEBUG] [LOCAL ] BCO: Trimmed 36634 records to 26271 (keeping 200 days of data) [2025-10-03T17:31:52.760023] [DEBUG] [LOCAL ] BCO: Primary data saved (26271 records). [2025-10-03T17:31:52.760156] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-03T17:31:52.760246] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCO took 45.1s. Estimated remaining: 4h 46m 14s. Rate: 7.5 symbols/min [2025-10-03T17:31:52.790626] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-03T17:31:53.173335] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:31:53.590710] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-03T17:31:53.770685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T17:31:54.390717] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-03T17:31:54.686076] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:31:55.190700] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-03T17:31:55.990626] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-03T17:31:56.286398] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T17:31:56.330217] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:31:56.790696] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-03T17:31:57.161339] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:31:57.590683] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-03T17:31:58.390681] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-03T17:31:58.534604] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:31:58.537514] [INFO ] [REMOTE ] BCS: Full fetch complete (77328 records). [2025-10-03T17:31:58.537630] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-03T17:31:58.908543] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:31:59.016008] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-03T17:31:59.016104] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-03T17:31:59.017737] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-03T17:31:59.017816] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-03T17:31:59.019985] [DEBUG] [LOCAL ] BCS: Trimmed 77328 records to 54229 (keeping 200 days of data) [2025-10-03T17:31:59.223849] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-03T17:31:59.388430] [DEBUG] [LOCAL ] BCS: Primary data saved (54229 records). [2025-10-03T17:31:59.388592] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-03T17:31:59.389376] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCS took 47.3s. Estimated remaining: 4h 45m 53s. Rate: 7.5 symbols/min [2025-10-03T17:31:59.793433] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:31:59.990714] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-03T17:32:00.280517] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:32:00.790723] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-03T17:32:01.401766] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:32:01.474356] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T17:32:01.590745] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-03T17:32:02.390711] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-03T17:32:02.626447] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:32:02.628170] [INFO ] [REMOTE ] BCX: Full fetch complete (34089 records). [2025-10-03T17:32:02.628251] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-03T17:32:03.057754] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-03T17:32:03.057892] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-03T17:32:03.058514] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-03T17:32:03.058592] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-03T17:32:03.059890] [DEBUG] [LOCAL ] BCX: Trimmed 34089 records to 22000 (keeping 200 days of data) [2025-10-03T17:32:03.213349] [DEBUG] [LOCAL ] BCX: Primary data saved (22000 records). [2025-10-03T17:32:03.213505] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-03T17:32:03.213608] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BCX took 30.3s. Estimated remaining: 4h 45m 7s. Rate: 7.5 symbols/min [2025-10-03T17:32:03.565149] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:32:03.570768] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-03T17:32:04.693286] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:32:04.700022] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-03T17:32:05.962060] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:32:05.969128] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-03T17:32:07.055326] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:32:07.061973] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-03T17:32:08.054811] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:32:08.056512] [INFO ] [REMOTE ] BDC: Full fetch complete (35937 records). [2025-10-03T17:32:08.056597] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-03T17:32:08.479110] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-03T17:32:08.479201] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-03T17:32:08.479758] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-03T17:32:08.479848] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-03T17:32:08.480980] [DEBUG] [LOCAL ] BDC: Trimmed 35937 records to 24963 (keeping 200 days of data) [2025-10-03T17:32:08.650262] [DEBUG] [LOCAL ] BDC: Primary data saved (24963 records). [2025-10-03T17:32:08.650402] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-03T17:32:08.650479] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BDC took 19.1s. Estimated remaining: 4h 44m 36s. Rate: 7.5 symbols/min [2025-10-03T17:32:09.320620] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.309972] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.377384] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.451904] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.490979] [DEBUG] [LOCAL ] BDJ: Loaded 29159 existing records from primary storage. [2025-10-03T17:32:09.491472] [INFO ] [MAIN ] BDJ: Loaded 29159 existing records. [2025-10-03T17:32:09.611934] [DEBUG] [LOCAL ] BDN: Loaded 47839 existing records from primary storage. [2025-10-03T17:32:09.630156] [INFO ] [MAIN ] BDN: Loaded 47839 existing records. [2025-10-03T17:32:09.784140] [DEBUG] [LOCAL ] BDX: Loaded 52730 existing records from primary storage. [2025-10-03T17:32:09.904859] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:09.874634] [INFO ] [MAIN ] BDX: Loaded 52730 existing records. [2025-10-03T17:32:09.911691] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-03T17:32:09.917070] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-03T17:32:09.906046] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-10-03T17:32:09.968516] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-10-03T17:32:10.045905] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-03T17:32:10.082189] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.114660] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-03T17:32:10.180813] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.254603] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-03T17:32:10.304847] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-03T17:32:10.461901] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.483919] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-03T17:32:10.521872] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.525417] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.530728] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-03T17:32:10.551258] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.577542] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-03T17:32:10.604870] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-03T17:32:10.610075] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-03T17:32:10.616348] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-03T17:32:10.636397] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-03T17:32:11.537232] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:11.650730] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-03T17:32:11.823070] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:11.882634] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-03T17:32:12.009857] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:12.033295] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-03T17:32:12.032925] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:12.033562] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-03T17:32:12.840021] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T17:32:12.847087] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-03T17:32:13.928637] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T17:32:13.939919] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-03T17:32:14.028140] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T17:32:14.041286] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-03T17:32:14.102663] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T17:32:14.121547] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-03T17:32:14.149975] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T17:32:14.163857] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-03T17:32:15.359280] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T17:32:15.369907] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-03T17:32:15.428046] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:32:15.439278] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-03T17:32:15.634988] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T17:32:15.645911] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-03T17:32:16.279197] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T17:32:16.291137] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-03T17:32:16.701945] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T17:32:16.790695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-03T17:32:17.088577] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:32:17.126718] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T17:32:17.590729] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-03T17:32:17.893170] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:32:18.196026] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T17:32:18.390721] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-03T17:32:19.190622] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-03T17:32:19.233492] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:32:19.990737] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-03T17:32:20.036989] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:32:20.691742] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T17:32:20.790734] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-03T17:32:21.590672] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-03T17:32:21.878939] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:32:22.040421] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:32:22.390718] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-03T17:32:23.190726] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-03T17:32:23.551757] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:32:23.990740] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-03T17:32:24.303246] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T17:32:24.790726] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-03T17:32:25.283628] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T17:32:25.590725] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-03T17:32:25.812815] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:32:26.352215] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:32:26.390664] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-03T17:32:27.190691] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-03T17:32:27.551523] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:32:27.990700] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-03T17:32:28.060430] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:32:28.760844] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:32:28.790677] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-03T17:32:28.829616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T17:32:29.590746] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-03T17:32:30.390639] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-03T17:32:30.505579] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:32:31.190684] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-03T17:32:31.604411] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T17:32:31.990731] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-03T17:32:32.400778] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:32:32.790736] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-03T17:32:32.880533] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:32:33.590701] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-03T17:32:34.390739] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-03T17:32:34.471140] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-03T17:32:34.528057] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:32:35.190705] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-03T17:32:35.662108] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:32:35.713292] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-03T17:32:35.715935] [INFO ] [REMOTE ] BDN: Full fetch complete (69263 records). [2025-10-03T17:32:35.716078] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-03T17:32:35.995891] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-03T17:32:36.162465] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-03T17:32:36.162571] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-03T17:32:36.163364] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-03T17:32:36.163435] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-03T17:32:36.165250] [DEBUG] [LOCAL ] BDN: Trimmed 69263 records to 48182 (keeping 200 days of data) [2025-10-03T17:32:36.458984] [DEBUG] [LOCAL ] BDN: Primary data saved (48182 records). [2025-10-03T17:32:36.459158] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-03T17:32:36.459351] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDN took 27.8s. Estimated remaining: 4h 47m 23s. Rate: 7.4 symbols/min [2025-10-03T17:32:36.655411] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:36.655730] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-03T17:32:36.655836] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-03T17:32:36.656128] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-03T17:32:36.656275] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-03T17:32:36.656462] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-03T17:32:36.656519] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-03T17:32:36.791487] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-03T17:32:37.040623] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T17:32:37.114377] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:37.590703] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-03T17:32:38.135917] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T17:32:38.303380] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T17:32:38.390737] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-03T17:32:38.552699] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-03T17:32:38.673201] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-03T17:32:39.190689] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-03T17:32:39.584936] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T17:32:39.990708] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-03T17:32:40.421399] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T17:32:40.790716] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-03T17:32:41.590729] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-03T17:32:42.347800] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:32:42.350955] [INFO ] [REMOTE ] BDX: Full fetch complete (75709 records). [2025-10-03T17:32:42.351093] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-03T17:32:42.399999] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-03T17:32:42.782954] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-03T17:32:42.783047] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-03T17:32:42.783833] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-03T17:32:42.783900] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-03T17:32:42.785549] [DEBUG] [LOCAL ] BDX: Trimmed 75709 records to 53085 (keeping 200 days of data) [2025-10-03T17:32:42.894169] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T17:32:43.166688] [DEBUG] [LOCAL ] BDX: Primary data saved (53085 records). [2025-10-03T17:32:43.166844] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-03T17:32:43.166934] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDX took 34.5s. Estimated remaining: 4h 47m 3s. Rate: 7.4 symbols/min [2025-10-03T17:32:43.200621] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-03T17:32:43.367961] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:43.422350] [DEBUG] [LOCAL ] BEKE: Loaded 53629 existing records from primary storage. [2025-10-03T17:32:43.422707] [INFO ] [MAIN ] BEKE: Loaded 53629 existing records. [2025-10-03T17:32:43.620116] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:43.621167] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-03T17:32:43.621228] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-03T17:32:43.621495] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-03T17:32:43.621556] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-03T17:32:43.806860] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T17:32:43.990685] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-03T17:32:44.088999] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:44.123340] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T17:32:44.790717] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-03T17:32:45.325102] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:32:45.590687] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-03T17:32:45.931872] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-03T17:32:46.390662] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-03T17:32:46.626918] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:32:47.190695] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-03T17:32:47.419746] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-03T17:32:47.990695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-03T17:32:48.682857] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-03T17:32:48.685764] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-03T17:32:48.685896] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-03T17:32:48.796168] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-03T17:32:48.997378] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:32:49.022604] [INFO ] [REMOTE ] BDJ: Full fetch complete (42926 records). [2025-10-03T17:32:49.038337] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-03T17:32:49.233438] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-03T17:32:49.239133] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-03T17:32:49.250274] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-03T17:32:49.281748] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-03T17:32:49.371104] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-10-03T17:32:49.593736] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-03T17:32:49.652967] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-03T17:32:49.656031] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-03T17:32:49.666450] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-03T17:32:49.667681] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-03T17:32:49.686061] [DEBUG] [LOCAL ] BDJ: Trimmed 42926 records to 29333 (keeping 200 days of data) [2025-10-03T17:32:49.988903] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T17:32:50.008440] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-10-03T17:32:50.009553] [INFO ] [MAIN ] BE: Full history saved. [2025-10-03T17:32:50.010001] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BE took 41.4s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-03T17:32:50.207807] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:50.329795] [DEBUG] [LOCAL ] BDJ: Primary data saved (29333 records). [2025-10-03T17:32:50.329949] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-03T17:32:50.330097] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BDJ took 41.7s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-03T17:32:50.328293] [DEBUG] [LOCAL ] BEN: Loaded 53426 existing records from primary storage. [2025-10-03T17:32:50.335775] [INFO ] [MAIN ] BEN: Loaded 53426 existing records. [2025-10-03T17:32:50.404708] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-03T17:32:50.695242] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:50.728954] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:50.729928] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-03T17:32:50.730446] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-03T17:32:50.731195] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-03T17:32:50.731327] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-03T17:32:50.835095] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-03T17:32:50.914229] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T17:32:51.053869] [DEBUG] [LOCAL ] BEP: Loaded 38963 existing records from primary storage. [2025-10-03T17:32:51.099022] [INFO ] [MAIN ] BEP: Loaded 38963 existing records. [2025-10-03T17:32:51.206986] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-03T17:32:51.370101] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:51.432147] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:51.432426] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-03T17:32:51.432553] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-03T17:32:51.432823] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-03T17:32:51.432884] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-03T17:32:51.841708] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:51.990735] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-03T17:32:52.790711] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-03T17:32:53.146856] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:32:53.147848] [INFO ] [REMOTE ] BEDU: Full fetch complete (1404 records). [2025-10-03T17:32:53.147951] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-03T17:32:53.362957] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-03T17:32:53.363926] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:32:53.364039] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:32:53.364255] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-03T17:32:53.364601] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-03T17:32:53.393662] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-03T17:32:53.396833] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-03T17:32:53.397824] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 16.9s. Estimated remaining: 4h 44m 37s. Rate: 7.5 symbols/min [2025-10-03T17:32:53.399100] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-03T17:32:53.603129] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:53.599025] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-03T17:32:53.636734] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T17:32:53.689047] [DEBUG] [LOCAL ] BEPC: Loaded 46818 existing records from primary storage. [2025-10-03T17:32:53.689377] [INFO ] [MAIN ] BEPC: Loaded 46818 existing records. [2025-10-03T17:32:53.882079] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:53.882295] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-03T17:32:53.882345] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-03T17:32:53.882631] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-03T17:32:53.882726] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-03T17:32:54.273716] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:54.390711] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-03T17:32:55.190734] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-03T17:32:55.664127] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T17:32:55.921783] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:32:55.990821] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-03T17:32:56.487259] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:32:56.790710] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-03T17:32:57.590698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-03T17:32:57.747227] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T17:32:58.390665] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-03T17:32:58.715046] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:32:58.803376] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:32:59.190713] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-03T17:32:59.990631] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-03T17:33:00.099877] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:33:00.771364] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T17:33:00.790638] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-03T17:33:01.233691] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T17:33:01.590702] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-03T17:33:02.390727] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-03T17:33:03.190733] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-03T17:33:03.480368] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T17:33:03.969843] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (3.18 seconds). [2025-10-03T17:33:03.990621] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-03T17:33:04.066336] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T17:33:04.790703] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-03T17:33:04.990932] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:33:05.590697] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-03T17:33:05.959421] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T17:33:06.243903] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:33:06.390739] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-03T17:33:07.190712] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-03T17:33:07.456706] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:33:07.990675] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-03T17:33:08.046178] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T17:33:08.736551] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:33:08.790713] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-03T17:33:09.590769] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-03T17:33:10.234297] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:33:10.390697] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-03T17:33:11.190696] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-03T17:33:11.469106] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T17:33:11.507388] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:33:11.990723] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-03T17:33:12.790677] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-03T17:33:13.059253] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:33:13.565429] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:33:13.590681] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-03T17:33:14.390683] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-03T17:33:14.485850] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:33:15.019337] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (7.03 seconds). [2025-10-03T17:33:15.064114] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:33:15.190722] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-03T17:33:15.775121] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:33:15.778283] [INFO ] [REMOTE ] BEKE: Full fetch complete (77192 records). [2025-10-03T17:33:15.778442] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-03T17:33:15.999345] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-03T17:33:16.237260] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-03T17:33:16.237347] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-03T17:33:16.238395] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-03T17:33:16.238482] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-03T17:33:16.240542] [DEBUG] [LOCAL ] BEKE: Trimmed 77192 records to 54017 (keeping 200 days of data) [2025-10-03T17:33:16.596818] [DEBUG] [LOCAL ] BEKE: Primary data saved (54017 records). [2025-10-03T17:33:16.596969] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-03T17:33:16.599028] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEKE took 33.4s. Estimated remaining: 4h 46m 40s. Rate: 7.4 symbols/min [2025-10-03T17:33:16.793863] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:16.791889] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-03T17:33:16.795102] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-03T17:33:16.795291] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-03T17:33:16.795488] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-03T17:33:16.795705] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-03T17:33:16.795787] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-03T17:33:16.795849] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-03T17:33:17.243961] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:17.300161] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T17:33:17.388025] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:33:17.590751] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-03T17:33:18.105019] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T17:33:18.362945] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:33:18.390724] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-03T17:33:19.190694] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-03T17:33:19.990730] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-03T17:33:20.047538] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:33:20.563545] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:33:20.790728] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-03T17:33:20.955139] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:33:20.957548] [INFO ] [REMOTE ] BEP: Full fetch complete (58421 records). [2025-10-03T17:33:20.957690] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-03T17:33:21.293697] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T17:33:21.390131] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-03T17:33:21.390222] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-03T17:33:21.390942] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-03T17:33:21.391014] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-03T17:33:21.392391] [DEBUG] [LOCAL ] BEP: Trimmed 58421 records to 39305 (keeping 200 days of data) [2025-10-03T17:33:21.603201] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-03T17:33:21.642470] [DEBUG] [LOCAL ] BEP: Primary data saved (39305 records). [2025-10-03T17:33:21.642630] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-03T17:33:21.642772] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 31.3s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-03T17:33:21.828814] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:21.835059] [DEBUG] [LOCAL ] BEPI: Loaded 3556 existing records from primary storage. [2025-10-03T17:33:21.835237] [INFO ] [MAIN ] BEPI: Loaded 3556 existing records. [2025-10-03T17:33:22.035248] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:22.035490] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-03T17:33:22.035539] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-03T17:33:22.035787] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-03T17:33:22.035863] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-03T17:33:22.393433] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-03T17:33:22.421818] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:22.672484] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:33:23.190692] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-03T17:33:23.942504] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:33:23.990729] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-03T17:33:24.790685] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-03T17:33:25.203767] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T17:33:25.502956] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:33:25.590725] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-03T17:33:25.802333] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:33:26.367289] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:33:26.390742] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-03T17:33:27.190737] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-03T17:33:27.990726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-03T17:33:28.460533] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T17:33:28.743404] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:33:28.790634] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-03T17:33:29.263144] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T17:33:29.590716] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-03T17:33:29.884703] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-03T17:33:30.390713] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-03T17:33:30.899756] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T17:33:31.190723] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-03T17:33:31.561336] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (5.17 seconds). [2025-10-03T17:33:31.564177] [INFO ] [REMOTE ] BEN: Full fetch complete (76892 records). [2025-10-03T17:33:31.564348] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-03T17:33:32.005069] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-03T17:33:32.001174] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-03T17:33:32.006019] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-03T17:33:32.006857] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-03T17:33:32.006923] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-03T17:33:32.008530] [DEBUG] [LOCAL ] BEN: Trimmed 76892 records to 53814 (keeping 200 days of data) [2025-10-03T17:33:32.362589] [DEBUG] [LOCAL ] BEN: Primary data saved (53814 records). [2025-10-03T17:33:32.362763] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-03T17:33:32.362875] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEN took 42.4s. Estimated remaining: 4h 46m 20s. Rate: 7.4 symbols/min [2025-10-03T17:33:32.549048] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:32.555132] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-03T17:33:32.555340] [INFO ] [MAIN ] BEPJ: Loaded 3156 existing records. [2025-10-03T17:33:32.769413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:33:32.792592] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:32.792729] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-03T17:33:32.794583] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-03T17:33:32.794833] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-03T17:33:32.795074] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-03T17:33:32.795678] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-03T17:33:33.181296] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:33.440889] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T17:33:33.590707] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-03T17:33:34.390742] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-03T17:33:34.918731] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:33:34.921456] [INFO ] [REMOTE ] BEPC: Full fetch complete (68534 records). [2025-10-03T17:33:34.921685] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-03T17:33:35.056790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T17:33:35.200994] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-03T17:33:35.394239] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-03T17:33:35.394318] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-03T17:33:35.395037] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-03T17:33:35.395103] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-03T17:33:35.396451] [DEBUG] [LOCAL ] BEPC: Trimmed 68534 records to 47157 (keeping 200 days of data) [2025-10-03T17:33:35.691254] [DEBUG] [LOCAL ] BEPC: Primary data saved (47157 records). [2025-10-03T17:33:35.691454] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-03T17:33:35.692295] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BEPC took 42.3s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-10-03T17:33:35.890579] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:35.931053] [DEBUG] [LOCAL ] BFAM: Loaded 33413 existing records from primary storage. [2025-10-03T17:33:35.931385] [INFO ] [MAIN ] BFAM: Loaded 33413 existing records. [2025-10-03T17:33:35.998965] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-03T17:33:36.126744] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:36.127002] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-03T17:33:36.127054] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-03T17:33:36.127308] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-03T17:33:36.127368] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-03T17:33:36.571630] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:36.752966] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:33:36.790683] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-03T17:33:37.266876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T17:33:37.570096] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (5.57 seconds). [2025-10-03T17:33:37.590622] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-03T17:33:37.894225] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-03T17:33:38.390690] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-03T17:33:38.990041] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T17:33:39.190688] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-03T17:33:39.811968] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:33:39.990689] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-03T17:33:40.555060] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (5.35 seconds). [2025-10-03T17:33:40.651089] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:33:40.651923] [INFO ] [REMOTE ] BEPI: Full fetch complete (4946 records). [2025-10-03T17:33:40.651997] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-03T17:33:40.795771] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-03T17:33:41.066012] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-03T17:33:41.066109] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-03T17:33:41.066275] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-03T17:33:41.066319] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-03T17:33:41.066956] [DEBUG] [LOCAL ] BEPI: Trimmed 4946 records to 3576 (keeping 200 days of data) [2025-10-03T17:33:41.090445] [DEBUG] [LOCAL ] BEPI: Primary data saved (3576 records). [2025-10-03T17:33:41.090608] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-03T17:33:41.090758] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPI took 19.4s. Estimated remaining: 4h 45m 0s. Rate: 7.4 symbols/min [2025-10-03T17:33:41.258519] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T17:33:41.296524] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:41.342726] [DEBUG] [LOCAL ] BFH: Loaded 41897 existing records from primary storage. [2025-10-03T17:33:41.343052] [INFO ] [MAIN ] BFH: Loaded 41897 existing records. [2025-10-03T17:33:41.549518] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:41.549941] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-03T17:33:41.550002] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-03T17:33:41.550279] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-03T17:33:41.550348] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-03T17:33:41.595875] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-03T17:33:41.937471] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:42.390690] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-03T17:33:43.189622] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:33:43.197165] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-03T17:33:43.286082] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:33:43.824559] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T17:33:43.990693] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-03T17:33:44.499763] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T17:33:44.790707] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-03T17:33:45.382882] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T17:33:45.590697] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-03T17:33:46.390693] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-03T17:33:46.541337] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T17:33:46.542331] [INFO ] [REMOTE ] BEPH: Full fetch complete (7744 records). [2025-10-03T17:33:46.542402] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-03T17:33:46.880129] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:33:46.967951] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-03T17:33:46.968039] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-03T17:33:46.968283] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-03T17:33:46.968345] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-03T17:33:46.968842] [DEBUG] [LOCAL ] BEPH: Trimmed 7744 records to 5430 (keeping 200 days of data) [2025-10-03T17:33:47.014129] [DEBUG] [LOCAL ] BEPH: Primary data saved (5430 records). [2025-10-03T17:33:47.014281] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-03T17:33:47.014381] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPH took 30.4s. Estimated remaining: 4h 44m 34s. Rate: 7.4 symbols/min [2025-10-03T17:33:47.198282] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-03T17:33:47.203519] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:47.222676] [DEBUG] [LOCAL ] BFK: Loaded 13980 existing records from primary storage. [2025-10-03T17:33:47.222947] [INFO ] [MAIN ] BFK: Loaded 13980 existing records. [2025-10-03T17:33:47.417799] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:47.418159] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-03T17:33:47.418221] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-03T17:33:47.418488] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-03T17:33:47.418553] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-03T17:33:47.857584] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:47.990718] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-03T17:33:48.192548] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:33:48.790692] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-03T17:33:49.594787] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-03T17:33:49.599723] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:33:49.857724] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T17:33:50.054004] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T17:33:50.390676] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-03T17:33:51.190725] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-03T17:33:51.990711] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-03T17:33:52.790699] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-03T17:33:54.000376] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-03T17:33:54.009909] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-03T17:33:54.674277] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-03T17:33:54.677463] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-03T17:33:55.604838] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-03T17:33:55.611909] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-03T17:33:55.717816] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:33:55.767623] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (5.38 seconds). [2025-10-03T17:33:55.893019] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:33:55.990726] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-03T17:33:56.790709] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-03T17:33:57.373735] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T17:33:57.398991] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T17:33:57.590720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-03T17:33:58.390701] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-03T17:33:58.509017] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T17:33:58.540025] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-03T17:33:58.717380] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T17:33:59.190730] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-03T17:33:59.990691] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-03T17:34:00.622332] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T17:34:00.790716] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-03T17:34:01.028479] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:34:01.590698] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-03T17:34:02.002351] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T17:34:02.003198] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4494 records). [2025-10-03T17:34:02.003273] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-03T17:34:02.400861] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-03T17:34:02.400604] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-03T17:34:02.401945] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-03T17:34:02.402112] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-03T17:34:02.402155] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-03T17:34:02.402574] [DEBUG] [LOCAL ] BEPJ: Trimmed 4494 records to 3166 (keeping 200 days of data) [2025-10-03T17:34:02.423327] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3166 records). [2025-10-03T17:34:02.423434] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-03T17:34:02.423531] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPJ took 30.1s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-03T17:34:02.603147] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:02.657003] [DEBUG] [LOCAL ] BFLY: Loaded 52160 existing records from primary storage. [2025-10-03T17:34:02.657348] [INFO ] [MAIN ] BFLY: Loaded 52160 existing records. [2025-10-03T17:34:02.855517] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:02.855760] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-03T17:34:02.855839] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-03T17:34:02.856531] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-03T17:34:02.856595] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-03T17:34:03.213904] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-03T17:34:03.235325] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:03.244307] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T17:34:03.990619] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-03T17:34:04.191035] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T17:34:04.498373] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:34:04.790685] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-03T17:34:04.892886] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T17:34:05.590734] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-03T17:34:06.295174] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:34:06.390743] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-03T17:34:07.190743] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-03T17:34:07.941874] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:34:07.990706] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-03T17:34:08.112494] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:34:08.600747] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T17:34:08.790751] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-03T17:34:08.920860] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:34:09.590720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-03T17:34:10.390702] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-03T17:34:10.450710] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T17:34:11.190759] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-03T17:34:11.775867] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:34:11.825902] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-03T17:34:11.990701] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-03T17:34:12.459020] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:34:12.790715] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-03T17:34:13.590694] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-03T17:34:14.090947] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-03T17:34:14.390732] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-03T17:34:14.880575] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T17:34:15.190731] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-03T17:34:15.990715] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-03T17:34:16.237859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-03T17:34:16.624500] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T17:34:16.790724] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-03T17:34:17.025163] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T17:34:17.439752] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:34:17.440900] [INFO ] [REMOTE ] BFK: Full fetch complete (19219 records). [2025-10-03T17:34:17.440976] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-03T17:34:17.441682] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:34:17.441907] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:34:17.441996] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:34:17.442092] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-03T17:34:17.442223] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-03T17:34:17.442297] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-03T17:34:17.442915] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-03T17:34:17.443067] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BFK took 30.4s. Estimated remaining: 4h 46m 18s. Rate: 7.4 symbols/min [2025-10-03T17:34:17.594313] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-03T17:34:17.672575] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:17.702827] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:34:17.717251] [DEBUG] [LOCAL ] BFS: Loaded 9213 existing records from primary storage. [2025-10-03T17:34:17.717542] [INFO ] [MAIN ] BFS: Loaded 9213 existing records. [2025-10-03T17:34:17.908521] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:17.908799] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-03T17:34:17.908869] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-03T17:34:17.909142] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-03T17:34:17.909200] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-03T17:34:18.290847] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:18.390694] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-03T17:34:19.190713] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-03T17:34:19.262542] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:34:19.598187] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:34:19.990685] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-03T17:34:20.795076] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-03T17:34:20.796188] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:34:21.011827] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:34:21.590729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-03T17:34:22.384193] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:34:22.390601] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-03T17:34:22.545391] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:34:23.190721] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-03T17:34:23.238156] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-03T17:34:23.990729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-03T17:34:24.253524] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:34:24.554558] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:34:24.790695] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-03T17:34:25.590725] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-03T17:34:26.390759] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-03T17:34:26.430555] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:34:26.434035] [INFO ] [REMOTE ] BFH: Full fetch complete (59737 records). [2025-10-03T17:34:26.434433] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-03T17:34:26.642196] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:34:27.098414] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-03T17:34:27.098590] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-03T17:34:27.099708] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-03T17:34:27.099798] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-03T17:34:27.101720] [DEBUG] [LOCAL ] BFH: Trimmed 59737 records to 42221 (keeping 200 days of data) [2025-10-03T17:34:27.198216] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-03T17:34:27.440543] [DEBUG] [LOCAL ] BFH: Primary data saved (42221 records). [2025-10-03T17:34:27.440745] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-03T17:34:27.440888] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFH took 46.3s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-03T17:34:27.644218] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:27.659537] [DEBUG] [LOCAL ] BFZ: Loaded 12227 existing records from primary storage. [2025-10-03T17:34:27.659889] [INFO ] [MAIN ] BFZ: Loaded 12227 existing records. [2025-10-03T17:34:27.868828] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:27.869090] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-03T17:34:27.869150] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-03T17:34:27.869518] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-03T17:34:27.869579] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-03T17:34:27.995983] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-03T17:34:28.058043] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T17:34:28.301988] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:28.333438] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:34:28.790722] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-03T17:34:29.590670] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-03T17:34:29.741139] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T17:34:29.832334] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-03T17:34:29.834373] [INFO ] [REMOTE ] BFAM: Full fetch complete (47006 records). [2025-10-03T17:34:29.834494] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-03T17:34:30.283775] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-03T17:34:30.283872] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-03T17:34:30.284488] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-03T17:34:30.284557] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-03T17:34:30.285838] [DEBUG] [LOCAL ] BFAM: Trimmed 47006 records to 33682 (keeping 200 days of data) [2025-10-03T17:34:30.391276] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-03T17:34:30.503437] [DEBUG] [LOCAL ] BFAM: Primary data saved (33682 records). [2025-10-03T17:34:30.503630] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-03T17:34:30.504838] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFAM took 54.8s. Estimated remaining: 4h 45m 35s. Rate: 7.4 symbols/min [2025-10-03T17:34:30.696843] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:30.752359] [DEBUG] [LOCAL ] BG: Loaded 50788 existing records from primary storage. [2025-10-03T17:34:30.752736] [INFO ] [MAIN ] BG: Loaded 50788 existing records. [2025-10-03T17:34:30.964126] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:30.964411] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-03T17:34:30.964493] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-03T17:34:30.965984] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-03T17:34:30.966047] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-03T17:34:31.200822] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-03T17:34:31.304081] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:34:31.382412] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:31.424415] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:34:31.982703] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T17:34:31.990620] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-03T17:34:32.764872] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:34:32.790677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-03T17:34:33.580540] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T17:34:33.590623] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-03T17:34:34.283048] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T17:34:34.284110] [INFO ] [REMOTE ] BFS: Full fetch complete (12716 records). [2025-10-03T17:34:34.284195] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-03T17:34:34.395784] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-03T17:34:34.682993] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-03T17:34:34.683079] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-03T17:34:34.683348] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-03T17:34:34.683409] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-03T17:34:34.683942] [DEBUG] [LOCAL ] BFS: Trimmed 12716 records to 9281 (keeping 200 days of data) [2025-10-03T17:34:34.743589] [DEBUG] [LOCAL ] BFS: Primary data saved (9281 records). [2025-10-03T17:34:34.743766] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-03T17:34:34.743880] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFS took 17.3s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-03T17:34:34.922115] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:34.941289] [DEBUG] [LOCAL ] BGB: Loaded 17717 existing records from primary storage. [2025-10-03T17:34:34.941565] [INFO ] [MAIN ] BGB: Loaded 17717 existing records. [2025-10-03T17:34:35.129238] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:35.129428] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-03T17:34:35.129482] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-03T17:34:35.130166] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-03T17:34:35.130229] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-03T17:34:35.194536] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-03T17:34:35.466740] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:34:35.554410] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:35.990713] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-03T17:34:36.790711] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-03T17:34:37.133038] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:34:37.540675] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T17:34:37.590697] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-03T17:34:37.808727] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:34:38.390728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-03T17:34:39.190670] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-03T17:34:39.305411] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:34:39.834077] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T17:34:39.990638] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-03T17:34:40.035396] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:34:40.790690] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-03T17:34:41.601765] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-03T17:34:41.608921] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T17:34:41.841666] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T17:34:42.390686] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-03T17:34:43.190630] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-03T17:34:43.307418] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:34:43.409056] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:34:43.995670] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-03T17:34:43.999808] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T17:34:44.790685] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-03T17:34:44.941376] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:34:45.590675] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-03T17:34:45.754827] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T17:34:46.390683] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-03T17:34:47.194717] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-03T17:34:47.199637] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:34:47.263742] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:34:47.990677] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-03T17:34:48.790671] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-03T17:34:48.910166] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:34:48.922828] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T17:34:48.932445] [INFO ] [REMOTE ] BFLY: Full fetch complete (75285 records). [2025-10-03T17:34:48.932886] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-03T17:34:49.361844] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-03T17:34:49.361982] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-03T17:34:49.363099] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-03T17:34:49.363184] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-03T17:34:49.367771] [DEBUG] [LOCAL ] BFLY: Trimmed 75285 records to 52549 (keeping 200 days of data) [2025-10-03T17:34:49.602229] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-03T17:34:49.719923] [DEBUG] [LOCAL ] BFLY: Primary data saved (52549 records). [2025-10-03T17:34:49.720138] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-03T17:34:49.720275] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFLY took 47.3s. Estimated remaining: 4h 45m 44s. Rate: 7.4 symbols/min [2025-10-03T17:34:49.941973] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:49.967818] [DEBUG] [LOCAL ] BGH: Loaded 17043 existing records from primary storage. [2025-10-03T17:34:49.968181] [INFO ] [MAIN ] BGH: Loaded 17043 existing records. [2025-10-03T17:34:50.151209] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:50.151521] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-03T17:34:50.151574] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-03T17:34:50.152461] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-03T17:34:50.152525] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-03T17:34:50.398638] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-03T17:34:50.533877] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:50.568601] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:34:50.771464] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T17:34:51.162408] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T17:34:51.190617] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-03T17:34:51.990698] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-03T17:34:52.010404] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:34:52.011606] [INFO ] [REMOTE ] BFZ: Full fetch complete (17993 records). [2025-10-03T17:34:52.011708] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-03T17:34:52.419837] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-03T17:34:52.419949] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-03T17:34:52.420459] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-03T17:34:52.420510] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-03T17:34:52.421276] [DEBUG] [LOCAL ] BFZ: Trimmed 17993 records to 12261 (keeping 200 days of data) [2025-10-03T17:34:52.504242] [DEBUG] [LOCAL ] BFZ: Primary data saved (12261 records). [2025-10-03T17:34:52.504461] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-03T17:34:52.504577] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFZ took 25.1s. Estimated remaining: 4h 44m 52s. Rate: 7.4 symbols/min [2025-10-03T17:34:52.679512] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:52.679784] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-10-03T17:34:52.679832] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-10-03T17:34:52.679966] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-03T17:34:52.680009] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-03T17:34:52.680051] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-03T17:34:52.680086] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-03T17:34:52.795941] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-03T17:34:53.043845] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:53.590750] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-03T17:34:53.714908] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:34:54.159270] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:34:54.390680] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-03T17:34:54.603495] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:34:55.190740] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-03T17:34:55.640244] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T17:34:55.780837] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T17:34:55.990712] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-03T17:34:56.790710] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-03T17:34:57.590666] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-03T17:34:57.751409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T17:34:57.900316] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T17:34:58.390639] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-03T17:34:58.495845] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T17:34:59.190687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-03T17:34:59.319514] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:34:59.990849] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-03T17:35:00.790752] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-03T17:35:01.167233] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:35:01.353432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T17:35:01.590687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-03T17:35:01.759291] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:35:02.390737] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-03T17:35:03.190692] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-03T17:35:03.395155] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T17:35:03.990720] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-03T17:35:04.059160] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T17:35:04.626827] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T17:35:04.638506] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:35:04.790700] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-03T17:35:05.579386] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:35:05.590708] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-03T17:35:06.390635] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-03T17:35:06.532376] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:35:07.190725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-03T17:35:07.710038] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:35:07.990844] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-03T17:35:08.247377] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:35:08.726203] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:35:08.790745] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-03T17:35:09.448211] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:35:09.590689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-03T17:35:10.390670] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-03T17:35:10.507335] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:35:10.509304] [INFO ] [REMOTE ] BGB: Full fetch complete (27093 records). [2025-10-03T17:35:10.509413] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-03T17:35:10.903583] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-03T17:35:10.903693] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-03T17:35:10.904111] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-03T17:35:10.904265] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-03T17:35:10.905048] [DEBUG] [LOCAL ] BGB: Trimmed 27093 records to 17901 (keeping 200 days of data) [2025-10-03T17:35:11.024011] [DEBUG] [LOCAL ] BGB: Primary data saved (17901 records). [2025-10-03T17:35:11.024183] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-03T17:35:11.024305] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BGB took 36.3s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-03T17:35:11.191757] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-03T17:35:11.222377] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:11.290226] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T17:35:11.297266] [DEBUG] [LOCAL ] BGS: Loaded 50795 existing records from primary storage. [2025-10-03T17:35:11.297625] [INFO ] [MAIN ] BGS: Loaded 50795 existing records. [2025-10-03T17:35:11.497085] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:11.497329] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-03T17:35:11.497390] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-03T17:35:11.499037] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-03T17:35:11.499109] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-03T17:35:11.899850] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:11.990739] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-03T17:35:12.194607] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:35:12.790703] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-03T17:35:12.902455] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:35:13.590733] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-03T17:35:13.960906] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:35:14.390737] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-03T17:35:15.190705] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-03T17:35:15.286926] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T17:35:15.293107] [INFO ] [REMOTE ] BG: Full fetch complete (72765 records). [2025-10-03T17:35:15.293273] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-03T17:35:15.485294] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:35:15.760911] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-03T17:35:15.760997] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-03T17:35:15.761744] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-03T17:35:15.761813] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-03T17:35:15.763344] [DEBUG] [LOCAL ] BG: Trimmed 72765 records to 51115 (keeping 200 days of data) [2025-10-03T17:35:15.991157] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-03T17:35:16.105069] [DEBUG] [LOCAL ] BG: Primary data saved (51115 records). [2025-10-03T17:35:16.105229] [INFO ] [MAIN ] BG: Full history saved. [2025-10-03T17:35:16.106190] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 45.6s. Estimated remaining: 4h 45m 36s. Rate: 7.4 symbols/min [2025-10-03T17:35:16.297142] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:16.307775] [DEBUG] [LOCAL ] BGSF: Loaded 7557 existing records from primary storage. [2025-10-03T17:35:16.308014] [INFO ] [MAIN ] BGSF: Loaded 7557 existing records. [2025-10-03T17:35:16.503210] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:16.503486] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-03T17:35:16.503537] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-03T17:35:16.504081] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-03T17:35:16.504143] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-03T17:35:16.794574] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-03T17:35:16.918789] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:17.057133] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T17:35:17.191771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:35:17.590696] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-03T17:35:17.604813] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:35:18.390719] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-03T17:35:18.572966] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:35:19.161965] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T17:35:19.163026] [INFO ] [REMOTE ] BGR: Full fetch complete (20131 records). [2025-10-03T17:35:19.163112] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-03T17:35:19.163786] [FATAL] [VALIDATOR ] BGR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:35:19.163900] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:35:19.163975] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:35:19.164122] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-03T17:35:19.164280] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-03T17:35:19.164348] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-10-03T17:35:19.164469] [DEBUG] [LOCAL ] BGR: No derivative data file found to delete. [2025-10-03T17:35:19.164573] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGR took 26.7s. Estimated remaining: 4h 44m 47s. Rate: 7.4 symbols/min [2025-10-03T17:35:19.198823] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-03T17:35:19.439206] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:19.468850] [DEBUG] [LOCAL ] BGT: Loaded 16702 existing records from primary storage. [2025-10-03T17:35:19.469295] [INFO ] [MAIN ] BGT: Loaded 16702 existing records. [2025-10-03T17:35:19.748234] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:19.748501] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-03T17:35:19.748563] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-03T17:35:19.749357] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-03T17:35:19.749431] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-03T17:35:19.996043] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-03T17:35:20.188731] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:20.790624] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-03T17:35:20.797144] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T17:35:20.892326] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:35:21.355055] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:35:21.590727] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-03T17:35:22.390700] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-03T17:35:22.445241] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:35:22.447719] [INFO ] [REMOTE ] BGH: Full fetch complete (22607 records). [2025-10-03T17:35:22.447882] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-03T17:35:22.881251] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-03T17:35:22.881331] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-03T17:35:22.881698] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-03T17:35:22.881767] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-03T17:35:22.882458] [DEBUG] [LOCAL ] BGH: Trimmed 22607 records to 17279 (keeping 200 days of data) [2025-10-03T17:35:22.970578] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T17:35:23.008551] [DEBUG] [LOCAL ] BGH: Primary data saved (17279 records). [2025-10-03T17:35:23.008738] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-03T17:35:23.008861] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGH took 33.3s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-03T17:35:23.195666] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:23.195742] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-03T17:35:23.209899] [DEBUG] [LOCAL ] BGX: Loaded 11102 existing records from primary storage. [2025-10-03T17:35:23.210268] [INFO ] [MAIN ] BGX: Loaded 11102 existing records. [2025-10-03T17:35:23.408997] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:23.409244] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-03T17:35:23.409295] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-03T17:35:23.410482] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-03T17:35:23.410545] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-03T17:35:23.859416] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:23.990796] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-03T17:35:24.790708] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-03T17:35:24.835989] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:35:24.969343] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T17:35:25.239277] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T17:35:25.590688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-03T17:35:26.390720] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-03T17:35:27.047242] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T17:35:27.190727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-03T17:35:27.528847] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:35:27.990726] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-03T17:35:28.399368] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:35:28.454269] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T17:35:28.790718] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-03T17:35:29.258357] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:35:29.590673] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-03T17:35:30.357232] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:35:30.390677] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-03T17:35:31.194159] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-03T17:35:31.199883] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:35:31.990725] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-03T17:35:32.790729] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-03T17:35:32.886054] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:35:32.958712] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:35:33.590681] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-03T17:35:33.621265] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:35:34.390628] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-03T17:35:34.630793] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:35:35.190695] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-03T17:35:35.990693] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-03T17:35:36.074845] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T17:35:36.263638] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:35:36.790676] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-03T17:35:36.967779] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T17:35:37.590692] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-03T17:35:38.392734] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:35:38.390797] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-03T17:35:38.438524] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T17:35:39.190732] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-03T17:35:39.307927] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T17:35:39.990735] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-03T17:35:40.790707] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-03T17:35:40.854764] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:35:40.992707] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:35:41.590728] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-03T17:35:41.781210] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:35:42.212746] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T17:35:42.390690] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-03T17:35:43.190703] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-03T17:35:43.342986] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:35:43.990687] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-03T17:35:44.362567] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:35:44.521959] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-03T17:35:44.790706] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-03T17:35:45.337423] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:35:45.590709] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-03T17:35:46.390726] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-03T17:35:47.190751] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-03T17:35:47.284177] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:35:47.322203] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T17:35:47.990711] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-03T17:35:48.156560] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:35:48.716235] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T17:35:48.790725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-03T17:35:49.590735] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-03T17:35:50.398636] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-03T17:35:50.421413] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:35:50.846057] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:35:51.190629] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-03T17:35:51.348981] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:35:51.990681] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-03T17:35:52.211341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T17:35:52.790690] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-03T17:35:52.853379] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:35:52.854771] [INFO ] [REMOTE ] BGX: Full fetch complete (16270 records). [2025-10-03T17:35:52.854844] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-03T17:35:53.241137] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-03T17:35:53.241216] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-03T17:35:53.241546] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-03T17:35:53.241600] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-03T17:35:53.242166] [DEBUG] [LOCAL ] BGX: Trimmed 16270 records to 11262 (keeping 200 days of data) [2025-10-03T17:35:53.315436] [DEBUG] [LOCAL ] BGX: Primary data saved (11262 records). [2025-10-03T17:35:53.315594] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-03T17:35:53.315733] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGX took 30.3s. Estimated remaining: 4h 46m 55s. Rate: 7.3 symbols/min [2025-10-03T17:35:53.534363] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:53.557396] [DEBUG] [LOCAL ] BGY: Loaded 22528 existing records from primary storage. [2025-10-03T17:35:53.557705] [INFO ] [MAIN ] BGY: Loaded 22528 existing records. [2025-10-03T17:35:53.592692] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-03T17:35:53.781978] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:53.776349] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:35:53.783366] [INFO ] [REMOTE ] BGT: Full fetch complete (24314 records). [2025-10-03T17:35:53.783458] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-03T17:35:53.783304] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-03T17:35:53.783663] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-03T17:35:53.816475] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-03T17:35:53.856143] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-03T17:35:54.397996] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-03T17:35:54.531608] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-03T17:35:54.531927] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-03T17:35:54.532431] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-03T17:35:54.532522] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-03T17:35:54.580927] [DEBUG] [LOCAL ] BGT: Trimmed 24314 records to 16780 (keeping 200 days of data) [2025-10-03T17:35:54.624953] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:54.742668] [DEBUG] [LOCAL ] BGT: Primary data saved (16780 records). [2025-10-03T17:35:54.742844] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-03T17:35:54.742939] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGT took 35.6s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-03T17:35:54.933603] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:54.951827] [DEBUG] [LOCAL ] BH: Loaded 15980 existing records from primary storage. [2025-10-03T17:35:54.952091] [INFO ] [MAIN ] BH: Loaded 15980 existing records. [2025-10-03T17:35:55.145233] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:55.145476] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-03T17:35:55.145525] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-03T17:35:55.146120] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-03T17:35:55.146184] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-03T17:35:55.191019] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-03T17:35:55.272087] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:35:55.324172] [INFO ] [REMOTE ] BGS: Full fetch complete (72486 records). [2025-10-03T17:35:55.333306] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-03T17:35:55.754612] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:55.905289] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T17:35:55.928637] [INFO ] [REMOTE ] BGSF: Full fetch complete (9038 records). [2025-10-03T17:35:55.939178] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-03T17:35:55.999710] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-03T17:35:56.109978] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-03T17:35:56.134911] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-03T17:35:56.156398] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-03T17:35:56.162669] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-03T17:35:56.297808] [DEBUG] [LOCAL ] BGS: Trimmed 72486 records to 51155 (keeping 200 days of data) [2025-10-03T17:35:56.517469] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:35:56.639271] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-03T17:35:56.639904] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-03T17:35:56.640702] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-03T17:35:56.640785] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-03T17:35:56.643046] [DEBUG] [LOCAL ] BGSF: Trimmed 9038 records to 7724 (keeping 200 days of data) [2025-10-03T17:35:56.706443] [DEBUG] [LOCAL ] BGSF: Primary data saved (7724 records). [2025-10-03T17:35:56.706910] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-03T17:35:56.707262] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGSF took 40.6s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-03T17:35:56.799744] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-03T17:35:57.011165] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:57.021175] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:35:57.087789] [DEBUG] [LOCAL ] BHC: Loaded 47149 existing records from primary storage. [2025-10-03T17:35:57.089555] [INFO ] [MAIN ] BHC: Loaded 47149 existing records. [2025-10-03T17:35:57.332169] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:57.337885] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-03T17:35:57.353046] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-03T17:35:57.355035] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-03T17:35:57.355115] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-03T17:35:57.593943] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-03T17:35:57.726173] [DEBUG] [LOCAL ] BGS: Primary data saved (51155 records). [2025-10-03T17:35:57.731823] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-03T17:35:57.732933] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BGS took 46.7s. Estimated remaining: 4h 43m 51s. Rate: 7.4 symbols/min [2025-10-03T17:35:57.870631] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:57.988193] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:58.011024] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:35:58.038564] [DEBUG] [LOCAL ] BHE: Loaded 24774 existing records from primary storage. [2025-10-03T17:35:58.038894] [INFO ] [MAIN ] BHE: Loaded 24774 existing records. [2025-10-03T17:35:58.240484] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:58.240816] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-03T17:35:58.241047] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-03T17:35:58.247183] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-03T17:35:58.247384] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-03T17:35:58.253704] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:35:58.395881] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-03T17:35:58.663229] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:59.190673] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-03T17:35:59.565180] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T17:35:59.990697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-03T17:36:00.488013] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:36:00.790732] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-03T17:36:01.383364] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:36:01.590724] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-03T17:36:01.999372] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:36:02.186045] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T17:36:02.390727] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-03T17:36:03.190637] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-03T17:36:03.337014] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T17:36:03.990733] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-03T17:36:04.427675] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:36:04.790737] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-03T17:36:05.046211] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T17:36:05.590743] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-03T17:36:06.390730] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-03T17:36:06.422525] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T17:36:06.542847] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:36:07.190702] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-03T17:36:07.405011] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:36:07.990735] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-03T17:36:08.354611] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T17:36:08.790637] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-03T17:36:09.026616] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:36:09.590714] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-03T17:36:09.778965] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:36:10.390707] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-03T17:36:10.957813] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:36:11.190695] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-03T17:36:11.292145] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:36:11.990736] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-03T17:36:12.715466] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T17:36:12.773415] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:36:12.790710] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-03T17:36:13.590636] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-03T17:36:13.912591] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T17:36:14.390734] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-03T17:36:14.657214] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:36:15.190762] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-03T17:36:15.505444] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:36:15.990708] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-03T17:36:16.113604] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T17:36:16.790740] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-03T17:36:17.529849] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:36:17.590683] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-03T17:36:17.600965] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T17:36:17.602765] [INFO ] [REMOTE ] BH: Full fetch complete (19687 records). [2025-10-03T17:36:17.603022] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-03T17:36:18.031480] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-03T17:36:18.031572] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-03T17:36:18.031943] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-03T17:36:18.032007] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-03T17:36:18.032700] [DEBUG] [LOCAL ] BH: Trimmed 19687 records to 16097 (keeping 200 days of data) [2025-10-03T17:36:18.139012] [DEBUG] [LOCAL ] BH: Primary data saved (16097 records). [2025-10-03T17:36:18.139173] [INFO ] [MAIN ] BH: Full history saved. [2025-10-03T17:36:18.139284] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BH took 23.4s. Estimated remaining: 4h 45m 20s. Rate: 7.4 symbols/min [2025-10-03T17:36:18.334351] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:18.358183] [DEBUG] [LOCAL ] BHK: Loaded 23155 existing records from primary storage. [2025-10-03T17:36:18.358499] [INFO ] [MAIN ] BHK: Loaded 23155 existing records. [2025-10-03T17:36:18.395965] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-03T17:36:18.566104] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:18.566348] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-03T17:36:18.566403] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-03T17:36:18.567307] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-03T17:36:18.567372] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-03T17:36:19.015994] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:19.195808] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-03T17:36:19.211498] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:36:19.296806] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:36:19.298907] [INFO ] [REMOTE ] BGY: Full fetch complete (33111 records). [2025-10-03T17:36:19.299047] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-03T17:36:19.721110] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-03T17:36:19.721201] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-03T17:36:19.721666] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-03T17:36:19.721741] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-03T17:36:19.722818] [DEBUG] [LOCAL ] BGY: Trimmed 33111 records to 22654 (keeping 200 days of data) [2025-10-03T17:36:19.865125] [DEBUG] [LOCAL ] BGY: Primary data saved (22654 records). [2025-10-03T17:36:19.865258] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-03T17:36:19.865349] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGY took 26.5s. Estimated remaining: 4h 44m 22s. Rate: 7.4 symbols/min [2025-10-03T17:36:19.995838] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-03T17:36:20.064498] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:20.129017] [DEBUG] [LOCAL ] BHP: Loaded 53758 existing records from primary storage. [2025-10-03T17:36:20.129358] [INFO ] [MAIN ] BHP: Loaded 53758 existing records. [2025-10-03T17:36:20.351670] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:20.352218] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-03T17:36:20.352342] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-03T17:36:20.359118] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-03T17:36:20.359228] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-03T17:36:20.460632] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:36:20.782173] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:20.790620] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-03T17:36:20.888810] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:36:21.590675] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-03T17:36:22.390637] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-03T17:36:22.514612] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T17:36:22.823173] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:36:23.190635] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-03T17:36:23.494273] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:36:23.990637] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-03T17:36:24.795771] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-03T17:36:24.801792] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T17:36:25.590704] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-03T17:36:25.761488] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:36:25.992929] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:36:26.390639] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-03T17:36:26.694512] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T17:36:27.190703] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-03T17:36:27.757153] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T17:36:27.990697] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-03T17:36:28.228097] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:36:28.790709] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-03T17:36:29.590696] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-03T17:36:29.930076] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:36:30.227424] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:36:30.390704] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-03T17:36:30.577881] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:36:31.190699] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-03T17:36:31.941036] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:36:31.990694] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-03T17:36:32.399023] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:36:32.790728] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-03T17:36:33.505251] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:36:33.590710] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-03T17:36:34.004012] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:36:34.390783] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-03T17:36:35.132277] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:36:35.190676] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-03T17:36:35.990712] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-03T17:36:36.613053] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T17:36:36.790712] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-03T17:36:37.036143] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:36:37.277856] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:36:37.590686] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-03T17:36:38.390731] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-03T17:36:38.642560] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:36:38.725535] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:36:39.190689] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-03T17:36:39.969964] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:36:39.990619] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-03T17:36:40.795724] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-03T17:36:40.802048] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:36:41.536136] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:36:41.539749] [INFO ] [REMOTE ] BHC: Full fetch complete (66934 records). [2025-10-03T17:36:41.539906] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-03T17:36:41.595778] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-03T17:36:41.864607] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:36:42.021821] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-03T17:36:42.021916] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-03T17:36:42.022607] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-03T17:36:42.022681] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-03T17:36:42.024115] [DEBUG] [LOCAL ] BHC: Trimmed 66934 records to 47483 (keeping 200 days of data) [2025-10-03T17:36:42.304200] [DEBUG] [LOCAL ] BHC: Primary data saved (47483 records). [2025-10-03T17:36:42.304355] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-03T17:36:42.305014] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BHC took 45.6s. Estimated remaining: 4h 46m 5s. Rate: 7.3 symbols/min [2025-10-03T17:36:42.395825] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-03T17:36:42.493872] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:42.518969] [DEBUG] [LOCAL ] BHR: Loaded 21586 existing records from primary storage. [2025-10-03T17:36:42.519240] [INFO ] [MAIN ] BHR: Loaded 21586 existing records. [2025-10-03T17:36:42.731748] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:42.731980] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-03T17:36:42.732034] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-03T17:36:42.732353] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-03T17:36:42.732417] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-03T17:36:43.128882] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:43.190680] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-03T17:36:43.432480] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:36:43.882081] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T17:36:43.990725] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-03T17:36:44.422592] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:36:44.790770] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-03T17:36:45.134721] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:36:45.590696] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-03T17:36:46.390673] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-03T17:36:46.473848] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:36:46.476082] [INFO ] [REMOTE ] BHK: Full fetch complete (30307 records). [2025-10-03T17:36:46.476180] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-03T17:36:46.899948] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-03T17:36:46.900134] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-03T17:36:46.900690] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-03T17:36:46.900773] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-03T17:36:46.930870] [DEBUG] [LOCAL ] BHK: Trimmed 30307 records to 23317 (keeping 200 days of data) [2025-10-03T17:36:46.932841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T17:36:47.092058] [DEBUG] [LOCAL ] BHK: Primary data saved (23317 records). [2025-10-03T17:36:47.092203] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-03T17:36:47.092304] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHK took 29.0s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-10-03T17:36:47.195793] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-03T17:36:47.301433] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:47.301689] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-03T17:36:47.301838] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-03T17:36:47.301995] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-03T17:36:47.302038] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-03T17:36:47.302081] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-03T17:36:47.302115] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-03T17:36:47.640954] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:36:47.714953] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:47.990708] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-03T17:36:48.048144] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:36:48.049617] [INFO ] [REMOTE ] BHE: Full fetch complete (36515 records). [2025-10-03T17:36:48.049870] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-03T17:36:48.468898] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-03T17:36:48.468991] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-03T17:36:48.469455] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-03T17:36:48.469553] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-03T17:36:48.470668] [DEBUG] [LOCAL ] BHE: Trimmed 36515 records to 24909 (keeping 200 days of data) [2025-10-03T17:36:48.627288] [DEBUG] [LOCAL ] BHE: Primary data saved (24909 records). [2025-10-03T17:36:48.627433] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-03T17:36:48.627528] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 50.9s. Estimated remaining: 4h 44m 31s. Rate: 7.4 symbols/min [2025-10-03T17:36:48.791577] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-03T17:36:48.845157] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:48.855973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T17:36:48.906883] [DEBUG] [LOCAL ] BHVN: Loaded 50165 existing records from primary storage. [2025-10-03T17:36:48.907260] [INFO ] [MAIN ] BHVN: Loaded 50165 existing records. [2025-10-03T17:36:49.101534] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:49.101814] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-03T17:36:49.101865] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-03T17:36:49.102524] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-03T17:36:49.102599] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-03T17:36:49.492786] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:49.590675] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-03T17:36:50.390634] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-03T17:36:50.521686] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:36:50.554060] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T17:36:51.190691] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-03T17:36:51.953456] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:36:51.990624] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-03T17:36:52.302990] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:36:52.790743] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-03T17:36:53.224355] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-03T17:36:53.542431] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:36:53.545296] [INFO ] [REMOTE ] BHP: Full fetch complete (77249 records). [2025-10-03T17:36:53.545433] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-03T17:36:53.595746] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-03T17:36:53.989335] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-03T17:36:53.989428] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-03T17:36:53.990310] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-03T17:36:53.990386] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-03T17:36:53.992097] [DEBUG] [LOCAL ] BHP: Trimmed 77249 records to 54148 (keeping 200 days of data) [2025-10-03T17:36:54.335341] [DEBUG] [LOCAL ] BHP: Primary data saved (54148 records). [2025-10-03T17:36:54.335494] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-03T17:36:54.335585] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHP took 34.5s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-03T17:36:54.396015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-03T17:36:54.528608] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:54.578097] [DEBUG] [LOCAL ] BILL: Loaded 52726 existing records from primary storage. [2025-10-03T17:36:54.578688] [INFO ] [MAIN ] BILL: Loaded 52726 existing records. [2025-10-03T17:36:54.791966] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:54.803865] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-03T17:36:54.806933] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-03T17:36:54.807036] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-03T17:36:54.806816] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:36:54.812618] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-03T17:36:54.812722] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-03T17:36:55.206386] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-03T17:36:55.212831] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:55.990730] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-03T17:36:56.308278] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-03T17:36:56.403267] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:36:56.790727] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-03T17:36:57.136925] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T17:36:57.590685] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-03T17:36:57.950075] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T17:36:58.390723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-03T17:36:59.190698] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-03T17:36:59.960200] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:36:59.990715] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-03T17:37:00.298406] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T17:37:00.790712] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-03T17:37:01.590720] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-03T17:37:01.953853] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T17:37:01.973729] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-03T17:37:02.390620] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-03T17:37:02.567713] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T17:37:03.190715] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-03T17:37:03.990635] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-03T17:37:04.117026] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:37:04.215330] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:37:04.448453] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T17:37:04.790729] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-03T17:37:05.590733] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-03T17:37:05.934195] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T17:37:06.390744] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-03T17:37:06.536700] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:37:07.190702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-03T17:37:07.736622] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T17:37:07.990730] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-03T17:37:08.790697] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-03T17:37:08.885192] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:37:09.020915] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T17:37:09.022635] [INFO ] [REMOTE ] BHR: Full fetch complete (30914 records). [2025-10-03T17:37:09.022741] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-03T17:37:09.438453] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-03T17:37:09.438537] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-03T17:37:09.439045] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-03T17:37:09.439129] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-03T17:37:09.440063] [DEBUG] [LOCAL ] BHR: Trimmed 30914 records to 21779 (keeping 200 days of data) [2025-10-03T17:37:09.572224] [DEBUG] [LOCAL ] BHR: Primary data saved (21779 records). [2025-10-03T17:37:09.572353] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-03T17:37:09.572433] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHR took 27.3s. Estimated remaining: 4h 44m 51s. Rate: 7.4 symbols/min [2025-10-03T17:37:09.595723] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-03T17:37:09.759586] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:09.784809] [DEBUG] [LOCAL ] BIO: Loaded 25067 existing records from primary storage. [2025-10-03T17:37:09.785086] [INFO ] [MAIN ] BIO: Loaded 25067 existing records. [2025-10-03T17:37:09.979850] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:09.980102] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-03T17:37:09.980173] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-03T17:37:09.980417] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-03T17:37:09.980475] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-03T17:37:10.381799] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:10.390694] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-03T17:37:10.610249] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:37:11.001829] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:37:11.190621] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-03T17:37:11.505406] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T17:37:11.990672] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-03T17:37:12.790677] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-03T17:37:12.980939] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:37:13.590699] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-03T17:37:13.859799] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:37:13.928902] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T17:37:14.390739] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-03T17:37:14.852498] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T17:37:15.190693] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-03T17:37:15.335830] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:37:15.990684] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-03T17:37:16.511996] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:37:16.790717] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-03T17:37:17.217721] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:37:17.590740] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-03T17:37:17.700231] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:37:17.946148] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:37:17.946833] [INFO ] [REMOTE ] BHV: Full fetch complete (1365 records). [2025-10-03T17:37:17.946906] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-03T17:37:18.154624] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-03T17:37:18.154921] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:37:18.154998] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:37:18.155076] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-03T17:37:18.155147] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-03T17:37:18.155202] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-03T17:37:18.155268] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-03T17:37:18.155354] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHV took 31.1s. Estimated remaining: 4h 44m 46s. Rate: 7.4 symbols/min [2025-10-03T17:37:18.343075] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:18.395811] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-03T17:37:18.399571] [DEBUG] [LOCAL ] BIP: Loaded 39822 existing records from primary storage. [2025-10-03T17:37:18.400076] [INFO ] [MAIN ] BIP: Loaded 39822 existing records. [2025-10-03T17:37:18.601906] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:18.602143] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-03T17:37:18.602192] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-03T17:37:18.602427] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-03T17:37:18.602486] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-03T17:37:18.991809] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:19.190709] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-03T17:37:19.995816] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-03T17:37:20.013891] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:37:20.790718] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-03T17:37:21.008526] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T17:37:21.072581] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:37:21.590714] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-03T17:37:22.225600] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:37:22.390727] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-03T17:37:22.928366] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:37:23.190728] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-03T17:37:23.990698] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-03T17:37:24.050680] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:37:24.098102] [DEBUG] [REMOTE ] BIO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T17:37:24.098445] [WARN ] [REMOTE ] BIO: No data returned for month 2025-05 [2025-10-03T17:37:24.098565] [FATAL] [REMOTE ] BIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:37:24.098694] [FATAL] [MAIN ] BIO: Failed to fetch primary data. [2025-10-03T17:37:24.098767] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:37:24.098838] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-03T17:37:24.098906] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-03T17:37:24.098946] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-03T17:37:24.099273] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-03T17:37:24.099361] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BIO took 14.5s. Estimated remaining: 4h 44m 21s. Rate: 7.4 symbols/min [2025-10-03T17:37:24.293983] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:24.337831] [DEBUG] [LOCAL ] BIPC: Loaded 41695 existing records from primary storage. [2025-10-03T17:37:24.338218] [INFO ] [MAIN ] BIPC: Loaded 41695 existing records. [2025-10-03T17:37:24.553442] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:24.553703] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-03T17:37:24.553764] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-03T17:37:24.554198] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-03T17:37:24.554264] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-03T17:37:24.797551] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-03T17:37:24.970684] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:25.075163] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:37:25.590716] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-03T17:37:26.178496] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:37:26.390722] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-03T17:37:27.190703] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-03T17:37:27.387164] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:37:27.805903] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:37:27.990681] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-03T17:37:28.611217] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T17:37:28.790687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-03T17:37:29.590688] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-03T17:37:29.632556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:37:29.635481] [INFO ] [REMOTE ] BILL: Full fetch complete (75741 records). [2025-10-03T17:37:29.635585] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-03T17:37:30.077234] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-03T17:37:30.077319] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-03T17:37:30.078231] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-03T17:37:30.078301] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-03T17:37:30.080009] [DEBUG] [LOCAL ] BILL: Trimmed 75741 records to 53112 (keeping 200 days of data) [2025-10-03T17:37:30.391351] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-03T17:37:30.413951] [DEBUG] [LOCAL ] BILL: Primary data saved (53112 records). [2025-10-03T17:37:30.414096] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-03T17:37:30.414181] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BILL took 36.1s. Estimated remaining: 4h 43m 59s. Rate: 7.4 symbols/min [2025-10-03T17:37:30.605257] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:30.605550] [DEBUG] [LOCAL ] BIPH: No existing data file found in primary storage. [2025-10-03T17:37:30.605624] [WARN ] [MAIN ] BIPH: No existing data found, performing full refresh instead. [2025-10-03T17:37:30.605883] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-03T17:37:30.605956] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-03T17:37:30.606068] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-10-03T17:37:30.606186] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-03T17:37:30.872578] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T17:37:31.052874] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:31.082380] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:37:31.190690] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-03T17:37:31.858915] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:37:31.979233] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:37:31.990599] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-03T17:37:32.790696] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-03T17:37:33.447812] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:37:33.590723] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-03T17:37:34.390715] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-03T17:37:34.483717] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:37:34.486463] [INFO ] [REMOTE ] BHVN: Full fetch complete (70033 records). [2025-10-03T17:37:34.486705] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-03T17:37:34.836687] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:37:34.941147] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-03T17:37:34.941247] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-03T17:37:34.942125] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-03T17:37:34.942201] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-03T17:37:34.943919] [DEBUG] [LOCAL ] BHVN: Trimmed 70033 records to 50537 (keeping 200 days of data) [2025-10-03T17:37:35.215669] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-03T17:37:35.256572] [DEBUG] [LOCAL ] BHVN: Primary data saved (50537 records). [2025-10-03T17:37:35.256790] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-03T17:37:35.258048] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BHVN took 46.6s. Estimated remaining: 4h 43m 26s. Rate: 7.4 symbols/min [2025-10-03T17:37:35.284597] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:37:35.990714] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-03T17:37:36.557199] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:37:36.790737] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-03T17:37:37.288336] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T17:37:37.590682] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-03T17:37:38.096388] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:37:38.390694] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-03T17:37:38.821706] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:37:39.063839] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T17:37:39.190698] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-03T17:37:39.742240] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T17:37:39.990749] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-03T17:37:40.541342] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:37:40.790733] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-03T17:37:41.590735] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-03T17:37:42.112863] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T17:37:42.333935] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:37:42.390747] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-03T17:37:43.190690] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-03T17:37:43.622248] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T17:37:43.811603] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:37:43.990728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-03T17:37:44.790698] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-03T17:37:45.379725] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T17:37:45.590758] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-03T17:37:46.037235] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T17:37:46.236612] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:37:46.390740] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-03T17:37:46.844308] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T17:37:47.190749] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-03T17:37:47.990761] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-03T17:37:48.661458] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:37:48.790733] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-03T17:37:49.564820] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:37:49.590613] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-03T17:37:50.390753] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-03T17:37:50.422799] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:37:50.889986] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:37:50.970531] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:37:51.190687] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-03T17:37:51.553833] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:37:51.554777] [INFO ] [REMOTE ] BIPH: Full fetch complete (4289 records). [2025-10-03T17:37:51.554851] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-03T17:37:51.939508] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-03T17:37:51.939634] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-03T17:37:51.940033] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-03T17:37:51.940104] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-03T17:37:51.940745] [DEBUG] [LOCAL ] BIPH: Trimmed 4289 records to 2595 (keeping 200 days of data) [2025-10-03T17:37:51.961224] [DEBUG] [LOCAL ] BIPH: Primary data saved (2595 records). [2025-10-03T17:37:51.961338] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-03T17:37:51.961436] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIPH took 21.5s. Estimated remaining: 4h 44m 23s. Rate: 7.4 symbols/min [2025-10-03T17:37:51.990703] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-03T17:37:52.790751] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-03T17:37:53.460524] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T17:37:53.590626] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-03T17:37:53.997839] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T17:37:54.000329] [INFO ] [REMOTE ] BIP: Full fetch complete (56949 records). [2025-10-03T17:37:54.000443] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-03T17:37:54.428624] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-03T17:37:54.428762] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-03T17:37:54.429451] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-03T17:37:54.429501] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-03T17:37:54.431005] [DEBUG] [LOCAL ] BIP: Trimmed 56949 records to 40146 (keeping 200 days of data) [2025-10-03T17:37:54.687177] [DEBUG] [LOCAL ] BIP: Primary data saved (40146 records). [2025-10-03T17:37:54.687344] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-03T17:37:54.687451] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BIP took 36.5s. Estimated remaining: 4h 43m 34s. Rate: 7.4 symbols/min [2025-10-03T17:37:54.820782] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:37:54.824530] [INFO ] [REMOTE ] BIPC: Full fetch complete (59910 records). [2025-10-03T17:37:54.824907] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-03T17:37:55.234288] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-03T17:37:55.234398] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-03T17:37:55.235265] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-03T17:37:55.235337] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-03T17:37:55.237059] [DEBUG] [LOCAL ] BIPC: Trimmed 59910 records to 41980 (keeping 200 days of data) [2025-10-03T17:37:55.513752] [DEBUG] [LOCAL ] BIPC: Primary data saved (41980 records). [2025-10-03T17:37:55.513997] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-03T17:37:55.515004] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 31.4s. Estimated remaining: 4h 42m 31s. Rate: 7.4 symbols/min [2025-10-03T17:37:56.227108] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.244162] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.330509] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.339792] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.346234] [DEBUG] [LOCAL ] BIPI: Loaded 3215 existing records from primary storage. [2025-10-03T17:37:56.346707] [INFO ] [MAIN ] BIPI: Loaded 3215 existing records. [2025-10-03T17:37:56.399800] [DEBUG] [LOCAL ] BIPJ: Loaded 3136 existing records from primary storage. [2025-10-03T17:37:56.453099] [INFO ] [MAIN ] BIPJ: Loaded 3136 existing records. [2025-10-03T17:37:56.565229] [DEBUG] [LOCAL ] BIT: Loaded 23002 existing records from primary storage. [2025-10-03T17:37:56.621802] [INFO ] [MAIN ] BIT: Loaded 23002 existing records. [2025-10-03T17:37:56.802045] [DEBUG] [LOCAL ] BIRK: Loaded 51310 existing records from primary storage. [2025-10-03T17:37:56.871637] [INFO ] [MAIN ] BIRK: Loaded 51310 existing records. [2025-10-03T17:37:56.910182] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:56.906141] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:56.976266] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-03T17:37:56.987154] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-03T17:37:56.981861] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.042997] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-03T17:37:57.048289] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-03T17:37:57.056715] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-03T17:37:57.066104] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-03T17:37:57.162581] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-03T17:37:57.384344] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:57.397145] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:57.423442] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.472076] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.533143] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-03T17:37:57.575778] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-03T17:37:57.586439] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-03T17:37:57.624257] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-03T17:37:57.639354] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-03T17:37:57.681758] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-03T17:37:58.132217] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.219498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-03T17:37:58.693547] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.711581] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-03T17:37:58.864625] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.886192] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-03T17:37:58.885897] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.887373] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-03T17:37:59.025283] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:37:59.027616] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-03T17:37:59.521063] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T17:37:59.522766] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-03T17:37:59.532919] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:37:59.536665] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-03T17:37:59.760037] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:37:59.965139] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T17:37:59.990678] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-03T17:38:00.152219] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:38:00.253437] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:38:00.330544] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T17:38:00.790807] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-03T17:38:01.254977] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T17:38:01.590729] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-03T17:38:02.390790] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-03T17:38:02.862852] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:38:03.120583] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:38:03.190690] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-03T17:38:03.741665] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:38:03.990712] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-03T17:38:04.533203] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T17:38:04.790726] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-03T17:38:05.235014] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T17:38:05.590721] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-03T17:38:06.239846] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:38:06.390714] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-03T17:38:07.190717] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-03T17:38:07.311783] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:38:07.476610] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-03T17:38:07.990787] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-03T17:38:08.790745] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-03T17:38:08.957490] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:38:09.436742] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:38:09.590795] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-03T17:38:10.390779] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-03T17:38:11.121738] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:38:11.170139] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:38:11.190630] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-03T17:38:11.735362] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:38:11.990722] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-03T17:38:12.790709] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-03T17:38:13.140638] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:38:13.287765] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T17:38:13.288723] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4412 records). [2025-10-03T17:38:13.288796] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-03T17:38:13.596163] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-03T17:38:13.688370] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-03T17:38:13.688480] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-03T17:38:13.688693] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-03T17:38:13.688757] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-03T17:38:13.689144] [DEBUG] [LOCAL ] BIPJ: Trimmed 4412 records to 3148 (keeping 200 days of data) [2025-10-03T17:38:13.709879] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3148 records). [2025-10-03T17:38:13.709990] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-03T17:38:13.710080] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 38s. Rate: 7.4 symbols/min [2025-10-03T17:38:13.895323] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:13.950866] [DEBUG] [LOCAL ] BJ: Loaded 51762 existing records from primary storage. [2025-10-03T17:38:13.951238] [INFO ] [MAIN ] BJ: Loaded 51762 existing records. [2025-10-03T17:38:14.137898] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:14.138273] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-03T17:38:14.138329] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-03T17:38:14.138617] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-03T17:38:14.138716] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-03T17:38:14.399309] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-03T17:38:14.567422] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:15.190746] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-03T17:38:15.282963] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:38:15.344057] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:38:15.990738] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-03T17:38:16.563688] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:38:16.790711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-03T17:38:17.437635] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T17:38:17.590737] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-03T17:38:18.157785] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T17:38:18.345596] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:38:18.390707] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-03T17:38:18.908114] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T17:38:19.190721] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-03T17:38:19.766203] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:38:19.990733] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-03T17:38:20.790758] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-03T17:38:21.590728] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-03T17:38:21.801144] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:38:21.841773] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:38:22.390696] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-03T17:38:23.190689] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-03T17:38:23.263204] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:38:23.929842] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:38:23.990689] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-03T17:38:24.201042] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:38:24.790725] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-03T17:38:25.590630] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-03T17:38:25.834574] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:38:25.921460] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:38:26.390695] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-03T17:38:27.003982] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:38:27.190690] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-03T17:38:27.701873] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T17:38:27.990685] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-03T17:38:28.790678] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-03T17:38:29.072522] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:38:29.590708] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-03T17:38:29.819887] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:38:30.220788] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:38:30.390782] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-03T17:38:31.190692] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-03T17:38:31.376872] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:38:31.519529] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:38:31.521513] [INFO ] [REMOTE ] BIT: Full fetch complete (31878 records). [2025-10-03T17:38:31.521718] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-03T17:38:31.950419] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-03T17:38:31.950523] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-03T17:38:31.951174] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-03T17:38:31.951243] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-03T17:38:31.952331] [DEBUG] [LOCAL ] BIT: Trimmed 31878 records to 23266 (keeping 200 days of data) [2025-10-03T17:38:32.012748] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-03T17:38:32.108505] [DEBUG] [LOCAL ] BIT: Primary data saved (23266 records). [2025-10-03T17:38:32.108671] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-03T17:38:32.108811] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIT took 36.6s. Estimated remaining: 4h 44m 46s. Rate: 7.3 symbols/min [2025-10-03T17:38:32.300314] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:32.359371] [DEBUG] [LOCAL ] BK: Loaded 53927 existing records from primary storage. [2025-10-03T17:38:32.359839] [INFO ] [MAIN ] BK: Loaded 53927 existing records. [2025-10-03T17:38:32.559367] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:32.559631] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-03T17:38:32.559725] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-03T17:38:32.560240] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-03T17:38:32.560300] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-03T17:38:32.794769] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-03T17:38:32.966138] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:33.001954] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:38:33.343732] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T17:38:33.344469] [INFO ] [REMOTE ] BIPI: Full fetch complete (5099 records). [2025-10-03T17:38:33.344552] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-03T17:38:33.600547] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-03T17:38:33.766819] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-03T17:38:33.767041] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-03T17:38:33.767238] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-03T17:38:33.767414] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-03T17:38:33.768028] [DEBUG] [LOCAL ] BIPI: Trimmed 5099 records to 3229 (keeping 200 days of data) [2025-10-03T17:38:33.791129] [DEBUG] [LOCAL ] BIPI: Primary data saved (3229 records). [2025-10-03T17:38:33.791441] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-03T17:38:33.791544] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIPI took 38.3s. Estimated remaining: 4h 43m 50s. Rate: 7.4 symbols/min [2025-10-03T17:38:33.966576] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T17:38:34.053840] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:34.114257] [DEBUG] [LOCAL ] BKD: Loaded 50577 existing records from primary storage. [2025-10-03T17:38:34.114691] [INFO ] [MAIN ] BKD: Loaded 50577 existing records. [2025-10-03T17:38:34.310704] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:34.310957] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-03T17:38:34.311009] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-03T17:38:34.311388] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-03T17:38:34.311449] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-03T17:38:34.397468] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-03T17:38:34.743265] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:35.190695] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-03T17:38:35.534900] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:38:35.990742] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-03T17:38:36.427774] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-03T17:38:36.434417] [INFO ] [REMOTE ] BIRK: Full fetch complete (73086 records). [2025-10-03T17:38:36.434560] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-03T17:38:36.801738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-03T17:38:36.858623] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-03T17:38:36.858906] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-03T17:38:36.859819] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-03T17:38:36.859987] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-03T17:38:36.871912] [DEBUG] [LOCAL ] BIRK: Trimmed 73086 records to 51678 (keeping 200 days of data) [2025-10-03T17:38:36.890352] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T17:38:37.212586] [DEBUG] [LOCAL ] BIRK: Primary data saved (51678 records). [2025-10-03T17:38:37.212765] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-03T17:38:37.212873] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 41.7s. Estimated remaining: 4h 43m 7s. Rate: 7.4 symbols/min [2025-10-03T17:38:37.405233] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:37.438951] [DEBUG] [LOCAL ] BKE: Loaded 34657 existing records from primary storage. [2025-10-03T17:38:37.439245] [INFO ] [MAIN ] BKE: Loaded 34657 existing records. [2025-10-03T17:38:37.596929] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-03T17:38:37.629615] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:37.629852] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-03T17:38:37.629901] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-03T17:38:37.630292] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-03T17:38:37.630352] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-03T17:38:38.014445] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:38.050892] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T17:38:38.150992] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:38:38.390715] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-03T17:38:39.079808] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:38:39.190694] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-03T17:38:39.990685] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-03T17:38:40.066875] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:38:40.274007] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:38:40.790718] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-03T17:38:41.590716] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-03T17:38:41.626909] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:38:42.390714] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-03T17:38:42.536175] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:38:43.067810] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:38:43.190686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-03T17:38:43.978109] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:38:43.990619] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-03T17:38:44.546893] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T17:38:44.790678] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-03T17:38:45.237735] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T17:38:45.590687] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-03T17:38:46.390702] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-03T17:38:46.461639] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:38:47.190636] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-03T17:38:47.526591] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T17:38:47.973023] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T17:38:47.990702] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-03T17:38:48.561845] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:38:48.790728] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-03T17:38:49.590692] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-03T17:38:49.685114] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:38:50.256375] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:38:50.261609] [INFO ] [REMOTE ] BJ: Full fetch complete (73916 records). [2025-10-03T17:38:50.261840] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-03T17:38:50.395852] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-03T17:38:50.715120] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-03T17:38:50.715252] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-03T17:38:50.716043] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-03T17:38:50.716112] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-03T17:38:50.717874] [DEBUG] [LOCAL ] BJ: Trimmed 73916 records to 52136 (keeping 200 days of data) [2025-10-03T17:38:51.050489] [DEBUG] [LOCAL ] BJ: Primary data saved (52136 records). [2025-10-03T17:38:51.050723] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-03T17:38:51.050829] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BJ took 37.3s. Estimated remaining: 4h 43m 40s. Rate: 7.4 symbols/min [2025-10-03T17:38:51.195285] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-03T17:38:51.249452] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:51.294398] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:38:51.315364] [DEBUG] [LOCAL ] BKH: Loaded 36907 existing records from primary storage. [2025-10-03T17:38:51.315717] [INFO ] [MAIN ] BKH: Loaded 36907 existing records. [2025-10-03T17:38:51.504573] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:51.504833] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-03T17:38:51.504886] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-03T17:38:51.505340] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-03T17:38:51.505399] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-03T17:38:51.897759] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:51.929675] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:38:51.990700] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-03T17:38:52.790723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-03T17:38:52.838089] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:38:53.529818] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:38:53.590689] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-03T17:38:54.063504] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:38:54.390727] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-03T17:38:55.149001] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:38:55.190706] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-03T17:38:55.671829] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:38:55.990680] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-03T17:38:56.415727] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:38:56.790754] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-03T17:38:57.356179] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:38:57.590716] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-03T17:38:58.393320] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-03T17:38:58.396628] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:38:58.574456] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:38:59.190750] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-03T17:38:59.919628] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:38:59.990632] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-03T17:39:00.790736] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-03T17:39:01.398739] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T17:39:01.590689] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-03T17:39:01.723711] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:39:02.204088] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:39:02.390728] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-03T17:39:03.190726] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-03T17:39:03.394008] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:39:03.990672] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-03T17:39:04.065331] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:39:04.410393] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T17:39:04.790712] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-03T17:39:05.568335] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:39:05.590691] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-03T17:39:06.258339] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:39:06.390721] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-03T17:39:06.739360] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T17:39:06.743714] [INFO ] [REMOTE ] BK: Full fetch complete (77479 records). [2025-10-03T17:39:06.743942] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-03T17:39:07.195874] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-03T17:39:07.437585] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-03T17:39:07.437789] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-03T17:39:07.439426] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-03T17:39:07.439582] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-03T17:39:07.458468] [DEBUG] [LOCAL ] BK: Trimmed 77479 records to 54317 (keeping 200 days of data) [2025-10-03T17:39:07.485144] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:39:07.951953] [DEBUG] [LOCAL ] BK: Primary data saved (54317 records). [2025-10-03T17:39:07.952120] [INFO ] [MAIN ] BK: Full history saved. [2025-10-03T17:39:07.952848] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BK took 35.8s. Estimated remaining: 4h 44m 36s. Rate: 7.3 symbols/min [2025-10-03T17:39:07.995895] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-03T17:39:08.183036] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:08.226031] [DEBUG] [LOCAL ] BKKT: Loaded 35643 existing records from primary storage. [2025-10-03T17:39:08.226362] [INFO ] [MAIN ] BKKT: Loaded 35643 existing records. [2025-10-03T17:39:08.427499] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:08.427799] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-03T17:39:08.427852] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-03T17:39:08.428185] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-03T17:39:08.428256] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-03T17:39:08.796087] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-03T17:39:08.835157] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:08.856237] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:39:09.218914] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T17:39:09.221164] [INFO ] [REMOTE ] BKE: Full fetch complete (50229 records). [2025-10-03T17:39:09.221276] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-03T17:39:09.596447] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-03T17:39:09.653008] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-03T17:39:09.653154] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-03T17:39:09.653818] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-03T17:39:09.653893] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-03T17:39:09.655108] [DEBUG] [LOCAL ] BKE: Trimmed 50229 records to 34858 (keeping 200 days of data) [2025-10-03T17:39:09.873243] [DEBUG] [LOCAL ] BKE: Primary data saved (34858 records). [2025-10-03T17:39:09.873409] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-03T17:39:09.873517] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 32.7s. Estimated remaining: 4h 43m 42s. Rate: 7.3 symbols/min [2025-10-03T17:39:10.070677] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:10.081320] [DEBUG] [LOCAL ] BKN: Loaded 7808 existing records from primary storage. [2025-10-03T17:39:10.081593] [INFO ] [MAIN ] BKN: Loaded 7808 existing records. [2025-10-03T17:39:10.278540] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:10.278804] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-03T17:39:10.278865] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-03T17:39:10.279127] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-03T17:39:10.279188] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-03T17:39:10.402315] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-03T17:39:10.603538] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T17:39:10.618977] [INFO ] [REMOTE ] BKD: Full fetch complete (71734 records). [2025-10-03T17:39:10.629731] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-03T17:39:10.780947] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:11.152519] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-03T17:39:11.152706] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-03T17:39:11.153810] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-03T17:39:11.153921] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-03T17:39:11.155637] [DEBUG] [LOCAL ] BKD: Trimmed 71734 records to 50962 (keeping 200 days of data) [2025-10-03T17:39:11.201817] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-03T17:39:11.265131] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:39:11.503913] [DEBUG] [LOCAL ] BKD: Primary data saved (50962 records). [2025-10-03T17:39:11.504062] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-03T17:39:11.504201] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BKD took 37.7s. Estimated remaining: 4h 42m 47s. Rate: 7.4 symbols/min [2025-10-03T17:39:11.690144] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:11.690338] [DEBUG] [LOCAL ] BKSY: No existing data file found in primary storage. [2025-10-03T17:39:11.690384] [WARN ] [MAIN ] BKSY: No existing data found, performing full refresh instead. [2025-10-03T17:39:11.690504] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-03T17:39:11.690548] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-03T17:39:11.690593] [DEBUG] [LOCAL ] BKSY: No primary data file found to delete. [2025-10-03T17:39:11.690627] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-03T17:39:11.999066] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-03T17:39:12.098889] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:12.284436] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:39:12.333590] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:39:12.790717] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-03T17:39:13.416747] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T17:39:13.590709] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-03T17:39:14.058836] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:39:14.390691] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-03T17:39:15.190732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-03T17:39:15.408771] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:39:15.599897] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:39:15.994763] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-03T17:39:15.995897] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:39:16.790689] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-03T17:39:17.174751] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:39:17.406452] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T17:39:17.590695] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-03T17:39:18.390715] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-03T17:39:18.928993] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:39:19.190697] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-03T17:39:19.990718] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-03T17:39:20.133571] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T17:39:20.790716] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-03T17:39:20.855919] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:39:21.397104] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T17:39:21.399688] [INFO ] [REMOTE ] BKH: Full fetch complete (52456 records). [2025-10-03T17:39:21.399798] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-03T17:39:21.595310] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-03T17:39:21.820940] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-03T17:39:21.821217] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-03T17:39:21.821875] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-03T17:39:21.821943] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-03T17:39:21.823219] [DEBUG] [LOCAL ] BKH: Trimmed 52456 records to 37195 (keeping 200 days of data) [2025-10-03T17:39:22.061832] [DEBUG] [LOCAL ] BKH: Primary data saved (37195 records). [2025-10-03T17:39:22.062614] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-03T17:39:22.062907] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKH took 31.0s. Estimated remaining: 4h 42m 56s. Rate: 7.4 symbols/min [2025-10-03T17:39:22.254774] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:22.268847] [DEBUG] [LOCAL ] BKT: Loaded 11524 existing records from primary storage. [2025-10-03T17:39:22.269100] [INFO ] [MAIN ] BKT: Loaded 11524 existing records. [2025-10-03T17:39:22.395747] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-03T17:39:22.471196] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:22.471545] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-03T17:39:22.471680] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-03T17:39:22.472259] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-03T17:39:22.472325] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-03T17:39:22.612813] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:39:22.883721] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:22.910840] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T17:39:23.190685] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-03T17:39:23.694732] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T17:39:23.950891] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:39:23.990611] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-03T17:39:24.768551] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:39:24.790614] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-03T17:39:25.292248] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T17:39:25.590687] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-03T17:39:25.694044] [DEBUG] [REMOTE ] BKKT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T17:39:25.694375] [WARN ] [REMOTE ] BKKT: No data returned for month 2025-05 [2025-10-03T17:39:25.694485] [FATAL] [REMOTE ] BKKT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:39:25.694588] [FATAL] [MAIN ] BKKT: Failed to fetch primary data. [2025-10-03T17:39:25.694679] [WARN ] [MAIN ] BKKT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:39:25.694760] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-03T17:39:25.694839] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-03T17:39:25.694914] [INFO ] [LOCAL ] BKKT: Starting deletion of derivative data. [2025-10-03T17:39:25.695286] [DEBUG] [LOCAL ] BKKT: Deleted derivative data file. [2025-10-03T17:39:25.697104] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKKT took 17.7s. Estimated remaining: 4h 42m 15s. Rate: 7.4 symbols/min [2025-10-03T17:39:25.891056] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:25.933813] [DEBUG] [LOCAL ] BKU: Loaded 41707 existing records from primary storage. [2025-10-03T17:39:25.934177] [INFO ] [MAIN ] BKU: Loaded 41707 existing records. [2025-10-03T17:39:26.133197] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:26.133408] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-03T17:39:26.133459] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-03T17:39:26.133981] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-03T17:39:26.134043] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-03T17:39:26.395775] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-03T17:39:26.571926] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:27.190684] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-03T17:39:27.211932] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:39:27.990636] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-03T17:39:28.108547] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T17:39:28.790700] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-03T17:39:29.388707] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:39:29.590700] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-03T17:39:29.697678] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:39:30.260283] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T17:39:30.390685] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-03T17:39:31.190690] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-03T17:39:31.941026] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T17:39:31.992896] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-03T17:39:31.998096] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T17:39:32.716515] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T17:39:32.790713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-03T17:39:33.590674] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-03T17:39:33.703366] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:39:34.390723] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-03T17:39:34.426158] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T17:39:35.190713] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-03T17:39:35.746673] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T17:39:35.990713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-03T17:39:36.354920] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:39:36.522335] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:39:36.523348] [INFO ] [REMOTE ] BKN: Full fetch complete (11870 records). [2025-10-03T17:39:36.523423] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-03T17:39:36.796923] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-03T17:39:36.936727] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-03T17:39:36.936816] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-03T17:39:36.937091] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-03T17:39:36.937153] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-03T17:39:36.937679] [DEBUG] [LOCAL ] BKN: Trimmed 11870 records to 7844 (keeping 200 days of data) [2025-10-03T17:39:36.989334] [DEBUG] [LOCAL ] BKN: Primary data saved (7844 records). [2025-10-03T17:39:36.989473] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-03T17:39:36.989580] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKN took 27.1s. Estimated remaining: 4h 42m 30s. Rate: 7.4 symbols/min [2025-10-03T17:39:37.166397] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:37.166608] [DEBUG] [LOCAL ] BKV: No existing data file found in primary storage. [2025-10-03T17:39:37.166684] [WARN ] [MAIN ] BKV: No existing data found, performing full refresh instead. [2025-10-03T17:39:37.166805] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-03T17:39:37.166849] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-03T17:39:37.166893] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-03T17:39:37.166927] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-03T17:39:37.550820] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:37.590612] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-03T17:39:38.358581] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:39:38.390684] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-03T17:39:38.596966] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:39:39.190721] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-03T17:39:39.956331] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:39:39.990680] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-03T17:39:40.459118] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:39:40.790728] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-03T17:39:40.982362] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T17:39:41.590718] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-03T17:39:41.714772] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:39:42.390719] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-03T17:39:43.037130] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:39:43.190734] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-03T17:39:43.990628] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-03T17:39:44.264064] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:39:44.418591] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:39:44.790666] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-03T17:39:44.811604] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:39:45.590680] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-03T17:39:46.016207] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T17:39:46.390682] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-03T17:39:46.960494] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:39:47.190690] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-03T17:39:47.223456] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T17:39:47.990733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-03T17:39:48.790738] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-03T17:39:49.506416] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:39:49.539905] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:39:49.571048] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T17:39:49.590628] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-03T17:39:50.390717] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-03T17:39:51.094317] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:39:51.190730] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-03T17:39:51.863625] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:39:51.990729] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-03T17:39:52.692074] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:39:52.790728] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-03T17:39:53.098383] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:39:53.590726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-03T17:39:54.046708] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:39:54.390744] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-03T17:39:54.802231] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T17:39:55.190735] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-03T17:39:55.322384] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T17:39:55.990635] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-03T17:39:56.414359] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:39:56.790717] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-03T17:39:57.091911] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T17:39:57.094938] [INFO ] [REMOTE ] BKU: Full fetch complete (59887 records). [2025-10-03T17:39:57.095102] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-03T17:39:57.539777] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-03T17:39:57.539879] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-03T17:39:57.540617] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-03T17:39:57.540722] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-03T17:39:57.542157] [DEBUG] [LOCAL ] BKU: Trimmed 59887 records to 42022 (keeping 200 days of data) [2025-10-03T17:39:57.605329] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-03T17:39:57.815592] [DEBUG] [LOCAL ] BKU: Primary data saved (42022 records). [2025-10-03T17:39:57.815780] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-03T17:39:57.816482] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKU took 32.1s. Estimated remaining: 4h 43m 52s. Rate: 7.3 symbols/min [2025-10-03T17:39:57.994849] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:39:58.027983] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:58.067751] [DEBUG] [LOCAL ] BLCO: Loaded 35657 existing records from primary storage. [2025-10-03T17:39:58.068078] [INFO ] [MAIN ] BLCO: Loaded 35657 existing records. [2025-10-03T17:39:58.260550] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:58.260885] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-03T17:39:58.260951] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-03T17:39:58.261233] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-03T17:39:58.261297] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-03T17:39:58.395860] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-03T17:39:58.661679] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:59.190737] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-03T17:39:59.446993] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:39:59.448528] [INFO ] [REMOTE ] BKT: Full fetch complete (15574 records). [2025-10-03T17:39:59.448631] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-03T17:39:59.971255] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-03T17:39:59.971471] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-03T17:39:59.972132] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-03T17:39:59.972411] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-03T17:39:59.995622] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-03T17:39:59.996272] [DEBUG] [LOCAL ] BKT: Trimmed 15574 records to 11681 (keeping 200 days of data) [2025-10-03T17:40:00.023413] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-03T17:40:00.148926] [DEBUG] [LOCAL ] BKT: Primary data saved (11681 records). [2025-10-03T17:40:00.149116] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-03T17:40:00.149244] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 38.1s. Estimated remaining: 4h 43m 2s. Rate: 7.3 symbols/min [2025-10-03T17:40:00.461555] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:00.461891] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-03T17:40:00.461986] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-03T17:40:00.462505] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-03T17:40:00.462626] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-03T17:40:00.462777] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-03T17:40:00.462856] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-03T17:40:00.795747] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-03T17:40:00.834984] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T17:40:00.926661] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:01.451472] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:40:01.590666] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-03T17:40:02.390748] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-03T17:40:02.844320] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:40:02.845933] [INFO ] [REMOTE ] BKV: Full fetch complete (44692 records). [2025-10-03T17:40:02.846044] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-03T17:40:02.846811] [FATAL] [VALIDATOR ] BKV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:40:02.846932] [FATAL] [MAIN ] BKV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:40:02.847008] [WARN ] [MAIN ] BKV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:40:02.847089] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-03T17:40:02.847166] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-03T17:40:02.847211] [INFO ] [LOCAL ] BKV: Starting deletion of derivative data. [2025-10-03T17:40:02.847298] [DEBUG] [LOCAL ] BKV: No derivative data file found to delete. [2025-10-03T17:40:02.847384] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKV took 25.9s. Estimated remaining: 4h 42m 15s. Rate: 7.4 symbols/min [2025-10-03T17:40:03.039999] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:03.073494] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T17:40:03.144090] [DEBUG] [LOCAL ] BLDR: Loaded 52007 existing records from primary storage. [2025-10-03T17:40:03.144476] [INFO ] [MAIN ] BLDR: Loaded 52007 existing records. [2025-10-03T17:40:03.195925] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-03T17:40:03.367743] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:03.367991] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-03T17:40:03.368044] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-03T17:40:03.368730] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-03T17:40:03.368802] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-03T17:40:03.790102] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:03.849041] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:40:03.990715] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-03T17:40:04.790688] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-03T17:40:05.057980] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:40:05.061882] [INFO ] [REMOTE ] BKSY: Full fetch complete (69761 records). [2025-10-03T17:40:05.062060] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-03T17:40:05.551370] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-03T17:40:05.551527] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-03T17:40:05.552899] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-03T17:40:05.553136] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-03T17:40:05.555489] [DEBUG] [LOCAL ] BKSY: Trimmed 69761 records to 48985 (keeping 200 days of data) [2025-10-03T17:40:05.636380] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-03T17:40:05.649743] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:40:05.903068] [DEBUG] [LOCAL ] BKSY: Primary data saved (48985 records). [2025-10-03T17:40:05.903228] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-03T17:40:05.903309] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BKSY took 54.4s. Estimated remaining: 4h 41m 31s. Rate: 7.4 symbols/min [2025-10-03T17:40:06.096525] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:06.112376] [DEBUG] [LOCAL ] BLE: Loaded 14402 existing records from primary storage. [2025-10-03T17:40:06.112622] [INFO ] [MAIN ] BLE: Loaded 14402 existing records. [2025-10-03T17:40:06.326600] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:06.328288] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:40:06.328485] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-03T17:40:06.335108] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-03T17:40:06.335385] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-03T17:40:06.335445] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-03T17:40:06.397451] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-03T17:40:06.743478] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:07.098508] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T17:40:07.190723] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-03T17:40:07.990714] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-03T17:40:08.409726] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:40:08.457038] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T17:40:08.790695] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-03T17:40:09.366048] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T17:40:09.515621] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:40:09.590735] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-03T17:40:10.390706] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-03T17:40:11.195757] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-03T17:40:11.222092] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:40:11.617067] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T17:40:11.990636] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-03T17:40:12.048077] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:40:12.790720] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-03T17:40:13.523932] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:40:13.590678] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-03T17:40:13.805755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:40:14.390712] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-03T17:40:14.762635] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T17:40:15.190725] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-03T17:40:15.547519] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T17:40:15.990693] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-03T17:40:16.557055] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T17:40:16.790697] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-03T17:40:17.388897] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:40:17.590712] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-03T17:40:18.396623] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-03T17:40:18.402758] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T17:40:18.498230] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:40:19.190726] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-03T17:40:19.808431] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T17:40:19.990639] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-03T17:40:20.197468] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:40:20.790728] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-03T17:40:21.365381] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:40:21.584974] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:40:21.590616] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-03T17:40:22.137521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T17:40:22.390729] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-03T17:40:23.190700] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-03T17:40:23.990705] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-03T17:40:24.145117] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:40:24.559416] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:40:24.790697] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-03T17:40:25.436587] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:40:25.468624] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:40:25.590718] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-03T17:40:26.390686] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-03T17:40:27.068751] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:40:27.190699] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-03T17:40:27.276495] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T17:40:27.278600] [INFO ] [REMOTE ] BLCO: Full fetch complete (52497 records). [2025-10-03T17:40:27.278732] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-03T17:40:27.721965] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-03T17:40:27.722134] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-03T17:40:27.722767] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-03T17:40:27.722833] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-03T17:40:27.724071] [DEBUG] [LOCAL ] BLCO: Trimmed 52497 records to 35851 (keeping 200 days of data) [2025-10-03T17:40:27.944851] [DEBUG] [LOCAL ] BLCO: Primary data saved (35851 records). [2025-10-03T17:40:27.945020] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-03T17:40:27.945542] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BLCO took 30.1s. Estimated remaining: 4h 43m 0s. Rate: 7.3 symbols/min [2025-10-03T17:40:27.995816] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-03T17:40:28.134353] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:28.175754] [DEBUG] [LOCAL ] BLK: Loaded 34684 existing records from primary storage. [2025-10-03T17:40:28.176067] [INFO ] [MAIN ] BLK: Loaded 34684 existing records. [2025-10-03T17:40:28.378498] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:28.378927] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-03T17:40:28.379003] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-03T17:40:28.385256] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-03T17:40:28.395321] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-03T17:40:28.402190] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:40:28.797737] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-03T17:40:28.826727] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:28.924077] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:40:28.925360] [INFO ] [REMOTE ] BLE: Full fetch complete (20271 records). [2025-10-03T17:40:28.925442] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-03T17:40:29.330867] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-03T17:40:29.330967] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-03T17:40:29.331396] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-03T17:40:29.331458] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-03T17:40:29.332220] [DEBUG] [LOCAL ] BLE: Trimmed 20271 records to 14475 (keeping 200 days of data) [2025-10-03T17:40:29.424394] [DEBUG] [LOCAL ] BLE: Primary data saved (14475 records). [2025-10-03T17:40:29.424585] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-03T17:40:29.424706] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLE took 23.5s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-10-03T17:40:29.602083] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-03T17:40:29.621638] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:29.674462] [DEBUG] [LOCAL ] BLND: Loaded 49624 existing records from primary storage. [2025-10-03T17:40:29.674879] [INFO ] [MAIN ] BLND: Loaded 49624 existing records. [2025-10-03T17:40:29.867693] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:29.867953] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-03T17:40:29.868009] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-03T17:40:29.868613] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-03T17:40:29.868718] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-03T17:40:30.264674] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:30.284977] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T17:40:30.390720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-03T17:40:31.038770] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:40:31.190715] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-03T17:40:31.990711] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-03T17:40:32.277116] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T17:40:32.501183] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T17:40:32.790724] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-03T17:40:33.597993] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-03T17:40:33.600553] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:40:34.390702] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-03T17:40:34.452316] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:40:35.190688] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-03T17:40:35.620989] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T17:40:35.653290] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:40:35.990728] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-03T17:40:36.445608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T17:40:36.790705] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-03T17:40:37.590673] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-03T17:40:37.788807] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T17:40:38.390680] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-03T17:40:38.572368] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T17:40:38.630115] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:40:39.190717] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-03T17:40:39.983548] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:40:39.992798] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-03T17:40:40.790708] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-03T17:40:41.069358] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:40:41.590686] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-03T17:40:41.719439] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:40:41.723177] [INFO ] [REMOTE ] BLD: Full fetch complete (40256 records). [2025-10-03T17:40:41.723309] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-03T17:40:42.117235] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T17:40:42.203592] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-03T17:40:42.203715] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-03T17:40:42.204312] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-03T17:40:42.204381] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-03T17:40:42.205525] [DEBUG] [LOCAL ] BLD: Trimmed 40256 records to 27960 (keeping 200 days of data) [2025-10-03T17:40:42.387525] [DEBUG] [LOCAL ] BLD: Primary data saved (27960 records). [2025-10-03T17:40:42.387698] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-03T17:40:42.387812] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLD took 42.2s. Estimated remaining: 4h 42m 30s. Rate: 7.3 symbols/min [2025-10-03T17:40:42.399607] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-03T17:40:42.586710] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:42.587163] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-03T17:40:42.587219] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-03T17:40:42.587416] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-03T17:40:42.587481] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-03T17:40:42.587550] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-03T17:40:42.587586] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-03T17:40:42.982880] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:43.190720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-03T17:40:43.826019] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:40:43.990636] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-03T17:40:44.247778] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:40:44.790708] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-03T17:40:44.982450] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:40:44.987270] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:40:44.994984] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-03T17:40:44.995422] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:40:44.995594] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-03T17:40:44.995716] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:40:44.995812] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-03T17:40:44.995898] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-03T17:40:44.995955] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-03T17:40:44.996033] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-03T17:40:44.996136] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLSH took 2.6s. Estimated remaining: 4h 41m 44s. Rate: 7.4 symbols/min [2025-10-03T17:40:45.182024] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:45.197870] [DEBUG] [LOCAL ] BLW: Loaded 13258 existing records from primary storage. [2025-10-03T17:40:45.198101] [INFO ] [MAIN ] BLW: Loaded 13258 existing records. [2025-10-03T17:40:45.392624] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:45.392934] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-03T17:40:45.393017] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-03T17:40:45.393697] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-03T17:40:45.393764] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-03T17:40:45.593380] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-03T17:40:45.696742] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:40:45.818138] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:46.390698] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-03T17:40:47.190639] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-03T17:40:47.293034] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T17:40:47.984274] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:40:47.991961] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-03T17:40:48.005384] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:40:48.790731] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-03T17:40:49.590713] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-03T17:40:49.615388] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T17:40:49.956309] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T17:40:50.390687] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-03T17:40:50.893935] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T17:40:51.190717] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-03T17:40:51.990684] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-03T17:40:52.053109] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T17:40:52.055771] [INFO ] [REMOTE ] BLDR: Full fetch complete (74472 records). [2025-10-03T17:40:52.055929] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-03T17:40:52.259013] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:40:52.505454] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-03T17:40:52.505541] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-03T17:40:52.506406] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-03T17:40:52.506510] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-03T17:40:52.508279] [DEBUG] [LOCAL ] BLDR: Trimmed 74472 records to 52382 (keeping 200 days of data) [2025-10-03T17:40:52.804725] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-03T17:40:52.854753] [DEBUG] [LOCAL ] BLDR: Primary data saved (52382 records). [2025-10-03T17:40:52.854886] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-03T17:40:52.854979] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLDR took 50.0s. Estimated remaining: 4h 41m 33s. Rate: 7.4 symbols/min [2025-10-03T17:40:53.048791] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:53.065440] [DEBUG] [LOCAL ] BLX: Loaded 15738 existing records from primary storage. [2025-10-03T17:40:53.065714] [INFO ] [MAIN ] BLX: Loaded 15738 existing records. [2025-10-03T17:40:53.267976] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:53.268256] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-03T17:40:53.268426] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-03T17:40:53.268799] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-03T17:40:53.268861] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-03T17:40:53.561099] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:40:53.602561] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-03T17:40:53.728995] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:54.390682] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-03T17:40:54.614162] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:40:54.721863] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:40:55.190732] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-03T17:40:55.990674] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-03T17:40:56.140608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:40:56.503291] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:40:56.790719] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-03T17:40:56.978524] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:40:57.590621] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-03T17:40:57.793034] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:40:58.390620] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-03T17:40:58.464800] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T17:40:59.190686] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-03T17:40:59.219409] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:40:59.990697] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-03T17:41:00.063532] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:41:00.790733] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-03T17:41:01.590722] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-03T17:41:01.634177] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:41:01.903369] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T17:41:02.274269] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T17:41:02.390726] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-03T17:41:03.190702] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-03T17:41:03.928319] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:41:03.931436] [INFO ] [REMOTE ] BLND: Full fetch complete (72237 records). [2025-10-03T17:41:03.931599] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-03T17:41:04.001700] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-03T17:41:04.388588] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-03T17:41:04.402478] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-03T17:41:04.404417] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-03T17:41:04.405338] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:41:04.405612] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-03T17:41:04.413131] [DEBUG] [LOCAL ] BLND: Trimmed 72237 records to 49987 (keeping 200 days of data) [2025-10-03T17:41:04.710150] [DEBUG] [LOCAL ] BLND: Primary data saved (49987 records). [2025-10-03T17:41:04.710323] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-03T17:41:04.711183] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLND took 35.3s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-03T17:41:04.799561] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-03T17:41:04.914336] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:04.953050] [DEBUG] [LOCAL ] BMA: Loaded 35644 existing records from primary storage. [2025-10-03T17:41:04.953386] [INFO ] [MAIN ] BMA: Loaded 35644 existing records. [2025-10-03T17:41:05.154281] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:05.154529] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-03T17:41:05.154579] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-03T17:41:05.154875] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-03T17:41:05.154937] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-03T17:41:05.559226] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:05.583485] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:41:05.590623] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-03T17:41:05.926147] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:41:06.167200] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:41:06.390688] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-03T17:41:07.191100] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-03T17:41:07.193524] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:41:07.990764] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-03T17:41:08.253367] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T17:41:08.790703] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-03T17:41:09.051290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:41:09.590722] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-03T17:41:09.744424] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:41:10.390723] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-03T17:41:10.988159] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:41:11.024726] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T17:41:11.027008] [INFO ] [REMOTE ] BLW: Full fetch complete (19314 records). [2025-10-03T17:41:11.027169] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-03T17:41:11.195800] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-03T17:41:11.482835] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-03T17:41:11.482916] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-03T17:41:11.483236] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-03T17:41:11.483276] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-03T17:41:11.483887] [DEBUG] [LOCAL ] BLW: Trimmed 19314 records to 13457 (keeping 200 days of data) [2025-10-03T17:41:11.572634] [DEBUG] [LOCAL ] BLW: Primary data saved (13457 records). [2025-10-03T17:41:11.572823] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-03T17:41:11.572939] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLW took 26.6s. Estimated remaining: 4h 41m 33s. Rate: 7.3 symbols/min [2025-10-03T17:41:11.770324] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:11.783172] [DEBUG] [LOCAL ] BME: Loaded 11009 existing records from primary storage. [2025-10-03T17:41:11.783400] [INFO ] [MAIN ] BME: Loaded 11009 existing records. [2025-10-03T17:41:11.970710] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:11.970977] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-03T17:41:11.971028] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-03T17:41:11.971246] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-03T17:41:11.971305] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-03T17:41:11.995790] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-03T17:41:12.381519] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:12.623213] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:41:12.625374] [INFO ] [REMOTE ] BLK: Full fetch complete (52630 records). [2025-10-03T17:41:12.625494] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-03T17:41:12.797690] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-03T17:41:13.056447] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-03T17:41:13.056553] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-03T17:41:13.057385] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-03T17:41:13.057479] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-03T17:41:13.059060] [DEBUG] [LOCAL ] BLK: Trimmed 52630 records to 34890 (keeping 200 days of data) [2025-10-03T17:41:13.311158] [DEBUG] [LOCAL ] BLK: Primary data saved (34890 records). [2025-10-03T17:41:13.311452] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-03T17:41:13.312046] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLK took 45.4s. Estimated remaining: 4h 40m 41s. Rate: 7.4 symbols/min [2025-10-03T17:41:13.502731] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:13.535694] [DEBUG] [LOCAL ] BMEZ: Loaded 26437 existing records from primary storage. [2025-10-03T17:41:13.536163] [INFO ] [MAIN ] BMEZ: Loaded 26437 existing records. [2025-10-03T17:41:13.598562] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-03T17:41:13.771842] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:41:13.776297] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:13.785067] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-03T17:41:13.785425] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-03T17:41:13.785878] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-03T17:41:13.785939] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-03T17:41:14.122935] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:41:14.201951] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:14.390695] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-03T17:41:14.689357] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:41:15.190699] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-03T17:41:15.210453] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T17:41:15.990706] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-03T17:41:16.328811] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T17:41:16.636946] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:41:16.790715] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-03T17:41:17.590719] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-03T17:41:17.614576] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T17:41:18.390697] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-03T17:41:18.959078] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:41:19.156550] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T17:41:19.190690] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-03T17:41:19.990683] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-03T17:41:20.708553] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T17:41:20.790695] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-03T17:41:21.058439] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:41:21.059918] [INFO ] [REMOTE ] BLX: Full fetch complete (22756 records). [2025-10-03T17:41:21.059996] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-03T17:41:21.483298] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-03T17:41:21.483391] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-03T17:41:21.483805] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-03T17:41:21.483872] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-03T17:41:21.484771] [DEBUG] [LOCAL ] BLX: Trimmed 22756 records to 15829 (keeping 200 days of data) [2025-10-03T17:41:21.586528] [DEBUG] [LOCAL ] BLX: Primary data saved (15829 records). [2025-10-03T17:41:21.586712] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-03T17:41:21.586820] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BLX took 28.7s. Estimated remaining: 4h 40m 34s. Rate: 7.4 symbols/min [2025-10-03T17:41:21.599486] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-03T17:41:21.785115] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:21.812669] [DEBUG] [LOCAL ] BMI: Loaded 24385 existing records from primary storage. [2025-10-03T17:41:21.812962] [INFO ] [MAIN ] BMI: Loaded 24385 existing records. [2025-10-03T17:41:22.026054] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:22.026455] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-03T17:41:22.026514] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-03T17:41:22.026891] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-03T17:41:22.026951] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-03T17:41:22.262638] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:41:22.390632] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-03T17:41:22.483476] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:22.492352] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T17:41:23.190682] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-03T17:41:23.572804] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:41:23.990686] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-03T17:41:24.034804] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T17:41:24.790699] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-03T17:41:25.545808] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T17:41:25.590707] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-03T17:41:25.884450] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:41:26.390683] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-03T17:41:26.841737] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:41:27.190700] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-03T17:41:27.292688] [DEBUG] [REMOTE ] BMEZ: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-03T17:41:27.293039] [WARN ] [REMOTE ] BMEZ: No data returned for month 2025-04 [2025-10-03T17:41:27.293137] [FATAL] [REMOTE ] BMEZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:41:27.293223] [FATAL] [MAIN ] BMEZ: Failed to fetch primary data. [2025-10-03T17:41:27.293290] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:41:27.293365] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-03T17:41:27.293433] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-03T17:41:27.293471] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-03T17:41:27.293769] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-03T17:41:27.293861] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BMEZ took 14.0s. Estimated remaining: 4h 40m 9s. Rate: 7.4 symbols/min [2025-10-03T17:41:27.484472] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T17:41:27.512839] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:27.518823] [DEBUG] [LOCAL ] BMN: Loaded 2594 existing records from primary storage. [2025-10-03T17:41:27.519005] [INFO ] [MAIN ] BMN: Loaded 2594 existing records. [2025-10-03T17:41:27.720005] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:27.720287] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-03T17:41:27.720347] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-03T17:41:27.720603] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-03T17:41:27.720698] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-03T17:41:27.995778] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-03T17:41:28.148007] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:28.790698] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-03T17:41:29.271213] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:41:29.459087] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:41:29.590703] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-03T17:41:30.051074] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:41:30.390731] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-03T17:41:31.190720] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-03T17:41:31.559196] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:41:31.990692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-03T17:41:32.159096] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T17:41:32.440742] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T17:41:32.790735] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-03T17:41:33.590692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-03T17:41:34.057324] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:41:34.390726] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-03T17:41:34.807956] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T17:41:35.190694] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-03T17:41:35.361992] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T17:41:35.990636] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-03T17:41:36.184159] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:41:36.430421] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:41:36.790692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-03T17:41:37.393523] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T17:41:37.590732] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-03T17:41:38.281049] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T17:41:38.390735] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-03T17:41:39.184110] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:41:39.190605] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-03T17:41:39.990673] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-03T17:41:40.033896] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T17:41:40.462255] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:41:40.790724] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-03T17:41:41.599407] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:41:41.598260] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-03T17:41:42.390754] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-03T17:41:42.948003] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T17:41:43.019849] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T17:41:43.021081] [INFO ] [REMOTE ] BME: Full fetch complete (16143 records). [2025-10-03T17:41:43.021163] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-03T17:41:43.193505] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-03T17:41:43.440543] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-03T17:41:43.440676] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-03T17:41:43.441132] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-03T17:41:43.441198] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-03T17:41:43.442048] [DEBUG] [LOCAL ] BME: Trimmed 16143 records to 11124 (keeping 200 days of data) [2025-10-03T17:41:43.517438] [DEBUG] [LOCAL ] BME: Primary data saved (11124 records). [2025-10-03T17:41:43.517598] [INFO ] [MAIN ] BME: Full history saved. [2025-10-03T17:41:43.517745] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BME took 31.9s. Estimated remaining: 4h 40m 56s. Rate: 7.3 symbols/min [2025-10-03T17:41:43.743755] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:43.787044] [DEBUG] [LOCAL ] BMO: Loaded 41494 existing records from primary storage. [2025-10-03T17:41:43.787385] [INFO ] [MAIN ] BMO: Loaded 41494 existing records. [2025-10-03T17:41:43.984559] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:43.984837] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-03T17:41:43.984929] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-03T17:41:43.985276] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-03T17:41:43.985361] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-03T17:41:43.997770] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-03T17:41:44.431272] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:44.546489] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:41:44.645302] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T17:41:44.790814] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-03T17:41:45.590763] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-03T17:41:46.226104] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:41:46.390757] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-03T17:41:47.187679] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:41:47.196285] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-03T17:41:47.649302] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T17:41:47.977353] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T17:41:47.990628] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-03T17:41:48.790735] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-03T17:41:49.297577] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T17:41:49.590734] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-03T17:41:49.833024] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:41:49.834469] [INFO ] [REMOTE ] BMI: Full fetch complete (32943 records). [2025-10-03T17:41:49.834802] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-03T17:41:50.215470] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-03T17:41:50.215588] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-03T17:41:50.216171] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-03T17:41:50.216238] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-03T17:41:50.217492] [DEBUG] [LOCAL ] BMI: Trimmed 32943 records to 24515 (keeping 200 days of data) [2025-10-03T17:41:50.384630] [DEBUG] [LOCAL ] BMI: Primary data saved (24515 records). [2025-10-03T17:41:50.384938] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-03T17:41:50.385089] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMI took 28.8s. Estimated remaining: 4h 40m 39s. Rate: 7.4 symbols/min [2025-10-03T17:41:50.397520] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-03T17:41:50.572230] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:50.634041] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-03T17:41:50.634615] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-03T17:41:50.895477] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:50.895982] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-03T17:41:50.896067] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-03T17:41:50.896609] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-03T17:41:50.896708] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-03T17:41:51.192427] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-03T17:41:51.313830] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:51.375809] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:41:51.833492] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T17:41:51.925184] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:41:51.990692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-03T17:41:52.516604] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:41:52.790703] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-03T17:41:53.590726] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-03T17:41:54.390754] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-03T17:41:54.964369] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:41:54.967814] [INFO ] [REMOTE ] BMA: Full fetch complete (51601 records). [2025-10-03T17:41:54.967939] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-03T17:41:55.237079] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-03T17:41:55.283230] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T17:41:55.470729] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-03T17:41:55.470824] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-03T17:41:55.471436] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-03T17:41:55.471482] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-03T17:41:55.474078] [DEBUG] [LOCAL ] BMA: Trimmed 51601 records to 35953 (keeping 200 days of data) [2025-10-03T17:41:55.704612] [DEBUG] [LOCAL ] BMA: Primary data saved (35953 records). [2025-10-03T17:41:55.704982] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-03T17:41:55.705621] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMA took 51.0s. Estimated remaining: 4h 40m 12s. Rate: 7.4 symbols/min [2025-10-03T17:41:55.810623] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:41:55.833921] [INFO ] [REMOTE ] BMN: Full fetch complete (3745 records). [2025-10-03T17:41:55.845224] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-03T17:41:55.953496] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:56.012460] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-03T17:41:56.244377] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:41:56.459689] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-03T17:41:56.459805] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-03T17:41:56.460012] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-03T17:41:56.460088] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-03T17:41:56.462523] [DEBUG] [LOCAL ] BMN: Trimmed 3745 records to 2606 (keeping 200 days of data) [2025-10-03T17:41:56.462264] [DEBUG] [LOCAL ] BN: Loaded 53383 existing records from primary storage. [2025-10-03T17:41:56.463524] [INFO ] [MAIN ] BN: Loaded 53383 existing records. [2025-10-03T17:41:56.536974] [DEBUG] [LOCAL ] BMN: Primary data saved (2606 records). [2025-10-03T17:41:56.550767] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-03T17:41:56.558681] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BMN took 29.3s. Estimated remaining: 4h 39m 15s. Rate: 7.4 symbols/min [2025-10-03T17:41:56.795472] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-03T17:41:56.953545] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:57.004846] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:57.005143] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-03T17:41:57.005232] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-03T17:41:57.005487] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-03T17:41:57.005564] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-03T17:41:57.268522] [DEBUG] [LOCAL ] BNED: Loaded 29657 existing records from primary storage. [2025-10-03T17:41:57.313704] [INFO ] [MAIN ] BNED: Loaded 29657 existing records. [2025-10-03T17:41:57.636126] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:57.648116] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-03T17:41:57.689148] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:57.689408] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-03T17:41:57.689463] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-03T17:41:57.689705] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-03T17:41:57.689765] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-03T17:41:58.085552] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:58.117582] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-03T17:41:58.390737] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-03T17:41:58.492296] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T17:41:59.190701] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-03T17:41:59.850772] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T17:41:59.990696] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-03T17:42:00.285213] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T17:42:00.790667] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-03T17:42:00.934631] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:42:01.436555] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:42:01.590733] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-03T17:42:02.390727] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-03T17:42:02.698507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:42:02.918443] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T17:42:03.190711] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-03T17:42:03.990672] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-03T17:42:04.256029] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T17:42:04.605377] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:42:04.790736] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-03T17:42:05.366528] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:42:05.590715] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-03T17:42:05.904833] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:42:06.390744] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-03T17:42:07.195970] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-03T17:42:07.214466] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:42:07.702733] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:42:07.990683] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-03T17:42:08.628446] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:42:08.790732] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-03T17:42:09.590688] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-03T17:42:09.726448] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:42:10.390698] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-03T17:42:11.013138] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:42:11.133396] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-03T17:42:11.190691] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-03T17:42:11.583226] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:42:11.990677] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-03T17:42:12.790697] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-03T17:42:13.281581] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:42:13.303571] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T17:42:13.306036] [INFO ] [REMOTE ] BMO: Full fetch complete (59723 records). [2025-10-03T17:42:13.306178] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-03T17:42:13.595904] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-03T17:42:13.736006] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-03T17:42:13.736109] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-03T17:42:13.736846] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-03T17:42:13.736913] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-03T17:42:13.738447] [DEBUG] [LOCAL ] BMO: Trimmed 59723 records to 41826 (keeping 200 days of data) [2025-10-03T17:42:14.014284] [DEBUG] [LOCAL ] BMO: Primary data saved (41826 records). [2025-10-03T17:42:14.014428] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-03T17:42:14.014539] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMO took 30.5s. Estimated remaining: 4h 40m 9s. Rate: 7.4 symbols/min [2025-10-03T17:42:14.211633] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:14.232385] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:42:14.246179] [DEBUG] [LOCAL ] BNH: Loaded 5161 existing records from primary storage. [2025-10-03T17:42:14.246436] [INFO ] [MAIN ] BNH: Loaded 5161 existing records. [2025-10-03T17:42:14.405452] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-03T17:42:14.452948] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:14.453298] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-03T17:42:14.453355] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-03T17:42:14.453719] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-03T17:42:14.453781] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-03T17:42:14.855678] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:15.190668] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-03T17:42:15.730963] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T17:42:15.885694] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T17:42:15.990698] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-03T17:42:16.440793] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T17:42:16.489838] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T17:42:16.790704] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-03T17:42:17.333908] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T17:42:17.590709] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-03T17:42:18.390714] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-03T17:42:19.190704] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-03T17:42:19.716101] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:42:19.990681] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-03T17:42:20.222521] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:42:20.464921] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:42:20.558782] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:42:20.790672] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-03T17:42:21.294398] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-03T17:42:21.590682] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-03T17:42:22.390692] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-03T17:42:23.053292] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T17:42:23.190704] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-03T17:42:23.990668] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-03T17:42:24.229981] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:42:24.790715] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-03T17:42:25.232323] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T17:42:25.401771] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T17:42:25.451458] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:42:25.590747] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-03T17:42:26.390632] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-03T17:42:26.721218] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:42:27.190734] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-03T17:42:27.990729] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-03T17:42:28.390578] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:42:28.632762] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T17:42:28.790692] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-03T17:42:29.325501] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:42:29.343279] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:42:29.590721] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-03T17:42:30.167166] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T17:42:30.390712] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-03T17:42:31.190733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-03T17:42:31.870093] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T17:42:31.872886] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-03T17:42:31.873043] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-03T17:42:32.000223] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-03T17:42:32.326782] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-03T17:42:32.326968] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-03T17:42:32.327855] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-03T17:42:32.328007] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-03T17:42:32.363827] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-10-03T17:42:32.367344] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T17:42:32.732500] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-03T17:42:32.732679] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-03T17:42:32.732792] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMY took 42.3s. Estimated remaining: 4h 41m 10s. Rate: 7.3 symbols/min [2025-10-03T17:42:32.802815] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-03T17:42:32.922686] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:32.922884] [DEBUG] [LOCAL ] BNJ: No existing data file found in primary storage. [2025-10-03T17:42:32.922923] [WARN ] [MAIN ] BNJ: No existing data found, performing full refresh instead. [2025-10-03T17:42:32.923033] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-03T17:42:32.923076] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-03T17:42:32.923117] [DEBUG] [LOCAL ] BNJ: No primary data file found to delete. [2025-10-03T17:42:32.923150] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-03T17:42:33.122993] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T17:42:33.179207] [INFO ] [REMOTE ] BNED: Full fetch complete (43775 records). [2025-10-03T17:42:33.202991] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-03T17:42:33.465170] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:33.509104] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T17:42:33.591487] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-03T17:42:33.771631] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-03T17:42:33.771781] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-03T17:42:33.772387] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-03T17:42:33.772454] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-03T17:42:33.773609] [DEBUG] [LOCAL ] BNED: Trimmed 43775 records to 29850 (keeping 200 days of data) [2025-10-03T17:42:33.956776] [DEBUG] [LOCAL ] BNED: Primary data saved (29850 records). [2025-10-03T17:42:33.956948] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-03T17:42:33.957047] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 37.4s. Estimated remaining: 4h 40m 16s. Rate: 7.3 symbols/min [2025-10-03T17:42:34.149811] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:34.204704] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:42:34.206097] [DEBUG] [LOCAL ] BNL: Loaded 47291 existing records from primary storage. [2025-10-03T17:42:34.208091] [INFO ] [MAIN ] BNL: Loaded 47291 existing records. [2025-10-03T17:42:34.207925] [INFO ] [REMOTE ] BNH: Full fetch complete (7006 records). [2025-10-03T17:42:34.213495] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-03T17:42:34.395939] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-03T17:42:34.646110] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:34.657521] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-03T17:42:34.667083] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-03T17:42:34.697827] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-03T17:42:34.766522] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-03T17:42:35.085971] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-03T17:42:35.087411] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-03T17:42:35.103360] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-03T17:42:35.105875] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-03T17:42:35.190025] [DEBUG] [LOCAL ] BNH: Trimmed 7006 records to 5198 (keeping 200 days of data) [2025-10-03T17:42:35.206043] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-03T17:42:35.256871] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:42:35.345507] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:35.351004] [DEBUG] [LOCAL ] BNH: Primary data saved (5198 records). [2025-10-03T17:42:35.351084] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-03T17:42:35.351163] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BNH took 21.3s. Estimated remaining: 4h 39m 24s. Rate: 7.4 symbols/min [2025-10-03T17:42:35.548420] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:35.601368] [DEBUG] [LOCAL ] BNS: Loaded 51859 existing records from primary storage. [2025-10-03T17:42:35.601790] [INFO ] [MAIN ] BNS: Loaded 51859 existing records. [2025-10-03T17:42:35.794676] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:35.794959] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-03T17:42:35.795017] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-03T17:42:35.795366] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-03T17:42:35.795426] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-03T17:42:35.997192] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-03T17:42:36.229081] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:36.790682] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-03T17:42:37.061986] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T17:42:37.590728] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-03T17:42:37.820858] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:42:38.108398] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T17:42:38.390696] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-03T17:42:38.698529] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T17:42:38.780338] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T17:42:39.190734] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-03T17:42:39.722201] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:42:39.990736] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-03T17:42:40.790747] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-03T17:42:41.590731] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-03T17:42:41.975046] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T17:42:42.390692] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-03T17:42:42.450055] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:42:42.968891] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T17:42:43.051738] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:42:43.190695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-03T17:42:43.990725] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-03T17:42:44.479602] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:42:44.647547] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T17:42:44.790713] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-03T17:42:45.201100] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T17:42:45.590706] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-03T17:42:46.029301] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T17:42:46.390713] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-03T17:42:47.190744] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-03T17:42:47.996544] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-03T17:42:48.019598] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:42:48.790740] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-03T17:42:48.877281] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T17:42:49.590730] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-03T17:42:49.706487] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:42:49.709322] [INFO ] [REMOTE ] BN: Full fetch complete (76697 records). [2025-10-03T17:42:49.709441] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-03T17:42:50.138379] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-03T17:42:50.138482] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-03T17:42:50.139282] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-03T17:42:50.139350] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-03T17:42:50.140950] [DEBUG] [LOCAL ] BN: Trimmed 76697 records to 53772 (keeping 200 days of data) [2025-10-03T17:42:50.394255] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-03T17:42:50.529938] [DEBUG] [LOCAL ] BN: Primary data saved (53772 records). [2025-10-03T17:42:50.530277] [INFO ] [MAIN ] BN: Full history saved. [2025-10-03T17:42:50.531961] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BN took 54.8s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-03T17:42:50.724424] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:50.760873] [DEBUG] [LOCAL ] BNT: Loaded 3393 existing records from primary storage. [2025-10-03T17:42:50.761687] [INFO ] [MAIN ] BNT: Loaded 3393 existing records. [2025-10-03T17:42:50.763061] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T17:42:50.893354] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T17:42:50.978617] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:50.978852] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-03T17:42:50.978901] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-03T17:42:50.979093] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-03T17:42:50.979152] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-03T17:42:51.195836] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-03T17:42:51.382907] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:51.459338] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:42:51.990718] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-03T17:42:52.790703] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-03T17:42:53.181211] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:42:53.350199] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:42:53.531053] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:42:53.590725] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-03T17:42:54.208589] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T17:42:54.390704] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-03T17:42:54.861851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T17:42:55.190714] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-03T17:42:55.504834] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T17:42:55.990690] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-03T17:42:56.524044] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:42:56.525263] [INFO ] [REMOTE ] BNJ: Full fetch complete (4295 records). [2025-10-03T17:42:56.525355] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-03T17:42:56.796045] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-03T17:42:56.932859] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-03T17:42:56.932947] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-03T17:42:56.933098] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-03T17:42:56.933139] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-03T17:42:56.933533] [DEBUG] [LOCAL ] BNJ: Trimmed 4295 records to 2666 (keeping 200 days of data) [2025-10-03T17:42:56.951146] [DEBUG] [LOCAL ] BNJ: Primary data saved (2666 records). [2025-10-03T17:42:56.951226] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-03T17:42:56.951292] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNJ took 24.2s. Estimated remaining: 4h 39m 42s. Rate: 7.3 symbols/min [2025-10-03T17:42:57.135701] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:57.147288] [DEBUG] [LOCAL ] BNY: Loaded 7174 existing records from primary storage. [2025-10-03T17:42:57.147499] [INFO ] [MAIN ] BNY: Loaded 7174 existing records. [2025-10-03T17:42:57.341030] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:57.341251] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-03T17:42:57.341302] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-03T17:42:57.341571] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-03T17:42:57.341630] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-03T17:42:57.598476] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-03T17:42:57.740552] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:58.337063] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:42:58.390685] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-03T17:42:59.122621] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:42:59.190733] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-03T17:42:59.470331] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:42:59.990724] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-03T17:43:00.790700] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-03T17:43:01.212566] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:43:01.391865] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:43:01.590697] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-03T17:43:01.786838] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T17:43:02.326779] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T17:43:02.390719] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-03T17:43:03.036669] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:43:03.190686] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-03T17:43:03.990721] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-03T17:43:04.639427] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:43:04.762369] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:43:04.790631] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-03T17:43:05.590682] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-03T17:43:06.366714] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:43:06.368008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:43:06.390617] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-03T17:43:07.190703] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-03T17:43:07.844361] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:43:07.847264] [INFO ] [REMOTE ] BNL: Full fetch complete (67041 records). [2025-10-03T17:43:07.847376] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-03T17:43:07.969603] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T17:43:07.992191] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-03T17:43:08.283800] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-03T17:43:08.283934] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-03T17:43:08.284713] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-03T17:43:08.284783] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-03T17:43:08.286259] [DEBUG] [LOCAL ] BNL: Trimmed 67041 records to 47668 (keeping 200 days of data) [2025-10-03T17:43:08.593106] [DEBUG] [LOCAL ] BNL: Primary data saved (47668 records). [2025-10-03T17:43:08.593264] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-03T17:43:08.594375] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNL took 34.6s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-03T17:43:08.708272] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:43:08.785171] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:08.790684] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-03T17:43:08.809056] [DEBUG] [LOCAL ] BOC: Loaded 18384 existing records from primary storage. [2025-10-03T17:43:08.809317] [INFO ] [MAIN ] BOC: Loaded 18384 existing records. [2025-10-03T17:43:08.999861] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:09.000070] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-03T17:43:09.000180] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-03T17:43:09.000425] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-03T17:43:09.000483] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-03T17:43:09.384600] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:09.590694] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-03T17:43:10.316928] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T17:43:10.390696] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-03T17:43:10.530974] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:43:11.190722] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-03T17:43:11.466031] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:43:11.990693] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-03T17:43:12.309830] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T17:43:12.790706] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-03T17:43:13.077831] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T17:43:13.378559] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T17:43:13.590696] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-03T17:43:14.310364] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T17:43:14.390665] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-03T17:43:15.190703] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-03T17:43:15.209148] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:43:15.990689] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-03T17:43:16.221618] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T17:43:16.444066] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T17:43:16.790687] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-03T17:43:17.590716] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-03T17:43:18.210387] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:43:18.360623] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T17:43:18.390728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-03T17:43:19.055595] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:43:19.056608] [INFO ] [REMOTE ] BNT: Full fetch complete (4520 records). [2025-10-03T17:43:19.056737] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-03T17:43:19.195883] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-03T17:43:19.451616] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-03T17:43:19.451780] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-03T17:43:19.452051] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-03T17:43:19.452121] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-03T17:43:19.453146] [DEBUG] [LOCAL ] BNT: Trimmed 4520 records to 3434 (keeping 200 days of data) [2025-10-03T17:43:19.476140] [DEBUG] [LOCAL ] BNT: Primary data saved (3434 records). [2025-10-03T17:43:19.476253] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-03T17:43:19.476366] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 28.9s. Estimated remaining: 4h 40m 6s. Rate: 7.3 symbols/min [2025-10-03T17:43:19.990710] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-03T17:43:20.661909] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:43:20.664874] [INFO ] [REMOTE ] BNS: Full fetch complete (74293 records). [2025-10-03T17:43:20.665033] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-03T17:43:20.795832] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-03T17:43:21.032446] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:43:21.122555] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-03T17:43:21.122699] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-03T17:43:21.123576] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-03T17:43:21.123667] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-03T17:43:21.125707] [DEBUG] [LOCAL ] BNS: Trimmed 74293 records to 52238 (keeping 200 days of data) [2025-10-03T17:43:21.467292] [DEBUG] [LOCAL ] BNS: Primary data saved (52238 records). [2025-10-03T17:43:21.467480] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-03T17:43:21.467674] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNS took 46.1s. Estimated remaining: 4h 39m 17s. Rate: 7.3 symbols/min [2025-10-03T17:43:21.590674] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-03T17:43:21.647809] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T17:43:22.390747] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-03T17:43:22.787710] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:43:22.800559] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T17:43:23.190734] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-03T17:43:23.882688] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:43:23.990690] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-03T17:43:24.790724] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-03T17:43:25.080616] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:43:25.590691] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-03T17:43:25.710455] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:43:25.711572] [INFO ] [REMOTE ] BNY: Full fetch complete (10444 records). [2025-10-03T17:43:25.711677] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-03T17:43:26.099827] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-03T17:43:26.100146] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-03T17:43:26.100445] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-03T17:43:26.100493] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-03T17:43:26.101213] [DEBUG] [LOCAL ] BNY: Trimmed 10444 records to 7209 (keeping 200 days of data) [2025-10-03T17:43:26.151171] [DEBUG] [LOCAL ] BNY: Primary data saved (7209 records). [2025-10-03T17:43:26.151313] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-03T17:43:26.151401] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNY took 29.2s. Estimated remaining: 4h 38m 47s. Rate: 7.4 symbols/min [2025-10-03T17:43:26.538502] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T17:43:26.543033] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-03T17:43:27.592758] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T17:43:27.597622] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-03T17:43:28.649972] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:43:28.655596] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-03T17:43:29.674797] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T17:43:29.679639] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-03T17:43:30.481671] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T17:43:30.483153] [INFO ] [REMOTE ] BOC: Full fetch complete (25762 records). [2025-10-03T17:43:30.483239] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-03T17:43:30.914357] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-03T17:43:30.914448] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-03T17:43:30.914912] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-03T17:43:30.914993] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-03T17:43:30.916339] [DEBUG] [LOCAL ] BOC: Trimmed 25762 records to 18490 (keeping 200 days of data) [2025-10-03T17:43:31.039637] [DEBUG] [LOCAL ] BOC: Primary data saved (18490 records). [2025-10-03T17:43:31.039818] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-03T17:43:31.039922] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BOC took 22.4s. Estimated remaining: 4h 38m 18s. Rate: 7.4 symbols/min [2025-10-03T17:43:31.700241] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.807396] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.818494] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.847963] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.872665] [DEBUG] [LOCAL ] BOE: Loaded 17889 existing records from primary storage. [2025-10-03T17:43:31.872940] [INFO ] [MAIN ] BOE: Loaded 17889 existing records. [2025-10-03T17:43:32.045012] [DEBUG] [LOCAL ] BOH: Loaded 30959 existing records from primary storage. [2025-10-03T17:43:32.060601] [DEBUG] [LOCAL ] BOND: Loaded 32444 existing records from primary storage. [2025-10-03T17:43:32.062079] [INFO ] [MAIN ] BOH: Loaded 30959 existing records. [2025-10-03T17:43:32.062340] [INFO ] [MAIN ] BOND: Loaded 32444 existing records. [2025-10-03T17:43:32.073422] [DEBUG] [LOCAL ] BOOT: Loaded 40795 existing records from primary storage. [2025-10-03T17:43:32.084061] [INFO ] [MAIN ] BOOT: Loaded 40795 existing records. [2025-10-03T17:43:32.336942] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.369165] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.384793] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-03T17:43:32.466489] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-03T17:43:32.498601] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-03T17:43:32.803889] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.843562] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.843344] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.882735] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.898596] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-03T17:43:32.898750] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-03T17:43:32.921715] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-03T17:43:32.925705] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.941696] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-03T17:43:32.962521] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.941593] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-03T17:43:32.993329] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-03T17:43:32.986830] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-03T17:43:33.019625] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-03T17:43:33.049959] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-03T17:43:33.755499] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:33.848995] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-03T17:43:34.379235] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.431461] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-03T17:43:34.435015] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.477963] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-03T17:43:34.501047] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.502728] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-03T17:43:35.224909] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:43:35.230242] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-03T17:43:35.912753] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:43:35.936163] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-03T17:43:35.938263] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:43:35.945925] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-03T17:43:36.125142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:43:36.133681] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-03T17:43:36.312320] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:43:36.317271] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-03T17:43:37.263470] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:43:37.288295] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T17:43:37.287329] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-03T17:43:37.317570] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:43:37.590682] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-03T17:43:37.743751] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:43:38.390743] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-03T17:43:38.437387] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T17:43:38.811541] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:43:39.190708] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-03T17:43:39.675055] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T17:43:39.990622] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-03T17:43:40.400820] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:43:40.790692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-03T17:43:41.584117] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:43:41.594171] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-03T17:43:42.216520] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:43:42.390710] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-03T17:43:42.816245] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:43:43.190704] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-03T17:43:43.888123] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:43:43.990732] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-03T17:43:44.441112] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:43:44.790703] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-03T17:43:45.332482] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T17:43:45.453175] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:43:45.590707] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-03T17:43:46.390692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-03T17:43:46.644220] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:43:47.190684] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-03T17:43:47.391678] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T17:43:47.990666] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-03T17:43:48.184031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T17:43:48.790702] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-03T17:43:49.590701] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-03T17:43:49.682142] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:43:49.844364] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T17:43:50.390712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-03T17:43:50.857627] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T17:43:51.190740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-03T17:43:51.425033] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:43:51.990725] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-03T17:43:52.566136] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:43:52.790689] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-03T17:43:53.590637] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-03T17:43:53.622386] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:43:54.133012] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T17:43:54.390708] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-03T17:43:55.042008] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:43:55.190696] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-03T17:43:55.716130] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:43:55.990730] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-03T17:43:56.473951] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T17:43:56.790712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-03T17:43:57.438938] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:43:57.590719] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-03T17:43:57.871067] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:43:57.872796] [INFO ] [REMOTE ] BOE: Full fetch complete (26819 records). [2025-10-03T17:43:57.872878] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-03T17:43:58.327824] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-03T17:43:58.327907] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-03T17:43:58.328348] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-03T17:43:58.328410] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-03T17:43:58.329175] [DEBUG] [LOCAL ] BOE: Trimmed 26819 records to 18104 (keeping 200 days of data) [2025-10-03T17:43:58.390839] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-03T17:43:58.449478] [DEBUG] [LOCAL ] BOE: Primary data saved (18104 records). [2025-10-03T17:43:58.449624] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-03T17:43:58.449780] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOE took 27.4s. Estimated remaining: 4h 40m 13s. Rate: 7.3 symbols/min [2025-10-03T17:43:58.644423] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:58.704848] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-03T17:43:58.705205] [INFO ] [MAIN ] BORR: Loaded 51498 existing records. [2025-10-03T17:43:58.903378] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:58.903764] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-03T17:43:58.903857] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-03T17:43:58.904355] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-03T17:43:58.904415] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-03T17:43:59.038376] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:43:59.195748] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-03T17:43:59.326874] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:59.694237] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:43:59.990740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-03T17:44:00.303229] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:44:00.304695] [INFO ] [REMOTE ] BOH: Full fetch complete (44632 records). [2025-10-03T17:44:00.304816] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-03T17:44:00.305464] [FATAL] [VALIDATOR ] BOH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:44:00.305562] [FATAL] [MAIN ] BOH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:44:00.305610] [WARN ] [MAIN ] BOH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:44:00.305683] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-03T17:44:00.305773] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-03T17:44:00.305817] [INFO ] [LOCAL ] BOH: Starting deletion of derivative data. [2025-10-03T17:44:00.306252] [DEBUG] [LOCAL ] BOH: Deleted derivative data file. [2025-10-03T17:44:00.306373] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOH took 29.3s. Estimated remaining: 4h 39m 24s. Rate: 7.3 symbols/min [2025-10-03T17:44:00.490355] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:00.519636] [DEBUG] [LOCAL ] BOW: Loaded 23861 existing records from primary storage. [2025-10-03T17:44:00.520069] [INFO ] [MAIN ] BOW: Loaded 23861 existing records. [2025-10-03T17:44:00.720577] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:00.720854] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-03T17:44:00.720907] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-03T17:44:00.721156] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-03T17:44:00.721268] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-03T17:44:00.795811] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-03T17:44:01.121033] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:01.435036] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:44:01.590696] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-03T17:44:02.390731] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-03T17:44:02.495621] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:44:02.497782] [INFO ] [REMOTE ] BOND: Full fetch complete (46509 records). [2025-10-03T17:44:02.497924] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-03T17:44:02.965790] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-03T17:44:02.965897] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-03T17:44:02.966503] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-03T17:44:02.966681] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-03T17:44:02.997149] [DEBUG] [LOCAL ] BOND: Trimmed 46509 records to 32665 (keeping 200 days of data) [2025-10-03T17:44:02.999142] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T17:44:03.195404] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-03T17:44:03.237851] [DEBUG] [LOCAL ] BOND: Primary data saved (32665 records). [2025-10-03T17:44:03.238000] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-03T17:44:03.238097] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOND took 32.2s. Estimated remaining: 4h 38m 43s. Rate: 7.3 symbols/min [2025-10-03T17:44:03.415860] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:03.474687] [DEBUG] [LOCAL ] BOX: Loaded 50593 existing records from primary storage. [2025-10-03T17:44:03.475083] [INFO ] [MAIN ] BOX: Loaded 50593 existing records. [2025-10-03T17:44:03.666527] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:03.666770] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-03T17:44:03.666829] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-03T17:44:03.667763] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-03T17:44:03.667834] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-03T17:44:04.002050] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-03T17:44:04.049248] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:04.220513] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:44:04.422284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T17:44:04.790678] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-03T17:44:05.590679] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-03T17:44:05.756462] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:44:05.909450] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:44:06.390725] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-03T17:44:07.154721] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:44:07.190692] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-03T17:44:07.990685] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-03T17:44:08.174045] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:44:08.790700] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-03T17:44:08.939590] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:44:09.362976] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:44:09.590672] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-03T17:44:09.645341] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:44:10.390704] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-03T17:44:11.190690] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-03T17:44:11.267013] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:44:11.882945] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T17:44:11.885343] [INFO ] [REMOTE ] BOOT: Full fetch complete (60221 records). [2025-10-03T17:44:11.885448] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-03T17:44:11.994318] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-03T17:44:12.309307] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-03T17:44:12.309451] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-03T17:44:12.310282] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-03T17:44:12.310397] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-03T17:44:12.311912] [DEBUG] [LOCAL ] BOOT: Trimmed 60221 records to 41070 (keeping 200 days of data) [2025-10-03T17:44:12.571088] [DEBUG] [LOCAL ] BOOT: Primary data saved (41070 records). [2025-10-03T17:44:12.571223] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-03T17:44:12.571322] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOOT took 41.5s. Estimated remaining: 4h 38m 42s. Rate: 7.3 symbols/min [2025-10-03T17:44:12.772321] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:12.801177] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-03T17:44:12.804674] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:44:12.867539] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-10-03T17:44:12.867955] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-10-03T17:44:13.075810] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:13.076070] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-03T17:44:13.076141] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-03T17:44:13.077837] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-03T17:44:13.077906] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-03T17:44:13.477695] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:13.498414] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T17:44:13.590721] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-03T17:44:14.390698] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-03T17:44:14.586104] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:44:15.190699] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-03T17:44:15.600176] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:44:15.990747] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-03T17:44:16.063901] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T17:44:16.775475] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:44:16.790618] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-03T17:44:17.211052] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T17:44:17.590681] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-03T17:44:18.390700] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-03T17:44:18.858951] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T17:44:19.195873] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-03T17:44:19.213082] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:44:19.656945] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:44:19.990724] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-03T17:44:20.790726] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-03T17:44:21.249481] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T17:44:21.416909] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:44:21.590743] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-03T17:44:22.380932] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:44:22.391629] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-03T17:44:22.428590] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T17:44:23.190714] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-03T17:44:23.990698] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-03T17:44:24.578333] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T17:44:24.790749] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-03T17:44:24.965132] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T17:44:25.590734] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-03T17:44:25.718002] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:44:25.767899] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:44:26.390689] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-03T17:44:27.190731] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-03T17:44:28.001574] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:44:28.001749] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-03T17:44:28.020146] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T17:44:28.612541] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:44:28.790673] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-03T17:44:28.820979] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T17:44:29.590749] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-03T17:44:30.390704] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-03T17:44:30.906239] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-03T17:44:30.954455] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T17:44:31.190679] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-03T17:44:31.425078] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:44:31.990735] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-03T17:44:32.790707] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-03T17:44:32.982326] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:44:32.984686] [INFO ] [REMOTE ] BOW: Full fetch complete (31735 records). [2025-10-03T17:44:32.984810] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-03T17:44:33.112118] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:44:33.452456] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-03T17:44:33.452537] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-03T17:44:33.452968] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-03T17:44:33.453032] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-03T17:44:33.453910] [DEBUG] [LOCAL ] BOW: Trimmed 31735 records to 24158 (keeping 200 days of data) [2025-10-03T17:44:33.592118] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-03T17:44:33.607164] [DEBUG] [LOCAL ] BOW: Primary data saved (24158 records). [2025-10-03T17:44:33.607375] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-03T17:44:33.607500] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOW took 33.3s. Estimated remaining: 4h 39m 55s. Rate: 7.3 symbols/min [2025-10-03T17:44:33.790466] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:33.829003] [DEBUG] [LOCAL ] BR: Loaded 34933 existing records from primary storage. [2025-10-03T17:44:33.829340] [INFO ] [MAIN ] BR: Loaded 34933 existing records. [2025-10-03T17:44:34.063946] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:34.064440] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-03T17:44:34.064677] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-03T17:44:34.066058] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-03T17:44:34.066126] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-03T17:44:34.400254] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-03T17:44:34.505834] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:44:34.511665] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:35.154713] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:44:35.190625] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-03T17:44:35.990668] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-03T17:44:36.390625] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:44:36.711603] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:44:36.714618] [INFO ] [REMOTE ] BOX: Full fetch complete (72088 records). [2025-10-03T17:44:36.714816] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-03T17:44:36.796874] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-03T17:44:37.135946] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-03T17:44:37.136036] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-03T17:44:37.136847] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-03T17:44:37.136935] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-03T17:44:37.138488] [DEBUG] [LOCAL ] BOX: Trimmed 72088 records to 50948 (keeping 200 days of data) [2025-10-03T17:44:37.453376] [DEBUG] [LOCAL ] BOX: Primary data saved (50948 records). [2025-10-03T17:44:37.453758] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-03T17:44:37.453977] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BOX took 34.2s. Estimated remaining: 4h 39m 19s. Rate: 7.3 symbols/min [2025-10-03T17:44:37.595794] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-03T17:44:37.646354] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:37.708805] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T17:44:37.710108] [DEBUG] [LOCAL ] BRBR: Loaded 51682 existing records from primary storage. [2025-10-03T17:44:37.712906] [INFO ] [MAIN ] BRBR: Loaded 51682 existing records. [2025-10-03T17:44:37.746891] [INFO ] [REMOTE ] BORR: Full fetch complete (74633 records). [2025-10-03T17:44:37.783568] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-03T17:44:38.077583] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:38.096078] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-03T17:44:38.096349] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-03T17:44:38.158085] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-03T17:44:38.179246] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-03T17:44:38.669129] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T17:44:38.683812] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-03T17:44:38.728085] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-03T17:44:38.727992] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-03T17:44:38.735510] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-03T17:44:38.741954] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-03T17:44:38.820358] [DEBUG] [LOCAL ] BORR: Trimmed 74633 records to 51865 (keeping 200 days of data) [2025-10-03T17:44:38.834349] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:39.143521] [DEBUG] [LOCAL ] BORR: Primary data saved (51865 records). [2025-10-03T17:44:39.143709] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-03T17:44:39.143826] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BORR took 40.7s. Estimated remaining: 4h 38m 30s. Rate: 7.3 symbols/min [2025-10-03T17:44:39.207857] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-03T17:44:39.337247] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:39.357215] [DEBUG] [LOCAL ] BRC: Loaded 19152 existing records from primary storage. [2025-10-03T17:44:39.357482] [INFO ] [MAIN ] BRC: Loaded 19152 existing records. [2025-10-03T17:44:39.564262] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:39.564478] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-03T17:44:39.564528] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-03T17:44:39.565133] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-03T17:44:39.565223] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-03T17:44:40.019338] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:40.020560] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-03T17:44:40.065926] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-03T17:44:40.092189] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:44:40.504058] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:44:40.790710] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-03T17:44:41.368962] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T17:44:41.590685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-03T17:44:41.884507] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:44:42.390717] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-03T17:44:43.001611] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:44:43.190717] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-03T17:44:43.573523] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:44:43.990733] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-03T17:44:44.270969] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:44:44.790726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-03T17:44:45.126122] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:44:45.590695] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-03T17:44:46.390734] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-03T17:44:46.980727] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-03T17:44:47.062070] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:44:47.190678] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-03T17:44:47.701922] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:44:47.990694] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-03T17:44:48.729327] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:44:48.790712] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-03T17:44:49.590739] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-03T17:44:50.017734] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:44:50.128704] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:44:50.390631] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-03T17:44:50.620512] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:44:51.190717] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-03T17:44:51.565281] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:44:51.990707] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-03T17:44:52.466733] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:44:52.790723] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-03T17:44:53.590695] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-03T17:44:53.668560] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T17:44:53.946465] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T17:44:54.390731] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-03T17:44:55.190737] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-03T17:44:55.418552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:44:55.550789] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T17:44:55.553580] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-10-03T17:44:55.553777] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-03T17:44:55.998543] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-03T17:44:56.002573] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-03T17:44:56.003687] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-03T17:44:56.004610] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-03T17:44:56.004837] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-03T17:44:56.006442] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54491 (keeping 200 days of data) [2025-10-03T17:44:56.369813] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-10-03T17:44:56.369967] [INFO ] [MAIN ] BP: Full history saved. [2025-10-03T17:44:56.372375] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BP took 43.8s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-03T17:44:56.564941] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:56.612324] [DEBUG] [LOCAL ] BRCC: Loaded 40474 existing records from primary storage. [2025-10-03T17:44:56.612882] [INFO ] [MAIN ] BRCC: Loaded 40474 existing records. [2025-10-03T17:44:56.794810] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-03T17:44:56.875086] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:56.876165] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-03T17:44:56.876390] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-03T17:44:56.878816] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:44:56.891559] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-03T17:44:56.892285] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-03T17:44:56.941065] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:44:57.292810] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:57.590710] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-03T17:44:58.390618] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-03T17:44:58.424128] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:44:59.190637] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-03T17:44:59.302629] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:44:59.344061] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:44:59.990693] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-03T17:45:00.790684] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-03T17:45:00.862698] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:45:01.590703] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-03T17:45:01.779856] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:45:01.828733] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:45:02.390734] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-03T17:45:03.190704] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-03T17:45:03.351811] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T17:45:03.862000] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:45:03.990684] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-03T17:45:04.790719] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-03T17:45:05.339024] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T17:45:05.401390] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:45:05.590698] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-03T17:45:06.156250] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:45:06.158202] [INFO ] [REMOTE ] BR: Full fetch complete (49329 records). [2025-10-03T17:45:06.158316] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-03T17:45:06.397151] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-03T17:45:06.578619] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-03T17:45:06.578744] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-03T17:45:06.579440] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-03T17:45:06.579534] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-03T17:45:06.580952] [DEBUG] [LOCAL ] BR: Trimmed 49329 records to 35147 (keeping 200 days of data) [2025-10-03T17:45:06.828536] [DEBUG] [LOCAL ] BR: Primary data saved (35147 records). [2025-10-03T17:45:06.828734] [INFO ] [MAIN ] BR: Full history saved. [2025-10-03T17:45:06.828861] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 33.2s. Estimated remaining: 4h 39m 24s. Rate: 7.3 symbols/min [2025-10-03T17:45:07.022618] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:07.083594] [DEBUG] [LOCAL ] BRO: Loaded 52266 existing records from primary storage. [2025-10-03T17:45:07.084023] [INFO ] [MAIN ] BRO: Loaded 52266 existing records. [2025-10-03T17:45:07.196639] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-03T17:45:07.288128] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:07.288486] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-03T17:45:07.288566] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-03T17:45:07.291095] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-03T17:45:07.291177] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-03T17:45:07.672530] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T17:45:07.757572] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:07.990690] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-03T17:45:08.077119] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:45:08.347940] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:45:08.790693] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-03T17:45:09.590682] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-03T17:45:09.615587] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:45:09.618357] [INFO ] [REMOTE ] BRBR: Full fetch complete (72128 records). [2025-10-03T17:45:09.618490] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-03T17:45:10.064477] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-03T17:45:10.064633] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-03T17:45:10.065617] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-03T17:45:10.065725] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-03T17:45:10.067307] [DEBUG] [LOCAL ] BRBR: Trimmed 72128 records to 52061 (keeping 200 days of data) [2025-10-03T17:45:10.316755] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:45:10.392891] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-03T17:45:10.440803] [DEBUG] [LOCAL ] BRBR: Primary data saved (52061 records). [2025-10-03T17:45:10.440973] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-03T17:45:10.441069] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRBR took 33.0s. Estimated remaining: 4h 38m 47s. Rate: 7.3 symbols/min [2025-10-03T17:45:10.625636] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:10.681804] [DEBUG] [LOCAL ] BROS: Loaded 53681 existing records from primary storage. [2025-10-03T17:45:10.682180] [INFO ] [MAIN ] BROS: Loaded 53681 existing records. [2025-10-03T17:45:10.872519] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:10.872755] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-03T17:45:10.872809] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-03T17:45:10.874844] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-03T17:45:10.874912] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-03T17:45:11.192609] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-03T17:45:11.266260] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:11.365459] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:45:11.990624] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-03T17:45:12.079022] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:45:12.099996] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T17:45:12.101736] [INFO ] [REMOTE ] BRC: Full fetch complete (28887 records). [2025-10-03T17:45:12.101879] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-03T17:45:12.102502] [FATAL] [VALIDATOR ] BRC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:45:12.102613] [FATAL] [MAIN ] BRC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:45:12.102711] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:45:12.102804] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-03T17:45:12.102895] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-03T17:45:12.103133] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-10-03T17:45:12.103541] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-10-03T17:45:12.103720] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BRC took 33.0s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-03T17:45:12.308967] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:12.309177] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-03T17:45:12.309235] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-03T17:45:12.309354] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-03T17:45:12.309399] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-03T17:45:12.309444] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-03T17:45:12.309478] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-03T17:45:12.704162] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:12.790638] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-03T17:45:13.008766] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:45:13.009009] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-03T17:45:13.009110] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:45:13.009183] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-03T17:45:13.009259] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:45:13.009350] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-03T17:45:13.009426] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-03T17:45:13.009469] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-03T17:45:13.009510] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-03T17:45:13.009558] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 37m 6s. Rate: 7.4 symbols/min [2025-10-03T17:45:13.196701] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:13.196933] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-03T17:45:13.196989] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-03T17:45:13.197102] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-03T17:45:13.197144] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-03T17:45:13.197185] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-03T17:45:13.197259] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-03T17:45:13.599981] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:13.593033] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-03T17:45:13.771011] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:45:14.390622] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-03T17:45:15.181251] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:45:15.190621] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-03T17:45:15.736723] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:45:15.990699] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-03T17:45:16.790720] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-03T17:45:16.838770] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T17:45:17.590708] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-03T17:45:17.837949] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:45:18.390678] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-03T17:45:18.819879] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:45:19.190697] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-03T17:45:19.295771] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:45:19.990685] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-03T17:45:20.155890] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T17:45:20.679093] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:45:20.790704] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-03T17:45:20.921726] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T17:45:21.590735] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-03T17:45:22.390679] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-03T17:45:22.499497] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:45:22.999927] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:45:23.190737] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-03T17:45:23.987446] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:45:23.997402] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-03T17:45:24.555407] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:45:24.790731] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-03T17:45:25.452444] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:45:25.590724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-03T17:45:26.390671] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-03T17:45:26.837242] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T17:45:27.063338] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:45:27.190794] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-03T17:45:27.990719] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-03T17:45:28.267884] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:45:28.790675] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-03T17:45:28.964300] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:45:29.344316] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T17:45:29.590758] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-03T17:45:30.390632] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-03T17:45:30.495533] [DEBUG] [REMOTE ] BRCC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T17:45:30.495913] [WARN ] [REMOTE ] BRCC: No data returned for month 2025-09 [2025-10-03T17:45:30.496010] [FATAL] [REMOTE ] BRCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:45:30.496096] [FATAL] [MAIN ] BRCC: Failed to fetch primary data. [2025-10-03T17:45:30.496160] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:45:30.496232] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-03T17:45:30.496298] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-03T17:45:30.496335] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-03T17:45:30.496595] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-03T17:45:30.496710] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 34.1s. Estimated remaining: 4h 37m 55s. Rate: 7.3 symbols/min [2025-10-03T17:45:30.692961] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:30.693612] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-03T17:45:30.694150] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-03T17:45:30.712987] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-03T17:45:30.726058] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-03T17:45:30.732768] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:45:30.762257] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-03T17:45:30.762851] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-03T17:45:30.823954] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T17:45:31.176340] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:31.190721] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-03T17:45:31.990727] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-03T17:45:32.801621] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-03T17:45:32.826928] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:45:33.381913] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:45:33.590752] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-03T17:45:33.618963] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:45:34.390703] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-03T17:45:35.090467] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:45:35.096340] [INFO ] [REMOTE ] BRO: Full fetch complete (74272 records). [2025-10-03T17:45:35.096473] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-03T17:45:35.195804] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-03T17:45:35.517391] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-03T17:45:35.517486] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-03T17:45:35.518348] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-03T17:45:35.518539] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-03T17:45:35.520315] [DEBUG] [LOCAL ] BRO: Trimmed 74272 records to 52641 (keeping 200 days of data) [2025-10-03T17:45:35.872142] [DEBUG] [LOCAL ] BRO: Primary data saved (52641 records). [2025-10-03T17:45:35.872286] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-03T17:45:35.872376] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRO took 29.0s. Estimated remaining: 4h 37m 30s. Rate: 7.3 symbols/min [2025-10-03T17:45:35.991314] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-03T17:45:36.080720] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:36.106959] [DEBUG] [LOCAL ] BRW: Loaded 20369 existing records from primary storage. [2025-10-03T17:45:36.107448] [INFO ] [MAIN ] BRW: Loaded 20369 existing records. [2025-10-03T17:45:36.326909] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:36.327469] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-03T17:45:36.327713] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-03T17:45:36.328221] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-03T17:45:36.328320] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-03T17:45:36.478066] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:45:36.706800] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:45:36.794924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-03T17:45:36.796609] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:45:36.869455] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:37.360143] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:45:37.590721] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-03T17:45:38.390715] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-03T17:45:39.190712] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-03T17:45:39.629414] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T17:45:39.791270] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:45:39.990722] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-03T17:45:39.994849] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:45:40.790732] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-03T17:45:41.431751] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T17:45:41.590706] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-03T17:45:42.158296] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T17:45:42.390630] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-03T17:45:42.787734] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T17:45:43.190738] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-03T17:45:43.943189] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T17:45:43.990662] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-03T17:45:44.440179] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T17:45:44.593877] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T17:45:44.790713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-03T17:45:45.590733] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-03T17:45:46.222868] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T17:45:46.242683] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T17:45:46.390712] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-03T17:45:47.190719] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-03T17:45:47.990730] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-03T17:45:48.339265] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T17:45:48.342803] [INFO ] [REMOTE ] BROS: Full fetch complete (77050 records). [2025-10-03T17:45:48.342998] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-03T17:45:48.789091] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T17:45:48.794485] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-03T17:45:48.869635] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-03T17:45:48.869803] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-03T17:45:48.870706] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-03T17:45:48.871335] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-03T17:45:48.888537] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:45:48.894805] [DEBUG] [LOCAL ] BROS: Trimmed 77050 records to 54071 (keeping 200 days of data) [2025-10-03T17:45:49.236625] [DEBUG] [LOCAL ] BROS: Primary data saved (54071 records). [2025-10-03T17:45:49.236816] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-03T17:45:49.236923] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BROS took 38.8s. Estimated remaining: 4h 37m 53s. Rate: 7.3 symbols/min [2025-10-03T17:45:49.436287] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:49.493039] [DEBUG] [LOCAL ] BRX: Loaded 52084 existing records from primary storage. [2025-10-03T17:45:49.493418] [INFO ] [MAIN ] BRX: Loaded 52084 existing records. [2025-10-03T17:45:49.595736] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-03T17:45:49.685761] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:45:49.748790] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:49.749033] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-03T17:45:49.749090] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-03T17:45:49.749782] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-03T17:45:49.749845] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-03T17:45:50.153970] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:50.390730] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-03T17:45:51.009540] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:45:51.039814] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T17:45:51.041885] [INFO ] [REMOTE ] BRSP: Full fetch complete (54192 records). [2025-10-03T17:45:51.041989] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-03T17:45:51.195847] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-03T17:45:51.461033] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-03T17:45:51.461166] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-03T17:45:51.461914] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-03T17:45:51.461982] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-03T17:45:51.463179] [DEBUG] [LOCAL ] BRSP: Trimmed 54192 records to 37343 (keeping 200 days of data) [2025-10-03T17:45:51.698802] [DEBUG] [LOCAL ] BRSP: Primary data saved (37343 records). [2025-10-03T17:45:51.698954] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-03T17:45:51.699071] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BRSP took 38.7s. Estimated remaining: 4h 37m 10s. Rate: 7.3 symbols/min [2025-10-03T17:45:51.906427] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:51.906632] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T17:45:51.908352] [INFO ] [REMOTE ] BRT: Full fetch complete (6803 records). [2025-10-03T17:45:51.908443] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-03T17:45:51.994765] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-03T17:45:52.201268] [DEBUG] [LOCAL ] BSAC: Loaded 33243 existing records from primary storage. [2025-10-03T17:45:52.226045] [INFO ] [MAIN ] BSAC: Loaded 33243 existing records. [2025-10-03T17:45:52.573517] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-03T17:45:52.573233] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:52.573718] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-03T17:45:52.573899] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-03T17:45:52.574297] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-03T17:45:52.574397] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-03T17:45:52.574543] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-03T17:45:52.574799] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-03T17:45:52.574875] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-03T17:45:52.636753] [DEBUG] [LOCAL ] BRT: Trimmed 6803 records to 5030 (keeping 200 days of data) [2025-10-03T17:45:52.793304] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-03T17:45:52.989070] [DEBUG] [LOCAL ] BRT: Primary data saved (5030 records). [2025-10-03T17:45:53.005407] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-03T17:45:53.021972] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRT took 22.5s. Estimated remaining: 4h 36m 21s. Rate: 7.4 symbols/min [2025-10-03T17:45:53.196862] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:53.269422] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T17:45:53.437067] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:53.502382] [DEBUG] [LOCAL ] BSBR: Loaded 35696 existing records from primary storage. [2025-10-03T17:45:53.502912] [INFO ] [MAIN ] BSBR: Loaded 35696 existing records. [2025-10-03T17:45:53.602015] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-03T17:45:53.794755] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:53.795103] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-03T17:45:53.795188] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-03T17:45:53.796841] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-03T17:45:53.796927] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-03T17:45:54.283007] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:54.390735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-03T17:45:54.800531] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T17:45:54.851734] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:45:55.190711] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-03T17:45:55.441017] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T17:45:55.990629] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-03T17:45:56.306997] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:45:56.790738] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-03T17:45:56.918920] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T17:45:57.590705] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-03T17:45:57.699232] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T17:45:58.390699] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-03T17:45:58.575679] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T17:45:59.190689] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-03T17:45:59.990612] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-03T17:46:00.034777] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:46:00.074735] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:46:00.790688] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-03T17:46:00.999886] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T17:46:01.590737] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-03T17:46:02.390751] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-03T17:46:02.479490] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:46:03.002064] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:46:03.190685] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-03T17:46:03.445203] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:46:03.990687] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-03T17:46:04.636787] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:46:04.790706] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-03T17:46:05.038606] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:46:05.590633] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-03T17:46:05.993550] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:46:06.390689] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-03T17:46:06.988712] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:46:07.190696] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-03T17:46:07.893064] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:46:07.990687] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-03T17:46:08.537613] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T17:46:08.790698] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-03T17:46:09.318086] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T17:46:09.590689] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-03T17:46:10.390665] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-03T17:46:10.740510] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T17:46:11.159718] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:46:11.190661] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-03T17:46:11.458815] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:46:11.990718] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-03T17:46:12.566862] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:46:12.790714] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-03T17:46:13.314470] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:46:13.590663] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-03T17:46:14.056444] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T17:46:14.390738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-03T17:46:14.867859] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:46:15.190742] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-03T17:46:15.741576] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:46:15.743783] [INFO ] [REMOTE ] BRW: Full fetch complete (30542 records). [2025-10-03T17:46:15.743878] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-03T17:46:16.000495] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-03T17:46:16.146383] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-03T17:46:16.146470] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-03T17:46:16.146921] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-03T17:46:16.147017] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-03T17:46:16.147917] [DEBUG] [LOCAL ] BRW: Trimmed 30542 records to 20684 (keeping 200 days of data) [2025-10-03T17:46:16.275942] [DEBUG] [LOCAL ] BRW: Primary data saved (20684 records). [2025-10-03T17:46:16.276080] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-03T17:46:16.276170] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRW took 40.4s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-03T17:46:16.487269] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:16.487585] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-03T17:46:16.487685] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-03T17:46:16.487851] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-03T17:46:16.487897] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-03T17:46:16.487941] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-03T17:46:16.487977] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-03T17:46:16.793955] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-03T17:46:16.867440] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:16.997838] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:46:17.590690] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-03T17:46:17.690935] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:46:17.942859] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:46:18.390758] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-03T17:46:18.486670] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T17:46:19.190726] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-03T17:46:19.443937] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:46:19.446008] [INFO ] [REMOTE ] BSAC: Full fetch complete (44003 records). [2025-10-03T17:46:19.446094] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-03T17:46:19.851426] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-03T17:46:19.851521] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-03T17:46:19.852133] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-03T17:46:19.852213] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-03T17:46:19.853383] [DEBUG] [LOCAL ] BSAC: Trimmed 44003 records to 33459 (keeping 200 days of data) [2025-10-03T17:46:20.014796] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-03T17:46:20.068499] [DEBUG] [LOCAL ] BSAC: Primary data saved (33459 records). [2025-10-03T17:46:20.068728] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-03T17:46:20.068857] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BSAC took 28.4s. Estimated remaining: 4h 37m 9s. Rate: 7.3 symbols/min [2025-10-03T17:46:20.264507] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:20.264796] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-03T17:46:20.264850] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-03T17:46:20.264968] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-03T17:46:20.265033] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-03T17:46:20.265097] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-03T17:46:20.265132] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-03T17:46:20.674617] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:20.676144] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:46:20.790708] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-03T17:46:21.121011] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:46:21.590728] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-03T17:46:21.626861] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:46:22.390724] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-03T17:46:22.864983] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T17:46:23.190766] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-03T17:46:23.192897] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T17:46:23.990735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-03T17:46:24.790711] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-03T17:46:24.943208] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T17:46:25.302338] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T17:46:25.383004] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:46:25.590703] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-03T17:46:26.390719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-03T17:46:26.725017] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T17:46:27.190724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-03T17:46:27.830876] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:46:27.990719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-03T17:46:28.603905] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T17:46:28.606047] [INFO ] [REMOTE ] BSBR: Full fetch complete (50706 records). [2025-10-03T17:46:28.606157] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-03T17:46:28.796367] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-03T17:46:29.067716] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-03T17:46:29.067816] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-03T17:46:29.068425] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-03T17:46:29.068495] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-03T17:46:29.069984] [DEBUG] [LOCAL ] BSBR: Trimmed 50706 records to 35923 (keeping 200 days of data) [2025-10-03T17:46:29.277732] [DEBUG] [LOCAL ] BSBR: Primary data saved (35923 records). [2025-10-03T17:46:29.277889] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-03T17:46:29.278464] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BSBR took 36.2s. Estimated remaining: 4h 37m 6s. Rate: 7.3 symbols/min [2025-10-03T17:46:29.483192] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:29.483419] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-03T17:46:29.483469] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-03T17:46:29.483822] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-03T17:46:29.483875] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-03T17:46:29.483920] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-03T17:46:29.483966] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-03T17:46:29.591117] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-03T17:46:29.829800] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:46:29.862600] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:46:29.958986] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:30.390719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-03T17:46:30.915898] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:46:31.190688] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-03T17:46:31.990740] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-03T17:46:32.221815] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T17:46:32.239001] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:46:32.654976] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T17:46:32.790721] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-03T17:46:33.590709] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-03T17:46:34.115406] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T17:46:34.117847] [INFO ] [REMOTE ] BRX: Full fetch complete (74571 records). [2025-10-03T17:46:34.118045] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-03T17:46:34.119123] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:46:34.119250] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:46:34.119320] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:46:34.119393] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-03T17:46:34.119477] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-03T17:46:34.119535] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-10-03T17:46:34.119906] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-10-03T17:46:34.120040] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BRX took 44.9s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-03T17:46:34.317923] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:34.323979] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-03T17:46:34.324827] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T17:46:34.324451] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-03T17:46:34.327462] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-03T17:46:34.327851] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-03T17:46:34.327912] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-03T17:46:34.327948] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-03T17:46:34.395890] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-03T17:46:34.733353] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:34.809788] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T17:46:35.190736] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-03T17:46:35.987270] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T17:46:35.990602] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-03T17:46:36.728179] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T17:46:36.729914] [INFO ] [REMOTE ] BSL: Full fetch complete (12771 records). [2025-10-03T17:46:36.730037] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-03T17:46:36.799396] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-03T17:46:37.139779] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-03T17:46:37.139865] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-03T17:46:37.140169] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-03T17:46:37.140210] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-03T17:46:37.140719] [DEBUG] [LOCAL ] BSL: Trimmed 12771 records to 8434 (keeping 200 days of data) [2025-10-03T17:46:37.194628] [DEBUG] [LOCAL ] BSL: Primary data saved (8434 records). [2025-10-03T17:46:37.194796] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-03T17:46:37.194903] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSL took 20.9s. Estimated remaining: 4h 35m 60s. Rate: 7.3 symbols/min [2025-10-03T17:46:37.375953] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:37.432485] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-03T17:46:37.432942] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-03T17:46:37.600329] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-03T17:46:37.636475] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:46:37.636789] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-03T17:46:37.636868] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-03T17:46:37.638835] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-03T17:46:37.638931] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-03T17:46:38.032375] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:38.046106] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:46:38.390680] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-03T17:46:38.918780] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:46:39.190715] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-03T17:46:39.938472] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:46:39.990635] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-03T17:46:40.302915] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:46:40.790680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-03T17:46:41.018696] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:46:41.590637] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-03T17:46:41.827838] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:46:42.390711] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-03T17:46:42.899918] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:46:43.190718] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-03T17:46:43.990714] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-03T17:46:44.288846] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T17:46:44.593938] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:46:44.790700] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-03T17:46:45.161780] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:46:45.590719] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-03T17:46:46.390741] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-03T17:46:46.733139] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T17:46:47.065208] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T17:46:47.190772] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-03T17:46:47.594982] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:46:47.990710] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-03T17:46:48.660191] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:46:48.790725] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-03T17:46:48.991054] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:46:49.590723] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-03T17:46:50.390694] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-03T17:46:50.918890] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T17:46:50.949683] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:46:50.997082] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T17:46:51.190707] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-03T17:46:51.990675] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-03T17:46:52.355056] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T17:46:52.790630] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-03T17:46:53.590667] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-03T17:46:53.916254] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T17:46:54.235847] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:46:54.390749] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-03T17:46:54.771880] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T17:46:55.190697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-03T17:46:55.561326] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T17:46:55.990715] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-03T17:46:56.790632] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-03T17:46:57.063681] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:46:57.183617] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T17:46:57.590740] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-03T17:46:58.171827] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:46:58.390705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-03T17:46:58.486967] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:46:59.190712] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-03T17:46:59.990776] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-03T17:47:00.271876] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T17:47:00.329448] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:47:00.790736] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-03T17:47:00.964493] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T17:47:01.590790] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-03T17:47:01.837766] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:47:01.839521] [INFO ] [REMOTE ] BSM: Full fetch complete (47199 records). [2025-10-03T17:47:01.839637] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-03T17:47:01.841505] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:01.841849] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:01.841928] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:01.842009] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-03T17:47:01.842100] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-03T17:47:01.842161] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-03T17:47:01.842222] [DEBUG] [LOCAL ] BSM: No derivative data file found to delete. [2025-10-03T17:47:01.842340] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSM took 41.8s. Estimated remaining: 4h 37m 29s. Rate: 7.3 symbols/min [2025-10-03T17:47:02.030299] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:02.030575] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-10-03T17:47:02.030634] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-10-03T17:47:02.030762] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-03T17:47:02.030830] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-03T17:47:02.030894] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-03T17:47:02.030930] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-03T17:47:02.395932] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-03T17:47:02.458910] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:02.672244] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T17:47:03.190760] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-03T17:47:03.990694] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-03T17:47:04.250109] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T17:47:04.251834] [INFO ] [REMOTE ] BST: Full fetch complete (28810 records). [2025-10-03T17:47:04.251944] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-03T17:47:04.788488] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-03T17:47:04.788736] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-03T17:47:04.789491] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-03T17:47:04.789586] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-03T17:47:04.790742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-03T17:47:04.792753] [DEBUG] [LOCAL ] BST: Trimmed 28810 records to 19287 (keeping 200 days of data) [2025-10-03T17:47:04.951042] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T17:47:04.995913] [DEBUG] [LOCAL ] BST: Primary data saved (19287 records). [2025-10-03T17:47:04.996147] [INFO ] [MAIN ] BST: Full history saved. [2025-10-03T17:47:04.996266] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BST took 35.7s. Estimated remaining: 4h 36m 51s. Rate: 7.3 symbols/min [2025-10-03T17:47:05.184050] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:05.205362] [DEBUG] [LOCAL ] BTCM: Loaded 15505 existing records from primary storage. [2025-10-03T17:47:05.205787] [INFO ] [MAIN ] BTCM: Loaded 15505 existing records. [2025-10-03T17:47:05.397354] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:05.397868] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-03T17:47:05.409003] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-03T17:47:05.416076] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-03T17:47:05.416152] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-03T17:47:05.422352] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T17:47:05.592154] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-03T17:47:05.758299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T17:47:05.874760] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:06.390708] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-03T17:47:06.845630] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T17:47:07.190680] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-03T17:47:07.608579] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:47:07.990728] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-03T17:47:08.507494] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:47:08.790699] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-03T17:47:08.852793] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T17:47:09.590737] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-03T17:47:10.308371] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:47:10.390734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-03T17:47:10.899200] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T17:47:11.190671] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-03T17:47:11.232754] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T17:47:11.990730] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-03T17:47:12.792942] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:47:12.791789] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-03T17:47:13.072502] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T17:47:13.392722] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:47:13.590736] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-03T17:47:14.257454] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T17:47:14.390689] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-03T17:47:15.190710] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-03T17:47:15.878250] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T17:47:15.990728] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-03T17:47:16.153030] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:47:16.155533] [INFO ] [REMOTE ] BSX: Full fetch complete (77309 records). [2025-10-03T17:47:16.155708] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-03T17:47:16.157825] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:16.157929] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:16.157989] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:16.158080] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-03T17:47:16.158168] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-03T17:47:16.158238] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-03T17:47:16.158729] [DEBUG] [LOCAL ] BSX: Deleted derivative data file. [2025-10-03T17:47:16.158912] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BSX took 39.0s. Estimated remaining: 4h 37m 0s. Rate: 7.3 symbols/min [2025-10-03T17:47:16.366864] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:16.427196] [DEBUG] [LOCAL ] BTE: Loaded 53107 existing records from primary storage. [2025-10-03T17:47:16.427568] [INFO ] [MAIN ] BTE: Loaded 53107 existing records. [2025-10-03T17:47:16.630087] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:16.630310] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-03T17:47:16.630360] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-03T17:47:16.630853] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-03T17:47:16.630913] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-03T17:47:16.750565] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:47:16.800985] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-03T17:47:17.056025] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:17.590724] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-03T17:47:17.858781] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T17:47:17.861394] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36783 records). [2025-10-03T17:47:17.861493] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-03T17:47:18.267548] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-03T17:47:18.267639] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-03T17:47:18.268160] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-03T17:47:18.268208] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-03T17:47:18.269800] [DEBUG] [LOCAL ] BSTZ: Trimmed 36783 records to 25154 (keeping 200 days of data) [2025-10-03T17:47:18.392547] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-03T17:47:18.438594] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25154 records). [2025-10-03T17:47:18.438761] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-03T17:47:18.438860] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSTZ took 44.3s. Estimated remaining: 4h 36m 17s. Rate: 7.3 symbols/min [2025-10-03T17:47:18.627943] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:18.694329] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-10-03T17:47:18.694790] [INFO ] [MAIN ] BTI: Loaded 53946 existing records. [2025-10-03T17:47:18.898398] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:18.899473] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-03T17:47:18.899885] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-03T17:47:18.899792] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T17:47:18.901989] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-03T17:47:18.902408] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-03T17:47:19.192081] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-03T17:47:19.305887] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:19.512687] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:47:19.990672] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-03T17:47:20.791192] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:47:20.791310] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-03T17:47:21.424704] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T17:47:21.464000] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T17:47:21.590721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-03T17:47:22.390737] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-03T17:47:23.189597] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:47:23.193913] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-03T17:47:23.990745] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-03T17:47:24.488715] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T17:47:24.758560] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-03T17:47:24.790636] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-03T17:47:25.590696] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-03T17:47:25.846685] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T17:47:26.293122] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T17:47:26.390707] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-03T17:47:26.628423] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:47:27.190727] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-03T17:47:27.990688] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-03T17:47:28.058111] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:47:28.643943] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T17:47:28.790705] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-03T17:47:29.282583] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T17:47:29.590742] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-03T17:47:30.390637] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-03T17:47:30.627117] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:47:30.833889] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:47:30.835469] [INFO ] [REMOTE ] BTCM: Full fetch complete (19483 records). [2025-10-03T17:47:30.835553] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-03T17:47:31.197638] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-03T17:47:31.237059] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-03T17:47:31.237140] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-03T17:47:31.237509] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-03T17:47:31.237550] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-03T17:47:31.238210] [DEBUG] [LOCAL ] BTCM: Trimmed 19483 records to 15705 (keeping 200 days of data) [2025-10-03T17:47:31.337341] [DEBUG] [LOCAL ] BTCM: Primary data saved (15705 records). [2025-10-03T17:47:31.337493] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-03T17:47:31.337584] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTCM took 26.3s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-03T17:47:31.515596] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:31.527222] [DEBUG] [LOCAL ] BTO: Loaded 8811 existing records from primary storage. [2025-10-03T17:47:31.527476] [INFO ] [MAIN ] BTO: Loaded 8811 existing records. [2025-10-03T17:47:31.731662] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:31.731900] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-03T17:47:31.731950] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-03T17:47:31.732168] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-03T17:47:31.732226] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-03T17:47:32.002251] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-03T17:47:32.151610] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:32.535787] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T17:47:32.737357] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T17:47:32.793918] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-03T17:47:32.800251] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:47:33.590689] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-03T17:47:34.390678] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-03T17:47:34.518112] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:47:34.774961] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T17:47:34.992511] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:47:35.190707] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-03T17:47:35.990688] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-03T17:47:36.790735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-03T17:47:37.379758] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-03T17:47:37.398982] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T17:47:37.590703] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-03T17:47:37.727902] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T17:47:38.365021] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:47:38.390733] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-03T17:47:39.157907] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:47:39.190729] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-03T17:47:39.810009] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T17:47:39.810843] [INFO ] [REMOTE ] BTA: Full fetch complete (9451 records). [2025-10-03T17:47:39.810915] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-03T17:47:39.995812] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-03T17:47:40.199459] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-03T17:47:40.199541] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-03T17:47:40.199791] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-03T17:47:40.199853] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-03T17:47:40.200296] [DEBUG] [LOCAL ] BTA: Trimmed 9451 records to 5450 (keeping 200 days of data) [2025-10-03T17:47:40.235389] [DEBUG] [LOCAL ] BTA: Primary data saved (5450 records). [2025-10-03T17:47:40.235535] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-03T17:47:40.235616] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BTA took 38.4s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-03T17:47:40.438609] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:40.438839] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-03T17:47:40.438931] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-03T17:47:40.439062] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-03T17:47:40.439108] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-03T17:47:40.439152] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-03T17:47:40.439185] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-03T17:47:40.796694] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-03T17:47:40.845541] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:41.590710] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-03T17:47:41.703019] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:47:41.995196] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:47:42.390730] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-03T17:47:43.190711] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-03T17:47:43.594222] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:47:43.647168] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:47:43.990685] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-03T17:47:44.014371] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T17:47:44.790670] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-03T17:47:44.944067] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T17:47:45.590705] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-03T17:47:46.390699] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-03T17:47:46.790536] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:47:47.190459] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:47:47.190632] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-03T17:47:47.353355] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:47:47.990717] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-03T17:47:48.790730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-03T17:47:49.309047] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T17:47:49.533352] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T17:47:49.590665] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-03T17:47:49.769575] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:47:50.328377] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T17:47:50.390698] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-03T17:47:51.190701] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-03T17:47:51.859985] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:47:51.862189] [INFO ] [REMOTE ] BTE: Full fetch complete (75696 records). [2025-10-03T17:47:51.862314] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-03T17:47:51.863275] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:51.863400] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:51.863685] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:51.863766] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-03T17:47:51.863849] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-03T17:47:51.863908] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-03T17:47:51.864163] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-03T17:47:51.864264] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BTE took 35.7s. Estimated remaining: 4h 36m 44s. Rate: 7.3 symbols/min [2025-10-03T17:47:51.995740] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-03T17:47:52.064860] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T17:47:52.065824] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:52.068914] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-03T17:47:52.068973] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-03T17:47:52.069085] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-03T17:47:52.069133] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-03T17:47:52.069179] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-03T17:47:52.069214] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-03T17:47:52.459174] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:52.790736] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-03T17:47:53.590711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-03T17:47:53.901785] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:47:54.133475] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:47:54.390686] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-03T17:47:55.122804] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:47:55.190697] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-03T17:47:55.368086] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:47:55.814570] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T17:47:55.815565] [INFO ] [REMOTE ] BTO: Full fetch complete (13231 records). [2025-10-03T17:47:55.815662] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-03T17:47:56.001378] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-03T17:47:56.206401] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-03T17:47:56.206487] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-03T17:47:56.206837] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-03T17:47:56.206900] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-03T17:47:56.207601] [DEBUG] [LOCAL ] BTO: Trimmed 13231 records to 8859 (keeping 200 days of data) [2025-10-03T17:47:56.269496] [DEBUG] [LOCAL ] BTO: Primary data saved (8859 records). [2025-10-03T17:47:56.269676] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-03T17:47:56.269791] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTO took 24.9s. Estimated remaining: 4h 36m 14s. Rate: 7.3 symbols/min [2025-10-03T17:47:56.464854] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:56.465061] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-03T17:47:56.465100] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-03T17:47:56.465224] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-03T17:47:56.465337] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-03T17:47:56.465412] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-03T17:47:56.465463] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-03T17:47:56.795824] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-03T17:47:56.864857] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:57.590671] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-03T17:47:57.895564] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T17:47:57.898208] [INFO ] [REMOTE ] BTI: Full fetch complete (77458 records). [2025-10-03T17:47:57.898365] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-03T17:47:58.337780] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-03T17:47:58.337880] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-03T17:47:58.338824] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-03T17:47:58.338893] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-03T17:47:58.340512] [DEBUG] [LOCAL ] BTI: Trimmed 77458 records to 54336 (keeping 200 days of data) [2025-10-03T17:47:58.394253] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-03T17:47:58.581106] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T17:47:58.668752] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:47:58.708691] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-03T17:47:58.709546] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:47:58.710028] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-03T17:47:58.712203] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:47:58.714364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:47:58.714839] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-03T17:47:58.715854] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-03T17:47:58.726969] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-03T17:47:58.728712] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-03T17:47:58.728862] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTX took 2.5s. Estimated remaining: 4h 35m 33s. Rate: 7.3 symbols/min [2025-10-03T17:47:58.931971] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:58.951739] [DEBUG] [LOCAL ] BTI: Primary data saved (54336 records). [2025-10-03T17:47:58.951922] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-03T17:47:58.952016] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTI took 40.5s. Estimated remaining: 4h 34m 39s. Rate: 7.3 symbols/min [2025-10-03T17:47:59.073261] [DEBUG] [LOCAL ] BTZ: Loaded 22996 existing records from primary storage. [2025-10-03T17:47:59.084372] [INFO ] [MAIN ] BTZ: Loaded 22996 existing records. [2025-10-03T17:47:59.195764] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-03T17:47:59.248678] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:59.261026] [DEBUG] [LOCAL ] BUD: No existing data file found in primary storage. [2025-10-03T17:47:59.261087] [WARN ] [MAIN ] BUD: No existing data found, performing full refresh instead. [2025-10-03T17:47:59.267263] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-03T17:47:59.277726] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-03T17:47:59.282968] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-10-03T17:47:59.288164] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-03T17:47:59.423187] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:59.456183] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-03T17:47:59.456289] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-03T17:47:59.456563] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-03T17:47:59.456633] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-03T17:47:59.993783] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-03T17:48:00.023809] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:00.160109] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:00.790683] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-03T17:48:01.124585] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T17:48:01.311287] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:48:01.590705] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-03T17:48:02.390723] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-03T17:48:02.685550] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:48:02.821746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:48:03.190689] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-03T17:48:03.547213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:48:03.990697] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-03T17:48:04.685567] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T17:48:04.790631] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-03T17:48:05.084950] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:48:05.590689] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-03T17:48:06.155491] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:48:06.390707] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-03T17:48:07.190624] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-03T17:48:07.454944] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T17:48:07.990688] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-03T17:48:08.285566] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:48:08.307416] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:48:08.790721] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-03T17:48:09.590718] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-03T17:48:09.731837] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T17:48:09.905206] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:48:10.390696] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-03T17:48:10.747303] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T17:48:11.190697] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-03T17:48:11.276295] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:48:11.990741] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-03T17:48:12.790690] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-03T17:48:13.088981] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:48:13.590744] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-03T17:48:14.008429] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:48:14.160687] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T17:48:14.390704] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-03T17:48:14.559462] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T17:48:15.190636] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-03T17:48:15.501616] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:48:15.990728] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-03T17:48:16.790630] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-03T17:48:17.265101] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:48:17.590693] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-03T17:48:17.832737] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T17:48:17.912539] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:48:18.390701] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-03T17:48:19.190731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-03T17:48:19.272386] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:48:19.952329] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T17:48:19.990620] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-03T17:48:20.626200] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T17:48:20.790728] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-03T17:48:21.044410] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:48:21.590685] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-03T17:48:22.390704] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-03T17:48:22.459572] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:48:22.642698] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:48:23.190703] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-03T17:48:23.990725] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-03T17:48:24.287277] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T17:48:24.790749] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-03T17:48:24.918984] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:48:24.924579] [INFO ] [REMOTE ] BTT: Full fetch complete (24070 records). [2025-10-03T17:48:24.924810] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-03T17:48:25.369226] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T17:48:25.392694] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-03T17:48:25.392919] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-03T17:48:25.393429] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-03T17:48:25.393500] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-03T17:48:25.394302] [DEBUG] [LOCAL ] BTT: Trimmed 24070 records to 16174 (keeping 200 days of data) [2025-10-03T17:48:25.499026] [DEBUG] [LOCAL ] BTT: Primary data saved (16174 records). [2025-10-03T17:48:25.499183] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-03T17:48:25.499289] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTT took 45.3s. Estimated remaining: 4h 36m 16s. Rate: 7.3 symbols/min [2025-10-03T17:48:25.595863] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-03T17:48:25.731955] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:25.732141] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-03T17:48:25.732301] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-03T17:48:25.732481] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-03T17:48:25.732531] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-03T17:48:25.732575] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-03T17:48:25.732609] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-03T17:48:25.857587] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:48:25.901599] [INFO ] [REMOTE ] BTZ: Full fetch complete (33870 records). [2025-10-03T17:48:25.947800] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-03T17:48:26.307047] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:26.396482] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-03T17:48:26.590788] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-03T17:48:26.591100] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-03T17:48:26.591684] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-03T17:48:26.591750] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-03T17:48:26.592715] [DEBUG] [LOCAL ] BTZ: Trimmed 33870 records to 23173 (keeping 200 days of data) [2025-10-03T17:48:26.745826] [DEBUG] [LOCAL ] BTZ: Primary data saved (23173 records). [2025-10-03T17:48:26.745966] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-03T17:48:26.746059] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTZ took 28.0s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-03T17:48:26.932833] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:26.983018] [DEBUG] [LOCAL ] BUR: Loaded 45456 existing records from primary storage. [2025-10-03T17:48:26.983350] [INFO ] [MAIN ] BUR: Loaded 45456 existing records. [2025-10-03T17:48:27.196679] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-03T17:48:27.203375] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:27.204614] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-03T17:48:27.204707] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-03T17:48:27.205209] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-03T17:48:27.205271] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-03T17:48:27.383539] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T17:48:27.412444] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T17:48:27.510479] [INFO ] [REMOTE ] BTU: Full fetch complete (76996 records). [2025-10-03T17:48:27.529470] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-03T17:48:27.764725] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:27.995800] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-03T17:48:28.072389] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-03T17:48:28.072526] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-03T17:48:28.073452] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-03T17:48:28.073520] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-03T17:48:28.075154] [DEBUG] [LOCAL ] BTU: Trimmed 76996 records to 54088 (keeping 200 days of data) [2025-10-03T17:48:28.422334] [DEBUG] [LOCAL ] BTU: Primary data saved (54088 records). [2025-10-03T17:48:28.422482] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-03T17:48:28.422560] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 36.6s. Estimated remaining: 4h 34m 43s. Rate: 7.3 symbols/min [2025-10-03T17:48:28.601936] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:28.648372] [DEBUG] [LOCAL ] BURL: Loaded 46323 existing records from primary storage. [2025-10-03T17:48:28.648725] [INFO ] [MAIN ] BURL: Loaded 46323 existing records. [2025-10-03T17:48:28.795971] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-03T17:48:28.865168] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:28.865429] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-03T17:48:28.865483] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-03T17:48:28.865800] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-03T17:48:28.865862] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-03T17:48:28.998689] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:48:29.275859] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:29.310270] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T17:48:29.590743] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-03T17:48:30.390639] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-03T17:48:30.416450] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:48:30.915901] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:48:31.190740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-03T17:48:31.253136] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T17:48:31.990739] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-03T17:48:32.427605] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T17:48:32.790739] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-03T17:48:33.556724] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:48:33.590697] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-03T17:48:34.300866] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:48:34.390730] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-03T17:48:35.190689] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-03T17:48:35.990669] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-03T17:48:36.033472] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-03T17:48:36.102565] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:48:36.132858] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:48:36.790702] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-03T17:48:37.600228] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-03T17:48:37.607004] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:48:37.993305] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:48:38.390724] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-03T17:48:38.656841] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:48:39.190692] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-03T17:48:39.990676] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-03T17:48:40.043790] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T17:48:40.192918] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:48:40.790723] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-03T17:48:41.590639] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-03T17:48:41.923339] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:48:42.390720] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-03T17:48:42.748724] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:48:42.973048] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:48:42.975752] [INFO ] [REMOTE ] BUD: Full fetch complete (76475 records). [2025-10-03T17:48:42.975874] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-03T17:48:43.192323] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-03T17:48:43.318856] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T17:48:43.425021] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-03T17:48:43.425112] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-03T17:48:43.425938] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-03T17:48:43.426007] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-03T17:48:43.427539] [DEBUG] [LOCAL ] BUD: Trimmed 76475 records to 53478 (keeping 200 days of data) [2025-10-03T17:48:43.779849] [DEBUG] [LOCAL ] BUD: Primary data saved (53478 records). [2025-10-03T17:48:43.780060] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-03T17:48:43.780179] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BUD took 44.8s. Estimated remaining: 4h 35m 15s. Rate: 7.3 symbols/min [2025-10-03T17:48:43.978395] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:43.994925] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-03T17:48:43.995358] [DEBUG] [LOCAL ] BUXX: Loaded 15276 existing records from primary storage. [2025-10-03T17:48:43.996367] [INFO ] [MAIN ] BUXX: Loaded 15276 existing records. [2025-10-03T17:48:44.195148] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:44.195389] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-03T17:48:44.195440] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-03T17:48:44.195758] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-03T17:48:44.195819] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-03T17:48:44.590300] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:44.790639] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-03T17:48:44.956917] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:48:45.023460] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T17:48:45.590692] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-03T17:48:46.390789] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-03T17:48:46.434263] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:48:46.516947] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:48:46.954591] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T17:48:47.190715] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-03T17:48:47.990701] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-03T17:48:48.790737] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-03T17:48:48.959495] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T17:48:49.590736] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-03T17:48:49.684432] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:48:49.791630] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:48:50.390742] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-03T17:48:51.195797] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-03T17:48:51.218965] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T17:48:51.990679] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-03T17:48:52.013512] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:48:52.014778] [INFO ] [REMOTE ] BUI: Full fetch complete (16438 records). [2025-10-03T17:48:52.014853] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-03T17:48:52.429609] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-03T17:48:52.429723] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-03T17:48:52.430091] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-03T17:48:52.430153] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-03T17:48:52.430721] [DEBUG] [LOCAL ] BUI: Trimmed 16438 records to 11813 (keeping 200 days of data) [2025-10-03T17:48:52.512201] [DEBUG] [LOCAL ] BUI: Primary data saved (11813 records). [2025-10-03T17:48:52.512341] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-03T17:48:52.512432] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BUI took 27.0s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-03T17:48:52.648499] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-03T17:48:52.790686] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-03T17:48:53.599469] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-03T17:48:53.605806] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:48:54.367448] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:48:54.390709] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-03T17:48:54.438004] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T17:48:55.132342] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:48:55.190679] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-03T17:48:55.980390] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:48:55.990618] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-03T17:48:56.790634] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-03T17:48:57.085341] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T17:48:57.590681] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-03T17:48:58.390683] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-03T17:48:58.467409] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:48:58.632072] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T17:48:59.190704] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-03T17:48:59.731786] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:48:59.734042] [INFO ] [REMOTE ] BUR: Full fetch complete (63475 records). [2025-10-03T17:48:59.734138] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-03T17:48:59.998441] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-03T17:49:00.149264] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-03T17:49:00.149380] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-03T17:49:00.150204] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-03T17:49:00.150294] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-03T17:49:00.161629] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T17:49:00.166923] [DEBUG] [LOCAL ] BUR: Trimmed 63475 records to 45747 (keeping 200 days of data) [2025-10-03T17:49:00.456938] [DEBUG] [LOCAL ] BUR: Primary data saved (45747 records). [2025-10-03T17:49:00.457078] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-03T17:49:00.458455] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUR took 33.7s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-03T17:49:00.790716] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-03T17:49:01.713922] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T17:49:01.718624] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-03T17:49:01.804778] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:49:02.390723] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-03T17:49:02.570082] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T17:49:03.190743] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-03T17:49:03.769108] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:49:03.772316] [INFO ] [REMOTE ] BURL: Full fetch complete (65640 records). [2025-10-03T17:49:03.772489] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-03T17:49:04.229456] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-03T17:49:04.234354] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-03T17:49:04.235466] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-03T17:49:04.235597] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-03T17:49:04.237204] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:49:04.241587] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-03T17:49:04.243132] [DEBUG] [LOCAL ] BURL: Trimmed 65640 records to 46622 (keeping 200 days of data) [2025-10-03T17:49:04.542996] [DEBUG] [LOCAL ] BURL: Primary data saved (46622 records). [2025-10-03T17:49:04.543146] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-03T17:49:04.543235] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BURL took 36.1s. Estimated remaining: 4h 34m 29s. Rate: 7.3 symbols/min [2025-10-03T17:49:05.219107] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:49:05.220275] [INFO ] [REMOTE ] BUXX: Full fetch complete (20359 records). [2025-10-03T17:49:05.220350] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-03T17:49:05.643397] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-03T17:49:05.643492] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-03T17:49:05.643919] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-03T17:49:05.644027] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-03T17:49:05.644824] [DEBUG] [LOCAL ] BUXX: Trimmed 20359 records to 15366 (keeping 200 days of data) [2025-10-03T17:49:05.749725] [DEBUG] [LOCAL ] BUXX: Primary data saved (15366 records). [2025-10-03T17:49:05.749880] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-03T17:49:05.749976] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUXX took 22.0s. Estimated remaining: 4h 33m 42s. Rate: 7.3 symbols/min [2025-10-03T17:49:06.431349] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.574089] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.550958] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.579396] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.698253] [DEBUG] [LOCAL ] BV: Loaded 38582 existing records from primary storage. [2025-10-03T17:49:06.701485] [DEBUG] [LOCAL ] BWA: Loaded 52569 existing records from primary storage. [2025-10-03T17:49:06.701724] [INFO ] [MAIN ] BV: Loaded 38582 existing records. [2025-10-03T17:49:06.700514] [DEBUG] [LOCAL ] BW: Loaded 40202 existing records from primary storage. [2025-10-03T17:49:06.713690] [INFO ] [MAIN ] BW: Loaded 40202 existing records. [2025-10-03T17:49:06.719942] [INFO ] [MAIN ] BWA: Loaded 52569 existing records. [2025-10-03T17:49:06.874010] [DEBUG] [LOCAL ] BVN: Loaded 44365 existing records from primary storage. [2025-10-03T17:49:07.052517] [INFO ] [MAIN ] BVN: Loaded 44365 existing records. [2025-10-03T17:49:07.366245] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.326756] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.424182] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.413749] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.429580] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-03T17:49:07.444350] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.429509] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-03T17:49:07.450199] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-03T17:49:07.471099] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-03T17:49:07.455545] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.476463] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-03T17:49:07.507828] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-03T17:49:07.549828] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-03T17:49:07.573866] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-03T17:49:07.590812] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-03T17:49:07.685837] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.708127] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.774297] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-03T17:49:07.936868] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-03T17:49:08.083298] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-03T17:49:08.742692] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:08.804902] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-03T17:49:08.837679] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:08.921431] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-03T17:49:09.117493] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:09.123475] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-03T17:49:09.203439] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:09.203798] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-03T17:49:10.305925] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T17:49:10.313378] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-03T17:49:10.661732] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:49:10.672433] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-03T17:49:10.701825] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:49:10.713164] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-03T17:49:10.747259] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:49:10.758632] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-03T17:49:11.544076] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T17:49:11.550886] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-03T17:49:12.230046] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:49:12.239540] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-03T17:49:12.268949] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:49:12.346729] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:49:12.790630] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-03T17:49:12.954521] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:49:13.590675] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-03T17:49:13.810939] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T17:49:14.390673] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-03T17:49:14.433150] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:49:15.051553] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:49:15.190721] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-03T17:49:15.869709] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:49:15.990729] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-03T17:49:16.586833] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:49:16.790775] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-03T17:49:17.401232] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:49:17.590693] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-03T17:49:18.390674] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-03T17:49:18.458089] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:49:19.190686] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-03T17:49:19.431243] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:49:19.867910] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:49:19.990747] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-03T17:49:20.731965] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:49:20.790716] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-03T17:49:21.590713] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-03T17:49:21.952625] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:49:22.022739] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:49:22.390690] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-03T17:49:23.190709] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-03T17:49:23.794371] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-03T17:49:23.829506] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:49:23.990694] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-03T17:49:24.614255] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:49:24.790711] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-03T17:49:25.117441] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T17:49:25.590747] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-03T17:49:26.383296] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T17:49:26.391366] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-03T17:49:27.051953] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:49:27.190721] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-03T17:49:27.990699] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-03T17:49:28.169733] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T17:49:28.641587] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:49:28.790737] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-03T17:49:29.209417] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:49:29.590728] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-03T17:49:30.037754] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:49:30.040112] [INFO ] [REMOTE ] BV: Full fetch complete (54247 records). [2025-10-03T17:49:30.040223] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-03T17:49:30.404192] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-03T17:49:30.470972] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-03T17:49:30.471107] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-03T17:49:30.471781] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-03T17:49:30.471847] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-03T17:49:30.473251] [DEBUG] [LOCAL ] BV: Trimmed 54247 records to 38880 (keeping 200 days of data) [2025-10-03T17:49:30.711150] [DEBUG] [LOCAL ] BV: Primary data saved (38880 records). [2025-10-03T17:49:30.711311] [INFO ] [MAIN ] BV: Full history saved. [2025-10-03T17:49:30.711434] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BV took 25.0s. Estimated remaining: 4h 35m 7s. Rate: 7.3 symbols/min [2025-10-03T17:49:30.900944] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:30.916355] [DEBUG] [LOCAL ] BWG: Loaded 12660 existing records from primary storage. [2025-10-03T17:49:30.916590] [INFO ] [MAIN ] BWG: Loaded 12660 existing records. [2025-10-03T17:49:31.109564] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:31.109913] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-03T17:49:31.109985] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-03T17:49:31.110222] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-03T17:49:31.110294] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-03T17:49:31.202272] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-03T17:49:31.214917] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:49:31.528795] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:31.990626] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-03T17:49:32.101468] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:49:32.743677] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T17:49:32.790627] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-03T17:49:33.488718] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:49:33.590692] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-03T17:49:34.107949] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:49:34.390727] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-03T17:49:34.601524] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:49:35.190695] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-03T17:49:35.990635] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-03T17:49:36.139531] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:49:36.551054] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T17:49:36.553754] [INFO ] [REMOTE ] BVN: Full fetch complete (62892 records). [2025-10-03T17:49:36.553930] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-03T17:49:36.799624] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-03T17:49:36.983414] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-03T17:49:36.983547] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-03T17:49:36.984723] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-03T17:49:36.984796] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-03T17:49:36.986871] [DEBUG] [LOCAL ] BVN: Trimmed 62892 records to 44704 (keeping 200 days of data) [2025-10-03T17:49:37.264979] [DEBUG] [LOCAL ] BVN: Primary data saved (44704 records). [2025-10-03T17:49:37.265177] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-03T17:49:37.265325] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BVN took 31.5s. Estimated remaining: 4h 34m 50s. Rate: 7.3 symbols/min [2025-10-03T17:49:37.457610] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:37.491775] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:49:37.538668] [DEBUG] [LOCAL ] BWLP: Loaded 32667 existing records from primary storage. [2025-10-03T17:49:37.539119] [INFO ] [MAIN ] BWLP: Loaded 32667 existing records. [2025-10-03T17:49:37.595887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-03T17:49:37.763862] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:37.764280] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-03T17:49:37.764351] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-03T17:49:37.764860] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-03T17:49:37.764940] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-03T17:49:38.183476] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:38.390725] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-03T17:49:38.575759] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:49:38.600299] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:49:39.190712] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-03T17:49:39.853133] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:49:39.934703] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:49:39.990730] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-03T17:49:40.790746] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-03T17:49:41.592628] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-03T17:49:41.596448] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T17:49:41.707383] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:49:42.390692] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-03T17:49:43.058833] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:49:43.190713] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-03T17:49:43.990630] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-03T17:49:44.103869] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:49:44.538254] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:49:44.790705] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-03T17:49:44.865079] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T17:49:45.590706] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-03T17:49:46.163709] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:49:46.390706] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-03T17:49:47.189117] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:49:47.191098] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-03T17:49:47.192688] [INFO ] [REMOTE ] BWA: Full fetch complete (75720 records). [2025-10-03T17:49:47.192776] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-03T17:49:47.635606] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-03T17:49:47.635755] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-03T17:49:47.636810] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-03T17:49:47.636938] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-03T17:49:47.638730] [DEBUG] [LOCAL ] BWA: Trimmed 75720 records to 52955 (keeping 200 days of data) [2025-10-03T17:49:47.785746] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:49:48.013288] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-03T17:49:48.063688] [DEBUG] [LOCAL ] BWA: Primary data saved (52955 records). [2025-10-03T17:49:48.063929] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-03T17:49:48.064053] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BWA took 42.3s. Estimated remaining: 4h 34m 56s. Rate: 7.3 symbols/min [2025-10-03T17:49:48.250268] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:48.260256] [DEBUG] [LOCAL ] BWMX: Loaded 7725 existing records from primary storage. [2025-10-03T17:49:48.260500] [INFO ] [MAIN ] BWMX: Loaded 7725 existing records. [2025-10-03T17:49:48.449188] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:48.449442] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-03T17:49:48.449496] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-03T17:49:48.449709] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-03T17:49:48.449771] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-03T17:49:48.797758] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-03T17:49:48.833568] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:48.897939] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:49:48.902923] [INFO ] [REMOTE ] BW: Full fetch complete (58840 records). [2025-10-03T17:49:48.903066] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-03T17:49:49.027798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:49:49.337968] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-03T17:49:49.338072] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-03T17:49:49.338829] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-03T17:49:49.338913] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-03T17:49:49.340323] [DEBUG] [LOCAL ] BW: Trimmed 58840 records to 40559 (keeping 200 days of data) [2025-10-03T17:49:49.577432] [DEBUG] [LOCAL ] BW: Primary data saved (40559 records). [2025-10-03T17:49:49.577560] [INFO ] [MAIN ] BW: Full history saved. [2025-10-03T17:49:49.577665] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BW took 43.8s. Estimated remaining: 4h 34m 10s. Rate: 7.3 symbols/min [2025-10-03T17:49:49.600389] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-03T17:49:49.763075] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:49.770758] [DEBUG] [LOCAL ] BWNB: Loaded 4466 existing records from primary storage. [2025-10-03T17:49:49.770983] [INFO ] [MAIN ] BWNB: Loaded 4466 existing records. [2025-10-03T17:49:49.976271] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:49.976762] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-03T17:49:49.976823] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-03T17:49:49.977070] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-03T17:49:49.977130] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-03T17:49:50.361354] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:50.383213] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T17:49:50.390769] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-03T17:49:50.472568] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:49:50.902160] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T17:49:51.190659] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-03T17:49:51.671271] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:49:51.990692] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-03T17:49:52.790673] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-03T17:49:52.914952] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T17:49:53.590683] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-03T17:49:53.653072] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:49:54.390721] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-03T17:49:54.928205] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T17:49:54.971490] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:49:55.190681] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-03T17:49:55.750027] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T17:49:55.990679] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-03T17:49:56.547211] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:49:56.790730] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-03T17:49:57.590680] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-03T17:49:57.733860] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T17:49:58.132093] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T17:49:58.390699] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-03T17:49:59.001226] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T17:49:59.190676] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-03T17:49:59.990633] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-03T17:50:00.085373] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:50:00.790697] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-03T17:50:01.590726] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-03T17:50:01.675121] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:50:01.805341] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:50:01.806797] [INFO ] [REMOTE ] BWG: Full fetch complete (17921 records). [2025-10-03T17:50:01.806878] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-03T17:50:02.161583] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:50:02.247443] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-03T17:50:02.247538] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-03T17:50:02.247917] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-03T17:50:02.247982] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-03T17:50:02.248734] [DEBUG] [LOCAL ] BWG: Trimmed 17921 records to 12694 (keeping 200 days of data) [2025-10-03T17:50:02.333679] [DEBUG] [LOCAL ] BWG: Primary data saved (12694 records). [2025-10-03T17:50:02.333873] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-03T17:50:02.333972] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BWG took 31.6s. Estimated remaining: 4h 34m 27s. Rate: 7.3 symbols/min [2025-10-03T17:50:02.395841] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-03T17:50:02.548728] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:02.558253] [DEBUG] [LOCAL ] BWSN: Loaded 5127 existing records from primary storage. [2025-10-03T17:50:02.558594] [INFO ] [MAIN ] BWSN: Loaded 5127 existing records. [2025-10-03T17:50:02.794251] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:02.794511] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-03T17:50:02.794592] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-03T17:50:02.794950] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-03T17:50:02.795035] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-03T17:50:03.125678] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:50:03.201621] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-03T17:50:03.208630] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:03.770087] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:50:03.990751] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-03T17:50:04.579758] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T17:50:04.790725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-03T17:50:05.407525] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:50:05.590739] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-03T17:50:06.390702] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-03T17:50:06.820719] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T17:50:07.057949] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:50:07.190727] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-03T17:50:07.788562] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:50:07.990739] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-03T17:50:08.547637] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:50:08.790703] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-03T17:50:09.224816] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:50:09.590698] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-03T17:50:10.130784] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T17:50:10.390754] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-03T17:50:11.190695] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-03T17:50:11.952073] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:50:11.954339] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T17:50:11.962337] [INFO ] [REMOTE ] BWNB: Full fetch complete (5722 records). [2025-10-03T17:50:11.962881] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-03T17:50:11.997722] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-03T17:50:12.397281] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-03T17:50:12.397365] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-03T17:50:12.397553] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-03T17:50:12.397596] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-03T17:50:12.398169] [DEBUG] [LOCAL ] BWNB: Trimmed 5722 records to 4475 (keeping 200 days of data) [2025-10-03T17:50:12.427756] [DEBUG] [LOCAL ] BWNB: Primary data saved (4475 records). [2025-10-03T17:50:12.427900] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-03T17:50:12.427988] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWNB took 22.9s. Estimated remaining: 4h 34m 29s. Rate: 7.3 symbols/min [2025-10-03T17:50:12.617308] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:12.663026] [DEBUG] [LOCAL ] BWXT: Loaded 47232 existing records from primary storage. [2025-10-03T17:50:12.663352] [INFO ] [MAIN ] BWXT: Loaded 47232 existing records. [2025-10-03T17:50:12.779173] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T17:50:12.791989] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-03T17:50:12.865254] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:12.865439] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-03T17:50:12.865488] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-03T17:50:12.865789] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-03T17:50:12.865849] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-03T17:50:13.265164] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:13.590631] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-03T17:50:13.672820] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T17:50:14.314761] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:50:14.390743] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-03T17:50:15.190748] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-03T17:50:15.527184] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:50:15.529217] [INFO ] [REMOTE ] BWLP: Full fetch complete (48133 records). [2025-10-03T17:50:15.529315] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-03T17:50:15.947915] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-03T17:50:15.948007] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-03T17:50:15.948787] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-03T17:50:15.948859] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-03T17:50:15.951730] [DEBUG] [LOCAL ] BWLP: Trimmed 48133 records to 32876 (keeping 200 days of data) [2025-10-03T17:50:16.005786] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-03T17:50:16.163799] [DEBUG] [LOCAL ] BWLP: Primary data saved (32876 records). [2025-10-03T17:50:16.163957] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-03T17:50:16.165721] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWLP took 38.9s. Estimated remaining: 4h 33m 57s. Rate: 7.3 symbols/min [2025-10-03T17:50:16.351236] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:16.411940] [DEBUG] [LOCAL ] BX: Loaded 53877 existing records from primary storage. [2025-10-03T17:50:16.412292] [INFO ] [MAIN ] BX: Loaded 53877 existing records. [2025-10-03T17:50:16.602049] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:16.602268] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-03T17:50:16.602321] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-03T17:50:16.602594] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-03T17:50:16.602683] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-03T17:50:16.791819] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-03T17:50:16.945992] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:50:17.020295] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:17.126065] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T17:50:17.590754] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-03T17:50:17.599080] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T17:50:18.390711] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-03T17:50:19.190637] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-03T17:50:19.406688] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T17:50:19.973437] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T17:50:19.990699] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-03T17:50:20.790743] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-03T17:50:20.982690] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-03T17:50:21.590631] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-03T17:50:21.645030] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:50:21.673174] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T17:50:22.390719] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-03T17:50:22.723753] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:50:23.190727] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-03T17:50:23.990695] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-03T17:50:24.166830] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:50:24.790732] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-03T17:50:24.880570] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:50:25.105532] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:50:25.590750] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-03T17:50:26.223241] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T17:50:26.390456] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T17:50:26.390625] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-03T17:50:27.064922] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T17:50:27.190716] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-03T17:50:27.720448] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:50:27.990737] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-03T17:50:28.790741] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-03T17:50:29.590674] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-03T17:50:29.929371] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:50:30.150443] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T17:50:30.151620] [INFO ] [REMOTE ] BWMX: Full fetch complete (10053 records). [2025-10-03T17:50:30.151749] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-03T17:50:30.401569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-03T17:50:30.609803] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-03T17:50:30.610013] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-03T17:50:30.610323] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-03T17:50:30.610399] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-03T17:50:30.637457] [DEBUG] [LOCAL ] BWMX: Trimmed 10053 records to 7749 (keeping 200 days of data) [2025-10-03T17:50:30.644283] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:50:30.705213] [DEBUG] [LOCAL ] BWMX: Primary data saved (7749 records). [2025-10-03T17:50:30.705360] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-03T17:50:30.705494] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWMX took 42.6s. Estimated remaining: 4h 34m 23s. Rate: 7.3 symbols/min [2025-10-03T17:50:30.894972] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:30.910451] [DEBUG] [LOCAL ] BXC: Loaded 13732 existing records from primary storage. [2025-10-03T17:50:30.910747] [INFO ] [MAIN ] BXC: Loaded 13732 existing records. [2025-10-03T17:50:31.120721] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:31.120995] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-03T17:50:31.121056] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-03T17:50:31.121234] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-03T17:50:31.121292] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-03T17:50:31.195874] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-03T17:50:31.548720] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:31.990638] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-03T17:50:32.477484] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T17:50:32.790731] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-03T17:50:32.847744] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:50:33.195383] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T17:50:33.196873] [INFO ] [REMOTE ] BWSN: Full fetch complete (6300 records). [2025-10-03T17:50:33.197001] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-03T17:50:33.591995] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-03T17:50:33.693249] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-03T17:50:33.693373] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-03T17:50:33.693766] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-03T17:50:33.693906] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-03T17:50:33.694773] [DEBUG] [LOCAL ] BWSN: Trimmed 6300 records to 5290 (keeping 200 days of data) [2025-10-03T17:50:33.734089] [DEBUG] [LOCAL ] BWSN: Primary data saved (5290 records). [2025-10-03T17:50:33.734263] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-03T17:50:33.734470] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWSN took 31.4s. Estimated remaining: 4h 33m 47s. Rate: 7.3 symbols/min [2025-10-03T17:50:33.947858] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-03T17:50:33.967264] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:34.025771] [DEBUG] [LOCAL ] BXMT: Loaded 47578 existing records from primary storage. [2025-10-03T17:50:34.026137] [INFO ] [MAIN ] BXMT: Loaded 47578 existing records. [2025-10-03T17:50:34.223036] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:34.223268] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-03T17:50:34.223318] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-03T17:50:34.223634] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-03T17:50:34.223751] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-03T17:50:34.395056] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-03T17:50:34.564912] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:50:34.651118] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:35.190704] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-03T17:50:35.977411] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:50:35.990627] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-03T17:50:36.296516] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T17:50:36.790706] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-03T17:50:36.854912] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T17:50:37.590730] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-03T17:50:38.390723] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-03T17:50:38.622338] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:50:38.675412] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:50:39.190719] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-03T17:50:39.990714] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-03T17:50:40.511200] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:50:40.790781] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-03T17:50:40.949430] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:50:41.068944] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T17:50:41.590793] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-03T17:50:42.390681] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-03T17:50:42.474582] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T17:50:42.657005] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:50:43.190714] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-03T17:50:43.990765] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-03T17:50:44.116119] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:50:44.790675] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-03T17:50:44.873102] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:50:44.876059] [INFO ] [REMOTE ] BWXT: Full fetch complete (67557 records). [2025-10-03T17:50:44.876183] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-03T17:50:45.237038] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:50:45.314399] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-03T17:50:45.314522] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-03T17:50:45.315449] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-03T17:50:45.315523] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-03T17:50:45.317512] [DEBUG] [LOCAL ] BWXT: Trimmed 67557 records to 47600 (keeping 200 days of data) [2025-10-03T17:50:45.590706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-03T17:50:45.660737] [DEBUG] [LOCAL ] BWXT: Primary data saved (47600 records). [2025-10-03T17:50:45.660929] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-03T17:50:45.661049] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BWXT took 33.2s. Estimated remaining: 4h 33m 58s. Rate: 7.3 symbols/min [2025-10-03T17:50:45.844701] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:45.867834] [DEBUG] [LOCAL ] BXMX: Loaded 19738 existing records from primary storage. [2025-10-03T17:50:45.868168] [INFO ] [MAIN ] BXMX: Loaded 19738 existing records. [2025-10-03T17:50:46.064770] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:46.065553] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-03T17:50:46.065617] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-03T17:50:46.066138] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-03T17:50:46.066202] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-03T17:50:46.390956] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-03T17:50:46.463598] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:46.499837] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:50:47.190748] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-03T17:50:47.374547] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:50:47.740326] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T17:50:47.990714] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-03T17:50:48.470719] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T17:50:48.790720] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-03T17:50:48.820609] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:50:49.590694] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-03T17:50:50.390721] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-03T17:50:50.869771] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T17:50:50.915179] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:50:51.190700] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-03T17:50:51.366750] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T17:50:51.990704] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-03T17:50:52.722093] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T17:50:52.723211] [INFO ] [REMOTE ] BXC: Full fetch complete (17952 records). [2025-10-03T17:50:52.723305] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-03T17:50:52.792758] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-03T17:50:53.036399] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:50:53.195537] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-03T17:50:53.195627] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-03T17:50:53.196051] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-03T17:50:53.196114] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-03T17:50:53.196721] [DEBUG] [LOCAL ] BXC: Trimmed 17952 records to 13793 (keeping 200 days of data) [2025-10-03T17:50:53.277635] [DEBUG] [LOCAL ] BXC: Primary data saved (13793 records). [2025-10-03T17:50:53.277811] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-03T17:50:53.277930] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BXC took 22.6s. Estimated remaining: 4h 33m 47s. Rate: 7.3 symbols/min [2025-10-03T17:50:53.458255] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:53.516368] [DEBUG] [LOCAL ] BXP: Loaded 50225 existing records from primary storage. [2025-10-03T17:50:53.516774] [INFO ] [MAIN ] BXP: Loaded 50225 existing records. [2025-10-03T17:50:53.597130] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-03T17:50:53.730735] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:53.731149] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-03T17:50:53.731218] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-03T17:50:53.731506] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-03T17:50:53.731564] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-03T17:50:54.119978] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:54.390712] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-03T17:50:54.719988] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:50:54.869042] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T17:50:55.190693] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-03T17:50:55.990633] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-03T17:50:56.143219] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:50:56.790692] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-03T17:50:56.954476] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:50:57.590698] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-03T17:50:58.095966] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T17:50:58.143869] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T17:50:58.390718] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-03T17:50:59.192981] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-03T17:50:59.199258] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:50:59.985829] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:50:59.996040] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-03T17:51:00.486759] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T17:51:00.790633] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-03T17:51:01.570192] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:51:01.590711] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-03T17:51:01.787235] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:51:02.390729] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-03T17:51:03.190677] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-03T17:51:03.322870] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T17:51:03.419405] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:51:03.990710] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-03T17:51:04.790709] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-03T17:51:04.820546] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:51:04.823998] [INFO ] [REMOTE ] BX: Full fetch complete (77408 records). [2025-10-03T17:51:04.824158] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-03T17:51:05.259308] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-03T17:51:05.259400] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-03T17:51:05.260225] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-03T17:51:05.260296] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-03T17:51:05.261954] [DEBUG] [LOCAL ] BX: Trimmed 77408 records to 54266 (keeping 200 days of data) [2025-10-03T17:51:05.607104] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-03T17:51:05.643204] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T17:51:05.682743] [DEBUG] [LOCAL ] BX: Primary data saved (54266 records). [2025-10-03T17:51:05.682911] [INFO ] [MAIN ] BX: Full history saved. [2025-10-03T17:51:05.683798] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BX took 49.5s. Estimated remaining: 4h 34m 1s. Rate: 7.3 symbols/min [2025-10-03T17:51:05.833900] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:51:05.889959] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:05.953107] [DEBUG] [LOCAL ] BXSL: Loaded 48025 existing records from primary storage. [2025-10-03T17:51:05.953457] [INFO ] [MAIN ] BXSL: Loaded 48025 existing records. [2025-10-03T17:51:06.147318] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:06.147619] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-03T17:51:06.147706] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-03T17:51:06.148012] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-03T17:51:06.148085] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-03T17:51:06.397898] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-03T17:51:06.543475] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:07.190703] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-03T17:51:07.539014] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:51:07.990706] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-03T17:51:08.118958] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:51:08.410028] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:51:08.790723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-03T17:51:09.590729] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-03T17:51:09.726740] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:51:10.390689] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-03T17:51:10.542200] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:51:11.190710] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-03T17:51:11.203518] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T17:51:11.206123] [INFO ] [REMOTE ] BXMT: Full fetch complete (69673 records). [2025-10-03T17:51:11.206333] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-03T17:51:11.639573] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-03T17:51:11.639692] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-03T17:51:11.640546] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-03T17:51:11.640622] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-03T17:51:11.642312] [DEBUG] [LOCAL ] BXMT: Trimmed 69673 records to 47953 (keeping 200 days of data) [2025-10-03T17:51:11.955820] [DEBUG] [LOCAL ] BXMT: Primary data saved (47953 records). [2025-10-03T17:51:11.955972] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-03T17:51:11.957380] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BXMT took 38.2s. Estimated remaining: 4h 33m 43s. Rate: 7.3 symbols/min [2025-10-03T17:51:11.995568] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-03T17:51:12.160200] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:12.194213] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:51:12.223295] [DEBUG] [LOCAL ] BY: Loaded 21841 existing records from primary storage. [2025-10-03T17:51:12.223573] [INFO ] [MAIN ] BY: Loaded 21841 existing records. [2025-10-03T17:51:12.347384] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T17:51:12.433372] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:12.433665] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-03T17:51:12.433730] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-03T17:51:12.433979] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-03T17:51:12.434038] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-03T17:51:12.795847] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-03T17:51:12.836270] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:13.590671] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-03T17:51:13.763056] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:51:13.838258] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:51:14.390702] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-03T17:51:15.188379] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:51:15.192442] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-03T17:51:15.316801] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:51:15.318397] [INFO ] [REMOTE ] BXMX: Full fetch complete (29077 records). [2025-10-03T17:51:15.318476] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-03T17:51:15.717230] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-03T17:51:15.717314] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-03T17:51:15.717780] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-03T17:51:15.717847] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-03T17:51:15.719186] [DEBUG] [LOCAL ] BXMX: Trimmed 29077 records to 19909 (keeping 200 days of data) [2025-10-03T17:51:15.846134] [DEBUG] [LOCAL ] BXMX: Primary data saved (19909 records). [2025-10-03T17:51:15.846286] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-03T17:51:15.846407] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXMX took 30.2s. Estimated remaining: 4h 33m 11s. Rate: 7.3 symbols/min [2025-10-03T17:51:16.005481] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-03T17:51:16.043783] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:16.093591] [DEBUG] [LOCAL ] BYD: Loaded 45277 existing records from primary storage. [2025-10-03T17:51:16.093973] [INFO ] [MAIN ] BYD: Loaded 45277 existing records. [2025-10-03T17:51:16.311089] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:16.311322] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-03T17:51:16.311383] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-03T17:51:16.311704] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-03T17:51:16.311767] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-03T17:51:16.715233] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:16.790699] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-03T17:51:16.891403] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T17:51:17.448699] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:51:17.590696] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-03T17:51:18.390682] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-03T17:51:18.496743] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:51:18.937201] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:51:19.190738] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-03T17:51:19.990637] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-03T17:51:20.098045] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:51:20.442477] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:51:20.790637] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-03T17:51:21.111400] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T17:51:21.590728] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-03T17:51:22.390717] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-03T17:51:22.396110] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:51:23.190753] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-03T17:51:23.263358] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:51:23.463030] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T17:51:23.990776] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-03T17:51:24.800862] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-03T17:51:24.807735] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:51:24.830104] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:51:25.590705] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-03T17:51:26.390701] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-03T17:51:26.557360] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:51:26.638562] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:51:27.190716] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-03T17:51:27.990670] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-03T17:51:28.148027] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:51:28.150717] [INFO ] [REMOTE ] BXP: Full fetch complete (71614 records). [2025-10-03T17:51:28.150869] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-03T17:51:28.642831] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-03T17:51:28.643190] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-03T17:51:28.645639] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:51:28.644590] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-03T17:51:28.652512] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-03T17:51:28.655238] [DEBUG] [LOCAL ] BXP: Trimmed 71614 records to 50590 (keeping 200 days of data) [2025-10-03T17:51:28.790827] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-03T17:51:28.996395] [DEBUG] [LOCAL ] BXP: Primary data saved (50590 records). [2025-10-03T17:51:28.996564] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-03T17:51:28.996735] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXP took 35.7s. Estimated remaining: 4h 33m 29s. Rate: 7.3 symbols/min [2025-10-03T17:51:29.189698] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:29.189876] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-10-03T17:51:29.189915] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-10-03T17:51:29.190082] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-03T17:51:29.190136] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-03T17:51:29.190181] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-03T17:51:29.190215] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-03T17:51:29.584540] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:29.590614] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-03T17:51:29.668352] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:51:29.932348] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:51:30.342436] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:51:30.390676] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-03T17:51:31.050012] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:51:31.190731] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-03T17:51:31.990769] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-03T17:51:32.744011] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:51:32.790668] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-03T17:51:33.590697] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-03T17:51:33.698944] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:51:33.989458] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:51:34.390760] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-03T17:51:34.865365] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:51:35.190712] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-03T17:51:35.990693] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-03T17:51:36.090913] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:51:36.474536] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T17:51:36.773200] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:51:36.790629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-03T17:51:37.590768] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-03T17:51:37.765264] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:51:38.390768] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-03T17:51:39.189334] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:51:39.191669] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-03T17:51:39.476365] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T17:51:39.990725] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-03T17:51:40.693239] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:51:40.790707] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-03T17:51:40.861278] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T17:51:41.590773] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-03T17:51:42.381224] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T17:51:42.385288] [INFO ] [REMOTE ] BXSL: Full fetch complete (69490 records). [2025-10-03T17:51:42.385414] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-03T17:51:42.398133] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-03T17:51:42.579987] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:51:42.856231] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-03T17:51:42.856338] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-03T17:51:42.857733] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-03T17:51:42.857808] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-03T17:51:42.859477] [DEBUG] [LOCAL ] BXSL: Trimmed 69490 records to 48413 (keeping 200 days of data) [2025-10-03T17:51:43.173961] [DEBUG] [LOCAL ] BXSL: Primary data saved (48413 records). [2025-10-03T17:51:43.174143] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-03T17:51:43.174263] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 37.5s. Estimated remaining: 4h 33m 53s. Rate: 7.3 symbols/min [2025-10-03T17:51:43.197267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-03T17:51:43.375598] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:43.412368] [DEBUG] [LOCAL ] BZH: Loaded 32621 existing records from primary storage. [2025-10-03T17:51:43.412816] [INFO ] [MAIN ] BZH: Loaded 32621 existing records. [2025-10-03T17:51:43.618590] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T17:51:43.702127] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:43.702368] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-03T17:51:43.702422] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-03T17:51:43.704375] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-03T17:51:43.704454] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-03T17:51:43.996244] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-03T17:51:44.092824] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:44.790711] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-03T17:51:45.134489] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:51:45.140039] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:51:45.151412] [INFO ] [REMOTE ] BY: Full fetch complete (29594 records). [2025-10-03T17:51:45.152328] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-03T17:51:45.543422] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-03T17:51:45.543560] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-03T17:51:45.544217] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-03T17:51:45.544287] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-03T17:51:45.545623] [DEBUG] [LOCAL ] BY: Trimmed 29594 records to 21972 (keeping 200 days of data) [2025-10-03T17:51:45.599751] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-03T17:51:45.692290] [DEBUG] [LOCAL ] BY: Primary data saved (21972 records). [2025-10-03T17:51:45.692481] [INFO ] [MAIN ] BY: Full history saved. [2025-10-03T17:51:45.692608] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 33.7s. Estimated remaining: 4h 33m 14s. Rate: 7.3 symbols/min [2025-10-03T17:51:45.874220] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:45.936931] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-03T17:51:45.937683] [INFO ] [MAIN ] C: Loaded 54130 existing records. [2025-10-03T17:51:46.132845] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:46.133370] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-03T17:51:46.133477] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-03T17:51:46.154074] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T17:51:46.160191] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-03T17:51:46.160977] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-03T17:51:46.393904] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-03T17:51:46.494271] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T17:51:46.559601] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:47.190776] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-03T17:51:47.990693] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-03T17:51:48.166966] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:51:48.790708] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-03T17:51:48.815023] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T17:51:48.855709] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:51:49.590709] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-03T17:51:49.821134] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T17:51:50.390691] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-03T17:51:50.411495] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:51:51.190753] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-03T17:51:51.990634] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-03T17:51:52.510447] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T17:51:52.702813] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:51:52.790766] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-03T17:51:53.470119] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:51:53.590673] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-03T17:51:54.390724] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-03T17:51:54.991164] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:51:55.045553] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-03T17:51:55.190697] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-03T17:51:55.526319] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:51:55.529404] [INFO ] [REMOTE ] BYD: Full fetch complete (65096 records). [2025-10-03T17:51:55.529591] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-03T17:51:55.976492] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-03T17:51:55.976585] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-03T17:51:55.977342] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-03T17:51:55.977432] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-03T17:51:55.979021] [DEBUG] [LOCAL ] BYD: Trimmed 65096 records to 45568 (keeping 200 days of data) [2025-10-03T17:51:56.034618] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-03T17:51:56.106853] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:51:56.277841] [DEBUG] [LOCAL ] BYD: Primary data saved (45568 records). [2025-10-03T17:51:56.278004] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-03T17:51:56.278109] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BYD took 40.4s. Estimated remaining: 4h 33m 18s. Rate: 7.3 symbols/min [2025-10-03T17:51:56.458943] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:56.480379] [DEBUG] [LOCAL ] CAAP: Loaded 20146 existing records from primary storage. [2025-10-03T17:51:56.480696] [INFO ] [MAIN ] CAAP: Loaded 20146 existing records. [2025-10-03T17:51:56.681119] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:56.681323] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-03T17:51:56.681371] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-03T17:51:56.681598] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-03T17:51:56.681697] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-03T17:51:56.790832] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-03T17:51:57.065223] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:57.584406] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:51:57.592252] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-03T17:51:58.390723] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-03T17:51:58.408017] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T17:51:58.743016] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T17:51:59.190737] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-03T17:51:59.542831] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T17:51:59.990718] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-03T17:52:00.562297] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:52:00.790701] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-03T17:52:01.005888] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:52:01.590735] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-03T17:52:02.390734] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-03T17:52:02.905170] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:52:03.052778] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-03T17:52:03.190663] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-03T17:52:03.201430] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T17:52:03.990701] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-03T17:52:04.790728] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-03T17:52:05.318522] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:52:05.481246] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-03T17:52:05.525625] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:52:05.590675] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-03T17:52:06.390711] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-03T17:52:06.658610] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:52:07.190727] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-03T17:52:07.990783] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-03T17:52:08.055232] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:52:08.056349] [INFO ] [REMOTE ] BYM: Full fetch complete (18044 records). [2025-10-03T17:52:08.056424] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-03T17:52:08.463910] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-03T17:52:08.464096] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-03T17:52:08.464482] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-03T17:52:08.464595] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-03T17:52:08.465746] [DEBUG] [LOCAL ] BYM: Trimmed 18044 records to 12190 (keeping 200 days of data) [2025-10-03T17:52:08.565181] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T17:52:08.598875] [DEBUG] [LOCAL ] BYM: Primary data saved (12190 records). [2025-10-03T17:52:08.599040] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-03T17:52:08.599140] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BYM took 39.6s. Estimated remaining: 4h 33m 32s. Rate: 7.3 symbols/min [2025-10-03T17:52:08.785851] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:08.790725] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-03T17:52:08.806857] [DEBUG] [LOCAL ] CABO: Loaded 17118 existing records from primary storage. [2025-10-03T17:52:08.807139] [INFO ] [MAIN ] CABO: Loaded 17118 existing records. [2025-10-03T17:52:09.014297] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:09.014575] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-03T17:52:09.014624] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-03T17:52:09.014943] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-03T17:52:09.015002] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-03T17:52:09.413597] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:09.493538] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:52:09.535539] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T17:52:09.590681] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-03T17:52:10.390675] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-03T17:52:10.992820] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T17:52:11.190706] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-03T17:52:11.281937] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:52:11.990717] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-03T17:52:12.781048] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T17:52:12.790613] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-03T17:52:13.415564] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-03T17:52:13.507495] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:52:13.590683] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-03T17:52:14.390705] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-03T17:52:14.611758] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:52:15.023187] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:52:15.190716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-03T17:52:15.990729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-03T17:52:16.158282] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T17:52:16.790711] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-03T17:52:17.590666] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-03T17:52:17.703739] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T17:52:18.350389] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T17:52:18.390692] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-03T17:52:18.626744] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T17:52:19.190736] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-03T17:52:19.521701] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:52:19.990721] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-03T17:52:20.740234] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:52:20.790758] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-03T17:52:21.345464] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:52:21.347488] [INFO ] [REMOTE ] BZH: Full fetch complete (46939 records). [2025-10-03T17:52:21.347625] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-03T17:52:21.595872] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-03T17:52:21.787913] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-03T17:52:21.788034] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-03T17:52:21.788839] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-03T17:52:21.788910] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-03T17:52:21.790354] [DEBUG] [LOCAL ] BZH: Trimmed 46939 records to 32801 (keeping 200 days of data) [2025-10-03T17:52:21.882604] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:52:21.885704] [INFO ] [REMOTE ] CAAP: Full fetch complete (27863 records). [2025-10-03T17:52:21.885825] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-03T17:52:22.338158] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-03T17:52:22.341459] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-03T17:52:22.342354] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-03T17:52:22.342442] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-03T17:52:22.348727] [DEBUG] [LOCAL ] CAAP: Trimmed 27863 records to 20340 (keeping 200 days of data) [2025-10-03T17:52:22.401396] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-03T17:52:22.527043] [DEBUG] [LOCAL ] BZH: Primary data saved (32801 records). [2025-10-03T17:52:22.528411] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-03T17:52:22.529055] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. BZH took 39.4s. Estimated remaining: 4h 33m 53s. Rate: 7.3 symbols/min [2025-10-03T17:52:22.736073] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:22.775856] [DEBUG] [LOCAL ] CACI: Loaded 24689 existing records from primary storage. [2025-10-03T17:52:22.776848] [INFO ] [MAIN ] CACI: Loaded 24689 existing records. [2025-10-03T17:52:22.776957] [DEBUG] [LOCAL ] CAAP: Primary data saved (20340 records). [2025-10-03T17:52:22.829364] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-03T17:52:22.847975] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. CAAP took 26.6s. Estimated remaining: 4h 33m 3s. Rate: 7.3 symbols/min [2025-10-03T17:52:23.092410] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:23.098028] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-03T17:52:23.098701] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-03T17:52:23.159143] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:52:23.154929] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-03T17:52:23.185893] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-03T17:52:23.195081] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-03T17:52:23.189706] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:23.570674] [DEBUG] [LOCAL ] CADE: Loaded 49221 existing records from primary storage. [2025-10-03T17:52:23.596630] [INFO ] [MAIN ] CADE: Loaded 49221 existing records. [2025-10-03T17:52:23.706576] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:23.830625] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:23.830934] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-03T17:52:23.830999] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-03T17:52:23.831300] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-03T17:52:23.831360] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-03T17:52:24.009327] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-03T17:52:24.234635] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:24.306941] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T17:52:24.536239] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:52:24.790690] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-03T17:52:25.245674] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T17:52:25.590729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-03T17:52:26.390698] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-03T17:52:26.560779] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:52:27.190691] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-03T17:52:27.229235] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:52:27.231892] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-03T17:52:27.232009] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-03T17:52:27.678129] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-03T17:52:27.678291] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-03T17:52:27.679350] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-03T17:52:27.679565] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-03T17:52:27.681326] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54520 (keeping 200 days of data) [2025-10-03T17:52:27.829559] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:52:28.014579] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-03T17:52:28.070826] [DEBUG] [LOCAL ] C: Primary data saved (54520 records). [2025-10-03T17:52:28.070961] [INFO ] [MAIN ] C: Full history saved. [2025-10-03T17:52:28.072312] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. C took 42.4s. Estimated remaining: 4h 32m 39s. Rate: 7.3 symbols/min [2025-10-03T17:52:28.256033] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:28.299873] [DEBUG] [LOCAL ] CAE: Loaded 39353 existing records from primary storage. [2025-10-03T17:52:28.300191] [INFO ] [MAIN ] CAE: Loaded 39353 existing records. [2025-10-03T17:52:28.506422] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:28.506879] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-03T17:52:28.506941] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-03T17:52:28.507465] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-03T17:52:28.507550] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-03T17:52:28.796892] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-03T17:52:28.935181] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:28.951444] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T17:52:28.989797] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:52:29.590734] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-03T17:52:30.011583] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:52:30.123104] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:52:30.390718] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-03T17:52:31.190750] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-03T17:52:31.924584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:52:31.938476] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T17:52:31.939835] [INFO ] [REMOTE ] CABO: Full fetch complete (23128 records). [2025-10-03T17:52:31.939913] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-03T17:52:31.998783] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-03T17:52:32.368104] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-03T17:52:32.368200] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-03T17:52:32.368629] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-03T17:52:32.368734] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-03T17:52:32.369953] [DEBUG] [LOCAL ] CABO: Trimmed 23128 records to 17184 (keeping 200 days of data) [2025-10-03T17:52:32.484559] [DEBUG] [LOCAL ] CABO: Primary data saved (17184 records). [2025-10-03T17:52:32.484731] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-03T17:52:32.484850] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CABO took 23.9s. Estimated remaining: 4h 32m 11s. Rate: 7.3 symbols/min [2025-10-03T17:52:32.664088] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:32.670116] [DEBUG] [LOCAL ] CAF: Loaded 3421 existing records from primary storage. [2025-10-03T17:52:32.670286] [INFO ] [MAIN ] CAF: Loaded 3421 existing records. [2025-10-03T17:52:32.795754] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-03T17:52:32.867323] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:32.867585] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-03T17:52:32.867637] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-03T17:52:32.867877] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-03T17:52:32.867937] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-03T17:52:33.264538] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:33.590729] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-03T17:52:33.639526] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:52:34.397502] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-03T17:52:34.402779] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:52:34.822440] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:52:35.190700] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-03T17:52:35.310708] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T17:52:35.990707] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-03T17:52:36.716981] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:52:36.790687] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-03T17:52:37.590700] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-03T17:52:37.783441] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:52:37.842002] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:52:38.390699] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-03T17:52:38.669679] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:52:39.190708] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-03T17:52:39.990674] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-03T17:52:40.034665] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:52:40.580407] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:52:40.579307] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T17:52:40.790705] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-03T17:52:41.371521] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T17:52:41.590692] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-03T17:52:42.141340] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T17:52:42.390680] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-03T17:52:43.190627] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-03T17:52:43.429329] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:52:43.785824] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T17:52:43.990683] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-03T17:52:44.559216] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T17:52:44.790709] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-03T17:52:45.590698] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-03T17:52:45.928976] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T17:52:46.390683] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-03T17:52:47.015713] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:52:47.190692] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-03T17:52:47.226674] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:52:47.990691] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-03T17:52:48.142291] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T17:52:48.790683] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-03T17:52:49.590702] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-03T17:52:49.639771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:52:49.874482] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T17:52:50.067498] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T17:52:50.390710] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-03T17:52:51.190679] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-03T17:52:51.239048] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:52:51.240477] [INFO ] [REMOTE ] CACI: Full fetch complete (38817 records). [2025-10-03T17:52:51.240578] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-03T17:52:51.639709] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-03T17:52:51.639812] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-03T17:52:51.640326] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-03T17:52:51.640371] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-03T17:52:51.641303] [DEBUG] [LOCAL ] CACI: Trimmed 38817 records to 24817 (keeping 200 days of data) [2025-10-03T17:52:51.790962] [DEBUG] [LOCAL ] CACI: Primary data saved (24817 records). [2025-10-03T17:52:51.791094] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-03T17:52:51.791179] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. CACI took 29.3s. Estimated remaining: 4h 33m 1s. Rate: 7.3 symbols/min [2025-10-03T17:52:51.965418] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:51.995786] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-03T17:52:52.019973] [DEBUG] [LOCAL ] CAG: Loaded 54053 existing records from primary storage. [2025-10-03T17:52:52.020322] [INFO ] [MAIN ] CAG: Loaded 54053 existing records. [2025-10-03T17:52:52.221513] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:52.221829] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-03T17:52:52.221882] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-03T17:52:52.222200] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-03T17:52:52.222300] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-03T17:52:52.706470] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:52.729972] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:52:52.790677] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-03T17:52:53.590685] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-03T17:52:53.854438] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:52:54.339310] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:52:54.390710] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-03T17:52:55.100730] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:52:55.190719] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-03T17:52:55.827398] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T17:52:55.990697] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-03T17:52:56.790711] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-03T17:52:56.834813] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:52:57.585613] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T17:52:57.594533] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-03T17:52:58.019544] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T17:52:58.390670] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-03T17:52:58.522994] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:52:59.190717] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-03T17:52:59.728746] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:52:59.990704] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-03T17:53:00.613829] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:53:00.790668] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-03T17:53:01.199595] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T17:53:01.590716] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-03T17:53:02.385131] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:53:02.393742] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-03T17:53:03.190625] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-03T17:53:03.299058] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:53:03.844441] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:53:03.847185] [INFO ] [REMOTE ] CADE: Full fetch complete (70013 records). [2025-10-03T17:53:03.847325] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-03T17:53:04.002665] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-03T17:53:04.274481] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-03T17:53:04.274603] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-03T17:53:04.275474] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-03T17:53:04.275535] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-03T17:53:04.277097] [DEBUG] [LOCAL ] CADE: Trimmed 70013 records to 49604 (keeping 200 days of data) [2025-10-03T17:53:04.387163] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:53:04.394581] [INFO ] [REMOTE ] CAE: Full fetch complete (56190 records). [2025-10-03T17:53:04.399161] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-03T17:53:04.800517] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-03T17:53:04.865002] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-03T17:53:04.865612] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-03T17:53:04.867018] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-03T17:53:04.867425] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-03T17:53:04.925486] [DEBUG] [LOCAL ] CAE: Trimmed 56190 records to 39676 (keeping 200 days of data) [2025-10-03T17:53:05.180405] [DEBUG] [LOCAL ] CADE: Primary data saved (49604 records). [2025-10-03T17:53:05.181180] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-03T17:53:05.181307] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CADE took 42.3s. Estimated remaining: 4h 33m 19s. Rate: 7.3 symbols/min [2025-10-03T17:53:05.475527] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:05.490797] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T17:53:05.497911] [INFO ] [REMOTE ] CAF: Full fetch complete (5597 records). [2025-10-03T17:53:05.503799] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-03T17:53:05.561931] [DEBUG] [LOCAL ] CAE: Primary data saved (39676 records). [2025-10-03T17:53:05.584716] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-03T17:53:05.603099] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CAE took 37.5s. Estimated remaining: 4h 32m 30s. Rate: 7.3 symbols/min [2025-10-03T17:53:06.005584] [DEBUG] [LOCAL ] CAH: Loaded 51794 existing records from primary storage. [2025-10-03T17:53:06.084910] [INFO ] [MAIN ] CAH: Loaded 51794 existing records. [2025-10-03T17:53:06.084782] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:06.355259] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-03T17:53:06.379780] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-03T17:53:06.380355] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-03T17:53:06.387715] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-03T17:53:06.418049] [DEBUG] [LOCAL ] CAF: Trimmed 5597 records to 3474 (keeping 200 days of data) [2025-10-03T17:53:06.403144] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:06.452670] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-03T17:53:06.453396] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-03T17:53:06.465666] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-03T17:53:06.472984] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-03T17:53:06.465488] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-03T17:53:06.497321] [DEBUG] [LOCAL ] CAF: Primary data saved (3474 records). [2025-10-03T17:53:06.540263] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-03T17:53:06.534354] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-03T17:53:06.569416] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CAF took 34.1s. Estimated remaining: 4h 31m 45s. Rate: 7.3 symbols/min [2025-10-03T17:53:06.577575] [DEBUG] [LOCAL ] CAL: Loaded 43440 existing records from primary storage. [2025-10-03T17:53:06.613113] [INFO ] [MAIN ] CAL: Loaded 43440 existing records. [2025-10-03T17:53:07.179373] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:07.263887] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:07.294241] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-03T17:53:07.330982] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-03T17:53:07.352383] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-03T17:53:07.389697] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-03T17:53:07.459020] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:07.479117] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-03T17:53:07.561671] [DEBUG] [LOCAL ] CALX: Loaded 38123 existing records from primary storage. [2025-10-03T17:53:07.582330] [INFO ] [MAIN ] CALX: Loaded 38123 existing records. [2025-10-03T17:53:07.991023] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:08.017353] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-03T17:53:08.036988] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-03T17:53:08.070420] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-03T17:53:08.076500] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:08.076902] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-03T17:53:08.076998] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-03T17:53:08.512929] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:08.513396] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-03T17:53:08.645067] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T17:53:08.790719] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-03T17:53:09.333216] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:53:09.600217] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-03T17:53:09.602885] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T17:53:09.872466] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T17:53:10.391411] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-03T17:53:10.394992] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:53:11.190727] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-03T17:53:11.368701] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:53:11.823391] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:53:11.990726] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-03T17:53:12.593614] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:53:12.790706] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-03T17:53:13.590707] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-03T17:53:13.905185] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T17:53:14.045835] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:53:14.390731] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-03T17:53:15.083614] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T17:53:15.190737] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-03T17:53:15.990748] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-03T17:53:16.567393] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T17:53:16.790713] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-03T17:53:16.951119] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:53:17.590723] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-03T17:53:17.749460] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T17:53:17.888295] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T17:53:18.390710] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-03T17:53:19.190698] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-03T17:53:19.388003] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T17:53:19.970289] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T17:53:19.990621] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-03T17:53:20.790727] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-03T17:53:21.149505] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:53:21.486473] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:53:21.590714] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-03T17:53:22.390632] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-03T17:53:22.495898] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:53:23.190707] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-03T17:53:23.461822] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:53:23.990703] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-03T17:53:24.378171] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T17:53:24.421797] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T17:53:24.790685] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-03T17:53:25.590729] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-03T17:53:25.841365] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:53:26.390707] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-03T17:53:26.652696] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:53:26.656637] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-03T17:53:26.656878] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-03T17:53:27.108635] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-03T17:53:27.108979] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-03T17:53:27.110117] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-03T17:53:27.110202] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-03T17:53:27.140486] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:53:27.150571] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 54443 (keeping 200 days of data) [2025-10-03T17:53:27.211197] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-03T17:53:27.520741] [DEBUG] [LOCAL ] CAG: Primary data saved (54443 records). [2025-10-03T17:53:27.520939] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-03T17:53:27.522958] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAG took 35.7s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-03T17:53:27.783858] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:27.821689] [DEBUG] [LOCAL ] CANG: Loaded 27199 existing records from primary storage. [2025-10-03T17:53:27.822546] [INFO ] [MAIN ] CANG: Loaded 27199 existing records. [2025-10-03T17:53:27.992298] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-03T17:53:28.084494] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:28.085158] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-03T17:53:28.085361] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-03T17:53:28.086258] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-03T17:53:28.086341] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-03T17:53:28.640446] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-03T17:53:28.735560] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:28.770423] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:53:28.790720] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-03T17:53:29.459441] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:53:29.590699] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-03T17:53:30.237101] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:53:30.390708] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-03T17:53:30.782965] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T17:53:31.190723] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-03T17:53:31.990630] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-03T17:53:32.046860] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:53:32.790665] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-03T17:53:32.828443] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T17:53:33.384507] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T17:53:33.590795] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-03T17:53:34.390670] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-03T17:53:34.557198] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:53:35.151853] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:53:35.190728] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-03T17:53:35.834219] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:53:35.990688] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-03T17:53:36.725396] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:53:36.790633] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-03T17:53:37.203371] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:53:37.590707] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-03T17:53:38.055191] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:53:38.057748] [INFO ] [REMOTE ] CAL: Full fetch complete (61834 records). [2025-10-03T17:53:38.057857] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-03T17:53:38.393849] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-03T17:53:38.490475] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-03T17:53:38.490561] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-03T17:53:38.491270] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-03T17:53:38.491340] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-03T17:53:38.492707] [DEBUG] [LOCAL ] CAL: Trimmed 61834 records to 43747 (keeping 200 days of data) [2025-10-03T17:53:38.779585] [DEBUG] [LOCAL ] CAL: Primary data saved (43747 records). [2025-10-03T17:53:38.779746] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-03T17:53:38.779867] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAL took 33.2s. Estimated remaining: 4h 32m 49s. Rate: 7.3 symbols/min [2025-10-03T17:53:38.893417] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:53:38.921908] [INFO ] [REMOTE ] CALX: Full fetch complete (54000 records). [2025-10-03T17:53:38.945097] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-03T17:53:38.979393] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:39.118964] [DEBUG] [LOCAL ] CAPL: Loaded 5818 existing records from primary storage. [2025-10-03T17:53:39.140412] [INFO ] [MAIN ] CAPL: Loaded 5818 existing records. [2025-10-03T17:53:39.211452] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-03T17:53:39.530765] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:39.552442] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-03T17:53:39.583895] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-03T17:53:39.634144] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-03T17:53:39.634572] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-03T17:53:39.634609] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-03T17:53:39.634833] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-03T17:53:39.635599] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-03T17:53:39.641130] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-03T17:53:39.752111] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:53:39.776832] [DEBUG] [LOCAL ] CALX: Trimmed 54000 records to 38363 (keeping 200 days of data) [2025-10-03T17:53:40.001021] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-03T17:53:40.261632] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:40.318076] [DEBUG] [LOCAL ] CALX: Primary data saved (38363 records). [2025-10-03T17:53:40.318241] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-03T17:53:40.318407] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CALX took 33.7s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-03T17:53:40.490770] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:40.547083] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-10-03T17:53:40.547455] [INFO ] [MAIN ] CARR: Loaded 53984 existing records. [2025-10-03T17:53:40.752361] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:40.752891] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-03T17:53:40.752967] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-03T17:53:40.753371] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-03T17:53:40.753434] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-03T17:53:40.797139] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-03T17:53:41.285116] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:41.309777] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:53:41.353726] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:53:41.590717] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-03T17:53:41.676008] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T17:53:42.390663] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-03T17:53:42.758927] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:53:43.114965] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:53:43.190676] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-03T17:53:43.990678] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-03T17:53:44.790692] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-03T17:53:44.817489] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:53:44.820153] [INFO ] [REMOTE ] CAH: Full fetch complete (74640 records). [2025-10-03T17:53:44.820265] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-03T17:53:45.281243] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-03T17:53:45.281332] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-03T17:53:45.282290] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-03T17:53:45.282360] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-03T17:53:45.283915] [DEBUG] [LOCAL ] CAH: Trimmed 74640 records to 52181 (keeping 200 days of data) [2025-10-03T17:53:45.596599] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-03T17:53:45.616604] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:53:45.632340] [DEBUG] [LOCAL ] CAH: Primary data saved (52181 records). [2025-10-03T17:53:45.632500] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-03T17:53:45.632612] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CAH took 40.5s. Estimated remaining: 4h 31m 43s. Rate: 7.3 symbols/min [2025-10-03T17:53:45.810805] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:45.851279] [DEBUG] [LOCAL ] CARS: Loaded 40093 existing records from primary storage. [2025-10-03T17:53:45.851731] [INFO ] [MAIN ] CARS: Loaded 40093 existing records. [2025-10-03T17:53:46.053271] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:46.053724] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-03T17:53:46.053820] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-03T17:53:46.054271] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-03T17:53:46.054412] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-03T17:53:46.252714] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-03T17:53:46.395784] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-03T17:53:46.514781] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:46.923936] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T17:53:47.185878] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:53:47.190601] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-03T17:53:47.949895] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:53:47.990684] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-03T17:53:48.790731] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-03T17:53:49.399216] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T17:53:49.593704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-03T17:53:49.598118] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:53:50.390629] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-03T17:53:50.966625] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T17:53:51.190827] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-03T17:53:51.190740] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:53:51.819822] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T17:53:51.990754] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-03T17:53:52.790730] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-03T17:53:53.430952] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:53:53.590718] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-03T17:53:54.151874] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:53:54.390692] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-03T17:53:54.846700] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:53:55.190620] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-03T17:53:55.286024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:53:55.904749] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T17:53:55.990709] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-03T17:53:56.642340] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:53:56.790712] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-03T17:53:57.299825] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T17:53:57.300785] [INFO ] [REMOTE ] CAPL: Full fetch complete (8772 records). [2025-10-03T17:53:57.300870] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-03T17:53:57.595790] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-03T17:53:57.695543] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-03T17:53:57.695624] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-03T17:53:57.695873] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-03T17:53:57.695923] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-03T17:53:57.696353] [DEBUG] [LOCAL ] CAPL: Trimmed 8772 records to 5854 (keeping 200 days of data) [2025-10-03T17:53:57.733366] [DEBUG] [LOCAL ] CAPL: Primary data saved (5854 records). [2025-10-03T17:53:57.733480] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-03T17:53:57.733562] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CAPL took 19.0s. Estimated remaining: 4h 31m 54s. Rate: 7.3 symbols/min [2025-10-03T17:53:57.910374] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:57.964296] [DEBUG] [LOCAL ] CAT: Loaded 53308 existing records from primary storage. [2025-10-03T17:53:57.964623] [INFO ] [MAIN ] CAT: Loaded 53308 existing records. [2025-10-03T17:53:58.151616] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:58.151849] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-03T17:53:58.151898] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-03T17:53:58.152136] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-03T17:53:58.152195] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-03T17:53:58.401854] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-03T17:53:58.533683] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:59.136543] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:53:59.190733] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-03T17:53:59.990742] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-03T17:54:00.141244] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:54:00.790686] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-03T17:54:01.059382] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:54:01.151453] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:54:01.154624] [INFO ] [REMOTE ] CANG: Full fetch complete (40531 records). [2025-10-03T17:54:01.154753] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-03T17:54:01.579735] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-03T17:54:01.579854] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-03T17:54:01.580421] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-03T17:54:01.580485] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-03T17:54:01.581419] [DEBUG] [LOCAL ] CANG: Trimmed 40531 records to 27426 (keeping 200 days of data) [2025-10-03T17:54:01.625810] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-03T17:54:01.737375] [DEBUG] [LOCAL ] CANG: Primary data saved (27426 records). [2025-10-03T17:54:01.737528] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-03T17:54:01.737638] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CANG took 34.2s. Estimated remaining: 4h 31m 25s. Rate: 7.3 symbols/min [2025-10-03T17:54:01.928540] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:01.939523] [DEBUG] [LOCAL ] CATO: Loaded 7127 existing records from primary storage. [2025-10-03T17:54:01.939800] [INFO ] [MAIN ] CATO: Loaded 7127 existing records. [2025-10-03T17:54:02.172895] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:02.173481] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-03T17:54:02.173630] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-03T17:54:02.173971] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-03T17:54:02.174035] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-03T17:54:02.401312] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-03T17:54:02.493838] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:54:02.632861] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:03.190684] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-03T17:54:03.551275] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:54:03.872260] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T17:54:03.966752] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T17:54:03.990672] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-03T17:54:04.790695] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-03T17:54:05.453518] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:54:05.590689] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-03T17:54:06.390701] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-03T17:54:06.696109] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:54:07.190717] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-03T17:54:07.722817] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-03T17:54:07.780028] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T17:54:07.808345] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:54:07.990732] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-03T17:54:08.728749] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:54:08.790680] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-03T17:54:09.567570] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:54:09.590614] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-03T17:54:10.346941] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:54:10.390708] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-03T17:54:10.928895] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T17:54:11.190732] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-03T17:54:11.990737] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-03T17:54:12.774470] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:54:12.790631] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-03T17:54:13.590733] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-03T17:54:14.254751] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:54:14.363918] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-03T17:54:14.390722] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-03T17:54:15.190735] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-03T17:54:15.656843] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T17:54:15.923777] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:54:15.990731] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-03T17:54:16.019900] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T17:54:16.790693] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-03T17:54:17.590695] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-03T17:54:18.069463] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T17:54:18.088124] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:54:18.090501] [INFO ] [REMOTE ] CARS: Full fetch complete (55542 records). [2025-10-03T17:54:18.090851] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-03T17:54:18.399046] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-03T17:54:18.528800] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-03T17:54:18.528889] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-03T17:54:18.529528] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-03T17:54:18.529572] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-03T17:54:18.530905] [DEBUG] [LOCAL ] CARS: Trimmed 55542 records to 40377 (keeping 200 days of data) [2025-10-03T17:54:18.768100] [DEBUG] [LOCAL ] CARS: Primary data saved (40377 records). [2025-10-03T17:54:18.768265] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-03T17:54:18.768392] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CARS took 33.1s. Estimated remaining: 4h 32m 1s. Rate: 7.3 symbols/min [2025-10-03T17:54:18.956332] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:19.010928] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-10-03T17:54:19.011328] [INFO ] [MAIN ] CAVA: Loaded 53942 existing records. [2025-10-03T17:54:19.124936] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T17:54:19.195756] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-03T17:54:19.231784] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:19.232328] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-03T17:54:19.232446] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-03T17:54:19.232984] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-03T17:54:19.233064] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-03T17:54:19.585723] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:54:19.684730] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:19.969851] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:54:19.990630] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-03T17:54:20.790740] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-03T17:54:21.590720] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-03T17:54:22.390715] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-03T17:54:23.174027] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-03T17:54:23.190606] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-03T17:54:23.499504] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-10-03T17:54:23.764866] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T17:54:23.990714] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-03T17:54:24.790724] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-03T17:54:25.374111] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T17:54:25.375097] [INFO ] [REMOTE ] CATO: Full fetch complete (11503 records). [2025-10-03T17:54:25.375191] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-03T17:54:25.856306] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-03T17:54:25.856511] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-03T17:54:25.856846] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-03T17:54:25.856974] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-03T17:54:25.857876] [DEBUG] [LOCAL ] CATO: Trimmed 11503 records to 7167 (keeping 200 days of data) [2025-10-03T17:54:25.935235] [DEBUG] [LOCAL ] CATO: Primary data saved (7167 records). [2025-10-03T17:54:25.936348] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-03T17:54:25.938469] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CATO took 24.2s. Estimated remaining: 4h 31m 47s. Rate: 7.3 symbols/min [2025-10-03T17:54:25.938252] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (3.55 seconds). [2025-10-03T17:54:25.990420] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-03T17:54:26.145102] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:26.216340] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:54:26.222514] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-10-03T17:54:26.280935] [DEBUG] [LOCAL ] CB: Loaded 50296 existing records from primary storage. [2025-10-03T17:54:26.281285] [INFO ] [MAIN ] CB: Loaded 50296 existing records. [2025-10-03T17:54:26.395780] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-03T17:54:26.483259] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:26.483764] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-03T17:54:26.483845] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-03T17:54:26.484181] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-03T17:54:26.484258] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-03T17:54:26.897818] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:27.190708] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-03T17:54:27.924596] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T17:54:27.990753] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-03T17:54:28.449675] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T17:54:28.790695] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-03T17:54:29.590705] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-03T17:54:30.148852] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T17:54:30.390758] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-03T17:54:31.230619] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-03T17:54:31.243609] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-03T17:54:31.300556] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:54:31.990692] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-03T17:54:32.100076] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:54:32.103244] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-03T17:54:32.103432] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-03T17:54:32.581458] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-03T17:54:32.581565] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-03T17:54:32.582637] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-03T17:54:32.582735] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-03T17:54:32.584317] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 54374 (keeping 200 days of data) [2025-10-03T17:54:32.933445] [DEBUG] [LOCAL ] CARR: Primary data saved (54374 records). [2025-10-03T17:54:32.933591] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-03T17:54:32.933715] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARR took 52.6s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-03T17:54:33.124622] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:33.124852] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-10-03T17:54:33.124909] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-10-03T17:54:33.125021] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-03T17:54:33.125065] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-03T17:54:33.125108] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-03T17:54:33.125141] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-03T17:54:33.548144] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:33.548759] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-03T17:54:33.617591] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (6.43 seconds). [2025-10-03T17:54:33.619977] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-03T17:54:33.643229] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-03T17:54:34.151262] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T17:54:34.205406] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T17:54:34.390727] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-03T17:54:35.195888] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-03T17:54:35.210184] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:54:35.990708] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-03T17:54:36.084898] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T17:54:36.575413] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T17:54:36.790702] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-03T17:54:37.590704] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-03T17:54:38.390723] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-03T17:54:38.678197] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T17:54:39.052576] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-03T17:54:39.190712] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-03T17:54:39.633984] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-03T17:54:39.990712] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-03T17:54:40.790682] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-03T17:54:41.263215] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T17:54:41.590691] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-03T17:54:41.905069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T17:54:41.907907] [INFO ] [REMOTE ] CAT: Full fetch complete (76686 records). [2025-10-03T17:54:41.908033] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-03T17:54:42.354178] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-03T17:54:42.354285] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-03T17:54:42.355144] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-03T17:54:42.355221] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-03T17:54:42.357011] [DEBUG] [LOCAL ] CAT: Trimmed 76686 records to 53696 (keeping 200 days of data) [2025-10-03T17:54:42.472133] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-10-03T17:54:42.478562] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-03T17:54:42.677080] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:54:42.800427] [DEBUG] [LOCAL ] CAT: Primary data saved (53696 records). [2025-10-03T17:54:42.800594] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-03T17:54:42.801438] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CAT took 45.1s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-03T17:54:43.190689] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-03T17:54:43.278878] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T17:54:43.819853] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T17:54:43.990685] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-03T17:54:44.790675] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-03T17:54:45.256041] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:54:45.278601] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T17:54:45.590724] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-03T17:54:46.390730] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-03T17:54:47.101065] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-03T17:54:47.190699] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-03T17:54:48.445422] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-03T17:54:48.448796] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-03T17:54:49.021735] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:54:49.024751] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-03T17:54:49.258785] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:54:49.578859] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:54:49.590606] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-03T17:54:50.374611] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-10-03T17:54:50.393572] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-03T17:54:50.394527] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:54:51.190696] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-03T17:54:51.990722] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-03T17:54:52.063944] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:54:52.732087] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:54:52.790681] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-03T17:54:53.130474] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T17:54:53.133151] [INFO ] [REMOTE ] CAVA: Full fetch complete (77301 records). [2025-10-03T17:54:53.133274] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-03T17:54:53.444460] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:54:53.457278] [INFO ] [REMOTE ] CBAN: Full fetch complete (16135 records). [2025-10-03T17:54:53.473162] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-03T17:54:53.603406] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-03T17:54:53.702970] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-03T17:54:53.707571] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-03T17:54:53.708880] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-03T17:54:53.729945] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-03T17:54:53.788768] [DEBUG] [LOCAL ] CAVA: Trimmed 77301 records to 54332 (keeping 200 days of data) [2025-10-03T17:54:54.097282] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-03T17:54:54.097705] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-03T17:54:54.104581] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-03T17:54:54.105958] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-03T17:54:54.114962] [DEBUG] [LOCAL ] CBAN: Trimmed 16135 records to 10995 (keeping 200 days of data) [2025-10-03T17:54:54.300544] [DEBUG] [LOCAL ] CBAN: Primary data saved (10995 records). [2025-10-03T17:54:54.306606] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-03T17:54:54.314333] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CBAN took 21.4s. Estimated remaining: 4h 31m 40s. Rate: 7.3 symbols/min [2025-10-03T17:54:54.400549] [DEBUG] [LOCAL ] CAVA: Primary data saved (54332 records). [2025-10-03T17:54:54.400733] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-03T17:54:54.400832] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CAVA took 35.6s. Estimated remaining: 4h 30m 51s. Rate: 7.3 symbols/min [2025-10-03T17:54:55.622997] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:54:55.634885] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-03T17:54:57.325825] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:54:57.337281] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-03T17:54:59.127720] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:54:59.141331] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-03T17:55:00.901879] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:55:00.904378] [INFO ] [REMOTE ] CB: Full fetch complete (72638 records). [2025-10-03T17:55:00.904519] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-03T17:55:01.346276] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-03T17:55:01.346379] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-03T17:55:01.347355] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-03T17:55:01.347426] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-03T17:55:01.350681] [DEBUG] [LOCAL ] CB: Trimmed 72638 records to 50658 (keeping 200 days of data) [2025-10-03T17:55:01.705604] [DEBUG] [LOCAL ] CB: Primary data saved (50658 records). [2025-10-03T17:55:01.705777] [INFO ] [MAIN ] CB: Full history saved. [2025-10-03T17:55:01.706781] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CB took 35.8s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-03T17:55:02.352367] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.452518] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.532793] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.570028] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.571043] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-03T17:55:02.571106] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-03T17:55:02.571198] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-03T17:55:02.571237] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-03T17:55:02.571279] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-03T17:55:02.571314] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-03T17:55:02.701690] [DEBUG] [LOCAL ] CBNA: Loaded 2927 existing records from primary storage. [2025-10-03T17:55:02.683141] [DEBUG] [LOCAL ] CBL: Loaded 16371 existing records from primary storage. [2025-10-03T17:55:02.702249] [INFO ] [MAIN ] CBNA: Loaded 2927 existing records. [2025-10-03T17:55:02.702363] [INFO ] [MAIN ] CBL: Loaded 16371 existing records. [2025-10-03T17:55:03.236102] [DEBUG] [LOCAL ] CBRE: Loaded 50924 existing records from primary storage. [2025-10-03T17:55:03.242639] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.279010] [INFO ] [MAIN ] CBRE: Loaded 50924 existing records. [2025-10-03T17:55:03.279205] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.299599] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-03T17:55:03.366151] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-03T17:55:03.395589] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.431966] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-03T17:55:03.426756] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.471176] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-03T17:55:03.528336] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-03T17:55:03.725967] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-03T17:55:03.724099] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:03.739035] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.739403] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-03T17:55:03.762218] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.797574] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-03T17:55:03.864193] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-03T17:55:03.900586] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-03T17:55:04.153201] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:55:04.209161] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-03T17:55:04.311245] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:55:04.448981] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-03T17:55:04.501616] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:55:04.566956] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.577449] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-03T17:55:04.614006] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-03T17:55:04.613918] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-03T17:55:04.644799] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-03T17:55:04.671931] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-03T17:55:04.693212] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBO took 2.9s. Estimated remaining: 4h 30m 4s. Rate: 7.3 symbols/min [2025-10-03T17:55:04.726854] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.732350] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-03T17:55:04.927503] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.930743] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-03T17:55:05.005786] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:05.042287] [DEBUG] [LOCAL ] CBT: Loaded 31073 existing records from primary storage. [2025-10-03T17:55:05.042565] [INFO ] [MAIN ] CBT: Loaded 31073 existing records. [2025-10-03T17:55:05.231166] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:05.231390] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-03T17:55:05.231439] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-03T17:55:05.232418] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-03T17:55:05.232478] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-03T17:55:05.546707] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:55:05.570422] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-03T17:55:05.643820] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:05.644152] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-03T17:55:06.026449] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:55:06.031866] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-03T17:55:06.296521] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T17:55:06.298519] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-03T17:55:06.722311] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T17:55:06.724163] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-03T17:55:06.813941] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:55:06.825945] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-03T17:55:06.914505] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:55:06.922430] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-03T17:55:07.051538] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T17:55:07.053609] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-03T17:55:07.069389] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:55:07.074826] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-03T17:55:07.626010] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T17:55:07.627909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-03T17:55:08.074820] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T17:55:08.079556] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-03T17:55:08.257981] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:55:08.293189] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:55:08.294785] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:55:08.790639] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-03T17:55:09.089447] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:55:09.590728] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-03T17:55:10.243303] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:55:10.390764] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-03T17:55:11.190628] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-03T17:55:11.239692] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:55:11.440697] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:55:11.990718] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-03T17:55:12.189110] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:55:12.790726] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-03T17:55:13.346212] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T17:55:13.411573] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:55:13.590762] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-03T17:55:13.973618] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-03T17:55:14.390727] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-03T17:55:15.190733] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-03T17:55:15.835002] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:55:15.939622] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T17:55:15.990695] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-03T17:55:16.790717] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-03T17:55:17.549348] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:55:17.590715] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-03T17:55:18.390691] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-03T17:55:18.849787] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T17:55:18.881038] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T17:55:19.190629] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-03T17:55:19.492908] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T17:55:19.990722] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-03T17:55:20.485432] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-03T17:55:20.525710] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:55:20.790715] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-03T17:55:21.590689] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-03T17:55:21.740391] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T17:55:22.390711] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-03T17:55:23.190631] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-03T17:55:23.325882] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:55:23.670029] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:55:23.847956] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T17:55:23.990702] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-03T17:55:24.790728] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-03T17:55:25.590717] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-03T17:55:25.735070] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:55:25.766352] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:55:26.390711] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-03T17:55:26.553063] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:55:26.555055] [INFO ] [REMOTE ] CBT: Full fetch complete (45681 records). [2025-10-03T17:55:26.555179] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-03T17:55:26.941454] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T17:55:26.960110] [INFO ] [REMOTE ] CBNA: Full fetch complete (4561 records). [2025-10-03T17:55:26.994621] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-03T17:55:26.997204] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-03T17:55:26.997486] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-03T17:55:27.046949] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-03T17:55:27.077535] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-03T17:55:27.135079] [DEBUG] [LOCAL ] CBT: Trimmed 45681 records to 31248 (keeping 200 days of data) [2025-10-03T17:55:27.196733] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-03T17:55:27.524779] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-03T17:55:27.529374] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-03T17:55:27.534474] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-03T17:55:27.539687] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-03T17:55:27.542253] [DEBUG] [LOCAL ] CBNA: Trimmed 4561 records to 2938 (keeping 200 days of data) [2025-10-03T17:55:27.621333] [DEBUG] [LOCAL ] CBNA: Primary data saved (2938 records). [2025-10-03T17:55:27.626341] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-03T17:55:27.629044] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBNA took 25.9s. Estimated remaining: 4h 31m 8s. Rate: 7.3 symbols/min [2025-10-03T17:55:27.753746] [DEBUG] [LOCAL ] CBT: Primary data saved (31248 records). [2025-10-03T17:55:27.760318] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-03T17:55:27.765604] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBT took 23.0s. Estimated remaining: 4h 30m 20s. Rate: 7.3 symbols/min [2025-10-03T17:55:27.912559] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:27.999904] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-03T17:55:28.046820] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:28.047153] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-03T17:55:28.047212] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-03T17:55:28.047338] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-03T17:55:28.047383] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-03T17:55:28.047535] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-03T17:55:28.047589] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-03T17:55:28.172111] [DEBUG] [LOCAL ] CBU: Loaded 22817 existing records from primary storage. [2025-10-03T17:55:28.183853] [INFO ] [MAIN ] CBU: Loaded 22817 existing records. [2025-10-03T17:55:28.351025] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:55:28.673218] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:28.678145] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:28.678980] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-03T17:55:28.679050] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-03T17:55:28.683624] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-03T17:55:28.683733] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-03T17:55:28.793673] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-03T17:55:29.067740] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:29.590629] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-03T17:55:29.708437] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:55:29.724176] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:55:29.726203] [INFO ] [REMOTE ] CBL: Full fetch complete (25450 records). [2025-10-03T17:55:29.726301] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-03T17:55:30.146224] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-03T17:55:30.146327] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-03T17:55:30.146850] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-03T17:55:30.146919] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-03T17:55:30.147680] [DEBUG] [LOCAL ] CBL: Trimmed 25450 records to 16471 (keeping 200 days of data) [2025-10-03T17:55:30.249592] [DEBUG] [LOCAL ] CBL: Primary data saved (16471 records). [2025-10-03T17:55:30.249778] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-03T17:55:30.249872] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CBL took 28.5s. Estimated remaining: 4h 29m 44s. Rate: 7.3 symbols/min [2025-10-03T17:55:30.398635] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-03T17:55:30.433620] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:30.475966] [DEBUG] [LOCAL ] CBZ: Loaded 33974 existing records from primary storage. [2025-10-03T17:55:30.476246] [INFO ] [MAIN ] CBZ: Loaded 33974 existing records. [2025-10-03T17:55:30.670242] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:30.670457] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-03T17:55:30.670506] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-03T17:55:30.671508] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-03T17:55:30.671583] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-03T17:55:30.903716] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:55:31.104553] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:31.190676] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-03T17:55:31.392598] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:55:31.392979] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-03T17:55:31.393075] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:55:31.393126] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-03T17:55:31.393194] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:55:31.393269] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-03T17:55:31.393335] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-03T17:55:31.393373] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-03T17:55:31.393429] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-03T17:55:31.393539] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBX took 3.6s. Estimated remaining: 4h 29m 1s. Rate: 7.3 symbols/min [2025-10-03T17:55:31.582425] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:31.644783] [DEBUG] [LOCAL ] CC: Loaded 53386 existing records from primary storage. [2025-10-03T17:55:31.645115] [INFO ] [MAIN ] CC: Loaded 53386 existing records. [2025-10-03T17:55:31.847637] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:31.847891] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-03T17:55:31.847941] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-03T17:55:31.848181] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-03T17:55:31.848239] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-03T17:55:31.996672] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-03T17:55:32.260863] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:32.296721] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T17:55:32.790722] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-03T17:55:33.249888] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:55:33.590723] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-03T17:55:34.175258] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:55:34.344683] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T17:55:34.390713] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-03T17:55:35.190716] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-03T17:55:35.458963] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:55:35.990734] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-03T17:55:36.790635] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-03T17:55:36.921002] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:55:37.182075] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T17:55:37.590691] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-03T17:55:38.142146] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:55:38.390738] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-03T17:55:38.597261] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T17:55:39.190686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-03T17:55:39.938984] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:55:39.941881] [INFO ] [REMOTE ] CBRE: Full fetch complete (73906 records). [2025-10-03T17:55:39.942010] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-03T17:55:40.000136] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-03T17:55:40.419218] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-03T17:55:40.419327] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-03T17:55:40.420265] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-03T17:55:40.420343] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-03T17:55:40.422133] [DEBUG] [LOCAL ] CBRE: Trimmed 73906 records to 51279 (keeping 200 days of data) [2025-10-03T17:55:40.703305] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:55:40.792378] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-03T17:55:40.802979] [DEBUG] [LOCAL ] CBRE: Primary data saved (51279 records). [2025-10-03T17:55:40.803263] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-03T17:55:40.803391] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBRE took 39.1s. Estimated remaining: 4h 28m 59s. Rate: 7.3 symbols/min [2025-10-03T17:55:40.987907] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:41.045378] [DEBUG] [LOCAL ] CCI: Loaded 53529 existing records from primary storage. [2025-10-03T17:55:41.045787] [INFO ] [MAIN ] CCI: Loaded 53529 existing records. [2025-10-03T17:55:41.235091] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:41.235382] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-03T17:55:41.236371] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-03T17:55:41.236691] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-03T17:55:41.236751] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-03T17:55:41.595850] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-03T17:55:41.639666] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:41.744070] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:55:42.145040] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:55:42.390725] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-03T17:55:42.805512] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:55:43.190733] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-03T17:55:43.990725] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-03T17:55:44.026632] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:55:44.790747] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-03T17:55:45.216230] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:55:45.386032] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:55:45.590749] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-03T17:55:46.370829] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:55:46.390635] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-03T17:55:46.505260] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:55:47.190756] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-03T17:55:47.990665] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-03T17:55:48.159835] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T17:55:48.401239] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:55:48.790778] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-03T17:55:49.336280] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:55:49.440408] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T17:55:49.590718] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-03T17:55:50.390693] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-03T17:55:51.190635] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-03T17:55:51.405386] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:55:51.430824] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:55:51.990701] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-03T17:55:52.753930] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:55:52.790707] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-03T17:55:53.590688] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-03T17:55:53.843830] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:55:54.057387] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T17:55:54.059394] [INFO ] [REMOTE ] CBZ: Full fetch complete (45594 records). [2025-10-03T17:55:54.059478] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-03T17:55:54.395926] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-03T17:55:54.492574] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-03T17:55:54.492714] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-03T17:55:54.493697] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-03T17:55:54.493772] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-03T17:55:54.500192] [DEBUG] [LOCAL ] CBZ: Trimmed 45594 records to 34222 (keeping 200 days of data) [2025-10-03T17:55:54.722781] [DEBUG] [LOCAL ] CBZ: Primary data saved (34222 records). [2025-10-03T17:55:54.722942] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-03T17:55:54.723086] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBZ took 24.5s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-03T17:55:54.911447] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:54.911683] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-03T17:55:54.911740] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-03T17:55:54.911882] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-03T17:55:54.911936] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-03T17:55:54.912005] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-03T17:55:54.912051] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-03T17:55:55.201736] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-03T17:55:55.305484] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:55.478326] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:55:55.522786] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T17:55:55.990746] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-03T17:55:56.709423] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:55:56.790739] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-03T17:55:57.590639] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-03T17:55:57.732122] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T17:55:57.914865] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T17:55:57.966720] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T17:55:58.390742] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-03T17:55:59.190703] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-03T17:55:59.630149] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T17:55:59.990717] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-03T17:56:00.413216] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:56:00.790730] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-03T17:56:01.118125] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T17:56:01.590701] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-03T17:56:01.878460] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-03T17:56:02.173846] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T17:56:02.390752] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-03T17:56:03.190680] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-03T17:56:03.626719] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T17:56:03.990715] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-03T17:56:04.298640] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:56:04.790686] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-03T17:56:05.590634] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-03T17:56:05.757164] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:56:06.390742] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-03T17:56:06.733581] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:56:06.783339] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:56:06.855172] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T17:56:07.190730] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-03T17:56:07.990713] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-03T17:56:08.462968] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T17:56:08.790689] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-03T17:56:08.999038] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:56:09.135995] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-03T17:56:09.590684] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-03T17:56:10.078941] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T17:56:10.390732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-03T17:56:10.821685] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:56:11.190709] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-03T17:56:11.538719] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T17:56:11.539700] [INFO ] [REMOTE ] CCIA: Full fetch complete (2073 records). [2025-10-03T17:56:11.539810] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-03T17:56:11.764400] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T17:56:11.764670] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:56:11.764746] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:56:11.764822] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-03T17:56:11.764926] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-03T17:56:11.764983] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-03T17:56:11.765044] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-03T17:56:11.765132] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CCIA took 17.0s. Estimated remaining: 4h 29m 52s. Rate: 7.3 symbols/min [2025-10-03T17:56:11.945292] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:11.963221] [DEBUG] [LOCAL ] CCIF: Loaded 15844 existing records from primary storage. [2025-10-03T17:56:11.963482] [INFO ] [MAIN ] CCIF: Loaded 15844 existing records. [2025-10-03T17:56:11.995886] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-03T17:56:12.160942] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:12.161195] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-03T17:56:12.161283] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-03T17:56:12.161714] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-03T17:56:12.161775] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-03T17:56:12.541015] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:12.790749] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-03T17:56:13.590729] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-03T17:56:13.619231] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:56:13.626107] [INFO ] [REMOTE ] CC: Full fetch complete (75660 records). [2025-10-03T17:56:13.626272] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-03T17:56:13.787188] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T17:56:14.131385] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-03T17:56:14.131480] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-03T17:56:14.132457] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-03T17:56:14.132543] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-03T17:56:14.134310] [DEBUG] [LOCAL ] CC: Trimmed 75660 records to 53769 (keeping 200 days of data) [2025-10-03T17:56:14.391175] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-03T17:56:14.490300] [DEBUG] [LOCAL ] CC: Primary data saved (53769 records). [2025-10-03T17:56:14.490461] [INFO ] [MAIN ] CC: Full history saved. [2025-10-03T17:56:14.490574] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CC took 43.1s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-03T17:56:14.680695] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:14.685020] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:56:14.686930] [INFO ] [REMOTE ] CBU: Full fetch complete (32368 records). [2025-10-03T17:56:14.687035] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-03T17:56:15.063404] [DEBUG] [LOCAL ] CCJ: Loaded 54063 existing records from primary storage. [2025-10-03T17:56:15.079172] [INFO ] [MAIN ] CCJ: Loaded 54063 existing records. [2025-10-03T17:56:15.231602] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-03T17:56:15.194039] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-03T17:56:15.242081] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-03T17:56:15.247995] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-03T17:56:15.269223] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-03T17:56:15.290311] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:56:15.379494] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:15.379604] [DEBUG] [LOCAL ] CBU: Trimmed 32368 records to 23000 (keeping 200 days of data) [2025-10-03T17:56:15.379923] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-03T17:56:15.379999] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-03T17:56:15.381814] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-03T17:56:15.381892] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-03T17:56:15.927089] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:15.960737] [DEBUG] [LOCAL ] CBU: Primary data saved (23000 records). [2025-10-03T17:56:15.960866] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-03T17:56:15.960947] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CBU took 48.3s. Estimated remaining: 4h 28m 37s. Rate: 7.3 symbols/min [2025-10-03T17:56:15.994752] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-03T17:56:16.143616] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:16.191745] [DEBUG] [LOCAL ] CCK: Loaded 46518 existing records from primary storage. [2025-10-03T17:56:16.192104] [INFO ] [MAIN ] CCK: Loaded 46518 existing records. [2025-10-03T17:56:16.382194] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:16.382414] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-03T17:56:16.382463] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-03T17:56:16.383811] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-03T17:56:16.383875] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-03T17:56:16.748042] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T17:56:16.794888] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-03T17:56:16.818150] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:17.012939] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:56:17.590698] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-03T17:56:18.390738] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-03T17:56:19.060883] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-03T17:56:19.190723] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-03T17:56:19.328937] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:56:19.990732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-03T17:56:20.328462] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:56:20.790666] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-03T17:56:21.032527] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:56:21.503566] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:56:21.574724] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:56:21.590698] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-03T17:56:22.390736] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-03T17:56:23.203501] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-03T17:56:23.210576] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:56:23.988280] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:56:23.997866] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-03T17:56:24.254272] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:56:24.790727] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-03T17:56:25.590702] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-03T17:56:25.819632] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:56:26.390703] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-03T17:56:26.701437] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:56:27.185102] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:56:27.198949] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-03T17:56:27.227233] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T17:56:27.990696] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-03T17:56:28.790673] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-03T17:56:29.160757] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:56:29.590687] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-03T17:56:29.820117] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:56:30.194757] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T17:56:30.307166] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:56:30.313090] [INFO ] [REMOTE ] CCI: Full fetch complete (76997 records). [2025-10-03T17:56:30.313244] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-03T17:56:30.395717] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-03T17:56:30.791726] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-03T17:56:30.791832] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-03T17:56:30.792946] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-03T17:56:30.793018] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-03T17:56:30.794628] [DEBUG] [LOCAL ] CCI: Trimmed 76997 records to 53918 (keeping 200 days of data) [2025-10-03T17:56:31.155140] [DEBUG] [LOCAL ] CCI: Primary data saved (53918 records). [2025-10-03T17:56:31.155291] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-03T17:56:31.157908] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CCI took 50.4s. Estimated remaining: 4h 29m 2s. Rate: 7.3 symbols/min [2025-10-03T17:56:31.195740] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-03T17:56:31.365553] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:31.426703] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-03T17:56:31.427321] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-03T17:56:31.639756] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:31.640032] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-03T17:56:31.640113] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-03T17:56:31.641702] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-03T17:56:31.641768] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-03T17:56:31.995752] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-03T17:56:32.081503] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:32.363785] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:56:32.436690] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:56:32.790702] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-03T17:56:33.590632] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-03T17:56:33.757842] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:56:33.790610] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T17:56:34.390694] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-03T17:56:35.190682] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-03T17:56:35.619052] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T17:56:35.894759] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:56:35.990671] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-03T17:56:36.790699] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-03T17:56:37.305929] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:56:37.590691] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-03T17:56:37.784283] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-03T17:56:38.390732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-03T17:56:38.720006] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:56:38.919444] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T17:56:39.190684] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-03T17:56:39.990634] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-03T17:56:40.037572] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:56:40.038799] [INFO ] [REMOTE ] CCIF: Full fetch complete (21918 records). [2025-10-03T17:56:40.038883] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-03T17:56:40.363802] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T17:56:40.489583] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-03T17:56:40.489687] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-03T17:56:40.490136] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-03T17:56:40.490201] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-03T17:56:40.490872] [DEBUG] [LOCAL ] CCIF: Trimmed 21918 records to 15916 (keeping 200 days of data) [2025-10-03T17:56:40.585599] [DEBUG] [LOCAL ] CCIF: Primary data saved (15916 records). [2025-10-03T17:56:40.585805] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-03T17:56:40.585913] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CCIF took 28.8s. Estimated remaining: 4h 28m 59s. Rate: 7.3 symbols/min [2025-10-03T17:56:40.773621] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:40.790707] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-03T17:56:40.823556] [DEBUG] [LOCAL ] CCO: Loaded 48249 existing records from primary storage. [2025-10-03T17:56:40.823914] [INFO ] [MAIN ] CCO: Loaded 48249 existing records. [2025-10-03T17:56:41.030191] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:41.030454] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-03T17:56:41.030514] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-03T17:56:41.031707] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-03T17:56:41.031775] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-03T17:56:41.435176] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:41.590723] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-03T17:56:42.239249] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T17:56:42.390671] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-03T17:56:42.508124] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:56:43.190706] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-03T17:56:43.957250] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-03T17:56:43.990675] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-03T17:56:44.188394] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T17:56:44.623100] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:56:44.625483] [INFO ] [REMOTE ] CCK: Full fetch complete (67611 records). [2025-10-03T17:56:44.625675] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-03T17:56:44.814284] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-03T17:56:45.052962] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-03T17:56:45.053065] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-03T17:56:45.054005] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-03T17:56:45.054083] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-03T17:56:45.055695] [DEBUG] [LOCAL ] CCK: Trimmed 67611 records to 46844 (keeping 200 days of data) [2025-10-03T17:56:45.353996] [DEBUG] [LOCAL ] CCK: Primary data saved (46844 records). [2025-10-03T17:56:45.354133] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-03T17:56:45.354226] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCK took 29.4s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-03T17:56:45.534962] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:45.544462] [DEBUG] [LOCAL ] CCRD: Loaded 9134 existing records from primary storage. [2025-10-03T17:56:45.544814] [INFO ] [MAIN ] CCRD: Loaded 9134 existing records. [2025-10-03T17:56:45.601020] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-03T17:56:45.743628] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:45.744196] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-03T17:56:45.744266] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-03T17:56:45.744824] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-03T17:56:45.744898] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-03T17:56:46.131570] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:46.168495] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-03T17:56:46.390698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-03T17:56:46.566440] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:56:47.063491] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:56:47.190680] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-03T17:56:47.990637] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-03T17:56:48.114824] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T17:56:48.648116] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:56:48.790729] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-03T17:56:49.590706] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-03T17:56:50.246294] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:56:50.390740] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-03T17:56:50.442866] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-03T17:56:50.866390] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T17:56:50.865594] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:56:51.190721] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-03T17:56:51.990738] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-03T17:56:52.790739] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-03T17:56:53.519200] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T17:56:53.590705] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-03T17:56:54.061243] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-03T17:56:54.064175] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-10-03T17:56:54.064368] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-03T17:56:54.204783] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T17:56:54.396028] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-03T17:56:54.521615] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:56:54.606062] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-03T17:56:54.606186] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-03T17:56:54.607191] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-03T17:56:54.607300] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-03T17:56:54.609378] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 54453 (keeping 200 days of data) [2025-10-03T17:56:54.949546] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:56:54.969693] [DEBUG] [LOCAL ] CCJ: Primary data saved (54453 records). [2025-10-03T17:56:54.969882] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-03T17:56:54.969982] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCJ took 40.5s. Estimated remaining: 4h 28m 33s. Rate: 7.3 symbols/min [2025-10-03T17:56:55.159237] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:55.190889] [DEBUG] [LOCAL ] CCS: Loaded 30685 existing records from primary storage. [2025-10-03T17:56:55.191010] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-03T17:56:55.192577] [INFO ] [MAIN ] CCS: Loaded 30685 existing records. [2025-10-03T17:56:55.386083] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:55.386302] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-03T17:56:55.386351] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-03T17:56:55.387266] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-03T17:56:55.387330] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-03T17:56:55.764966] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:55.990721] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-03T17:56:56.664481] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:56:56.790713] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-03T17:56:57.595616] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-03T17:56:57.601921] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-03T17:56:57.919749] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:56:58.390737] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-03T17:56:58.888456] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:56:59.190671] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-03T17:56:59.789446] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:56:59.977884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:56:59.990669] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-03T17:57:00.790690] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-03T17:57:00.892965] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T17:57:01.590693] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-03T17:57:02.390702] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-03T17:57:02.991155] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:57:03.190673] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-03T17:57:03.211869] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T17:57:03.327669] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-03T17:57:03.990695] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-03T17:57:04.790691] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-03T17:57:04.812894] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:57:04.813883] [INFO ] [REMOTE ] CCRD: Full fetch complete (11844 records). [2025-10-03T17:57:04.813965] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-03T17:57:05.110972] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:57:05.273464] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-03T17:57:05.273543] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-03T17:57:05.273855] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-03T17:57:05.273918] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-03T17:57:05.274462] [DEBUG] [LOCAL ] CCRD: Trimmed 11844 records to 9165 (keeping 200 days of data) [2025-10-03T17:57:05.331248] [DEBUG] [LOCAL ] CCRD: Primary data saved (9165 records). [2025-10-03T17:57:05.331413] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-03T17:57:05.331506] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCRD took 20.0s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-03T17:57:05.521347] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:05.521562] [DEBUG] [LOCAL ] CCU: No existing data file found in primary storage. [2025-10-03T17:57:05.521618] [WARN ] [MAIN ] CCU: No existing data found, performing full refresh instead. [2025-10-03T17:57:05.521760] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-03T17:57:05.521803] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-03T17:57:05.521844] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-03T17:57:05.521876] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-03T17:57:05.595866] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-03T17:57:05.919221] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:06.390728] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-03T17:57:07.049606] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-03T17:57:07.192467] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-03T17:57:07.205937] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:57:07.617331] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T17:57:07.990702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-03T17:57:08.514149] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:57:08.599796] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T17:57:08.790686] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-03T17:57:09.590731] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-03T17:57:09.937722] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:57:10.390694] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-03T17:57:11.190703] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-03T17:57:11.671911] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:57:11.990638] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-03T17:57:12.216449] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-03T17:57:12.790685] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-03T17:57:12.842678] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:57:13.073086] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:57:13.590702] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-03T17:57:14.151621] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:57:14.390714] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-03T17:57:14.828028] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:57:15.190724] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-03T17:57:15.508959] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T17:57:15.990728] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-03T17:57:16.488033] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T17:57:16.790725] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-03T17:57:17.590702] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-03T17:57:18.090405] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-03T17:57:18.093465] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-03T17:57:18.093613] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-03T17:57:18.396031] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-03T17:57:18.490436] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:57:18.609098] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-03T17:57:18.609280] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-03T17:57:18.610321] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-03T17:57:18.610444] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-03T17:57:18.612451] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-10-03T17:57:18.723869] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:57:18.985750] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-03T17:57:18.985910] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-03T17:57:18.987148] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCL took 47.8s. Estimated remaining: 4h 28m 52s. Rate: 7.3 symbols/min [2025-10-03T17:57:19.182950] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:19.183198] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-03T17:57:19.183257] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-03T17:57:19.183375] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-03T17:57:19.183425] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-03T17:57:19.183473] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-03T17:57:19.183508] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-03T17:57:19.196756] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-03T17:57:19.609013] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:19.875530] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:57:19.990719] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-03T17:57:20.732940] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:57:20.790705] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-03T17:57:21.067538] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:57:21.590743] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-03T17:57:22.399831] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-03T17:57:22.421095] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:57:22.810608] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-03T17:57:22.813818] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T17:57:23.190705] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-03T17:57:23.990702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-03T17:57:24.466919] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:57:24.790700] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-03T17:57:25.047148] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:57:25.590696] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-03T17:57:25.911812] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T17:57:25.913420] [INFO ] [REMOTE ] CCS: Full fetch complete (45009 records). [2025-10-03T17:57:25.913513] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-03T17:57:26.316713] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-03T17:57:26.316852] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-03T17:57:26.317475] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-03T17:57:26.317522] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-03T17:57:26.318719] [DEBUG] [LOCAL ] CCS: Trimmed 45009 records to 30853 (keeping 200 days of data) [2025-10-03T17:57:26.408062] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-03T17:57:26.514579] [DEBUG] [LOCAL ] CCS: Primary data saved (30853 records). [2025-10-03T17:57:26.514756] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-03T17:57:26.514854] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCS took 31.5s. Estimated remaining: 4h 28m 40s. Rate: 7.3 symbols/min [2025-10-03T17:57:26.707914] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:26.703469] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-03T17:57:26.763282] [DEBUG] [LOCAL ] CDE: Loaded 54032 existing records from primary storage. [2025-10-03T17:57:26.763625] [INFO ] [MAIN ] CDE: Loaded 54032 existing records. [2025-10-03T17:57:26.961906] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:26.962231] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-03T17:57:26.962306] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-03T17:57:26.963981] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-03T17:57:26.964048] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-03T17:57:27.207739] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-03T17:57:27.209869] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T17:57:27.429968] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:27.558141] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T17:57:27.990695] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-03T17:57:28.790692] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-03T17:57:29.389139] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T17:57:29.394435] [INFO ] [REMOTE ] CCO: Full fetch complete (66798 records). [2025-10-03T17:57:29.394634] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-03T17:57:29.604844] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-03T17:57:29.839008] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-03T17:57:29.838831] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:57:29.839207] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-03T17:57:29.844195] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-03T17:57:29.844717] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-03T17:57:29.846798] [DEBUG] [LOCAL ] CCO: Trimmed 66798 records to 48625 (keeping 200 days of data) [2025-10-03T17:57:29.904821] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-03T17:57:30.143956] [DEBUG] [LOCAL ] CCO: Primary data saved (48625 records). [2025-10-03T17:57:30.144095] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-03T17:57:30.146351] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCO took 49.6s. Estimated remaining: 4h 28m 10s. Rate: 7.3 symbols/min [2025-10-03T17:57:30.331876] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:30.345675] [DEBUG] [LOCAL ] CDLR: Loaded 9932 existing records from primary storage. [2025-10-03T17:57:30.345942] [INFO ] [MAIN ] CDLR: Loaded 9932 existing records. [2025-10-03T17:57:30.395881] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-03T17:57:30.539339] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:30.539630] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-03T17:57:30.539721] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-03T17:57:30.540355] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-03T17:57:30.540602] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-03T17:57:30.939968] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:31.190693] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-03T17:57:31.502752] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:57:31.504282] [INFO ] [REMOTE ] CCU: Full fetch complete (32901 records). [2025-10-03T17:57:31.504389] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-03T17:57:31.592377] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-03T17:57:31.932752] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-03T17:57:31.932834] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-03T17:57:31.933312] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-03T17:57:31.933375] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-03T17:57:31.934869] [DEBUG] [LOCAL ] CCU: Trimmed 32901 records to 23444 (keeping 200 days of data) [2025-10-03T17:57:31.992488] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-03T17:57:32.083511] [DEBUG] [LOCAL ] CCU: Primary data saved (23444 records). [2025-10-03T17:57:32.083671] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-03T17:57:32.083767] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCU took 26.8s. Estimated remaining: 4h 27m 33s. Rate: 7.3 symbols/min [2025-10-03T17:57:32.267320] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-03T17:57:32.268934] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:32.314606] [DEBUG] [LOCAL ] CDP: Loaded 42936 existing records from primary storage. [2025-10-03T17:57:32.314974] [INFO ] [MAIN ] CDP: Loaded 42936 existing records. [2025-10-03T17:57:32.507689] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:32.507945] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-03T17:57:32.508003] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-03T17:57:32.509455] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-03T17:57:32.509517] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-03T17:57:32.795858] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-03T17:57:32.880963] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:33.120715] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:57:33.121059] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-03T17:57:33.121168] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:57:33.121270] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-03T17:57:33.121342] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:57:33.121419] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-03T17:57:33.121535] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-03T17:57:33.121613] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-03T17:57:33.121727] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-03T17:57:33.121823] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCZ took 14.1s. Estimated remaining: 4h 26m 51s. Rate: 7.3 symbols/min [2025-10-03T17:57:33.308495] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:33.338756] [DEBUG] [LOCAL ] CDRE: Loaded 25140 existing records from primary storage. [2025-10-03T17:57:33.339088] [INFO ] [MAIN ] CDRE: Loaded 25140 existing records. [2025-10-03T17:57:33.541031] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:33.541284] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-03T17:57:33.541333] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-03T17:57:33.542247] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-03T17:57:33.542333] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-03T17:57:33.595821] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-03T17:57:33.937663] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:34.390720] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-03T17:57:35.190767] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-03T17:57:35.223753] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T17:57:35.487219] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T17:57:35.990711] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-03T17:57:36.800037] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-03T17:57:36.802849] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:57:37.590722] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-03T17:57:37.906740] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:57:38.157315] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T17:57:38.218579] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:57:38.390696] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-03T17:57:39.190713] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-03T17:57:39.772913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T17:57:39.990685] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-03T17:57:40.237098] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:57:40.790631] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-03T17:57:41.108047] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:57:41.590699] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-03T17:57:42.390620] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-03T17:57:42.545914] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T17:57:42.678397] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:57:43.190699] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-03T17:57:43.334315] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T17:57:43.990702] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-03T17:57:44.666866] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:57:44.790635] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-03T17:57:45.101354] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:57:45.590707] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-03T17:57:45.631051] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T17:57:46.390674] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-03T17:57:46.737512] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:57:47.063323] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:57:47.190716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-03T17:57:47.866456] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T17:57:47.990691] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-03T17:57:48.790699] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-03T17:57:49.590688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-03T17:57:49.629799] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:57:50.380776] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:57:50.390608] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-03T17:57:50.803034] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T17:57:51.190688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-03T17:57:51.206326] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T17:57:51.990719] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-03T17:57:52.603050] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:57:52.729898] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:57:52.790690] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-03T17:57:53.536410] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T17:57:53.537616] [INFO ] [REMOTE ] CDLR: Full fetch complete (13387 records). [2025-10-03T17:57:53.537751] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-03T17:57:53.596452] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-03T17:57:53.943118] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-03T17:57:53.943203] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-03T17:57:53.943565] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-03T17:57:53.943612] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-03T17:57:53.944217] [DEBUG] [LOCAL ] CDLR: Trimmed 13387 records to 10028 (keeping 200 days of data) [2025-10-03T17:57:54.012382] [DEBUG] [LOCAL ] CDLR: Primary data saved (10028 records). [2025-10-03T17:57:54.012544] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-03T17:57:54.012669] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CDLR took 23.9s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:57:54.194440] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:54.252615] [DEBUG] [LOCAL ] CE: Loaded 51874 existing records from primary storage. [2025-10-03T17:57:54.253009] [INFO ] [MAIN ] CE: Loaded 51874 existing records. [2025-10-03T17:57:54.395856] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-03T17:57:54.451881] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:54.452217] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-03T17:57:54.452275] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-03T17:57:54.453809] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-03T17:57:54.453873] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-03T17:57:54.844079] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:55.190761] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-03T17:57:55.252309] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:57:55.597871] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:57:55.990729] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-03T17:57:56.790629] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-03T17:57:57.148936] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:57:57.590696] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-03T17:57:57.805981] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:57:58.301451] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T17:57:58.390687] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-03T17:57:58.584134] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T17:57:59.190670] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-03T17:57:59.482526] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:57:59.990724] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-03T17:58:00.790636] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-03T17:58:01.168976] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:58:01.219864] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T17:58:01.590743] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-03T17:58:02.390706] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-03T17:58:02.596568] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T17:58:03.190703] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-03T17:58:03.377821] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:58:03.379418] [INFO ] [REMOTE ] CDRE: Full fetch complete (35123 records). [2025-10-03T17:58:03.379507] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-03T17:58:03.861355] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-03T17:58:03.861724] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-03T17:58:03.862932] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-03T17:58:03.863047] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-03T17:58:03.864602] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T17:58:03.878592] [DEBUG] [LOCAL ] CDRE: Trimmed 35123 records to 25295 (keeping 200 days of data) [2025-10-03T17:58:03.991326] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-03T17:58:04.046528] [DEBUG] [LOCAL ] CDRE: Primary data saved (25295 records). [2025-10-03T17:58:04.046715] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-03T17:58:04.046817] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CDRE took 30.9s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:58:04.230822] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:04.238918] [DEBUG] [LOCAL ] CEE: Loaded 5968 existing records from primary storage. [2025-10-03T17:58:04.239168] [INFO ] [MAIN ] CEE: Loaded 5968 existing records. [2025-10-03T17:58:04.440150] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:04.440441] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-03T17:58:04.440699] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-03T17:58:04.441148] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-03T17:58:04.441210] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-03T17:58:04.797669] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:58:04.796019] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-03T17:58:04.870771] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:05.590622] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-03T17:58:05.776605] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T17:58:06.390735] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-03T17:58:06.870423] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T17:58:07.021092] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:58:07.118094] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:58:07.190686] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-03T17:58:07.990730] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-03T17:58:08.563711] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T17:58:08.790727] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-03T17:58:09.410437] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T17:58:09.590715] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-03T17:58:10.390710] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-03T17:58:10.492739] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:58:11.190731] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-03T17:58:11.235580] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:58:11.489541] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T17:58:11.990685] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-03T17:58:12.790724] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-03T17:58:13.332430] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-03T17:58:13.335408] [INFO ] [REMOTE ] CDE: Full fetch complete (77584 records). [2025-10-03T17:58:13.335536] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-03T17:58:13.592448] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-03T17:58:13.780952] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-03T17:58:13.781112] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-03T17:58:13.782119] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-03T17:58:13.782251] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-03T17:58:13.784179] [DEBUG] [LOCAL ] CDE: Trimmed 77584 records to 54422 (keeping 200 days of data) [2025-10-03T17:58:13.958807] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T17:58:14.211953] [DEBUG] [LOCAL ] CDE: Primary data saved (54422 records). [2025-10-03T17:58:14.212179] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-03T17:58:14.212288] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDE took 47.7s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:58:14.400171] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-03T17:58:14.432804] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:58:14.437896] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:14.475970] [DEBUG] [LOCAL ] CEPU: Loaded 26149 existing records from primary storage. [2025-10-03T17:58:14.476264] [INFO ] [MAIN ] CEPU: Loaded 26149 existing records. [2025-10-03T17:58:14.601324] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:58:14.695127] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:14.695370] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-03T17:58:14.695420] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-03T17:58:14.696184] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-03T17:58:14.696246] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-03T17:58:15.102476] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:15.190676] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-03T17:58:15.990665] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-03T17:58:16.236333] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:58:16.404215] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T17:58:16.683780] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T17:58:16.790695] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-03T17:58:17.590726] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-03T17:58:18.108908] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:58:18.390683] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-03T17:58:18.633748] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T17:58:19.190689] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-03T17:58:19.491350] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:58:19.990680] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-03T17:58:20.790634] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-03T17:58:20.858597] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:58:21.096937] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:58:21.165077] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T17:58:21.590689] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-03T17:58:21.955012] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-03T17:58:22.390702] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-03T17:58:23.190687] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-03T17:58:23.990674] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-03T17:58:24.196989] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:58:24.297069] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:58:24.790731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-03T17:58:25.593120] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-03T17:58:25.885506] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T17:58:26.038796] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:58:26.051092] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T17:58:26.390684] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-03T17:58:27.148911] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:58:27.190679] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-03T17:58:27.990688] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-03T17:58:28.378036] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T17:58:28.380790] [INFO ] [REMOTE ] CDP: Full fetch complete (61914 records). [2025-10-03T17:58:28.380958] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-03T17:58:28.795792] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-03T17:58:28.819991] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-03T17:58:28.820099] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-03T17:58:28.820974] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-03T17:58:28.821153] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-03T17:58:28.822709] [DEBUG] [LOCAL ] CDP: Trimmed 61914 records to 43241 (keeping 200 days of data) [2025-10-03T17:58:29.115340] [DEBUG] [LOCAL ] CDP: Primary data saved (43241 records). [2025-10-03T17:58:29.115514] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-03T17:58:29.115672] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDP took 57.0s. Estimated remaining: 4h 28m 5s. Rate: 7.3 symbols/min [2025-10-03T17:58:29.301762] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:58:29.319281] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:29.379057] [DEBUG] [LOCAL ] CF: Loaded 52560 existing records from primary storage. [2025-10-03T17:58:29.380060] [INFO ] [MAIN ] CF: Loaded 52560 existing records. [2025-10-03T17:58:29.566131] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:29.566569] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-03T17:58:29.566692] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-03T17:58:29.568912] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-03T17:58:29.568979] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-03T17:58:29.601058] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-03T17:58:29.943869] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:30.390688] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-03T17:58:30.611217] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T17:58:30.719620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:58:31.190708] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-03T17:58:31.990707] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-03T17:58:32.178141] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:58:32.225806] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:58:32.559490] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:58:32.560358] [INFO ] [REMOTE ] CEE: Full fetch complete (10183 records). [2025-10-03T17:58:32.560452] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-03T17:58:32.795847] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-03T17:58:32.969199] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-03T17:58:32.969286] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-03T17:58:32.969668] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-03T17:58:32.969732] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-03T17:58:32.970385] [DEBUG] [LOCAL ] CEE: Trimmed 10183 records to 5980 (keeping 200 days of data) [2025-10-03T17:58:33.007007] [DEBUG] [LOCAL ] CEE: Primary data saved (5980 records). [2025-10-03T17:58:33.007174] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-03T17:58:33.007272] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CEE took 29.0s. Estimated remaining: 4h 27m 36s. Rate: 7.3 symbols/min [2025-10-03T17:58:33.195209] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:33.256439] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-10-03T17:58:33.256844] [INFO ] [MAIN ] CFG: Loaded 54014 existing records. [2025-10-03T17:58:33.451756] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:33.451970] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-03T17:58:33.452052] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-03T17:58:33.453660] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-03T17:58:33.453730] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-03T17:58:33.604898] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-03T17:58:33.853901] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:34.175708] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:58:34.390727] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-03T17:58:34.967729] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T17:58:35.190703] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-03T17:58:35.990675] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-03T17:58:36.415878] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:58:36.416175] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:58:36.431575] [INFO ] [REMOTE ] CEPU: Full fetch complete (39601 records). [2025-10-03T17:58:36.431776] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-03T17:58:36.795797] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-03T17:58:36.840365] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-03T17:58:36.840459] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-03T17:58:36.841111] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-03T17:58:36.841180] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-03T17:58:36.842289] [DEBUG] [LOCAL ] CEPU: Trimmed 39601 records to 26369 (keeping 200 days of data) [2025-10-03T17:58:36.999143] [DEBUG] [LOCAL ] CEPU: Primary data saved (26369 records). [2025-10-03T17:58:36.999289] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-03T17:58:36.999375] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CEPU took 22.8s. Estimated remaining: 4h 27m 9s. Rate: 7.3 symbols/min [2025-10-03T17:58:37.188087] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:37.188288] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-03T17:58:37.188328] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-03T17:58:37.188467] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-03T17:58:37.188547] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-03T17:58:37.188601] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-03T17:58:37.188667] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-03T17:58:37.587400] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:37.590621] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-03T17:58:37.790765] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:58:37.794271] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-03T17:58:37.795049] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:58:37.796297] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:58:37.796516] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-03T17:58:37.807844] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:58:37.807933] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-03T17:58:37.808184] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-03T17:58:37.808236] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-03T17:58:37.808298] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-03T17:58:37.808386] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CFND took 0.8s. Estimated remaining: 4h 26m 27s. Rate: 7.3 symbols/min [2025-10-03T17:58:37.991850] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:38.026502] [DEBUG] [LOCAL ] CFR: Loaded 33393 existing records from primary storage. [2025-10-03T17:58:38.026811] [INFO ] [MAIN ] CFR: Loaded 33393 existing records. [2025-10-03T17:58:38.211455] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:38.211690] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-03T17:58:38.211748] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-03T17:58:38.212955] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-03T17:58:38.213017] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-03T17:58:38.395819] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-03T17:58:38.596804] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:38.634425] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:58:39.190674] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-03T17:58:39.990664] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-03T17:58:40.137459] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:58:40.140200] [INFO ] [REMOTE ] CE: Full fetch complete (74821 records). [2025-10-03T17:58:40.140325] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-03T17:58:40.572271] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-03T17:58:40.572441] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-03T17:58:40.573476] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-03T17:58:40.573567] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-03T17:58:40.592208] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:58:40.599729] [DEBUG] [LOCAL ] CE: Trimmed 74821 records to 52243 (keeping 200 days of data) [2025-10-03T17:58:40.795067] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-03T17:58:40.934942] [DEBUG] [LOCAL ] CE: Primary data saved (52243 records). [2025-10-03T17:58:40.935121] [INFO ] [MAIN ] CE: Full history saved. [2025-10-03T17:58:40.935926] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CE took 46.9s. Estimated remaining: 4h 25m 55s. Rate: 7.3 symbols/min [2025-10-03T17:58:41.129865] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:41.130043] [DEBUG] [LOCAL ] CGAU: No existing data file found in primary storage. [2025-10-03T17:58:41.130081] [WARN ] [MAIN ] CGAU: No existing data found, performing full refresh instead. [2025-10-03T17:58:41.130210] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-03T17:58:41.130253] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-03T17:58:41.130295] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-03T17:58:41.130329] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-03T17:58:41.552869] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:41.590676] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-03T17:58:41.718333] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:58:42.395755] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-03T17:58:42.417763] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:58:42.971971] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:58:43.190675] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-03T17:58:43.990713] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-03T17:58:44.144350] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:58:44.790751] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-03T17:58:45.027717] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:58:45.288741] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:58:45.590737] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-03T17:58:46.060246] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:58:46.390707] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-03T17:58:47.190638] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-03T17:58:47.469076] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T17:58:47.925630] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T17:58:47.990713] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-03T17:58:48.624005] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:58:48.790685] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-03T17:58:49.590694] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-03T17:58:49.740758] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:58:50.258978] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T17:58:50.390690] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-03T17:58:51.190680] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-03T17:58:51.339176] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:58:51.990681] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-03T17:58:52.030486] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:58:52.282460] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T17:58:52.790695] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-03T17:58:53.590698] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-03T17:58:53.696034] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:58:53.842501] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:58:54.390726] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-03T17:58:55.190682] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-03T17:58:55.399783] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:58:55.442096] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:58:55.990739] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-03T17:58:56.790681] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-03T17:58:56.962898] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T17:58:57.479884] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T17:58:57.590670] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-03T17:58:58.224793] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T17:58:58.390710] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-03T17:58:59.067083] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:58:59.190692] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-03T17:58:59.990631] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-03T17:59:00.203312] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:59:00.790720] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-03T17:59:00.838056] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T17:59:00.842479] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-03T17:59:00.842768] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-03T17:59:01.539142] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-03T17:59:01.549480] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T17:59:01.548111] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-03T17:59:01.557791] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-03T17:59:01.558870] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-03T17:59:01.561047] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-10-03T17:59:01.632333] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-03T17:59:01.951289] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-10-03T17:59:01.951448] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-03T17:59:01.952442] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CFG took 28.9s. Estimated remaining: 4h 26m 45s. Rate: 7.3 symbols/min [2025-10-03T17:59:02.134789] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:02.139027] [DEBUG] [LOCAL ] CGV: Loaded 1408 existing records from primary storage. [2025-10-03T17:59:02.139187] [INFO ] [MAIN ] CGV: Loaded 1408 existing records. [2025-10-03T17:59:02.333900] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:02.334295] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-03T17:59:02.334409] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-03T17:59:02.334920] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-03T17:59:02.335068] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-03T17:59:02.398553] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-03T17:59:02.673572] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:59:02.794599] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:02.812397] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:59:03.190675] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-03T17:59:03.755102] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:59:03.990690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-03T17:59:04.513368] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-03T17:59:04.790667] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-03T17:59:05.078088] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T17:59:05.590737] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-03T17:59:06.002301] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T17:59:06.040786] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:59:06.390702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-03T17:59:07.190680] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-03T17:59:07.813044] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:59:07.990691] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-03T17:59:08.565927] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:59:08.568723] [INFO ] [REMOTE ] CF: Full fetch complete (75262 records). [2025-10-03T17:59:08.568864] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-03T17:59:08.795924] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-03T17:59:09.010390] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-03T17:59:09.010498] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-03T17:59:09.011519] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-03T17:59:09.011603] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-03T17:59:09.013405] [DEBUG] [LOCAL ] CF: Trimmed 75262 records to 52917 (keeping 200 days of data) [2025-10-03T17:59:09.268532] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:59:09.389542] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:59:09.396272] [DEBUG] [LOCAL ] CF: Primary data saved (52917 records). [2025-10-03T17:59:09.396408] [INFO ] [MAIN ] CF: Full history saved. [2025-10-03T17:59:09.396493] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CF took 40.3s. Estimated remaining: 4h 26m 33s. Rate: 7.3 symbols/min [2025-10-03T17:59:09.584475] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:09.584671] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-03T17:59:09.584730] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-03T17:59:09.584880] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-03T17:59:09.584925] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-03T17:59:09.584969] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-03T17:59:09.585004] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-03T17:59:09.596090] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-03T17:59:09.971477] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:10.107928] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T17:59:10.390701] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-03T17:59:10.747279] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T17:59:11.190675] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-03T17:59:11.525411] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-03T17:59:11.990700] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-03T17:59:12.790698] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-03T17:59:13.190610] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T17:59:13.590699] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-03T17:59:14.390684] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-03T17:59:14.710333] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:59:14.919933] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-03T17:59:14.942097] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:59:15.190690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-03T17:59:15.673191] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T17:59:15.990707] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-03T17:59:16.790700] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-03T17:59:17.137426] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T17:59:17.590621] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-03T17:59:17.773370] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:59:18.390685] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-03T17:59:18.907543] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:59:19.095253] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T17:59:19.190727] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-03T17:59:19.990679] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-03T17:59:20.366528] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T17:59:20.790691] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-03T17:59:21.058166] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:59:21.060134] [INFO ] [REMOTE ] CFR: Full fetch complete (48528 records). [2025-10-03T17:59:21.060256] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-03T17:59:21.228914] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T17:59:21.479049] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-03T17:59:21.479132] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-03T17:59:21.479776] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-03T17:59:21.479852] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-03T17:59:21.481093] [DEBUG] [LOCAL ] CFR: Trimmed 48528 records to 33593 (keeping 200 days of data) [2025-10-03T17:59:21.594713] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-03T17:59:21.713475] [DEBUG] [LOCAL ] CFR: Primary data saved (33593 records). [2025-10-03T17:59:21.713662] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-03T17:59:21.713773] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFR took 43.9s. Estimated remaining: 4h 26m 43s. Rate: 7.3 symbols/min [2025-10-03T17:59:21.895832] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:21.946771] [DEBUG] [LOCAL ] CHD: Loaded 52490 existing records from primary storage. [2025-10-03T17:59:21.947133] [INFO ] [MAIN ] CHD: Loaded 52490 existing records. [2025-10-03T17:59:22.149200] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:22.149448] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-03T17:59:22.149500] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-03T17:59:22.151181] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-03T17:59:22.151243] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-03T17:59:22.401548] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-03T17:59:22.537902] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:22.961008] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T17:59:22.961964] [INFO ] [REMOTE ] CGV: Full fetch complete (2275 records). [2025-10-03T17:59:22.962076] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-03T17:59:23.204920] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-03T17:59:23.237441] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:59:23.293569] [INFO ] [REMOTE ] CGAU: Full fetch complete (61011 records). [2025-10-03T17:59:23.311747] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-03T17:59:23.560089] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-03T17:59:23.584852] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-03T17:59:23.599403] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-03T17:59:23.641046] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-03T17:59:23.711133] [DEBUG] [LOCAL ] CGV: Trimmed 2275 records to 1411 (keeping 200 days of data) [2025-10-03T17:59:23.796978] [DEBUG] [LOCAL ] CGV: Primary data saved (1411 records). [2025-10-03T17:59:23.816759] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-03T17:59:23.853276] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CGV took 21.9s. Estimated remaining: 4h 26m 7s. Rate: 7.3 symbols/min [2025-10-03T17:59:23.861832] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-03T17:59:23.904559] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-03T17:59:23.934120] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-03T17:59:23.945545] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-03T17:59:23.991821] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-03T17:59:24.045886] [DEBUG] [LOCAL ] CGAU: Trimmed 61011 records to 43455 (keeping 200 days of data) [2025-10-03T17:59:24.049872] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:24.159539] [DEBUG] [LOCAL ] CHE: Loaded 15178 existing records from primary storage. [2025-10-03T17:59:24.162371] [INFO ] [MAIN ] CHE: Loaded 15178 existing records. [2025-10-03T17:59:24.380084] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:24.383753] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-03T17:59:24.383835] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-03T17:59:24.385192] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-03T17:59:24.385299] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-03T17:59:24.964830] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:24.968543] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-03T17:59:24.970735] [DEBUG] [LOCAL ] CGAU: Primary data saved (43455 records). [2025-10-03T17:59:24.972166] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-03T17:59:24.972426] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 44.0s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-03T17:59:25.167705] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:25.198825] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T17:59:25.248914] [DEBUG] [LOCAL ] CHGG: Loaded 47996 existing records from primary storage. [2025-10-03T17:59:25.249323] [INFO ] [MAIN ] CHGG: Loaded 47996 existing records. [2025-10-03T17:59:25.465753] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:25.466204] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-03T17:59:25.467450] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:59:25.466684] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-03T17:59:25.473889] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-03T17:59:25.474084] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-03T17:59:25.590634] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-03T17:59:25.896384] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:25.898578] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:59:26.390628] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-03T17:59:26.492606] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T17:59:27.190685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-03T17:59:27.796409] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:59:27.990698] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-03T17:59:28.790720] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-03T17:59:29.028135] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:59:29.069119] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:59:29.590718] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-03T17:59:29.828630] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:59:30.390710] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-03T17:59:31.195793] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-03T17:59:31.214264] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T17:59:31.662160] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:59:31.990698] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-03T17:59:32.799235] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-03T17:59:32.818204] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:59:32.957573] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:59:33.590725] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-03T17:59:33.671212] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T17:59:34.390723] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-03T17:59:34.569670] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T17:59:35.190714] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-03T17:59:35.990704] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-03T17:59:36.174751] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:59:36.789469] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:59:36.798892] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-03T17:59:36.980229] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:59:36.981702] [INFO ] [REMOTE ] CHCT: Full fetch complete (34928 records). [2025-10-03T17:59:36.981785] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-03T17:59:37.402690] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-03T17:59:37.402812] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-03T17:59:37.403370] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-03T17:59:37.403453] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-03T17:59:37.404633] [DEBUG] [LOCAL ] CHCT: Trimmed 34928 records to 24161 (keeping 200 days of data) [2025-10-03T17:59:37.565808] [DEBUG] [LOCAL ] CHCT: Primary data saved (24161 records). [2025-10-03T17:59:37.565957] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-03T17:59:37.566051] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CHCT took 28.2s. Estimated remaining: 4h 25m 39s. Rate: 7.3 symbols/min [2025-10-03T17:59:37.603516] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-03T17:59:37.782630] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:37.819135] [DEBUG] [LOCAL ] CHH: Loaded 32209 existing records from primary storage. [2025-10-03T17:59:37.819446] [INFO ] [MAIN ] CHH: Loaded 32209 existing records. [2025-10-03T17:59:38.017481] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:38.017728] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-03T17:59:38.017815] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-03T17:59:38.018131] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-03T17:59:38.018190] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-03T17:59:38.391149] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-03T17:59:38.426305] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:38.723432] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:59:39.190639] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-03T17:59:39.473451] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:59:39.631492] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T17:59:39.990722] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-03T17:59:40.790685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-03T17:59:40.992175] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:59:41.005744] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T17:59:41.590686] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-03T17:59:42.356428] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:59:42.390626] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-03T17:59:42.755174] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:59:43.190696] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-03T17:59:43.797040] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:59:43.990694] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-03T17:59:44.522818] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:59:44.790711] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-03T17:59:45.590718] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-03T17:59:45.951041] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T17:59:46.390637] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-03T17:59:46.701299] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T17:59:46.778582] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:59:47.190637] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-03T17:59:47.419545] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:59:47.990716] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-03T17:59:48.790736] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-03T17:59:49.003929] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:59:49.482348] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:59:49.568378] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T17:59:49.590684] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-03T17:59:50.390763] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-03T17:59:51.190712] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-03T17:59:51.461865] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:59:51.990676] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-03T17:59:52.278807] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T17:59:52.312959] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:59:52.790727] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-03T17:59:53.602292] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-03T17:59:53.638689] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T17:59:54.390708] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-03T17:59:54.562398] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:59:54.608315] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T17:59:55.190697] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-03T17:59:55.990740] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-03T17:59:56.201806] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:59:56.313785] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T17:59:56.790716] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-03T17:59:57.361884] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:59:57.590782] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-03T17:59:58.390702] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-03T17:59:58.489282] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:59:58.490781] [INFO ] [REMOTE ] CHE: Full fetch complete (20121 records). [2025-10-03T17:59:58.490884] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-03T17:59:58.848398] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T17:59:58.980342] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-03T17:59:58.980429] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-03T17:59:58.980844] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-03T17:59:58.980910] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-03T17:59:58.981539] [DEBUG] [LOCAL ] CHE: Trimmed 20121 records to 15300 (keeping 200 days of data) [2025-10-03T17:59:59.082610] [DEBUG] [LOCAL ] CHE: Primary data saved (15300 records). [2025-10-03T17:59:59.082781] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-03T17:59:59.082917] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CHE took 35.2s. Estimated remaining: 4h 26m 29s. Rate: 7.3 symbols/min [2025-10-03T17:59:59.195830] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-03T17:59:59.271525] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:59.296259] [DEBUG] [LOCAL ] CHMI: Loaded 22017 existing records from primary storage. [2025-10-03T17:59:59.296554] [INFO ] [MAIN ] CHMI: Loaded 22017 existing records. [2025-10-03T17:59:59.491816] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:59.492079] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-03T17:59:59.492134] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-03T17:59:59.492376] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-03T17:59:59.492442] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-03T17:59:59.890759] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:59.990723] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-03T18:00:00.017215] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:00:00.020007] [INFO ] [REMOTE ] CHGG: Full fetch complete (70444 records). [2025-10-03T18:00:00.020169] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-03T18:00:00.438245] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-03T18:00:00.438340] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-03T18:00:00.439292] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-03T18:00:00.439368] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-03T18:00:00.441079] [DEBUG] [LOCAL ] CHGG: Trimmed 70444 records to 48372 (keeping 200 days of data) [2025-10-03T18:00:00.748978] [DEBUG] [LOCAL ] CHGG: Primary data saved (48372 records). [2025-10-03T18:00:00.749200] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-03T18:00:00.750191] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHGG took 35.8s. Estimated remaining: 4h 25m 52s. Rate: 7.3 symbols/min [2025-10-03T18:00:00.798971] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:00:00.792081] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-03T18:00:00.827440] [INFO ] [REMOTE ] CHD: Full fetch complete (74413 records). [2025-10-03T18:00:00.851721] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-03T18:00:01.084509] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:01.178542] [DEBUG] [LOCAL ] CHN: Loaded 4849 existing records from primary storage. [2025-10-03T18:00:01.202126] [INFO ] [MAIN ] CHN: Loaded 4849 existing records. [2025-10-03T18:00:01.652499] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:00:01.721534] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:01.721782] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-03T18:00:01.722046] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-03T18:00:01.722176] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-03T18:00:01.722127] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-03T18:00:01.723447] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-03T18:00:01.729900] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-03T18:00:01.723382] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-03T18:00:01.730199] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-03T18:00:01.729757] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-03T18:00:01.848715] [DEBUG] [LOCAL ] CHD: Trimmed 74413 records to 52856 (keeping 200 days of data) [2025-10-03T18:00:02.303280] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:02.347059] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T18:00:02.424706] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-03T18:00:02.588136] [DEBUG] [LOCAL ] CHD: Primary data saved (52856 records). [2025-10-03T18:00:02.588316] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-03T18:00:02.588410] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHD took 40.9s. Estimated remaining: 4h 25m 15s. Rate: 7.3 symbols/min [2025-10-03T18:00:03.117884] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:00:03.190712] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-03T18:00:03.990722] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-03T18:00:04.029716] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T18:00:04.666296] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T18:00:04.790682] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-03T18:00:05.112045] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:00:05.590698] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-03T18:00:06.152829] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:00:06.192705] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:00:06.390724] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-03T18:00:07.190703] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-03T18:00:07.856720] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:00:07.990774] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-03T18:00:08.346957] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:00:08.430084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:00:08.790740] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-03T18:00:09.385157] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T18:00:09.590732] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-03T18:00:10.390701] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-03T18:00:10.924800] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T18:00:11.102116] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T18:00:11.190706] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-03T18:00:11.990699] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-03T18:00:12.494455] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:00:12.624420] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:00:12.790696] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-03T18:00:13.590742] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-03T18:00:13.980148] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:00:13.982091] [INFO ] [REMOTE ] CHH: Full fetch complete (46744 records). [2025-10-03T18:00:13.982179] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-03T18:00:14.309707] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T18:00:14.395880] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-03T18:00:14.454239] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-03T18:00:14.454336] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-03T18:00:14.455872] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-03T18:00:14.455972] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-03T18:00:14.458092] [DEBUG] [LOCAL ] CHH: Trimmed 46744 records to 32481 (keeping 200 days of data) [2025-10-03T18:00:14.691538] [DEBUG] [LOCAL ] CHH: Primary data saved (32481 records). [2025-10-03T18:00:14.691723] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-03T18:00:14.691909] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHH took 37.1s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-03T18:00:15.013433] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:00:15.190705] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-03T18:00:15.834826] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:00:15.990739] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-03T18:00:16.657306] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:00:16.790702] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-03T18:00:17.590713] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-03T18:00:17.920740] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:00:18.121333] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T18:00:18.122343] [INFO ] [REMOTE ] CHN: Full fetch complete (7434 records). [2025-10-03T18:00:18.122439] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-03T18:00:18.397091] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-03T18:00:18.526958] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-03T18:00:18.527048] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-03T18:00:18.527287] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-03T18:00:18.527329] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-03T18:00:18.527857] [DEBUG] [LOCAL ] CHN: Trimmed 7434 records to 4866 (keeping 200 days of data) [2025-10-03T18:00:18.558280] [DEBUG] [LOCAL ] CHN: Primary data saved (4866 records). [2025-10-03T18:00:18.558443] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-03T18:00:18.558595] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHN took 17.8s. Estimated remaining: 4h 24m 57s. Rate: 7.3 symbols/min [2025-10-03T18:00:19.720941] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:00:19.726462] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-03T18:00:20.755588] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:00:20.760856] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-03T18:00:21.855383] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:00:21.861523] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-03T18:00:22.994501] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T18:00:22.995882] [INFO ] [REMOTE ] CHMI: Full fetch complete (31836 records). [2025-10-03T18:00:22.995958] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-03T18:00:23.423941] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-03T18:00:23.424038] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-03T18:00:23.424562] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-03T18:00:23.424662] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-03T18:00:23.425617] [DEBUG] [LOCAL ] CHMI: Trimmed 31836 records to 22168 (keeping 200 days of data) [2025-10-03T18:00:23.567257] [DEBUG] [LOCAL ] CHMI: Primary data saved (22168 records). [2025-10-03T18:00:23.567401] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-03T18:00:23.567500] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHMI took 24.5s. Estimated remaining: 4h 24m 34s. Rate: 7.3 symbols/min [2025-10-03T18:00:24.221568] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.347497] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.435832] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.437748] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.437893] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-03T18:00:24.438030] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-03T18:00:24.438940] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-03T18:00:24.438991] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-03T18:00:24.439037] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-03T18:00:24.439071] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-03T18:00:24.581762] [DEBUG] [LOCAL ] CHT: Loaded 19829 existing records from primary storage. [2025-10-03T18:00:24.609796] [INFO ] [MAIN ] CHT: Loaded 19829 existing records. [2025-10-03T18:00:25.054526] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-10-03T18:00:25.158099] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.122071] [INFO ] [MAIN ] CHWY: Loaded 54044 existing records. [2025-10-03T18:00:25.213623] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.179891] [DEBUG] [LOCAL ] CI: Loaded 50086 existing records from primary storage. [2025-10-03T18:00:25.229237] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-03T18:00:25.291756] [INFO ] [MAIN ] CI: Loaded 50086 existing records. [2025-10-03T18:00:25.354942] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:25.372259] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-03T18:00:25.382790] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-03T18:00:25.428281] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-03T18:00:25.626390] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.721715] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.759479] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-03T18:00:25.774550] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.821377] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-03T18:00:25.821496] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.855918] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-03T18:00:25.885706] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-03T18:00:25.875743] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-03T18:00:25.908797] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-03T18:00:26.352760] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.425968] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-03T18:00:26.962273] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.971844] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-03T18:00:26.971284] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.973281] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-03T18:00:27.662943] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:00:27.668201] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-03T18:00:27.848061] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:00:27.859921] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-03T18:00:28.320204] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:00:28.324324] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-03T18:00:28.865584] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:00:28.877737] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-03T18:00:29.043083] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T18:00:29.048308] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-03T18:00:29.370908] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-03T18:00:29.382604] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-03T18:00:30.065755] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:00:30.071585] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-03T18:00:30.178889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-03T18:00:30.390615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-03T18:00:30.741004] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T18:00:31.190673] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-03T18:00:31.263534] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:00:31.290122] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T18:00:31.990721] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-03T18:00:32.670635] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-03T18:00:32.790615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-03T18:00:33.000442] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:00:33.182514] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T18:00:33.590691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-03T18:00:34.390614] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-03T18:00:34.893960] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T18:00:35.190717] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-03T18:00:35.429693] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:00:35.453895] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:00:35.990744] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-03T18:00:36.790756] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-03T18:00:36.854909] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:00:36.957445] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T18:00:37.590712] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-03T18:00:38.390734] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-03T18:00:39.190744] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-03T18:00:39.392555] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:00:39.617388] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-03T18:00:39.990709] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-03T18:00:40.502713] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:00:40.548928] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:00:40.790698] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-03T18:00:41.590738] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-03T18:00:42.043155] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T18:00:42.070989] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T18:00:42.390721] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-03T18:00:43.190724] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-03T18:00:43.780500] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-03T18:00:43.824628] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T18:00:43.990686] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-03T18:00:44.790631] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-03T18:00:45.160140] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:00:45.590702] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-03T18:00:45.881814] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:00:45.885185] [INFO ] [REMOTE ] CHT: Full fetch complete (27489 records). [2025-10-03T18:00:45.885265] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-03T18:00:46.316523] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-03T18:00:46.316714] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-03T18:00:46.317201] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-03T18:00:46.317282] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-03T18:00:46.328609] [DEBUG] [LOCAL ] CHT: Trimmed 27489 records to 19918 (keeping 200 days of data) [2025-10-03T18:00:46.349676] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-03T18:00:46.398706] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-03T18:00:46.482271] [DEBUG] [LOCAL ] CHT: Primary data saved (19918 records). [2025-10-03T18:00:46.482419] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-03T18:00:46.482505] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CHT took 22.9s. Estimated remaining: 4h 25m 30s. Rate: 7.3 symbols/min [2025-10-03T18:00:46.670304] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:46.688293] [DEBUG] [LOCAL ] CIA: Loaded 17134 existing records from primary storage. [2025-10-03T18:00:46.688596] [INFO ] [MAIN ] CIA: Loaded 17134 existing records. [2025-10-03T18:00:46.899324] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:46.899586] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-03T18:00:46.899679] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-03T18:00:46.899928] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-03T18:00:46.900004] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-03T18:00:47.196779] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-03T18:00:47.341099] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:47.379513] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:00:47.990629] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-03T18:00:48.443040] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T18:00:48.790706] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-03T18:00:49.590756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-03T18:00:49.954803] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T18:00:50.390681] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-03T18:00:50.475533] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:00:50.589989] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:00:51.190691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-03T18:00:51.505956] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (4.31 seconds). [2025-10-03T18:00:51.990718] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-03T18:00:52.468328] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T18:00:52.724098] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:00:52.790696] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-03T18:00:53.590712] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-03T18:00:53.653411] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:00:54.360232] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:00:54.363105] [INFO ] [REMOTE ] CI: Full fetch complete (72362 records). [2025-10-03T18:00:54.363260] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-03T18:00:54.395783] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-03T18:00:54.794456] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-03T18:00:54.794547] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-03T18:00:54.795362] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-03T18:00:54.795431] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-03T18:00:54.796950] [DEBUG] [LOCAL ] CI: Trimmed 72362 records to 50475 (keeping 200 days of data) [2025-10-03T18:00:55.137505] [DEBUG] [LOCAL ] CI: Primary data saved (50475 records). [2025-10-03T18:00:55.137667] [INFO ] [MAIN ] CI: Full history saved. [2025-10-03T18:00:55.139066] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CI took 31.5s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-03T18:00:55.195774] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-03T18:00:55.344005] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:55.344270] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-03T18:00:55.344347] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-03T18:00:55.344561] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-03T18:00:55.344609] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-03T18:00:55.344694] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-03T18:00:55.344748] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-03T18:00:55.444250] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:00:55.761275] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:55.796866] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T18:00:55.990730] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-03T18:00:56.790635] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-03T18:00:56.971349] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:00:57.041885] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T18:00:57.590758] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-03T18:00:57.757739] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:00:58.390728] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-03T18:00:58.961338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:00:59.190693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-03T18:00:59.723370] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T18:00:59.725850] [INFO ] [REMOTE ] CHPT: Full fetch complete (72573 records). [2025-10-03T18:00:59.725990] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-03T18:00:59.996594] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-03T18:01:00.203185] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-03T18:01:00.203327] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-03T18:01:00.204435] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-03T18:01:00.204512] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-03T18:01:00.211956] [DEBUG] [LOCAL ] CHPT: Trimmed 72573 records to 49254 (keeping 200 days of data) [2025-10-03T18:01:00.528325] [DEBUG] [LOCAL ] CHPT: Primary data saved (49254 records). [2025-10-03T18:01:00.528510] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-03T18:01:00.528669] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHPT took 37.0s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-03T18:01:00.722212] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:00.722446] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-03T18:01:00.722510] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-03T18:01:00.722685] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-03T18:01:00.722757] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-03T18:01:00.722830] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-03T18:01:00.722869] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-03T18:01:00.801018] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-03T18:01:01.150524] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:01.233900] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:01:01.278781] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T18:01:01.590693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-03T18:01:02.390762] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-03T18:01:02.934294] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-03T18:01:03.190722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-03T18:01:03.234374] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T18:01:03.237241] [INFO ] [REMOTE ] CHWY: Full fetch complete (77633 records). [2025-10-03T18:01:03.237410] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-03T18:01:03.420356] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:01:03.724592] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-03T18:01:03.724946] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-03T18:01:03.726315] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-03T18:01:03.726388] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-03T18:01:03.728711] [DEBUG] [LOCAL ] CHWY: Trimmed 77633 records to 54434 (keeping 200 days of data) [2025-10-03T18:01:03.991004] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-03T18:01:04.179594] [DEBUG] [LOCAL ] CHWY: Primary data saved (54434 records). [2025-10-03T18:01:04.179855] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-03T18:01:04.179981] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHWY took 40.6s. Estimated remaining: 4h 24m 35s. Rate: 7.3 symbols/min [2025-10-03T18:01:04.472059] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:04.472465] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-03T18:01:04.472698] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-03T18:01:04.472943] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-03T18:01:04.473010] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-03T18:01:04.473084] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-03T18:01:04.473144] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-03T18:01:04.795787] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-03T18:01:04.817682] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:01:05.016753] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:05.590731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-03T18:01:05.808767] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:01:06.390691] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-03T18:01:07.139404] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-10-03T18:01:07.163984] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T18:01:07.190631] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-03T18:01:07.990743] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-03T18:01:08.579511] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:01:08.790708] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-03T18:01:09.590697] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-03T18:01:11.491587] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:01:11.507414] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-03T18:01:11.537087] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (5.15 seconds). [2025-10-03T18:01:11.543409] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-03T18:01:12.559986] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:01:12.565286] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-03T18:01:13.189370] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T18:01:13.201270] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-03T18:01:14.195271] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (7.00 seconds). [2025-10-03T18:01:14.202719] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-03T18:01:14.822139] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (6.03 seconds). [2025-10-03T18:01:14.823476] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-03T18:01:14.922610] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:01:15.190713] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-03T18:01:15.285165] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-03T18:01:15.305985] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T18:01:15.990692] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-03T18:01:16.792335] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T18:01:16.792183] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-03T18:01:16.994468] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:01:17.595768] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-03T18:01:17.602964] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (5.04 seconds). [2025-10-03T18:01:17.715822] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:01:18.091856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T18:01:18.390697] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-03T18:01:19.190699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-03T18:01:19.401939] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:01:19.990726] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-03T18:01:20.735406] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:01:20.736580] [INFO ] [REMOTE ] CIA: Full fetch complete (23474 records). [2025-10-03T18:01:20.736715] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-03T18:01:20.737299] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:01:20.737386] [FATAL] [MAIN ] CIA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:01:20.737432] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:01:20.737472] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-03T18:01:20.737543] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-03T18:01:20.737600] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-10-03T18:01:20.738093] [DEBUG] [LOCAL ] CIA: Deleted derivative data file. [2025-10-03T18:01:20.738224] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CIA took 34.3s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-03T18:01:20.795928] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-03T18:01:20.935285] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:20.942688] [DEBUG] [LOCAL ] CIF: Loaded 4220 existing records from primary storage. [2025-10-03T18:01:20.942916] [INFO ] [MAIN ] CIF: Loaded 4220 existing records. [2025-10-03T18:01:21.189253] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:21.189823] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-03T18:01:21.192291] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:01:21.190380] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-03T18:01:21.204306] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-03T18:01:21.204891] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-03T18:01:21.324824] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-03T18:01:21.599578] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-03T18:01:21.622739] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:22.024681] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T18:01:22.390741] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-03T18:01:23.153118] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T18:01:23.190626] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-03T18:01:23.787338] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:01:23.990750] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-03T18:01:24.258100] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-03T18:01:24.790745] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-03T18:01:25.590704] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-03T18:01:25.927925] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T18:01:26.390693] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-03T18:01:26.577589] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:01:26.785909] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T18:01:26.786579] [INFO ] [REMOTE ] CICB: Full fetch complete (2045 records). [2025-10-03T18:01:26.786675] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-03T18:01:27.063777] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T18:01:27.064032] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:01:27.064125] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:01:27.064223] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-03T18:01:27.064309] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-03T18:01:27.064350] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-03T18:01:27.064393] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-03T18:01:27.064452] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CICB took 26.5s. Estimated remaining: 4h 24m 46s. Rate: 7.3 symbols/min [2025-10-03T18:01:27.195855] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-03T18:01:27.246231] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:27.246403] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-03T18:01:27.246507] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-03T18:01:27.246627] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-03T18:01:27.246706] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-03T18:01:27.246763] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-03T18:01:27.246801] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-03T18:01:27.658121] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:27.805372] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T18:01:27.990689] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-03T18:01:28.701961] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T18:01:28.790697] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-03T18:01:29.590725] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-03T18:01:30.257967] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T18:01:30.390733] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-03T18:01:31.190769] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-03T18:01:31.820426] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-10-03T18:01:31.990700] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-03T18:01:32.223408] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:01:32.790727] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-03T18:01:33.346198] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:01:33.590724] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-03T18:01:34.018622] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-03T18:01:34.084217] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:01:34.390732] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-03T18:01:35.190634] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-03T18:01:35.317454] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:01:35.708310] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:01:35.990700] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-03T18:01:36.297577] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:01:36.299400] [INFO ] [REMOTE ] CIB: Full fetch complete (44576 records). [2025-10-03T18:01:36.299492] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-03T18:01:36.730366] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-03T18:01:36.730486] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-03T18:01:36.731143] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-03T18:01:36.731212] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-03T18:01:36.732517] [DEBUG] [LOCAL ] CIB: Trimmed 44576 records to 31243 (keeping 200 days of data) [2025-10-03T18:01:36.810387] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-03T18:01:36.956991] [DEBUG] [LOCAL ] CIB: Primary data saved (31243 records). [2025-10-03T18:01:36.957153] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-03T18:01:36.957237] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CIB took 41.8s. Estimated remaining: 4h 24m 45s. Rate: 7.3 symbols/min [2025-10-03T18:01:37.147763] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:37.147962] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-03T18:01:37.148120] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-03T18:01:37.148250] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-03T18:01:37.148294] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-03T18:01:37.148340] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-03T18:01:37.148375] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-03T18:01:37.566711] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:37.590715] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-03T18:01:38.107153] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T18:01:38.390638] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-03T18:01:38.649522] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:01:39.190733] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-03T18:01:39.750553] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T18:01:39.927702] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:01:39.990727] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-03T18:01:40.790706] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-03T18:01:41.432853] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:01:41.478891] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T18:01:41.534795] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (4.72 seconds). [2025-10-03T18:01:41.590737] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-03T18:01:42.390725] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-03T18:01:42.556395] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:01:43.190730] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-03T18:01:43.819710] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:01:43.990693] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-03T18:01:44.168368] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:01:44.790720] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-03T18:01:45.446329] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T18:01:45.590706] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-03T18:01:46.211238] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:01:46.212028] [INFO ] [REMOTE ] CIF: Full fetch complete (6604 records). [2025-10-03T18:01:46.212100] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-03T18:01:46.397206] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-03T18:01:46.623070] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-03T18:01:46.623190] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-03T18:01:46.623456] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-03T18:01:46.623523] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-03T18:01:46.624051] [DEBUG] [LOCAL ] CIF: Trimmed 6604 records to 4246 (keeping 200 days of data) [2025-10-03T18:01:46.650975] [DEBUG] [LOCAL ] CIF: Primary data saved (4246 records). [2025-10-03T18:01:46.651130] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-03T18:01:46.651220] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CIF took 25.9s. Estimated remaining: 4h 24m 43s. Rate: 7.3 symbols/min [2025-10-03T18:01:46.830565] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:46.874474] [DEBUG] [LOCAL ] CIM: Loaded 37813 existing records from primary storage. [2025-10-03T18:01:46.874805] [INFO ] [MAIN ] CIM: Loaded 37813 existing records. [2025-10-03T18:01:47.081473] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:47.081779] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-03T18:01:47.081835] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-03T18:01:47.082227] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-03T18:01:47.082292] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-03T18:01:47.192817] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-03T18:01:47.488353] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:47.585458] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T18:01:47.990726] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-03T18:01:48.270589] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (4.28 seconds). [2025-10-03T18:01:48.790706] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-03T18:01:49.227592] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:01:49.272624] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T18:01:49.590744] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-03T18:01:49.998206] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T18:01:50.251637] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T18:01:50.390732] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-03T18:01:51.190663] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-03T18:01:51.990701] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-03T18:01:52.061140] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T18:01:52.790704] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-03T18:01:52.843680] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:01:53.074226] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T18:01:53.077813] [INFO ] [REMOTE ] CIEN: Full fetch complete (75568 records). [2025-10-03T18:01:53.077988] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-03T18:01:53.512971] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-03T18:01:53.513087] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-03T18:01:53.514692] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-03T18:01:53.514768] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-03T18:01:53.516517] [DEBUG] [LOCAL ] CIEN: Trimmed 75568 records to 52838 (keeping 200 days of data) [2025-10-03T18:01:53.602599] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-03T18:01:53.839708] [DEBUG] [LOCAL ] CIEN: Primary data saved (52838 records). [2025-10-03T18:01:53.839862] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-03T18:01:53.839963] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CIEN took 49.7s. Estimated remaining: 4h 24m 30s. Rate: 7.3 symbols/min [2025-10-03T18:01:54.044957] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:54.051077] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-10-03T18:01:54.051349] [INFO ] [MAIN ] CIMN: Loaded 2697 existing records. [2025-10-03T18:01:54.263818] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:54.264102] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-03T18:01:54.264212] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-03T18:01:54.264582] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-03T18:01:54.264685] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-03T18:01:54.398776] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-03T18:01:54.626970] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:01:54.713760] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:01:54.770979] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:55.190733] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-03T18:01:55.605780] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T18:01:55.990702] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-03T18:01:56.096361] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:01:56.467937] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:01:56.790735] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-03T18:01:57.590957] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-03T18:01:57.739245] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:01:58.390709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-03T18:01:59.190758] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-03T18:01:59.347044] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:01:59.558024] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T18:01:59.664217] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T18:01:59.990724] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-03T18:02:00.790740] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-03T18:02:01.270044] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T18:02:01.418956] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:02:01.420376] [INFO ] [REMOTE ] CII: Full fetch complete (23037 records). [2025-10-03T18:02:01.420501] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-03T18:02:01.595488] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-03T18:02:01.859619] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-03T18:02:01.859744] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-03T18:02:01.860244] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-03T18:02:01.860311] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-03T18:02:01.861074] [DEBUG] [LOCAL ] CII: Trimmed 23037 records to 15458 (keeping 200 days of data) [2025-10-03T18:02:01.961776] [DEBUG] [LOCAL ] CII: Primary data saved (15458 records). [2025-10-03T18:02:01.962058] [INFO ] [MAIN ] CII: Full history saved. [2025-10-03T18:02:01.962183] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CII took 25.0s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-03T18:02:02.207917] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:02.208153] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-03T18:02:02.208213] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-03T18:02:02.208379] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-03T18:02:02.208431] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-03T18:02:02.208507] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-03T18:02:02.208566] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-03T18:02:02.395830] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-03T18:02:02.650853] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:02.750690] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T18:02:03.190699] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-03T18:02:03.990726] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-03T18:02:04.062471] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:02:04.293121] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:02:04.352203] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-03T18:02:04.790695] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-03T18:02:05.257201] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:02:05.590693] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-03T18:02:06.390691] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-03T18:02:06.483823] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T18:02:07.190709] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-03T18:02:07.682600] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T18:02:07.767783] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:02:07.770461] [INFO ] [REMOTE ] CIG: Full fetch complete (61245 records). [2025-10-03T18:02:07.770587] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-03T18:02:07.997362] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-03T18:02:08.228160] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-03T18:02:08.228263] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-03T18:02:08.229063] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-03T18:02:08.229133] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-03T18:02:08.230600] [DEBUG] [LOCAL ] CIG: Trimmed 61245 records to 44526 (keeping 200 days of data) [2025-10-03T18:02:08.500748] [DEBUG] [LOCAL ] CIG: Primary data saved (44526 records). [2025-10-03T18:02:08.500899] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-03T18:02:08.500979] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CIG took 41.4s. Estimated remaining: 4h 24m 5s. Rate: 7.3 symbols/min [2025-10-03T18:02:08.699204] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:08.699445] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-03T18:02:08.699504] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-03T18:02:08.699730] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-03T18:02:08.699817] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-03T18:02:08.699879] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-03T18:02:08.699915] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-03T18:02:08.795793] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-03T18:02:09.093891] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:09.294246] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T18:02:09.590696] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-03T18:02:09.717223] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:02:10.074866] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:02:10.390685] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-03T18:02:10.832839] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:02:11.190690] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-03T18:02:11.829359] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:02:11.990681] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-03T18:02:12.626196] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T18:02:12.627152] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-10-03T18:02:12.627253] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-03T18:02:12.795721] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-03T18:02:13.039814] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-03T18:02:13.039908] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-03T18:02:13.040078] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-03T18:02:13.040149] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-03T18:02:13.040552] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2714 (keeping 200 days of data) [2025-10-03T18:02:13.058493] [DEBUG] [LOCAL ] CIMN: Primary data saved (2714 records). [2025-10-03T18:02:13.058579] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-03T18:02:13.058698] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIMN took 19.2s. Estimated remaining: 4h 23m 41s. Rate: 7.3 symbols/min [2025-10-03T18:02:13.106580] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:02:13.162090] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-03T18:02:13.173882] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:02:13.179796] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-03T18:02:13.179929] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:02:13.200526] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-03T18:02:13.225309] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-03T18:02:13.232240] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-03T18:02:13.250452] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:13.250788] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-03T18:02:13.251257] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CIMP took 4.8s. Estimated remaining: 4h 22m 59s. Rate: 7.3 symbols/min [2025-10-03T18:02:13.452184] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:13.452777] [DEBUG] [LOCAL ] CINT: Loaded 18940 existing records from primary storage. [2025-10-03T18:02:13.453266] [INFO ] [MAIN ] CINT: Loaded 18940 existing records. [2025-10-03T18:02:13.593437] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-03T18:02:13.634319] [DEBUG] [LOCAL ] CIO: Loaded 20557 existing records from primary storage. [2025-10-03T18:02:13.676324] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:13.677107] [INFO ] [MAIN ] CIO: Loaded 20557 existing records. [2025-10-03T18:02:13.677434] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-03T18:02:13.682748] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-03T18:02:13.696466] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-03T18:02:13.702137] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-03T18:02:14.191715] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:14.239800] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-03T18:02:14.242836] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-03T18:02:14.249006] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-03T18:02:14.259290] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-03T18:02:14.395760] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-03T18:02:14.402731] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:14.656604] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:02:14.739333] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:15.190717] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-03T18:02:15.979309] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:02:15.990608] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-03T18:02:16.204489] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:02:16.790690] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-03T18:02:17.461596] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:02:17.590710] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-03T18:02:17.715554] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T18:02:18.390730] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-03T18:02:18.860438] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:02:19.190710] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-03T18:02:19.649145] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:02:19.990706] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-03T18:02:20.790733] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-03T18:02:20.858985] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:02:21.136495] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:02:21.590678] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-03T18:02:21.750736] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T18:02:22.365130] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:02:22.390664] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-03T18:02:23.190697] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-03T18:02:23.254242] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T18:02:23.629117] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T18:02:23.990714] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-03T18:02:24.790722] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-03T18:02:24.954032] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:02:25.140663] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:02:25.590739] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-03T18:02:26.046094] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T18:02:26.390720] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-03T18:02:27.030486] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:02:27.190691] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-03T18:02:27.990681] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-03T18:02:28.287994] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T18:02:28.790718] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-03T18:02:29.341968] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T18:02:29.593487] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-03T18:02:29.595359] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T18:02:30.390725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-03T18:02:30.985134] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T18:02:31.190732] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-03T18:02:31.255446] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:02:31.990687] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-03T18:02:32.051754] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T18:02:32.790706] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-03T18:02:33.009443] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:02:33.590757] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-03T18:02:34.139046] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:02:34.390720] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-03T18:02:34.798993] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T18:02:35.163116] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:02:35.190730] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-03T18:02:35.936089] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:02:35.937047] [INFO ] [REMOTE ] CIMO: Full fetch complete (5337 records). [2025-10-03T18:02:35.937123] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-03T18:02:35.999164] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-03T18:02:36.145161] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:02:36.145425] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:02:36.145499] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:02:36.145573] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-03T18:02:36.145660] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-03T18:02:36.145722] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-03T18:02:36.145789] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-03T18:02:36.145899] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIMO took 34.2s. Estimated remaining: 4h 23m 53s. Rate: 7.3 symbols/min [2025-10-03T18:02:36.338792] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:36.380372] [DEBUG] [LOCAL ] CION: Loaded 29036 existing records from primary storage. [2025-10-03T18:02:36.380721] [INFO ] [MAIN ] CION: Loaded 29036 existing records. [2025-10-03T18:02:36.616805] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:36.617057] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-03T18:02:36.617109] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-03T18:02:36.617956] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-03T18:02:36.618019] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-03T18:02:36.794717] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-03T18:02:37.052061] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:37.064849] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:02:37.590714] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-03T18:02:38.097339] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:02:38.390700] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-03T18:02:39.190699] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-03T18:02:39.429128] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T18:02:39.602561] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T18:02:39.990732] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-03T18:02:40.070348] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:02:40.790715] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-03T18:02:41.359570] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:02:41.362371] [INFO ] [REMOTE ] CIM: Full fetch complete (54996 records). [2025-10-03T18:02:41.362540] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-03T18:02:41.598104] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-03T18:02:41.810083] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-03T18:02:41.810709] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:02:41.816024] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-03T18:02:41.817558] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-03T18:02:41.817733] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-03T18:02:41.819538] [DEBUG] [LOCAL ] CIM: Trimmed 54996 records to 38123 (keeping 200 days of data) [2025-10-03T18:02:42.114163] [DEBUG] [LOCAL ] CIM: Primary data saved (38123 records). [2025-10-03T18:02:42.114333] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-03T18:02:42.114494] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIM took 55.5s. Estimated remaining: 4h 23m 35s. Rate: 7.3 symbols/min [2025-10-03T18:02:42.301384] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:42.361815] [DEBUG] [LOCAL ] CIVI: Loaded 52985 existing records from primary storage. [2025-10-03T18:02:42.362176] [INFO ] [MAIN ] CIVI: Loaded 52985 existing records. [2025-10-03T18:02:42.399209] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-03T18:02:42.586098] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:42.586325] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-03T18:02:42.586377] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-03T18:02:42.588085] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-03T18:02:42.588148] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-03T18:02:42.686331] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:02:42.717037] [INFO ] [REMOTE ] CIO: Full fetch complete (29204 records). [2025-10-03T18:02:42.717199] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-03T18:02:43.197429] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-03T18:02:43.374968] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:43.469739] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-03T18:02:43.469861] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-03T18:02:43.470345] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-03T18:02:43.470422] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-03T18:02:43.471745] [DEBUG] [LOCAL ] CIO: Trimmed 29204 records to 20752 (keeping 200 days of data) [2025-10-03T18:02:43.579578] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T18:02:43.626802] [DEBUG] [LOCAL ] CIO: Primary data saved (20752 records). [2025-10-03T18:02:43.626938] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-03T18:02:43.627039] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CIO took 30.4s. Estimated remaining: 4h 22m 58s. Rate: 7.3 symbols/min [2025-10-03T18:02:43.833934] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:43.834128] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-03T18:02:43.834167] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-03T18:02:43.834282] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-03T18:02:43.834324] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-03T18:02:43.834365] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-03T18:02:43.834397] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-03T18:02:43.995832] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-03T18:02:44.247808] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:44.496682] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:02:44.790613] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-03T18:02:45.189691] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T18:02:45.590726] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-03T18:02:46.390731] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-03T18:02:46.671899] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:02:47.011967] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T18:02:47.190673] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-03T18:02:47.413364] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T18:02:47.415992] [INFO ] [REMOTE ] CINT: Full fetch complete (26784 records). [2025-10-03T18:02:47.416138] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-03T18:02:47.847039] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-03T18:02:47.847152] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-03T18:02:47.847678] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-03T18:02:47.847745] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-03T18:02:47.848758] [DEBUG] [LOCAL ] CINT: Trimmed 26784 records to 19081 (keeping 200 days of data) [2025-10-03T18:02:47.966922] [DEBUG] [LOCAL ] CINT: Primary data saved (19081 records). [2025-10-03T18:02:47.967078] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-03T18:02:47.967169] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CINT took 34.9s. Estimated remaining: 4h 22m 34s. Rate: 7.3 symbols/min [2025-10-03T18:02:48.002102] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-03T18:02:48.190270] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:48.236883] [DEBUG] [LOCAL ] CLB: Loaded 33203 existing records from primary storage. [2025-10-03T18:02:48.237227] [INFO ] [MAIN ] CLB: Loaded 33203 existing records. [2025-10-03T18:02:48.447008] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:48.447261] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-03T18:02:48.447329] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-03T18:02:48.448474] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-03T18:02:48.448568] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-03T18:02:48.804692] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-03T18:02:48.852885] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:49.581149] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:02:49.593404] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-03T18:02:49.854710] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-03T18:02:50.390669] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-03T18:02:50.523276] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:02:50.875545] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T18:02:51.190677] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-03T18:02:51.566386] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T18:02:51.990732] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-03T18:02:52.790635] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-03T18:02:52.907843] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:02:53.285314] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:02:53.590720] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-03T18:02:54.111154] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:02:54.390732] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-03T18:02:54.763196] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:02:55.190728] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-03T18:02:55.959950] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:02:55.990688] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-03T18:02:56.411309] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:02:56.790697] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-03T18:02:57.590706] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-03T18:02:57.725115] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:02:58.390742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-03T18:02:58.504278] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T18:02:58.942354] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T18:02:59.190897] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-03T18:02:59.990939] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-03T18:03:00.245431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:03:00.790695] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-03T18:03:01.160893] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T18:03:01.590747] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-03T18:03:01.815510] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:03:02.390703] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-03T18:03:02.502960] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:03:03.190770] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-03T18:03:03.377837] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:03:03.707526] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:03:03.990690] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-03T18:03:04.275403] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:03:04.790685] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-03T18:03:04.835766] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:03:05.590711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-03T18:03:06.076456] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:03:06.390683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-03T18:03:07.190678] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-03T18:03:07.360563] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T18:03:07.469152] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T18:03:07.470755] [INFO ] [REMOTE ] CION: Full fetch complete (40944 records). [2025-10-03T18:03:07.470883] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-03T18:03:07.921850] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-03T18:03:07.921949] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-03T18:03:07.922626] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-03T18:03:07.922842] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-03T18:03:07.924090] [DEBUG] [LOCAL ] CION: Trimmed 40944 records to 29192 (keeping 200 days of data) [2025-10-03T18:03:08.015271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-03T18:03:08.117364] [DEBUG] [LOCAL ] CION: Primary data saved (29192 records). [2025-10-03T18:03:08.117519] [INFO ] [MAIN ] CION: Full history saved. [2025-10-03T18:03:08.117611] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CION took 32.0s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-03T18:03:08.319350] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:08.334710] [DEBUG] [LOCAL ] CLCO: Loaded 12817 existing records from primary storage. [2025-10-03T18:03:08.334955] [INFO ] [MAIN ] CLCO: Loaded 12817 existing records. [2025-10-03T18:03:08.545069] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:08.545789] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-03T18:03:08.545908] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-03T18:03:08.546274] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-03T18:03:08.567984] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-03T18:03:08.575278] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:03:08.795752] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-03T18:03:08.985865] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:09.590620] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-03T18:03:09.927186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T18:03:10.281963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T18:03:10.390729] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-03T18:03:10.488329] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:03:11.190719] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-03T18:03:11.990664] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-03T18:03:12.041806] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:03:12.790730] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-03T18:03:13.002139] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T18:03:13.487362] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T18:03:13.529943] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:03:13.590737] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-03T18:03:14.390735] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-03T18:03:14.693435] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:03:14.695446] [INFO ] [REMOTE ] CLB: Full fetch complete (46745 records). [2025-10-03T18:03:14.695552] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-03T18:03:15.129696] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-03T18:03:15.129797] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-03T18:03:15.130386] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-03T18:03:15.130430] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-03T18:03:15.131620] [DEBUG] [LOCAL ] CLB: Trimmed 46745 records to 33416 (keeping 200 days of data) [2025-10-03T18:03:15.197118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-03T18:03:15.363199] [DEBUG] [LOCAL ] CLB: Primary data saved (33416 records). [2025-10-03T18:03:15.363354] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-03T18:03:15.363443] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CLB took 27.4s. Estimated remaining: 4h 23m 3s. Rate: 7.3 symbols/min [2025-10-03T18:03:15.556755] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:15.585808] [DEBUG] [LOCAL ] CLDT: Loaded 25578 existing records from primary storage. [2025-10-03T18:03:15.586116] [INFO ] [MAIN ] CLDT: Loaded 25578 existing records. [2025-10-03T18:03:15.814664] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:15.815055] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-03T18:03:15.815113] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-03T18:03:15.815365] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-03T18:03:15.815424] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-03T18:03:15.995782] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-03T18:03:16.250293] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:16.317631] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:03:16.790621] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-03T18:03:17.158863] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T18:03:17.284297] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T18:03:17.590730] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-03T18:03:18.390709] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-03T18:03:18.542372] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:03:19.190703] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-03T18:03:19.597622] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:03:19.634628] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:03:19.990792] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-03T18:03:20.417613] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:03:20.790793] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-03T18:03:21.590701] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-03T18:03:21.757477] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T18:03:21.897877] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:03:22.390714] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-03T18:03:22.721587] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:03:23.190735] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-03T18:03:23.990678] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-03T18:03:24.088980] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T18:03:24.465876] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:03:24.469430] [INFO ] [REMOTE ] CIVI: Full fetch complete (75717 records). [2025-10-03T18:03:24.469676] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-03T18:03:24.799937] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-03T18:03:24.967565] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-03T18:03:24.967756] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-03T18:03:24.968732] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-03T18:03:24.968806] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-03T18:03:24.970447] [DEBUG] [LOCAL ] CIVI: Trimmed 75717 records to 53365 (keeping 200 days of data) [2025-10-03T18:03:25.323354] [DEBUG] [LOCAL ] CIVI: Primary data saved (53365 records). [2025-10-03T18:03:25.323511] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-03T18:03:25.323599] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CIVI took 43.2s. Estimated remaining: 4h 23m 1s. Rate: 7.3 symbols/min [2025-10-03T18:03:25.517027] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:25.531813] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T18:03:25.581729] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-03T18:03:25.582094] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-03T18:03:25.595883] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-03T18:03:25.782753] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:25.783075] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-03T18:03:25.783149] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-03T18:03:25.783499] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-03T18:03:25.783578] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-03T18:03:26.219854] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:26.220893] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-03T18:03:26.226556] [INFO ] [REMOTE ] CL: Full fetch complete (77619 records). [2025-10-03T18:03:26.226724] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-03T18:03:26.399029] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-03T18:03:26.723303] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-03T18:03:26.723464] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-03T18:03:26.724389] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-03T18:03:26.724459] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-03T18:03:26.726425] [DEBUG] [LOCAL ] CL: Trimmed 77619 records to 54425 (keeping 200 days of data) [2025-10-03T18:03:27.095360] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:03:27.135730] [DEBUG] [LOCAL ] CL: Primary data saved (54425 records). [2025-10-03T18:03:27.135893] [INFO ] [MAIN ] CL: Full history saved. [2025-10-03T18:03:27.136016] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CL took 43.5s. Estimated remaining: 4h 22m 27s. Rate: 7.3 symbols/min [2025-10-03T18:03:27.199463] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-03T18:03:27.385862] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:27.416725] [DEBUG] [LOCAL ] CLH: Loaded 28009 existing records from primary storage. [2025-10-03T18:03:27.417077] [INFO ] [MAIN ] CLH: Loaded 28009 existing records. [2025-10-03T18:03:27.625866] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:27.626099] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-03T18:03:27.626149] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-03T18:03:27.626400] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-03T18:03:27.626459] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-03T18:03:27.997598] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-03T18:03:28.034888] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:28.181693] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:03:28.704595] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-03T18:03:28.790722] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-03T18:03:29.439225] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:03:29.590733] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-03T18:03:30.151941] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:03:30.390701] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-03T18:03:31.190737] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-03T18:03:31.284400] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T18:03:31.557798] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T18:03:31.990749] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-03T18:03:32.081777] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T18:03:32.790729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-03T18:03:33.590682] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-03T18:03:33.803835] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:03:34.123133] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-03T18:03:34.390744] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-03T18:03:34.737146] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T18:03:35.190716] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-03T18:03:35.536679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T18:03:35.990713] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-03T18:03:36.790634] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-03T18:03:37.115741] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:03:37.310672] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:03:37.356872] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T18:03:37.590729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-03T18:03:38.276065] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:03:38.277567] [INFO ] [REMOTE ] CLCO: Full fetch complete (22773 records). [2025-10-03T18:03:38.277723] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-03T18:03:38.398738] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-03T18:03:38.703724] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-03T18:03:38.703825] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-03T18:03:38.704295] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-03T18:03:38.704361] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-03T18:03:38.705184] [DEBUG] [LOCAL ] CLCO: Trimmed 22773 records to 13025 (keeping 200 days of data) [2025-10-03T18:03:38.783083] [DEBUG] [LOCAL ] CLCO: Primary data saved (13025 records). [2025-10-03T18:03:38.783243] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-03T18:03:38.783378] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 30.7s. Estimated remaining: 4h 22m 32s. Rate: 7.3 symbols/min [2025-10-03T18:03:38.965834] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:38.966050] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-03T18:03:38.966106] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-03T18:03:38.966267] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-03T18:03:38.966322] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-03T18:03:38.966391] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-03T18:03:38.966428] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-03T18:03:39.198459] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-03T18:03:39.350770] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:39.887034] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:03:39.990738] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-03T18:03:40.332901] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T18:03:40.790706] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-03T18:03:41.590731] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-03T18:03:41.874431] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:03:42.270298] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T18:03:42.390756] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-03T18:03:42.864600] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:03:43.190721] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-03T18:03:43.921169] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T18:03:43.990685] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-03T18:03:44.790729] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-03T18:03:45.013482] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:03:45.257004] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T18:03:45.590684] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-03T18:03:45.992349] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:03:46.390691] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-03T18:03:47.190740] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-03T18:03:47.350539] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T18:03:47.352273] [INFO ] [REMOTE ] CLDT: Full fetch complete (37115 records). [2025-10-03T18:03:47.352358] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-03T18:03:47.773135] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-03T18:03:47.773338] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-03T18:03:47.773885] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-03T18:03:47.773978] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-03T18:03:47.775329] [DEBUG] [LOCAL ] CLDT: Trimmed 37115 records to 25759 (keeping 200 days of data) [2025-10-03T18:03:47.856392] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-03T18:03:47.981233] [DEBUG] [LOCAL ] CLDT: Primary data saved (25759 records). [2025-10-03T18:03:47.981407] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-03T18:03:47.981510] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 32.6s. Estimated remaining: 4h 22m 28s. Rate: 7.3 symbols/min [2025-10-03T18:03:47.995842] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-03T18:03:48.183665] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:48.183879] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-03T18:03:48.183948] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-03T18:03:48.184066] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-03T18:03:48.184111] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-03T18:03:48.184155] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-03T18:03:48.184189] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-03T18:03:48.516964] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:03:48.601473] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:48.790717] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-03T18:03:48.838164] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:03:49.590711] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-03T18:03:50.390739] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-03T18:03:50.784633] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T18:03:50.909391] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:03:51.176983] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:03:51.190622] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-03T18:03:51.990698] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-03T18:03:52.124009] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:03:52.790684] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-03T18:03:53.157679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:03:53.590712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-03T18:03:54.390690] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-03T18:03:54.809369] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:03:54.910045] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:03:55.190665] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-03T18:03:55.990712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-03T18:03:56.790703] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-03T18:03:56.847681] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-03T18:03:57.189717] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:03:57.191938] [INFO ] [REMOTE ] CLH: Full fetch complete (41874 records). [2025-10-03T18:03:57.192021] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-03T18:03:57.591780] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-03T18:03:57.639630] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-03T18:03:57.664507] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-03T18:03:57.668159] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-03T18:03:57.668381] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-03T18:03:57.674263] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T18:03:57.672451] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-03T18:03:57.690157] [DEBUG] [LOCAL ] CLH: Trimmed 41874 records to 28188 (keeping 200 days of data) [2025-10-03T18:03:57.871497] [DEBUG] [LOCAL ] CLH: Primary data saved (28188 records). [2025-10-03T18:03:57.871637] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-03T18:03:57.871781] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLH took 30.7s. Estimated remaining: 4h 22m 26s. Rate: 7.3 symbols/min [2025-10-03T18:03:58.052697] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:58.104741] [DEBUG] [LOCAL ] CLVT: Loaded 52342 existing records from primary storage. [2025-10-03T18:03:58.105077] [INFO ] [MAIN ] CLVT: Loaded 52342 existing records. [2025-10-03T18:03:58.307205] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:58.307502] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-03T18:03:58.307567] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-03T18:03:58.307909] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-03T18:03:58.307986] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-03T18:03:58.395826] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-03T18:03:58.720273] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:59.190706] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-03T18:03:59.694775] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T18:03:59.990692] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-03T18:04:00.790705] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-03T18:04:01.077179] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-03T18:04:01.143456] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:04:01.563016] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:04:01.590683] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-03T18:04:02.093275] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T18:04:02.390683] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-03T18:04:03.190701] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-03T18:04:03.990749] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-03T18:04:04.039993] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T18:04:04.094946] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:04:04.094638] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-03T18:04:04.790689] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-03T18:04:05.590701] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-03T18:04:05.672492] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:04:05.699570] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:04:05.701953] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-10-03T18:04:05.702078] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-03T18:04:05.703114] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:04:05.703277] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:04:05.703359] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:04:05.703464] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-03T18:04:05.703535] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-03T18:04:05.703574] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-10-03T18:04:05.703909] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-10-03T18:04:05.704010] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLF took 40.4s. Estimated remaining: 4h 22m 16s. Rate: 7.3 symbols/min [2025-10-03T18:04:05.895182] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:05.918673] [DEBUG] [LOCAL ] CLW: Loaded 21887 existing records from primary storage. [2025-10-03T18:04:05.918981] [INFO ] [MAIN ] CLW: Loaded 21887 existing records. [2025-10-03T18:04:06.119567] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:06.119830] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-03T18:04:06.119885] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-03T18:04:06.120103] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-03T18:04:06.120167] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-03T18:04:06.396282] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-03T18:04:06.498000] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:07.190705] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-03T18:04:07.287387] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T18:04:07.844175] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-03T18:04:07.990754] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-03T18:04:08.790719] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-03T18:04:08.851237] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:04:09.537834] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T18:04:09.590691] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-03T18:04:10.390721] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-03T18:04:10.719356] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T18:04:10.899346] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T18:04:11.155883] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T18:04:11.190704] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-03T18:04:11.990683] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-03T18:04:12.362602] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:04:12.549917] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T18:04:12.550919] [INFO ] [REMOTE ] CLPR: Full fetch complete (17538 records). [2025-10-03T18:04:12.551024] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-03T18:04:12.791694] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-03T18:04:12.960875] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-03T18:04:12.960992] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-03T18:04:12.961536] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-03T18:04:12.961579] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-03T18:04:12.962232] [DEBUG] [LOCAL ] CLPR: Trimmed 17538 records to 11502 (keeping 200 days of data) [2025-10-03T18:04:13.043328] [DEBUG] [LOCAL ] CLPR: Primary data saved (11502 records). [2025-10-03T18:04:13.043560] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-03T18:04:13.043690] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 34.3s. Estimated remaining: 4h 22m 4s. Rate: 7.3 symbols/min [2025-10-03T18:04:13.215750] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:13.294924] [DEBUG] [LOCAL ] CLX: Loaded 51852 existing records from primary storage. [2025-10-03T18:04:13.295442] [INFO ] [MAIN ] CLX: Loaded 51852 existing records. [2025-10-03T18:04:13.479966] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:13.480293] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-03T18:04:13.480347] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-03T18:04:13.480725] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-03T18:04:13.480787] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-03T18:04:13.595862] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-03T18:04:13.856183] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:14.390706] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-03T18:04:14.735443] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:04:14.762174] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T18:04:15.190735] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-03T18:04:15.990768] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-03T18:04:16.677829] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T18:04:16.790637] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-03T18:04:16.962965] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:04:17.590723] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-03T18:04:17.815856] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:04:18.390719] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-03T18:04:19.190698] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-03T18:04:19.470150] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:04:19.557796] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-03T18:04:19.990727] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-03T18:04:20.022147] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:04:20.511288] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T18:04:20.790738] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-03T18:04:21.590724] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-03T18:04:22.390665] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-03T18:04:22.499987] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T18:04:22.546500] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T18:04:22.573636] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T18:04:23.190734] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-03T18:04:23.990704] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-03T18:04:24.134829] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T18:04:24.790735] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-03T18:04:25.287105] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T18:04:25.590737] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-03T18:04:25.788346] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T18:04:25.964627] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T18:04:25.967735] [INFO ] [REMOTE ] CLS: Full fetch complete (77457 records). [2025-10-03T18:04:25.967882] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-03T18:04:26.395952] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-03T18:04:26.399907] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-03T18:04:26.399985] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-03T18:04:26.401925] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-03T18:04:26.402091] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-03T18:04:26.403969] [DEBUG] [LOCAL ] CLS: Trimmed 77457 records to 54389 (keeping 200 days of data) [2025-10-03T18:04:26.759011] [DEBUG] [LOCAL ] CLS: Primary data saved (54389 records). [2025-10-03T18:04:26.759161] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-03T18:04:26.759252] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLS took 38.8s. Estimated remaining: 4h 22m 18s. Rate: 7.3 symbols/min [2025-10-03T18:04:26.941041] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:26.995357] [DEBUG] [LOCAL ] CM: Loaded 48929 existing records from primary storage. [2025-10-03T18:04:26.996035] [INFO ] [MAIN ] CM: Loaded 48929 existing records. [2025-10-03T18:04:27.197251] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:27.193542] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-03T18:04:27.197708] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-03T18:04:27.198925] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-03T18:04:27.199277] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-03T18:04:27.199459] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-03T18:04:27.409799] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:04:27.637914] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:27.990696] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-03T18:04:28.229621] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:04:28.352360] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T18:04:28.790714] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-03T18:04:29.590697] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-03T18:04:29.752377] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:04:29.866124] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:04:30.390712] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-03T18:04:31.190639] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-03T18:04:31.252504] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:04:31.863583] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:04:31.990701] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-03T18:04:32.419012] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:04:32.790717] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-03T18:04:33.457546] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T18:04:33.460388] [INFO ] [REMOTE ] CLVT: Full fetch complete (75240 records). [2025-10-03T18:04:33.460795] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-03T18:04:33.595777] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-03T18:04:33.901302] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-03T18:04:33.901396] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-03T18:04:33.902325] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-03T18:04:33.902408] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-03T18:04:33.904075] [DEBUG] [LOCAL ] CLVT: Trimmed 75240 records to 52720 (keeping 200 days of data) [2025-10-03T18:04:34.216021] [DEBUG] [LOCAL ] CLVT: Primary data saved (52720 records). [2025-10-03T18:04:34.216187] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-03T18:04:34.216298] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLVT took 36.3s. Estimated remaining: 4h 22m 7s. Rate: 7.3 symbols/min [2025-10-03T18:04:34.403043] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-03T18:04:34.432076] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:34.433422] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-03T18:04:34.433538] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-03T18:04:34.433688] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-03T18:04:34.433745] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-03T18:04:34.433792] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-03T18:04:34.433857] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-03T18:04:34.545710] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:04:34.580129] [INFO ] [REMOTE ] CLW: Full fetch complete (34750 records). [2025-10-03T18:04:34.613318] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-03T18:04:34.663085] [FATAL] [VALIDATOR ] CLW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:04:34.700013] [FATAL] [MAIN ] CLW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:04:34.713587] [WARN ] [MAIN ] CLW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:04:34.737235] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-03T18:04:34.756002] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-03T18:04:34.764970] [INFO ] [LOCAL ] CLW: Starting deletion of derivative data. [2025-10-03T18:04:34.778923] [DEBUG] [LOCAL ] CLW: Deleted derivative data file. [2025-10-03T18:04:34.784460] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLW took 29.1s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-03T18:04:34.922183] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:35.067157] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-03T18:04:35.108883] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:35.135432] [DEBUG] [LOCAL ] CMBT: Loaded 23828 existing records from primary storage. [2025-10-03T18:04:35.135806] [INFO ] [MAIN ] CMBT: Loaded 23828 existing records. [2025-10-03T18:04:35.195869] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-03T18:04:35.363105] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:35.363332] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-03T18:04:35.363381] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-03T18:04:35.363755] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-03T18:04:35.363834] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-03T18:04:35.778444] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:35.990747] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-03T18:04:36.123857] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:04:36.790621] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-03T18:04:37.054781] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T18:04:37.590685] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-03T18:04:37.632484] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:04:38.351840] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:04:38.390729] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-03T18:04:39.190727] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-03T18:04:39.309069] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:04:39.990735] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-03T18:04:40.379901] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:04:40.790697] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-03T18:04:40.900289] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:04:41.035012] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T18:04:41.590719] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-03T18:04:42.390693] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-03T18:04:42.599787] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:04:43.036168] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T18:04:43.190697] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-03T18:04:43.281315] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:04:43.990721] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-03T18:04:44.790665] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-03T18:04:44.886726] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:04:45.121819] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:04:45.590735] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-03T18:04:46.230980] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:04:46.390709] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-03T18:04:46.712082] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T18:04:47.190700] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-03T18:04:47.990667] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-03T18:04:48.123045] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:04:48.284590] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T18:04:48.790719] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-03T18:04:49.590706] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-03T18:04:49.660857] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:04:50.390629] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-03T18:04:50.537195] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T18:04:50.540077] [INFO ] [REMOTE ] CLX: Full fetch complete (73123 records). [2025-10-03T18:04:50.540202] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-03T18:04:50.841442] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T18:04:51.128722] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-03T18:04:51.128900] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-03T18:04:51.130354] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-03T18:04:51.130458] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-03T18:04:51.132958] [DEBUG] [LOCAL ] CLX: Trimmed 73123 records to 52222 (keeping 200 days of data) [2025-10-03T18:04:51.228031] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-03T18:04:51.630574] [DEBUG] [LOCAL ] CLX: Primary data saved (52222 records). [2025-10-03T18:04:51.630983] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-03T18:04:51.634118] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLX took 38.6s. Estimated remaining: 4h 21m 54s. Rate: 7.3 symbols/min [2025-10-03T18:04:51.867558] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:51.941373] [DEBUG] [LOCAL ] CMC: Loaded 45898 existing records from primary storage. [2025-10-03T18:04:51.942048] [INFO ] [MAIN ] CMC: Loaded 45898 existing records. [2025-10-03T18:04:51.994168] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-03T18:04:52.207160] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:52.207528] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-03T18:04:52.207773] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-03T18:04:52.223445] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-03T18:04:52.237538] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:04:52.236107] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-03T18:04:52.452427] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:04:52.664393] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:52.790688] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-03T18:04:53.519714] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:04:53.590683] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-03T18:04:54.390730] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-03T18:04:54.641718] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:04:54.998624] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T18:04:55.190694] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-03T18:04:55.826774] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:04:55.990680] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-03T18:04:56.790694] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-03T18:04:56.948426] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T18:04:57.575846] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:04:57.590675] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-03T18:04:58.390722] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-03T18:04:58.686699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T18:04:59.190750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-03T18:04:59.366154] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T18:04:59.990743] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-03T18:05:00.057766] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:05:00.755414] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:05:00.790634] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-03T18:05:01.590619] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-03T18:05:01.665347] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:05:02.077463] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T18:05:02.080218] [INFO ] [REMOTE ] CM: Full fetch complete (69457 records). [2025-10-03T18:05:02.080376] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-03T18:05:02.395845] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-03T18:05:02.525074] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-03T18:05:02.525170] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-03T18:05:02.525999] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-03T18:05:02.526098] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-03T18:05:02.527598] [DEBUG] [LOCAL ] CM: Trimmed 69457 records to 49298 (keeping 200 days of data) [2025-10-03T18:05:02.853269] [DEBUG] [LOCAL ] CM: Primary data saved (49298 records). [2025-10-03T18:05:02.853445] [INFO ] [MAIN ] CM: Full history saved. [2025-10-03T18:05:02.857401] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CM took 36.1s. Estimated remaining: 4h 21m 57s. Rate: 7.2 symbols/min [2025-10-03T18:05:03.063529] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:03.073108] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-10-03T18:05:03.073344] [INFO ] [MAIN ] CMCM: Loaded 4758 existing records. [2025-10-03T18:05:03.191081] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-03T18:05:03.279199] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:03.279509] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-03T18:05:03.279707] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-03T18:05:03.280008] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-03T18:05:03.280127] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-03T18:05:03.548924] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T18:05:03.699697] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:03.978822] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:05:03.990744] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-03T18:05:04.790624] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-03T18:05:05.072371] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T18:05:05.075430] [INFO ] [REMOTE ] CMBT: Full fetch complete (30776 records). [2025-10-03T18:05:05.075555] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-03T18:05:05.492991] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-03T18:05:05.493171] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-03T18:05:05.493721] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-03T18:05:05.493900] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-03T18:05:05.495465] [DEBUG] [LOCAL ] CMBT: Trimmed 30776 records to 24208 (keeping 200 days of data) [2025-10-03T18:05:05.597155] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-03T18:05:05.680694] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:05:05.720718] [DEBUG] [LOCAL ] CMBT: Primary data saved (24208 records). [2025-10-03T18:05:05.721036] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-03T18:05:05.721228] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMBT took 30.9s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-03T18:05:05.801047] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:05:05.926304] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:05.926541] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-03T18:05:05.926587] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-03T18:05:05.926752] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-03T18:05:05.926809] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-03T18:05:05.926910] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-03T18:05:05.926971] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-03T18:05:06.322703] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:06.390738] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-03T18:05:06.598739] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:05:06.599141] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-03T18:05:06.599226] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:05:06.599281] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-03T18:05:06.599349] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:05:06.599423] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-03T18:05:06.599492] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-03T18:05:06.599531] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-03T18:05:06.599591] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-03T18:05:06.599705] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMDB took 0.9s. Estimated remaining: 4h 20m 49s. Rate: 7.3 symbols/min [2025-10-03T18:05:06.781198] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:06.843920] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-03T18:05:06.844307] [INFO ] [MAIN ] CMG: Loaded 54111 existing records. [2025-10-03T18:05:07.035793] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:07.036012] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-03T18:05:07.036062] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-03T18:05:07.036338] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-03T18:05:07.036399] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-03T18:05:07.201124] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-03T18:05:07.432407] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:07.466639] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:05:07.990780] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-03T18:05:08.738241] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T18:05:08.790703] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-03T18:05:09.305059] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T18:05:09.590678] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-03T18:05:09.806467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:05:10.390700] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-03T18:05:11.093613] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:05:11.190697] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-03T18:05:11.907591] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:05:11.910135] [INFO ] [REMOTE ] CMA: Full fetch complete (73090 records). [2025-10-03T18:05:11.910269] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-03T18:05:11.995795] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-03T18:05:12.342975] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-03T18:05:12.343085] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-03T18:05:12.343959] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-03T18:05:12.344029] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-03T18:05:12.345571] [DEBUG] [LOCAL ] CMA: Trimmed 73090 records to 50603 (keeping 200 days of data) [2025-10-03T18:05:12.682146] [DEBUG] [LOCAL ] CMA: Primary data saved (50603 records). [2025-10-03T18:05:12.687838] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-03T18:05:12.689096] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CMA took 38.5s. Estimated remaining: 4h 20m 33s. Rate: 7.3 symbols/min [2025-10-03T18:05:12.688830] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T18:05:12.795777] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-03T18:05:12.891992] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:12.935915] [DEBUG] [LOCAL ] CMI: Loaded 42060 existing records from primary storage. [2025-10-03T18:05:12.936283] [INFO ] [MAIN ] CMI: Loaded 42060 existing records. [2025-10-03T18:05:13.142046] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:13.167433] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-03T18:05:13.170343] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-03T18:05:13.171104] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-03T18:05:13.172405] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-03T18:05:13.172316] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-03T18:05:13.584778] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:13.590700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-03T18:05:14.390721] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-03T18:05:15.076970] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:05:15.190325] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:05:15.201223] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-03T18:05:15.990668] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-03T18:05:16.107335] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:05:16.140367] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T18:05:16.790723] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-03T18:05:17.590782] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-03T18:05:17.810080] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:05:18.367065] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:05:18.390718] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-03T18:05:19.190723] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-03T18:05:19.710616] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:05:19.814205] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:05:19.853428] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:05:19.990734] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-03T18:05:20.790737] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-03T18:05:21.590713] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-03T18:05:21.741604] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:05:22.106620] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T18:05:22.390708] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-03T18:05:22.854197] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T18:05:22.940896] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T18:05:23.190725] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-03T18:05:23.990722] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-03T18:05:24.769705] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:05:24.790638] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-03T18:05:25.590775] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-03T18:05:26.081466] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T18:05:26.177474] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:05:26.180260] [INFO ] [REMOTE ] CMC: Full fetch complete (66943 records). [2025-10-03T18:05:26.180390] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-03T18:05:26.391838] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-03T18:05:26.511805] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:05:26.652938] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-03T18:05:26.653033] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-03T18:05:26.653920] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-03T18:05:26.653997] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-03T18:05:26.655628] [DEBUG] [LOCAL ] CMC: Trimmed 66943 records to 46192 (keeping 200 days of data) [2025-10-03T18:05:26.958317] [DEBUG] [LOCAL ] CMC: Primary data saved (46192 records). [2025-10-03T18:05:26.958490] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-03T18:05:26.961023] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMC took 35.3s. Estimated remaining: 4h 20m 48s. Rate: 7.3 symbols/min [2025-10-03T18:05:27.182777] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:27.190729] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-03T18:05:27.223797] [DEBUG] [LOCAL ] CMP: Loaded 36460 existing records from primary storage. [2025-10-03T18:05:27.224125] [INFO ] [MAIN ] CMP: Loaded 36460 existing records. [2025-10-03T18:05:27.454749] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:27.454985] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-03T18:05:27.455061] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-03T18:05:27.455318] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-03T18:05:27.455406] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-03T18:05:27.916572] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:27.990746] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-03T18:05:28.615912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:05:28.619094] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-03T18:05:28.790718] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-03T18:05:29.166778] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:05:29.590714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-03T18:05:30.390674] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-03T18:05:30.893870] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T18:05:31.190693] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-03T18:05:31.228970] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:05:31.990672] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-03T18:05:32.078135] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T18:05:32.790684] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-03T18:05:33.130241] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T18:05:33.307429] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:05:33.399570] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:05:33.590736] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-03T18:05:34.390744] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-03T18:05:35.190741] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-03T18:05:35.930959] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:05:35.935003] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T18:05:35.935155] [INFO ] [REMOTE ] CMCM: Full fetch complete (6969 records). [2025-10-03T18:05:35.949178] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-03T18:05:36.007936] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-03T18:05:36.085904] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:05:36.416249] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-03T18:05:36.416670] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-03T18:05:36.416926] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-03T18:05:36.416987] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-03T18:05:36.417427] [DEBUG] [LOCAL ] CMCM: Trimmed 6969 records to 4794 (keeping 200 days of data) [2025-10-03T18:05:36.449782] [DEBUG] [LOCAL ] CMCM: Primary data saved (4794 records). [2025-10-03T18:05:36.449928] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-03T18:05:36.450043] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMCM took 33.6s. Estimated remaining: 4h 20m 45s. Rate: 7.3 symbols/min [2025-10-03T18:05:36.638490] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:36.698760] [DEBUG] [LOCAL ] CMPO: Loaded 39512 existing records from primary storage. [2025-10-03T18:05:36.699102] [INFO ] [MAIN ] CMPO: Loaded 39512 existing records. [2025-10-03T18:05:36.796705] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-03T18:05:36.899881] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:36.900215] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-03T18:05:36.900306] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-03T18:05:36.900886] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-03T18:05:36.900946] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-03T18:05:37.288337] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:37.590744] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-03T18:05:38.390735] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-03T18:05:38.448440] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:05:38.539340] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-03T18:05:39.190693] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-03T18:05:39.348143] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:05:39.840618] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:05:39.990705] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-03T18:05:40.553592] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:05:40.790716] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-03T18:05:41.438202] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:05:41.590702] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-03T18:05:42.390694] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-03T18:05:43.024701] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:05:43.027994] [INFO ] [REMOTE ] CMI: Full fetch complete (60093 records). [2025-10-03T18:05:43.028134] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-03T18:05:43.192689] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-03T18:05:43.324923] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T18:05:43.611741] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-03T18:05:43.611846] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-03T18:05:43.612735] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-03T18:05:43.612827] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-03T18:05:43.616957] [DEBUG] [LOCAL ] CMI: Trimmed 60093 records to 42360 (keeping 200 days of data) [2025-10-03T18:05:43.938897] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:05:43.991082] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-03T18:05:44.031914] [DEBUG] [LOCAL ] CMI: Primary data saved (42360 records). [2025-10-03T18:05:44.032078] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-03T18:05:44.032188] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMI took 31.3s. Estimated remaining: 4h 20m 34s. Rate: 7.3 symbols/min [2025-10-03T18:05:44.732702] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:05:44.790737] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-03T18:05:45.439874] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:05:45.590696] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-03T18:05:46.290400] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:05:46.390702] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-03T18:05:47.190703] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-03T18:05:47.856821] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T18:05:47.859833] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-03T18:05:47.860034] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-03T18:05:48.323015] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:05:48.369987] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-03T18:05:48.370632] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-03T18:05:48.372295] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-03T18:05:48.372476] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-03T18:05:48.371118] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-03T18:05:48.375439] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54501 (keeping 200 days of data) [2025-10-03T18:05:48.717828] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-10-03T18:05:48.718064] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-03T18:05:48.718214] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMG took 42.1s. Estimated remaining: 4h 20m 12s. Rate: 7.3 symbols/min [2025-10-03T18:05:49.023850] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:05:49.033862] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-03T18:05:49.889764] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:05:49.899073] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-03T18:05:50.614314] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:05:50.625260] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-03T18:05:51.482708] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:05:51.492818] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-03T18:05:52.107411] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:05:52.120861] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-03T18:05:52.781594] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:05:52.790620] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-03T18:05:53.567808] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T18:05:53.590621] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-03T18:05:54.078595] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:05:54.390690] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-03T18:05:54.683930] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T18:05:55.190701] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-03T18:05:55.734880] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T18:05:55.736773] [INFO ] [REMOTE ] CMP: Full fetch complete (52404 records). [2025-10-03T18:05:55.736904] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-03T18:05:56.162343] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-03T18:05:56.162431] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-03T18:05:56.163186] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-03T18:05:56.163253] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-03T18:05:56.164440] [DEBUG] [LOCAL ] CMP: Trimmed 52404 records to 36601 (keeping 200 days of data) [2025-10-03T18:05:56.385577] [DEBUG] [LOCAL ] CMP: Primary data saved (36601 records). [2025-10-03T18:05:56.385755] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-03T18:05:56.386198] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMP took 29.4s. Estimated remaining: 4h 20m 1s. Rate: 7.3 symbols/min [2025-10-03T18:05:56.698976] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:05:56.708810] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-03T18:05:58.205197] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T18:05:58.214374] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-03T18:05:59.327033] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:05:59.333314] [INFO ] [REMOTE ] CMPO: Full fetch complete (58891 records). [2025-10-03T18:05:59.333456] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-03T18:05:59.752610] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-03T18:05:59.752735] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-03T18:05:59.753461] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-03T18:05:59.753528] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-03T18:05:59.755026] [DEBUG] [LOCAL ] CMPO: Trimmed 58891 records to 39703 (keeping 200 days of data) [2025-10-03T18:05:59.995755] [DEBUG] [LOCAL ] CMPO: Primary data saved (39703 records). [2025-10-03T18:05:59.995915] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-03T18:05:59.996004] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMPO took 23.5s. Estimated remaining: 4h 19m 35s. Rate: 7.3 symbols/min [2025-10-03T18:06:00.723834] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.819708] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.790636] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.856599] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.865798] [DEBUG] [LOCAL ] CMSC: Loaded 5108 existing records from primary storage. [2025-10-03T18:06:00.866301] [INFO ] [MAIN ] CMSC: Loaded 5108 existing records. [2025-10-03T18:06:00.907518] [DEBUG] [LOCAL ] CMSA: Loaded 3530 existing records from primary storage. [2025-10-03T18:06:00.963587] [INFO ] [MAIN ] CMSA: Loaded 3530 existing records. [2025-10-03T18:06:01.062385] [DEBUG] [LOCAL ] CMRE: Loaded 35698 existing records from primary storage. [2025-10-03T18:06:01.140096] [INFO ] [MAIN ] CMRE: Loaded 35698 existing records. [2025-10-03T18:06:01.305125] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:01.349318] [DEBUG] [LOCAL ] CMS: Loaded 52995 existing records from primary storage. [2025-10-03T18:06:01.427376] [INFO ] [MAIN ] CMS: Loaded 52995 existing records. [2025-10-03T18:06:01.427185] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-03T18:06:01.464760] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-03T18:06:01.527556] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:01.553040] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-03T18:06:01.563886] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-03T18:06:01.569062] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-03T18:06:01.633988] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-03T18:06:01.639511] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-03T18:06:01.634215] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-03T18:06:01.952922] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:02.053508] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-03T18:06:02.053221] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:02.062103] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-03T18:06:02.067904] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-03T18:06:02.076749] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-03T18:06:02.080837] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-03T18:06:02.102187] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-03T18:06:02.091432] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-03T18:06:02.158263] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-03T18:06:03.077121] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.162701] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-03T18:06:03.242205] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.314925] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-03T18:06:03.440282] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.452518] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-03T18:06:03.530195] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.530904] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-03T18:06:04.110224] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:06:04.112202] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-03T18:06:04.185950] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T18:06:04.188244] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-03T18:06:04.741551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:06:04.744567] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-03T18:06:04.842291] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T18:06:04.848282] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-03T18:06:04.901708] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:06:04.903617] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-03T18:06:05.289510] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T18:06:05.291018] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-03T18:06:05.338561] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:06:05.567415] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:06:05.590737] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-03T18:06:05.628796] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T18:06:05.750127] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T18:06:06.390709] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-03T18:06:07.008309] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T18:06:07.190698] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-03T18:06:07.376135] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:06:07.827229] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:06:07.990729] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-03T18:06:08.542549] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:06:08.790728] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-03T18:06:09.373081] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:06:09.590727] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-03T18:06:10.390703] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-03T18:06:10.440438] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T18:06:11.190711] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-03T18:06:11.767613] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T18:06:11.767401] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:06:11.990734] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-03T18:06:12.611772] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T18:06:12.790720] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-03T18:06:13.590700] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-03T18:06:14.232512] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T18:06:14.390683] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-03T18:06:14.436695] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:06:15.190708] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-03T18:06:15.957189] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T18:06:15.990718] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-03T18:06:16.790710] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-03T18:06:17.001011] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:06:17.357269] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:06:17.358066] [INFO ] [REMOTE ] CMSA: Full fetch complete (5107 records). [2025-10-03T18:06:17.358137] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-03T18:06:17.597241] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-03T18:06:17.721576] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:06:17.803968] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-03T18:06:17.804056] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-03T18:06:17.804219] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-03T18:06:17.804261] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-03T18:06:17.804861] [DEBUG] [LOCAL ] CMSA: Trimmed 5107 records to 3544 (keeping 200 days of data) [2025-10-03T18:06:17.827322] [DEBUG] [LOCAL ] CMSA: Primary data saved (3544 records). [2025-10-03T18:06:17.827467] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-03T18:06:17.827556] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 17.8s. Estimated remaining: 4h 20m 4s. Rate: 7.3 symbols/min [2025-10-03T18:06:18.024438] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:18.037221] [DEBUG] [LOCAL ] CMSD: Loaded 8137 existing records from primary storage. [2025-10-03T18:06:18.037469] [INFO ] [MAIN ] CMSD: Loaded 8137 existing records. [2025-10-03T18:06:18.241681] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:18.242108] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-03T18:06:18.242282] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-03T18:06:18.242609] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-03T18:06:18.242722] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-03T18:06:18.380990] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T18:06:18.397292] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-03T18:06:18.659106] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:19.190719] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-03T18:06:19.990635] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-03T18:06:20.202684] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:06:20.315340] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:06:20.790747] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-03T18:06:21.381721] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:06:21.435067] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:06:21.590707] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-03T18:06:22.193598] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:06:22.390713] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-03T18:06:22.819933] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T18:06:23.190723] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-03T18:06:23.990709] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-03T18:06:24.557851] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T18:06:24.790689] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-03T18:06:25.060448] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T18:06:25.590694] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-03T18:06:25.659989] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T18:06:26.171873] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:06:26.172885] [INFO ] [REMOTE ] CMSC: Full fetch complete (7187 records). [2025-10-03T18:06:26.172960] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-03T18:06:26.395853] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-03T18:06:26.587260] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-03T18:06:26.587349] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-03T18:06:26.587568] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-03T18:06:26.587630] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-03T18:06:26.588117] [DEBUG] [LOCAL ] CMSC: Trimmed 7187 records to 5138 (keeping 200 days of data) [2025-10-03T18:06:26.621014] [DEBUG] [LOCAL ] CMSC: Primary data saved (5138 records). [2025-10-03T18:06:26.621162] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-03T18:06:26.621288] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMSC took 26.6s. Estimated remaining: 4h 19m 58s. Rate: 7.3 symbols/min [2025-10-03T18:06:26.805098] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:26.842401] [DEBUG] [LOCAL ] CMTG: Loaded 37088 existing records from primary storage. [2025-10-03T18:06:26.842747] [INFO ] [MAIN ] CMTG: Loaded 37088 existing records. [2025-10-03T18:06:27.063511] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:27.064014] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-03T18:06:27.064077] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-03T18:06:27.064309] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-03T18:06:27.064380] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-03T18:06:27.195821] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-03T18:06:27.458538] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:27.990736] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-03T18:06:28.265082] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:06:28.714377] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:06:28.790781] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-03T18:06:29.118696] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:06:29.590698] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-03T18:06:30.244727] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T18:06:30.390714] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-03T18:06:30.981572] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:06:31.190745] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-03T18:06:31.800861] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:06:31.990715] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-03T18:06:32.790756] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-03T18:06:32.962620] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:06:33.377411] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:06:33.381170] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:06:33.590729] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-03T18:06:34.390727] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-03T18:06:35.031391] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:06:35.190727] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-03T18:06:35.990780] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-03T18:06:36.127303] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:06:36.384279] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:06:36.387257] [INFO ] [REMOTE ] CMRE: Full fetch complete (50086 records). [2025-10-03T18:06:36.387561] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-03T18:06:36.800748] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-03T18:06:37.012308] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-03T18:06:37.012445] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-03T18:06:37.013575] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-03T18:06:37.013773] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-03T18:06:37.015603] [DEBUG] [LOCAL ] CMRE: Trimmed 50086 records to 35928 (keeping 200 days of data) [2025-10-03T18:06:37.246347] [DEBUG] [LOCAL ] CMRE: Primary data saved (35928 records). [2025-10-03T18:06:37.246737] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-03T18:06:37.246869] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMRE took 37.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-03T18:06:37.452478] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:37.461761] [DEBUG] [LOCAL ] CMU: Loaded 6891 existing records from primary storage. [2025-10-03T18:06:37.462020] [INFO ] [MAIN ] CMU: Loaded 6891 existing records. [2025-10-03T18:06:37.595073] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-03T18:06:37.702300] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T18:06:37.706629] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:37.727103] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-03T18:06:37.727311] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-03T18:06:37.727637] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-03T18:06:37.727979] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-03T18:06:37.766338] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T18:06:38.125070] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:38.390728] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-03T18:06:39.147592] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:06:39.190639] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-03T18:06:39.452956] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T18:06:39.961717] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:06:39.990614] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-03T18:06:40.695352] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T18:06:40.790711] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-03T18:06:41.590690] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-03T18:06:42.390672] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-03T18:06:42.514298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:06:42.552092] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:06:43.190696] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-03T18:06:43.990635] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-03T18:06:43.992263] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:06:43.995116] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-10-03T18:06:43.995219] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-03T18:06:44.434423] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-03T18:06:44.434563] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-03T18:06:44.435599] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-03T18:06:44.435693] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-03T18:06:44.437218] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 53374 (keeping 200 days of data) [2025-10-03T18:06:44.716240] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T18:06:44.712505] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:06:44.805823] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-03T18:06:44.832674] [DEBUG] [LOCAL ] CMS: Primary data saved (53374 records). [2025-10-03T18:06:44.832817] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-03T18:06:44.832937] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 44.8s. Estimated remaining: 4h 19m 48s. Rate: 7.3 symbols/min [2025-10-03T18:06:45.010317] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:45.042942] [DEBUG] [LOCAL ] CNA: Loaded 33010 existing records from primary storage. [2025-10-03T18:06:45.043257] [INFO ] [MAIN ] CNA: Loaded 33010 existing records. [2025-10-03T18:06:45.233388] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:45.233609] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-03T18:06:45.233687] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-03T18:06:45.233958] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-03T18:06:45.234019] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-03T18:06:45.554201] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:06:45.597579] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-03T18:06:45.643769] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:46.208415] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T18:06:46.390705] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-03T18:06:47.190708] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-03T18:06:47.636475] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T18:06:47.836939] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:06:47.990678] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-03T18:06:48.690758] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T18:06:48.790711] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-03T18:06:49.590752] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-03T18:06:50.165343] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:06:50.349903] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:06:50.390698] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-03T18:06:51.190711] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-03T18:06:51.990683] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-03T18:06:52.034910] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T18:06:52.082461] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:06:52.790689] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-03T18:06:53.237214] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:06:53.590688] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-03T18:06:54.213754] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T18:06:54.217509] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:06:54.390738] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-03T18:06:54.968110] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:06:55.190747] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-03T18:06:55.961457] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:06:55.962437] [INFO ] [REMOTE ] CMSD: Full fetch complete (12342 records). [2025-10-03T18:06:55.962512] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-03T18:06:55.995809] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-03T18:06:56.364385] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-03T18:06:56.364506] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-03T18:06:56.364876] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-03T18:06:56.364959] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-03T18:06:56.365804] [DEBUG] [LOCAL ] CMSD: Trimmed 12342 records to 8171 (keeping 200 days of data) [2025-10-03T18:06:56.419375] [DEBUG] [LOCAL ] CMSD: Primary data saved (8171 records). [2025-10-03T18:06:56.419604] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-03T18:06:56.419790] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 38.6s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-03T18:06:56.610631] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:56.682536] [DEBUG] [LOCAL ] CNC: Loaded 54129 existing records from primary storage. [2025-10-03T18:06:56.682935] [INFO ] [MAIN ] CNC: Loaded 54129 existing records. [2025-10-03T18:06:56.791048] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-03T18:06:56.876384] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:56.876591] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-03T18:06:56.876663] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-03T18:06:56.876988] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-03T18:06:56.877050] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-03T18:06:57.259288] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T18:06:57.299059] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:57.590743] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-03T18:06:58.096490] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T18:06:58.390688] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-03T18:06:59.190691] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-03T18:06:59.256073] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:06:59.724212] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:06:59.990694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-03T18:07:00.331544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:07:00.333356] [INFO ] [REMOTE ] CMTG: Full fetch complete (53626 records). [2025-10-03T18:07:00.333474] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-03T18:07:00.752021] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-03T18:07:00.752138] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-03T18:07:00.752807] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-03T18:07:00.752875] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-03T18:07:00.754636] [DEBUG] [LOCAL ] CMTG: Trimmed 53626 records to 37256 (keeping 200 days of data) [2025-10-03T18:07:00.806680] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-03T18:07:00.977164] [DEBUG] [LOCAL ] CMTG: Primary data saved (37256 records). [2025-10-03T18:07:00.977328] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-03T18:07:00.977423] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMTG took 34.4s. Estimated remaining: 4h 19m 30s. Rate: 7.3 symbols/min [2025-10-03T18:07:01.163568] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:01.163768] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-03T18:07:01.163814] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-03T18:07:01.163933] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-03T18:07:01.163977] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-03T18:07:01.164023] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-03T18:07:01.164060] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-03T18:07:01.586535] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:01.600249] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-03T18:07:01.616829] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:07:01.872249] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:07:02.390714] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-03T18:07:02.398175] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:07:03.190688] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-03T18:07:03.765743] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T18:07:03.990628] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-03T18:07:04.091823] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:07:04.292046] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-03T18:07:04.790689] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-03T18:07:05.590727] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-03T18:07:06.138700] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:07:06.332966] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T18:07:06.390724] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-03T18:07:07.190735] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-03T18:07:07.856767] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:07:07.990669] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-03T18:07:08.112105] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:07:08.790705] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-03T18:07:09.292038] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T18:07:09.292912] [INFO ] [REMOTE ] CMU: Full fetch complete (9680 records). [2025-10-03T18:07:09.292984] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-03T18:07:09.513954] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:07:09.596357] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-03T18:07:09.741122] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-03T18:07:09.741203] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-03T18:07:09.741470] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-03T18:07:09.741512] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-03T18:07:09.742433] [DEBUG] [LOCAL ] CMU: Trimmed 9680 records to 6911 (keeping 200 days of data) [2025-10-03T18:07:09.787788] [DEBUG] [LOCAL ] CMU: Primary data saved (6911 records). [2025-10-03T18:07:09.787938] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-03T18:07:09.788056] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMU took 32.5s. Estimated remaining: 4h 19m 24s. Rate: 7.3 symbols/min [2025-10-03T18:07:09.996504] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:10.063011] [DEBUG] [LOCAL ] CNH: Loaded 53944 existing records from primary storage. [2025-10-03T18:07:10.063443] [INFO ] [MAIN ] CNH: Loaded 53944 existing records. [2025-10-03T18:07:10.269260] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:10.269519] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-03T18:07:10.269579] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-03T18:07:10.269853] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-03T18:07:10.269915] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-03T18:07:10.395979] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-03T18:07:10.651820] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:11.190730] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-03T18:07:11.284774] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T18:07:11.743975] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T18:07:11.990720] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-03T18:07:12.790726] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-03T18:07:13.106190] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:07:13.590697] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-03T18:07:13.940188] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:07:14.328184] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:07:14.390675] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-03T18:07:15.190686] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-03T18:07:15.310609] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:07:15.599431] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:07:15.990635] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-03T18:07:15.996900] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T18:07:16.790716] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-03T18:07:17.590619] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-03T18:07:17.842879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:07:18.052498] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:07:18.069928] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T18:07:18.390714] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-03T18:07:19.190685] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-03T18:07:19.990679] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-03T18:07:20.140546] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T18:07:20.265794] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:07:20.790699] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-03T18:07:21.590691] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-03T18:07:21.690027] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:07:22.372622] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T18:07:22.390660] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-03T18:07:22.627238] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:07:23.190702] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-03T18:07:23.255162] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:07:23.258847] [INFO ] [REMOTE ] CNA: Full fetch complete (45615 records). [2025-10-03T18:07:23.258973] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-03T18:07:23.717479] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-03T18:07:23.717592] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-03T18:07:23.718364] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-03T18:07:23.718479] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-03T18:07:23.719993] [DEBUG] [LOCAL ] CNA: Trimmed 45615 records to 33259 (keeping 200 days of data) [2025-10-03T18:07:23.941254] [DEBUG] [LOCAL ] CNA: Primary data saved (33259 records). [2025-10-03T18:07:23.941411] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-03T18:07:23.941561] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNA took 39.1s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-03T18:07:23.995755] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-03T18:07:24.135679] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:24.145438] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-03T18:07:24.146528] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:07:24.146585] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-03T18:07:24.150471] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-03T18:07:24.150864] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-03T18:07:24.151245] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-03T18:07:24.151295] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-03T18:07:24.547477] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:24.790717] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-03T18:07:25.590767] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-03T18:07:25.738606] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T18:07:26.021046] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:07:26.390725] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-03T18:07:27.190623] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-03T18:07:27.245802] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:07:27.246717] [INFO ] [REMOTE ] CNF: Full fetch complete (12963 records). [2025-10-03T18:07:27.246792] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-03T18:07:27.247322] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:07:27.247419] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:07:27.247464] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:07:27.247529] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-03T18:07:27.247618] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-03T18:07:27.247711] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-03T18:07:27.247785] [DEBUG] [LOCAL ] CNF: No derivative data file found to delete. [2025-10-03T18:07:27.247863] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNF took 26.3s. Estimated remaining: 4h 19m 11s. Rate: 7.3 symbols/min [2025-10-03T18:07:27.496977] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:27.500633] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T18:07:27.562624] [DEBUG] [LOCAL ] CNK: Loaded 53264 existing records from primary storage. [2025-10-03T18:07:27.562981] [INFO ] [MAIN ] CNK: Loaded 53264 existing records. [2025-10-03T18:07:27.759633] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:27.759916] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-03T18:07:27.759988] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-03T18:07:27.760253] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-03T18:07:27.760313] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-03T18:07:27.999368] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-03T18:07:28.154749] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:28.790749] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-03T18:07:28.873370] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:07:29.590727] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-03T18:07:30.048499] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T18:07:30.390722] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-03T18:07:31.190748] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-03T18:07:31.456786] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-03T18:07:31.512072] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:07:31.990707] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-03T18:07:32.122005] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:07:32.790636] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-03T18:07:32.903967] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:07:33.590679] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-03T18:07:33.632340] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T18:07:34.390706] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-03T18:07:35.038428] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-03T18:07:35.190707] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-03T18:07:35.250404] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:07:35.990742] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-03T18:07:36.416979] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:07:36.790705] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-03T18:07:37.387321] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-03T18:07:37.590690] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-03T18:07:37.774633] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:07:38.380988] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:07:38.383952] [INFO ] [REMOTE ] CNH: Full fetch complete (77536 records). [2025-10-03T18:07:38.384081] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-03T18:07:38.397967] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-03T18:07:38.866748] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-03T18:07:38.866910] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-03T18:07:38.868156] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-03T18:07:38.868236] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-03T18:07:38.869960] [DEBUG] [LOCAL ] CNH: Trimmed 77536 records to 54333 (keeping 200 days of data) [2025-10-03T18:07:39.199352] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-03T18:07:39.229868] [DEBUG] [LOCAL ] CNH: Primary data saved (54333 records). [2025-10-03T18:07:39.230036] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-03T18:07:39.230125] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNH took 29.4s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-03T18:07:39.420805] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:39.453935] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T18:07:39.512130] [DEBUG] [LOCAL ] CNM: Loaded 51367 existing records from primary storage. [2025-10-03T18:07:39.512469] [INFO ] [MAIN ] CNM: Loaded 51367 existing records. [2025-10-03T18:07:39.711227] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:39.711463] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-03T18:07:39.711512] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-03T18:07:39.711829] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-03T18:07:39.711890] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-03T18:07:39.995783] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-03T18:07:40.108150] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:40.591050] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-03T18:07:40.599466] [INFO ] [REMOTE ] CNC: Full fetch complete (77673 records). [2025-10-03T18:07:40.599601] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-03T18:07:40.796610] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-03T18:07:41.052015] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-03T18:07:41.052137] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-03T18:07:41.053180] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-03T18:07:41.053272] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-03T18:07:41.055254] [DEBUG] [LOCAL ] CNC: Trimmed 77673 records to 54518 (keeping 200 days of data) [2025-10-03T18:07:41.169296] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:07:41.424239] [DEBUG] [LOCAL ] CNC: Primary data saved (54518 records). [2025-10-03T18:07:41.424386] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-03T18:07:41.425299] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNC took 45.0s. Estimated remaining: 4h 18m 45s. Rate: 7.3 symbols/min [2025-10-03T18:07:41.597594] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-03T18:07:41.634343] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:41.674979] [DEBUG] [LOCAL ] CNMD: Loaded 32498 existing records from primary storage. [2025-10-03T18:07:41.675311] [INFO ] [MAIN ] CNMD: Loaded 32498 existing records. [2025-10-03T18:07:41.899415] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:41.900248] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-03T18:07:41.900381] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-03T18:07:41.900812] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-03T18:07:41.900965] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-03T18:07:42.266362] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T18:07:42.384502] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:42.398920] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-03T18:07:42.422451] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:07:43.174116] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:07:43.190613] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-03T18:07:43.733240] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:07:43.990706] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-03T18:07:44.790675] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-03T18:07:44.884152] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:07:45.382690] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:07:45.590691] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-03T18:07:46.185891] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:07:46.390692] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-03T18:07:46.985498] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:07:47.190706] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-03T18:07:47.866231] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:07:47.990696] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-03T18:07:48.790632] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-03T18:07:49.133961] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:07:49.596286] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-03T18:07:49.615971] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:07:50.268546] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:07:50.390694] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-03T18:07:50.723235] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:07:51.190724] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-03T18:07:51.990678] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-03T18:07:52.105690] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T18:07:52.794313] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-03T18:07:52.800621] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T18:07:53.145360] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T18:07:53.590742] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-03T18:07:54.390699] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-03T18:07:54.729690] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:07:55.190696] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-03T18:07:55.291070] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:07:55.998969] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-03T18:07:56.021252] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:07:56.611147] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T18:07:56.790714] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-03T18:07:57.590634] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-03T18:07:57.636890] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:07:58.390746] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-03T18:07:58.535909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:07:58.983872] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:07:59.190731] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-03T18:07:59.689537] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:07:59.990634] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-03T18:08:00.790697] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-03T18:08:01.280745] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T18:08:01.590638] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-03T18:08:01.661235] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:08:02.345927] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:08:02.390626] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-03T18:08:02.947549] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T18:08:03.190722] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-03T18:08:03.990731] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-03T18:08:04.161725] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:08:04.165506] [INFO ] [REMOTE ] CNI: Full fetch complete (74595 records). [2025-10-03T18:08:04.165694] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-03T18:08:04.591686] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-03T18:08:04.591847] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-03T18:08:04.592815] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-03T18:08:04.592881] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-03T18:08:04.594343] [DEBUG] [LOCAL ] CNI: Trimmed 74595 records to 52388 (keeping 200 days of data) [2025-10-03T18:08:04.794587] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-03T18:08:04.865387] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:08:04.980393] [DEBUG] [LOCAL ] CNI: Primary data saved (52388 records). [2025-10-03T18:08:04.980543] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-03T18:08:04.980634] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 41.0s. Estimated remaining: 4h 19m 35s. Rate: 7.2 symbols/min [2025-10-03T18:08:05.171636] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:05.209737] [DEBUG] [LOCAL ] CNNE: Loaded 36641 existing records from primary storage. [2025-10-03T18:08:05.210050] [INFO ] [MAIN ] CNNE: Loaded 36641 existing records. [2025-10-03T18:08:05.426541] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:05.426913] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-03T18:08:05.427038] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-03T18:08:05.427474] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-03T18:08:05.427591] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-03T18:08:05.598471] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-03T18:08:05.691046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:08:05.850120] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:06.390696] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-03T18:08:06.489461] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:08:06.492760] [INFO ] [REMOTE ] CNK: Full fetch complete (75812 records). [2025-10-03T18:08:06.492905] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-03T18:08:06.919083] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-03T18:08:06.919176] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-03T18:08:06.920493] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-03T18:08:06.920565] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-03T18:08:06.922397] [DEBUG] [LOCAL ] CNK: Trimmed 75812 records to 53649 (keeping 200 days of data) [2025-10-03T18:08:07.217271] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-03T18:08:07.274979] [DEBUG] [LOCAL ] CNK: Primary data saved (53649 records). [2025-10-03T18:08:07.275254] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-03T18:08:07.276241] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNK took 40.0s. Estimated remaining: 4h 19m 4s. Rate: 7.2 symbols/min [2025-10-03T18:08:07.488155] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:07.527334] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T18:08:07.579314] [DEBUG] [LOCAL ] CNO: Loaded 41454 existing records from primary storage. [2025-10-03T18:08:07.579664] [INFO ] [MAIN ] CNO: Loaded 41454 existing records. [2025-10-03T18:08:07.779568] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:07.779896] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-03T18:08:07.779977] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-03T18:08:07.788209] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-03T18:08:07.788305] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-03T18:08:07.900769] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:08:07.997127] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-03T18:08:08.202535] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:08.218148] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:08:08.790738] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-03T18:08:09.136575] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:08:09.590706] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-03T18:08:10.374226] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:08:10.378602] [INFO ] [REMOTE ] CNM: Full fetch complete (73646 records). [2025-10-03T18:08:10.378732] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-03T18:08:10.395785] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-03T18:08:10.801363] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-03T18:08:10.806673] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-03T18:08:10.816531] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-03T18:08:10.817993] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:08:10.817215] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-03T18:08:10.825570] [DEBUG] [LOCAL ] CNM: Trimmed 73646 records to 51723 (keeping 200 days of data) [2025-10-03T18:08:11.130130] [DEBUG] [LOCAL ] CNM: Primary data saved (51723 records). [2025-10-03T18:08:11.130273] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-03T18:08:11.130371] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNM took 31.9s. Estimated remaining: 4h 18m 39s. Rate: 7.3 symbols/min [2025-10-03T18:08:11.199165] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-03T18:08:11.318933] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:11.374538] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-10-03T18:08:11.374987] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-10-03T18:08:11.560794] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:11.561060] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-03T18:08:11.561115] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-03T18:08:11.562882] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-03T18:08:11.562946] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-03T18:08:11.879766] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:08:11.899695] [INFO ] [REMOTE ] CNMD: Full fetch complete (47344 records). [2025-10-03T18:08:11.922864] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-03T18:08:12.009876] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:11.997781] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-03T18:08:12.394895] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-03T18:08:12.394981] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-03T18:08:12.395615] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-03T18:08:12.395689] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-03T18:08:12.396877] [DEBUG] [LOCAL ] CNMD: Trimmed 47344 records to 32705 (keeping 200 days of data) [2025-10-03T18:08:12.603818] [DEBUG] [LOCAL ] CNMD: Primary data saved (32705 records). [2025-10-03T18:08:12.604105] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-03T18:08:12.604968] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNMD took 31.2s. Estimated remaining: 4h 18m 5s. Rate: 7.3 symbols/min [2025-10-03T18:08:12.788513] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:12.790684] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-03T18:08:12.852189] [DEBUG] [LOCAL ] CNQ: Loaded 53970 existing records from primary storage. [2025-10-03T18:08:12.852610] [INFO ] [MAIN ] CNQ: Loaded 53970 existing records. [2025-10-03T18:08:13.022941] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:08:13.090188] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:13.090499] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-03T18:08:13.090626] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-03T18:08:13.097320] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-03T18:08:13.106690] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-03T18:08:13.113330] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:08:13.511572] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:13.590693] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-03T18:08:14.390687] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-03T18:08:14.662044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:08:15.190706] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-03T18:08:15.488009] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:08:15.879144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:08:15.990747] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-03T18:08:16.790670] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-03T18:08:16.950304] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:08:17.590705] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-03T18:08:17.736446] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:08:18.390623] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-03T18:08:18.595963] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T18:08:18.833836] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:08:19.190735] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-03T18:08:19.984562] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:08:19.994047] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-03T18:08:20.790634] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-03T18:08:20.835529] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:08:20.979550] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:08:21.590702] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-03T18:08:22.390733] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-03T18:08:22.513384] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:08:23.190703] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-03T18:08:23.417830] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:08:23.579379] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T18:08:23.990691] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-03T18:08:24.790682] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-03T18:08:25.255087] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T18:08:25.556830] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T18:08:25.590730] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-03T18:08:26.390683] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-03T18:08:26.625894] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:08:27.179105] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:08:27.190626] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-03T18:08:27.784909] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:08:27.990727] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-03T18:08:28.488669] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:08:28.790790] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-03T18:08:29.590785] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-03T18:08:29.749242] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:08:29.855364] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:08:30.390725] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-03T18:08:31.068118] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T18:08:31.190722] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-03T18:08:31.990730] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-03T18:08:32.228375] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:08:32.469044] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T18:08:32.790701] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-03T18:08:33.590668] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-03T18:08:34.005091] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T18:08:34.167955] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T18:08:34.390688] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-03T18:08:35.190697] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-03T18:08:35.467873] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:08:35.990721] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-03T18:08:36.721768] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-03T18:08:36.790675] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-03T18:08:37.174098] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T18:08:37.590916] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-03T18:08:37.805704] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:08:37.944709] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T18:08:37.947766] [INFO ] [REMOTE ] CNNE: Full fetch complete (50015 records). [2025-10-03T18:08:37.947935] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-03T18:08:38.395893] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-03T18:08:38.483276] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-03T18:08:38.483402] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-03T18:08:38.484288] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-03T18:08:38.484363] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-03T18:08:38.485804] [DEBUG] [LOCAL ] CNNE: Trimmed 50015 records to 36931 (keeping 200 days of data) [2025-10-03T18:08:38.746330] [DEBUG] [LOCAL ] CNNE: Primary data saved (36931 records). [2025-10-03T18:08:38.746547] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-03T18:08:38.746741] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNNE took 33.8s. Estimated remaining: 4h 19m 4s. Rate: 7.2 symbols/min [2025-10-03T18:08:38.967728] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:38.968025] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-03T18:08:38.968135] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-03T18:08:38.968380] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-03T18:08:38.968703] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-03T18:08:38.977410] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-03T18:08:38.982741] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-03T18:08:39.072172] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:08:39.194105] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-03T18:08:39.425272] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:39.943160] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T18:08:39.990713] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-03T18:08:40.182730] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:08:40.183129] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-03T18:08:40.183217] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:08:40.183267] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-03T18:08:40.183330] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:08:40.183403] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-03T18:08:40.183549] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-03T18:08:40.183602] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-03T18:08:40.183710] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-03T18:08:40.183771] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNR took 1.4s. Estimated remaining: 4h 18m 30s. Rate: 7.2 symbols/min [2025-10-03T18:08:40.366177] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:40.387442] [DEBUG] [LOCAL ] CNS: Loaded 20779 existing records from primary storage. [2025-10-03T18:08:40.387734] [INFO ] [MAIN ] CNS: Loaded 20779 existing records. [2025-10-03T18:08:40.583313] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:40.583530] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-03T18:08:40.583581] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-03T18:08:40.584253] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-03T18:08:40.584316] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-03T18:08:40.790751] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-03T18:08:41.017713] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:08:41.016202] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:41.590698] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-03T18:08:42.390689] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-03T18:08:42.592508] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:08:42.814862] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:08:42.817036] [INFO ] [REMOTE ] CNO: Full fetch complete (60639 records). [2025-10-03T18:08:42.817188] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-03T18:08:43.195780] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-03T18:08:43.254703] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-03T18:08:43.254821] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-03T18:08:43.255711] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-03T18:08:43.255780] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-03T18:08:43.257345] [DEBUG] [LOCAL ] CNO: Trimmed 60639 records to 41722 (keeping 200 days of data) [2025-10-03T18:08:43.531089] [DEBUG] [LOCAL ] CNO: Primary data saved (41722 records). [2025-10-03T18:08:43.531225] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-03T18:08:43.532003] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNO took 36.3s. Estimated remaining: 4h 18m 3s. Rate: 7.3 symbols/min [2025-10-03T18:08:43.715467] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:43.715730] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-03T18:08:43.715790] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-03T18:08:43.715920] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-03T18:08:43.715969] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-03T18:08:43.716013] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-03T18:08:43.716047] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-03T18:08:43.991460] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-03T18:08:44.126212] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:44.141967] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T18:08:44.144769] [INFO ] [REMOTE ] CNP: Full fetch complete (77369 records). [2025-10-03T18:08:44.144909] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-03T18:08:44.561267] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:08:44.627709] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-03T18:08:44.627835] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-03T18:08:44.628885] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-03T18:08:44.628956] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-03T18:08:44.630563] [DEBUG] [LOCAL ] CNP: Trimmed 77369 records to 54248 (keeping 200 days of data) [2025-10-03T18:08:44.814267] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-03T18:08:44.978628] [DEBUG] [LOCAL ] CNP: Primary data saved (54248 records). [2025-10-03T18:08:44.978821] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-03T18:08:44.978935] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNP took 33.8s. Estimated remaining: 4h 17m 30s. Rate: 7.3 symbols/min [2025-10-03T18:08:45.157379] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:45.198254] [DEBUG] [LOCAL ] CODI: Loaded 40283 existing records from primary storage. [2025-10-03T18:08:45.198626] [INFO ] [MAIN ] CODI: Loaded 40283 existing records. [2025-10-03T18:08:45.393935] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:45.394169] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-03T18:08:45.394227] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-03T18:08:45.395595] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-03T18:08:45.395726] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-03T18:08:45.600232] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-03T18:08:45.811670] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:45.903373] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:08:46.390696] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-03T18:08:46.533964] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:08:46.896967] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:08:47.190685] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-03T18:08:47.628830] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:08:47.990682] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-03T18:08:48.790631] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-03T18:08:48.922632] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:08:49.109477] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:08:49.590697] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-03T18:08:49.874556] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:08:50.390736] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-03T18:08:51.189605] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:08:51.199569] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-03T18:08:51.475034] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T18:08:51.990665] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-03T18:08:51.993164] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:08:52.790631] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-03T18:08:53.180177] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:08:53.590726] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-03T18:08:54.390694] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-03T18:08:54.468223] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:08:54.577117] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:08:55.190730] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-03T18:08:55.884585] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T18:08:55.990635] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-03T18:08:56.219918] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T18:08:56.795853] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-03T18:08:56.805951] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T18:08:57.551696] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:08:57.590681] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-03T18:08:58.390698] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-03T18:08:58.640679] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:08:59.190694] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-03T18:08:59.942959] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:08:59.945886] [INFO ] [REMOTE ] CNQ: Full fetch complete (77552 records). [2025-10-03T18:08:59.946019] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-03T18:08:59.994741] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-03T18:09:00.394553] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:09:00.428279] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-03T18:09:00.428985] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-03T18:09:00.430440] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-03T18:09:00.430558] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-03T18:09:00.432790] [DEBUG] [LOCAL ] CNQ: Trimmed 77552 records to 54359 (keeping 200 days of data) [2025-10-03T18:09:00.790960] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-03T18:09:00.819044] [DEBUG] [LOCAL ] CNQ: Primary data saved (54359 records). [2025-10-03T18:09:00.819175] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-03T18:09:00.820904] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNQ took 48.2s. Estimated remaining: 4h 17m 50s. Rate: 7.3 symbols/min [2025-10-03T18:09:01.003568] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:01.064153] [DEBUG] [LOCAL ] COF: Loaded 53999 existing records from primary storage. [2025-10-03T18:09:01.064518] [INFO ] [MAIN ] COF: Loaded 53999 existing records. [2025-10-03T18:09:01.254064] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:01.254283] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-03T18:09:01.254341] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-03T18:09:01.256419] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-03T18:09:01.256500] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-03T18:09:01.593690] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-03T18:09:01.681222] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:01.769531] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:09:01.771073] [INFO ] [REMOTE ] CNS: Full fetch complete (30091 records). [2025-10-03T18:09:01.788977] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-03T18:09:01.792398] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:09:01.793709] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:09:01.793914] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:09:01.801610] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:09:01.802486] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-03T18:09:01.802568] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-03T18:09:01.802608] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-03T18:09:01.802996] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-03T18:09:01.803101] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNS took 21.6s. Estimated remaining: 4h 17m 14s. Rate: 7.3 symbols/min [2025-10-03T18:09:01.987863] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:01.988164] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-03T18:09:01.988220] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-03T18:09:01.988340] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-03T18:09:01.988382] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-03T18:09:01.988426] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-03T18:09:01.988460] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-03T18:09:02.365402] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:02.390692] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-03T18:09:03.190688] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-03T18:09:03.351737] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:09:03.990681] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-03T18:09:04.478766] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:09:04.553413] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T18:09:04.790689] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-03T18:09:05.590688] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-03T18:09:05.753053] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:09:06.390737] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-03T18:09:06.784626] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-03T18:09:07.190745] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-03T18:09:07.599663] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T18:09:07.990624] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-03T18:09:08.029407] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:09:08.790688] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-03T18:09:08.959002] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T18:09:09.563809] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:09:09.590698] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-03T18:09:10.390714] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-03T18:09:10.730757] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T18:09:11.190675] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-03T18:09:11.271451] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:09:11.990672] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-03T18:09:12.104218] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:09:12.790672] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-03T18:09:13.035868] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:09:13.590712] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-03T18:09:13.730963] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:09:14.345868] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T18:09:14.390668] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-03T18:09:15.190708] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-03T18:09:15.704774] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:09:15.990727] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-03T18:09:16.057548] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:09:16.557715] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:09:16.790690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-03T18:09:17.590695] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-03T18:09:17.992690] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:09:17.994867] [INFO ] [REMOTE ] CODI: Full fetch complete (51146 records). [2025-10-03T18:09:17.994963] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-03T18:09:18.151875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:09:18.405078] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-03T18:09:18.467415] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-03T18:09:18.467515] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-03T18:09:18.468221] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-03T18:09:18.468291] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-03T18:09:18.469606] [DEBUG] [LOCAL ] CODI: Trimmed 51146 records to 40570 (keeping 200 days of data) [2025-10-03T18:09:18.722866] [DEBUG] [LOCAL ] CODI: Primary data saved (40570 records). [2025-10-03T18:09:18.723097] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-03T18:09:18.723380] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CODI took 33.7s. Estimated remaining: 4h 17m 38s. Rate: 7.3 symbols/min [2025-10-03T18:09:18.905774] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:18.968474] [DEBUG] [LOCAL ] COLD: Loaded 52465 existing records from primary storage. [2025-10-03T18:09:18.968965] [INFO ] [MAIN ] COLD: Loaded 52465 existing records. [2025-10-03T18:09:19.163585] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:19.163898] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-03T18:09:19.163954] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-03T18:09:19.166263] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-03T18:09:19.166330] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-03T18:09:19.198043] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-03T18:09:19.600270] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:19.640251] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T18:09:19.990696] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-03T18:09:20.217666] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:09:20.790707] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-03T18:09:21.326369] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-03T18:09:21.590736] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-03T18:09:21.645766] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:09:22.390753] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-03T18:09:22.439674] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T18:09:22.442251] [INFO ] [REMOTE ] CNX: Full fetch complete (74724 records). [2025-10-03T18:09:22.442366] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-03T18:09:22.882805] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-03T18:09:22.882900] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-03T18:09:22.883801] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-03T18:09:22.883869] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-03T18:09:22.885527] [DEBUG] [LOCAL ] CNX: Trimmed 74724 records to 52109 (keeping 200 days of data) [2025-10-03T18:09:23.191849] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-03T18:09:23.216887] [DEBUG] [LOCAL ] CNX: Primary data saved (52109 records). [2025-10-03T18:09:23.217076] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-03T18:09:23.217194] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CNX took 39.7s. Estimated remaining: 4h 17m 16s. Rate: 7.3 symbols/min [2025-10-03T18:09:23.406696] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:23.406891] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-03T18:09:23.406938] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-03T18:09:23.407084] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-03T18:09:23.407143] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-03T18:09:23.407189] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-03T18:09:23.407225] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-03T18:09:23.804745] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:23.838097] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-03T18:09:23.990696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-03T18:09:24.272738] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:09:24.790698] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-03T18:09:25.083624] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T18:09:25.590713] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-03T18:09:25.827312] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T18:09:26.390636] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-03T18:09:26.918352] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:09:27.000337] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:09:27.190733] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-03T18:09:27.990748] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-03T18:09:28.054872] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:09:28.790708] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-03T18:09:28.927308] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:09:29.590626] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-03T18:09:30.093571] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T18:09:30.390698] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-03T18:09:30.522836] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:09:31.190730] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-03T18:09:31.596453] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:09:31.990709] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-03T18:09:32.133113] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:09:32.790673] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-03T18:09:33.133300] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:09:33.590716] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-03T18:09:34.388117] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-03T18:09:34.399768] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-03T18:09:34.579662] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:09:35.190671] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-03T18:09:35.509662] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:09:35.749247] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:09:35.990689] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-03T18:09:36.684662] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T18:09:36.790704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-03T18:09:37.590687] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-03T18:09:37.958051] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:09:38.390689] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-03T18:09:38.819113] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:09:39.190693] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-03T18:09:39.767760] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T18:09:39.771233] [INFO ] [REMOTE ] COHR: Full fetch complete (77127 records). [2025-10-03T18:09:39.771405] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-03T18:09:39.991815] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-03T18:09:40.244546] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-03T18:09:40.244743] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-03T18:09:40.245961] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-03T18:09:40.246060] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-03T18:09:40.248662] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:09:40.261537] [DEBUG] [LOCAL ] COHR: Trimmed 77127 records to 54136 (keeping 200 days of data) [2025-10-03T18:09:40.613670] [DEBUG] [LOCAL ] COHR: Primary data saved (54136 records). [2025-10-03T18:09:40.613832] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-03T18:09:40.613933] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COHR took 38.8s. Estimated remaining: 4h 17m 41s. Rate: 7.2 symbols/min [2025-10-03T18:09:40.801716] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-03T18:09:40.840305] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:40.843716] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:09:40.891711] [DEBUG] [LOCAL ] CON: Loaded 39102 existing records from primary storage. [2025-10-03T18:09:40.892074] [INFO ] [MAIN ] CON: Loaded 39102 existing records. [2025-10-03T18:09:41.093503] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:41.093776] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-03T18:09:41.093868] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-03T18:09:41.095129] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-03T18:09:41.095194] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-03T18:09:41.504251] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:41.590700] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-03T18:09:41.791577] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T18:09:41.794509] [INFO ] [REMOTE ] COF: Full fetch complete (77426 records). [2025-10-03T18:09:41.794666] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-03T18:09:42.269512] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-03T18:09:42.269731] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-03T18:09:42.270566] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-03T18:09:42.270616] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-03T18:09:42.272238] [DEBUG] [LOCAL ] COF: Trimmed 77426 records to 54389 (keeping 200 days of data) [2025-10-03T18:09:42.390845] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-03T18:09:42.555464] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T18:09:42.688831] [DEBUG] [LOCAL ] COF: Primary data saved (54389 records). [2025-10-03T18:09:42.689001] [INFO ] [MAIN ] COF: Full history saved. [2025-10-03T18:09:42.689839] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COF took 41.9s. Estimated remaining: 4h 17m 10s. Rate: 7.3 symbols/min [2025-10-03T18:09:42.873139] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:42.898815] [DEBUG] [LOCAL ] COOK: Loaded 24479 existing records from primary storage. [2025-10-03T18:09:42.899111] [INFO ] [MAIN ] COOK: Loaded 24479 existing records. [2025-10-03T18:09:43.096858] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:43.097278] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-03T18:09:43.097571] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-03T18:09:43.098465] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-03T18:09:43.098536] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-03T18:09:43.198372] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-03T18:09:43.363739] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T18:09:43.547807] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:43.990627] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-03T18:09:44.245371] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:09:44.577348] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:09:44.790689] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-03T18:09:45.432110] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:09:45.590686] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-03T18:09:46.390746] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-03T18:09:46.614795] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:09:47.048577] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:09:47.184426] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T18:09:47.190616] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-03T18:09:47.863716] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T18:09:47.990717] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-03T18:09:48.790691] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-03T18:09:49.512177] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:09:49.555732] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:09:49.590721] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-03T18:09:50.390672] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-03T18:09:51.185467] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:09:51.189330] [INFO ] [REMOTE ] COLD: Full fetch complete (74328 records). [2025-10-03T18:09:51.189511] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-03T18:09:51.195811] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-03T18:09:51.698726] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-03T18:09:51.698845] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-03T18:09:51.700069] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-03T18:09:51.700155] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-03T18:09:51.702304] [DEBUG] [LOCAL ] COLD: Trimmed 74328 records to 52854 (keeping 200 days of data) [2025-10-03T18:09:52.033288] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-03T18:09:52.076275] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:09:52.110698] [DEBUG] [LOCAL ] COLD: Primary data saved (52854 records). [2025-10-03T18:09:52.110880] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-03T18:09:52.110995] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COLD took 33.4s. Estimated remaining: 4h 17m 6s. Rate: 7.3 symbols/min [2025-10-03T18:09:52.304347] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:52.352635] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:09:52.376870] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-03T18:09:52.377201] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-03T18:09:52.584979] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:52.585313] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-03T18:09:52.585421] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-03T18:09:52.587257] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-03T18:09:52.587361] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-03T18:09:52.799230] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-03T18:09:53.087188] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:53.590714] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-03T18:09:54.042113] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:09:54.109683] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:09:54.390742] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-03T18:09:55.190723] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-03T18:09:55.468119] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:09:55.666812] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:09:55.990693] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-03T18:09:56.608211] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:09:56.790691] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-03T18:09:57.590636] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-03T18:09:57.858440] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:09:58.040314] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T18:09:58.390690] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-03T18:09:58.886517] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:09:59.190733] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-03T18:09:59.990697] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-03T18:10:00.114802] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T18:10:00.172447] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:10:00.790746] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-03T18:10:01.379493] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:10:01.590728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-03T18:10:02.390705] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-03T18:10:02.557121] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:10:03.190766] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-03T18:10:03.943288] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-03T18:10:03.990710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-03T18:10:04.302042] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T18:10:04.306890] [INFO ] [REMOTE ] COMP: Full fetch complete (77178 records). [2025-10-03T18:10:04.307164] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-03T18:10:04.764978] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-03T18:10:04.765149] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-03T18:10:04.766254] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-03T18:10:04.766382] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-03T18:10:04.777136] [DEBUG] [LOCAL ] COMP: Trimmed 77178 records to 54169 (keeping 200 days of data) [2025-10-03T18:10:04.792174] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-03T18:10:04.796430] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T18:10:05.138136] [DEBUG] [LOCAL ] COMP: Primary data saved (54169 records). [2025-10-03T18:10:05.138298] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-03T18:10:05.138503] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. COMP took 41.9s. Estimated remaining: 4h 17m 15s. Rate: 7.2 symbols/min [2025-10-03T18:10:05.355687] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:05.407623] [DEBUG] [LOCAL ] COR: Loaded 47382 existing records from primary storage. [2025-10-03T18:10:05.408025] [INFO ] [MAIN ] COR: Loaded 47382 existing records. [2025-10-03T18:10:05.606135] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-03T18:10:05.613561] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:05.614894] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-03T18:10:05.614962] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-03T18:10:05.615745] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-03T18:10:05.615870] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-03T18:10:06.018632] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:06.252620] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T18:10:06.265622] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-03T18:10:06.390738] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-03T18:10:06.981564] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:10:06.983806] [INFO ] [REMOTE ] CON: Full fetch complete (56908 records). [2025-10-03T18:10:06.983906] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-03T18:10:07.195871] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-03T18:10:07.414033] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-03T18:10:07.414218] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-03T18:10:07.415062] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-03T18:10:07.415129] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-03T18:10:07.419033] [DEBUG] [LOCAL ] CON: Trimmed 56908 records to 39417 (keeping 200 days of data) [2025-10-03T18:10:07.680522] [DEBUG] [LOCAL ] CON: Primary data saved (39417 records). [2025-10-03T18:10:07.680733] [INFO ] [MAIN ] CON: Full history saved. [2025-10-03T18:10:07.680866] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. CON took 27.1s. Estimated remaining: 4h 16m 46s. Rate: 7.3 symbols/min [2025-10-03T18:10:07.868801] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:07.921799] [DEBUG] [LOCAL ] COTY: Loaded 53616 existing records from primary storage. [2025-10-03T18:10:07.922132] [INFO ] [MAIN ] COTY: Loaded 53616 existing records. [2025-10-03T18:10:08.000724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-03T18:10:08.141623] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:08.142030] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-03T18:10:08.142197] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-03T18:10:08.142622] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-03T18:10:08.142727] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-03T18:10:08.495532] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T18:10:08.642058] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:08.660735] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:10:08.790737] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-03T18:10:09.590716] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-03T18:10:10.145202] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-03T18:10:10.390684] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-03T18:10:10.660716] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:10:10.913266] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T18:10:11.190728] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-03T18:10:11.990624] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-03T18:10:12.500299] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-03T18:10:12.790724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-03T18:10:13.020031] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:10:13.021664] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:10:13.033089] [INFO ] [REMOTE ] COOK: Full fetch complete (32417 records). [2025-10-03T18:10:13.033701] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-03T18:10:13.447171] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-03T18:10:13.447303] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-03T18:10:13.447988] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-03T18:10:13.448056] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-03T18:10:13.449195] [DEBUG] [LOCAL ] COOK: Trimmed 32417 records to 24640 (keeping 200 days of data) [2025-10-03T18:10:13.593171] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-03T18:10:13.605189] [DEBUG] [LOCAL ] COOK: Primary data saved (24640 records). [2025-10-03T18:10:13.605375] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-03T18:10:13.605540] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COOK took 30.9s. Estimated remaining: 4h 16m 29s. Rate: 7.3 symbols/min [2025-10-03T18:10:13.788463] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:13.842372] [DEBUG] [LOCAL ] COUR: Loaded 49263 existing records from primary storage. [2025-10-03T18:10:13.842750] [INFO ] [MAIN ] COUR: Loaded 49263 existing records. [2025-10-03T18:10:14.036762] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:14.037025] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-03T18:10:14.037080] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-03T18:10:14.037342] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-03T18:10:14.037405] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-03T18:10:14.399221] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-03T18:10:14.446244] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:14.569810] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:10:15.190714] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-03T18:10:15.401245] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:10:15.990724] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-03T18:10:16.601516] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-03T18:10:16.790720] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-03T18:10:17.174398] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:10:17.513103] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:10:17.590739] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-03T18:10:18.390726] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-03T18:10:18.640250] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:10:19.155636] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:10:19.190675] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-03T18:10:19.990695] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-03T18:10:20.499051] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T18:10:20.715843] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T18:10:20.790722] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-03T18:10:21.590635] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-03T18:10:22.109076] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T18:10:22.399189] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-03T18:10:22.418779] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:10:23.190744] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-03T18:10:23.690459] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T18:10:23.990753] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-03T18:10:24.133437] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:10:24.790701] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-03T18:10:25.023803] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:10:25.590719] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-03T18:10:26.030018] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T18:10:26.390727] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-03T18:10:26.439777] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:10:27.190704] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-03T18:10:27.310864] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:10:27.990698] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-03T18:10:28.229879] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:10:28.790713] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-03T18:10:29.141618] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T18:10:29.144581] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-03T18:10:29.144833] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-03T18:10:29.593793] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-03T18:10:29.599066] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-03T18:10:29.599188] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-03T18:10:29.600422] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-03T18:10:29.600840] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-03T18:10:29.628877] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:10:29.639337] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-10-03T18:10:29.994313] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-03T18:10:29.994477] [INFO ] [MAIN ] COP: Full history saved. [2025-10-03T18:10:29.994598] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 37.9s. Estimated remaining: 4h 16m 50s. Rate: 7.2 symbols/min [2025-10-03T18:10:30.189637] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:30.251452] [DEBUG] [LOCAL ] CP: Loaded 53656 existing records from primary storage. [2025-10-03T18:10:30.251902] [INFO ] [MAIN ] CP: Loaded 53656 existing records. [2025-10-03T18:10:30.395881] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-03T18:10:30.461314] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:30.461539] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-03T18:10:30.461590] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-03T18:10:30.463339] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-03T18:10:30.463413] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-03T18:10:30.874398] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T18:10:30.923328] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:31.190708] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-03T18:10:31.255503] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:10:31.990696] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-03T18:10:32.287901] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:10:32.790708] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-03T18:10:33.376786] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:10:33.464220] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T18:10:33.590718] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-03T18:10:34.390676] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-03T18:10:34.904544] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:10:35.190676] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-03T18:10:35.480021] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:10:35.699530] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T18:10:35.990717] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-03T18:10:36.790702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-03T18:10:37.020053] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:10:37.590711] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-03T18:10:37.952619] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:10:37.971516] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:10:37.974521] [INFO ] [REMOTE ] COR: Full fetch complete (68792 records). [2025-10-03T18:10:37.974719] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-03T18:10:38.407821] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-03T18:10:38.435269] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-03T18:10:38.435437] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-03T18:10:38.436351] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-03T18:10:38.436426] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-03T18:10:38.438249] [DEBUG] [LOCAL ] COR: Trimmed 68792 records to 47718 (keeping 200 days of data) [2025-10-03T18:10:38.757075] [DEBUG] [LOCAL ] COR: Primary data saved (47718 records). [2025-10-03T18:10:38.757230] [INFO ] [MAIN ] COR: Full history saved. [2025-10-03T18:10:38.758742] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COR took 33.6s. Estimated remaining: 4h 16m 44s. Rate: 7.2 symbols/min [2025-10-03T18:10:38.961429] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:38.961713] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-03T18:10:38.961765] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-03T18:10:38.961880] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-03T18:10:38.961923] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-03T18:10:38.961966] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-03T18:10:38.962029] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-03T18:10:39.207081] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-03T18:10:39.392870] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:39.436473] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:10:39.990626] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-03T18:10:40.108045] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:10:40.790680] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-03T18:10:41.143364] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:10:41.590699] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-03T18:10:41.998915] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:10:42.142450] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:10:42.145015] [INFO ] [REMOTE ] COUR: Full fetch complete (70861 records). [2025-10-03T18:10:42.145153] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-03T18:10:42.395843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-03T18:10:42.605166] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-03T18:10:42.605298] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-03T18:10:42.606408] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-03T18:10:42.606491] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-03T18:10:42.608480] [DEBUG] [LOCAL ] COUR: Trimmed 70861 records to 49645 (keeping 200 days of data) [2025-10-03T18:10:42.918094] [DEBUG] [LOCAL ] COUR: Primary data saved (49645 records). [2025-10-03T18:10:42.918252] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-03T18:10:42.919068] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 29.3s. Estimated remaining: 4h 16m 21s. Rate: 7.2 symbols/min [2025-10-03T18:10:43.114016] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:43.114452] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-03T18:10:43.114699] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-03T18:10:43.114903] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-03T18:10:43.114955] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-03T18:10:43.115009] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-03T18:10:43.115056] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-03T18:10:43.196532] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-03T18:10:43.543484] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:43.546382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T18:10:43.990668] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-03T18:10:44.255688] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:10:44.651754] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:10:44.769636] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:10:44.790625] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-03T18:10:45.590713] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-03T18:10:46.062340] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T18:10:46.390720] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-03T18:10:47.190631] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-03T18:10:47.291318] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:10:47.606944] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:10:47.990726] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-03T18:10:48.324244] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:10:48.790699] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-03T18:10:49.125935] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T18:10:49.128817] [INFO ] [REMOTE ] COTY: Full fetch complete (77101 records). [2025-10-03T18:10:49.128973] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-03T18:10:49.590090] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-03T18:10:49.590219] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-03T18:10:49.591358] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-03T18:10:49.591701] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-03T18:10:49.591469] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-03T18:10:49.595107] [DEBUG] [LOCAL ] COTY: Trimmed 77101 records to 54004 (keeping 200 days of data) [2025-10-03T18:10:49.929962] [DEBUG] [LOCAL ] COTY: Primary data saved (54004 records). [2025-10-03T18:10:49.930133] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-03T18:10:49.930232] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COTY took 42.2s. Estimated remaining: 4h 16m 8s. Rate: 7.3 symbols/min [2025-10-03T18:10:50.044887] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T18:10:50.123145] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:50.157355] [DEBUG] [LOCAL ] CPAY: Loaded 30849 existing records from primary storage. [2025-10-03T18:10:50.157772] [INFO ] [MAIN ] CPAY: Loaded 30849 existing records. [2025-10-03T18:10:50.368129] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:50.368427] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-03T18:10:50.368517] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-03T18:10:50.369845] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-03T18:10:50.369917] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-03T18:10:50.395848] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-03T18:10:50.781135] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T18:10:50.838181] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:51.190702] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-03T18:10:51.555745] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-03T18:10:51.793720] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T18:10:51.990691] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-03T18:10:52.790713] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-03T18:10:53.358501] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T18:10:53.590734] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-03T18:10:54.380353] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:10:54.390612] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-03T18:10:55.092597] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T18:10:55.190716] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-03T18:10:55.800693] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T18:10:55.990728] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-03T18:10:56.690903] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:10:56.790719] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-03T18:10:57.341536] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:10:57.590719] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-03T18:10:58.390706] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-03T18:10:58.646056] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T18:10:58.955875] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T18:10:59.190741] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-03T18:10:59.860297] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T18:10:59.990715] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-03T18:11:00.790747] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-03T18:11:01.328328] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:11:01.394150] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:11:01.408093] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-03T18:11:01.410854] [INFO ] [REMOTE ] CP: Full fetch complete (77127 records). [2025-10-03T18:11:01.411023] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-03T18:11:01.603626] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-03T18:11:01.847742] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-03T18:11:01.847845] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-03T18:11:01.848835] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-03T18:11:01.848908] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-03T18:11:01.852684] [DEBUG] [LOCAL ] CP: Trimmed 77127 records to 54043 (keeping 200 days of data) [2025-10-03T18:11:02.084604] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T18:11:02.214220] [DEBUG] [LOCAL ] CP: Primary data saved (54043 records). [2025-10-03T18:11:02.214376] [INFO ] [MAIN ] CP: Full history saved. [2025-10-03T18:11:02.214479] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CP took 32.2s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-03T18:11:02.400903] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-03T18:11:02.405837] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:02.424110] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-03T18:11:02.424422] [INFO ] [MAIN ] CPF: Loaded 15271 existing records. [2025-10-03T18:11:02.625013] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:02.625297] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-03T18:11:02.625375] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-03T18:11:02.626023] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-03T18:11:02.626087] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-03T18:11:03.083137] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:03.190730] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-03T18:11:03.733805] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:11:03.990737] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-03T18:11:04.368192] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T18:11:04.705404] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T18:11:04.790699] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-03T18:11:05.590704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-03T18:11:06.229127] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:11:06.390729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-03T18:11:06.783776] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:11:07.190737] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-03T18:11:07.412304] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:11:07.990735] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-03T18:11:08.270711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:11:08.790738] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-03T18:11:09.356037] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:11:09.590689] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-03T18:11:09.807550] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T18:11:10.390708] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-03T18:11:10.861441] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T18:11:10.929223] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T18:11:11.190722] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-03T18:11:11.990687] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-03T18:11:12.311421] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:11:12.790701] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-03T18:11:13.100006] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:11:13.102403] [INFO ] [REMOTE ] CPA: Full fetch complete (41703 records). [2025-10-03T18:11:13.102559] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-03T18:11:13.308729] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:11:13.532768] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-03T18:11:13.532850] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-03T18:11:13.533516] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-03T18:11:13.533581] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-03T18:11:13.534829] [DEBUG] [LOCAL ] CPA: Trimmed 41703 records to 28805 (keeping 200 days of data) [2025-10-03T18:11:13.597216] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-03T18:11:13.730602] [DEBUG] [LOCAL ] CPA: Primary data saved (28805 records). [2025-10-03T18:11:13.730773] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-03T18:11:13.730866] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CPA took 35.0s. Estimated remaining: 4h 16m 17s. Rate: 7.2 symbols/min [2025-10-03T18:11:13.924480] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:13.941873] [DEBUG] [LOCAL ] CPK: Loaded 13609 existing records from primary storage. [2025-10-03T18:11:13.942129] [INFO ] [MAIN ] CPK: Loaded 13609 existing records. [2025-10-03T18:11:14.113197] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:11:14.146681] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:14.148202] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-03T18:11:14.148265] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-03T18:11:14.149024] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-03T18:11:14.149139] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-03T18:11:14.395770] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-03T18:11:14.542423] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:15.190724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-03T18:11:15.990735] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-03T18:11:16.051081] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:11:16.279595] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T18:11:16.555886] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-03T18:11:16.790735] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-03T18:11:17.580126] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:11:17.590670] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-03T18:11:18.390716] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-03T18:11:18.966184] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:11:18.974220] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:11:19.190738] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-03T18:11:19.990702] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-03T18:11:20.424186] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:11:20.790692] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-03T18:11:21.042143] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:11:21.590739] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-03T18:11:22.124967] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T18:11:22.126724] [INFO ] [REMOTE ] CPAY: Full fetch complete (44992 records). [2025-10-03T18:11:22.126830] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-03T18:11:22.395837] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-03T18:11:22.472711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T18:11:22.571823] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-03T18:11:22.571905] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-03T18:11:22.573175] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-03T18:11:22.573241] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-03T18:11:22.576857] [DEBUG] [LOCAL ] CPAY: Trimmed 44992 records to 30967 (keeping 200 days of data) [2025-10-03T18:11:22.780498] [DEBUG] [LOCAL ] CPAY: Primary data saved (30967 records). [2025-10-03T18:11:22.780666] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-03T18:11:22.780811] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CPAY took 32.9s. Estimated remaining: 4h 16m 12s. Rate: 7.2 symbols/min [2025-10-03T18:11:22.969778] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:23.025291] [DEBUG] [LOCAL ] CPNG: Loaded 54061 existing records from primary storage. [2025-10-03T18:11:23.025692] [INFO ] [MAIN ] CPNG: Loaded 54061 existing records. [2025-10-03T18:11:23.195493] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-03T18:11:23.221966] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:23.222328] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-03T18:11:23.222386] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-03T18:11:23.224225] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-03T18:11:23.224292] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-03T18:11:23.620545] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:23.629403] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:11:23.769443] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:11:23.770230] [INFO ] [REMOTE ] CPAC: Full fetch complete (1872 records). [2025-10-03T18:11:23.770305] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-03T18:11:23.968871] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:11:23.969087] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:11:23.969175] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:11:23.969280] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-03T18:11:23.969396] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-03T18:11:23.969438] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-03T18:11:23.969482] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-03T18:11:23.969541] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPAC took 41.1s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-03T18:11:23.990625] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-03T18:11:24.790688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-03T18:11:24.948564] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:11:25.590694] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-03T18:11:25.759115] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T18:11:26.369771] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T18:11:26.390701] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-03T18:11:27.190679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-03T18:11:27.339804] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:11:27.990706] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-03T18:11:28.122255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:11:28.790704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-03T18:11:29.590707] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-03T18:11:29.757443] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T18:11:30.385178] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:11:30.396366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-03T18:11:30.420037] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:11:31.190737] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-03T18:11:31.361866] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:11:31.990704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-03T18:11:32.790728] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-03T18:11:32.833347] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:11:32.834631] [INFO ] [REMOTE ] CPF: Full fetch complete (24163 records). [2025-10-03T18:11:32.834745] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-03T18:11:33.277523] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-03T18:11:33.277741] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-03T18:11:33.278453] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-03T18:11:33.278558] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-03T18:11:33.279944] [DEBUG] [LOCAL ] CPF: Trimmed 24163 records to 15402 (keeping 200 days of data) [2025-10-03T18:11:33.388760] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T18:11:33.426281] [DEBUG] [LOCAL ] CPF: Primary data saved (15402 records). [2025-10-03T18:11:33.426453] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-03T18:11:33.426587] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPF took 31.2s. Estimated remaining: 4h 15m 34s. Rate: 7.2 symbols/min [2025-10-03T18:11:33.590702] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-03T18:11:33.863740] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:11:34.390688] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-03T18:11:35.149325] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T18:11:35.150563] [INFO ] [REMOTE ] CPK: Full fetch complete (17823 records). [2025-10-03T18:11:35.150699] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-03T18:11:35.151273] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:11:35.151375] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:11:35.151428] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:11:35.151470] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-03T18:11:35.151555] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-03T18:11:35.151614] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-03T18:11:35.152006] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-10-03T18:11:35.152104] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 21.4s. Estimated remaining: 4h 15m 2s. Rate: 7.3 symbols/min [2025-10-03T18:11:35.734024] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-03T18:11:35.745295] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-03T18:11:37.937078] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T18:11:37.949639] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-03T18:11:40.387604] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-03T18:11:40.400618] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-03T18:11:42.869281] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-03T18:11:42.881829] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-03T18:11:45.124713] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-03T18:11:45.136805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-03T18:11:47.563522] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-03T18:11:47.576726] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-03T18:11:49.897907] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T18:11:49.911075] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-03T18:11:52.191411] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T18:11:52.204265] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-03T18:11:54.452477] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-03T18:11:54.455378] [INFO ] [REMOTE ] CPNG: Full fetch complete (77674 records). [2025-10-03T18:11:54.455495] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-03T18:11:54.892782] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-03T18:11:54.892872] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-03T18:11:54.893779] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-03T18:11:54.893848] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-03T18:11:54.895459] [DEBUG] [LOCAL ] CPNG: Trimmed 77674 records to 54451 (keeping 200 days of data) [2025-10-03T18:11:55.246251] [DEBUG] [LOCAL ] CPNG: Primary data saved (54451 records). [2025-10-03T18:11:55.246404] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-03T18:11:55.246512] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 32.5s. Estimated remaining: 4h 15m 36s. Rate: 7.2 symbols/min [2025-10-03T18:11:55.931899] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:55.969728] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.062325] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.067394] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.098087] [DEBUG] [LOCAL ] CQP: Loaded 19574 existing records from primary storage. [2025-10-03T18:11:56.117729] [INFO ] [MAIN ] CQP: Loaded 19574 existing records. [2025-10-03T18:11:56.118794] [DEBUG] [LOCAL ] CPS: Loaded 26039 existing records from primary storage. [2025-10-03T18:11:56.152771] [INFO ] [MAIN ] CPS: Loaded 26039 existing records. [2025-10-03T18:11:56.329749] [DEBUG] [LOCAL ] CPT: Loaded 44684 existing records from primary storage. [2025-10-03T18:11:56.366751] [INFO ] [MAIN ] CPT: Loaded 44684 existing records. [2025-10-03T18:11:56.517435] [DEBUG] [LOCAL ] CPRI: Loaded 52920 existing records from primary storage. [2025-10-03T18:11:56.545347] [INFO ] [MAIN ] CPRI: Loaded 52920 existing records. [2025-10-03T18:11:56.545021] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:56.598484] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-03T18:11:56.620318] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-03T18:11:56.704239] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-03T18:11:56.802696] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-03T18:11:56.825314] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:56.917201] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.013264] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-03T18:11:57.024307] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:57.040469] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-03T18:11:57.051809] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-03T18:11:57.083692] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.201588] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-03T18:11:57.341534] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:57.347139] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-03T18:11:57.347320] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-03T18:11:57.377386] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.410800] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-03T18:11:57.478243] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-03T18:11:57.569611] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-03T18:11:58.049382] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.093169] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-03T18:11:58.416846] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.441761] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-03T18:11:58.641189] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.647727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-03T18:11:58.725467] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.725842] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-03T18:11:59.486010] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:11:59.492081] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-03T18:11:59.610850] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:11:59.616175] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-03T18:12:00.270035] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:12:00.281927] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-03T18:12:00.387079] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:12:00.396391] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-03T18:12:00.824488] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:12:00.829602] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-03T18:12:00.912986] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:12:00.919352] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-03T18:12:02.097897] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:12:02.103582] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-03T18:12:02.243076] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T18:12:02.254192] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-03T18:12:02.287808] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-03T18:12:02.300363] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-03T18:12:02.324072] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:12:02.333137] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-03T18:12:03.398013] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T18:12:03.405080] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-03T18:12:03.432006] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:12:03.437889] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-03T18:12:03.661853] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:12:03.672821] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-03T18:12:04.033270] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:12:04.043568] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-03T18:12:04.227145] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:12:04.231884] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-03T18:12:04.718929] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T18:12:04.726710] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-03T18:12:05.285549] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T18:12:05.291049] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-03T18:12:05.406847] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:12:05.419203] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-03T18:12:05.691534] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:12:05.701887] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-03T18:12:05.736945] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:12:05.744979] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-03T18:12:06.663332] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:12:06.670568] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-03T18:12:06.796870] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:12:06.802391] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-03T18:12:07.271854] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:12:07.283885] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-03T18:12:07.421230] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:12:07.432390] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-03T18:12:07.857445] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T18:12:07.879601] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-03T18:12:07.883470] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:12:07.890486] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-03T18:12:08.809909] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:12:08.813689] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-03T18:12:08.982563] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:12:08.994825] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-03T18:12:09.027120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:12:09.035228] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-03T18:12:09.074060] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:12:09.085019] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-03T18:12:09.823584] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:12:09.827560] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-03T18:12:10.424224] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:12:10.429936] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-03T18:12:10.641857] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:12:10.644499] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:12:10.657997] [INFO ] [REMOTE ] CQP: Full fetch complete (30537 records). [2025-10-03T18:12:10.660059] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-03T18:12:10.660619] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-03T18:12:10.661511] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:12:10.662867] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:12:10.663188] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:12:10.663345] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-03T18:12:10.663459] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-03T18:12:10.663634] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-03T18:12:10.663955] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-03T18:12:10.664138] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CQP took 15.4s. Estimated remaining: 4h 15m 53s. Rate: 7.2 symbols/min [2025-10-03T18:12:10.938772] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:10.943757] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:12:10.979579] [DEBUG] [LOCAL ] CR: Loaded 24566 existing records from primary storage. [2025-10-03T18:12:10.979886] [INFO ] [MAIN ] CR: Loaded 24566 existing records. [2025-10-03T18:12:11.173111] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:11.173372] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-03T18:12:11.173433] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-03T18:12:11.173943] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-03T18:12:11.174004] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-03T18:12:11.208959] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-03T18:12:11.501600] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:12:11.535203] [INFO ] [REMOTE ] CPS: Full fetch complete (36177 records). [2025-10-03T18:12:11.559725] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-03T18:12:11.576531] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:12:11.598939] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:11.599110] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:12:11.599705] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:12:11.599803] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-03T18:12:11.599892] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-03T18:12:11.599934] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-03T18:12:11.600163] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-03T18:12:11.600327] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CPS took 16.3s. Estimated remaining: 4h 15m 19s. Rate: 7.2 symbols/min [2025-10-03T18:12:11.791993] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:11.805952] [DEBUG] [LOCAL ] CRBD: Loaded 9065 existing records from primary storage. [2025-10-03T18:12:11.806255] [INFO ] [MAIN ] CRBD: Loaded 9065 existing records. [2025-10-03T18:12:11.991062] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-03T18:12:12.035487] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:12.036261] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-03T18:12:12.036393] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-03T18:12:12.036791] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-03T18:12:12.036867] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-03T18:12:12.438918] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:12.481089] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:12:12.790716] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-03T18:12:12.949334] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:12:13.284027] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T18:12:13.590616] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-03T18:12:13.662717] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:12:14.390618] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-03T18:12:14.787730] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T18:12:15.181148] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:12:15.190610] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-03T18:12:15.990715] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-03T18:12:16.051169] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T18:12:16.790721] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-03T18:12:17.513996] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:12:17.590706] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-03T18:12:18.307913] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:12:18.390682] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-03T18:12:18.505439] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T18:12:19.190678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-03T18:12:19.525114] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T18:12:19.938814] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T18:12:19.990661] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-03T18:12:20.757411] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:12:20.790725] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-03T18:12:21.543593] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:12:21.590741] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-03T18:12:22.390719] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-03T18:12:23.190678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-03T18:12:23.366795] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:12:23.653173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:12:23.990724] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-03T18:12:24.097918] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T18:12:24.790751] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-03T18:12:25.280012] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T18:12:25.579588] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:12:25.590688] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-03T18:12:26.371718] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:12:26.390708] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-03T18:12:27.190634] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-03T18:12:27.990682] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-03T18:12:28.302508] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T18:12:28.606569] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:12:28.607576] [INFO ] [REMOTE ] CRBD: Full fetch complete (14504 records). [2025-10-03T18:12:28.607695] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-03T18:12:28.769077] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:12:28.790859] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-03T18:12:28.834364] [INFO ] [REMOTE ] CPT: Full fetch complete (63961 records). [2025-10-03T18:12:28.882588] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-03T18:12:29.164841] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-03T18:12:29.185460] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-03T18:12:29.207607] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-03T18:12:29.227816] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-03T18:12:29.329339] [DEBUG] [LOCAL ] CRBD: Trimmed 14504 records to 9105 (keeping 200 days of data) [2025-10-03T18:12:29.516064] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-03T18:12:29.516725] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-03T18:12:29.518851] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-03T18:12:29.519503] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-03T18:12:29.523810] [DEBUG] [LOCAL ] CPT: Trimmed 63961 records to 44977 (keeping 200 days of data) [2025-10-03T18:12:29.586141] [DEBUG] [LOCAL ] CRBD: Primary data saved (9105 records). [2025-10-03T18:12:29.595329] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-03T18:12:29.595695] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-03T18:12:29.596732] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CRBD took 18.0s. Estimated remaining: 4h 15m 45s. Rate: 7.2 symbols/min [2025-10-03T18:12:29.828476] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:30.000255] [DEBUG] [LOCAL ] CRBG: Loaded 52747 existing records from primary storage. [2025-10-03T18:12:30.001477] [INFO ] [MAIN ] CRBG: Loaded 52747 existing records. [2025-10-03T18:12:30.217236] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:30.219009] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-03T18:12:30.219694] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-03T18:12:30.220258] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-03T18:12:30.220898] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-03T18:12:30.523857] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:12:30.585986] [INFO ] [REMOTE ] CPRI: Full fetch complete (76139 records). [2025-10-03T18:12:30.618615] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-03T18:12:30.643430] [DEBUG] [LOCAL ] CPT: Primary data saved (44977 records). [2025-10-03T18:12:30.680265] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-03T18:12:30.740122] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 35.5s. Estimated remaining: 4h 15m 11s. Rate: 7.2 symbols/min [2025-10-03T18:12:30.790963] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:30.808381] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-03T18:12:31.022607] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:12:31.137374] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:31.198273] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-03T18:12:31.397206] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-03T18:12:31.397356] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-03T18:12:31.398314] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-03T18:12:31.398474] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-03T18:12:31.400480] [DEBUG] [LOCAL ] CPRI: Trimmed 76139 records to 53294 (keeping 200 days of data) [2025-10-03T18:12:31.476404] [DEBUG] [LOCAL ] CRC: Loaded 44370 existing records from primary storage. [2025-10-03T18:12:31.503869] [INFO ] [MAIN ] CRC: Loaded 44370 existing records. [2025-10-03T18:12:31.812833] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:31.842282] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-03T18:12:31.852189] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-03T18:12:31.854905] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-03T18:12:31.856679] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-03T18:12:32.366279] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:32.370823] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-03T18:12:32.388958] [DEBUG] [LOCAL ] CPRI: Primary data saved (53294 records). [2025-10-03T18:12:32.389330] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-03T18:12:32.389478] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CPRI took 37.1s. Estimated remaining: 4h 14m 40s. Rate: 7.2 symbols/min [2025-10-03T18:12:32.590973] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:12:32.653422] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:32.653840] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-03T18:12:32.654025] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-03T18:12:32.654313] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-03T18:12:32.654395] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-03T18:12:32.654482] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-03T18:12:32.654627] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-03T18:12:32.793314] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-03T18:12:33.022470] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:12:33.160435] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:33.590631] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-03T18:12:33.863445] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:12:34.166245] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:12:34.390727] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-03T18:12:35.187514] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:12:35.198996] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-03T18:12:35.243734] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T18:12:35.414368] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:12:35.414759] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-03T18:12:35.414850] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:12:35.414901] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-03T18:12:35.414936] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:12:35.415009] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-03T18:12:35.415074] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-03T18:12:35.415110] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-03T18:12:35.415150] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-03T18:12:35.415197] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CRCL took 3.0s. Estimated remaining: 4h 14m 13s. Rate: 7.3 symbols/min [2025-10-03T18:12:35.610950] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:35.668279] [DEBUG] [LOCAL ] CRGY: Loaded 52894 existing records from primary storage. [2025-10-03T18:12:35.668706] [INFO ] [MAIN ] CRGY: Loaded 52894 existing records. [2025-10-03T18:12:35.864155] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:35.864384] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-03T18:12:35.864439] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-03T18:12:35.864929] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-03T18:12:35.864991] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-03T18:12:35.995796] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-03T18:12:36.273140] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:36.790739] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-03T18:12:37.590620] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-03T18:12:37.911003] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T18:12:37.934290] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:12:38.390699] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-03T18:12:39.190699] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-03T18:12:39.618092] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T18:12:39.740695] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:12:39.990750] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-03T18:12:40.575981] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:12:40.790712] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-03T18:12:41.590729] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-03T18:12:41.751341] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:12:41.768893] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:12:41.771169] [INFO ] [REMOTE ] CR: Full fetch complete (34743 records). [2025-10-03T18:12:41.771319] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-03T18:12:42.204020] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-03T18:12:42.204124] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-03T18:12:42.204691] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-03T18:12:42.204759] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-03T18:12:42.205892] [DEBUG] [LOCAL ] CR: Trimmed 34743 records to 24735 (keeping 200 days of data) [2025-10-03T18:12:42.368257] [DEBUG] [LOCAL ] CR: Primary data saved (24735 records). [2025-10-03T18:12:42.368397] [INFO ] [MAIN ] CR: Full history saved. [2025-10-03T18:12:42.368503] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CR took 31.7s. Estimated remaining: 4h 13m 60s. Rate: 7.3 symbols/min [2025-10-03T18:12:42.395864] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-03T18:12:42.564910] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:42.618719] [DEBUG] [LOCAL ] CRH: Loaded 53852 existing records from primary storage. [2025-10-03T18:12:42.619041] [INFO ] [MAIN ] CRH: Loaded 53852 existing records. [2025-10-03T18:12:42.811543] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:42.811782] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-03T18:12:42.811834] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-03T18:12:42.812108] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-03T18:12:42.812167] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-03T18:12:43.191241] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-03T18:12:43.212329] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:43.504124] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:12:43.664558] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:12:43.990694] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-03T18:12:44.790691] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-03T18:12:45.204178] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:12:45.590674] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-03T18:12:45.934767] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T18:12:46.354355] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:12:46.390617] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-03T18:12:47.190692] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-03T18:12:47.564823] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T18:12:47.990724] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-03T18:12:48.282977] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T18:12:48.552337] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:12:48.790718] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-03T18:12:49.590686] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-03T18:12:49.796873] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:12:50.395717] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-03T18:12:50.414347] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T18:12:51.190693] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-03T18:12:51.414804] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:12:51.632693] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:12:51.990710] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-03T18:12:52.365412] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T18:12:52.790747] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-03T18:12:53.590735] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-03T18:12:53.895126] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T18:12:54.195886] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:12:54.390739] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-03T18:12:55.151595] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T18:12:55.190672] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-03T18:12:55.990709] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-03T18:12:56.403489] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:12:56.790635] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-03T18:12:56.842053] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:12:57.590695] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-03T18:12:57.790912] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:12:58.390740] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-03T18:12:58.809089] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T18:12:59.190729] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-03T18:12:59.734160] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T18:12:59.990710] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-03T18:13:00.383129] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:13:00.790723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-03T18:13:01.561228] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-03T18:13:01.590696] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-03T18:13:02.012079] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T18:13:02.390695] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-03T18:13:03.190709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-03T18:13:04.077410] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (3.29 seconds). [2025-10-03T18:13:04.079493] [INFO ] [REMOTE ] CRC: Full fetch complete (62134 records). [2025-10-03T18:13:04.079688] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-03T18:13:04.080854] [FATAL] [VALIDATOR ] CRC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:13:04.080976] [FATAL] [MAIN ] CRC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:13:04.081059] [WARN ] [MAIN ] CRC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:13:04.081146] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-03T18:13:04.081244] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-03T18:13:04.081313] [INFO ] [LOCAL ] CRC: Starting deletion of derivative data. [2025-10-03T18:13:04.081583] [DEBUG] [LOCAL ] CRC: Deleted derivative data file. [2025-10-03T18:13:04.081752] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 33.3s. Estimated remaining: 4h 14m 39s. Rate: 7.2 symbols/min [2025-10-03T18:13:04.273428] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:04.329471] [DEBUG] [LOCAL ] CRI: Loaded 50218 existing records from primary storage. [2025-10-03T18:13:04.329833] [INFO ] [MAIN ] CRI: Loaded 50218 existing records. [2025-10-03T18:13:04.564118] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:04.564620] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-03T18:13:04.564775] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-03T18:13:04.565043] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-03T18:13:04.565111] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-03T18:13:04.764674] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-03T18:13:04.779107] [INFO ] [REMOTE ] CRBG: Full fetch complete (75725 records). [2025-10-03T18:13:04.810844] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-03T18:13:05.095411] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:05.100293] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-03T18:13:05.363393] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-03T18:13:05.392737] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-03T18:13:05.550217] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-03T18:13:05.550052] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T18:13:05.561603] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-03T18:13:05.563442] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-03T18:13:05.564063] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-03T18:13:05.565898] [DEBUG] [LOCAL ] CRBG: Trimmed 75725 records to 53133 (keeping 200 days of data) [2025-10-03T18:13:05.626890] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-03T18:13:05.907573] [DEBUG] [LOCAL ] CRBG: Primary data saved (53133 records). [2025-10-03T18:13:05.907741] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-03T18:13:05.907832] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRBG took 36.3s. Estimated remaining: 4h 14m 8s. Rate: 7.2 symbols/min [2025-10-03T18:13:06.083897] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:06.134197] [DEBUG] [LOCAL ] CRK: Loaded 52539 existing records from primary storage. [2025-10-03T18:13:06.134531] [INFO ] [MAIN ] CRK: Loaded 52539 existing records. [2025-10-03T18:13:06.322972] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:06.323178] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-03T18:13:06.323225] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-03T18:13:06.323475] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-03T18:13:06.323534] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-03T18:13:06.711668] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:06.712291] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-03T18:13:06.895321] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:13:07.190745] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-03T18:13:07.403169] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T18:13:07.456476] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:13:07.990729] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-03T18:13:08.628275] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:13:08.790733] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-03T18:13:09.399456] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-03T18:13:09.590732] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-03T18:13:10.101840] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T18:13:10.390617] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-03T18:13:10.511892] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:13:11.190675] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-03T18:13:11.600062] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:13:11.990621] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-03T18:13:12.305065] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:13:12.790498] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:13:12.790688] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-03T18:13:13.569711] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T18:13:13.590615] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-03T18:13:14.390707] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-03T18:13:14.707848] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T18:13:14.929900] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T18:13:15.190711] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-03T18:13:15.990635] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-03T18:13:16.106673] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:13:16.109738] [INFO ] [REMOTE ] CRGY: Full fetch complete (75980 records). [2025-10-03T18:13:16.109861] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-03T18:13:16.552053] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-03T18:13:16.552151] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-03T18:13:16.553075] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-03T18:13:16.553166] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-03T18:13:16.555006] [DEBUG] [LOCAL ] CRGY: Trimmed 75980 records to 53284 (keeping 200 days of data) [2025-10-03T18:13:16.790898] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-03T18:13:16.892436] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T18:13:16.895704] [INFO ] [REMOTE ] CRH: Full fetch complete (76909 records). [2025-10-03T18:13:16.896382] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-03T18:13:16.897936] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:13:16.898873] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:13:16.900848] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:13:16.901866] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-03T18:13:16.902910] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-03T18:13:16.903012] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-03T18:13:16.904028] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-03T18:13:16.904525] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRH took 34.5s. Estimated remaining: 4h 14m 9s. Rate: 7.2 symbols/min [2025-10-03T18:13:17.117662] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:17.122123] [DEBUG] [LOCAL ] CRGY: Primary data saved (53284 records). [2025-10-03T18:13:17.122313] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-03T18:13:17.123989] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRGY took 41.7s. Estimated remaining: 4h 13m 33s. Rate: 7.3 symbols/min [2025-10-03T18:13:17.330175] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:17.345684] [DEBUG] [LOCAL ] CRL: Loaded 43331 existing records from primary storage. [2025-10-03T18:13:17.346026] [INFO ] [MAIN ] CRL: Loaded 43331 existing records. [2025-10-03T18:13:17.559727] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:17.560471] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-03T18:13:17.560635] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-03T18:13:17.561145] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-03T18:13:17.561303] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-03T18:13:17.825900] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-03T18:13:17.874989] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-03T18:13:18.148333] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:13:18.340915] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-03T18:13:18.346401] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:18.414194] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-03T18:13:18.480778] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:18.482033] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-03T18:13:18.482110] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-03T18:13:18.483723] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-03T18:13:18.483804] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-03T18:13:18.992963] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:19.034827] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T18:13:19.190717] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-03T18:13:19.832295] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:13:19.990671] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-03T18:13:20.134594] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:13:20.790684] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-03T18:13:20.896399] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:13:21.540320] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:13:21.590710] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-03T18:13:22.390683] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-03T18:13:22.485084] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:13:22.864246] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:13:23.190719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-03T18:13:23.990689] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-03T18:13:24.790631] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-03T18:13:24.863600] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:13:25.005281] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:13:25.288203] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T18:13:25.590696] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-03T18:13:26.291163] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:13:26.390717] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-03T18:13:27.190698] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-03T18:13:27.843859] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T18:13:27.990676] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-03T18:13:28.157419] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:13:28.790628] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-03T18:13:29.108511] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:13:29.590663] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-03T18:13:30.313865] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-03T18:13:30.390630] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-03T18:13:30.526743] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:13:31.190680] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-03T18:13:31.419718] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:13:31.990726] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-03T18:13:32.370136] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:13:32.413662] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T18:13:32.790749] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-03T18:13:33.498447] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:13:33.590765] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-03T18:13:34.390753] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-03T18:13:34.755148] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:13:35.190726] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-03T18:13:35.423508] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:13:35.655265] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T18:13:35.990772] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-03T18:13:36.790730] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-03T18:13:37.597882] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-03T18:13:37.626192] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-03T18:13:37.679238] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:13:37.887712] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:13:38.390738] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-03T18:13:39.190701] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-03T18:13:39.541754] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:13:39.853605] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:13:39.856141] [INFO ] [REMOTE ] CRI: Full fetch complete (70924 records). [2025-10-03T18:13:39.856263] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-03T18:13:40.005184] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-03T18:13:40.284761] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-03T18:13:40.284852] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-03T18:13:40.285628] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-03T18:13:40.285746] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-03T18:13:40.287297] [DEBUG] [LOCAL ] CRI: Trimmed 70924 records to 50562 (keeping 200 days of data) [2025-10-03T18:13:40.621061] [DEBUG] [LOCAL ] CRI: Primary data saved (50562 records). [2025-10-03T18:13:40.621244] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-03T18:13:40.622064] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 36.5s. Estimated remaining: 4h 14m 17s. Rate: 7.2 symbols/min [2025-10-03T18:13:40.801599] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-03T18:13:40.805678] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:40.854617] [DEBUG] [LOCAL ] CRS: Loaded 43533 existing records from primary storage. [2025-10-03T18:13:40.855037] [INFO ] [MAIN ] CRS: Loaded 43533 existing records. [2025-10-03T18:13:41.081531] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:41.084191] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:13:41.084338] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-03T18:13:41.084615] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-03T18:13:41.095377] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-03T18:13:41.095492] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-03T18:13:41.481552] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:41.590792] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-03T18:13:41.671285] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:13:41.675170] [INFO ] [REMOTE ] CRK: Full fetch complete (75590 records). [2025-10-03T18:13:41.675278] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-03T18:13:42.120947] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-03T18:13:42.121041] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-03T18:13:42.122067] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-03T18:13:42.122140] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-03T18:13:42.123959] [DEBUG] [LOCAL ] CRK: Trimmed 75590 records to 52920 (keeping 200 days of data) [2025-10-03T18:13:42.410771] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-03T18:13:42.458792] [DEBUG] [LOCAL ] CRK: Primary data saved (52920 records). [2025-10-03T18:13:42.458949] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-03T18:13:42.459059] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 36.6s. Estimated remaining: 4h 13m 46s. Rate: 7.2 symbols/min [2025-10-03T18:13:42.648458] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:42.656617] [DEBUG] [LOCAL ] CRT: Loaded 5011 existing records from primary storage. [2025-10-03T18:13:42.656849] [INFO ] [MAIN ] CRT: Loaded 5011 existing records. [2025-10-03T18:13:42.858366] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:42.858701] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-03T18:13:42.858763] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-03T18:13:42.858963] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-03T18:13:42.859027] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-03T18:13:43.016097] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:13:43.101187] [INFO ] [REMOTE ] CRL: Full fetch complete (63059 records). [2025-10-03T18:13:43.123529] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-03T18:13:43.426385] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:43.465771] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-03T18:13:43.777044] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-10-03T18:13:43.813484] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-03T18:13:43.813677] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-03T18:13:43.815451] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-03T18:13:43.815557] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-03T18:13:43.817639] [DEBUG] [LOCAL ] CRL: Trimmed 63059 records to 43656 (keeping 200 days of data) [2025-10-03T18:13:43.937930] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:13:44.033056] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-03T18:13:44.132181] [DEBUG] [LOCAL ] CRL: Primary data saved (43656 records). [2025-10-03T18:13:44.132363] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-03T18:13:44.132462] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRL took 27.2s. Estimated remaining: 4h 13m 15s. Rate: 7.2 symbols/min [2025-10-03T18:13:44.321581] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:44.329119] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T18:13:44.372194] [DEBUG] [LOCAL ] CSAN: Loaded 42614 existing records from primary storage. [2025-10-03T18:13:44.372529] [INFO ] [MAIN ] CSAN: Loaded 42614 existing records. [2025-10-03T18:13:44.564477] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:44.564731] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-03T18:13:44.564836] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-03T18:13:44.565783] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-03T18:13:44.565879] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-03T18:13:44.799595] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-03T18:13:44.948008] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:45.528273] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:13:45.590720] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-03T18:13:46.247854] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:13:46.390665] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-03T18:13:46.624198] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-03T18:13:47.079595] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T18:13:47.190720] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-03T18:13:47.990862] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-03T18:13:48.790684] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-03T18:13:48.845076] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T18:13:49.527524] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T18:13:49.557034] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:13:49.590692] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-03T18:13:50.390674] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-03T18:13:51.000821] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:13:51.190703] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-03T18:13:51.990690] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-03T18:13:52.563721] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:13:52.723204] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:13:52.790630] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-03T18:13:52.950178] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-03T18:13:53.591865] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-03T18:13:53.593143] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T18:13:54.390691] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-03T18:13:55.082362] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T18:13:55.190702] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-03T18:13:55.990686] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-03T18:13:56.118355] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T18:13:56.577754] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T18:13:56.603538] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:13:56.790674] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-03T18:13:57.510742] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:13:57.590716] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-03T18:13:58.160360] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:13:58.161721] [INFO ] [REMOTE ] CRT: Full fetch complete (7566 records). [2025-10-03T18:13:58.161856] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-03T18:13:58.395817] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-03T18:13:58.636126] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-03T18:13:58.636274] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-03T18:13:58.636558] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-03T18:13:58.636636] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-03T18:13:58.637167] [DEBUG] [LOCAL ] CRT: Trimmed 7566 records to 5044 (keeping 200 days of data) [2025-10-03T18:13:58.674234] [DEBUG] [LOCAL ] CRT: Primary data saved (5044 records). [2025-10-03T18:13:58.674372] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-03T18:13:58.674497] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRT took 16.2s. Estimated remaining: 4h 13m 29s. Rate: 7.2 symbols/min [2025-10-03T18:13:58.861827] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:58.901538] [DEBUG] [LOCAL ] CSL: Loaded 31700 existing records from primary storage. [2025-10-03T18:13:58.901882] [INFO ] [MAIN ] CSL: Loaded 31700 existing records. [2025-10-03T18:13:59.096540] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:59.098415] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-03T18:13:59.098497] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-03T18:13:59.099939] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-03T18:13:59.100000] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-03T18:13:59.195739] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-03T18:13:59.510717] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:59.995920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-03T18:14:00.018440] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T18:14:00.790693] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-03T18:14:01.590636] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-03T18:14:01.812345] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-03T18:14:01.816407] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-03T18:14:01.816617] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-03T18:14:02.283884] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-03T18:14:02.284243] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-03T18:14:02.285528] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-03T18:14:02.285741] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-03T18:14:02.298853] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-10-03T18:14:02.317144] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-03T18:14:02.390901] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-03T18:14:02.456999] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:14:02.733607] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-03T18:14:02.733824] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-03T18:14:02.734878] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRM took 45.6s. Estimated remaining: 4h 13m 6s. Rate: 7.2 symbols/min [2025-10-03T18:14:02.934809] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:02.955794] [DEBUG] [LOCAL ] CSR: Loaded 12887 existing records from primary storage. [2025-10-03T18:14:02.956051] [INFO ] [MAIN ] CSR: Loaded 12887 existing records. [2025-10-03T18:14:03.147673] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:03.148108] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-03T18:14:03.148259] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-03T18:14:03.149135] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-03T18:14:03.149203] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-03T18:14:03.198779] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-03T18:14:03.376906] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:14:03.601866] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:03.990635] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-03T18:14:04.067354] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:14:04.655344] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:14:04.790674] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-03T18:14:05.510044] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:14:05.590684] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-03T18:14:06.390637] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-03T18:14:06.477162] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:14:06.551832] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:14:07.190708] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-03T18:14:07.841851] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T18:14:07.990719] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-03T18:14:08.677542] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T18:14:08.790707] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-03T18:14:09.459135] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:14:09.590742] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-03T18:14:10.390744] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-03T18:14:10.565835] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:14:10.990107] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T18:14:11.012949] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T18:14:11.190740] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-03T18:14:11.977198] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:14:11.990712] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-03T18:14:12.790731] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-03T18:14:13.590708] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-03T18:14:13.775835] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:14:14.104122] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:14:14.390697] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-03T18:14:14.922449] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:14:15.190700] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-03T18:14:15.921306] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:14:15.990688] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-03T18:14:16.019677] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T18:14:16.790693] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-03T18:14:16.985931] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:14:17.590743] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-03T18:14:18.085854] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T18:14:18.087943] [INFO ] [REMOTE ] CSAN: Full fetch complete (60604 records). [2025-10-03T18:14:18.088043] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-03T18:14:18.398212] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-03T18:14:18.515438] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-03T18:14:18.515595] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-03T18:14:18.516427] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-03T18:14:18.516492] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-03T18:14:18.517968] [DEBUG] [LOCAL ] CSAN: Trimmed 60604 records to 42880 (keeping 200 days of data) [2025-10-03T18:14:18.777331] [DEBUG] [LOCAL ] CSAN: Primary data saved (42880 records). [2025-10-03T18:14:18.777467] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-03T18:14:18.777575] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CSAN took 34.6s. Estimated remaining: 4h 13m 24s. Rate: 7.2 symbols/min [2025-10-03T18:14:18.983098] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:18.984916] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:14:19.036405] [DEBUG] [LOCAL ] CSTM: Loaded 47784 existing records from primary storage. [2025-10-03T18:14:19.036747] [INFO ] [MAIN ] CSTM: Loaded 47784 existing records. [2025-10-03T18:14:19.198744] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-03T18:14:19.234765] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:19.235430] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-03T18:14:19.235494] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-03T18:14:19.236432] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-03T18:14:19.236512] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-03T18:14:19.622781] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:19.975603] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:14:19.990618] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-03T18:14:20.614635] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:14:20.790702] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-03T18:14:21.597926] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-03T18:14:21.601404] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T18:14:21.792698] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T18:14:22.390688] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-03T18:14:22.669377] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T18:14:23.190683] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-03T18:14:23.356521] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T18:14:23.990716] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-03T18:14:24.559577] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:14:24.561853] [INFO ] [REMOTE ] CRS: Full fetch complete (62739 records). [2025-10-03T18:14:24.562023] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-03T18:14:24.809065] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-03T18:14:24.936384] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T18:14:25.055109] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-03T18:14:25.055207] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-03T18:14:25.055947] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-03T18:14:25.056016] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-03T18:14:25.057422] [DEBUG] [LOCAL ] CRS: Trimmed 62739 records to 43817 (keeping 200 days of data) [2025-10-03T18:14:25.350235] [DEBUG] [LOCAL ] CRS: Primary data saved (43817 records). [2025-10-03T18:14:25.350379] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-03T18:14:25.351231] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CRS took 44.7s. Estimated remaining: 4h 13m 10s. Rate: 7.2 symbols/min [2025-10-03T18:14:25.539212] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:25.557366] [DEBUG] [LOCAL ] CSV: Loaded 12924 existing records from primary storage. [2025-10-03T18:14:25.557611] [INFO ] [MAIN ] CSV: Loaded 12924 existing records. [2025-10-03T18:14:25.595859] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-03T18:14:25.760171] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:25.760412] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-03T18:14:25.760463] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-03T18:14:25.760797] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-03T18:14:25.760859] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-03T18:14:26.148009] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:26.390696] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-03T18:14:26.454785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:14:26.528150] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:14:27.190702] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-03T18:14:27.568383] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T18:14:27.990693] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-03T18:14:28.602019] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T18:14:28.702523] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:14:28.790688] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-03T18:14:29.590689] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-03T18:14:29.705776] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:14:30.390683] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-03T18:14:31.187440] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T18:14:31.195037] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-03T18:14:31.990730] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-03T18:14:32.036747] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:14:32.163062] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T18:14:32.790994] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-03T18:14:32.796605] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T18:14:33.590747] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-03T18:14:34.390693] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-03T18:14:34.391978] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:14:34.582990] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T18:14:35.190689] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-03T18:14:35.580843] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:14:35.583282] [INFO ] [REMOTE ] CSL: Full fetch complete (45377 records). [2025-10-03T18:14:35.583407] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-03T18:14:35.972560] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:14:35.992282] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-03T18:14:36.011042] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-03T18:14:36.011163] [INFO ] [REMOTE ] CSR: Full fetch complete (17712 records). [2025-10-03T18:14:36.011322] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-03T18:14:36.012212] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-03T18:14:36.012134] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-03T18:14:36.012443] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-03T18:14:36.055797] [DEBUG] [LOCAL ] CSL: Trimmed 45377 records to 31939 (keeping 200 days of data) [2025-10-03T18:14:36.544997] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-03T18:14:36.554689] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-03T18:14:36.555156] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-03T18:14:36.555623] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-03T18:14:36.568570] [DEBUG] [LOCAL ] CSR: Trimmed 17712 records to 12973 (keeping 200 days of data) [2025-10-03T18:14:36.741437] [DEBUG] [LOCAL ] CSL: Primary data saved (31939 records). [2025-10-03T18:14:36.742113] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-03T18:14:36.742252] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSL took 38.1s. Estimated remaining: 4h 13m 12s. Rate: 7.2 symbols/min [2025-10-03T18:14:36.802918] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-03T18:14:36.883946] [DEBUG] [LOCAL ] CSR: Primary data saved (12973 records). [2025-10-03T18:14:36.889415] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-03T18:14:36.909688] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSR took 34.2s. Estimated remaining: 4h 12m 36s. Rate: 7.2 symbols/min [2025-10-03T18:14:36.963868] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:36.987920] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-03T18:14:37.017045] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-03T18:14:37.035125] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-03T18:14:37.067240] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-03T18:14:37.082046] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-03T18:14:37.131671] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-03T18:14:37.176220] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:37.207299] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T18:14:37.288783] [DEBUG] [LOCAL ] CTBB: Loaded 7097 existing records from primary storage. [2025-10-03T18:14:37.306675] [INFO ] [MAIN ] CTBB: Loaded 7097 existing records. [2025-10-03T18:14:37.597845] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-03T18:14:37.773041] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:37.809568] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-03T18:14:37.822096] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-03T18:14:37.836403] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:37.836875] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-03T18:14:37.836962] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-03T18:14:38.243485] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:38.390634] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-03T18:14:38.566941] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:14:38.583024] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:14:38.583414] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-03T18:14:38.583510] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:14:38.583561] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-03T18:14:38.583628] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:14:38.583738] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-03T18:14:38.583816] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-03T18:14:38.583872] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-03T18:14:38.583992] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-03T18:14:38.584088] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSW took 1.8s. Estimated remaining: 4h 12m 6s. Rate: 7.3 symbols/min [2025-10-03T18:14:38.786231] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:38.787394] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T18:14:38.800298] [DEBUG] [LOCAL ] CTDD: Loaded 5926 existing records from primary storage. [2025-10-03T18:14:38.800532] [INFO ] [MAIN ] CTDD: Loaded 5926 existing records. [2025-10-03T18:14:39.010876] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:39.011110] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-03T18:14:39.011163] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-03T18:14:39.011534] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-03T18:14:39.011594] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-03T18:14:39.191406] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-03T18:14:39.411841] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:39.990689] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-03T18:14:40.193932] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:14:40.790696] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-03T18:14:40.824755] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:14:41.518863] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:14:41.590759] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-03T18:14:42.390693] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-03T18:14:42.981407] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:14:43.190730] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-03T18:14:43.882177] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T18:14:43.999357] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-03T18:14:44.027625] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:14:44.771511] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:14:44.790683] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-03T18:14:45.590743] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-03T18:14:45.680056] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:14:46.390729] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-03T18:14:46.407711] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T18:14:47.029375] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T18:14:47.190784] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-03T18:14:47.799838] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:14:47.990706] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-03T18:14:48.722481] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:14:48.790739] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-03T18:14:49.590739] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-03T18:14:49.924799] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T18:14:50.221283] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T18:14:50.390675] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-03T18:14:51.190694] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-03T18:14:51.243682] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T18:14:51.990680] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-03T18:14:52.259542] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:14:52.790694] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-03T18:14:53.590767] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-03T18:14:53.715856] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:14:54.033125] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T18:14:54.307576] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T18:14:54.390714] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-03T18:14:55.136951] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:14:55.138388] [INFO ] [REMOTE ] CSV: Full fetch complete (19591 records). [2025-10-03T18:14:55.138520] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-03T18:14:55.195884] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-03T18:14:55.513892] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-03T18:14:55.514000] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-03T18:14:55.514674] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-03T18:14:55.514741] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-03T18:14:55.515325] [DEBUG] [LOCAL ] CSV: Trimmed 19591 records to 13044 (keeping 200 days of data) [2025-10-03T18:14:55.598084] [DEBUG] [LOCAL ] CSV: Primary data saved (13044 records). [2025-10-03T18:14:55.598286] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-03T18:14:55.598404] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSV took 30.2s. Estimated remaining: 4h 12m 27s. Rate: 7.2 symbols/min [2025-10-03T18:14:55.769931] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:55.770237] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-03T18:14:55.770297] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-03T18:14:55.770429] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-03T18:14:55.770487] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-03T18:14:55.770528] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-03T18:14:55.770563] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-03T18:14:55.995870] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-03T18:14:56.039387] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T18:14:56.155041] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:56.760155] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:14:56.790681] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-03T18:14:57.590774] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-03T18:14:57.903534] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:14:57.903944] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-03T18:14:57.904049] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:14:57.904125] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-03T18:14:57.904191] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:14:57.904275] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-03T18:14:57.904534] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-03T18:14:57.904866] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-03T18:14:57.904950] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-03T18:14:57.905025] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CTEST took 2.3s. Estimated remaining: 4h 11m 59s. Rate: 7.3 symbols/min [2025-10-03T18:14:58.085195] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:58.085523] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-03T18:14:58.085594] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-03T18:14:58.085801] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-03T18:14:58.085917] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-03T18:14:58.085985] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-03T18:14:58.086022] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-03T18:14:58.395788] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-03T18:14:58.541926] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:58.585702] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:14:59.151906] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T18:14:59.153326] [INFO ] [REMOTE ] CTBB: Full fetch complete (10694 records). [2025-10-03T18:14:59.153632] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-03T18:14:59.154582] [FATAL] [VALIDATOR ] CTBB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:14:59.154739] [FATAL] [MAIN ] CTBB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:14:59.154787] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:14:59.154831] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-03T18:14:59.154896] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-03T18:14:59.154934] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-03T18:14:59.155232] [DEBUG] [LOCAL ] CTBB: Deleted derivative data file. [2025-10-03T18:14:59.155346] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTBB took 22.2s. Estimated remaining: 4h 11m 27s. Rate: 7.3 symbols/min [2025-10-03T18:14:59.196011] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-03T18:14:59.359807] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:59.395632] [DEBUG] [LOCAL ] CTO: Loaded 28044 existing records from primary storage. [2025-10-03T18:14:59.395945] [INFO ] [MAIN ] CTO: Loaded 28044 existing records. [2025-10-03T18:14:59.585836] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:59.586082] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-03T18:14:59.586132] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-03T18:14:59.586370] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-03T18:14:59.586430] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-03T18:14:59.906457] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T18:14:59.991508] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:59.991668] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-03T18:15:00.193426] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:15:00.193820] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-03T18:15:00.193914] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:15:00.194003] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-03T18:15:00.194072] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:15:00.194144] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-03T18:15:00.194211] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-03T18:15:00.194249] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-03T18:15:00.194291] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-03T18:15:00.194340] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTEV took 2.3s. Estimated remaining: 4h 10m 54s. Rate: 7.3 symbols/min [2025-10-03T18:15:00.394705] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:00.436632] [DEBUG] [LOCAL ] CTOS: Loaded 36860 existing records from primary storage. [2025-10-03T18:15:00.437019] [INFO ] [MAIN ] CTOS: Loaded 36860 existing records. [2025-10-03T18:15:00.645424] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:00.645696] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-03T18:15:00.645769] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-03T18:15:00.646258] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-03T18:15:00.646319] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-03T18:15:00.795931] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-03T18:15:01.050304] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:01.590725] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-03T18:15:02.390704] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-03T18:15:03.190751] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-03T18:15:03.385525] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:15:03.472203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-03T18:15:03.736074] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T18:15:03.990750] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-03T18:15:04.224815] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:15:04.790708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-03T18:15:05.590709] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-03T18:15:05.839704] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:15:05.929183] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T18:15:06.222893] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T18:15:06.390708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-03T18:15:07.190705] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-03T18:15:07.820279] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:15:07.820060] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:15:07.990708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-03T18:15:08.790720] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-03T18:15:09.406772] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:15:09.575597] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:15:09.590621] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-03T18:15:10.390677] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-03T18:15:10.950244] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:15:11.190700] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-03T18:15:11.854015] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:15:11.856753] [INFO ] [REMOTE ] CSTM: Full fetch complete (69251 records). [2025-10-03T18:15:11.856870] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-03T18:15:11.993127] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-03T18:15:12.330781] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-03T18:15:12.330935] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-03T18:15:12.331723] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-03T18:15:12.331816] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-03T18:15:12.333393] [DEBUG] [LOCAL ] CSTM: Trimmed 69251 records to 48106 (keeping 200 days of data) [2025-10-03T18:15:12.635250] [DEBUG] [LOCAL ] CSTM: Primary data saved (48106 records). [2025-10-03T18:15:12.635432] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-03T18:15:12.635560] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CSTM took 53.9s. Estimated remaining: 4h 10m 60s. Rate: 7.3 symbols/min [2025-10-03T18:15:12.800066] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-03T18:15:12.848578] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:12.852766] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:15:12.915308] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-03T18:15:12.915680] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-10-03T18:15:13.122095] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:13.122348] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-03T18:15:13.122401] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-03T18:15:13.122768] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-03T18:15:13.122830] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-03T18:15:13.425781] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:15:13.487690] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:15:13.530420] [INFO ] [REMOTE ] CTDD: Full fetch complete (8402 records). [2025-10-03T18:15:13.545399] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-03T18:15:13.569434] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:13.570414] [FATAL] [VALIDATOR ] CTDD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:15:13.571022] [FATAL] [MAIN ] CTDD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:15:13.571112] [WARN ] [MAIN ] CTDD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:15:13.571187] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-03T18:15:13.571260] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-03T18:15:13.571299] [INFO ] [LOCAL ] CTDD: Starting deletion of derivative data. [2025-10-03T18:15:13.571587] [DEBUG] [LOCAL ] CTDD: Deleted derivative data file. [2025-10-03T18:15:13.571729] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTDD took 35.0s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-03T18:15:13.595785] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-03T18:15:13.766933] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:13.816921] [DEBUG] [LOCAL ] CTRE: Loaded 49617 existing records from primary storage. [2025-10-03T18:15:13.817277] [INFO ] [MAIN ] CTRE: Loaded 49617 existing records. [2025-10-03T18:15:14.007503] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:14.007753] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-03T18:15:14.007807] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-03T18:15:14.008065] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-03T18:15:14.008125] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-03T18:15:14.393877] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-03T18:15:14.417611] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:15.190680] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-03T18:15:15.672128] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:15:15.862501] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:15:15.990688] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-03T18:15:16.790715] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-03T18:15:17.304173] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:15:17.590691] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-03T18:15:18.206613] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:15:18.368765] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-03T18:15:18.390668] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-03T18:15:18.543840] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:15:19.190700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-03T18:15:19.847727] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:15:19.990683] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-03T18:15:20.788935] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:15:20.800897] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-03T18:15:21.590705] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-03T18:15:21.879752] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:15:21.917109] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:15:22.390671] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-03T18:15:22.805263] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:15:23.190694] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-03T18:15:23.952378] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:15:23.990698] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-03T18:15:24.790701] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-03T18:15:25.095913] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:15:25.313776] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:15:25.590705] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-03T18:15:26.011685] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:15:26.390691] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-03T18:15:27.190717] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-03T18:15:27.609293] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:15:27.645714] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T18:15:27.990736] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-03T18:15:28.791038] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-03T18:15:28.791879] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:15:28.795063] [INFO ] [REMOTE ] CTO: Full fetch complete (41788 records). [2025-10-03T18:15:28.795173] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-03T18:15:29.227404] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-03T18:15:29.227496] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-03T18:15:29.228095] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-03T18:15:29.228199] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-03T18:15:29.229495] [DEBUG] [LOCAL ] CTO: Trimmed 41788 records to 28288 (keeping 200 days of data) [2025-10-03T18:15:29.418734] [DEBUG] [LOCAL ] CTO: Primary data saved (28288 records). [2025-10-03T18:15:29.418892] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-03T18:15:29.419006] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTO took 30.3s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-03T18:15:29.626933] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-03T18:15:29.631738] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:29.682849] [DEBUG] [LOCAL ] CTRI: Loaded 39023 existing records from primary storage. [2025-10-03T18:15:29.683197] [INFO ] [MAIN ] CTRI: Loaded 39023 existing records. [2025-10-03T18:15:29.940954] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:29.941230] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-03T18:15:29.941406] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-03T18:15:29.941850] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-03T18:15:29.942185] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-03T18:15:29.944067] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:15:30.352548] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:30.371851] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:15:30.390615] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-03T18:15:31.190635] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-03T18:15:31.449286] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:15:31.863375] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:15:31.990720] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-03T18:15:32.790741] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-03T18:15:32.886509] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:15:33.590720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-03T18:15:33.886227] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:15:33.930295] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:15:34.390693] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-03T18:15:34.888223] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:15:35.190711] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-03T18:15:35.810890] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:15:35.990734] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-03T18:15:36.790636] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-03T18:15:37.343286] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T18:15:37.403114] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:15:37.590682] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-03T18:15:38.004313] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:15:38.390717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-03T18:15:39.190710] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-03T18:15:39.384793] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:15:39.990672] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-03T18:15:40.377396] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:15:40.414018] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:15:40.790700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-03T18:15:41.230565] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:15:41.590721] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-03T18:15:42.390702] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-03T18:15:42.522243] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T18:15:42.854827] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T18:15:42.857088] [INFO ] [REMOTE ] CTOS: Full fetch complete (53621 records). [2025-10-03T18:15:42.857188] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-03T18:15:43.195934] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-03T18:15:43.276867] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-03T18:15:43.276959] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-03T18:15:43.277713] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-03T18:15:43.277781] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-03T18:15:43.279149] [DEBUG] [LOCAL ] CTOS: Trimmed 53621 records to 37159 (keeping 200 days of data) [2025-10-03T18:15:43.508165] [DEBUG] [LOCAL ] CTOS: Primary data saved (37159 records). [2025-10-03T18:15:43.508321] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-03T18:15:43.508410] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTOS took 43.3s. Estimated remaining: 4h 10m 55s. Rate: 7.3 symbols/min [2025-10-03T18:15:43.711605] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:43.744098] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T18:15:43.759922] [DEBUG] [LOCAL ] CTS: Loaded 19508 existing records from primary storage. [2025-10-03T18:15:43.760230] [INFO ] [MAIN ] CTS: Loaded 19508 existing records. [2025-10-03T18:15:43.961089] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:43.961314] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-03T18:15:43.961367] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-03T18:15:43.961601] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-03T18:15:43.961691] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-03T18:15:43.995766] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-03T18:15:44.391828] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:44.790694] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-03T18:15:44.891544] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T18:15:44.894616] [INFO ] [REMOTE ] CTRA: Full fetch complete (77662 records). [2025-10-03T18:15:44.894842] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-03T18:15:45.324873] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-03T18:15:45.324962] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-03T18:15:45.325947] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-03T18:15:45.326020] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-03T18:15:45.327750] [DEBUG] [LOCAL ] CTRA: Trimmed 77662 records to 54427 (keeping 200 days of data) [2025-10-03T18:15:45.590686] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-03T18:15:45.709744] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:15:45.750115] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:15:45.768765] [DEBUG] [LOCAL ] CTRA: Primary data saved (54427 records). [2025-10-03T18:15:45.768939] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-03T18:15:45.769030] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRA took 33.1s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-03T18:15:45.952317] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:45.952510] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-03T18:15:45.952553] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-03T18:15:45.952695] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-03T18:15:45.952751] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-03T18:15:45.952798] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-03T18:15:45.952834] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-03T18:15:46.353502] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:46.390701] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-03T18:15:46.845076] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T18:15:47.190735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-03T18:15:47.662320] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:15:47.669431] [INFO ] [REMOTE ] CTRE: Full fetch complete (71215 records). [2025-10-03T18:15:47.669630] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-03T18:15:47.991838] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-03T18:15:48.095069] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-03T18:15:48.095161] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-03T18:15:48.096021] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-03T18:15:48.096091] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-03T18:15:48.097625] [DEBUG] [LOCAL ] CTRE: Trimmed 71215 records to 49988 (keeping 200 days of data) [2025-10-03T18:15:48.426728] [DEBUG] [LOCAL ] CTRE: Primary data saved (49988 records). [2025-10-03T18:15:48.426888] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-03T18:15:48.426991] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTRE took 34.9s. Estimated remaining: 4h 10m 1s. Rate: 7.3 symbols/min [2025-10-03T18:15:48.615932] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:48.616345] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-03T18:15:48.616427] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-03T18:15:48.633138] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-03T18:15:48.633226] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-03T18:15:48.633286] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-03T18:15:48.633325] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-03T18:15:48.720561] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T18:15:48.795769] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-03T18:15:49.071129] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:49.590726] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-03T18:15:49.764350] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T18:15:50.041346] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T18:15:50.055251] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T18:15:50.390677] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-03T18:15:51.190678] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-03T18:15:51.396217] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T18:15:51.990703] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-03T18:15:52.790695] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-03T18:15:52.911959] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:15:53.433059] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T18:15:53.461583] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:15:53.590703] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-03T18:15:54.390690] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-03T18:15:54.689910] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:15:55.190720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-03T18:15:55.817049] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:15:55.990718] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-03T18:15:56.585369] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:15:56.790701] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-03T18:15:57.126526] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:15:57.590725] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-03T18:15:57.902327] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:15:58.390686] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-03T18:15:59.170378] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:15:59.190712] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-03T18:15:59.994255] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-03T18:16:00.002363] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:16:00.373459] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T18:16:00.503918] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T18:16:00.790722] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-03T18:16:01.590755] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-03T18:16:02.390699] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-03T18:16:02.464718] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:16:03.073571] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-03T18:16:03.190725] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-03T18:16:03.990638] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-03T18:16:04.118797] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T18:16:04.207897] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:16:04.280140] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-03T18:16:04.790674] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-03T18:16:05.590718] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-03T18:16:05.932169] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T18:16:06.090578] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T18:16:06.092799] [INFO ] [REMOTE ] CTRI: Full fetch complete (51728 records). [2025-10-03T18:16:06.092960] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-03T18:16:06.093939] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:16:06.094109] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:06.094166] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:06.094217] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-03T18:16:06.094296] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-03T18:16:06.094371] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-03T18:16:06.094807] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-03T18:16:06.095624] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRI took 36.7s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-03T18:16:06.299042] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:06.381021] [DEBUG] [LOCAL ] CUBE: Loaded 51004 existing records from primary storage. [2025-10-03T18:16:06.381482] [INFO ] [MAIN ] CUBE: Loaded 51004 existing records. [2025-10-03T18:16:06.396131] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-03T18:16:06.605862] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:06.606134] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-03T18:16:06.606186] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-03T18:16:06.606593] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-03T18:16:06.606693] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-03T18:16:07.042624] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:07.190776] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-03T18:16:07.990682] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-03T18:16:08.252473] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-03T18:16:08.254902] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:16:08.790708] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-03T18:16:08.860792] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:16:09.590713] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-03T18:16:10.390722] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-03T18:16:10.821700] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T18:16:11.018276] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:16:11.190731] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-03T18:16:11.779103] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:16:11.990724] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-03T18:16:12.790716] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-03T18:16:13.111039] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T18:16:13.207525] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T18:16:13.590737] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-03T18:16:14.390637] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-03T18:16:14.459310] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T18:16:14.600020] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:16:15.190718] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-03T18:16:15.698173] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-03T18:16:15.990683] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-03T18:16:16.412321] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:16:16.764600] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:16:16.765903] [INFO ] [REMOTE ] CTS: Full fetch complete (26699 records). [2025-10-03T18:16:16.766047] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-03T18:16:16.766607] [FATAL] [VALIDATOR ] CTS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:16:16.766756] [FATAL] [MAIN ] CTS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:16.766839] [WARN ] [MAIN ] CTS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:16.766941] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-03T18:16:16.767069] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-03T18:16:16.767146] [INFO ] [LOCAL ] CTS: Starting deletion of derivative data. [2025-10-03T18:16:16.767422] [DEBUG] [LOCAL ] CTS: Deleted derivative data file. [2025-10-03T18:16:16.767583] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CTS took 33.3s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-03T18:16:16.795836] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-03T18:16:16.985371] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:17.016258] [DEBUG] [LOCAL ] CUBI: Loaded 27296 existing records from primary storage. [2025-10-03T18:16:17.016782] [INFO ] [MAIN ] CUBI: Loaded 27296 existing records. [2025-10-03T18:16:17.253302] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:17.253600] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-03T18:16:17.253691] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-03T18:16:17.253948] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-03T18:16:17.254006] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-03T18:16:17.595771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-03T18:16:17.639572] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:17.967889] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:16:18.390683] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-03T18:16:18.507518] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:16:18.510271] [INFO ] [REMOTE ] CTVA: Full fetch complete (76991 records). [2025-10-03T18:16:18.510396] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-03T18:16:18.811208] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T18:16:18.974485] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-03T18:16:18.974601] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-03T18:16:18.975889] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-03T18:16:18.975988] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-03T18:16:18.980715] [DEBUG] [LOCAL ] CTVA: Trimmed 76991 records to 54019 (keeping 200 days of data) [2025-10-03T18:16:19.194314] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-03T18:16:19.358713] [DEBUG] [LOCAL ] CTVA: Primary data saved (54019 records). [2025-10-03T18:16:19.358877] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-03T18:16:19.358959] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CTVA took 33.6s. Estimated remaining: 4h 9m 56s. Rate: 7.3 symbols/min [2025-10-03T18:16:19.583282] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:19.638665] [DEBUG] [LOCAL ] CUK: Loaded 51371 existing records from primary storage. [2025-10-03T18:16:19.639032] [INFO ] [MAIN ] CUK: Loaded 51371 existing records. [2025-10-03T18:16:19.870042] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:19.870318] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-03T18:16:19.870369] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-03T18:16:19.870759] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-03T18:16:19.870818] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-03T18:16:19.995725] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-03T18:16:20.327797] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:20.415066] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T18:16:20.790686] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-03T18:16:21.030546] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:16:21.031294] [INFO ] [REMOTE ] CUBB: Full fetch complete (925 records). [2025-10-03T18:16:21.031367] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-03T18:16:21.240266] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-03T18:16:21.240457] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:21.240526] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:21.240598] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-03T18:16:21.240693] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-03T18:16:21.240752] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-03T18:16:21.240799] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-03T18:16:21.240861] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBB took 32.8s. Estimated remaining: 4h 9m 27s. Rate: 7.3 symbols/min [2025-10-03T18:16:21.441078] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:21.448743] [DEBUG] [LOCAL ] CULP: Loaded 2954 existing records from primary storage. [2025-10-03T18:16:21.449035] [INFO ] [MAIN ] CULP: Loaded 2954 existing records. [2025-10-03T18:16:21.595854] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-03T18:16:21.662245] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:21.662449] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-03T18:16:21.662518] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-03T18:16:21.662723] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-03T18:16:21.662783] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-03T18:16:22.091101] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:16:22.172161] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:22.390715] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-03T18:16:23.102540] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T18:16:23.190639] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-03T18:16:23.462076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:16:23.923051] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:16:23.990735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-03T18:16:24.574877] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T18:16:24.790691] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-03T18:16:25.590763] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-03T18:16:26.390744] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-03T18:16:26.751070] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:16:26.811441] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T18:16:27.190696] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-03T18:16:27.990744] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-03T18:16:28.143161] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:16:28.581941] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:16:28.790683] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-03T18:16:29.590733] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-03T18:16:29.775179] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:16:29.868713] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:16:30.101092] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T18:16:30.390705] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-03T18:16:31.190727] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-03T18:16:31.990666] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-03T18:16:32.043851] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:16:32.338878] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T18:16:32.790708] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-03T18:16:33.099985] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T18:16:33.590725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-03T18:16:34.078881] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T18:16:34.390746] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-03T18:16:35.190740] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-03T18:16:35.519050] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:16:35.990675] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-03T18:16:36.230320] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:16:36.396461] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:16:36.790709] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-03T18:16:37.590694] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-03T18:16:38.071883] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:16:38.108859] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:16:38.390737] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-03T18:16:38.846178] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:16:39.190718] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-03T18:16:39.421016] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:16:39.423333] [INFO ] [REMOTE ] CUBI: Full fetch complete (39392 records). [2025-10-03T18:16:39.423499] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-03T18:16:39.880269] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T18:16:39.986676] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-03T18:16:39.986781] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-03T18:16:39.987894] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-03T18:16:39.987976] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-03T18:16:39.989189] [DEBUG] [LOCAL ] CUBI: Trimmed 39392 records to 27487 (keeping 200 days of data) [2025-10-03T18:16:39.990692] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-03T18:16:40.195514] [DEBUG] [LOCAL ] CUBI: Primary data saved (27487 records). [2025-10-03T18:16:40.195709] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-03T18:16:40.195919] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CUBI took 23.4s. Estimated remaining: 4h 9m 54s. Rate: 7.3 symbols/min [2025-10-03T18:16:40.443907] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:40.491781] [DEBUG] [LOCAL ] CURB: Loaded 32869 existing records from primary storage. [2025-10-03T18:16:40.492093] [INFO ] [MAIN ] CURB: Loaded 32869 existing records. [2025-10-03T18:16:40.598153] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:16:40.711331] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:40.711628] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-03T18:16:40.711718] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-03T18:16:40.711953] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-03T18:16:40.712014] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-03T18:16:40.795914] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-03T18:16:41.112007] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:41.590733] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-03T18:16:42.390689] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-03T18:16:42.496262] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:16:42.892987] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:16:43.190715] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-03T18:16:43.450424] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:16:43.990714] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-03T18:16:44.790687] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-03T18:16:44.928289] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:16:45.466008] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T18:16:45.590691] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-03T18:16:46.390692] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-03T18:16:46.583014] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T18:16:47.190720] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-03T18:16:47.386816] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:16:47.426226] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T18:16:47.990700] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-03T18:16:48.738012] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T18:16:48.790743] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-03T18:16:49.198332] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T18:16:49.314729] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:16:49.590720] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-03T18:16:50.390712] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-03T18:16:51.147324] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:16:51.154629] [INFO ] [REMOTE ] CUBE: Full fetch complete (73048 records). [2025-10-03T18:16:51.154861] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-03T18:16:51.199215] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-03T18:16:51.599996] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-03T18:16:51.600102] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-03T18:16:51.601176] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-03T18:16:51.601265] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-03T18:16:51.603257] [DEBUG] [LOCAL ] CUBE: Trimmed 73048 records to 51365 (keeping 200 days of data) [2025-10-03T18:16:51.958289] [DEBUG] [LOCAL ] CUBE: Primary data saved (51365 records). [2025-10-03T18:16:51.958491] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-03T18:16:51.959556] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CUBE took 45.9s. Estimated remaining: 4h 9m 57s. Rate: 7.3 symbols/min [2025-10-03T18:16:51.990697] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-03T18:16:52.119915] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T18:16:52.458293] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:16:52.658936] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:16:52.790725] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-03T18:16:53.391030] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:16:53.391785] [INFO ] [REMOTE ] CULP: Full fetch complete (4647 records). [2025-10-03T18:16:53.391856] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-03T18:16:53.601098] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-03T18:16:53.798201] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-03T18:16:53.798286] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-03T18:16:53.798511] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-03T18:16:53.798563] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-03T18:16:53.799025] [DEBUG] [LOCAL ] CULP: Trimmed 4647 records to 2970 (keeping 200 days of data) [2025-10-03T18:16:53.818032] [DEBUG] [LOCAL ] CULP: Primary data saved (2970 records). [2025-10-03T18:16:53.818198] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-03T18:16:53.818309] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CULP took 32.6s. Estimated remaining: 4h 9m 28s. Rate: 7.3 symbols/min [2025-10-03T18:16:54.390722] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-03T18:16:55.136383] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:16:55.190687] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-03T18:16:56.227034] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:16:56.238911] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-03T18:16:56.791073] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T18:16:56.799960] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-03T18:16:57.779183] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:16:57.782103] [INFO ] [REMOTE ] CUK: Full fetch complete (73987 records). [2025-10-03T18:16:57.782254] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-03T18:16:58.253017] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-03T18:16:58.253844] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-03T18:16:58.254713] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:16:58.255708] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-03T18:16:58.262699] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-03T18:16:58.263405] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-03T18:16:58.265384] [DEBUG] [LOCAL ] CUK: Trimmed 73987 records to 51758 (keeping 200 days of data) [2025-10-03T18:16:58.600356] [DEBUG] [LOCAL ] CUK: Primary data saved (51758 records). [2025-10-03T18:16:58.600512] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-03T18:16:58.600603] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CUK took 39.2s. Estimated remaining: 4h 9m 8s. Rate: 7.3 symbols/min [2025-10-03T18:16:59.529516] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:16:59.537781] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-03T18:17:01.178054] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:17:01.188267] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-03T18:17:02.511154] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:17:02.519882] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-03T18:17:03.819541] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:17:03.827620] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-03T18:17:04.995425] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:17:04.997531] [INFO ] [REMOTE ] CURB: Full fetch complete (47394 records). [2025-10-03T18:17:04.997636] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-03T18:17:05.458864] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-03T18:17:05.458979] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-03T18:17:05.459661] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-03T18:17:05.459728] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-03T18:17:05.461122] [DEBUG] [LOCAL ] CURB: Trimmed 47394 records to 33201 (keeping 200 days of data) [2025-10-03T18:17:05.754680] [DEBUG] [LOCAL ] CURB: Primary data saved (33201 records). [2025-10-03T18:17:05.754850] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-03T18:17:05.754943] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 25.6s. Estimated remaining: 4h 8m 56s. Rate: 7.3 symbols/min [2025-10-03T18:17:06.669144] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.831250] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.807287] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.831856] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-03T18:17:06.833182] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.833876] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-03T18:17:06.833785] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-03T18:17:06.834061] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-03T18:17:06.834135] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-03T18:17:06.834226] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-03T18:17:06.834342] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-03T18:17:06.834292] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-03T18:17:06.850816] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-03T18:17:06.872583] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-03T18:17:06.916892] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-03T18:17:06.929264] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-03T18:17:07.014459] [DEBUG] [LOCAL ] CVEO: Loaded 15211 existing records from primary storage. [2025-10-03T18:17:07.054763] [INFO ] [MAIN ] CVEO: Loaded 15211 existing records. [2025-10-03T18:17:07.383555] [DEBUG] [LOCAL ] CUZ: Loaded 49712 existing records from primary storage. [2025-10-03T18:17:07.428538] [INFO ] [MAIN ] CUZ: Loaded 49712 existing records. [2025-10-03T18:17:07.876818] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:07.916207] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-03T18:17:07.946605] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-03T18:17:08.081429] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-03T18:17:08.168190] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:08.172601] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-03T18:17:08.192046] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:08.172763] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-03T18:17:08.212251] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:08.203068] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-03T18:17:08.229857] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-03T18:17:08.229573] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-03T18:17:08.256703] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-03T18:17:08.302072] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-03T18:17:09.042431] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:09.048026] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-03T18:17:09.118922] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:09.119306] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-03T18:17:09.921448] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:17:09.930480] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-03T18:17:10.180053] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:17:10.180811] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:17:10.195285] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-03T18:17:10.194745] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-03T18:17:10.852355] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:17:10.862987] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-03T18:17:10.890070] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T18:17:10.892422] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-03T18:17:11.049035] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:17:11.055387] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-03T18:17:11.742561] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T18:17:11.745789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-03T18:17:12.137476] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T18:17:12.150151] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-03T18:17:12.167740] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:17:12.173933] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-03T18:17:12.236120] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:17:12.247147] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-03T18:17:12.831052] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:17:12.835197] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-03T18:17:13.308534] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:17:13.409604] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T18:17:13.590625] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-03T18:17:13.634732] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:17:13.779237] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T18:17:14.390704] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-03T18:17:15.190666] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-03T18:17:15.378353] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:17:15.430433] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:17:15.990708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-03T18:17:16.790680] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-03T18:17:17.183350] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T18:17:17.184512] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:17:17.590710] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-03T18:17:18.390733] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-03T18:17:18.488479] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:17:18.653432] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:17:19.174890] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T18:17:19.190610] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-03T18:17:19.990734] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-03T18:17:20.595168] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:17:20.790732] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-03T18:17:21.590704] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-03T18:17:21.886051] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T18:17:22.390727] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-03T18:17:22.650346] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:17:22.938175] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T18:17:23.190708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-03T18:17:23.598769] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T18:17:23.990723] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-03T18:17:24.628693] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:17:24.790700] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-03T18:17:25.472387] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:17:25.590716] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-03T18:17:25.695829] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T18:17:26.390720] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-03T18:17:27.190721] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-03T18:17:27.464152] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:17:27.990667] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-03T18:17:28.062834] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:17:28.601698] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T18:17:28.790719] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-03T18:17:29.590733] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-03T18:17:29.808048] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:17:30.014114] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:17:30.016246] [INFO ] [REMOTE ] CURV: Full fetch complete (38939 records). [2025-10-03T18:17:30.016450] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-03T18:17:30.403246] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-03T18:17:30.435285] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-03T18:17:30.436277] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-03T18:17:30.437016] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-03T18:17:30.437226] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-03T18:17:30.438416] [DEBUG] [LOCAL ] CURV: Trimmed 38939 records to 27147 (keeping 200 days of data) [2025-10-03T18:17:30.599956] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:17:30.616366] [DEBUG] [LOCAL ] CURV: Primary data saved (27147 records). [2025-10-03T18:17:30.616503] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-03T18:17:30.616595] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CURV took 24.9s. Estimated remaining: 4h 9m 42s. Rate: 7.2 symbols/min [2025-10-03T18:17:30.796516] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:30.796824] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-03T18:17:30.796883] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-03T18:17:30.797003] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-03T18:17:30.797047] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-03T18:17:30.797119] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-03T18:17:30.797165] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-03T18:17:31.188762] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:31.190633] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-03T18:17:31.990631] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-03T18:17:32.190833] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:17:32.790674] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-03T18:17:32.994185] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:17:33.590737] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-03T18:17:33.939525] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T18:17:34.390684] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-03T18:17:34.477359] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:17:34.478671] [INFO ] [REMOTE ] CVEO: Full fetch complete (20361 records). [2025-10-03T18:17:34.478757] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-03T18:17:34.816349] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T18:17:34.954444] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-03T18:17:34.954523] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-03T18:17:34.954900] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-03T18:17:34.954967] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-03T18:17:34.955609] [DEBUG] [LOCAL ] CVEO: Trimmed 20361 records to 15333 (keeping 200 days of data) [2025-10-03T18:17:35.047272] [DEBUG] [LOCAL ] CVEO: Primary data saved (15333 records). [2025-10-03T18:17:35.047420] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-03T18:17:35.047521] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CVEO took 29.3s. Estimated remaining: 4h 9m 21s. Rate: 7.3 symbols/min [2025-10-03T18:17:35.195836] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-03T18:17:35.248810] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:35.249091] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-03T18:17:35.249147] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-03T18:17:35.249239] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-03T18:17:35.249281] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-03T18:17:35.249331] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-03T18:17:35.249372] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-03T18:17:35.654762] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:35.990718] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-03T18:17:36.271201] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:17:36.548690] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T18:17:36.790636] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-03T18:17:36.867369] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:17:37.590715] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-03T18:17:38.390728] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-03T18:17:38.463912] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T18:17:38.572059] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:17:39.190712] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-03T18:17:39.867320] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:17:39.870348] [INFO ] [REMOTE ] CUZ: Full fetch complete (70794 records). [2025-10-03T18:17:39.870496] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-03T18:17:39.995737] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-03T18:17:40.004289] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T18:17:40.327482] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-03T18:17:40.327597] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-03T18:17:40.328475] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-03T18:17:40.328540] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-03T18:17:40.330134] [DEBUG] [LOCAL ] CUZ: Trimmed 70794 records to 50071 (keeping 200 days of data) [2025-10-03T18:17:40.659087] [DEBUG] [LOCAL ] CUZ: Primary data saved (50071 records). [2025-10-03T18:17:40.659247] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-03T18:17:40.659363] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CUZ took 34.9s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-03T18:17:40.793981] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-03T18:17:40.871391] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:40.929436] [DEBUG] [LOCAL ] CVNA: Loaded 53343 existing records from primary storage. [2025-10-03T18:17:40.929861] [INFO ] [MAIN ] CVNA: Loaded 53343 existing records. [2025-10-03T18:17:41.132232] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:41.132517] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-03T18:17:41.132567] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-03T18:17:41.132998] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-03T18:17:41.133061] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-03T18:17:41.549256] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:41.590694] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-03T18:17:41.657674] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T18:17:41.660313] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-03T18:17:41.660440] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-03T18:17:41.795311] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:17:42.105700] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-03T18:17:42.105817] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-03T18:17:42.106932] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-03T18:17:42.107003] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-03T18:17:42.109120] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 54336 (keeping 200 days of data) [2025-10-03T18:17:42.406998] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-03T18:17:42.468313] [DEBUG] [LOCAL ] CVE: Primary data saved (54336 records). [2025-10-03T18:17:42.468561] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-03T18:17:42.468718] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CVE took 36.7s. Estimated remaining: 4h 8m 35s. Rate: 7.3 symbols/min [2025-10-03T18:17:42.667059] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:42.725621] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-10-03T18:17:42.726142] [INFO ] [MAIN ] CVS: Loaded 54086 existing records. [2025-10-03T18:17:42.910000] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:42.910300] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-03T18:17:42.910351] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-03T18:17:42.910718] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-03T18:17:42.910778] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-03T18:17:43.196617] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-03T18:17:43.280538] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:43.713390] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T18:17:43.990690] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-03T18:17:44.017886] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:17:44.397933] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T18:17:44.790733] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-03T18:17:45.590708] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-03T18:17:45.751740] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:17:46.390733] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-03T18:17:46.485304] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T18:17:47.190744] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-03T18:17:47.248070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:17:47.509775] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T18:17:47.990696] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-03T18:17:48.790626] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-03T18:17:49.282826] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-03T18:17:49.590743] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-03T18:17:49.785465] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T18:17:50.146911] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-03T18:17:50.390730] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-03T18:17:51.055625] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T18:17:51.190731] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-03T18:17:51.990664] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-03T18:17:52.406242] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:17:52.543008] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T18:17:52.790737] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-03T18:17:53.590741] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-03T18:17:54.390747] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-03T18:17:55.174575] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-10-03T18:17:55.190617] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-03T18:17:55.315525] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:17:55.990686] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-03T18:17:56.601939] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:17:56.779079] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:17:56.780544] [INFO ] [REMOTE ] CVLG: Full fetch complete (21059 records). [2025-10-03T18:17:56.780621] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-03T18:17:56.794971] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-03T18:17:57.204278] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-03T18:17:57.231917] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-03T18:17:57.236011] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-03T18:17:57.236173] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-03T18:17:57.239149] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (4.45 seconds). [2025-10-03T18:17:57.239443] [DEBUG] [LOCAL ] CVLG: Trimmed 21059 records to 15666 (keeping 200 days of data) [2025-10-03T18:17:57.368200] [DEBUG] [LOCAL ] CVLG: Primary data saved (15666 records). [2025-10-03T18:17:57.368363] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-03T18:17:57.368463] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 22.3s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-03T18:17:57.557533] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:57.590722] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-03T18:17:57.635630] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-03T18:17:57.636074] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-03T18:17:57.855196] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:57.855506] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-03T18:17:57.855566] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-03T18:17:57.856344] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-03T18:17:57.856413] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-03T18:17:58.337310] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:58.390746] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-03T18:17:58.581892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:17:58.707345] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (5.12 seconds). [2025-10-03T18:17:59.190741] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-03T18:17:59.771453] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T18:17:59.990718] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-03T18:18:00.734161] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T18:18:00.790729] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-03T18:18:01.502952] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-03T18:18:01.590737] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-03T18:18:02.396982] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-03T18:18:02.404441] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T18:18:03.188080] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-03T18:18:03.198567] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-03T18:18:03.990696] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-03T18:18:04.203255] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T18:18:04.246375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:18:04.790745] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-03T18:18:05.052575] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:18:05.590724] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-03T18:18:06.223323] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-03T18:18:06.390692] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-03T18:18:06.537336] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:18:07.190752] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-03T18:18:07.990707] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-03T18:18:08.129047] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-03T18:18:08.694189] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-03T18:18:08.790726] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-03T18:18:08.986567] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:18:09.590730] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-03T18:18:10.225625] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:18:10.390703] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-03T18:18:11.135820] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:18:11.138237] [INFO ] [REMOTE ] CVI: Full fetch complete (67352 records). [2025-10-03T18:18:11.138337] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-03T18:18:11.201688] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-03T18:18:11.336588] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-03T18:18:11.648763] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-03T18:18:11.648869] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-03T18:18:11.649619] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-03T18:18:11.649699] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-03T18:18:11.651307] [DEBUG] [LOCAL ] CVI: Trimmed 67352 records to 47178 (keeping 200 days of data) [2025-10-03T18:18:11.957606] [DEBUG] [LOCAL ] CVI: Primary data saved (47178 records). [2025-10-03T18:18:11.957788] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-03T18:18:11.957890] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 41.3s. Estimated remaining: 4h 9m 0s. Rate: 7.2 symbols/min [2025-10-03T18:18:11.994004] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-03T18:18:12.155036] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:12.182271] [DEBUG] [LOCAL ] CW: Loaded 22388 existing records from primary storage. [2025-10-03T18:18:12.182763] [INFO ] [MAIN ] CW: Loaded 22388 existing records. [2025-10-03T18:18:12.398663] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:12.399109] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-03T18:18:12.399201] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-03T18:18:12.399674] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-03T18:18:12.399750] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-03T18:18:12.809056] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:12.810977] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-03T18:18:12.822473] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-03T18:18:13.559417] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T18:18:13.590628] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-03T18:18:14.119944] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:18:14.310178] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-03T18:18:14.390681] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-03T18:18:15.190687] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-03T18:18:15.621494] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:18:15.662589] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T18:18:15.990725] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-03T18:18:16.790740] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-03T18:18:17.301474] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T18:18:17.591898] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-03T18:18:17.600215] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-03T18:18:18.390677] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-03T18:18:18.853210] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:18:19.190715] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-03T18:18:19.990751] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-03T18:18:20.075522] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T18:18:20.075837] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:18:20.090389] [INFO ] [REMOTE ] CVNA: Full fetch complete (76656 records). [2025-10-03T18:18:20.091104] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-03T18:18:20.568697] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-03T18:18:20.569278] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T18:18:20.569493] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-03T18:18:20.570711] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-03T18:18:20.576208] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-03T18:18:20.578304] [DEBUG] [LOCAL ] CVNA: Trimmed 76656 records to 53720 (keeping 200 days of data) [2025-10-03T18:18:20.801087] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-03T18:18:20.934506] [DEBUG] [LOCAL ] CVNA: Primary data saved (53720 records). [2025-10-03T18:18:20.934896] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-03T18:18:20.935015] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVNA took 40.3s. Estimated remaining: 4h 8m 54s. Rate: 7.2 symbols/min [2025-10-03T18:18:21.116319] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:21.116513] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-03T18:18:21.116553] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-03T18:18:21.116774] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-03T18:18:21.116817] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-03T18:18:21.116935] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-03T18:18:21.116991] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-03T18:18:21.509998] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:21.590702] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-03T18:18:21.617808] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:18:21.620065] [INFO ] [REMOTE ] CVS: Full fetch complete (77423 records). [2025-10-03T18:18:21.620189] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-03T18:18:21.621092] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:18:21.621190] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:18:21.621235] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:18:21.621306] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-03T18:18:21.621373] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-10-03T18:18:21.621411] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-10-03T18:18:21.621819] [DEBUG] [LOCAL ] CVS: Deleted derivative data file. [2025-10-03T18:18:21.621937] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVS took 39.2s. Estimated remaining: 4h 8m 22s. Rate: 7.3 symbols/min [2025-10-03T18:18:21.811003] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:21.867130] [DEBUG] [LOCAL ] CWEN: Loaded 45415 existing records from primary storage. [2025-10-03T18:18:21.867464] [INFO ] [MAIN ] CWEN: Loaded 45415 existing records. [2025-10-03T18:18:22.059846] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:22.060167] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-03T18:18:22.060325] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-03T18:18:22.066524] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-03T18:18:22.074579] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-03T18:18:22.081173] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T18:18:22.395784] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-03T18:18:22.513262] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:23.190715] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-03T18:18:23.916902] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-03T18:18:23.987026] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:18:23.997673] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-03T18:18:24.520150] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:18:24.790725] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-03T18:18:25.590731] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-03T18:18:26.298446] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T18:18:26.390706] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-03T18:18:26.480159] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:18:26.701003] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:18:27.190752] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-03T18:18:27.990778] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-03T18:18:28.552088] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T18:18:28.783338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:18:28.797191] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-03T18:18:29.250088] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:18:29.590727] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-03T18:18:30.390781] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-03T18:18:31.176111] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:18:31.185915] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-03T18:18:31.190368] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-03T18:18:31.190617] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-03T18:18:31.190557] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-03T18:18:31.678545] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-03T18:18:31.678724] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-03T18:18:31.679846] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-03T18:18:31.679923] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-03T18:18:31.682506] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-10-03T18:18:31.995050] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-03T18:18:32.150020] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-10-03T18:18:32.151117] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-03T18:18:32.152169] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T18:18:32.153848] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CVX took 34.8s. Estimated remaining: 4h 8m 21s. Rate: 7.3 symbols/min [2025-10-03T18:18:32.358878] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:32.423622] [DEBUG] [LOCAL ] CWH: Loaded 51715 existing records from primary storage. [2025-10-03T18:18:32.424079] [INFO ] [MAIN ] CWH: Loaded 51715 existing records. [2025-10-03T18:18:32.602222] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:32.602520] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-03T18:18:32.602574] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-03T18:18:32.604333] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-03T18:18:32.604396] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-03T18:18:32.809541] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-03T18:18:32.999131] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:33.035098] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:18:33.150614] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T18:18:33.590755] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-03T18:18:34.390746] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-03T18:18:34.594693] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:18:35.190625] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-03T18:18:35.367166] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T18:18:35.990688] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-03T18:18:36.152599] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:18:36.769529] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:18:36.790620] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-03T18:18:37.365299] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:18:37.590713] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-03T18:18:38.390729] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-03T18:18:38.531806] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:18:38.863287] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T18:18:39.190719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-03T18:18:39.962936] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:18:39.990624] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-03T18:18:40.428970] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:18:40.790720] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-03T18:18:41.591244] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-03T18:18:41.594470] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:18:41.950232] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:18:42.390668] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-03T18:18:43.197590] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-03T18:18:43.205880] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:18:43.990758] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-03T18:18:44.080973] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:18:44.790663] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-03T18:18:44.980052] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:18:45.360196] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:18:45.590724] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-03T18:18:45.691433] [DEBUG] [REMOTE ] CWEN: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T18:18:45.691886] [WARN ] [REMOTE ] CWEN: No data returned for month 2025-09 [2025-10-03T18:18:45.692001] [FATAL] [REMOTE ] CWEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:18:45.692112] [FATAL] [MAIN ] CWEN: Failed to fetch primary data. [2025-10-03T18:18:45.692191] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:18:45.692337] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-03T18:18:45.692473] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-03T18:18:45.692551] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-03T18:18:45.692875] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-03T18:18:45.693055] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CWEN took 24.1s. Estimated remaining: 4h 8m 29s. Rate: 7.2 symbols/min [2025-10-03T18:18:45.887189] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:45.946170] [DEBUG] [LOCAL ] CWK: Loaded 49782 existing records from primary storage. [2025-10-03T18:18:45.946551] [INFO ] [MAIN ] CWK: Loaded 49782 existing records. [2025-10-03T18:18:46.066712] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:18:46.079544] [INFO ] [REMOTE ] CW: Full fetch complete (33202 records). [2025-10-03T18:18:46.090102] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-03T18:18:46.123505] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:18:46.155287] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:46.155593] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:18:46.155930] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-03T18:18:46.156020] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-03T18:18:46.156106] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:18:46.156257] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-03T18:18:46.156341] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-03T18:18:46.156381] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-10-03T18:18:46.156561] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-10-03T18:18:46.156744] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CW took 34.2s. Estimated remaining: 4h 7m 56s. Rate: 7.3 symbols/min [2025-10-03T18:18:46.162176] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-03T18:18:46.195781] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-03T18:18:46.399677] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-03T18:18:46.573923] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:46.807521] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:46.823874] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-03T18:18:46.824251] [INFO ] [MAIN ] CWT: Loaded 28121 existing records. [2025-10-03T18:18:47.015973] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:47.016185] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-03T18:18:47.016234] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-03T18:18:47.016479] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-03T18:18:47.016540] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-03T18:18:47.195526] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-03T18:18:47.399704] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:47.990674] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-03T18:18:48.380932] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:18:48.790727] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-03T18:18:48.916382] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:18:49.590680] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-03T18:18:49.810744] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:18:50.390635] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-03T18:18:50.492925] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:18:51.116692] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:18:51.190738] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-03T18:18:51.760058] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:18:51.990697] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-03T18:18:52.790680] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-03T18:18:52.831290] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:18:53.579503] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:18:53.590619] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-03T18:18:54.075380] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:18:54.390736] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-03T18:18:55.190511] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:18:55.190788] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-03T18:18:55.990627] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-03T18:18:56.284387] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:18:56.423873] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T18:18:56.790691] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-03T18:18:57.563035] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:18:57.590693] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-03T18:18:58.390724] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-03T18:18:58.575483] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:18:59.190627] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-03T18:18:59.356087] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:18:59.990717] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-03T18:19:00.212476] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:19:00.790692] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-03T18:19:00.917671] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:19:00.921892] [INFO ] [REMOTE ] CWAN: Full fetch complete (75154 records). [2025-10-03T18:19:00.922027] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-03T18:19:01.345944] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-03T18:19:01.346053] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-03T18:19:01.347143] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-03T18:19:01.347217] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-03T18:19:01.348946] [DEBUG] [LOCAL ] CWAN: Trimmed 75154 records to 53184 (keeping 200 days of data) [2025-10-03T18:19:01.590869] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-03T18:19:01.687052] [DEBUG] [LOCAL ] CWAN: Primary data saved (53184 records). [2025-10-03T18:19:01.687198] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-03T18:19:01.687295] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 40.8s. Estimated remaining: 4h 8m 11s. Rate: 7.2 symbols/min [2025-10-03T18:19:01.918034] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:01.923293] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:19:01.998179] [DEBUG] [LOCAL ] CX: Loaded 53213 existing records from primary storage. [2025-10-03T18:19:01.998782] [INFO ] [MAIN ] CX: Loaded 53213 existing records. [2025-10-03T18:19:02.225849] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:02.226152] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-03T18:19:02.226281] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-03T18:19:02.226872] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-03T18:19:02.226933] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-03T18:19:02.410797] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-03T18:19:02.618438] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:03.049613] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T18:19:03.190693] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-03T18:19:03.332931] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:19:03.992157] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-03T18:19:03.994976] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:19:04.621091] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:19:04.623994] [INFO ] [REMOTE ] CWH: Full fetch complete (72989 records). [2025-10-03T18:19:04.624190] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-03T18:19:04.797992] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-03T18:19:05.062493] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-03T18:19:05.062614] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-03T18:19:05.063922] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-03T18:19:05.064010] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-03T18:19:05.065862] [DEBUG] [LOCAL ] CWH: Trimmed 72989 records to 52068 (keeping 200 days of data) [2025-10-03T18:19:05.223698] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:19:05.431592] [DEBUG] [LOCAL ] CWH: Primary data saved (52068 records). [2025-10-03T18:19:05.431779] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-03T18:19:05.432452] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 33.3s. Estimated remaining: 4h 7m 48s. Rate: 7.3 symbols/min [2025-10-03T18:19:05.591246] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-03T18:19:05.614671] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:05.626415] [DEBUG] [LOCAL ] CXE: Loaded 6615 existing records from primary storage. [2025-10-03T18:19:05.626872] [INFO ] [MAIN ] CXE: Loaded 6615 existing records. [2025-10-03T18:19:05.822030] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:05.822291] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-03T18:19:05.822348] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-03T18:19:05.822549] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-03T18:19:05.822621] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-03T18:19:06.203543] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:06.390702] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-03T18:19:06.687503] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:19:07.190671] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-03T18:19:07.300715] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:19:07.337947] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:19:07.990699] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-03T18:19:08.788190] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:19:08.798727] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-03T18:19:08.831820] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:19:09.590706] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-03T18:19:09.998748] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T18:19:10.390714] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-03T18:19:11.190769] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-03T18:19:11.325022] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:19:11.990704] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-03T18:19:12.125923] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:19:12.586930] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:19:12.790746] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-03T18:19:13.527391] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:19:13.590697] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-03T18:19:13.744993] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T18:19:14.390704] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-03T18:19:15.190738] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-03T18:19:15.275549] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T18:19:15.969034] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:19:15.990633] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-03T18:19:16.067057] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:19:16.790639] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-03T18:19:16.999388] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:19:17.546089] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:19:17.590695] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-03T18:19:18.390684] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-03T18:19:19.073607] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:19:19.076222] [INFO ] [REMOTE ] CWK: Full fetch complete (71028 records). [2025-10-03T18:19:19.076369] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-03T18:19:19.135691] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T18:19:19.195741] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-03T18:19:19.567360] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-03T18:19:19.567469] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-03T18:19:19.568453] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-03T18:19:19.568526] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-03T18:19:19.573186] [DEBUG] [LOCAL ] CWK: Trimmed 71028 records to 50148 (keeping 200 days of data) [2025-10-03T18:19:19.892926] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T18:19:19.903823] [DEBUG] [LOCAL ] CWK: Primary data saved (50148 records). [2025-10-03T18:19:19.904348] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-03T18:19:19.904497] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 34.2s. Estimated remaining: 4h 7m 59s. Rate: 7.2 symbols/min [2025-10-03T18:19:19.996027] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-03T18:19:20.096532] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:20.103998] [DEBUG] [LOCAL ] CXH: Loaded 4422 existing records from primary storage. [2025-10-03T18:19:20.104226] [INFO ] [MAIN ] CXH: Loaded 4422 existing records. [2025-10-03T18:19:20.297892] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:20.298183] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-03T18:19:20.298247] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-03T18:19:20.298414] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-03T18:19:20.298474] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-03T18:19:20.719489] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:20.790764] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-03T18:19:21.226024] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:19:21.273165] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T18:19:21.590687] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-03T18:19:22.045717] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T18:19:22.390752] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-03T18:19:23.190746] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-03T18:19:23.353397] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T18:19:23.355215] [INFO ] [REMOTE ] CWT: Full fetch complete (40371 records). [2025-10-03T18:19:23.355324] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-03T18:19:23.357023] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:19:23.357116] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:19:23.357160] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:19:23.357225] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-03T18:19:23.357318] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-03T18:19:23.357374] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-03T18:19:23.357684] [DEBUG] [LOCAL ] CWT: Deleted derivative data file. [2025-10-03T18:19:23.357817] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CWT took 37.2s. Estimated remaining: 4h 7m 36s. Rate: 7.2 symbols/min [2025-10-03T18:19:23.530847] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:23.580574] [DEBUG] [LOCAL ] CXM: Loaded 47964 existing records from primary storage. [2025-10-03T18:19:23.581022] [INFO ] [MAIN ] CXM: Loaded 47964 existing records. [2025-10-03T18:19:23.682559] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:19:23.808172] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:23.808537] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-03T18:19:23.808634] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-03T18:19:23.808978] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-03T18:19:23.809038] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-03T18:19:23.990770] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-03T18:19:24.224807] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:24.748448] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:19:24.790708] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-03T18:19:25.590716] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-03T18:19:26.390696] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-03T18:19:26.790026] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:19:27.000853] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T18:19:27.190632] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-03T18:19:27.309930] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:19:27.990727] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-03T18:19:28.790692] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-03T18:19:28.873513] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:19:28.926540] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:19:29.590710] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-03T18:19:30.018141] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T18:19:30.390749] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-03T18:19:30.623318] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:19:31.190729] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-03T18:19:31.777541] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:19:31.990710] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-03T18:19:32.214324] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:19:32.790730] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-03T18:19:33.509233] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T18:19:33.590633] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-03T18:19:34.344494] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T18:19:34.390672] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-03T18:19:34.641226] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:19:34.957884] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:19:35.190729] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-03T18:19:35.841746] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:19:35.843154] [INFO ] [REMOTE ] CXE: Full fetch complete (11766 records). [2025-10-03T18:19:35.843250] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-03T18:19:36.001049] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-03T18:19:36.236090] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-03T18:19:36.236176] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-03T18:19:36.236439] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-03T18:19:36.236481] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-03T18:19:36.237069] [DEBUG] [LOCAL ] CXE: Trimmed 11766 records to 6646 (keeping 200 days of data) [2025-10-03T18:19:36.276291] [DEBUG] [LOCAL ] CXE: Primary data saved (6646 records). [2025-10-03T18:19:36.276421] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-03T18:19:36.276519] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CXE took 30.8s. Estimated remaining: 4h 7m 42s. Rate: 7.2 symbols/min [2025-10-03T18:19:36.517361] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:36.517885] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-10-03T18:19:36.517998] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-10-03T18:19:36.518162] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-03T18:19:36.518220] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-03T18:19:36.518271] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-03T18:19:36.518305] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-03T18:19:36.795235] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-03T18:19:36.886044] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:19:36.927072] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:37.590761] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-03T18:19:38.394045] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-03T18:19:38.400448] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:19:38.931483] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:19:39.190715] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-03T18:19:39.990702] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-03T18:19:40.431687] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T18:19:40.784568] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:19:40.790612] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-03T18:19:40.827662] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:19:41.374252] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T18:19:41.590681] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-03T18:19:42.386053] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T18:19:42.386832] [INFO ] [REMOTE ] CXH: Full fetch complete (5454 records). [2025-10-03T18:19:42.386906] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-03T18:19:42.398584] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-03T18:19:42.816956] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-03T18:19:42.817047] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-03T18:19:42.817214] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-03T18:19:42.817253] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-03T18:19:42.817685] [DEBUG] [LOCAL ] CXH: Trimmed 5454 records to 4450 (keeping 200 days of data) [2025-10-03T18:19:42.843340] [DEBUG] [LOCAL ] CXH: Primary data saved (4450 records). [2025-10-03T18:19:42.843464] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-03T18:19:42.843560] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXH took 22.9s. Estimated remaining: 4h 7m 28s. Rate: 7.2 symbols/min [2025-10-03T18:19:43.046243] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:43.087899] [DEBUG] [LOCAL ] CXW: Loaded 44355 existing records from primary storage. [2025-10-03T18:19:43.088236] [INFO ] [MAIN ] CXW: Loaded 44355 existing records. [2025-10-03T18:19:43.199633] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-03T18:19:43.288032] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:43.288261] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-03T18:19:43.288329] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-03T18:19:43.288709] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-03T18:19:43.288811] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-03T18:19:43.688383] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:43.990713] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-03T18:19:44.067899] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:19:44.790684] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-03T18:19:45.006843] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:19:45.071849] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:19:45.590720] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-03T18:19:46.390692] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-03T18:19:46.464405] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:19:47.190699] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-03T18:19:47.318013] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:19:47.738957] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:19:47.742081] [INFO ] [REMOTE ] CX: Full fetch complete (76385 records). [2025-10-03T18:19:47.742232] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-03T18:19:47.995896] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-03T18:19:48.174878] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-03T18:19:48.174969] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-03T18:19:48.175912] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-03T18:19:48.175989] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-03T18:19:48.177706] [DEBUG] [LOCAL ] CX: Trimmed 76385 records to 53593 (keeping 200 days of data) [2025-10-03T18:19:48.527591] [DEBUG] [LOCAL ] CX: Primary data saved (53593 records). [2025-10-03T18:19:48.527811] [INFO ] [MAIN ] CX: Full history saved. [2025-10-03T18:19:48.528064] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CX took 46.8s. Estimated remaining: 4h 7m 12s. Rate: 7.2 symbols/min [2025-10-03T18:19:48.668441] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:19:48.744288] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:48.775406] [DEBUG] [LOCAL ] CYD: Loaded 26748 existing records from primary storage. [2025-10-03T18:19:48.775734] [INFO ] [MAIN ] CYD: Loaded 26748 existing records. [2025-10-03T18:19:48.797785] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-03T18:19:48.968342] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:48.968559] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-03T18:19:48.968639] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-03T18:19:48.968980] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-03T18:19:48.969041] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-03T18:19:49.367729] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:49.590704] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-03T18:19:49.701149] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:19:50.390997] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-03T18:19:50.499985] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:19:51.134852] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:19:51.194513] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:19:51.193724] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-03T18:19:51.990728] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-03T18:19:52.456889] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:19:52.746442] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:19:52.790678] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-03T18:19:53.590690] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-03T18:19:54.013770] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:19:54.390768] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-03T18:19:54.604312] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T18:19:55.190684] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-03T18:19:55.990703] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-03T18:19:56.218563] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:19:56.686445] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:19:56.790742] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-03T18:19:57.545765] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:19:57.590624] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-03T18:19:58.126766] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:19:58.390744] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-03T18:19:58.998890] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:19:59.001609] [INFO ] [REMOTE ] CXM: Full fetch complete (68729 records). [2025-10-03T18:19:59.001762] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-03T18:19:59.196215] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-03T18:19:59.443883] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-03T18:19:59.443977] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-03T18:19:59.444791] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-03T18:19:59.444857] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-03T18:19:59.446353] [DEBUG] [LOCAL ] CXM: Trimmed 68729 records to 48291 (keeping 200 days of data) [2025-10-03T18:19:59.761240] [DEBUG] [LOCAL ] CXM: Primary data saved (48291 records). [2025-10-03T18:19:59.761371] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-03T18:19:59.763222] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXM took 36.4s. Estimated remaining: 4h 7m 13s. Rate: 7.2 symbols/min [2025-10-03T18:19:59.895490] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:19:59.974422] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:59.999982] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-03T18:20:00.022441] [DEBUG] [LOCAL ] CYH: Loaded 47856 existing records from primary storage. [2025-10-03T18:20:00.022831] [INFO ] [MAIN ] CYH: Loaded 47856 existing records. [2025-10-03T18:20:00.233440] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:00.233683] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-03T18:20:00.233744] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-03T18:20:00.234007] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-03T18:20:00.234098] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-03T18:20:00.638017] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:00.790723] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-03T18:20:01.335332] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T18:20:01.590906] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-03T18:20:01.765810] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:20:02.390710] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-03T18:20:02.504160] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:20:03.190699] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-03T18:20:03.745481] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-03T18:20:03.990672] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-03T18:20:04.100554] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T18:20:04.238805] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:20:04.790716] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-03T18:20:05.590699] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-03T18:20:05.639573] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:20:05.742261] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T18:20:06.390710] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-03T18:20:06.650552] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T18:20:07.190702] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-03T18:20:07.561676] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:20:07.564739] [INFO ] [REMOTE ] CXT: Full fetch complete (45537 records). [2025-10-03T18:20:07.564928] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-03T18:20:07.983220] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-03T18:20:07.983301] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-03T18:20:07.983976] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-03T18:20:07.984043] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-03T18:20:07.985186] [DEBUG] [LOCAL ] CXT: Trimmed 45537 records to 31460 (keeping 200 days of data) [2025-10-03T18:20:08.043193] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-03T18:20:08.197698] [DEBUG] [LOCAL ] CXT: Primary data saved (31460 records). [2025-10-03T18:20:08.197896] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-03T18:20:08.198011] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CXT took 31.9s. Estimated remaining: 4h 7m 5s. Rate: 7.2 symbols/min [2025-10-03T18:20:08.394432] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:08.394796] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-03T18:20:08.394854] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-03T18:20:08.394969] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-03T18:20:08.395013] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-03T18:20:08.395056] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-03T18:20:08.395095] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-03T18:20:08.815535] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:20:08.812492] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-03T18:20:08.849486] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:09.590627] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-03T18:20:09.686549] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:20:10.390637] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-03T18:20:10.504511] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:20:11.190633] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-03T18:20:11.608126] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:20:11.662229] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T18:20:11.990704] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-03T18:20:12.790678] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-03T18:20:13.034253] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T18:20:13.590724] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-03T18:20:14.390713] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-03T18:20:14.906552] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T18:20:14.959320] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:20:15.190722] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-03T18:20:15.563468] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (3.57 seconds). [2025-10-03T18:20:15.782016] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:20:15.990743] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-03T18:20:16.675569] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:20:16.790703] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-03T18:20:17.590704] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-03T18:20:17.660581] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:20:18.243990] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:20:18.390727] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-03T18:20:18.965742] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:20:18.967696] [INFO ] [REMOTE ] CYD: Full fetch complete (33515 records). [2025-10-03T18:20:18.967807] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-03T18:20:19.195806] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-03T18:20:19.387344] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-03T18:20:19.387438] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-03T18:20:19.387952] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-03T18:20:19.388020] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-03T18:20:19.389278] [DEBUG] [LOCAL ] CYD: Trimmed 33515 records to 26957 (keeping 200 days of data) [2025-10-03T18:20:19.563960] [DEBUG] [LOCAL ] CYD: Primary data saved (26957 records). [2025-10-03T18:20:19.564097] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-03T18:20:19.564181] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CYD took 31.0s. Estimated remaining: 4h 7m 6s. Rate: 7.2 symbols/min [2025-10-03T18:20:19.767926] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:19.768868] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:20:19.770736] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-10-03T18:20:19.771345] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-10-03T18:20:19.771545] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-03T18:20:19.771631] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-03T18:20:19.771764] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-03T18:20:19.771848] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-03T18:20:19.777422] [INFO ] [REMOTE ] CXW: Full fetch complete (64887 records). [2025-10-03T18:20:19.777538] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-03T18:20:19.995196] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-03T18:20:20.670273] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-03T18:20:20.669875] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:20.670857] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-03T18:20:20.671668] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-03T18:20:20.671740] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-03T18:20:20.673069] [DEBUG] [LOCAL ] CXW: Trimmed 64887 records to 44678 (keeping 200 days of data) [2025-10-03T18:20:20.790769] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-03T18:20:20.934112] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:20:21.014411] [DEBUG] [LOCAL ] CXW: Primary data saved (44678 records). [2025-10-03T18:20:21.014565] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-03T18:20:21.014689] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CXW took 38.2s. Estimated remaining: 4h 6m 37s. Rate: 7.3 symbols/min [2025-10-03T18:20:21.217519] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:21.272362] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-03T18:20:21.272755] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-03T18:20:21.468304] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:21.468520] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-03T18:20:21.468573] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-03T18:20:21.468879] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-03T18:20:21.468937] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-03T18:20:21.595894] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-03T18:20:21.887972] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:21.924974] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:20:22.020254] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:20:22.390734] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-03T18:20:23.190729] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-03T18:20:23.495791] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T18:20:23.990666] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-03T18:20:24.300821] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:20:24.790669] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-03T18:20:24.972341] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:20:25.195073] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:20:25.590727] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-03T18:20:26.390703] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-03T18:20:26.545842] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T18:20:26.644612] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:20:27.190733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-03T18:20:27.990736] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-03T18:20:28.605907] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:20:28.790621] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-03T18:20:28.816381] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T18:20:28.918183] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:20:29.590721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-03T18:20:30.390731] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-03T18:20:30.692935] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T18:20:31.190733] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-03T18:20:31.440769] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:20:31.990733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-03T18:20:32.206375] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:20:32.341684] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T18:20:32.790732] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-03T18:20:33.590634] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-03T18:20:33.989429] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T18:20:34.346036] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:20:34.390675] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-03T18:20:35.190860] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-03T18:20:35.905336] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-03T18:20:35.990733] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-03T18:20:36.165137] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:20:36.790724] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-03T18:20:37.183878] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:20:37.343064] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:20:37.590724] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-03T18:20:38.069067] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:20:38.390742] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-03T18:20:39.161292] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T18:20:39.190746] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-03T18:20:39.943517] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:20:39.990768] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-03T18:20:40.075211] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T18:20:40.078052] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-10-03T18:20:40.078236] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-03T18:20:40.524507] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-03T18:20:40.524602] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-03T18:20:40.525597] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-03T18:20:40.525744] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-03T18:20:40.527750] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54424 (keeping 200 days of data) [2025-10-03T18:20:40.792160] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-03T18:20:40.902679] [DEBUG] [LOCAL ] D: Primary data saved (54424 records). [2025-10-03T18:20:40.902868] [INFO ] [MAIN ] D: Full history saved. [2025-10-03T18:20:40.903009] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. D took 32.7s. Estimated remaining: 4h 7m 4s. Rate: 7.2 symbols/min [2025-10-03T18:20:41.097292] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:41.097554] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-03T18:20:41.097611] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-03T18:20:41.097841] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-03T18:20:41.097928] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-03T18:20:41.098027] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-03T18:20:41.098078] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-03T18:20:41.503023] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:41.590738] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-03T18:20:42.246567] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T18:20:42.390721] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-03T18:20:42.539944] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:20:43.190725] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-03T18:20:43.686831] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T18:20:43.990710] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-03T18:20:44.426350] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T18:20:44.534514] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T18:20:44.537972] [INFO ] [REMOTE ] CYH: Full fetch complete (69941 records). [2025-10-03T18:20:44.538206] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-03T18:20:44.804121] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-03T18:20:45.028268] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T18:20:45.079023] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-03T18:20:45.079502] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-03T18:20:45.080484] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-03T18:20:45.080558] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-03T18:20:45.082224] [DEBUG] [LOCAL ] CYH: Trimmed 69941 records to 48183 (keeping 200 days of data) [2025-10-03T18:20:45.374253] [DEBUG] [LOCAL ] CYH: Primary data saved (48183 records). [2025-10-03T18:20:45.374406] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-03T18:20:45.374498] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. CYH took 45.6s. Estimated remaining: 4h 6m 44s. Rate: 7.2 symbols/min [2025-10-03T18:20:45.556235] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:45.556407] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-03T18:20:45.556446] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-03T18:20:45.556582] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-03T18:20:45.556626] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-03T18:20:45.556753] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-03T18:20:45.556805] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-03T18:20:45.595959] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-03T18:20:45.958762] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:46.390725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-03T18:20:46.549036] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:20:47.190633] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-03T18:20:47.519750] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-03T18:20:47.567246] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T18:20:47.667915] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T18:20:47.990727] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-03T18:20:48.783528] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:20:48.790608] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-03T18:20:49.590737] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-03T18:20:50.031287] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:20:50.273463] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T18:20:50.274524] [INFO ] [REMOTE ] DAC: Full fetch complete (19392 records). [2025-10-03T18:20:50.274597] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-03T18:20:50.394555] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-03T18:20:50.686064] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-03T18:20:50.686146] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-03T18:20:50.686548] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-03T18:20:50.686591] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-03T18:20:50.687243] [DEBUG] [LOCAL ] DAC: Trimmed 19392 records to 12664 (keeping 200 days of data) [2025-10-03T18:20:50.781082] [DEBUG] [LOCAL ] DAC: Primary data saved (12664 records). [2025-10-03T18:20:50.781265] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-03T18:20:50.781370] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. DAC took 31.2s. Estimated remaining: 4h 6m 27s. Rate: 7.2 symbols/min [2025-10-03T18:20:50.992698] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:51.062963] [DEBUG] [LOCAL ] DAR: Loaded 52218 existing records from primary storage. [2025-10-03T18:20:51.063347] [INFO ] [MAIN ] DAR: Loaded 52218 existing records. [2025-10-03T18:20:51.195822] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-03T18:20:51.285289] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:51.285504] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-03T18:20:51.285552] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-03T18:20:51.285958] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-03T18:20:51.286019] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-03T18:20:51.731998] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:51.897357] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:20:51.990685] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-03T18:20:52.790731] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-03T18:20:53.320011] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T18:20:53.463947] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-03T18:20:53.590730] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-03T18:20:54.390709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-03T18:20:54.547204] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:20:55.190729] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-03T18:20:55.353407] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:20:55.990780] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-03T18:20:56.489160] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T18:20:56.795796] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-03T18:20:56.811507] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:20:57.081129] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T18:20:57.590699] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-03T18:20:58.390630] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-03T18:20:58.424168] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:20:58.625380] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T18:20:59.190707] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-03T18:20:59.990699] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-03T18:21:00.482766] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-03T18:21:00.485967] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-03T18:21:00.486193] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-03T18:21:00.800977] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-03T18:21:00.970001] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-03T18:21:00.970299] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-03T18:21:00.971585] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-03T18:21:00.971686] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-03T18:21:00.973336] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-10-03T18:21:01.358500] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-03T18:21:01.358750] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-03T18:21:01.358914] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAL took 40.3s. Estimated remaining: 4h 6m 26s. Rate: 7.2 symbols/min [2025-10-03T18:21:01.572631] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:01.618100] [DEBUG] [LOCAL ] DAVA: Loaded 41312 existing records from primary storage. [2025-10-03T18:21:01.618427] [INFO ] [MAIN ] DAVA: Loaded 41312 existing records. [2025-10-03T18:21:01.834897] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:01.835474] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-03T18:21:01.835597] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-03T18:21:01.836041] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-03T18:21:01.836161] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-03T18:21:02.037147] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-03T18:21:02.153442] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-03T18:21:02.345439] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-03T18:21:02.383175] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:02.393733] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-03T18:21:02.978999] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:21:03.190748] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-03T18:21:03.956183] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:21:03.990633] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-03T18:21:04.417406] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:21:04.790717] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-03T18:21:05.129460] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:21:05.590728] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-03T18:21:05.791106] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:21:06.036523] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:21:06.390727] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-03T18:21:07.190705] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-03T18:21:07.389831] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:21:07.963676] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T18:21:07.990631] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-03T18:21:08.148731] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T18:21:08.790707] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-03T18:21:09.590743] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-03T18:21:09.766715] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:21:10.105768] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T18:21:10.390708] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-03T18:21:10.778843] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:21:11.190696] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-03T18:21:11.625811] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:21:11.990707] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-03T18:21:12.266408] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T18:21:12.790717] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-03T18:21:13.579809] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:21:13.590722] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-03T18:21:14.330806] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:21:14.333338] [INFO ] [REMOTE ] DAO: Full fetch complete (32741 records). [2025-10-03T18:21:14.333497] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-03T18:21:14.399336] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-03T18:21:14.725073] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:21:14.852780] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-03T18:21:14.852872] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-03T18:21:14.853456] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-03T18:21:14.853526] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-03T18:21:14.854580] [DEBUG] [LOCAL ] DAO: Trimmed 32741 records to 20992 (keeping 200 days of data) [2025-10-03T18:21:14.982086] [DEBUG] [LOCAL ] DAO: Primary data saved (20992 records). [2025-10-03T18:21:14.982247] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-03T18:21:14.982350] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. DAO took 29.6s. Estimated remaining: 4h 6m 34s. Rate: 7.2 symbols/min [2025-10-03T18:21:15.165455] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:15.195799] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-03T18:21:15.221692] [DEBUG] [LOCAL ] DAY: Loaded 49792 existing records from primary storage. [2025-10-03T18:21:15.222114] [INFO ] [MAIN ] DAY: Loaded 49792 existing records. [2025-10-03T18:21:15.438535] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:15.438827] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-03T18:21:15.438880] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-03T18:21:15.439229] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-03T18:21:15.439289] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-03T18:21:15.870009] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:15.990668] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-03T18:21:16.095297] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:21:16.790662] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-03T18:21:17.043164] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:21:17.590719] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-03T18:21:17.934783] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:21:18.390701] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-03T18:21:18.486180] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:21:18.981282] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:21:18.983255] [INFO ] [REMOTE ] DAN: Full fetch complete (70484 records). [2025-10-03T18:21:18.983367] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-03T18:21:18.984142] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:18.984244] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:18.984309] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:18.984382] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-03T18:21:18.984449] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-03T18:21:18.984486] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-03T18:21:18.984561] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-03T18:21:18.984669] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAN took 38.1s. Estimated remaining: 4h 6m 13s. Rate: 7.2 symbols/min [2025-10-03T18:21:19.173255] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:19.173465] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-10-03T18:21:19.173522] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-10-03T18:21:19.173664] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-03T18:21:19.173723] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-03T18:21:19.173812] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-03T18:21:19.173863] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-03T18:21:19.196618] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-03T18:21:19.573835] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:19.805401] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:21:19.990719] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-03T18:21:20.790737] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-03T18:21:20.925602] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:21:21.590726] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-03T18:21:21.728375] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:21:22.257833] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:21:22.390716] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-03T18:21:22.880573] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:21:23.190710] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-03T18:21:23.897231] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:21:23.990916] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-03T18:21:24.749553] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:21:24.790721] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-03T18:21:25.295106] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:21:25.590704] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-03T18:21:26.390681] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-03T18:21:26.501375] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:21:27.017970] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:21:27.020695] [INFO ] [REMOTE ] DAR: Full fetch complete (74633 records). [2025-10-03T18:21:27.020831] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-03T18:21:27.192636] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-03T18:21:27.463449] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-03T18:21:27.463542] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-03T18:21:27.464405] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-03T18:21:27.464474] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-03T18:21:27.466042] [DEBUG] [LOCAL ] DAR: Trimmed 74633 records to 52592 (keeping 200 days of data) [2025-10-03T18:21:27.808803] [DEBUG] [LOCAL ] DAR: Primary data saved (52592 records). [2025-10-03T18:21:27.808971] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-03T18:21:27.809134] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAR took 37.0s. Estimated remaining: 4h 6m 6s. Rate: 7.2 symbols/min [2025-10-03T18:21:27.995989] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:27.994323] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-03T18:21:27.996195] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-03T18:21:27.996271] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-03T18:21:27.997264] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-03T18:21:27.997309] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-03T18:21:27.997353] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-03T18:21:27.997413] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-03T18:21:28.426107] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:28.462215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T18:21:28.539265] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:21:28.790727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-03T18:21:29.590715] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-03T18:21:29.683199] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:21:29.723067] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T18:21:30.390685] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-03T18:21:31.017197] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:21:31.190727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-03T18:21:31.515947] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:21:31.990720] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-03T18:21:32.190630] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T18:21:32.790743] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-03T18:21:33.590700] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-03T18:21:33.956256] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:21:34.390634] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-03T18:21:34.678559] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:21:34.884792] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T18:21:35.190749] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-03T18:21:35.990679] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-03T18:21:36.100974] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:21:36.758826] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:21:36.761492] [INFO ] [REMOTE ] DAVA: Full fetch complete (56072 records). [2025-10-03T18:21:36.761609] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-03T18:21:36.795773] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-03T18:21:37.196150] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-03T18:21:37.196242] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-03T18:21:37.196936] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-03T18:21:37.197003] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-03T18:21:37.198206] [DEBUG] [LOCAL ] DAVA: Trimmed 56072 records to 41673 (keeping 200 days of data) [2025-10-03T18:21:37.445901] [DEBUG] [LOCAL ] DAVA: Primary data saved (41673 records). [2025-10-03T18:21:37.446036] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-03T18:21:37.446134] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAVA took 36.1s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-03T18:21:37.602237] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-03T18:21:37.636931] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:37.680493] [DEBUG] [LOCAL ] DBI: Loaded 44841 existing records from primary storage. [2025-10-03T18:21:37.680851] [INFO ] [MAIN ] DBI: Loaded 44841 existing records. [2025-10-03T18:21:37.883708] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:37.884460] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-03T18:21:37.884608] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-03T18:21:37.885361] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-03T18:21:37.885521] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-03T18:21:38.216465] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T18:21:38.330611] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-03T18:21:38.344161] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:38.390626] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-03T18:21:39.190677] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-03T18:21:39.236832] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:21:39.990718] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-03T18:21:40.503707] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:21:40.725446] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T18:21:40.790725] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-03T18:21:41.590707] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-03T18:21:41.947573] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:21:42.390691] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-03T18:21:42.692831] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:21:42.731577] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T18:21:43.190736] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-03T18:21:43.742626] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T18:21:43.990631] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-03T18:21:44.314780] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:21:44.790707] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-03T18:21:45.590617] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-03T18:21:45.984610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:21:46.174086] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:21:46.390696] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-03T18:21:47.025755] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:21:47.190685] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-03T18:21:47.298217] [DEBUG] [REMOTE ] DBI: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-03T18:21:47.298672] [WARN ] [REMOTE ] DBI: No data returned for month 2025-03 [2025-10-03T18:21:47.298762] [FATAL] [REMOTE ] DBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:21:47.298860] [FATAL] [MAIN ] DBI: Failed to fetch primary data. [2025-10-03T18:21:47.298932] [WARN ] [MAIN ] DBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:21:47.299014] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-03T18:21:47.299087] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-03T18:21:47.299129] [INFO ] [LOCAL ] DBI: Starting deletion of derivative data. [2025-10-03T18:21:47.299448] [DEBUG] [LOCAL ] DBI: Deleted derivative data file. [2025-10-03T18:21:47.299552] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DBI took 9.9s. Estimated remaining: 4h 5m 58s. Rate: 7.2 symbols/min [2025-10-03T18:21:47.516020] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:47.533049] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:21:47.547671] [DEBUG] [LOCAL ] DBL: Loaded 9352 existing records from primary storage. [2025-10-03T18:21:47.547967] [INFO ] [MAIN ] DBL: Loaded 9352 existing records. [2025-10-03T18:21:47.735847] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:47.736084] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-03T18:21:47.736143] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-03T18:21:47.736600] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-03T18:21:47.736694] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-03T18:21:47.995882] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-03T18:21:48.145937] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:48.790735] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-03T18:21:49.590696] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-03T18:21:49.738466] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:21:50.311168] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T18:21:50.312663] [INFO ] [REMOTE ] DBD: Full fetch complete (30820 records). [2025-10-03T18:21:50.312791] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-03T18:21:50.313377] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:50.313473] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:50.313520] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:50.313561] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-03T18:21:50.313712] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-03T18:21:50.313773] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-03T18:21:50.313835] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-03T18:21:50.313943] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DBD took 22.5s. Estimated remaining: 4h 5m 34s. Rate: 7.2 symbols/min [2025-10-03T18:21:50.398967] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-03T18:21:50.533423] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:50.533746] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-03T18:21:50.533823] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-03T18:21:50.533971] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-03T18:21:50.534068] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-03T18:21:50.534159] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-03T18:21:50.534227] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-03T18:21:50.947868] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:50.991475] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:21:51.190716] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-03T18:21:51.990735] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-03T18:21:52.461414] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-03T18:21:52.790714] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-03T18:21:53.178554] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:21:53.590703] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-03T18:21:54.143804] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:21:54.319928] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:21:54.390696] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-03T18:21:55.112850] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:21:55.115253] [INFO ] [REMOTE ] DB: Full fetch complete (74286 records). [2025-10-03T18:21:55.115367] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-03T18:21:55.116474] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:55.116566] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:55.116613] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:55.116686] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-03T18:21:55.116788] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-03T18:21:55.116844] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-10-03T18:21:55.116977] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-10-03T18:21:55.117124] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DB took 36.1s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-03T18:21:55.195759] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-03T18:21:55.312832] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:55.313030] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-03T18:21:55.313070] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-03T18:21:55.313224] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-03T18:21:55.313302] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-03T18:21:55.313369] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-03T18:21:55.313406] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-03T18:21:55.722226] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:55.797181] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:21:55.799798] [INFO ] [REMOTE ] DAY: Full fetch complete (71525 records). [2025-10-03T18:21:55.799961] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-03T18:21:55.995910] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-03T18:21:56.148666] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:21:56.252494] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-03T18:21:56.252591] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-03T18:21:56.253454] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-03T18:21:56.253532] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-03T18:21:56.255111] [DEBUG] [LOCAL ] DAY: Trimmed 71525 records to 50058 (keeping 200 days of data) [2025-10-03T18:21:56.568525] [DEBUG] [LOCAL ] DAY: Primary data saved (50058 records). [2025-10-03T18:21:56.568747] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-03T18:21:56.569484] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DAY took 41.6s. Estimated remaining: 4h 4m 46s. Rate: 7.3 symbols/min [2025-10-03T18:21:56.766392] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:56.784231] [DEBUG] [LOCAL ] DCO: Loaded 13948 existing records from primary storage. [2025-10-03T18:21:56.784498] [INFO ] [MAIN ] DCO: Loaded 13948 existing records. [2025-10-03T18:21:56.796682] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-03T18:21:56.990034] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:56.990302] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-03T18:21:56.990353] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-03T18:21:56.990619] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-03T18:21:56.990725] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-03T18:21:57.401234] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:57.556017] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T18:21:57.590758] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-03T18:21:57.870934] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:21:58.390729] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-03T18:21:59.190684] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-03T18:21:59.265015] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:21:59.449308] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:21:59.964165] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:21:59.990687] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-03T18:22:00.790731] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-03T18:22:00.983064] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T18:22:01.590991] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-03T18:22:01.715158] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T18:22:02.390737] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-03T18:22:03.055274] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:22:03.071090] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:22:03.190727] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-03T18:22:03.990739] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-03T18:22:04.610935] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:22:04.626360] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:22:04.790709] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-03T18:22:05.590744] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-03T18:22:06.390738] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-03T18:22:06.552092] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T18:22:07.002416] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:22:07.184452] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:22:07.193328] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-03T18:22:07.978617] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:22:07.990621] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-03T18:22:08.790739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-03T18:22:08.849461] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:22:09.590705] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-03T18:22:10.390703] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-03T18:22:10.421155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:22:11.190709] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-03T18:22:11.385769] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:22:11.385455] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:22:11.682038] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-03T18:22:11.990726] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-03T18:22:12.790702] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-03T18:22:13.039254] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:22:13.590689] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-03T18:22:13.648420] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T18:22:14.390714] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-03T18:22:15.073528] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:22:15.190716] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-03T18:22:15.881757] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:22:15.990740] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-03T18:22:16.658204] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:22:16.790734] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-03T18:22:17.590706] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-03T18:22:17.622258] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:22:17.887849] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T18:22:18.390675] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-03T18:22:18.957572] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:22:19.190740] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-03T18:22:19.443131] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T18:22:19.960195] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T18:22:19.990742] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-03T18:22:20.790711] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-03T18:22:21.590678] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-03T18:22:21.673277] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:22:22.388811] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:22:22.397051] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-03T18:22:22.801906] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:22:23.190695] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-03T18:22:23.945218] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:22:23.990631] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-03T18:22:24.569525] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T18:22:24.790713] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-03T18:22:25.473930] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:22:25.590738] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-03T18:22:25.858450] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:22:25.859444] [INFO ] [REMOTE ] DBL: Full fetch complete (12563 records). [2025-10-03T18:22:25.859535] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-03T18:22:26.267509] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-03T18:22:26.267604] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-03T18:22:26.268149] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-03T18:22:26.268216] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-03T18:22:26.270300] [DEBUG] [LOCAL ] DBL: Trimmed 12563 records to 9400 (keeping 200 days of data) [2025-10-03T18:22:26.334627] [DEBUG] [LOCAL ] DBL: Primary data saved (9400 records). [2025-10-03T18:22:26.334798] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-03T18:22:26.334967] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBL took 39.0s. Estimated remaining: 4h 5m 42s. Rate: 7.2 symbols/min [2025-10-03T18:22:26.395758] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-03T18:22:26.523164] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:26.566974] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:22:26.569303] [INFO ] [REMOTE ] DCI: Full fetch complete (53815 records). [2025-10-03T18:22:26.569481] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-03T18:22:26.707135] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-10-03T18:22:26.728296] [INFO ] [MAIN ] DD: Loaded 53213 existing records. [2025-10-03T18:22:27.136091] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:27.172392] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-03T18:22:27.187603] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-03T18:22:27.204237] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-03T18:22:27.223627] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-03T18:22:27.227251] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-03T18:22:27.227068] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-03T18:22:27.232604] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-03T18:22:27.252062] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-03T18:22:27.252281] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-03T18:22:27.349629] [DEBUG] [LOCAL ] DCI: Trimmed 53815 records to 37763 (keeping 200 days of data) [2025-10-03T18:22:27.600749] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:22:27.771836] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:27.910671] [DEBUG] [LOCAL ] DCI: Primary data saved (37763 records). [2025-10-03T18:22:27.910842] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-03T18:22:27.910942] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DCI took 32.8s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-03T18:22:27.995747] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-03T18:22:28.096466] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:28.148125] [DEBUG] [LOCAL ] DDD: Loaded 51270 existing records from primary storage. [2025-10-03T18:22:28.148459] [INFO ] [MAIN ] DDD: Loaded 51270 existing records. [2025-10-03T18:22:28.338923] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:28.339154] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-03T18:22:28.339205] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-03T18:22:28.339470] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-03T18:22:28.339529] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-03T18:22:28.753886] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:28.790688] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-03T18:22:29.069993] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:22:29.590744] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-03T18:22:29.652216] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:22:29.653390] [INFO ] [REMOTE ] DCO: Full fetch complete (19099 records). [2025-10-03T18:22:29.653508] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-03T18:22:30.105914] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-03T18:22:30.107965] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:22:30.118950] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-03T18:22:30.120144] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-03T18:22:30.120214] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-03T18:22:30.121085] [DEBUG] [LOCAL ] DCO: Trimmed 19099 records to 14009 (keeping 200 days of data) [2025-10-03T18:22:30.207967] [DEBUG] [LOCAL ] DCO: Primary data saved (14009 records). [2025-10-03T18:22:30.208134] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-03T18:22:30.208228] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DCO took 33.6s. Estimated remaining: 4h 4m 48s. Rate: 7.2 symbols/min [2025-10-03T18:22:30.390710] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-03T18:22:31.190733] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-03T18:22:31.226845] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T18:22:31.229626] [INFO ] [REMOTE ] DBRG: Full fetch complete (72382 records). [2025-10-03T18:22:31.229801] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-03T18:22:31.673120] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-03T18:22:31.673229] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-03T18:22:31.674149] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-03T18:22:31.674221] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-03T18:22:31.676538] [DEBUG] [LOCAL ] DBRG: Trimmed 72382 records to 50472 (keeping 200 days of data) [2025-10-03T18:22:32.020609] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:22:32.033853] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-03T18:22:32.044676] [DEBUG] [LOCAL ] DBRG: Primary data saved (50472 records). [2025-10-03T18:22:32.044797] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-03T18:22:32.044876] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DBRG took 41.7s. Estimated remaining: 4h 4m 20s. Rate: 7.3 symbols/min [2025-10-03T18:22:33.081090] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:22:33.095311] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-03T18:22:33.751984] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:22:33.762547] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-03T18:22:34.918638] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:22:34.930288] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-03T18:22:35.508026] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:22:35.519871] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-03T18:22:36.300610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:22:36.311743] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-03T18:22:37.205957] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:22:37.218378] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-03T18:22:38.202468] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:22:38.214381] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-03T18:22:38.767618] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:22:38.781821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-03T18:22:40.212866] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:22:40.224968] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-03T18:22:40.512767] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:22:40.527164] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-03T18:22:42.067950] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:22:42.079909] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-03T18:22:42.518988] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:22:42.531941] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-03T18:22:43.968120] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T18:22:43.980142] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-03T18:22:44.386170] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:22:44.401047] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-03T18:22:45.394519] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T18:22:45.407250] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-03T18:22:46.208116] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:22:46.221880] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-03T18:22:47.258763] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:22:47.270363] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-03T18:22:47.835469] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T18:22:47.839207] [INFO ] [REMOTE ] DD: Full fetch complete (76346 records). [2025-10-03T18:22:47.839354] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-03T18:22:48.322894] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-03T18:22:48.322999] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-03T18:22:48.324225] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-03T18:22:48.324298] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-03T18:22:48.325926] [DEBUG] [LOCAL ] DD: Trimmed 76346 records to 53600 (keeping 200 days of data) [2025-10-03T18:22:48.681105] [DEBUG] [LOCAL ] DD: Primary data saved (53600 records). [2025-10-03T18:22:48.681261] [INFO ] [MAIN ] DD: Full history saved. [2025-10-03T18:22:48.681360] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 22.3s. Estimated remaining: 4h 4m 37s. Rate: 7.2 symbols/min [2025-10-03T18:22:49.230723] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T18:22:49.243112] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-03T18:22:50.933231] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:22:50.936402] [INFO ] [REMOTE ] DDD: Full fetch complete (73692 records). [2025-10-03T18:22:50.936574] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-03T18:22:51.401795] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-03T18:22:51.401895] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-03T18:22:51.403154] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-03T18:22:51.403255] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-03T18:22:51.405509] [DEBUG] [LOCAL ] DDD: Trimmed 73692 records to 51654 (keeping 200 days of data) [2025-10-03T18:22:51.730158] [DEBUG] [LOCAL ] DDD: Primary data saved (51654 records). [2025-10-03T18:22:51.730319] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-03T18:22:51.731895] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 23.8s. Estimated remaining: 4h 4m 13s. Rate: 7.2 symbols/min [2025-10-03T18:22:52.489298] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.457777] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.516043] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-03T18:22:52.538294] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-03T18:22:52.577667] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.596520] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-03T18:22:52.601518] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.602772] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-03T18:22:52.602907] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-03T18:22:52.602950] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-03T18:22:52.678441] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-03T18:22:52.703509] [INFO ] [MAIN ] DDT: Loaded 2086 existing records. [2025-10-03T18:22:52.856599] [DEBUG] [LOCAL ] DDL: Loaded 37057 existing records from primary storage. [2025-10-03T18:22:52.913050] [INFO ] [MAIN ] DDL: Loaded 37057 existing records. [2025-10-03T18:22:53.230173] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:53.259103] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-03T18:22:53.243270] [DEBUG] [LOCAL ] DE: Loaded 47908 existing records from primary storage. [2025-10-03T18:22:53.294601] [INFO ] [MAIN ] DE: Loaded 47908 existing records. [2025-10-03T18:22:53.289309] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-03T18:22:53.360562] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-03T18:22:53.416552] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-03T18:22:53.652376] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:53.701788] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-03T18:22:53.750154] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-03T18:22:53.797199] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:53.818470] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-03T18:22:53.847230] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-03T18:22:53.878941] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-03T18:22:54.141200] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:54.156514] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-03T18:22:54.206617] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-03T18:22:54.283213] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-03T18:22:54.322809] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-03T18:22:54.808934] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:54.832336] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-03T18:22:55.033758] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:55.037535] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-03T18:22:55.124233] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:55.124538] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-03T18:23:06.824214] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (11.99 seconds). [2025-10-03T18:23:06.825493] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-03T18:23:07.206597] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (13.39 seconds). [2025-10-03T18:23:07.210449] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-03T18:23:07.450137] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T18:23:07.451491] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-03T18:23:08.414472] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (13.38 seconds). [2025-10-03T18:23:08.424504] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-03T18:23:08.510025] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (13.39 seconds). [2025-10-03T18:23:08.520355] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-03T18:23:09.477016] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:23:09.484885] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-03T18:23:10.823875] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T18:23:10.831681] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-03T18:23:12.308544] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T18:23:12.317717] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-03T18:23:12.789260] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (5.34 seconds). [2025-10-03T18:23:12.790870] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-03T18:23:13.449682] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (6.24 seconds). [2025-10-03T18:23:13.453021] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-03T18:23:13.959489] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:23:13.972152] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-03T18:23:13.994794] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T18:23:13.996087] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-03T18:23:14.593623] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T18:23:14.597253] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-03T18:23:14.608491] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T18:23:14.610546] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-03T18:23:14.670404] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (6.15 seconds). [2025-10-03T18:23:14.681079] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-03T18:23:14.934309] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T18:23:14.935675] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-03T18:23:15.306356] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T18:23:15.307681] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-03T18:23:15.626278] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:23:15.630306] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-03T18:23:15.675785] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:23:15.677202] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-03T18:23:15.944614] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:23:15.955226] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-03T18:23:16.123566] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T18:23:16.124748] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-03T18:23:16.456099] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:23:16.466490] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-03T18:23:16.509728] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-03T18:23:16.511207] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-03T18:23:16.523074] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:23:16.527411] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-03T18:23:16.879315] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T18:23:16.886033] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-03T18:23:16.998175] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T18:23:16.998995] [INFO ] [REMOTE ] DDT: Full fetch complete (2872 records). [2025-10-03T18:23:16.999070] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-03T18:23:16.999520] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:23:16.999678] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:23:16.999741] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:23:16.999787] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-03T18:23:16.999844] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-03T18:23:16.999886] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-03T18:23:17.000261] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-03T18:23:17.000357] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 25.3s. Estimated remaining: 4h 4m 55s. Rate: 7.2 symbols/min [2025-10-03T18:23:17.187012] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:17.187211] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-03T18:23:17.187256] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-03T18:23:17.187399] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-03T18:23:17.187465] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-03T18:23:17.187532] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-03T18:23:17.187606] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-03T18:23:17.586696] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:17.587105] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-03T18:23:17.629977] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:23:17.633852] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-03T18:23:18.346164] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:23:18.353240] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-03T18:23:18.462089] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T18:23:18.474278] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-03T18:23:18.484051] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:23:18.487930] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-03T18:23:18.969952] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:23:18.980438] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-03T18:23:19.230784] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T18:23:19.235474] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-03T18:23:19.702267] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:23:19.709207] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-03T18:23:20.189891] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:23:20.193897] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-03T18:23:20.386777] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:23:20.403771] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-03T18:23:20.591405] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:23:20.601667] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-03T18:23:21.082030] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T18:23:21.086029] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-03T18:23:21.214941] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:23:21.224816] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-03T18:23:21.865724] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:23:21.866751] [INFO ] [REMOTE ] DDS: Full fetch complete (18964 records). [2025-10-03T18:23:21.866860] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-03T18:23:22.032057] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:23:22.129059] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-03T18:23:22.332461] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-03T18:23:22.332735] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-03T18:23:22.333178] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-03T18:23:22.333332] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-03T18:23:22.334532] [DEBUG] [LOCAL ] DDS: Trimmed 18964 records to 13150 (keeping 200 days of data) [2025-10-03T18:23:22.363104] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:23:22.434798] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-03T18:23:22.461937] [DEBUG] [LOCAL ] DDS: Primary data saved (13150 records). [2025-10-03T18:23:22.462071] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-03T18:23:22.462212] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 30.7s. Estimated remaining: 4h 4m 38s. Rate: 7.2 symbols/min [2025-10-03T18:23:22.571558] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:23:22.589711] [INFO ] [REMOTE ] DDL: Full fetch complete (52904 records). [2025-10-03T18:23:22.605231] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-03T18:23:22.638224] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:23:22.667427] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:23:22.667285] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:22.668192] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:23:22.668311] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-03T18:23:22.668411] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-03T18:23:22.668488] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-03T18:23:22.668807] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-03T18:23:22.668913] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DDL took 30.9s. Estimated remaining: 4h 4m 6s. Rate: 7.2 symbols/min [2025-10-03T18:23:22.869801] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:22.881841] [DEBUG] [LOCAL ] DEC: Loaded 30765 existing records from primary storage. [2025-10-03T18:23:22.882163] [INFO ] [MAIN ] DEC: Loaded 30765 existing records. [2025-10-03T18:23:23.085324] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:23.085610] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-03T18:23:23.085699] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-03T18:23:23.086110] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-03T18:23:23.100178] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-03T18:23:23.247002] [DEBUG] [LOCAL ] DECK: Loaded 53683 existing records from primary storage. [2025-10-03T18:23:23.279194] [INFO ] [MAIN ] DECK: Loaded 53683 existing records. [2025-10-03T18:23:23.691638] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:23.709371] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-03T18:23:23.709468] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-03T18:23:23.735410] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-03T18:23:23.758274] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-03T18:23:23.766023] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:23.791562] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-03T18:23:24.201470] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T18:23:24.264517] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:24.276771] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-03T18:23:24.276454] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-03T18:23:24.311030] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:23:24.790711] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-03T18:23:25.049390] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:23:25.590784] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-03T18:23:26.138776] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:23:26.369617] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:23:26.390703] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-03T18:23:26.420172] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:23:26.706715] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:23:27.190694] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-03T18:23:27.904904] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T18:23:27.990704] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-03T18:23:28.790906] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-03T18:23:29.111765] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:23:29.295231] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:23:29.590726] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-03T18:23:30.388613] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T18:23:30.397918] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-03T18:23:31.124762] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:23:31.190697] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-03T18:23:31.990904] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-03T18:23:32.490150] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T18:23:32.631341] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:23:32.790926] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-03T18:23:33.371427] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T18:23:33.590689] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-03T18:23:34.026945] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T18:23:34.390736] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-03T18:23:35.190711] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-03T18:23:35.339293] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:23:35.990700] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-03T18:23:36.018100] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:23:36.790685] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-03T18:23:37.335466] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T18:23:37.590674] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-03T18:23:37.646467] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T18:23:37.648971] [INFO ] [REMOTE ] DE: Full fetch complete (69566 records). [2025-10-03T18:23:37.649085] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-03T18:23:38.145242] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-03T18:23:38.145392] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-03T18:23:38.146524] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-03T18:23:38.147155] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-03T18:23:38.148483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:23:38.158453] [DEBUG] [LOCAL ] DE: Trimmed 69566 records to 48234 (keeping 200 days of data) [2025-10-03T18:23:38.393252] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-03T18:23:38.481390] [DEBUG] [LOCAL ] DE: Primary data saved (48234 records). [2025-10-03T18:23:38.481539] [INFO ] [MAIN ] DE: Full history saved. [2025-10-03T18:23:38.481626] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DE took 46.7s. Estimated remaining: 4h 4m 20s. Rate: 7.2 symbols/min [2025-10-03T18:23:38.671109] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:38.718170] [DEBUG] [LOCAL ] DEI: Loaded 48684 existing records from primary storage. [2025-10-03T18:23:38.718509] [INFO ] [MAIN ] DEI: Loaded 48684 existing records. [2025-10-03T18:23:38.924192] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:38.924567] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-03T18:23:38.924633] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-03T18:23:38.925014] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-03T18:23:38.925074] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-03T18:23:39.103291] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T18:23:39.195939] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-03T18:23:39.375238] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:39.824205] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:23:39.990688] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-03T18:23:40.636223] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:23:40.790731] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-03T18:23:41.448158] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:23:41.451255] [INFO ] [REMOTE ] DEA: Full fetch complete (62389 records). [2025-10-03T18:23:41.451428] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-03T18:23:41.595803] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-03T18:23:41.896473] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-03T18:23:41.896566] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-03T18:23:41.897337] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-03T18:23:41.897417] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-03T18:23:41.898873] [DEBUG] [LOCAL ] DEA: Trimmed 62389 records to 41408 (keeping 200 days of data) [2025-10-03T18:23:42.167269] [DEBUG] [LOCAL ] DEA: Primary data saved (41408 records). [2025-10-03T18:23:42.167418] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-03T18:23:42.167547] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEA took 25.2s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-03T18:23:42.359595] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:42.392454] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-03T18:23:42.422696] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:23:42.454884] [DEBUG] [LOCAL ] DELL: Loaded 54125 existing records from primary storage. [2025-10-03T18:23:42.455248] [INFO ] [MAIN ] DELL: Loaded 54125 existing records. [2025-10-03T18:23:42.665893] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:42.666239] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-03T18:23:42.666465] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-03T18:23:42.666895] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-03T18:23:42.666960] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-03T18:23:42.998417] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T18:23:43.132165] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:43.190691] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-03T18:23:43.990690] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-03T18:23:44.475922] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:23:44.790700] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-03T18:23:45.361365] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T18:23:45.590685] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-03T18:23:45.720800] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-03T18:23:46.390714] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-03T18:23:46.992811] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T18:23:47.190571] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-03T18:23:47.233112] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:23:47.990728] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-03T18:23:48.792701] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-03T18:23:48.817682] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-03T18:23:49.151956] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T18:23:49.509169] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T18:23:49.590693] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-03T18:23:49.797314] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:23:49.800476] [INFO ] [REMOTE ] DEC: Full fetch complete (43460 records). [2025-10-03T18:23:49.800691] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-03T18:23:50.246561] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-03T18:23:50.246687] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-03T18:23:50.247407] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-03T18:23:50.247457] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-03T18:23:50.248733] [DEBUG] [LOCAL ] DEC: Trimmed 43460 records to 31087 (keeping 200 days of data) [2025-10-03T18:23:50.390723] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-03T18:23:50.466151] [DEBUG] [LOCAL ] DEC: Primary data saved (31087 records). [2025-10-03T18:23:50.466349] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-03T18:23:50.466458] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEC took 28.0s. Estimated remaining: 4h 3m 50s. Rate: 7.2 symbols/min [2025-10-03T18:23:50.729640] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:50.729902] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-03T18:23:50.729968] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-03T18:23:50.730126] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-03T18:23:50.730192] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-03T18:23:50.730267] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-03T18:23:50.730325] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-03T18:23:51.199524] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-03T18:23:51.235089] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:23:51.391396] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:51.990723] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-03T18:23:52.589947] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T18:23:52.790710] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-03T18:23:53.526846] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-03T18:23:53.590732] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-03T18:23:53.765779] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T18:23:54.390690] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-03T18:23:54.755841] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T18:23:55.190722] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-03T18:23:55.349241] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:23:55.990682] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-03T18:23:56.540753] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:23:56.790755] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-03T18:23:56.827811] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-03T18:23:57.590723] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-03T18:23:57.997174] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:23:58.378986] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:23:58.390813] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-03T18:23:59.190728] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-03T18:23:59.952088] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T18:23:59.999207] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-03T18:24:00.008240] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:24:00.790701] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-03T18:24:01.430568] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-03T18:24:01.434249] [INFO ] [REMOTE ] DECK: Full fetch complete (76730 records). [2025-10-03T18:24:01.434439] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-03T18:24:01.595883] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-03T18:24:01.935809] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-03T18:24:01.936050] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-03T18:24:01.937392] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-03T18:24:01.937515] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-03T18:24:01.940405] [DEBUG] [LOCAL ] DECK: Trimmed 76730 records to 54072 (keeping 200 days of data) [2025-10-03T18:24:02.097390] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T18:24:02.390742] [DEBUG] [LOCAL ] DECK: Primary data saved (54072 records). [2025-10-03T18:24:02.391131] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-03T18:24:02.392011] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 39.7s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-03T18:24:02.390904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-03T18:24:02.576618] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:02.613825] [DEBUG] [LOCAL ] DFH: Loaded 32447 existing records from primary storage. [2025-10-03T18:24:02.614146] [INFO ] [MAIN ] DFH: Loaded 32447 existing records. [2025-10-03T18:24:02.807775] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:02.808043] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-03T18:24:02.808094] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-03T18:24:02.808303] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-03T18:24:02.808363] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-03T18:24:03.219941] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:03.220528] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-03T18:24:03.326577] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-03T18:24:03.366263] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T18:24:03.990736] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-03T18:24:04.225140] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:24:04.755276] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:24:04.790716] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-03T18:24:05.590736] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-03T18:24:06.390691] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-03T18:24:06.546010] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:24:07.029814] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-10-03T18:24:07.190710] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-03T18:24:07.345615] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:24:07.542616] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:24:07.990749] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-03T18:24:08.790703] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-03T18:24:09.368183] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:24:09.590713] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-03T18:24:09.747627] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T18:24:10.198820] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:24:10.201330] [INFO ] [REMOTE ] DEI: Full fetch complete (69701 records). [2025-10-03T18:24:10.201484] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-03T18:24:10.395794] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-03T18:24:10.634255] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-03T18:24:10.634355] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-03T18:24:10.635231] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-03T18:24:10.635304] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-03T18:24:10.636885] [DEBUG] [LOCAL ] DEI: Trimmed 69701 records to 49012 (keeping 200 days of data) [2025-10-03T18:24:10.944745] [DEBUG] [LOCAL ] DEI: Primary data saved (49012 records). [2025-10-03T18:24:10.944887] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-03T18:24:10.945443] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 32.5s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-03T18:24:11.126864] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:11.151963] [DEBUG] [LOCAL ] DFIN: Loaded 23174 existing records from primary storage. [2025-10-03T18:24:11.152280] [INFO ] [MAIN ] DFIN: Loaded 23174 existing records. [2025-10-03T18:24:11.202356] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-03T18:24:11.361891] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:11.362331] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-03T18:24:11.362457] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-03T18:24:11.362896] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-03T18:24:11.363053] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-03T18:24:11.588533] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:24:11.808974] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:11.990710] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-03T18:24:12.685388] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-03T18:24:12.790692] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-03T18:24:12.837064] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:24:13.590631] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-03T18:24:13.831253] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:24:14.390757] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-03T18:24:15.091326] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:24:15.178380] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-03T18:24:15.191139] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-03T18:24:15.990691] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-03T18:24:15.991959] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:24:16.512868] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T18:24:16.790708] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-03T18:24:17.590673] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-03T18:24:17.817058] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T18:24:18.114360] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-03T18:24:18.117242] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-03T18:24:18.117407] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-03T18:24:18.396782] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-03T18:24:18.564984] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-03T18:24:18.565082] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-03T18:24:18.565977] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-03T18:24:18.566046] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-03T18:24:18.567693] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-10-03T18:24:18.921888] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-10-03T18:24:18.922065] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-03T18:24:18.922164] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DELL took 36.8s. Estimated remaining: 4h 3m 35s. Rate: 7.2 symbols/min [2025-10-03T18:24:19.121313] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:19.135230] [DEBUG] [LOCAL ] DFP: Loaded 11492 existing records from primary storage. [2025-10-03T18:24:19.135554] [INFO ] [MAIN ] DFP: Loaded 11492 existing records. [2025-10-03T18:24:19.200717] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-03T18:24:19.353756] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:19.354256] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-03T18:24:19.354383] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-03T18:24:19.354609] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-03T18:24:19.354709] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-03T18:24:19.765255] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:19.784873] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:24:19.824026] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:24:19.990683] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-03T18:24:20.449458] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T18:24:20.625674] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:24:20.790696] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-03T18:24:21.590726] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-03T18:24:22.390685] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-03T18:24:22.717738] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:24:23.188851] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:24:23.191783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-03T18:24:23.667923] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:24:23.990724] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-03T18:24:24.173214] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:24:24.790692] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-03T18:24:25.576637] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:24:25.590632] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-03T18:24:25.822218] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T18:24:26.390719] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-03T18:24:27.192867] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-03T18:24:27.197322] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:24:27.268346] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:24:27.990726] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-03T18:24:28.613779] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:24:28.790712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-03T18:24:29.120241] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T18:24:29.590702] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-03T18:24:30.151501] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:24:30.154239] [INFO ] [REMOTE ] DEO: Full fetch complete (71509 records). [2025-10-03T18:24:30.154357] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-03T18:24:30.393762] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-03T18:24:30.522717] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T18:24:30.617200] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-03T18:24:30.617300] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-03T18:24:30.618249] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-03T18:24:30.618321] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-03T18:24:30.620000] [DEBUG] [LOCAL ] DEO: Trimmed 71509 records to 49783 (keeping 200 days of data) [2025-10-03T18:24:30.939925] [DEBUG] [LOCAL ] DEO: Primary data saved (49783 records). [2025-10-03T18:24:30.940071] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-03T18:24:30.940192] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DEO took 40.5s. Estimated remaining: 4h 3m 38s. Rate: 7.2 symbols/min [2025-10-03T18:24:31.133771] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:31.191157] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-03T18:24:31.193728] [DEBUG] [LOCAL ] DG: Loaded 53672 existing records from primary storage. [2025-10-03T18:24:31.194224] [INFO ] [MAIN ] DG: Loaded 53672 existing records. [2025-10-03T18:24:31.393955] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:31.394214] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-03T18:24:31.394267] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-03T18:24:31.396099] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-03T18:24:31.396167] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-03T18:24:31.517389] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T18:24:31.816803] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:31.990719] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-03T18:24:32.302971] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T18:24:32.790721] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-03T18:24:33.590690] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-03T18:24:33.611524] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T18:24:33.869887] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:24:34.272750] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-03T18:24:34.390702] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-03T18:24:35.190683] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-03T18:24:35.228143] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:24:35.990685] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-03T18:24:36.790671] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-03T18:24:37.153998] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T18:24:37.349259] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:24:37.590627] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-03T18:24:37.986198] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:24:38.352721] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:24:38.390712] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-03T18:24:39.191228] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T18:24:39.190841] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-03T18:24:39.990636] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-03T18:24:40.284795] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:24:40.790623] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-03T18:24:41.003448] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:24:41.005667] [INFO ] [REMOTE ] DFH: Full fetch complete (48546 records). [2025-10-03T18:24:41.005759] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-03T18:24:41.430103] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-03T18:24:41.430202] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-03T18:24:41.430912] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-03T18:24:41.430982] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-03T18:24:41.432198] [DEBUG] [LOCAL ] DFH: Trimmed 48546 records to 32660 (keeping 200 days of data) [2025-10-03T18:24:41.608437] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-03T18:24:41.645782] [DEBUG] [LOCAL ] DFH: Primary data saved (32660 records). [2025-10-03T18:24:41.645979] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-03T18:24:41.646105] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DFH took 39.3s. Estimated remaining: 4h 3m 36s. Rate: 7.2 symbols/min [2025-10-03T18:24:41.787510] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:24:41.811019] [INFO ] [REMOTE ] DFIN: Full fetch complete (33672 records). [2025-10-03T18:24:41.821674] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-03T18:24:41.904893] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:42.331092] [DEBUG] [LOCAL ] DGX: Loaded 45232 existing records from primary storage. [2025-10-03T18:24:42.390624] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-03T18:24:42.388575] [INFO ] [MAIN ] DGX: Loaded 45232 existing records. [2025-10-03T18:24:42.397269] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-03T18:24:42.426493] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-03T18:24:42.441827] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-03T18:24:42.471044] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-03T18:24:42.517479] [DEBUG] [LOCAL ] DFIN: Trimmed 33672 records to 23342 (keeping 200 days of data) [2025-10-03T18:24:42.648526] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:42.692337] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-03T18:24:42.692998] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-03T18:24:42.694559] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:24:42.697984] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-03T18:24:42.699810] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-03T18:24:43.119881] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:43.156760] [DEBUG] [LOCAL ] DFIN: Primary data saved (23342 records). [2025-10-03T18:24:43.156902] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-03T18:24:43.156988] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFIN took 32.2s. Estimated remaining: 4h 3m 9s. Rate: 7.2 symbols/min [2025-10-03T18:24:43.195712] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-03T18:24:43.356607] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:43.386262] [DEBUG] [LOCAL ] DHF: Loaded 21198 existing records from primary storage. [2025-10-03T18:24:43.386912] [INFO ] [MAIN ] DHF: Loaded 21198 existing records. [2025-10-03T18:24:43.731549] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:43.731854] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-03T18:24:43.731929] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-03T18:24:43.732390] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-03T18:24:43.732471] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-03T18:24:43.906563] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T18:24:43.913383] [INFO ] [REMOTE ] DFP: Full fetch complete (16100 records). [2025-10-03T18:24:43.933961] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-03T18:24:43.993627] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-03T18:24:44.539865] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:44.803012] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-03T18:24:44.817061] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-03T18:24:44.817875] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-03T18:24:44.818395] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-03T18:24:44.818507] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-03T18:24:44.819851] [DEBUG] [LOCAL ] DFP: Trimmed 16100 records to 11537 (keeping 200 days of data) [2025-10-03T18:24:44.917718] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-03T18:24:44.948107] [DEBUG] [LOCAL ] DFP: Primary data saved (11537 records). [2025-10-03T18:24:44.948391] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-03T18:24:44.948542] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFP took 26.0s. Estimated remaining: 4h 2m 42s. Rate: 7.2 symbols/min [2025-10-03T18:24:45.133711] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:45.197279] [DEBUG] [LOCAL ] DHI: Loaded 53731 existing records from primary storage. [2025-10-03T18:24:45.197682] [INFO ] [MAIN ] DHI: Loaded 53731 existing records. [2025-10-03T18:24:45.396785] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:45.397049] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-03T18:24:45.397103] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-03T18:24:45.399067] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-03T18:24:45.399133] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-03T18:24:45.592529] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-03T18:24:45.813205] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:45.840085] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:24:46.060780] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:24:46.390702] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-03T18:24:47.190685] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-03T18:24:47.676332] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T18:24:47.990735] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-03T18:24:48.369032] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:24:48.728691] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T18:24:48.790737] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-03T18:24:49.122040] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:24:49.590727] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-03T18:24:50.390687] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-03T18:24:50.422295] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:24:51.190684] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-03T18:24:51.420307] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:24:51.636434] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T18:24:51.990717] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-03T18:24:52.790724] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-03T18:24:53.064189] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:24:53.093551] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:24:53.590757] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-03T18:24:54.390719] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-03T18:24:54.447933] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:24:55.190685] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-03T18:24:55.655068] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T18:24:55.805896] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:24:55.990639] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-03T18:24:56.790666] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-03T18:24:57.135772] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:24:57.590630] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-03T18:24:57.879757] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:24:57.956209] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T18:24:58.390756] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-03T18:24:59.190635] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-03T18:24:59.290193] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:24:59.990628] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-03T18:25:00.385732] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T18:25:00.790735] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-03T18:25:01.317356] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:25:01.590715] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-03T18:25:01.713115] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T18:25:02.265317] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T18:25:02.390714] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-03T18:25:03.190694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-03T18:25:03.519233] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:25:03.661149] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T18:25:03.990734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-03T18:25:04.790682] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-03T18:25:04.874716] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T18:25:05.590755] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-03T18:25:05.824232] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:25:06.193178] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:25:06.390723] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-03T18:25:07.190729] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-03T18:25:07.878573] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-03T18:25:07.990733] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-03T18:25:08.225208] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:25:08.790725] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-03T18:25:09.226622] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T18:25:09.590734] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-03T18:25:10.193945] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T18:25:10.283438] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T18:25:10.390693] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-03T18:25:11.190683] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-03T18:25:11.565830] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:25:11.583781] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:25:11.586886] [INFO ] [REMOTE ] DGX: Full fetch complete (65174 records). [2025-10-03T18:25:11.587029] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-03T18:25:11.998770] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-03T18:25:12.068421] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-03T18:25:12.068547] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-03T18:25:12.069470] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-03T18:25:12.069542] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-03T18:25:12.071169] [DEBUG] [LOCAL ] DGX: Trimmed 65174 records to 45574 (keeping 200 days of data) [2025-10-03T18:25:12.370001] [DEBUG] [LOCAL ] DGX: Primary data saved (45574 records). [2025-10-03T18:25:12.370143] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-03T18:25:12.370242] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DGX took 30.7s. Estimated remaining: 4h 3m 28s. Rate: 7.2 symbols/min [2025-10-03T18:25:12.490936] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:25:12.581191] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:12.644075] [DEBUG] [LOCAL ] DHR: Loaded 53756 existing records from primary storage. [2025-10-03T18:25:12.644455] [INFO ] [MAIN ] DHR: Loaded 53756 existing records. [2025-10-03T18:25:12.795863] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-03T18:25:12.861906] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:12.862343] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-03T18:25:12.862417] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-03T18:25:12.864242] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-03T18:25:12.864308] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-03T18:25:13.269451] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:13.590702] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-03T18:25:14.079242] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:25:14.082101] [INFO ] [REMOTE ] DG: Full fetch complete (77210 records). [2025-10-03T18:25:14.082239] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-03T18:25:14.403223] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-03T18:25:14.525632] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-03T18:25:14.525791] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-03T18:25:14.526703] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-03T18:25:14.526769] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-03T18:25:14.528373] [DEBUG] [LOCAL ] DG: Trimmed 77210 records to 54057 (keeping 200 days of data) [2025-10-03T18:25:14.913439] [DEBUG] [LOCAL ] DG: Primary data saved (54057 records). [2025-10-03T18:25:14.913689] [INFO ] [MAIN ] DG: Full history saved. [2025-10-03T18:25:14.913841] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 44.0s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-03T18:25:15.115790] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:15.173353] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-03T18:25:15.201088] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-03T18:25:15.202178] [DEBUG] [LOCAL ] DHT: Loaded 48248 existing records from primary storage. [2025-10-03T18:25:15.203228] [INFO ] [MAIN ] DHT: Loaded 48248 existing records. [2025-10-03T18:25:15.400083] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:15.400536] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-03T18:25:15.400689] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-03T18:25:15.402157] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-03T18:25:15.402223] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-03T18:25:15.526519] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T18:25:15.830943] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:15.865140] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-03T18:25:15.990705] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-03T18:25:16.790735] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-03T18:25:17.329719] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:25:17.590718] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-03T18:25:18.138914] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T18:25:18.390681] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-03T18:25:18.431908] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:25:18.434101] [INFO ] [REMOTE ] DHF: Full fetch complete (30166 records). [2025-10-03T18:25:18.434202] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-03T18:25:18.868249] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:25:18.920922] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-03T18:25:18.921008] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-03T18:25:18.921548] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-03T18:25:18.921597] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-03T18:25:18.922519] [DEBUG] [LOCAL ] DHF: Trimmed 30166 records to 21451 (keeping 200 days of data) [2025-10-03T18:25:19.045945] [DEBUG] [LOCAL ] DHF: Primary data saved (21451 records). [2025-10-03T18:25:19.046079] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-03T18:25:19.046190] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DHF took 35.9s. Estimated remaining: 4h 2m 43s. Rate: 7.2 symbols/min [2025-10-03T18:25:19.200776] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-03T18:25:19.229998] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:19.231264] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-03T18:25:19.231325] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-03T18:25:19.231458] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-03T18:25:19.231510] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-03T18:25:19.231558] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-03T18:25:19.231592] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-03T18:25:19.649604] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:19.903516] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:25:19.990690] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-03T18:25:20.790719] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-03T18:25:20.889851] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:25:20.963722] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T18:25:20.966856] [INFO ] [REMOTE ] DHI: Full fetch complete (76824 records). [2025-10-03T18:25:20.967029] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-03T18:25:20.968248] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:25:20.968383] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:25:20.968474] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:25:20.968572] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-03T18:25:20.968748] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-03T18:25:20.968827] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-03T18:25:20.969269] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-03T18:25:20.969437] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 36.0s. Estimated remaining: 4h 2m 17s. Rate: 7.2 symbols/min [2025-10-03T18:25:21.170340] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:21.185686] [DEBUG] [LOCAL ] DIAX: Loaded 13011 existing records from primary storage. [2025-10-03T18:25:21.185985] [INFO ] [MAIN ] DIAX: Loaded 13011 existing records. [2025-10-03T18:25:21.389894] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:21.390150] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-03T18:25:21.390217] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-03T18:25:21.390802] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-03T18:25:21.390868] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-03T18:25:21.592395] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-03T18:25:21.802005] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:22.390764] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-03T18:25:22.671998] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:25:22.717545] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:25:23.190697] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-03T18:25:23.299454] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T18:25:23.990727] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-03T18:25:24.790632] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-03T18:25:24.830271] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:25:25.590624] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-03T18:25:25.901083] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:25:26.106976] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T18:25:26.390677] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-03T18:25:27.190739] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-03T18:25:27.402852] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:25:27.990633] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-03T18:25:28.330179] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T18:25:28.331139] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:25:28.790719] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-03T18:25:29.590750] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-03T18:25:29.867698] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:25:30.126438] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-03T18:25:30.396447] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-03T18:25:30.400466] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:25:31.190692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-03T18:25:31.974499] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T18:25:31.990623] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-03T18:25:32.186258] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:25:32.790694] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-03T18:25:33.590633] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-03T18:25:33.699257] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:25:34.080378] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T18:25:34.390728] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-03T18:25:34.713564] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T18:25:35.190675] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-03T18:25:35.429733] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T18:25:35.786734] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:25:35.990738] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-03T18:25:36.734454] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T18:25:36.790707] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-03T18:25:37.590639] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-03T18:25:37.648788] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T18:25:38.210984] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:25:38.390698] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-03T18:25:39.190676] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-03T18:25:39.979017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:25:39.990671] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-03T18:25:40.291393] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:25:40.790671] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-03T18:25:40.866679] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:25:41.590726] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-03T18:25:42.390630] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-03T18:25:42.399535] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:25:42.400638] [INFO ] [REMOTE ] DHX: Full fetch complete (20772 records). [2025-10-03T18:25:42.400765] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-03T18:25:42.812778] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-03T18:25:42.812937] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-03T18:25:42.813506] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-03T18:25:42.813671] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-03T18:25:42.814533] [DEBUG] [LOCAL ] DHX: Trimmed 20772 records to 13198 (keeping 200 days of data) [2025-10-03T18:25:42.892574] [DEBUG] [LOCAL ] DHX: Primary data saved (13198 records). [2025-10-03T18:25:42.892832] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-03T18:25:42.892956] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHX took 23.8s. Estimated remaining: 4h 2m 47s. Rate: 7.2 symbols/min [2025-10-03T18:25:43.054081] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-03T18:25:43.150964] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:43.151753] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:25:43.190685] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-03T18:25:43.204408] [DEBUG] [LOCAL ] DIN: Loaded 37507 existing records from primary storage. [2025-10-03T18:25:43.204761] [INFO ] [MAIN ] DIN: Loaded 37507 existing records. [2025-10-03T18:25:43.405555] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:43.405802] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-03T18:25:43.405857] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-03T18:25:43.407151] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-03T18:25:43.407218] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-03T18:25:43.788340] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:43.990715] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-03T18:25:44.191702] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:25:44.790727] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-03T18:25:45.590712] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-03T18:25:45.844428] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:25:46.390707] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-03T18:25:46.575536] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:25:46.621926] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T18:25:47.190729] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-03T18:25:47.990706] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-03T18:25:47.998172] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:25:47.999860] [INFO ] [REMOTE ] DIAX: Full fetch complete (17814 records). [2025-10-03T18:25:48.000077] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-03T18:25:48.411323] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-03T18:25:48.411581] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-03T18:25:48.412190] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-03T18:25:48.412365] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-03T18:25:48.413557] [DEBUG] [LOCAL ] DIAX: Trimmed 17814 records to 13148 (keeping 200 days of data) [2025-10-03T18:25:48.524291] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:25:48.552291] [DEBUG] [LOCAL ] DIAX: Primary data saved (13148 records). [2025-10-03T18:25:48.552422] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-03T18:25:48.552506] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DIAX took 27.6s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-03T18:25:48.731544] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:48.731764] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-03T18:25:48.731811] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-03T18:25:48.731927] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-03T18:25:48.731970] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-03T18:25:48.732016] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-03T18:25:48.732048] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-03T18:25:48.802030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-03T18:25:49.128661] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:49.590635] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-03T18:25:49.620483] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:25:50.390722] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-03T18:25:50.629125] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-03T18:25:50.632212] [INFO ] [REMOTE ] DHR: Full fetch complete (76887 records). [2025-10-03T18:25:50.632371] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-03T18:25:50.633429] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:25:50.633554] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:25:50.633667] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:25:50.633759] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-03T18:25:50.633848] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-03T18:25:50.633954] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-03T18:25:50.634279] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-03T18:25:50.635989] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 38.3s. Estimated remaining: 4h 2m 5s. Rate: 7.2 symbols/min [2025-10-03T18:25:50.840070] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:50.840259] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-03T18:25:50.840304] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-03T18:25:50.840440] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-03T18:25:50.840487] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-03T18:25:50.840531] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-03T18:25:50.840565] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-03T18:25:51.190933] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-03T18:25:51.235412] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:51.456626] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:25:51.900758] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T18:25:51.990723] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-03T18:25:52.790672] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-03T18:25:52.884430] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T18:25:53.565572] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:25:53.590699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-03T18:25:54.320283] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:25:54.390728] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-03T18:25:54.974488] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:25:55.190727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-03T18:25:55.990720] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-03T18:25:56.790675] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-03T18:25:56.833284] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:25:56.925953] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-03T18:25:57.563237] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:25:57.590675] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-03T18:25:58.311822] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:25:58.390683] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-03T18:25:59.023451] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:25:59.027638] [INFO ] [REMOTE ] DHT: Full fetch complete (69954 records). [2025-10-03T18:25:59.027879] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-03T18:25:59.203203] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-03T18:25:59.482825] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-03T18:25:59.482929] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-03T18:25:59.483809] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-03T18:25:59.483882] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-03T18:25:59.485503] [DEBUG] [LOCAL ] DHT: Trimmed 69954 records to 48575 (keeping 200 days of data) [2025-10-03T18:25:59.818733] [DEBUG] [LOCAL ] DHT: Primary data saved (48575 records). [2025-10-03T18:25:59.818927] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-03T18:25:59.819049] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DHT took 44.9s. Estimated remaining: 4h 1m 59s. Rate: 7.2 symbols/min [2025-10-03T18:26:00.002939] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-03T18:26:00.038312] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:00.038482] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-03T18:26:00.038522] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-03T18:26:00.038749] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-03T18:26:00.038802] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-03T18:26:00.038846] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-03T18:26:00.038900] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-03T18:26:00.239343] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:26:00.552302] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:00.790726] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-03T18:26:01.590713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-03T18:26:01.773936] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:26:01.881950] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-03T18:26:02.198683] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:26:02.370189] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:26:02.390675] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-03T18:26:02.695620] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-03T18:26:03.190710] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-03T18:26:03.634510] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:26:03.990697] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-03T18:26:04.790755] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-03T18:26:05.590721] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-03T18:26:05.810519] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:26:06.390721] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-03T18:26:06.885196] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T18:26:07.126191] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T18:26:07.190687] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-03T18:26:07.563663] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:26:07.990730] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-03T18:26:08.790697] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-03T18:26:09.278578] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:26:09.590674] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-03T18:26:09.639190] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:26:09.686552] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-03T18:26:10.390750] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-03T18:26:10.762144] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T18:26:11.078828] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:26:11.190722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-03T18:26:11.541922] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:26:11.990718] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-03T18:26:12.596419] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:26:12.790725] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-03T18:26:13.590719] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-03T18:26:14.390713] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-03T18:26:14.745373] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:26:15.190738] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-03T18:26:15.803578] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T18:26:15.995751] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-03T18:26:16.009400] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:26:16.790700] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-03T18:26:16.859335] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:26:17.163194] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:26:17.590692] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-03T18:26:18.390706] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-03T18:26:18.526326] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-03T18:26:19.190735] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-03T18:26:19.432147] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:26:19.548936] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T18:26:19.828195] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:26:19.990699] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-03T18:26:20.339665] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T18:26:20.340336] [INFO ] [REMOTE ] DIVY: Full fetch complete (1730 records). [2025-10-03T18:26:20.340406] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-03T18:26:20.543041] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T18:26:20.543261] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:26:20.543337] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:26:20.543453] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-03T18:26:20.543551] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-03T18:26:20.543611] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-03T18:26:20.543717] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-03T18:26:20.543810] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIVY took 20.7s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-03T18:26:20.739520] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:20.790350] [DEBUG] [LOCAL ] DK: Loaded 49690 existing records from primary storage. [2025-10-03T18:26:20.790686] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-03T18:26:20.790930] [INFO ] [MAIN ] DK: Loaded 49690 existing records. [2025-10-03T18:26:20.993494] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:20.993748] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-03T18:26:20.993805] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-03T18:26:20.995234] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-03T18:26:20.995297] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-03T18:26:21.391056] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:21.590676] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-03T18:26:22.390739] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-03T18:26:23.094229] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-03T18:26:23.190700] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-03T18:26:23.440214] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:26:23.861786] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T18:26:23.864434] [INFO ] [REMOTE ] DINO: Full fetch complete (76678 records). [2025-10-03T18:26:23.864550] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-03T18:26:23.995788] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-03T18:26:24.293029] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-03T18:26:24.293133] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-03T18:26:24.294074] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-03T18:26:24.294145] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-03T18:26:24.295904] [DEBUG] [LOCAL ] DINO: Trimmed 76678 records to 53696 (keeping 200 days of data) [2025-10-03T18:26:24.637403] [DEBUG] [LOCAL ] DINO: Primary data saved (53696 records). [2025-10-03T18:26:24.637553] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-03T18:26:24.637635] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DINO took 36.1s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-03T18:26:24.795944] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-03T18:26:24.825623] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:24.846276] [DEBUG] [LOCAL ] DKL: Loaded 18727 existing records from primary storage. [2025-10-03T18:26:24.846555] [INFO ] [MAIN ] DKL: Loaded 18727 existing records. [2025-10-03T18:26:25.044003] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:25.044373] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-03T18:26:25.044431] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-03T18:26:25.045104] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-03T18:26:25.045166] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-03T18:26:25.443463] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:25.530112] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T18:26:25.590635] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-03T18:26:25.699157] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:26:26.390669] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-03T18:26:26.427109] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:26:27.190715] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-03T18:26:27.915910] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-03T18:26:27.930585] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:26:27.934702] [INFO ] [REMOTE ] DIN: Full fetch complete (55228 records). [2025-10-03T18:26:27.934875] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-03T18:26:28.000700] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-03T18:26:28.411691] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-03T18:26:28.412074] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-03T18:26:28.413981] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-03T18:26:28.414196] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-03T18:26:28.416364] [DEBUG] [LOCAL ] DIN: Trimmed 55228 records to 37756 (keeping 200 days of data) [2025-10-03T18:26:28.732686] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:26:28.789229] [DEBUG] [LOCAL ] DIN: Primary data saved (37756 records). [2025-10-03T18:26:28.789441] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-03T18:26:28.789573] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DIN took 45.9s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-03T18:26:28.795146] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-03T18:26:29.045527] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:29.116942] [DEBUG] [LOCAL ] DKS: Loaded 50084 existing records from primary storage. [2025-10-03T18:26:29.117455] [INFO ] [MAIN ] DKS: Loaded 50084 existing records. [2025-10-03T18:26:29.379635] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:29.379883] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-03T18:26:29.379935] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-03T18:26:29.381455] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-03T18:26:29.381522] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-03T18:26:29.606826] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-03T18:26:29.883364] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:29.899135] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T18:26:29.900725] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T18:26:30.390690] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-03T18:26:31.190684] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-03T18:26:31.990749] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-03T18:26:32.052559] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:26:32.272312] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-03T18:26:32.468402] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:26:32.790702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-03T18:26:33.590636] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-03T18:26:33.985809] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:26:34.390690] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-03T18:26:35.056357] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T18:26:35.063960] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-03T18:26:35.064603] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-03T18:26:35.195787] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-03T18:26:35.514928] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-03T18:26:35.515172] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-03T18:26:35.516197] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-03T18:26:35.516284] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-03T18:26:35.518572] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 54568 (keeping 200 days of data) [2025-10-03T18:26:35.553221] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:26:35.924557] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-03T18:26:35.924775] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-03T18:26:35.924889] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DIS took 45.3s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-10-03T18:26:35.993719] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-03T18:26:36.115254] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:36.148890] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:26:36.183511] [DEBUG] [LOCAL ] DLB: Loaded 32228 existing records from primary storage. [2025-10-03T18:26:36.183831] [INFO ] [MAIN ] DLB: Loaded 32228 existing records. [2025-10-03T18:26:36.378914] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:36.379231] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-03T18:26:36.379327] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-03T18:26:36.385471] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-03T18:26:36.394847] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-03T18:26:36.395311] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T18:26:36.799525] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:36.795385] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-03T18:26:37.590699] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-03T18:26:37.840449] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:26:38.390726] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-03T18:26:38.437778] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:26:38.702312] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:26:39.190713] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-03T18:26:39.995763] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-03T18:26:40.015964] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:26:40.786193] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T18:26:40.793622] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-03T18:26:41.590705] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-03T18:26:41.885136] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:26:42.218226] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:26:42.390686] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-03T18:26:43.190732] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-03T18:26:43.277926] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:26:43.990697] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-03T18:26:44.179696] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:26:44.242334] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T18:26:44.790708] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-03T18:26:45.590682] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-03T18:26:45.868891] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:26:46.390632] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-03T18:26:46.406173] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T18:26:46.664168] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T18:26:47.190729] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-03T18:26:47.759180] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:26:47.990705] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-03T18:26:48.790711] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-03T18:26:48.835379] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:26:49.006569] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:26:49.590729] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-03T18:26:50.390705] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-03T18:26:50.715822] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T18:26:51.182775] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:26:51.185464] [INFO ] [REMOTE ] DK: Full fetch complete (70882 records). [2025-10-03T18:26:51.185620] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-03T18:26:51.198490] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-03T18:26:51.623601] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-03T18:26:51.623852] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-03T18:26:51.624783] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-03T18:26:51.624869] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-03T18:26:51.626528] [DEBUG] [LOCAL ] DK: Trimmed 70882 records to 50047 (keeping 200 days of data) [2025-10-03T18:26:51.879355] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:26:51.980300] [DEBUG] [LOCAL ] DK: Primary data saved (50047 records). [2025-10-03T18:26:51.980497] [INFO ] [MAIN ] DK: Full history saved. [2025-10-03T18:26:51.980618] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DK took 31.4s. Estimated remaining: 4h 1m 48s. Rate: 7.2 symbols/min [2025-10-03T18:26:51.996306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-03T18:26:52.170417] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:52.180336] [DEBUG] [LOCAL ] DLNG: Loaded 6130 existing records from primary storage. [2025-10-03T18:26:52.180565] [INFO ] [MAIN ] DLNG: Loaded 6130 existing records. [2025-10-03T18:26:52.375758] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:52.377172] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-03T18:26:52.377235] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-03T18:26:52.377940] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-03T18:26:52.378002] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-03T18:26:52.793481] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-03T18:26:52.800357] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:53.130862] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:26:53.545464] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:26:53.590725] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-03T18:26:53.725224] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:26:54.390623] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-03T18:26:54.466554] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:26:55.190779] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-03T18:26:55.990713] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-03T18:26:56.193032] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:26:56.236169] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:26:56.790685] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-03T18:26:57.140934] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T18:26:57.590683] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-03T18:26:58.390624] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-03T18:26:58.591727] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:26:58.615261] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:26:59.190686] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-03T18:26:59.722895] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:26:59.990675] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-03T18:27:00.013281] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T18:27:00.790701] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-03T18:27:01.130211] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T18:27:01.590737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-03T18:27:01.909875] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:27:01.911074] [INFO ] [REMOTE ] DKL: Full fetch complete (28582 records). [2025-10-03T18:27:01.911148] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-03T18:27:02.304529] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-03T18:27:02.304608] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-03T18:27:02.305170] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-03T18:27:02.305260] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-03T18:27:02.306129] [DEBUG] [LOCAL ] DKL: Trimmed 28582 records to 18799 (keeping 200 days of data) [2025-10-03T18:27:02.394609] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-03T18:27:02.431267] [DEBUG] [LOCAL ] DKL: Primary data saved (18799 records). [2025-10-03T18:27:02.431418] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-03T18:27:02.431504] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DKL took 37.8s. Estimated remaining: 4h 1m 45s. Rate: 7.2 symbols/min [2025-10-03T18:27:02.621311] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:02.685862] [DEBUG] [LOCAL ] DLR: Loaded 51291 existing records from primary storage. [2025-10-03T18:27:02.686216] [INFO ] [MAIN ] DLR: Loaded 51291 existing records. [2025-10-03T18:27:02.895921] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:02.896142] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-03T18:27:02.896212] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-03T18:27:02.896540] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-03T18:27:02.896601] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-03T18:27:03.199165] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T18:27:03.199256] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-03T18:27:03.311028] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T18:27:03.351521] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:03.990737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-03T18:27:04.790632] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-03T18:27:04.944249] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T18:27:04.947254] [INFO ] [REMOTE ] DKS: Full fetch complete (71591 records). [2025-10-03T18:27:04.947393] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-03T18:27:05.380894] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-03T18:27:05.381043] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-03T18:27:05.381994] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-03T18:27:05.382187] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-03T18:27:05.383874] [DEBUG] [LOCAL ] DKS: Trimmed 71591 records to 50431 (keeping 200 days of data) [2025-10-03T18:27:05.505279] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:27:05.607319] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-03T18:27:05.758667] [DEBUG] [LOCAL ] DKS: Primary data saved (50431 records). [2025-10-03T18:27:05.758832] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-03T18:27:05.759858] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DKS took 37.0s. Estimated remaining: 4h 1m 23s. Rate: 7.2 symbols/min [2025-10-03T18:27:05.882697] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T18:27:05.965408] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:06.002246] [DEBUG] [LOCAL ] DLX: Loaded 28713 existing records from primary storage. [2025-10-03T18:27:06.002579] [INFO ] [MAIN ] DLX: Loaded 28713 existing records. [2025-10-03T18:27:06.221054] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:06.221269] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-03T18:27:06.221318] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-03T18:27:06.221933] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-03T18:27:06.221996] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-03T18:27:06.392525] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-03T18:27:06.624386] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:06.859781] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T18:27:06.861751] [INFO ] [REMOTE ] DLB: Full fetch complete (46959 records). [2025-10-03T18:27:06.861942] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-03T18:27:07.199805] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-03T18:27:07.300074] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-03T18:27:07.300172] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-03T18:27:07.300923] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-03T18:27:07.300993] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-03T18:27:07.302320] [DEBUG] [LOCAL ] DLB: Trimmed 46959 records to 32449 (keeping 200 days of data) [2025-10-03T18:27:07.424696] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T18:27:07.538273] [DEBUG] [LOCAL ] DLB: Primary data saved (32449 records). [2025-10-03T18:27:07.538428] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-03T18:27:07.538519] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 31.6s. Estimated remaining: 4h 0m 57s. Rate: 7.2 symbols/min [2025-10-03T18:27:07.740863] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:07.763800] [DEBUG] [LOCAL ] DLY: Loaded 20149 existing records from primary storage. [2025-10-03T18:27:07.764059] [INFO ] [MAIN ] DLY: Loaded 20149 existing records. [2025-10-03T18:27:07.947745] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:07.947974] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-03T18:27:07.948023] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-03T18:27:07.948227] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-03T18:27:07.948285] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-03T18:27:07.995891] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-03T18:27:08.321403] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:08.676836] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T18:27:08.790678] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-03T18:27:09.129092] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:27:09.403534] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:27:09.590729] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-03T18:27:10.390741] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-03T18:27:10.832630] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:27:10.972579] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T18:27:11.190726] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-03T18:27:11.990715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-03T18:27:12.305618] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T18:27:12.790701] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-03T18:27:13.399193] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:27:13.590704] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-03T18:27:13.788936] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T18:27:14.390718] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-03T18:27:14.873420] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:27:14.933982] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T18:27:14.934974] [INFO ] [REMOTE ] DLNG: Full fetch complete (11918 records). [2025-10-03T18:27:14.935051] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-03T18:27:15.195822] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-03T18:27:15.327675] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-03T18:27:15.327775] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-03T18:27:15.328121] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-03T18:27:15.328165] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-03T18:27:15.328746] [DEBUG] [LOCAL ] DLNG: Trimmed 11918 records to 6166 (keeping 200 days of data) [2025-10-03T18:27:15.366674] [DEBUG] [LOCAL ] DLNG: Primary data saved (6166 records). [2025-10-03T18:27:15.366857] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-03T18:27:15.366970] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 23.4s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-03T18:27:15.601987] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:15.609117] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-10-03T18:27:15.609425] [INFO ] [MAIN ] DMA: Loaded 4570 existing records. [2025-10-03T18:27:15.816746] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:15.817003] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-03T18:27:15.817059] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-03T18:27:15.817266] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-03T18:27:15.817326] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-03T18:27:16.011217] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-03T18:27:16.250564] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:16.519973] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T18:27:16.790690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-03T18:27:17.315061] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:27:17.590739] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-03T18:27:18.192929] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T18:27:18.234261] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T18:27:18.390691] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-03T18:27:19.190720] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-03T18:27:19.990688] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-03T18:27:20.136726] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:27:20.212010] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:27:20.790761] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-03T18:27:21.281990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:27:21.590716] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-03T18:27:22.300078] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:27:22.320600] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:27:22.390709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-03T18:27:22.956816] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T18:27:23.190719] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-03T18:27:23.990719] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-03T18:27:24.790680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-03T18:27:24.963080] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:27:25.272144] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T18:27:25.293338] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:27:25.590637] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-03T18:27:26.159733] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T18:27:26.390730] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-03T18:27:27.077442] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T18:27:27.190675] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-03T18:27:27.710454] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T18:27:27.990717] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-03T18:27:28.790635] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-03T18:27:29.101810] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:27:29.590701] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-03T18:27:30.251607] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T18:27:30.390677] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-03T18:27:30.753086] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:27:31.190713] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-03T18:27:31.717780] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:27:31.990720] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-03T18:27:32.644081] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:27:32.790707] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-03T18:27:32.923747] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:27:33.507697] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:27:33.590681] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-03T18:27:34.390716] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-03T18:27:34.732867] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T18:27:34.987497] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:27:35.190620] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-03T18:27:35.703035] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:27:35.704034] [INFO ] [REMOTE ] DMA: Full fetch complete (6624 records). [2025-10-03T18:27:35.704151] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-03T18:27:35.995855] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-03T18:27:36.091448] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-03T18:27:36.091557] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-03T18:27:36.091891] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-03T18:27:36.091956] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-03T18:27:36.092434] [DEBUG] [LOCAL ] DMA: Trimmed 6624 records to 4595 (keeping 200 days of data) [2025-10-03T18:27:36.121550] [DEBUG] [LOCAL ] DMA: Primary data saved (4595 records). [2025-10-03T18:27:36.121747] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-03T18:27:36.121865] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DMA took 20.8s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-03T18:27:36.308854] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:36.322242] [DEBUG] [LOCAL ] DMB: Loaded 10281 existing records from primary storage. [2025-10-03T18:27:36.322518] [INFO ] [MAIN ] DMB: Loaded 10281 existing records. [2025-10-03T18:27:36.504863] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:36.505169] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-03T18:27:36.505226] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-03T18:27:36.505555] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-03T18:27:36.505628] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-03T18:27:36.795917] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-03T18:27:36.899505] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:36.952814] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:27:37.590706] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-03T18:27:38.390827] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-03T18:27:38.602531] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T18:27:38.913183] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T18:27:39.190714] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-03T18:27:39.291613] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:27:39.990628] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-03T18:27:40.382161] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T18:27:40.790712] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-03T18:27:40.947043] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:27:41.590693] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-03T18:27:41.796454] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:27:42.390704] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-03T18:27:42.931136] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T18:27:43.190724] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-03T18:27:43.990732] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-03T18:27:44.215869] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:27:44.218192] [INFO ] [REMOTE ] DLX: Full fetch complete (41432 records). [2025-10-03T18:27:44.218412] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-03T18:27:44.592416] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:27:44.697339] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-03T18:27:44.697456] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-03T18:27:44.698443] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-03T18:27:44.698517] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-03T18:27:44.699777] [DEBUG] [LOCAL ] DLX: Trimmed 41432 records to 28911 (keeping 200 days of data) [2025-10-03T18:27:44.794392] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-03T18:27:44.817933] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:27:44.914758] [DEBUG] [LOCAL ] DLX: Primary data saved (28911 records). [2025-10-03T18:27:44.915020] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-03T18:27:44.915183] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 39.2s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-03T18:27:45.114277] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:45.127249] [DEBUG] [LOCAL ] DMO: Loaded 9961 existing records from primary storage. [2025-10-03T18:27:45.127490] [INFO ] [MAIN ] DMO: Loaded 9961 existing records. [2025-10-03T18:27:45.329221] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:45.329466] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-03T18:27:45.329530] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-03T18:27:45.329793] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-03T18:27:45.329854] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-03T18:27:45.595776] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-03T18:27:45.716864] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:45.883697] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:27:46.390730] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-03T18:27:47.109785] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T18:27:47.162403] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:27:47.190635] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-03T18:27:47.908227] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:27:47.990683] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-03T18:27:48.790749] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-03T18:27:48.849261] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:27:49.590719] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-03T18:27:49.637511] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T18:27:50.390716] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-03T18:27:51.190670] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-03T18:27:51.224134] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:27:51.226798] [INFO ] [REMOTE ] DLR: Full fetch complete (74078 records). [2025-10-03T18:27:51.226952] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-03T18:27:51.354986] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:27:51.705636] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-03T18:27:51.705765] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-03T18:27:51.706741] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-03T18:27:51.706809] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-03T18:27:51.708458] [DEBUG] [LOCAL ] DLR: Trimmed 74078 records to 51668 (keeping 200 days of data) [2025-10-03T18:27:52.004616] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-03T18:27:52.054157] [DEBUG] [LOCAL ] DLR: Primary data saved (51668 records). [2025-10-03T18:27:52.054337] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-03T18:27:52.054458] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLR took 49.6s. Estimated remaining: 4h 0m 54s. Rate: 7.2 symbols/min [2025-10-03T18:27:52.263572] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:52.310284] [DEBUG] [LOCAL ] DNA: Loaded 48642 existing records from primary storage. [2025-10-03T18:27:52.310620] [INFO ] [MAIN ] DNA: Loaded 48642 existing records. [2025-10-03T18:27:52.419969] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:27:52.447036] [INFO ] [REMOTE ] DLY: Full fetch complete (28488 records). [2025-10-03T18:27:52.462703] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-03T18:27:52.608929] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:52.638738] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-03T18:27:52.639212] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-03T18:27:52.665618] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-03T18:27:52.680629] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-03T18:27:52.824556] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-03T18:27:52.937573] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T18:27:53.357218] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:53.357525] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-03T18:27:53.357792] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-03T18:27:53.358827] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-03T18:27:53.358897] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-03T18:27:53.360102] [DEBUG] [LOCAL ] DLY: Trimmed 28488 records to 20380 (keeping 200 days of data) [2025-10-03T18:27:53.487861] [DEBUG] [LOCAL ] DLY: Primary data saved (20380 records). [2025-10-03T18:27:53.487989] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-03T18:27:53.488102] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DLY took 45.9s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-03T18:27:53.595951] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-03T18:27:53.727429] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:53.777391] [DEBUG] [LOCAL ] DNOW: Loaded 44016 existing records from primary storage. [2025-10-03T18:27:53.777734] [INFO ] [MAIN ] DNOW: Loaded 44016 existing records. [2025-10-03T18:27:53.902579] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T18:27:54.002367] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:54.002691] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-03T18:27:54.002766] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-03T18:27:54.003058] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-03T18:27:54.003132] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-03T18:27:54.408349] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:54.401461] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-03T18:27:54.410920] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T18:27:55.174684] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T18:27:55.190612] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-03T18:27:55.940150] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T18:27:55.990681] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-03T18:27:56.790705] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-03T18:27:56.840764] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:27:57.590673] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-03T18:27:58.207943] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:27:58.326251] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:27:58.327684] [INFO ] [REMOTE ] DMB: Full fetch complete (14995 records). [2025-10-03T18:27:58.327764] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-03T18:27:58.395916] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-03T18:27:58.724945] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-03T18:27:58.725027] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-03T18:27:58.725390] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-03T18:27:58.725432] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-03T18:27:58.725984] [DEBUG] [LOCAL ] DMB: Trimmed 14995 records to 10319 (keeping 200 days of data) [2025-10-03T18:27:58.793693] [DEBUG] [LOCAL ] DMB: Primary data saved (10319 records). [2025-10-03T18:27:58.793846] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-03T18:27:58.793959] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMB took 22.7s. Estimated remaining: 4h 0m 11s. Rate: 7.2 symbols/min [2025-10-03T18:27:58.976808] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:59.011989] [DEBUG] [LOCAL ] DNP: Loaded 33447 existing records from primary storage. [2025-10-03T18:27:59.012317] [INFO ] [MAIN ] DNP: Loaded 33447 existing records. [2025-10-03T18:27:59.216315] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:59.208439] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-03T18:27:59.217842] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-03T18:27:59.217903] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-03T18:27:59.218422] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-03T18:27:59.218482] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-03T18:27:59.618457] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:59.990702] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-03T18:28:00.298765] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:28:00.790675] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-03T18:28:01.232965] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:28:01.321137] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:28:01.590695] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-03T18:28:01.696472] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:28:02.390748] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-03T18:28:02.919721] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:28:03.190738] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-03T18:28:03.970333] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:28:03.990620] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-03T18:28:04.704143] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:28:04.790725] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-03T18:28:05.590693] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-03T18:28:06.010407] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:28:06.067772] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:28:06.390721] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-03T18:28:07.197740] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-03T18:28:07.201089] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:28:07.223487] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T18:28:07.990693] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-03T18:28:08.790705] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-03T18:28:09.078411] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:28:09.237792] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T18:28:09.590680] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-03T18:28:09.709574] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:28:10.339619] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:28:10.390761] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-03T18:28:11.190700] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-03T18:28:11.994931] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-03T18:28:11.999550] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:28:12.790628] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-03T18:28:13.123800] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T18:28:13.590636] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-03T18:28:13.689683] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:28:13.773809] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:28:14.390728] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-03T18:28:15.096449] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T18:28:15.190632] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-03T18:28:15.280013] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:28:15.990686] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-03T18:28:16.234840] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:28:16.790701] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-03T18:28:17.515157] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:28:17.590747] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-03T18:28:18.306829] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:28:18.366781] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:28:18.390622] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-03T18:28:19.048418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T18:28:19.049490] [INFO ] [REMOTE ] DMO: Full fetch complete (14470 records). [2025-10-03T18:28:19.049564] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-03T18:28:19.202931] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-03T18:28:19.450116] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-03T18:28:19.450206] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-03T18:28:19.450562] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-03T18:28:19.450625] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-03T18:28:19.451265] [DEBUG] [LOCAL ] DMO: Trimmed 14470 records to 10026 (keeping 200 days of data) [2025-10-03T18:28:19.514212] [DEBUG] [LOCAL ] DMO: Primary data saved (10026 records). [2025-10-03T18:28:19.514388] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-03T18:28:19.514495] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMO took 34.6s. Estimated remaining: 4h 0m 36s. Rate: 7.2 symbols/min [2025-10-03T18:28:19.694522] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:19.751879] [DEBUG] [LOCAL ] DOC: Loaded 53930 existing records from primary storage. [2025-10-03T18:28:19.752213] [INFO ] [MAIN ] DOC: Loaded 53930 existing records. [2025-10-03T18:28:19.943462] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:19.943728] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-03T18:28:19.943787] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-03T18:28:19.944036] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-03T18:28:19.944096] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-03T18:28:19.995788] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-03T18:28:20.340631] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:20.790698] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-03T18:28:21.036003] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:28:21.422086] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:28:21.590713] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-03T18:28:22.349325] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T18:28:22.390684] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-03T18:28:23.190682] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-03T18:28:23.641125] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T18:28:23.990635] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-03T18:28:24.175263] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:28:24.368372] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T18:28:24.790704] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-03T18:28:25.590672] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-03T18:28:25.825814] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:28:26.201496] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:28:26.390698] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-03T18:28:27.151373] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:28:27.190622] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-03T18:28:27.990638] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-03T18:28:28.079571] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:28:28.649187] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:28:28.790685] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-03T18:28:29.590526] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:28:29.590737] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-03T18:28:30.390701] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-03T18:28:30.677253] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T18:28:30.681098] [INFO ] [REMOTE ] DNA: Full fetch complete (70977 records). [2025-10-03T18:28:30.681276] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-03T18:28:30.960967] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:28:31.062694] [INFO ] [REMOTE ] DNOW: Full fetch complete (62994 records). [2025-10-03T18:28:31.098836] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-03T18:28:31.208194] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-03T18:28:31.517899] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-03T18:28:31.529493] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-03T18:28:31.557305] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-03T18:28:31.593463] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-03T18:28:31.707205] [DEBUG] [LOCAL ] DNA: Trimmed 70977 records to 49019 (keeping 200 days of data) [2025-10-03T18:28:32.030507] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-03T18:28:32.031055] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-03T18:28:32.032791] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-03T18:28:32.033306] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-03T18:28:32.037155] [DEBUG] [LOCAL ] DNOW: Trimmed 62994 records to 44313 (keeping 200 days of data) [2025-10-03T18:28:32.399415] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:28:32.412932] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-03T18:28:32.455032] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T18:28:32.573020] [DEBUG] [LOCAL ] DNA: Primary data saved (49019 records). [2025-10-03T18:28:32.574324] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-03T18:28:32.574477] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNA took 40.5s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-03T18:28:32.611169] [DEBUG] [LOCAL ] DNOW: Primary data saved (44313 records). [2025-10-03T18:28:32.611357] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-03T18:28:32.612992] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNOW took 39.1s. Estimated remaining: 4h 0m 10s. Rate: 7.2 symbols/min [2025-10-03T18:28:32.790695] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-03T18:28:33.745672] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T18:28:33.754037] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-03T18:28:34.711916] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:28:34.728084] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-03T18:28:34.734674] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:28:34.737219] [INFO ] [REMOTE ] DNP: Full fetch complete (49254 records). [2025-10-03T18:28:34.737363] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-03T18:28:35.162851] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-03T18:28:35.162940] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-03T18:28:35.163623] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-03T18:28:35.163706] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-03T18:28:35.164954] [DEBUG] [LOCAL ] DNP: Trimmed 49254 records to 33654 (keeping 200 days of data) [2025-10-03T18:28:35.377193] [DEBUG] [LOCAL ] DNP: Primary data saved (33654 records). [2025-10-03T18:28:35.377344] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-03T18:28:35.377435] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNP took 36.6s. Estimated remaining: 3h 59m 47s. Rate: 7.2 symbols/min [2025-10-03T18:28:36.618820] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T18:28:36.631471] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-03T18:28:38.451638] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:28:38.463123] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-03T18:28:40.434507] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T18:28:40.447074] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-03T18:28:42.386616] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:28:42.398740] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-03T18:28:44.421434] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:28:44.434213] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-03T18:28:46.166914] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:28:46.169666] [INFO ] [REMOTE ] DOC: Full fetch complete (77388 records). [2025-10-03T18:28:46.169794] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-03T18:28:46.615110] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-03T18:28:46.615272] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-03T18:28:46.616179] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-03T18:28:46.616246] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-03T18:28:46.617828] [DEBUG] [LOCAL ] DOC: Trimmed 77388 records to 54318 (keeping 200 days of data) [2025-10-03T18:28:46.969051] [DEBUG] [LOCAL ] DOC: Primary data saved (54318 records). [2025-10-03T18:28:46.969196] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-03T18:28:46.970834] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 27.5s. Estimated remaining: 3h 59m 47s. Rate: 7.2 symbols/min [2025-10-03T18:28:47.679678] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.686582] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.704405] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.809395] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.876630] [DEBUG] [LOCAL ] DOUG: Loaded 34608 existing records from primary storage. [2025-10-03T18:28:47.886298] [DEBUG] [LOCAL ] DOCN: Loaded 50952 existing records from primary storage. [2025-10-03T18:28:47.886551] [INFO ] [MAIN ] DOUG: Loaded 34608 existing records. [2025-10-03T18:28:47.892328] [INFO ] [MAIN ] DOCN: Loaded 50952 existing records. [2025-10-03T18:28:48.101761] [DEBUG] [LOCAL ] DOLE: Loaded 38730 existing records from primary storage. [2025-10-03T18:28:48.133955] [INFO ] [MAIN ] DOLE: Loaded 38730 existing records. [2025-10-03T18:28:48.183047] [DEBUG] [LOCAL ] DOCS: Loaded 51492 existing records from primary storage. [2025-10-03T18:28:48.220755] [INFO ] [MAIN ] DOCS: Loaded 51492 existing records. [2025-10-03T18:28:48.425189] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.530171] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.635849] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.635963] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-03T18:28:48.657319] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.662835] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-03T18:28:48.685132] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-03T18:28:48.711422] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-03T18:28:48.695708] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-03T18:28:48.768289] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-03T18:28:48.775111] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.855922] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.855810] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.923525] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.928919] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-03T18:28:48.912308] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-03T18:28:48.951548] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-03T18:28:48.977445] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-03T18:28:48.977365] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-03T18:28:49.055708] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-03T18:28:50.263014] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.365721] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.348978] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-03T18:28:50.430775] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.386855] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-03T18:28:50.449043] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-03T18:28:50.475306] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.475722] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-03T18:28:51.713894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:28:51.721475] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-03T18:28:51.956893] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:28:51.970398] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-03T18:28:52.004592] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:28:52.016282] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-03T18:28:52.045439] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T18:28:52.054570] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-03T18:28:52.127995] [DEBUG] [REMOTE ] DOCS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T18:28:52.128389] [WARN ] [REMOTE ] DOCS: No data returned for month 2025-01 [2025-10-03T18:28:52.128514] [FATAL] [REMOTE ] DOCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:28:52.128708] [FATAL] [MAIN ] DOCS: Failed to fetch primary data. [2025-10-03T18:28:52.128802] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:28:52.128892] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-03T18:28:52.128979] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-03T18:28:52.129034] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-03T18:28:52.129439] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-03T18:28:52.129549] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOCS took 5.2s. Estimated remaining: 3h 59m 30s. Rate: 7.2 symbols/min [2025-10-03T18:28:52.326937] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:52.381572] [DEBUG] [LOCAL ] DOV: Loaded 45755 existing records from primary storage. [2025-10-03T18:28:52.381916] [INFO ] [MAIN ] DOV: Loaded 45755 existing records. [2025-10-03T18:28:52.570532] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:52.570790] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-03T18:28:52.570843] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-03T18:28:52.572298] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-03T18:28:52.572361] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-03T18:28:52.996058] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T18:28:53.022439] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:53.031786] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-03T18:28:53.032342] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-03T18:28:53.430553] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:28:53.438935] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-03T18:28:53.667041] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:28:53.677057] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-03T18:28:54.393266] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:28:54.402877] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-03T18:28:54.478130] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T18:28:54.486895] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-03T18:28:54.800860] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:28:54.809345] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-03T18:28:54.944517] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:28:54.955034] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-03T18:28:55.380948] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T18:28:55.389017] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-03T18:28:56.073503] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:28:56.083172] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-03T18:28:56.195396] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T18:28:56.233566] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:28:56.232001] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-03T18:28:56.245161] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-03T18:28:56.800315] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T18:28:56.809284] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-03T18:28:57.601561] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T18:28:57.612256] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-03T18:28:57.676884] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:28:57.686368] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-03T18:28:57.716634] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:28:57.730358] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-03T18:28:58.266272] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:28:58.390692] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-03T18:28:59.021310] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T18:28:59.190634] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-03T18:28:59.362422] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:28:59.496687] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:28:59.793508] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:28:59.990710] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-03T18:29:00.173051] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:29:00.790707] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-03T18:29:01.590735] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-03T18:29:01.855721] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T18:29:02.390707] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-03T18:29:02.934680] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T18:29:03.190673] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-03T18:29:03.538091] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:29:03.990697] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-03T18:29:04.179248] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:29:04.537217] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:29:04.790710] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-03T18:29:05.350064] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:29:05.590683] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-03T18:29:06.300663] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:29:06.390685] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-03T18:29:06.522300] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T18:29:07.190716] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-03T18:29:07.988564] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:29:07.992986] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-03T18:29:08.374738] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:29:08.376537] [INFO ] [REMOTE ] DOUG: Full fetch complete (50991 records). [2025-10-03T18:29:08.376708] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-03T18:29:08.800953] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-03T18:29:08.823252] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-03T18:29:08.823358] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-03T18:29:08.824162] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-03T18:29:08.824278] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-03T18:29:08.826361] [DEBUG] [LOCAL ] DOUG: Trimmed 50991 records to 34792 (keeping 200 days of data) [2025-10-03T18:29:09.032721] [DEBUG] [LOCAL ] DOUG: Primary data saved (34792 records). [2025-10-03T18:29:09.032881] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-03T18:29:09.033037] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOUG took 22.0s. Estimated remaining: 3h 59m 45s. Rate: 7.2 symbols/min [2025-10-03T18:29:09.219946] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:09.277483] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-03T18:29:09.277852] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-03T18:29:09.477996] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:09.478305] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-03T18:29:09.478368] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-03T18:29:09.478743] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-03T18:29:09.478802] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-03T18:29:09.592718] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-03T18:29:09.884044] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:09.912628] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T18:29:10.390693] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-03T18:29:10.451471] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:29:11.190688] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-03T18:29:11.604008] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:29:11.990724] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-03T18:29:12.393481] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:29:12.486128] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:29:12.790724] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-03T18:29:13.391130] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T18:29:13.393808] [INFO ] [REMOTE ] DOCN: Full fetch complete (71853 records). [2025-10-03T18:29:13.393914] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-03T18:29:13.601796] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-03T18:29:13.823977] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-03T18:29:13.824069] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-03T18:29:13.825023] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-03T18:29:13.825103] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-03T18:29:13.829747] [DEBUG] [LOCAL ] DOCN: Trimmed 71853 records to 51332 (keeping 200 days of data) [2025-10-03T18:29:14.141006] [DEBUG] [LOCAL ] DOCN: Primary data saved (51332 records). [2025-10-03T18:29:14.141172] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-03T18:29:14.141309] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOCN took 27.2s. Estimated remaining: 3h 59m 28s. Rate: 7.2 symbols/min [2025-10-03T18:29:14.345245] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:14.343492] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:29:14.345486] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-10-03T18:29:14.347179] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-10-03T18:29:14.347808] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-03T18:29:14.347862] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-03T18:29:14.347908] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-03T18:29:14.347941] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-03T18:29:14.348050] [INFO ] [REMOTE ] DOLE: Full fetch complete (53957 records). [2025-10-03T18:29:14.353326] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-03T18:29:14.409596] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-03T18:29:15.129459] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:15.188833] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-03T18:29:15.188957] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-03T18:29:15.189717] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-03T18:29:15.189791] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-03T18:29:15.190672] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-03T18:29:15.192056] [DEBUG] [LOCAL ] DOLE: Trimmed 53957 records to 39011 (keeping 200 days of data) [2025-10-03T18:29:15.438078] [DEBUG] [LOCAL ] DOLE: Primary data saved (39011 records). [2025-10-03T18:29:15.438231] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-03T18:29:15.438327] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOLE took 28.5s. Estimated remaining: 3h 59m 1s. Rate: 7.2 symbols/min [2025-10-03T18:29:15.629045] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:15.665394] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T18:29:15.713683] [DEBUG] [LOCAL ] DQ: Loaded 43712 existing records from primary storage. [2025-10-03T18:29:15.714010] [INFO ] [MAIN ] DQ: Loaded 43712 existing records. [2025-10-03T18:29:15.920911] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:15.921136] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-03T18:29:15.921188] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-03T18:29:15.921508] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-03T18:29:15.921567] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-03T18:29:15.997567] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-03T18:29:16.363824] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:16.365685] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:29:16.408158] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T18:29:16.790703] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-03T18:29:17.590731] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-03T18:29:18.286964] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-03T18:29:18.390630] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-03T18:29:18.665956] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:29:19.190692] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-03T18:29:19.246592] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:29:19.990686] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-03T18:29:20.015136] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T18:29:20.264045] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:29:20.790697] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-03T18:29:21.528191] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:29:21.590691] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-03T18:29:21.653620] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:29:22.390692] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-03T18:29:23.056903] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T18:29:23.190688] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-03T18:29:23.891738] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T18:29:23.895243] [INFO ] [REMOTE ] DOV: Full fetch complete (64898 records). [2025-10-03T18:29:23.895457] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-03T18:29:23.896621] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:29:23.896776] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:29:23.896858] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:29:23.896959] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-03T18:29:23.897075] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-03T18:29:23.897136] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-10-03T18:29:23.897462] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-10-03T18:29:23.898744] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DOV took 31.8s. Estimated remaining: 3h 58m 53s. Rate: 7.2 symbols/min [2025-10-03T18:29:23.990952] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-03T18:29:24.184449] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:24.185962] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-10-03T18:29:24.187124] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:29:24.187288] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-10-03T18:29:24.193887] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-03T18:29:24.194092] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-03T18:29:24.194159] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-03T18:29:24.194199] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-03T18:29:24.746954] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:24.790736] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-03T18:29:25.590697] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-03T18:29:25.715408] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:29:26.381744] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-03T18:29:26.395285] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-03T18:29:27.098510] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:29:27.190698] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-03T18:29:27.639742] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:29:27.990714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-03T18:29:28.790688] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-03T18:29:28.988205] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:29:29.027536] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:29:29.590701] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-03T18:29:29.910205] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:29:30.172048] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:29:30.390676] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-03T18:29:31.190703] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-03T18:29:31.990708] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-03T18:29:32.020688] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:29:32.201224] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:29:32.790696] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-03T18:29:33.590691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-03T18:29:33.726612] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T18:29:34.119716] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:29:34.390704] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-03T18:29:34.487304] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T18:29:35.190680] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-03T18:29:35.359320] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:29:35.990730] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-03T18:29:36.732213] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:29:36.733352] [INFO ] [REMOTE ] DPG: Full fetch complete (18997 records). [2025-10-03T18:29:36.733448] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-03T18:29:36.803134] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-03T18:29:37.191771] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-03T18:29:37.191858] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-03T18:29:37.192349] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-03T18:29:37.192415] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-03T18:29:37.193156] [DEBUG] [LOCAL ] DPG: Trimmed 18997 records to 13698 (keeping 200 days of data) [2025-10-03T18:29:37.281545] [DEBUG] [LOCAL ] DPG: Primary data saved (13698 records). [2025-10-03T18:29:37.281737] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-03T18:29:37.281829] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DPG took 23.1s. Estimated remaining: 3h 58m 58s. Rate: 7.2 symbols/min [2025-10-03T18:29:37.477623] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:37.514244] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T18:29:37.575276] [DEBUG] [LOCAL ] DRH: Loaded 50844 existing records from primary storage. [2025-10-03T18:29:37.575615] [INFO ] [MAIN ] DRH: Loaded 50844 existing records. [2025-10-03T18:29:37.597159] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-03T18:29:37.773413] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:37.773670] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-03T18:29:37.773745] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-03T18:29:37.775103] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-03T18:29:37.775166] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-03T18:29:38.167199] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:38.390700] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-03T18:29:38.529110] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:29:39.190738] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-03T18:29:39.403379] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:29:39.990709] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-03T18:29:40.140958] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:29:40.790736] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-03T18:29:40.942784] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:29:41.415257] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:29:41.590728] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-03T18:29:42.056236] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:29:42.390705] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-03T18:29:43.190744] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-03T18:29:43.845245] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T18:29:43.879552] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:29:43.990757] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-03T18:29:44.795750] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-03T18:29:44.811134] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:29:45.590722] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-03T18:29:45.924862] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:29:46.198326] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T18:29:46.390691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-03T18:29:47.190730] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-03T18:29:47.398552] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T18:29:47.401702] [INFO ] [REMOTE ] DOW: Full fetch complete (77401 records). [2025-10-03T18:29:47.401881] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-03T18:29:47.402985] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:29:47.403700] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:29:47.403790] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:29:47.403883] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-03T18:29:47.403985] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-03T18:29:47.404059] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-10-03T18:29:47.404393] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-10-03T18:29:47.405279] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOW took 38.4s. Estimated remaining: 3h 58m 55s. Rate: 7.2 symbols/min [2025-10-03T18:29:47.616183] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:47.667481] [DEBUG] [LOCAL ] DRI: Loaded 48135 existing records from primary storage. [2025-10-03T18:29:47.667878] [INFO ] [MAIN ] DRI: Loaded 48135 existing records. [2025-10-03T18:29:47.862194] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:47.862504] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-03T18:29:47.862582] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-03T18:29:47.864499] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-03T18:29:47.864616] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-03T18:29:47.991070] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-03T18:29:48.029880] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:29:48.292712] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:48.721075] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T18:29:48.790702] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-03T18:29:49.590723] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-03T18:29:49.691518] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:29:50.390632] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-03T18:29:50.440726] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:29:51.191392] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-03T18:29:51.191311] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T18:29:51.990717] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-03T18:29:52.610052] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T18:29:52.713268] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T18:29:52.790688] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-03T18:29:53.551090] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T18:29:53.590702] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-03T18:29:54.339749] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:29:54.390638] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-03T18:29:55.197263] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-03T18:29:55.203741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:29:55.589958] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:29:55.990691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-03T18:29:56.779411] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:29:56.781870] [INFO ] [REMOTE ] DQ: Full fetch complete (63080 records). [2025-10-03T18:29:56.782002] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-03T18:29:56.796442] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-03T18:29:57.207807] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-03T18:29:57.207917] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-03T18:29:57.209094] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-03T18:29:57.209172] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-03T18:29:57.210737] [DEBUG] [LOCAL ] DQ: Trimmed 63080 records to 44035 (keeping 200 days of data) [2025-10-03T18:29:57.481910] [DEBUG] [LOCAL ] DQ: Primary data saved (44035 records). [2025-10-03T18:29:57.482153] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-03T18:29:57.482361] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DQ took 42.0s. Estimated remaining: 3h 58m 51s. Rate: 7.2 symbols/min [2025-10-03T18:29:57.596703] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-03T18:29:57.711311] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:57.713407] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T18:29:57.733737] [DEBUG] [LOCAL ] DRLL: Loaded 9485 existing records from primary storage. [2025-10-03T18:29:57.733976] [INFO ] [MAIN ] DRLL: Loaded 9485 existing records. [2025-10-03T18:29:57.926545] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:57.926809] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-03T18:29:57.926860] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-03T18:29:57.927147] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-03T18:29:57.927221] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-03T18:29:58.322369] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:58.390701] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-03T18:29:58.438235] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:29:59.047027] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T18:29:59.190627] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-03T18:29:59.575709] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:29:59.990706] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-03T18:30:00.752443] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:30:00.790660] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-03T18:30:01.590741] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-03T18:30:01.865325] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T18:30:02.218331] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T18:30:02.390711] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-03T18:30:03.190693] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-03T18:30:03.317258] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:30:03.319669] [INFO ] [REMOTE ] DRD: Full fetch complete (50036 records). [2025-10-03T18:30:03.319794] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-03T18:30:03.766293] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-03T18:30:03.766420] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-03T18:30:03.767372] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-03T18:30:03.767465] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-03T18:30:03.769297] [DEBUG] [LOCAL ] DRD: Trimmed 50036 records to 37644 (keeping 200 days of data) [2025-10-03T18:30:03.994199] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-03T18:30:04.030156] [DEBUG] [LOCAL ] DRD: Primary data saved (37644 records). [2025-10-03T18:30:04.030332] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-03T18:30:04.030463] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DRD took 40.1s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-03T18:30:04.230271] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:04.261835] [DEBUG] [LOCAL ] DSL: Loaded 28612 existing records from primary storage. [2025-10-03T18:30:04.262155] [INFO ] [MAIN ] DSL: Loaded 28612 existing records. [2025-10-03T18:30:04.458989] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:04.459377] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-03T18:30:04.459429] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-03T18:30:04.460594] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-03T18:30:04.460684] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-03T18:30:04.665112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T18:30:04.795932] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-03T18:30:04.919511] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:05.071508] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:30:05.325807] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:30:05.590688] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-03T18:30:06.390727] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-03T18:30:06.479045] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:30:06.793985] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T18:30:07.190736] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-03T18:30:07.711049] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:30:07.990724] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-03T18:30:08.215631] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:30:08.790707] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-03T18:30:09.590627] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-03T18:30:09.766112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:30:09.897383] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:30:10.390731] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-03T18:30:11.190742] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-03T18:30:11.314905] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:30:11.317466] [INFO ] [REMOTE ] DRH: Full fetch complete (71535 records). [2025-10-03T18:30:11.317612] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-03T18:30:11.318685] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:30:11.318783] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:30:11.318828] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:30:11.318869] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-03T18:30:11.318945] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-03T18:30:11.319070] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-03T18:30:11.319313] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-03T18:30:11.319428] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRH took 34.0s. Estimated remaining: 3h 58m 27s. Rate: 7.2 symbols/min [2025-10-03T18:30:11.504581] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:11.520706] [DEBUG] [LOCAL ] DSM: Loaded 15196 existing records from primary storage. [2025-10-03T18:30:11.521038] [INFO ] [MAIN ] DSM: Loaded 15196 existing records. [2025-10-03T18:30:11.720909] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:11.721164] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-03T18:30:11.721246] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-03T18:30:11.721988] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-03T18:30:11.722051] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-03T18:30:11.992817] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-03T18:30:12.090129] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T18:30:12.174942] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:12.216727] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:30:12.790753] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-03T18:30:13.285865] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:30:13.590730] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-03T18:30:14.390677] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-03T18:30:14.872472] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-03T18:30:15.193502] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-03T18:30:15.196357] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:30:15.990774] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-03T18:30:16.614092] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T18:30:16.654434] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T18:30:16.790792] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-03T18:30:17.230096] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T18:30:17.590726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-03T18:30:18.382470] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:30:18.385270] [INFO ] [REMOTE ] DRI: Full fetch complete (69594 records). [2025-10-03T18:30:18.385433] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-03T18:30:18.398774] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-03T18:30:18.721660] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:30:18.866952] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-03T18:30:18.867071] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-03T18:30:18.868238] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-03T18:30:18.868306] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-03T18:30:18.869836] [DEBUG] [LOCAL ] DRI: Trimmed 69594 records to 48491 (keeping 200 days of data) [2025-10-03T18:30:19.185303] [DEBUG] [LOCAL ] DRI: Primary data saved (48491 records). [2025-10-03T18:30:19.185451] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-03T18:30:19.186461] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRI took 31.8s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-03T18:30:19.197998] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-03T18:30:19.388589] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:19.388883] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-03T18:30:19.388941] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-03T18:30:19.389054] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-03T18:30:19.389098] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-03T18:30:19.389140] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-03T18:30:19.389173] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-03T18:30:19.699779] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:30:19.852745] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:19.990699] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-03T18:30:20.114078] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:30:20.790692] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-03T18:30:21.022977] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:30:21.334305] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T18:30:21.335243] [INFO ] [REMOTE ] DRLL: Full fetch complete (15222 records). [2025-10-03T18:30:21.335318] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-03T18:30:21.335799] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:30:21.335889] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:30:21.335963] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:30:21.336041] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-03T18:30:21.336148] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-03T18:30:21.336207] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-03T18:30:21.336503] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-03T18:30:21.336636] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DRLL took 23.9s. Estimated remaining: 3h 57m 53s. Rate: 7.2 symbols/min [2025-10-03T18:30:21.527993] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:21.554175] [DEBUG] [LOCAL ] DSU: Loaded 22729 existing records from primary storage. [2025-10-03T18:30:21.554449] [INFO ] [MAIN ] DSU: Loaded 22729 existing records. [2025-10-03T18:30:21.596065] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-03T18:30:21.757594] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:21.757826] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-03T18:30:21.757877] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-03T18:30:21.758165] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-03T18:30:21.758238] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-03T18:30:22.148090] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:22.390689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-03T18:30:22.717695] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:30:23.190695] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-03T18:30:23.618209] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T18:30:23.724978] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-03T18:30:23.990703] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-03T18:30:24.410460] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:30:24.790699] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-03T18:30:25.590730] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-03T18:30:25.821345] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:30:26.390705] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-03T18:30:26.833016] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:30:26.876183] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T18:30:27.190679] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-03T18:30:27.748821] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T18:30:27.990682] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-03T18:30:28.531799] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:30:28.790684] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-03T18:30:29.590684] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-03T18:30:30.018550] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:30:30.390697] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-03T18:30:30.575089] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T18:30:30.820830] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:30:31.190725] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-03T18:30:31.990704] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-03T18:30:32.222418] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T18:30:32.790713] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-03T18:30:33.464218] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:30:33.590699] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-03T18:30:33.986193] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T18:30:34.390698] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-03T18:30:34.410346] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T18:30:35.190682] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-03T18:30:35.212613] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T18:30:35.691854] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:30:35.990733] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-03T18:30:36.790703] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-03T18:30:37.354561] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T18:30:37.590691] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-03T18:30:37.894493] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T18:30:38.390622] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-03T18:30:38.467558] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T18:30:39.190706] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-03T18:30:39.530755] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:30:39.990689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-03T18:30:40.042049] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:30:40.790714] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-03T18:30:41.482381] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:30:41.590727] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-03T18:30:42.081794] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T18:30:42.390741] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-03T18:30:42.427137] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T18:30:42.816823] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T18:30:43.190730] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-03T18:30:43.990702] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-03T18:30:44.032712] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:30:44.033856] [INFO ] [REMOTE ] DSM: Full fetch complete (24474 records). [2025-10-03T18:30:44.033939] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-03T18:30:44.433695] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-03T18:30:44.433798] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-03T18:30:44.434324] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-03T18:30:44.434388] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-03T18:30:44.435318] [DEBUG] [LOCAL ] DSM: Trimmed 24474 records to 15256 (keeping 200 days of data) [2025-10-03T18:30:44.526726] [DEBUG] [LOCAL ] DSM: Primary data saved (15256 records). [2025-10-03T18:30:44.526928] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-03T18:30:44.527072] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSM took 33.2s. Estimated remaining: 3h 58m 24s. Rate: 7.2 symbols/min [2025-10-03T18:30:44.769911] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:44.793283] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-03T18:30:44.806976] [DEBUG] [LOCAL ] DSX: Loaded 24147 existing records from primary storage. [2025-10-03T18:30:44.807346] [INFO ] [MAIN ] DSX: Loaded 24147 existing records. [2025-10-03T18:30:44.998787] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:44.999198] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-03T18:30:44.999359] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-03T18:30:44.999771] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-03T18:30:44.999836] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-03T18:30:45.393124] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:30:45.397120] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:45.590748] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-03T18:30:45.863173] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:30:46.219604] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:30:46.390710] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-03T18:30:47.190707] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-03T18:30:47.597525] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:30:47.600923] [INFO ] [REMOTE ] DSL: Full fetch complete (41562 records). [2025-10-03T18:30:47.601206] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-03T18:30:48.005727] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-03T18:30:48.024169] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-03T18:30:48.024276] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-03T18:30:48.025141] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-03T18:30:48.025208] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-03T18:30:48.026573] [DEBUG] [LOCAL ] DSL: Trimmed 41562 records to 28880 (keeping 200 days of data) [2025-10-03T18:30:48.217700] [DEBUG] [LOCAL ] DSL: Primary data saved (28880 records). [2025-10-03T18:30:48.217913] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-03T18:30:48.218023] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DSL took 44.2s. Estimated remaining: 3h 58m 3s. Rate: 7.2 symbols/min [2025-10-03T18:30:48.421576] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:48.423486] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:30:48.497901] [DEBUG] [LOCAL ] DT: Loaded 53316 existing records from primary storage. [2025-10-03T18:30:48.498415] [INFO ] [MAIN ] DT: Loaded 53316 existing records. [2025-10-03T18:30:48.685959] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:48.686311] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-03T18:30:48.686378] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-03T18:30:48.686711] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-03T18:30:48.686775] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-03T18:30:48.793788] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-03T18:30:49.064867] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:49.342269] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T18:30:49.590711] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-03T18:30:49.732370] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:30:50.095589] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T18:30:50.096495] [INFO ] [REMOTE ] DSMC: Full fetch complete (2884 records). [2025-10-03T18:30:50.096578] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-03T18:30:50.399333] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-03T18:30:50.489404] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-03T18:30:50.489545] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-03T18:30:50.489697] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-03T18:30:50.489762] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-03T18:30:50.490118] [DEBUG] [LOCAL ] DSMC: Trimmed 2884 records to 1903 (keeping 200 days of data) [2025-10-03T18:30:50.502552] [DEBUG] [LOCAL ] DSMC: Primary data saved (1903 records). [2025-10-03T18:30:50.502661] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-03T18:30:50.502770] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSMC took 31.3s. Estimated remaining: 3h 57m 39s. Rate: 7.2 symbols/min [2025-10-03T18:30:50.685994] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:50.701758] [DEBUG] [LOCAL ] DTB: Loaded 4947 existing records from primary storage. [2025-10-03T18:30:50.702052] [INFO ] [MAIN ] DTB: Loaded 4947 existing records. [2025-10-03T18:30:50.891008] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:50.891219] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-03T18:30:50.891268] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-03T18:30:50.891495] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-03T18:30:50.891554] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-03T18:30:51.195901] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-03T18:30:51.284762] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:51.609144] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:30:51.990724] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-03T18:30:52.790808] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-03T18:30:53.340877] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T18:30:53.354231] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:30:53.590767] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-03T18:30:53.629390] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T18:30:54.390736] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-03T18:30:54.861349] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T18:30:55.190754] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-03T18:30:55.734475] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:30:55.990747] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-03T18:30:56.578092] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:30:56.790722] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-03T18:30:56.915349] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:30:57.155158] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T18:30:57.590719] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-03T18:30:58.205927] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T18:30:58.390701] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-03T18:30:58.939158] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T18:30:59.190725] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-03T18:30:59.783551] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:30:59.990715] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-03T18:31:00.790728] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-03T18:31:01.322846] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T18:31:01.438257] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:31:01.590741] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-03T18:31:02.390724] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-03T18:31:02.668066] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:31:03.190720] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-03T18:31:03.211438] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T18:31:03.990685] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-03T18:31:04.530787] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T18:31:04.790723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-03T18:31:05.010188] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:31:05.590703] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-03T18:31:06.194725] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:31:06.390703] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-03T18:31:06.758845] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:31:06.889489] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T18:31:07.190775] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-03T18:31:07.990758] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-03T18:31:08.790679] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-03T18:31:08.993544] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:31:09.217937] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:31:09.367847] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:31:09.369095] [INFO ] [REMOTE ] DTB: Full fetch complete (6824 records). [2025-10-03T18:31:09.369175] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-03T18:31:09.369705] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:31:09.369796] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:09.369843] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:09.369886] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-03T18:31:09.369970] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-03T18:31:09.370027] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-03T18:31:09.370269] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-03T18:31:09.370390] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DTB took 18.9s. Estimated remaining: 3h 57m 59s. Rate: 7.2 symbols/min [2025-10-03T18:31:09.581773] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:09.590672] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-03T18:31:09.654951] [DEBUG] [LOCAL ] DTE: Loaded 48040 existing records from primary storage. [2025-10-03T18:31:09.655459] [INFO ] [MAIN ] DTE: Loaded 48040 existing records. [2025-10-03T18:31:09.836048] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:09.836355] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-03T18:31:09.836411] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-03T18:31:09.836837] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-03T18:31:09.836901] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-03T18:31:10.236238] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:10.390764] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-03T18:31:11.190739] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-03T18:31:11.747579] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T18:31:11.762614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:31:11.990731] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-03T18:31:12.790634] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-03T18:31:13.010171] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:31:13.131087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:31:13.590728] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-03T18:31:13.952689] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T18:31:13.954440] [INFO ] [REMOTE ] DSU: Full fetch complete (32859 records). [2025-10-03T18:31:13.954520] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-03T18:31:14.365585] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-03T18:31:14.365724] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-03T18:31:14.366574] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-03T18:31:14.366667] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-03T18:31:14.367986] [DEBUG] [LOCAL ] DSU: Trimmed 32859 records to 22916 (keeping 200 days of data) [2025-10-03T18:31:14.430902] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-03T18:31:14.527609] [DEBUG] [LOCAL ] DSU: Primary data saved (22916 records). [2025-10-03T18:31:14.527815] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-03T18:31:14.527921] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DSU took 53.2s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-03T18:31:14.678702] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:31:14.740042] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:14.740318] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-03T18:31:14.740358] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-03T18:31:14.740492] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-03T18:31:14.740538] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-03T18:31:14.740582] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-03T18:31:14.740617] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-03T18:31:15.122712] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:15.190688] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-03T18:31:15.990668] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-03T18:31:16.094056] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:31:16.138710] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:31:16.790729] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-03T18:31:16.999881] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:31:17.001320] [INFO ] [REMOTE ] DSX: Full fetch complete (36316 records). [2025-10-03T18:31:17.001410] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-03T18:31:17.002006] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:31:17.002116] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:17.002163] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:17.002233] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-03T18:31:17.002308] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-03T18:31:17.002344] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-03T18:31:17.002552] [DEBUG] [LOCAL ] DSX: Deleted derivative data file. [2025-10-03T18:31:17.002672] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DSX took 32.5s. Estimated remaining: 3h 57m 18s. Rate: 7.2 symbols/min [2025-10-03T18:31:17.179965] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:17.180264] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-03T18:31:17.180321] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-03T18:31:17.180452] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-03T18:31:17.180496] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-03T18:31:17.180538] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-03T18:31:17.180572] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-03T18:31:17.572329] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:17.590754] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-03T18:31:18.063251] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:31:18.353857] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:31:18.390669] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-03T18:31:19.190686] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-03T18:31:19.286301] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:31:19.990726] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-03T18:31:20.641910] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:31:20.790636] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-03T18:31:20.980567] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:31:21.227055] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:31:21.590697] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-03T18:31:22.215520] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T18:31:22.390695] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-03T18:31:23.190774] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-03T18:31:23.786127] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T18:31:23.990777] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-03T18:31:24.340817] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:31:24.533876] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:31:24.790710] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-03T18:31:25.221323] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:31:25.590702] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-03T18:31:25.881062] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-03T18:31:26.390754] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-03T18:31:26.762118] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:31:27.190795] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-03T18:31:27.956132] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:31:27.990637] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-03T18:31:28.637974] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:31:28.790735] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-03T18:31:29.476828] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T18:31:29.590715] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-03T18:31:30.390778] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-03T18:31:30.744091] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:31:31.190761] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-03T18:31:31.332417] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:31:31.726272] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T18:31:31.990725] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-03T18:31:32.790681] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-03T18:31:33.564800] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:31:33.590712] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-03T18:31:33.854600] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:31:34.262046] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T18:31:34.390740] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-03T18:31:35.182250] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:31:35.190620] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-03T18:31:35.808261] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:31:35.990713] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-03T18:31:36.790695] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-03T18:31:37.408373] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:31:37.409263] [INFO ] [REMOTE ] DTF: Full fetch complete (2061 records). [2025-10-03T18:31:37.409390] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-03T18:31:37.598587] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-03T18:31:37.624427] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T18:31:37.625662] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:37.625849] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:37.625931] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-03T18:31:37.626035] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-03T18:31:37.626092] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-03T18:31:37.626171] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-03T18:31:37.626301] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DTF took 23.1s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-03T18:31:37.819745] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:37.820097] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-03T18:31:37.820176] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-03T18:31:37.820329] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-03T18:31:37.820395] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-03T18:31:37.820514] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-03T18:31:37.820743] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-03T18:31:38.171801] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:31:38.259563] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:38.390714] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-03T18:31:38.596597] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:31:38.597030] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-03T18:31:38.597156] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:31:38.597263] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-03T18:31:38.597339] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:31:38.597420] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-03T18:31:38.597526] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-03T18:31:38.597590] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-03T18:31:38.597721] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-03T18:31:38.597795] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTK took 1.0s. Estimated remaining: 3h 57m 15s. Rate: 7.2 symbols/min [2025-10-03T18:31:38.807405] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:38.862538] [DEBUG] [LOCAL ] DTM: Loaded 44445 existing records from primary storage. [2025-10-03T18:31:38.862890] [INFO ] [MAIN ] DTM: Loaded 44445 existing records. [2025-10-03T18:31:39.082559] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:39.083028] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-03T18:31:39.083084] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-03T18:31:39.083630] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-03T18:31:39.083740] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-03T18:31:39.195831] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-03T18:31:39.505476] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:39.538054] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:31:39.975981] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:31:39.976919] [INFO ] [REMOTE ] DTG: Full fetch complete (8949 records). [2025-10-03T18:31:39.977017] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-03T18:31:39.999352] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-03T18:31:40.369074] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-03T18:31:40.369160] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-03T18:31:40.369387] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-03T18:31:40.369426] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-03T18:31:40.369929] [DEBUG] [LOCAL ] DTG: Trimmed 8949 records to 6011 (keeping 200 days of data) [2025-10-03T18:31:40.411041] [DEBUG] [LOCAL ] DTG: Primary data saved (6011 records). [2025-10-03T18:31:40.411197] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-03T18:31:40.411286] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTG took 23.4s. Estimated remaining: 3h 56m 49s. Rate: 7.2 symbols/min [2025-10-03T18:31:40.593280] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:40.604062] [DEBUG] [LOCAL ] DTW: Loaded 4936 existing records from primary storage. [2025-10-03T18:31:40.604269] [INFO ] [MAIN ] DTW: Loaded 4936 existing records. [2025-10-03T18:31:40.806389] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-03T18:31:40.814020] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:40.814325] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-03T18:31:40.814381] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-03T18:31:40.814572] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-03T18:31:40.814631] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-03T18:31:41.231962] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:41.539071] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:31:41.590710] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-03T18:31:42.390744] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-03T18:31:42.482997] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:31:42.553619] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:31:43.190724] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-03T18:31:43.860993] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T18:31:43.990684] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-03T18:31:44.311564] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:31:44.479829] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:31:44.790703] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-03T18:31:45.427358] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:31:45.590686] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-03T18:31:46.390707] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-03T18:31:47.190733] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-03T18:31:47.529562] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:31:47.784210] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:31:47.813681] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T18:31:47.990709] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-03T18:31:48.790736] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-03T18:31:49.424979] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:31:49.594717] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-03T18:31:49.600272] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:31:50.390716] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-03T18:31:50.983142] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:31:51.190686] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-03T18:31:51.216174] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T18:31:51.219798] [INFO ] [REMOTE ] DT: Full fetch complete (76673 records). [2025-10-03T18:31:51.219946] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-03T18:31:51.682732] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-03T18:31:51.682827] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-03T18:31:51.683788] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-03T18:31:51.683858] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-03T18:31:51.685601] [DEBUG] [LOCAL ] DT: Trimmed 76673 records to 53705 (keeping 200 days of data) [2025-10-03T18:31:52.004499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-03T18:31:52.059862] [DEBUG] [LOCAL ] DT: Primary data saved (53705 records). [2025-10-03T18:31:52.060042] [INFO ] [MAIN ] DT: Full history saved. [2025-10-03T18:31:52.061349] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DT took 1m 4s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-03T18:31:52.251846] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:52.326363] [DEBUG] [LOCAL ] DUK: Loaded 53845 existing records from primary storage. [2025-10-03T18:31:52.326812] [INFO ] [MAIN ] DUK: Loaded 53845 existing records. [2025-10-03T18:31:52.533189] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:52.533414] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-03T18:31:52.533463] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-03T18:31:52.533801] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-03T18:31:52.533861] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-03T18:31:52.794993] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-03T18:31:52.949019] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:52.987420] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T18:31:52.988792] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:31:53.590734] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-03T18:31:54.390668] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-03T18:31:54.507369] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T18:31:55.190635] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-03T18:31:55.301593] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T18:31:55.990683] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-03T18:31:56.153706] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:31:56.617411] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:31:56.790699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-03T18:31:56.939776] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:31:57.590698] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-03T18:31:58.390685] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-03T18:31:58.587528] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:31:58.986449] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T18:31:58.988872] [INFO ] [REMOTE ] DTE: Full fetch complete (68899 records). [2025-10-03T18:31:58.988982] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-03T18:31:59.199269] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-03T18:31:59.438770] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-03T18:31:59.438867] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-03T18:31:59.440250] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-03T18:31:59.440355] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-03T18:31:59.442568] [DEBUG] [LOCAL ] DTE: Trimmed 68899 records to 48375 (keeping 200 days of data) [2025-10-03T18:31:59.798491] [DEBUG] [LOCAL ] DTE: Primary data saved (48375 records). [2025-10-03T18:31:59.798682] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-03T18:31:59.799465] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTE took 50.4s. Estimated remaining: 3h 56m 40s. Rate: 7.2 symbols/min [2025-10-03T18:31:59.995627] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-03T18:31:59.988401] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:32:00.038331] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:00.045379] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:32:00.059159] [DEBUG] [LOCAL ] DUKB: Loaded 6410 existing records from primary storage. [2025-10-03T18:32:00.059421] [INFO ] [MAIN ] DUKB: Loaded 6410 existing records. [2025-10-03T18:32:00.248805] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:00.249050] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-03T18:32:00.249099] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-03T18:32:00.249300] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-03T18:32:00.249358] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-03T18:32:00.642562] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:00.790705] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-03T18:32:01.590701] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-03T18:32:01.732693] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T18:32:01.733566] [INFO ] [REMOTE ] DTW: Full fetch complete (7536 records). [2025-10-03T18:32:01.733662] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-03T18:32:01.734136] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:32:01.734239] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:32:01.734289] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:32:01.734384] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-03T18:32:01.734469] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-03T18:32:01.734543] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-03T18:32:01.734834] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-03T18:32:01.734954] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTW took 21.3s. Estimated remaining: 3h 56m 15s. Rate: 7.2 symbols/min [2025-10-03T18:32:01.978014] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:01.980303] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T18:32:02.049280] [DEBUG] [LOCAL ] DV: Loaded 51670 existing records from primary storage. [2025-10-03T18:32:02.049636] [INFO ] [MAIN ] DV: Loaded 51670 existing records. [2025-10-03T18:32:02.244884] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:02.245138] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-03T18:32:02.245207] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-03T18:32:02.245458] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-03T18:32:02.245518] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-03T18:32:02.395802] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-03T18:32:02.647537] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:03.190715] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-03T18:32:03.225616] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:32:03.990731] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-03T18:32:04.790668] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-03T18:32:05.112628] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:32:05.590715] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-03T18:32:05.603298] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T18:32:06.104309] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T18:32:06.390675] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-03T18:32:07.153244] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:32:07.190633] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-03T18:32:07.735596] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (5.34 seconds). [2025-10-03T18:32:07.990699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-03T18:32:08.659457] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T18:32:08.790759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-03T18:32:09.590741] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-03T18:32:09.608137] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T18:32:09.905707] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-03T18:32:10.390692] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-03T18:32:10.502378] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-03T18:32:11.190708] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-03T18:32:11.850742] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T18:32:11.990704] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-03T18:32:12.080233] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:32:12.371428] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:32:12.790697] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-03T18:32:12.849962] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:32:13.590686] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-03T18:32:14.390709] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-03T18:32:14.902990] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-03T18:32:15.028516] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T18:32:15.190680] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-03T18:32:15.803495] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T18:32:15.990694] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-03T18:32:16.790699] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-03T18:32:16.932609] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:32:17.312931] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T18:32:17.315014] [INFO ] [REMOTE ] DTM: Full fetch complete (64494 records). [2025-10-03T18:32:17.315258] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-03T18:32:17.316935] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:32:17.317161] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:32:17.317284] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:32:17.317402] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-03T18:32:17.317513] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-03T18:32:17.317589] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-03T18:32:17.317950] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-03T18:32:17.318099] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DTM took 38.7s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-03T18:32:17.507592] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:17.547371] [DEBUG] [LOCAL ] DVA: Loaded 41335 existing records from primary storage. [2025-10-03T18:32:17.547689] [INFO ] [MAIN ] DVA: Loaded 41335 existing records. [2025-10-03T18:32:17.595788] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-03T18:32:17.738217] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:17.738452] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-03T18:32:17.738504] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-03T18:32:17.738796] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-03T18:32:17.738864] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-03T18:32:18.150224] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:18.210922] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:32:18.352238] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:32:18.390633] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-03T18:32:19.190734] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-03T18:32:19.990724] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-03T18:32:20.239505] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:32:20.790629] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-03T18:32:21.041626] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:32:21.590672] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-03T18:32:22.346761] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:32:22.348627] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T18:32:22.390683] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-03T18:32:22.570366] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:32:23.190719] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-03T18:32:23.990664] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-03T18:32:24.335195] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:32:24.764696] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:32:24.790624] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-03T18:32:25.590673] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-03T18:32:25.707479] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T18:32:26.292798] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T18:32:26.390681] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-03T18:32:26.473677] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:32:27.190722] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-03T18:32:27.990723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-03T18:32:28.232305] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:32:28.790671] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-03T18:32:28.859835] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:32:28.891841] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:32:29.590673] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-03T18:32:30.044731] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T18:32:30.359809] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:32:30.362412] [INFO ] [REMOTE ] DV: Full fetch complete (73542 records). [2025-10-03T18:32:30.362563] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-03T18:32:30.395782] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-03T18:32:30.793744] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-03T18:32:30.793844] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-03T18:32:30.794688] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-03T18:32:30.794755] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-03T18:32:30.796273] [DEBUG] [LOCAL ] DV: Trimmed 73542 records to 52046 (keeping 200 days of data) [2025-10-03T18:32:31.126334] [DEBUG] [LOCAL ] DV: Primary data saved (52046 records). [2025-10-03T18:32:31.126511] [INFO ] [MAIN ] DV: Full history saved. [2025-10-03T18:32:31.126637] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DV took 29.4s. Estimated remaining: 3h 56m 31s. Rate: 7.2 symbols/min [2025-10-03T18:32:31.200339] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-03T18:32:31.319807] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:31.369751] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-03T18:32:31.370137] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-03T18:32:31.560683] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:31.560935] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-03T18:32:31.560991] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-03T18:32:31.561214] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-03T18:32:31.561276] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-03T18:32:31.960581] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:31.990689] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-03T18:32:32.372244] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:32:32.595338] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:32:32.790617] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-03T18:32:33.022484] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T18:32:33.026051] [INFO ] [REMOTE ] DUK: Full fetch complete (77403 records). [2025-10-03T18:32:33.026187] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-03T18:32:33.463183] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-03T18:32:33.463325] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-03T18:32:33.464384] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-03T18:32:33.464465] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-03T18:32:33.466291] [DEBUG] [LOCAL ] DUK: Trimmed 77403 records to 54233 (keeping 200 days of data) [2025-10-03T18:32:33.590814] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-03T18:32:33.829774] [DEBUG] [LOCAL ] DUK: Primary data saved (54233 records). [2025-10-03T18:32:33.829927] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-03T18:32:33.830766] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 41.8s. Estimated remaining: 3h 56m 9s. Rate: 7.2 symbols/min [2025-10-03T18:32:34.011991] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:34.066006] [DEBUG] [LOCAL ] DX: Loaded 52848 existing records from primary storage. [2025-10-03T18:32:34.066362] [INFO ] [MAIN ] DX: Loaded 52848 existing records. [2025-10-03T18:32:34.248688] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T18:32:34.270771] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:34.274525] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-03T18:32:34.275074] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-03T18:32:34.275524] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-03T18:32:34.275601] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-03T18:32:34.394433] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-03T18:32:34.553729] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:32:34.743718] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:35.190741] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-03T18:32:35.990718] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-03T18:32:36.705736] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:32:36.790695] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-03T18:32:36.811824] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T18:32:36.812693] [INFO ] [REMOTE ] DUKB: Full fetch complete (9473 records). [2025-10-03T18:32:36.812837] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-03T18:32:37.186784] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-03T18:32:37.273507] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-03T18:32:37.273591] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-03T18:32:37.273850] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-03T18:32:37.273911] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-03T18:32:37.274441] [DEBUG] [LOCAL ] DUKB: Trimmed 9473 records to 6427 (keeping 200 days of data) [2025-10-03T18:32:37.314712] [DEBUG] [LOCAL ] DUKB: Primary data saved (6427 records). [2025-10-03T18:32:37.314853] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-03T18:32:37.314972] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DUKB took 37.5s. Estimated remaining: 3h 55m 48s. Rate: 7.2 symbols/min [2025-10-03T18:32:37.507529] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:37.507764] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-03T18:32:37.507813] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-03T18:32:37.507936] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-03T18:32:37.507980] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-03T18:32:37.508025] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-03T18:32:37.508061] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-03T18:32:37.595847] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-03T18:32:37.900256] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:38.390634] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-03T18:32:38.721940] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:32:39.190716] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-03T18:32:39.851937] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T18:32:39.935275] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:32:39.990745] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-03T18:32:40.790705] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-03T18:32:40.859291] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:32:41.590747] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-03T18:32:41.955995] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:32:42.390633] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-03T18:32:42.474962] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T18:32:43.190674] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-03T18:32:43.287635] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:32:43.990708] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-03T18:32:44.417669] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:32:44.457367] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T18:32:44.790705] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-03T18:32:45.558074] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:32:45.590673] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-03T18:32:46.390726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-03T18:32:46.896263] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:32:47.190743] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-03T18:32:47.403930] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:32:47.654840] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T18:32:47.657224] [INFO ] [REMOTE ] DVA: Full fetch complete (59859 records). [2025-10-03T18:32:47.657398] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-03T18:32:47.994989] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-03T18:32:48.097731] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-03T18:32:48.097829] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-03T18:32:48.098668] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-03T18:32:48.098736] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-03T18:32:48.100065] [DEBUG] [LOCAL ] DVA: Trimmed 59859 records to 41630 (keeping 200 days of data) [2025-10-03T18:32:48.358634] [DEBUG] [LOCAL ] DVA: Primary data saved (41630 records). [2025-10-03T18:32:48.358795] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-03T18:32:48.358893] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DVA took 31.0s. Estimated remaining: 3h 55m 47s. Rate: 7.2 symbols/min [2025-10-03T18:32:48.565942] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:48.604779] [DEBUG] [LOCAL ] DXYZ: Loaded 37235 existing records from primary storage. [2025-10-03T18:32:48.605081] [INFO ] [MAIN ] DXYZ: Loaded 37235 existing records. [2025-10-03T18:32:48.791726] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:48.791957] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-03T18:32:48.792209] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-03T18:32:48.793133] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-03T18:32:48.793459] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-03T18:32:48.793518] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-03T18:32:49.177147] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:49.213826] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:32:49.590690] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-03T18:32:50.165426] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T18:32:50.390707] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-03T18:32:50.468983] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:32:51.190734] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-03T18:32:51.990694] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-03T18:32:52.058577] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:32:52.257882] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:32:52.790706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-03T18:32:53.099022] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:32:53.590697] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-03T18:32:53.638576] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:32:54.390716] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-03T18:32:55.038320] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T18:32:55.190705] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-03T18:32:55.543830] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T18:32:55.584022] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:32:55.990736] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-03T18:32:56.790678] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-03T18:32:57.203624] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-03T18:32:57.305206] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:32:57.590732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-03T18:32:58.402762] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-03T18:32:58.408826] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:32:58.842196] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T18:32:59.190704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-03T18:32:59.990697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-03T18:33:00.130370] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T18:33:00.790739] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-03T18:33:01.590745] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-03T18:33:02.052068] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-03T18:33:02.119720] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:33:02.390698] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-03T18:33:03.190699] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-03T18:33:03.737179] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-03T18:33:03.990683] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-03T18:33:04.118665] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-03T18:33:04.790735] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-03T18:33:05.027692] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:33:05.476505] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-03T18:33:05.590723] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-03T18:33:06.390680] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-03T18:33:06.849102] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:33:07.190704] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-03T18:33:07.364401] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (3.37 seconds). [2025-10-03T18:33:07.514012] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T18:33:07.990679] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-03T18:33:08.389994] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T18:33:08.790741] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-03T18:33:09.590700] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-03T18:33:10.013421] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:33:10.224671] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-03T18:33:10.228690] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-03T18:33:10.228883] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-03T18:33:10.394165] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-03T18:33:10.600299] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T18:33:10.639680] [INFO ] [REMOTE ] DX: Full fetch complete (75478 records). [2025-10-03T18:33:10.656605] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-03T18:33:10.767749] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-03T18:33:10.808355] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-03T18:33:10.823507] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-03T18:33:10.829508] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-03T18:33:10.906437] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-10-03T18:33:11.175460] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:33:11.222768] [INFO ] [REMOTE ] DXC: Full fetch complete (69415 records). [2025-10-03T18:33:11.239120] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-03T18:33:11.326935] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-03T18:33:11.351629] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-03T18:33:11.364875] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-03T18:33:11.378153] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-03T18:33:11.468779] [DEBUG] [LOCAL ] DX: Trimmed 75478 records to 53234 (keeping 200 days of data) [2025-10-03T18:33:12.036611] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-03T18:33:12.037237] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-03T18:33:12.039326] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-03T18:33:12.041115] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-03T18:33:12.050168] [DEBUG] [LOCAL ] DXC: Trimmed 69415 records to 50520 (keeping 200 days of data) [2025-10-03T18:33:12.547516] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T18:33:12.625979] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-03T18:33:12.874835] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-10-03T18:33:12.875751] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-03T18:33:12.876471] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DVN took 41.7s. Estimated remaining: 3h 56m 19s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.118822] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.190377] [DEBUG] [LOCAL ] DX: Primary data saved (53234 records). [2025-10-03T18:33:13.194676] [INFO ] [MAIN ] DX: Full history saved. [2025-10-03T18:33:13.194562] [DEBUG] [LOCAL ] DXC: Primary data saved (50520 records). [2025-10-03T18:33:13.194819] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-03T18:33:13.196945] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DX took 39.4s. Estimated remaining: 3h 55m 51s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.197371] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DXC took 35.9s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.440958] [DEBUG] [LOCAL ] DY: Loaded 29225 existing records from primary storage. [2025-10-03T18:33:13.445558] [INFO ] [MAIN ] DY: Loaded 29225 existing records. [2025-10-03T18:33:13.620881] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.702037] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.852827] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:13.853306] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-03T18:33:13.853381] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-03T18:33:13.853696] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-03T18:33:13.853782] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-03T18:33:14.055206] [DEBUG] [LOCAL ] EAF: Loaded 42985 existing records from primary storage. [2025-10-03T18:33:14.037195] [DEBUG] [LOCAL ] E: Loaded 33524 existing records from primary storage. [2025-10-03T18:33:14.079729] [INFO ] [MAIN ] E: Loaded 33524 existing records. [2025-10-03T18:33:14.105221] [INFO ] [MAIN ] EAF: Loaded 42985 existing records. [2025-10-03T18:33:14.690310] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:14.720616] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:14.738352] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-03T18:33:14.745125] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:14.745587] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-03T18:33:14.746010] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-03T18:33:14.745809] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-03T18:33:14.747377] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-03T18:33:14.747786] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-03T18:33:14.747852] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-03T18:33:14.747894] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-03T18:33:14.767488] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-03T18:33:15.494779] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:15.513862] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-03T18:33:15.555098] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-10-03T18:33:15.590692] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:15.598887] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-03T18:33:15.600502] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-03T18:33:16.690837] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:33:16.703147] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-03T18:33:17.305314] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:33:17.313934] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-03T18:33:17.726732] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T18:33:17.737974] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-03T18:33:17.801450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:33:17.809780] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-03T18:33:18.331529] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:33:18.390697] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-03T18:33:18.654467] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:33:19.197200] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-03T18:33:19.216937] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T18:33:19.716362] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:33:19.851450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T18:33:19.990690] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-03T18:33:20.550775] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:33:20.790698] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-03T18:33:21.590703] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-03T18:33:21.991078] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T18:33:21.994136] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57779 records). [2025-10-03T18:33:21.994281] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-03T18:33:22.410089] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-03T18:33:22.452350] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-03T18:33:22.455953] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-03T18:33:22.456917] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-03T18:33:22.457417] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-03T18:33:22.458602] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:33:22.469584] [DEBUG] [LOCAL ] DXYZ: Trimmed 57779 records to 37604 (keeping 200 days of data) [2025-10-03T18:33:22.711053] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37604 records). [2025-10-03T18:33:22.711219] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-03T18:33:22.711342] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DXYZ took 34.4s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-03T18:33:22.903876] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:22.904145] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-03T18:33:22.904205] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-03T18:33:22.904321] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-03T18:33:22.904365] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-03T18:33:22.904410] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-03T18:33:22.904444] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-03T18:33:23.194230] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-03T18:33:23.252931] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:33:23.344594] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:23.934520] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:33:23.990715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-03T18:33:24.744274] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:33:24.790715] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-03T18:33:25.590684] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-03T18:33:25.622128] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:33:25.656467] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:33:26.390691] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-03T18:33:26.979495] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:33:27.094904] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:33:27.190746] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-03T18:33:27.990708] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-03T18:33:28.800253] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-03T18:33:28.806414] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:33:29.150597] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T18:33:29.275799] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T18:33:29.590733] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-03T18:33:30.390713] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-03T18:33:31.093367] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:33:31.190702] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-03T18:33:31.661127] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:33:31.990732] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-03T18:33:32.594453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T18:33:32.598787] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:33:32.790715] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-03T18:33:33.549506] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:33:33.590697] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-03T18:33:34.245350] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:33:34.390685] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-03T18:33:34.993560] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:33:35.190722] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-03T18:33:35.990701] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-03T18:33:36.461970] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:33:36.648708] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:33:36.790723] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-03T18:33:37.590707] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-03T18:33:38.111851] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:33:38.390736] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-03T18:33:38.999282] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:33:39.064070] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:33:39.190729] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-03T18:33:39.990729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-03T18:33:40.555301] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T18:33:40.587283] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:33:40.790706] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-03T18:33:41.396491] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:33:41.590717] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-03T18:33:42.390723] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-03T18:33:43.190679] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-03T18:33:43.468983] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T18:33:43.470426] [INFO ] [REMOTE ] DY: Full fetch complete (44341 records). [2025-10-03T18:33:43.470509] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-03T18:33:43.735890] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T18:33:43.759600] [INFO ] [REMOTE ] EAI: Full fetch complete (6127 records). [2025-10-03T18:33:43.770991] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-03T18:33:43.821859] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-03T18:33:43.846018] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:33:43.880413] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:33:43.883466] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:33:43.883554] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-03T18:33:43.884007] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-03T18:33:43.889465] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-03T18:33:43.910076] [DEBUG] [LOCAL ] EAI: No derivative data file found to delete. [2025-10-03T18:33:43.910199] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. EAI took 21.2s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-03T18:33:43.990677] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-03T18:33:44.068999] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-03T18:33:44.092517] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-03T18:33:44.097089] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-03T18:33:44.102971] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-03T18:33:44.147131] [DEBUG] [LOCAL ] DY: Trimmed 44341 records to 29368 (keeping 200 days of data) [2025-10-03T18:33:44.175518] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:44.305860] [DEBUG] [LOCAL ] EARN: Loaded 29843 existing records from primary storage. [2025-10-03T18:33:44.307184] [INFO ] [MAIN ] EARN: Loaded 29843 existing records. [2025-10-03T18:33:44.522591] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:44.524292] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-03T18:33:44.525280] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-03T18:33:44.525951] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-03T18:33:44.526032] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-03T18:33:44.798488] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-03T18:33:44.963558] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:44.976238] [DEBUG] [LOCAL ] DY: Primary data saved (29368 records). [2025-10-03T18:33:44.976406] [INFO ] [MAIN ] DY: Full history saved. [2025-10-03T18:33:44.976505] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. DY took 32.1s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-10-03T18:33:45.162612] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:45.210200] [DEBUG] [LOCAL ] EAT: Loaded 50148 existing records from primary storage. [2025-10-03T18:33:45.210562] [INFO ] [MAIN ] EAT: Loaded 50148 existing records. [2025-10-03T18:33:45.403476] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:45.403774] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-03T18:33:45.403832] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-03T18:33:45.404067] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-03T18:33:45.404127] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-03T18:33:45.597902] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-03T18:33:45.820899] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:45.814372] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:33:46.327455] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:33:46.390694] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-03T18:33:47.190634] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-03T18:33:47.445295] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:33:47.720818] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:33:47.990728] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-03T18:33:48.790672] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-03T18:33:49.233578] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T18:33:49.312963] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:33:49.590698] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-03T18:33:49.934141] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:33:49.936298] [INFO ] [REMOTE ] E: Full fetch complete (48030 records). [2025-10-03T18:33:49.936409] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-03T18:33:49.937204] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:33:49.937316] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:33:49.937372] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:33:49.937597] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-03T18:33:49.937720] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-03T18:33:49.937784] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-10-03T18:33:49.938073] [DEBUG] [LOCAL ] E: Deleted derivative data file. [2025-10-03T18:33:49.938192] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. E took 36.7s. Estimated remaining: 3h 54m 57s. Rate: 7.2 symbols/min [2025-10-03T18:33:50.133837] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:50.134029] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-03T18:33:50.134084] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-03T18:33:50.134201] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-03T18:33:50.134243] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-03T18:33:50.134289] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-03T18:33:50.134322] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-03T18:33:50.399349] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-03T18:33:50.512957] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:51.040353] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:33:51.190725] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-03T18:33:51.701727] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:33:51.990705] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-03T18:33:52.790685] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-03T18:33:53.045131] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T18:33:53.520763] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:33:53.590742] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-03T18:33:54.390635] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-03T18:33:54.683692] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:33:54.685728] [INFO ] [REMOTE ] EAF: Full fetch complete (63459 records). [2025-10-03T18:33:54.712552] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-03T18:33:54.723573] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:33:55.145908] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-03T18:33:55.145996] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-03T18:33:55.146829] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-03T18:33:55.146899] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-03T18:33:55.148368] [DEBUG] [LOCAL ] EAF: Trimmed 63459 records to 43181 (keeping 200 days of data) [2025-10-03T18:33:55.195803] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-03T18:33:55.397805] [DEBUG] [LOCAL ] EAF: Primary data saved (43181 records). [2025-10-03T18:33:55.397941] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-03T18:33:55.398090] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EAF took 42.2s. Estimated remaining: 3h 54m 41s. Rate: 7.2 symbols/min [2025-10-03T18:33:55.796206] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:33:55.990685] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-03T18:33:56.714974] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:33:56.790697] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-03T18:33:57.590742] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-03T18:33:57.798927] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:33:58.242510] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:33:58.390702] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-03T18:33:58.861918] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:33:59.190702] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-03T18:33:59.990697] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-03T18:34:00.071286] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:34:00.545251] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:34:00.790685] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-03T18:34:01.590732] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-03T18:34:02.187585] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-03T18:34:02.390671] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-03T18:34:02.498699] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T18:34:02.847783] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:34:03.190707] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-03T18:34:03.990723] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-03T18:34:04.723242] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-03T18:34:04.757035] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:34:04.790747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-03T18:34:05.590751] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-03T18:34:05.647544] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:34:06.390625] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-03T18:34:06.415366] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T18:34:07.190690] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-03T18:34:07.927979] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:34:07.990715] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-03T18:34:08.238815] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-03T18:34:08.439458] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T18:34:08.790738] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-03T18:34:09.528995] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:34:09.590703] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-03T18:34:10.390699] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-03T18:34:10.518339] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:34:10.805767] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:34:10.809311] [INFO ] [REMOTE ] EARN: Full fetch complete (45937 records). [2025-10-03T18:34:10.809440] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-03T18:34:11.204019] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-03T18:34:11.223223] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-03T18:34:11.223299] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-03T18:34:11.224048] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-03T18:34:11.224206] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-03T18:34:11.225522] [DEBUG] [LOCAL ] EARN: Trimmed 45937 records to 30021 (keeping 200 days of data) [2025-10-03T18:34:11.415405] [DEBUG] [LOCAL ] EARN: Primary data saved (30021 records). [2025-10-03T18:34:11.415547] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-03T18:34:11.415687] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EARN took 27.5s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-03T18:34:11.680266] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:34:11.990685] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-03T18:34:13.197001] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:34:13.211274] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-03T18:34:13.458952] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:34:13.590711] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-03T18:34:14.793810] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:34:14.798731] [INFO ] [REMOTE ] EB: Full fetch complete (56095 records). [2025-10-03T18:34:14.798906] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-03T18:34:15.146879] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:34:15.199749] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-03T18:34:15.281122] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-03T18:34:15.281209] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-03T18:34:15.281926] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-03T18:34:15.281993] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-03T18:34:15.283210] [DEBUG] [LOCAL ] EB: Trimmed 56095 records to 37650 (keeping 200 days of data) [2025-10-03T18:34:15.504992] [DEBUG] [LOCAL ] EB: Primary data saved (37650 records). [2025-10-03T18:34:15.505139] [INFO ] [MAIN ] EB: Full history saved. [2025-10-03T18:34:15.505217] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EB took 25.6s. Estimated remaining: 3h 54m 33s. Rate: 7.2 symbols/min [2025-10-03T18:34:17.282943] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T18:34:17.294774] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-03T18:34:18.659371] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:34:18.662218] [INFO ] [REMOTE ] EAT: Full fetch complete (71667 records). [2025-10-03T18:34:18.662419] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-03T18:34:18.663449] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:34:18.663612] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:34:18.663717] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:34:18.663842] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-03T18:34:18.663943] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-03T18:34:18.663998] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-03T18:34:18.664285] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-03T18:34:18.664423] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 33.7s. Estimated remaining: 3h 54m 12s. Rate: 7.2 symbols/min [2025-10-03T18:34:19.344001] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.423520] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.466335] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-03T18:34:19.467748] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.497742] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.478360] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-03T18:34:19.499152] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-03T18:34:19.499358] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-03T18:34:19.499521] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-03T18:34:19.499634] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-03T18:34:19.499865] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-03T18:34:19.499971] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-03T18:34:19.500026] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-03T18:34:19.499788] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-03T18:34:19.505320] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-03T18:34:19.523990] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-03T18:34:20.040506] [DEBUG] [LOCAL ] EBR: Loaded 43379 existing records from primary storage. [2025-10-03T18:34:20.158832] [INFO ] [MAIN ] EBR: Loaded 43379 existing records. [2025-10-03T18:34:20.180555] [DEBUG] [LOCAL ] EC: Loaded 49591 existing records from primary storage. [2025-10-03T18:34:20.274592] [INFO ] [MAIN ] EC: Loaded 49591 existing records. [2025-10-03T18:34:20.540423] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:20.586436] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-03T18:34:20.755110] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:20.787796] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-03T18:34:20.781793] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:20.788043] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-03T18:34:20.798845] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-03T18:34:20.804115] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-03T18:34:20.832034] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-03T18:34:20.900001] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:20.952615] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-03T18:34:20.958718] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-03T18:34:20.964249] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-03T18:34:20.986770] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-03T18:34:21.592874] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:21.603638] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-03T18:34:21.669064] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:21.669372] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-03T18:34:22.162637] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:34:22.166604] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-03T18:34:22.365218] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T18:34:22.375320] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-03T18:34:22.817873] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:34:22.822091] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-03T18:34:23.472613] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:34:23.483731] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-03T18:34:23.503006] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:34:23.508298] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-03T18:34:23.622796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:34:23.632207] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-03T18:34:23.786968] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T18:34:23.990748] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-03T18:34:24.607581] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:34:24.790718] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-03T18:34:24.968964] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:34:25.189704] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:34:25.576505] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:34:25.590621] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-03T18:34:25.856282] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:34:26.390696] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-03T18:34:26.963696] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:34:27.190727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-03T18:34:27.990686] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-03T18:34:28.205011] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:34:28.790696] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-03T18:34:28.852731] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:34:29.090954] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:34:29.590743] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-03T18:34:30.149472] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T18:34:30.390720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-03T18:34:31.190703] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-03T18:34:31.442757] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:34:31.991723] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T18:34:31.991800] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-03T18:34:32.231303] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:34:32.790689] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-03T18:34:33.590684] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-03T18:34:33.759800] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:34:34.105847] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T18:34:34.390634] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-03T18:34:34.702530] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T18:34:35.190743] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-03T18:34:35.990782] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-03T18:34:36.253102] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:34:36.797485] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-03T18:34:36.803858] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:34:37.491051] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:34:37.590720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-03T18:34:37.851068] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:34:38.390711] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-03T18:34:39.133563] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:34:39.190713] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-03T18:34:39.990633] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-03T18:34:40.220851] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:34:40.790686] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-03T18:34:40.964834] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:34:41.490281] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:34:41.590739] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-03T18:34:42.390680] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-03T18:34:42.582101] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:34:42.628103] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T18:34:43.190729] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-03T18:34:43.990697] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-03T18:34:44.012087] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T18:34:44.013824] [INFO ] [REMOTE ] EBF: Full fetch complete (27501 records). [2025-10-03T18:34:44.014024] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-03T18:34:44.500147] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-03T18:34:44.500376] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-03T18:34:44.501101] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-03T18:34:44.501215] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-03T18:34:44.503464] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T18:34:44.516711] [DEBUG] [LOCAL ] EBF: Trimmed 27501 records to 19506 (keeping 200 days of data) [2025-10-03T18:34:44.641768] [DEBUG] [LOCAL ] EBF: Primary data saved (19506 records). [2025-10-03T18:34:44.641921] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-03T18:34:44.642029] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBF took 26.0s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-03T18:34:44.797001] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-03T18:34:44.827254] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:44.827505] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-03T18:34:44.827553] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-03T18:34:44.827696] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-03T18:34:44.827753] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-03T18:34:44.827799] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-03T18:34:44.827834] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-03T18:34:45.222468] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:45.590632] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-03T18:34:45.829957] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:34:46.390682] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-03T18:34:46.556586] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:34:46.995470] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:34:47.190708] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-03T18:34:47.990634] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-03T18:34:48.188203] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:34:48.790735] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-03T18:34:48.840516] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:34:49.223864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:34:49.590694] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-03T18:34:50.002551] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:34:50.004966] [INFO ] [REMOTE ] EBS: Full fetch complete (67311 records). [2025-10-03T18:34:50.005098] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-03T18:34:50.391677] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-03T18:34:50.433728] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-03T18:34:50.433947] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-03T18:34:50.434896] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-03T18:34:50.435019] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-03T18:34:50.436765] [DEBUG] [LOCAL ] EBS: Trimmed 67311 records to 47245 (keeping 200 days of data) [2025-10-03T18:34:50.712931] [DEBUG] [LOCAL ] EBS: Primary data saved (47245 records). [2025-10-03T18:34:50.713087] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-03T18:34:50.713226] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. EBS took 32.0s. Estimated remaining: 3h 54m 34s. Rate: 7.2 symbols/min [2025-10-03T18:34:50.920038] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:34:50.921780] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:50.971349] [DEBUG] [LOCAL ] ECC: Loaded 43668 existing records from primary storage. [2025-10-03T18:34:50.971680] [INFO ] [MAIN ] ECC: Loaded 43668 existing records. [2025-10-03T18:34:51.164072] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:51.164337] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-03T18:34:51.164394] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-03T18:34:51.166153] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-03T18:34:51.166221] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-03T18:34:51.198242] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-03T18:34:51.556427] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:51.977605] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:34:51.980144] [INFO ] [REMOTE ] EC: Full fetch complete (71919 records). [2025-10-03T18:34:51.980260] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-03T18:34:51.995759] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-03T18:34:52.439503] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-03T18:34:52.439623] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-03T18:34:52.440623] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-03T18:34:52.440884] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-03T18:34:52.442881] [DEBUG] [LOCAL ] EC: Trimmed 71919 records to 49923 (keeping 200 days of data) [2025-10-03T18:34:52.561433] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:34:52.776915] [DEBUG] [LOCAL ] EC: Primary data saved (49923 records). [2025-10-03T18:34:52.777051] [INFO ] [MAIN ] EC: Full history saved. [2025-10-03T18:34:52.777158] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EC took 34.1s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-10-03T18:34:52.799632] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-03T18:34:53.002966] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:53.003144] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-03T18:34:53.003182] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-03T18:34:53.003300] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-03T18:34:53.003342] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-03T18:34:53.003383] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-03T18:34:53.003415] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-03T18:34:53.389062] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:53.590681] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-03T18:34:53.633436] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:34:54.082134] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:34:54.192224] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T18:34:54.390726] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-03T18:34:55.190700] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-03T18:34:55.770855] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:34:55.773248] [INFO ] [REMOTE ] EBR: Full fetch complete (62610 records). [2025-10-03T18:34:55.773346] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-03T18:34:55.998102] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-03T18:34:56.189811] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-03T18:34:56.189906] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-03T18:34:56.190775] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-03T18:34:56.190840] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-03T18:34:56.192172] [DEBUG] [LOCAL ] EBR: Trimmed 62610 records to 43694 (keeping 200 days of data) [2025-10-03T18:34:56.451722] [DEBUG] [LOCAL ] EBR: Primary data saved (43694 records). [2025-10-03T18:34:56.451854] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-03T18:34:56.451938] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EBR took 37.8s. Estimated remaining: 3h 53m 50s. Rate: 7.2 symbols/min [2025-10-03T18:34:56.637488] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:56.637675] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-03T18:34:56.637731] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-03T18:34:56.637845] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-03T18:34:56.637889] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-03T18:34:56.637933] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-03T18:34:56.637968] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-03T18:34:56.797952] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-03T18:34:57.031961] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:57.050892] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T18:34:57.112669] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:34:57.182497] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-03T18:34:57.590688] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-03T18:34:57.973708] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:34:58.390746] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-03T18:34:59.190705] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-03T18:34:59.799888] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:34:59.948456] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:34:59.990632] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-03T18:35:00.790726] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-03T18:35:01.542819] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:35:01.544846] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:35:01.590719] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-03T18:35:02.390762] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-03T18:35:03.190699] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-03T18:35:03.354092] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T18:35:03.770990] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:35:03.875773] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T18:35:03.990691] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-03T18:35:04.790674] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-03T18:35:05.484312] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T18:35:05.590634] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-03T18:35:05.819675] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T18:35:05.945886] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T18:35:06.390752] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-03T18:35:07.190632] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-03T18:35:07.656637] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:35:07.990692] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-03T18:35:08.527121] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T18:35:08.790694] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-03T18:35:08.994629] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:35:09.590694] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-03T18:35:09.936183] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T18:35:10.176803] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:35:10.390708] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-03T18:35:11.027983] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T18:35:11.190700] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-03T18:35:11.626229] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T18:35:11.990713] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-03T18:35:12.790705] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-03T18:35:13.239559] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T18:35:13.421525] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:35:13.590727] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-03T18:35:14.062470] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T18:35:14.390715] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-03T18:35:14.838517] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:35:15.190706] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-03T18:35:15.584564] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:35:15.585317] [INFO ] [REMOTE ] ECCU: Full fetch complete (4487 records). [2025-10-03T18:35:15.585398] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-03T18:35:15.585844] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:35:15.585933] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:15.585979] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:15.586045] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-03T18:35:15.586118] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-03T18:35:15.586157] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-03T18:35:15.586225] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-03T18:35:15.586335] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCU took 19.1s. Estimated remaining: 3h 54m 8s. Rate: 7.2 symbols/min [2025-10-03T18:35:15.773490] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:15.773743] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-03T18:35:15.773796] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-03T18:35:15.773924] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-03T18:35:15.773991] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-03T18:35:15.774047] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-03T18:35:15.774095] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-03T18:35:15.998430] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-03T18:35:16.171892] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:16.791037] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-03T18:35:17.342621] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T18:35:17.590729] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-03T18:35:17.740536] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T18:35:18.025353] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:35:18.390697] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-03T18:35:19.190705] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-03T18:35:19.990720] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-03T18:35:20.321589] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:35:20.357564] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T18:35:20.675698] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:35:20.790722] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-03T18:35:21.447178] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:35:21.590726] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-03T18:35:22.323489] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:35:22.390732] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-03T18:35:23.190731] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-03T18:35:23.586724] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-03T18:35:23.618260] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:35:23.620825] [INFO ] [REMOTE ] ECAT: Full fetch complete (42917 records). [2025-10-03T18:35:23.620974] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-03T18:35:23.995810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-03T18:35:24.115916] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-03T18:35:24.116068] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-03T18:35:24.116789] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-03T18:35:24.116869] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-03T18:35:24.118531] [DEBUG] [LOCAL ] ECAT: Trimmed 42917 records to 29940 (keeping 200 days of data) [2025-10-03T18:35:24.309859] [DEBUG] [LOCAL ] ECAT: Primary data saved (29940 records). [2025-10-03T18:35:24.310006] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-03T18:35:24.310131] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECAT took 39.7s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-03T18:35:24.446155] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T18:35:24.508743] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:24.508927] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-03T18:35:24.508984] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-03T18:35:24.509096] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-03T18:35:24.509138] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-03T18:35:24.509179] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-03T18:35:24.509210] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-03T18:35:24.795875] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-03T18:35:24.895955] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:25.078821] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-03T18:35:25.590679] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-03T18:35:26.016374] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T18:35:26.390741] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-03T18:35:26.790970] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-03T18:35:27.190715] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-03T18:35:27.895568] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T18:35:27.990729] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-03T18:35:28.507123] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T18:35:28.790749] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-03T18:35:29.136495] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:35:29.590731] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-03T18:35:30.143407] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T18:35:30.144128] [INFO ] [REMOTE ] ECCC: Full fetch complete (1297 records). [2025-10-03T18:35:30.144220] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-03T18:35:30.342076] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T18:35:30.342293] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:30.342366] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:30.342441] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-03T18:35:30.342509] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-03T18:35:30.342548] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-03T18:35:30.342592] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-03T18:35:30.342672] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECCC took 37.6s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-03T18:35:30.395742] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-03T18:35:30.530893] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:30.568573] [DEBUG] [LOCAL ] ECG: Loaded 34056 existing records from primary storage. [2025-10-03T18:35:30.569054] [INFO ] [MAIN ] ECG: Loaded 34056 existing records. [2025-10-03T18:35:30.764202] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:30.766322] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-03T18:35:30.766861] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-03T18:35:30.767924] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-03T18:35:30.768188] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-03T18:35:30.768273] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-03T18:35:31.170957] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:31.190695] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-03T18:35:31.990727] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-03T18:35:32.512638] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T18:35:32.799155] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-03T18:35:32.804706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T18:35:33.215631] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T18:35:33.590705] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-03T18:35:34.390721] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-03T18:35:34.802494] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T18:35:35.138617] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T18:35:35.190696] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-03T18:35:35.503872] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-03T18:35:35.990700] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-03T18:35:36.790715] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-03T18:35:37.231095] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T18:35:37.231808] [INFO ] [REMOTE ] ECCW: Full fetch complete (1411 records). [2025-10-03T18:35:37.231879] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-03T18:35:37.422702] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-03T18:35:37.423118] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:37.423244] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:37.423457] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-03T18:35:37.423603] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-03T18:35:37.423734] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-03T18:35:37.423864] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-03T18:35:37.423996] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCW took 21.8s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-03T18:35:37.596341] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-03T18:35:37.634022] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:37.637058] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:35:37.688716] [DEBUG] [LOCAL ] ECL: Loaded 47096 existing records from primary storage. [2025-10-03T18:35:37.689051] [INFO ] [MAIN ] ECL: Loaded 47096 existing records. [2025-10-03T18:35:37.883740] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:37.883959] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-03T18:35:37.884060] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-03T18:35:37.884381] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-03T18:35:37.884441] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-03T18:35:38.272741] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:38.390768] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-03T18:35:38.937881] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T18:35:39.153436] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:35:39.157414] [INFO ] [REMOTE ] ECC: Full fetch complete (61033 records). [2025-10-03T18:35:39.157584] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-03T18:35:39.199068] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-03T18:35:39.598169] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-03T18:35:39.598284] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-03T18:35:39.599255] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-03T18:35:39.599325] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-03T18:35:39.600796] [DEBUG] [LOCAL ] ECC: Trimmed 61033 records to 43966 (keeping 200 days of data) [2025-10-03T18:35:39.690612] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:35:39.874338] [DEBUG] [LOCAL ] ECC: Primary data saved (43966 records). [2025-10-03T18:35:39.874486] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-03T18:35:39.875202] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECC took 49.2s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-03T18:35:39.995771] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-03T18:35:40.062082] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:40.083389] [DEBUG] [LOCAL ] ECO: Loaded 18558 existing records from primary storage. [2025-10-03T18:35:40.083708] [INFO ] [MAIN ] ECO: Loaded 18558 existing records. [2025-10-03T18:35:40.273307] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:40.273543] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-03T18:35:40.273591] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-03T18:35:40.273840] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-03T18:35:40.273898] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-03T18:35:40.389977] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T18:35:40.666173] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:40.790659] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-03T18:35:41.142097] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:35:41.590706] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-03T18:35:42.390729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-03T18:35:42.762383] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T18:35:42.876673] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T18:35:43.190729] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-03T18:35:43.990696] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-03T18:35:44.738477] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:35:44.790673] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-03T18:35:45.590677] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-03T18:35:45.667499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T18:35:46.290278] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:35:46.390736] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-03T18:35:47.119233] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:35:47.190738] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-03T18:35:47.991121] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-03T18:35:47.996257] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:35:48.470045] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:35:48.790749] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-03T18:35:49.590634] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-03T18:35:49.742713] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:35:50.041593] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T18:35:50.193699] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T18:35:50.390703] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-03T18:35:51.190693] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-03T18:35:51.511677] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:35:51.990688] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-03T18:35:52.790632] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-03T18:35:52.986673] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T18:35:53.171775] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T18:35:53.590731] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-03T18:35:54.098166] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T18:35:54.274721] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-03T18:35:54.390724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-03T18:35:55.190737] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-03T18:35:55.661804] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T18:35:55.990697] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-03T18:35:56.216489] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:35:56.790693] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-03T18:35:57.064875] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:35:57.590702] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-03T18:35:58.390726] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-03T18:35:58.802830] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T18:35:58.847257] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:35:59.190685] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-03T18:35:59.561028] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T18:35:59.562331] [INFO ] [REMOTE ] ECCX: Full fetch complete (1506 records). [2025-10-03T18:35:59.562409] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-03T18:35:59.773956] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-03T18:35:59.774363] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:59.774567] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:59.774785] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-03T18:35:59.774889] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-03T18:35:59.775002] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-03T18:35:59.775158] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-03T18:35:59.775260] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECCX took 35.5s. Estimated remaining: 3h 53m 33s. Rate: 7.2 symbols/min [2025-10-03T18:35:59.971166] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:59.993251] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-03T18:35:59.997500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:36:00.049548] [DEBUG] [LOCAL ] ECVT: Loaded 43382 existing records from primary storage. [2025-10-03T18:36:00.049993] [INFO ] [MAIN ] ECVT: Loaded 43382 existing records. [2025-10-03T18:36:00.256349] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:00.256598] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-03T18:36:00.256713] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-03T18:36:00.257055] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-03T18:36:00.257116] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-03T18:36:00.638266] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:00.790734] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-03T18:36:01.590691] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-03T18:36:01.812350] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:36:02.315596] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:36:02.390670] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-03T18:36:02.606084] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:36:03.190683] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-03T18:36:03.703301] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T18:36:03.990712] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-03T18:36:04.790686] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-03T18:36:04.843918] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:36:05.064072] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:36:05.066087] [INFO ] [REMOTE ] ECG: Full fetch complete (51312 records). [2025-10-03T18:36:05.066183] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-03T18:36:05.496049] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-03T18:36:05.496183] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-03T18:36:05.496993] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-03T18:36:05.497075] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-03T18:36:05.498307] [DEBUG] [LOCAL ] ECG: Trimmed 51312 records to 34260 (keeping 200 days of data) [2025-10-03T18:36:05.592889] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-03T18:36:05.718570] [DEBUG] [LOCAL ] ECG: Primary data saved (34260 records). [2025-10-03T18:36:05.718754] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-03T18:36:05.718941] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECG took 35.4s. Estimated remaining: 3h 53m 19s. Rate: 7.2 symbols/min [2025-10-03T18:36:05.897182] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:05.956783] [DEBUG] [LOCAL ] ED: Loaded 53131 existing records from primary storage. [2025-10-03T18:36:05.957132] [INFO ] [MAIN ] ED: Loaded 53131 existing records. [2025-10-03T18:36:06.185810] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:06.186081] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-03T18:36:06.186231] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-03T18:36:06.188741] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-03T18:36:06.188811] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-03T18:36:06.395794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-03T18:36:06.700121] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:06.737876] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:36:06.767313] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:36:07.190724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-03T18:36:07.813624] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:36:07.990668] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-03T18:36:08.790633] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-03T18:36:08.957017] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:36:09.020736] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:36:09.590708] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-03T18:36:10.390685] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-03T18:36:10.925528] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T18:36:11.190715] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-03T18:36:11.310852] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T18:36:11.695106] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:36:11.990716] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-03T18:36:12.790736] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-03T18:36:13.007298] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:36:13.590700] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-03T18:36:13.777553] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:36:14.306359] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:36:14.390731] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-03T18:36:15.190742] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-03T18:36:15.397437] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:36:15.400891] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:36:15.411390] [INFO ] [REMOTE ] ECO: Full fetch complete (28865 records). [2025-10-03T18:36:15.412182] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-03T18:36:15.820288] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-03T18:36:15.820372] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-03T18:36:15.820908] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-03T18:36:15.820982] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-03T18:36:15.821854] [DEBUG] [LOCAL ] ECO: Trimmed 28865 records to 18643 (keeping 200 days of data) [2025-10-03T18:36:15.943968] [DEBUG] [LOCAL ] ECO: Primary data saved (18643 records). [2025-10-03T18:36:15.944128] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-03T18:36:15.944222] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECO took 36.1s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-03T18:36:15.995885] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-03T18:36:16.134101] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:16.163931] [DEBUG] [LOCAL ] EDD: Loaded 27357 existing records from primary storage. [2025-10-03T18:36:16.164263] [INFO ] [MAIN ] EDD: Loaded 27357 existing records. [2025-10-03T18:36:16.387217] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:16.387435] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-03T18:36:16.387486] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-03T18:36:16.388166] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-03T18:36:16.388234] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-03T18:36:16.792452] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-03T18:36:16.792375] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:17.024207] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:36:17.590671] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-03T18:36:17.940447] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:36:18.163506] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:36:18.170045] [INFO ] [REMOTE ] ECL: Full fetch complete (68040 records). [2025-10-03T18:36:18.170199] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-03T18:36:18.398786] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-03T18:36:18.601782] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-03T18:36:18.601906] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-03T18:36:18.602796] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-03T18:36:18.602864] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-03T18:36:18.604307] [DEBUG] [LOCAL ] ECL: Trimmed 68040 records to 47436 (keeping 200 days of data) [2025-10-03T18:36:18.927823] [DEBUG] [LOCAL ] ECL: Primary data saved (47436 records). [2025-10-03T18:36:18.927976] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-03T18:36:18.928064] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 41.5s. Estimated remaining: 3h 52m 53s. Rate: 7.2 symbols/min [2025-10-03T18:36:19.119882] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:19.134342] [DEBUG] [LOCAL ] EDF: Loaded 13420 existing records from primary storage. [2025-10-03T18:36:19.134662] [INFO ] [MAIN ] EDF: Loaded 13420 existing records. [2025-10-03T18:36:19.194409] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-03T18:36:19.337526] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:19.337984] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-03T18:36:19.338140] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-03T18:36:19.338968] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-03T18:36:19.339105] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-03T18:36:19.749545] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:36:19.783361] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:19.990699] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-03T18:36:20.071388] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:36:20.790700] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-03T18:36:20.935136] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:36:21.590737] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-03T18:36:21.942215] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:36:22.174923] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:36:22.313596] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T18:36:22.390699] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-03T18:36:23.190705] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-03T18:36:23.917942] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T18:36:23.990670] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-03T18:36:24.209039] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T18:36:24.790710] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-03T18:36:25.475365] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:36:25.520142] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:36:25.590690] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-03T18:36:26.390733] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-03T18:36:26.871345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:36:27.190719] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-03T18:36:27.844881] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T18:36:27.847411] [INFO ] [REMOTE ] ECVT: Full fetch complete (60268 records). [2025-10-03T18:36:27.847542] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-03T18:36:27.995928] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-03T18:36:28.337692] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-03T18:36:28.337850] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-03T18:36:28.338815] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-03T18:36:28.338885] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-03T18:36:28.341127] [DEBUG] [LOCAL ] ECVT: Trimmed 60268 records to 43747 (keeping 200 days of data) [2025-10-03T18:36:28.610972] [DEBUG] [LOCAL ] ECVT: Primary data saved (43747 records). [2025-10-03T18:36:28.611120] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-03T18:36:28.613555] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. ECVT took 28.8s. Estimated remaining: 3h 52m 48s. Rate: 7.2 symbols/min [2025-10-03T18:36:28.796724] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-03T18:36:28.809111] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:28.834995] [DEBUG] [LOCAL ] EDN: Loaded 18336 existing records from primary storage. [2025-10-03T18:36:28.835256] [INFO ] [MAIN ] EDN: Loaded 18336 existing records. [2025-10-03T18:36:29.038826] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:29.039505] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-03T18:36:29.039599] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-03T18:36:29.040409] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-03T18:36:29.040556] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-03T18:36:29.373546] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-03T18:36:29.400889] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:36:29.521029] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:29.590634] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-03T18:36:29.856228] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:36:30.390693] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-03T18:36:31.190632] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-03T18:36:31.395112] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:36:31.830300] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:36:31.990738] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-03T18:36:32.602427] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:36:32.790709] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-03T18:36:33.070982] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:36:33.590711] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-03T18:36:34.190510] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:36:34.390698] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-03T18:36:34.518696] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T18:36:35.190670] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-03T18:36:35.990669] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-03T18:36:36.252602] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T18:36:36.490859] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:36:36.790715] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-03T18:36:36.864096] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:36:37.590726] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-03T18:36:38.390660] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-03T18:36:38.537099] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:36:38.564539] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T18:36:39.190701] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-03T18:36:39.534029] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:36:39.990680] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-03T18:36:40.302469] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:36:40.790723] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-03T18:36:41.051768] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:36:41.590674] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-03T18:36:41.738113] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:36:42.390686] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-03T18:36:42.757547] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:36:43.190688] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-03T18:36:43.627916] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:36:43.990711] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-03T18:36:44.083334] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T18:36:44.790720] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-03T18:36:45.485203] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:36:45.590721] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-03T18:36:46.390672] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-03T18:36:46.552791] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:36:46.806252] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:36:47.190634] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-03T18:36:47.663589] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T18:36:47.990711] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-03T18:36:48.773063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:36:48.775828] [INFO ] [REMOTE ] ED: Full fetch complete (76323 records). [2025-10-03T18:36:48.775982] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-03T18:36:48.799146] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-03T18:36:49.195268] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:36:49.220455] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-03T18:36:49.224530] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-03T18:36:49.225572] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-03T18:36:49.226211] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-03T18:36:49.227789] [DEBUG] [LOCAL ] ED: Trimmed 76323 records to 53511 (keeping 200 days of data) [2025-10-03T18:36:49.579709] [DEBUG] [LOCAL ] ED: Primary data saved (53511 records). [2025-10-03T18:36:49.579854] [INFO ] [MAIN ] ED: Full history saved. [2025-10-03T18:36:49.579943] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. ED took 43.9s. Estimated remaining: 3h 53m 11s. Rate: 7.2 symbols/min [2025-10-03T18:36:49.597691] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-03T18:36:49.774404] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:49.817804] [DEBUG] [LOCAL ] EDU: Loaded 45267 existing records from primary storage. [2025-10-03T18:36:49.818150] [INFO ] [MAIN ] EDU: Loaded 45267 existing records. [2025-10-03T18:36:50.018623] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:50.019013] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-03T18:36:50.019077] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-03T18:36:50.025444] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-03T18:36:50.037203] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-03T18:36:50.038048] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T18:36:50.401593] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-03T18:36:50.447031] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:50.713041] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T18:36:51.190690] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-03T18:36:51.631548] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:36:51.990715] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-03T18:36:52.164485] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:36:52.790700] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-03T18:36:52.939981] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:36:52.941414] [INFO ] [REMOTE ] EDN: Full fetch complete (30027 records). [2025-10-03T18:36:52.941491] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-03T18:36:53.366592] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-03T18:36:53.366716] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-03T18:36:53.367299] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-03T18:36:53.367367] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-03T18:36:53.368346] [DEBUG] [LOCAL ] EDN: Trimmed 30027 records to 18464 (keeping 200 days of data) [2025-10-03T18:36:53.479380] [DEBUG] [LOCAL ] EDN: Primary data saved (18464 records). [2025-10-03T18:36:53.479539] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-03T18:36:53.479669] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDN took 24.9s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-03T18:36:53.597187] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-03T18:36:53.673500] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:53.710976] [DEBUG] [LOCAL ] EE: Loaded 32660 existing records from primary storage. [2025-10-03T18:36:53.711330] [INFO ] [MAIN ] EE: Loaded 32660 existing records. [2025-10-03T18:36:53.904214] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:36:53.932722] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:53.934951] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-03T18:36:53.935068] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-03T18:36:53.935690] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-03T18:36:53.935780] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-03T18:36:53.945368] [INFO ] [REMOTE ] EDD: Full fetch complete (38855 records). [2025-10-03T18:36:54.022715] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-03T18:36:54.399682] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-03T18:36:54.730040] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:54.801389] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-03T18:36:54.801469] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-03T18:36:54.802137] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-03T18:36:54.802202] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-03T18:36:54.803116] [DEBUG] [LOCAL ] EDD: Trimmed 38855 records to 27540 (keeping 200 days of data) [2025-10-03T18:36:54.973183] [DEBUG] [LOCAL ] EDD: Primary data saved (27540 records). [2025-10-03T18:36:54.973330] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-03T18:36:54.973457] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDD took 39.0s. Estimated remaining: 3h 52m 27s. Rate: 7.2 symbols/min [2025-10-03T18:36:55.157345] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:55.157592] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-03T18:36:55.157850] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-03T18:36:55.158108] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-03T18:36:55.158158] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-03T18:36:55.158202] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-03T18:36:55.158234] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-03T18:36:55.203575] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-03T18:36:55.409168] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:36:55.451018] [INFO ] [REMOTE ] EDF: Full fetch complete (20806 records). [2025-10-03T18:36:55.470824] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-03T18:36:55.626415] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:55.763664] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T18:36:56.006224] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-03T18:36:56.053753] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-03T18:36:56.053837] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-03T18:36:56.054263] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-03T18:36:56.054305] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-03T18:36:56.054943] [DEBUG] [LOCAL ] EDF: Trimmed 20806 records to 13491 (keeping 200 days of data) [2025-10-03T18:36:56.145167] [DEBUG] [LOCAL ] EDF: Primary data saved (13491 records). [2025-10-03T18:36:56.145312] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-03T18:36:56.145420] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. EDF took 37.2s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-10-03T18:36:56.335927] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:56.336050] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-03T18:36:56.336087] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-03T18:36:56.336171] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-03T18:36:56.336211] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-03T18:36:56.336252] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-03T18:36:56.336284] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-03T18:36:56.751240] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:56.756308] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T18:36:56.776359] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:36:56.790603] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-03T18:36:57.590634] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-03T18:36:58.025675] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:36:58.077196] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T18:36:58.390688] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-03T18:36:58.915637] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T18:36:59.190732] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-03T18:36:59.769985] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T18:36:59.990737] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-03T18:37:00.790715] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-03T18:37:01.464161] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T18:37:01.590690] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-03T18:37:01.948213] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T18:37:02.390633] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-03T18:37:02.715735] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T18:37:03.190680] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-03T18:37:03.990665] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-03T18:37:04.087632] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:37:04.118687] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:37:04.455529] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T18:37:04.790706] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-03T18:37:05.262027] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:37:05.590691] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-03T18:37:06.157948] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T18:37:06.390693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-03T18:37:07.190687] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-03T18:37:07.839324] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:37:07.910598] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:37:07.990679] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-03T18:37:08.315942] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T18:37:08.790693] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-03T18:37:09.256399] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T18:37:09.257143] [INFO ] [REMOTE ] EEA: Full fetch complete (3902 records). [2025-10-03T18:37:09.257233] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-03T18:37:09.486336] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:37:09.486596] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:09.486718] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:09.486797] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-03T18:37:09.486866] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-03T18:37:09.486935] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-03T18:37:09.486996] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-03T18:37:09.487109] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EEA took 14.5s. Estimated remaining: 3h 52m 5s. Rate: 7.2 symbols/min [2025-10-03T18:37:09.599209] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-03T18:37:09.681797] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:09.729272] [DEBUG] [LOCAL ] EFC: Loaded 46536 existing records from primary storage. [2025-10-03T18:37:09.729634] [INFO ] [MAIN ] EFC: Loaded 46536 existing records. [2025-10-03T18:37:09.925428] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:09.925735] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-03T18:37:09.925788] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-03T18:37:09.926068] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-03T18:37:09.926156] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-03T18:37:10.297315] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:10.390680] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-03T18:37:10.981711] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:37:11.190710] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-03T18:37:11.990630] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-03T18:37:12.281882] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T18:37:12.417616] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:37:12.790697] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-03T18:37:13.285629] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:37:13.590680] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-03T18:37:13.703884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T18:37:14.390735] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-03T18:37:15.098852] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T18:37:15.190706] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-03T18:37:15.986532] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:37:15.991684] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-03T18:37:16.790718] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-03T18:37:17.401563] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:37:17.422423] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T18:37:17.590676] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-03T18:37:17.830596] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:37:18.239825] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:37:18.390727] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-03T18:37:19.161898] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:37:19.190682] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-03T18:37:19.990709] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-03T18:37:20.345214] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T18:37:20.790685] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-03T18:37:21.590723] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-03T18:37:22.343772] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:37:22.390693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-03T18:37:22.429012] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-03T18:37:23.190703] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-03T18:37:23.434533] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:37:23.967828] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:37:23.990705] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-03T18:37:24.080685] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T18:37:24.790684] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-03T18:37:25.211525] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:37:25.485064] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T18:37:25.590688] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-03T18:37:26.390698] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-03T18:37:26.601836] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:37:26.603305] [INFO ] [REMOTE ] EE: Full fetch complete (43461 records). [2025-10-03T18:37:26.603380] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-03T18:37:26.604087] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:37:26.604179] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:26.604225] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:26.604298] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-03T18:37:26.604364] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-03T18:37:26.604419] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-03T18:37:26.604834] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-03T18:37:26.604972] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EE took 33.1s. Estimated remaining: 3h 52m 17s. Rate: 7.2 symbols/min [2025-10-03T18:37:26.794436] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:26.814165] [DEBUG] [LOCAL ] EFR: Loaded 14752 existing records from primary storage. [2025-10-03T18:37:26.814410] [INFO ] [MAIN ] EFR: Loaded 14752 existing records. [2025-10-03T18:37:26.970775] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:37:26.992617] [INFO ] [REMOTE ] EEX: Full fetch complete (19136 records). [2025-10-03T18:37:27.016036] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:27.016145] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-03T18:37:27.016460] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-03T18:37:27.016587] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-03T18:37:27.017053] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:37:27.017180] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:27.017260] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:27.017340] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-03T18:37:27.017409] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-03T18:37:27.017462] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-03T18:37:27.017521] [DEBUG] [LOCAL ] EEX: No derivative data file found to delete. [2025-10-03T18:37:27.017683] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-03T18:37:27.017614] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EEX took 30.9s. Estimated remaining: 3h 51m 50s. Rate: 7.2 symbols/min [2025-10-03T18:37:27.017860] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-03T18:37:27.198307] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-03T18:37:27.400116] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:27.579992] [DEBUG] [LOCAL ] EFT: Loaded 13189 existing records from primary storage. [2025-10-03T18:37:27.591905] [INFO ] [MAIN ] EFT: Loaded 13189 existing records. [2025-10-03T18:37:27.614841] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:27.803829] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:27.804054] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-03T18:37:27.804101] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-03T18:37:27.805243] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-03T18:37:27.805304] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-03T18:37:27.995770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-03T18:37:28.179785] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:28.490589] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:37:28.790730] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-03T18:37:29.584818] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:37:29.593874] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-03T18:37:30.390702] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-03T18:37:30.478343] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:37:30.931998] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:37:31.190724] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-03T18:37:31.990710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-03T18:37:32.051682] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:37:32.658612] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:37:32.790623] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-03T18:37:33.103198] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T18:37:33.546041] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T18:37:33.590703] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-03T18:37:34.390746] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-03T18:37:35.195713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-03T18:37:35.212448] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T18:37:35.583596] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:37:35.990726] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-03T18:37:36.205737] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T18:37:36.790741] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-03T18:37:37.590681] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-03T18:37:37.654491] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:37:38.384394] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:37:38.390611] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-03T18:37:38.487714] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T18:37:39.179070] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:37:39.190634] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-03T18:37:39.990686] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-03T18:37:40.719386] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:37:40.790687] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-03T18:37:40.960016] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:37:41.590738] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-03T18:37:42.245755] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:37:42.249090] [INFO ] [REMOTE ] EDU: Full fetch complete (66457 records). [2025-10-03T18:37:42.249211] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-03T18:37:42.395821] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-03T18:37:42.690183] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-03T18:37:42.690305] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-03T18:37:42.691208] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-03T18:37:42.691282] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-03T18:37:42.692703] [DEBUG] [LOCAL ] EDU: Trimmed 66457 records to 45595 (keeping 200 days of data) [2025-10-03T18:37:42.972810] [DEBUG] [LOCAL ] EDU: Primary data saved (45595 records). [2025-10-03T18:37:42.972951] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-03T18:37:42.973061] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EDU took 53.4s. Estimated remaining: 3h 52m 0s. Rate: 7.2 symbols/min [2025-10-03T18:37:43.166992] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:43.192820] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-03T18:37:43.214321] [DEBUG] [LOCAL ] EFX: Loaded 44908 existing records from primary storage. [2025-10-03T18:37:43.214703] [INFO ] [MAIN ] EFX: Loaded 44908 existing records. [2025-10-03T18:37:43.435298] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:43.459382] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-03T18:37:43.464873] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-03T18:37:43.475250] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:37:43.476391] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-03T18:37:43.476169] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:37:43.476563] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-03T18:37:43.904470] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:43.990683] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-03T18:37:44.069088] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:37:44.790746] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-03T18:37:45.341308] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:37:45.590721] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-03T18:37:45.632255] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T18:37:46.190600] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:37:46.390693] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-03T18:37:47.190711] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-03T18:37:47.392705] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:37:47.990707] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-03T18:37:48.790674] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-03T18:37:48.993824] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:37:49.058609] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:37:49.590693] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-03T18:37:50.157464] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:37:50.390693] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-03T18:37:51.190694] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-03T18:37:51.328609] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T18:37:51.331016] [INFO ] [REMOTE ] EFC: Full fetch complete (66542 records). [2025-10-03T18:37:51.331169] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-03T18:37:51.851870] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-03T18:37:51.851977] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-03T18:37:51.852925] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-03T18:37:51.853005] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-03T18:37:51.854951] [DEBUG] [LOCAL ] EFC: Trimmed 66542 records to 46894 (keeping 200 days of data) [2025-10-03T18:37:51.991410] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-03T18:37:52.160684] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T18:37:52.162524] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T18:37:52.262555] [DEBUG] [LOCAL ] EFC: Primary data saved (46894 records). [2025-10-03T18:37:52.262750] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-03T18:37:52.263537] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFC took 42.8s. Estimated remaining: 3h 51m 54s. Rate: 7.2 symbols/min [2025-10-03T18:37:52.475543] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:52.475777] [DEBUG] [LOCAL ] EFXT: No existing data file found in primary storage. [2025-10-03T18:37:52.475835] [WARN ] [MAIN ] EFXT: No existing data found, performing full refresh instead. [2025-10-03T18:37:52.475958] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-03T18:37:52.476006] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-03T18:37:52.476106] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-03T18:37:52.476186] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-03T18:37:52.795907] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-03T18:37:52.909787] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:53.062681] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:37:53.590691] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-03T18:37:54.390624] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-03T18:37:54.590782] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:37:54.670812] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:37:55.190725] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-03T18:37:55.995718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-03T18:37:55.999990] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:37:56.790629] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-03T18:37:57.050188] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:37:57.050691] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:37:57.498868] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T18:37:57.500133] [INFO ] [REMOTE ] EFR: Full fetch complete (19042 records). [2025-10-03T18:37:57.500210] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-03T18:37:57.595780] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-03T18:37:57.907416] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-03T18:37:57.907537] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-03T18:37:57.908044] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-03T18:37:57.908112] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-03T18:37:57.908797] [DEBUG] [LOCAL ] EFR: Trimmed 19042 records to 14886 (keeping 200 days of data) [2025-10-03T18:37:58.000854] [DEBUG] [LOCAL ] EFR: Primary data saved (14886 records). [2025-10-03T18:37:58.001018] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-03T18:37:58.001154] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 31.4s. Estimated remaining: 3h 51m 39s. Rate: 7.2 symbols/min [2025-10-03T18:37:58.182806] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:58.212389] [DEBUG] [LOCAL ] EG: Loaded 28356 existing records from primary storage. [2025-10-03T18:37:58.212707] [INFO ] [MAIN ] EG: Loaded 28356 existing records. [2025-10-03T18:37:58.400488] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-03T18:37:58.407060] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:58.408133] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-03T18:37:58.408191] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-03T18:37:58.408418] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-03T18:37:58.408476] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-03T18:37:58.697586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:37:58.835715] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:59.190704] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-03T18:37:59.951238] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:37:59.990693] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-03T18:38:00.790732] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-03T18:38:00.838633] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:38:01.450588] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:38:01.590713] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-03T18:38:02.390703] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-03T18:38:02.448503] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:38:03.149157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:38:03.190631] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-03T18:38:03.671098] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:38:03.990685] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-03T18:38:04.568675] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:38:04.790689] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-03T18:38:05.305502] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T18:38:05.590685] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-03T18:38:05.900797] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:38:06.390685] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-03T18:38:07.190683] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-03T18:38:07.214325] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:38:07.990722] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-03T18:38:08.171526] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:38:08.696637] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:38:08.790685] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-03T18:38:08.973059] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T18:38:09.590731] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-03T18:38:10.390715] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-03T18:38:10.460473] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:38:10.507293] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:38:11.190720] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-03T18:38:11.990723] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-03T18:38:12.067041] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T18:38:12.727755] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:38:12.729193] [INFO ] [REMOTE ] EFT: Full fetch complete (17971 records). [2025-10-03T18:38:12.729283] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-03T18:38:12.796734] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-03T18:38:12.939087] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:38:13.170716] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-03T18:38:13.170805] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-03T18:38:13.171196] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-03T18:38:13.171236] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-03T18:38:13.171820] [DEBUG] [LOCAL ] EFT: Trimmed 17971 records to 13268 (keeping 200 days of data) [2025-10-03T18:38:13.255740] [DEBUG] [LOCAL ] EFT: Primary data saved (13268 records). [2025-10-03T18:38:13.255888] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-03T18:38:13.255993] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EFT took 46.2s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-03T18:38:13.443843] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:13.504143] [DEBUG] [LOCAL ] EGO: Loaded 51982 existing records from primary storage. [2025-10-03T18:38:13.504546] [INFO ] [MAIN ] EGO: Loaded 51982 existing records. [2025-10-03T18:38:13.595836] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-03T18:38:13.700396] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:13.700624] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-03T18:38:13.700723] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-03T18:38:13.701071] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-03T18:38:13.701142] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-03T18:38:14.107824] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:14.390674] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-03T18:38:14.464445] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:38:14.469578] [INFO ] [REMOTE ] EFX: Full fetch complete (64208 records). [2025-10-03T18:38:14.469787] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-03T18:38:14.470723] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:38:14.470822] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:38:14.470867] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:38:14.470908] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-03T18:38:14.470996] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-03T18:38:14.471055] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-03T18:38:14.471320] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-03T18:38:14.471448] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 31.5s. Estimated remaining: 3h 51m 22s. Rate: 7.2 symbols/min [2025-10-03T18:38:14.661016] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:14.702554] [DEBUG] [LOCAL ] EGP: Loaded 31092 existing records from primary storage. [2025-10-03T18:38:14.702866] [INFO ] [MAIN ] EGP: Loaded 31092 existing records. [2025-10-03T18:38:14.895552] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:14.895770] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-03T18:38:14.895839] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-03T18:38:14.896518] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-03T18:38:14.896579] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-03T18:38:15.033715] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:38:15.198612] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-03T18:38:15.312451] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:15.990634] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-03T18:38:16.089215] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T18:38:16.568010] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:38:16.790694] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-03T18:38:17.519446] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:38:17.590672] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-03T18:38:18.311468] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:38:18.390726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-03T18:38:19.077804] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:38:19.190637] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-03T18:38:19.513205] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:38:19.990729] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-03T18:38:20.765049] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:38:20.790635] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-03T18:38:21.355490] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:38:21.590706] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-03T18:38:22.392968] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-03T18:38:22.398964] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:38:22.464148] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T18:38:23.190704] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-03T18:38:23.777952] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:38:23.990711] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-03T18:38:24.790728] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-03T18:38:25.165871] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:38:25.184028] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:38:25.186097] [INFO ] [REMOTE ] EFXT: Full fetch complete (44187 records). [2025-10-03T18:38:25.186185] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-03T18:38:25.597123] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-03T18:38:25.616977] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-03T18:38:25.617063] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-03T18:38:25.617790] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-03T18:38:25.617966] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-03T18:38:25.619048] [DEBUG] [LOCAL ] EFXT: Trimmed 44187 records to 29657 (keeping 200 days of data) [2025-10-03T18:38:25.804968] [DEBUG] [LOCAL ] EFXT: Primary data saved (29657 records). [2025-10-03T18:38:25.805133] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-03T18:38:25.805241] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 33.5s. Estimated remaining: 3h 51m 21s. Rate: 7.2 symbols/min [2025-10-03T18:38:25.986831] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:26.037502] [DEBUG] [LOCAL ] EGY: Loaded 42435 existing records from primary storage. [2025-10-03T18:38:26.037883] [INFO ] [MAIN ] EGY: Loaded 42435 existing records. [2025-10-03T18:38:26.275148] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:26.275610] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-03T18:38:26.275723] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-03T18:38:26.276398] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-03T18:38:26.276480] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-03T18:38:26.401629] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-03T18:38:26.439816] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:38:26.701241] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:27.091554] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:38:27.190743] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-03T18:38:27.653196] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T18:38:27.990742] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-03T18:38:28.790750] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-03T18:38:28.977878] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:38:29.590674] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-03T18:38:29.660360] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:38:30.048708] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T18:38:30.390694] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-03T18:38:31.154811] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:38:31.190631] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-03T18:38:31.533603] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:38:31.535356] [INFO ] [REMOTE ] EG: Full fetch complete (43510 records). [2025-10-03T18:38:31.535540] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-03T18:38:31.966783] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-03T18:38:31.966875] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-03T18:38:31.967563] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-03T18:38:31.967683] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-03T18:38:31.968783] [DEBUG] [LOCAL ] EG: Trimmed 43510 records to 28480 (keeping 200 days of data) [2025-10-03T18:38:32.030744] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-03T18:38:32.161355] [DEBUG] [LOCAL ] EG: Primary data saved (28480 records). [2025-10-03T18:38:32.161495] [INFO ] [MAIN ] EG: Full history saved. [2025-10-03T18:38:32.161578] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EG took 34.2s. Estimated remaining: 3h 51m 8s. Rate: 7.2 symbols/min [2025-10-03T18:38:32.353041] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:32.384506] [DEBUG] [LOCAL ] EHAB: Loaded 29810 existing records from primary storage. [2025-10-03T18:38:32.384828] [INFO ] [MAIN ] EHAB: Loaded 29810 existing records. [2025-10-03T18:38:32.592311] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:32.592545] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-03T18:38:32.592594] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-03T18:38:32.592928] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-03T18:38:32.592990] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-03T18:38:32.797090] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-03T18:38:32.951088] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:38:33.061595] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:33.590672] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-03T18:38:33.744550] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T18:38:34.403582] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-03T18:38:34.407134] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:38:34.984332] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:38:35.190730] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-03T18:38:35.660638] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T18:38:35.990705] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-03T18:38:36.584324] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:38:36.790703] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-03T18:38:37.590676] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-03T18:38:37.826043] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T18:38:37.884702] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T18:38:38.390685] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-03T18:38:38.820306] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:38:39.190705] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-03T18:38:39.990677] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-03T18:38:40.142951] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:38:40.790630] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-03T18:38:40.820930] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T18:38:40.907128] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T18:38:41.590709] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-03T18:38:42.277845] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:38:42.390736] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-03T18:38:43.171493] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:38:43.190621] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-03T18:38:43.990761] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-03T18:38:44.225462] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T18:38:44.497888] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T18:38:44.500720] [INFO ] [REMOTE ] EGO: Full fetch complete (73742 records). [2025-10-03T18:38:44.500867] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-03T18:38:44.795793] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-03T18:38:44.946160] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-03T18:38:44.946255] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-03T18:38:44.947205] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-03T18:38:44.947278] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-03T18:38:44.949117] [DEBUG] [LOCAL ] EGO: Trimmed 73742 records to 52369 (keeping 200 days of data) [2025-10-03T18:38:45.269407] [DEBUG] [LOCAL ] EGO: Primary data saved (52369 records). [2025-10-03T18:38:45.269547] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-03T18:38:45.269631] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGO took 32.0s. Estimated remaining: 3h 51m 11s. Rate: 7.2 symbols/min [2025-10-03T18:38:45.467599] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:45.487587] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:38:45.533841] [DEBUG] [LOCAL ] EHC: Loaded 41398 existing records from primary storage. [2025-10-03T18:38:45.534167] [INFO ] [MAIN ] EHC: Loaded 41398 existing records. [2025-10-03T18:38:45.600596] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-03T18:38:45.727821] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:45.728037] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-03T18:38:45.728088] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-03T18:38:45.729413] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-03T18:38:45.729476] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-03T18:38:46.106969] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:46.390693] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-03T18:38:46.429902] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:38:47.190631] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-03T18:38:47.217265] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T18:38:47.657735] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:38:47.990734] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-03T18:38:48.752759] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:38:48.790626] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-03T18:38:49.115241] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:38:49.116924] [INFO ] [REMOTE ] EGP: Full fetch complete (45450 records). [2025-10-03T18:38:49.117016] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-03T18:38:49.541255] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-03T18:38:49.541337] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-03T18:38:49.541963] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-03T18:38:49.542027] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-03T18:38:49.543167] [DEBUG] [LOCAL ] EGP: Trimmed 45450 records to 31284 (keeping 200 days of data) [2025-10-03T18:38:49.606591] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-03T18:38:49.755746] [DEBUG] [LOCAL ] EGP: Primary data saved (31284 records). [2025-10-03T18:38:49.755888] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-03T18:38:49.755974] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EGP took 35.3s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-03T18:38:49.955782] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:49.968153] [DEBUG] [LOCAL ] EHI: Loaded 10681 existing records from primary storage. [2025-10-03T18:38:49.968398] [INFO ] [MAIN ] EHI: Loaded 10681 existing records. [2025-10-03T18:38:50.181319] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:50.181542] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-03T18:38:50.181589] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-03T18:38:50.181803] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-03T18:38:50.181862] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-03T18:38:50.396311] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-03T18:38:50.531851] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:38:50.623068] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:51.099872] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:38:51.190668] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-03T18:38:51.990669] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-03T18:38:52.228489] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:38:52.431338] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:38:52.790683] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-03T18:38:53.495834] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:38:53.590694] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-03T18:38:53.726778] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T18:38:54.390709] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-03T18:38:55.065003] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T18:38:55.190718] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-03T18:38:55.294960] [DEBUG] [REMOTE ] EGY: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T18:38:55.295288] [WARN ] [REMOTE ] EGY: No data returned for month 2025-08 [2025-10-03T18:38:55.295382] [FATAL] [REMOTE ] EGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:38:55.295517] [FATAL] [MAIN ] EGY: Failed to fetch primary data. [2025-10-03T18:38:55.295592] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:38:55.295703] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-03T18:38:55.295781] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-03T18:38:55.295822] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-03T18:38:55.296056] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-03T18:38:55.296582] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 29.5s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-03T18:38:55.489869] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:55.515688] [DEBUG] [LOCAL ] EIC: Loaded 23651 existing records from primary storage. [2025-10-03T18:38:55.516030] [INFO ] [MAIN ] EIC: Loaded 23651 existing records. [2025-10-03T18:38:55.724953] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:55.725280] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-03T18:38:55.725483] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-03T18:38:55.741620] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-03T18:38:55.742174] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-03T18:38:55.742920] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T18:38:55.995713] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-03T18:38:56.155717] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:56.790690] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-03T18:38:56.963040] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:38:57.590698] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-03T18:38:58.194362] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:38:58.390690] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-03T18:38:58.867476] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T18:38:59.190721] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-03T18:38:59.558616] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T18:38:59.990695] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-03T18:39:00.557529] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:39:00.761313] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:39:00.790717] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-03T18:39:01.590698] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-03T18:39:02.390685] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-03T18:39:02.893864] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T18:39:03.031544] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:39:03.034296] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:39:03.190735] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-03T18:39:03.990638] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-03T18:39:04.454409] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T18:39:04.790676] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-03T18:39:05.066492] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:39:05.590626] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-03T18:39:05.663266] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:39:06.390685] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-03T18:39:07.106241] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:39:07.190692] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-03T18:39:07.246277] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T18:39:07.947459] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T18:39:07.990585] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-03T18:39:08.790714] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-03T18:39:09.031386] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T18:39:09.032964] [INFO ] [REMOTE ] EHAB: Full fetch complete (41057 records). [2025-10-03T18:39:09.033087] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-03T18:39:09.427558] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-03T18:39:09.427716] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-03T18:39:09.428395] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-03T18:39:09.428471] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-03T18:39:09.429683] [DEBUG] [LOCAL ] EHAB: Trimmed 41057 records to 29954 (keeping 200 days of data) [2025-10-03T18:39:09.593707] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-03T18:39:09.603175] [DEBUG] [LOCAL ] EHAB: Primary data saved (29954 records). [2025-10-03T18:39:09.604051] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-03T18:39:09.604156] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHAB took 37.4s. Estimated remaining: 3h 50m 44s. Rate: 7.2 symbols/min [2025-10-03T18:39:09.790305] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:09.790530] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-03T18:39:09.790571] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-03T18:39:09.790753] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-03T18:39:09.790795] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-03T18:39:09.790839] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-03T18:39:09.791106] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-03T18:39:10.235704] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:10.237552] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T18:39:10.390715] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-03T18:39:11.010330] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:39:11.190722] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-03T18:39:11.235096] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:39:11.990713] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-03T18:39:12.535894] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T18:39:12.790744] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-03T18:39:12.992525] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:39:13.590687] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-03T18:39:14.005251] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:39:14.390714] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-03T18:39:14.884832] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T18:39:15.190687] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-03T18:39:15.282493] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T18:39:15.530567] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:39:15.990690] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-03T18:39:16.790756] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-03T18:39:17.080216] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T18:39:17.590711] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-03T18:39:18.246773] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:39:18.329280] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:39:18.390740] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-03T18:39:19.190732] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-03T18:39:19.990702] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-03T18:39:20.282983] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:39:20.549263] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T18:39:20.790705] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-03T18:39:21.253066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T18:39:21.388139] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-03T18:39:21.390532] [INFO ] [REMOTE ] EHC: Full fetch complete (58926 records). [2025-10-03T18:39:21.390766] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-03T18:39:21.596453] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-03T18:39:21.828663] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-03T18:39:21.828763] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-03T18:39:21.829505] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-03T18:39:21.829553] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-03T18:39:21.830945] [DEBUG] [LOCAL ] EHC: Trimmed 58926 records to 41700 (keeping 200 days of data) [2025-10-03T18:39:22.115323] [DEBUG] [LOCAL ] EHC: Primary data saved (41700 records). [2025-10-03T18:39:22.115509] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-03T18:39:22.115638] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHC took 36.8s. Estimated remaining: 3h 50m 45s. Rate: 7.2 symbols/min [2025-10-03T18:39:22.300814] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:22.300986] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-03T18:39:22.301028] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-03T18:39:22.301149] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-03T18:39:22.301192] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-03T18:39:22.301235] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-03T18:39:22.301289] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-03T18:39:22.395873] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-03T18:39:22.707405] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:22.883798] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:39:22.959290] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:39:23.190718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-03T18:39:23.597391] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T18:39:23.990725] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-03T18:39:24.340257] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-03T18:39:24.790691] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-03T18:39:25.369778] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T18:39:25.590724] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-03T18:39:26.390690] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-03T18:39:26.670042] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:39:26.809213] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T18:39:27.190725] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-03T18:39:27.575447] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:39:27.990714] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-03T18:39:28.325801] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T18:39:28.790692] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-03T18:39:29.590738] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-03T18:39:29.724123] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:39:29.968601] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T18:39:29.969314] [INFO ] [REMOTE ] EICA: Full fetch complete (1297 records). [2025-10-03T18:39:29.969428] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-03T18:39:30.171141] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-03T18:39:30.171420] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:30.171515] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:30.171604] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-03T18:39:30.171729] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-03T18:39:30.171800] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-03T18:39:30.171862] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-03T18:39:30.171959] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EICA took 20.6s. Estimated remaining: 3h 50m 36s. Rate: 7.2 symbols/min [2025-10-03T18:39:30.357699] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:30.357913] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-03T18:39:30.357970] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-03T18:39:30.358085] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-03T18:39:30.358130] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-03T18:39:30.358172] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-03T18:39:30.358205] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-03T18:39:30.395727] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-03T18:39:30.752480] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:30.881948] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T18:39:31.190718] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-03T18:39:31.990711] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-03T18:39:32.270035] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T18:39:32.667781] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T18:39:32.790721] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-03T18:39:33.205180] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T18:39:33.590741] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-03T18:39:34.013808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-03T18:39:34.390727] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-03T18:39:34.821111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:39:35.190710] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-03T18:39:35.990704] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-03T18:39:36.262481] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:39:36.263821] [INFO ] [REMOTE ] EIC: Full fetch complete (34806 records). [2025-10-03T18:39:36.263929] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-03T18:39:36.698296] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-03T18:39:36.698465] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-03T18:39:36.699102] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-03T18:39:36.699168] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-03T18:39:36.700104] [DEBUG] [LOCAL ] EIC: Trimmed 34806 records to 23785 (keeping 200 days of data) [2025-10-03T18:39:36.793204] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-03T18:39:36.862160] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T18:39:36.870957] [DEBUG] [LOCAL ] EIC: Primary data saved (23785 records). [2025-10-03T18:39:36.871112] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-03T18:39:36.871205] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EIC took 41.6s. Estimated remaining: 3h 50m 24s. Rate: 7.2 symbols/min [2025-10-03T18:39:37.055972] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:37.078356] [DEBUG] [LOCAL ] EIG: Loaded 20444 existing records from primary storage. [2025-10-03T18:39:37.078698] [INFO ] [MAIN ] EIG: Loaded 20444 existing records. [2025-10-03T18:39:37.196231] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-03T18:39:37.277558] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:39:37.277825] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-03T18:39:37.277918] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-03T18:39:37.278193] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-03T18:39:37.278255] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-03T18:39:37.594992] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-03T18:39:37.680111] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:38.191357] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:39:38.390715] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-03T18:39:38.852081] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T18:39:39.190730] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-03T18:39:39.631807] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:39:39.990703] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-03T18:39:40.638922] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T18:39:40.790676] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-03T18:39:41.590712] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-03T18:39:41.855895] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:39:41.857450] [INFO ] [REMOTE ] EHI: Full fetch complete (16327 records). [2025-10-03T18:39:41.857555] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-03T18:39:41.984313] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:39:41.996294] [INFO ] [REMOTE ] EICB: Full fetch complete (2730 records). [2025-10-03T18:39:42.006736] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-03T18:39:42.393167] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-03T18:39:42.498165] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T18:39:42.519212] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:42.519315] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:42.519380] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-03T18:39:42.519488] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-03T18:39:42.530980] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-03T18:39:42.531145] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-03T18:39:42.531315] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-03T18:39:42.531993] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-03T18:39:42.532125] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-03T18:39:42.531488] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-03T18:39:42.532469] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 20.4s. Estimated remaining: 3h 50m 9s. Rate: 7.2 symbols/min [2025-10-03T18:39:42.533321] [DEBUG] [LOCAL ] EHI: Trimmed 16327 records to 10783 (keeping 200 days of data) [2025-10-03T18:39:42.774186] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:42.790997] [DEBUG] [LOCAL ] EHI: Primary data saved (10783 records). [2025-10-03T18:39:42.791173] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-03T18:39:42.791283] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EHI took 53.0s. Estimated remaining: 3h 49m 42s. Rate: 7.2 symbols/min [2025-10-03T18:39:42.839257] [DEBUG] [LOCAL ] EIX: Loaded 53730 existing records from primary storage. [2025-10-03T18:39:42.839677] [INFO ] [MAIN ] EIX: Loaded 53730 existing records. [2025-10-03T18:39:43.032548] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:39:43.032840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-03T18:39:43.032895] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-03T18:39:43.033454] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-03T18:39:43.033515] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-03T18:39:43.152954] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:39:43.197591] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-03T18:39:43.435391] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:43.905398] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T18:39:43.990694] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-03T18:39:44.790716] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-03T18:39:45.387036] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:39:45.590696] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-03T18:39:45.842757] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:39:46.046856] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T18:39:46.390714] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-03T18:39:47.190692] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-03T18:39:47.734410] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:39:47.990703] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-03T18:39:48.681246] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T18:39:48.790689] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-03T18:39:49.163398] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:39:49.212867] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:39:49.590699] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-03T18:39:50.390697] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-03T18:39:50.496873] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T18:39:51.190744] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-03T18:39:51.906026] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:39:51.990733] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-03T18:39:52.234730] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T18:39:52.790669] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-03T18:39:53.004462] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T18:39:53.590737] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-03T18:39:54.193930] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:39:54.194832] [INFO ] [REMOTE ] EICC: Full fetch complete (8265 records). [2025-10-03T18:39:54.194902] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-03T18:39:54.195343] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:39:54.195431] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:54.195475] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:54.195515] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-03T18:39:54.195571] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-03T18:39:54.195608] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-03T18:39:54.195689] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-03T18:39:54.195797] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EICC took 24.0s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-03T18:39:54.390712] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-03T18:39:54.654883] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T18:39:55.190745] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-03T18:39:55.528750] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:39:55.990754] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-03T18:39:57.137797] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:39:57.166437] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-03T18:39:57.168625] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T18:39:57.590734] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-03T18:39:58.964109] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T18:39:58.970281] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-03T18:39:59.129965] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:39:59.190689] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-03T18:40:00.013269] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:40:00.018061] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-03T18:40:01.172604] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T18:40:01.177967] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-03T18:40:01.244887] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T18:40:01.590704] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-03T18:40:02.437937] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T18:40:02.446982] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-03T18:40:03.801365] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T18:40:03.814722] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-03T18:40:03.834588] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:40:03.990691] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-03T18:40:05.104599] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:40:05.106125] [INFO ] [REMOTE ] EIG: Full fetch complete (27131 records). [2025-10-03T18:40:05.106221] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-03T18:40:05.507016] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-03T18:40:05.507105] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-03T18:40:05.507674] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-03T18:40:05.507741] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-03T18:40:05.508624] [DEBUG] [LOCAL ] EIG: Trimmed 27131 records to 20583 (keeping 200 days of data) [2025-10-03T18:40:05.634171] [DEBUG] [LOCAL ] EIG: Primary data saved (20583 records). [2025-10-03T18:40:05.634299] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-03T18:40:05.634404] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIG took 28.8s. Estimated remaining: 3h 49m 40s. Rate: 7.2 symbols/min [2025-10-03T18:40:06.010186] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:40:06.022297] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-03T18:40:08.029994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:40:08.042194] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-03T18:40:09.763542] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:40:09.766243] [INFO ] [REMOTE ] EIX: Full fetch complete (77038 records). [2025-10-03T18:40:09.766366] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-03T18:40:10.193785] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-03T18:40:10.193873] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-03T18:40:10.194864] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-03T18:40:10.194933] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-03T18:40:10.196613] [DEBUG] [LOCAL ] EIX: Trimmed 77038 records to 54120 (keeping 200 days of data) [2025-10-03T18:40:10.534774] [DEBUG] [LOCAL ] EIX: Primary data saved (54120 records). [2025-10-03T18:40:10.534922] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-03T18:40:10.535013] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EIX took 28.0s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-03T18:40:11.142322] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.342374] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.362430] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.357670] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.373559] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-03T18:40:11.373993] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-10-03T18:40:11.638085] [DEBUG] [LOCAL ] EL: Loaded 53778 existing records from primary storage. [2025-10-03T18:40:11.682807] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:11.686439] [DEBUG] [LOCAL ] ELF: Loaded 52560 existing records from primary storage. [2025-10-03T18:40:11.685101] [INFO ] [MAIN ] EL: Loaded 53778 existing records. [2025-10-03T18:40:11.685322] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-03T18:40:11.692713] [DEBUG] [LOCAL ] ELAN: Loaded 53643 existing records from primary storage. [2025-10-03T18:40:11.699741] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-03T18:40:11.705342] [INFO ] [MAIN ] ELF: Loaded 52560 existing records. [2025-10-03T18:40:11.711763] [INFO ] [MAIN ] ELAN: Loaded 53643 existing records. [2025-10-03T18:40:11.747005] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-03T18:40:11.774008] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-03T18:40:12.430594] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.451445] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.480532] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.474592] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.491787] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.502293] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.474728] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-03T18:40:12.507578] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-03T18:40:12.524790] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-03T18:40:12.575597] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-03T18:40:12.588936] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-03T18:40:12.588642] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-03T18:40:12.594217] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-03T18:40:12.631033] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-03T18:40:12.655215] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-03T18:40:13.337407] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:13.418350] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-03T18:40:13.934193] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:13.957155] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-03T18:40:13.968299] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:14.001703] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-03T18:40:14.039729] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:14.040840] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-03T18:40:14.501117] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T18:40:14.503005] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-03T18:40:15.092743] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:40:15.094259] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-03T18:40:15.548247] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T18:40:15.549834] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-03T18:40:15.959876] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:40:15.971554] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-03T18:40:16.290370] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-03T18:40:16.301939] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-03T18:40:16.308458] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:40:16.309955] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-03T18:40:16.346763] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:40:16.359019] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-03T18:40:16.720918] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T18:40:16.722618] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-03T18:40:17.284134] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:40:17.285805] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-03T18:40:17.579842] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:40:17.591628] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-03T18:40:17.852886] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:40:17.854870] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-03T18:40:17.959101] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:40:18.053451] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:40:18.227224] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:40:18.390737] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-03T18:40:19.190629] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-03T18:40:19.239114] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:40:19.990611] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-03T18:40:20.504636] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T18:40:20.790701] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-03T18:40:21.342524] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T18:40:21.403353] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T18:40:21.590722] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-03T18:40:21.742039] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:40:22.390704] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-03T18:40:22.954893] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:40:23.190700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-03T18:40:23.571363] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:40:23.673454] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:40:23.674235] [INFO ] [REMOTE ] ELC: Full fetch complete (5088 records). [2025-10-03T18:40:23.674307] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-03T18:40:23.674740] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:40:23.674826] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:40:23.674885] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:40:23.674987] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-03T18:40:23.675070] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-03T18:40:23.675110] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-03T18:40:23.675414] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-03T18:40:23.675519] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 13.1s. Estimated remaining: 3h 49m 26s. Rate: 7.2 symbols/min [2025-10-03T18:40:23.875639] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:23.928124] [DEBUG] [LOCAL ] ELME: Loaded 39517 existing records from primary storage. [2025-10-03T18:40:23.928438] [INFO ] [MAIN ] ELME: Loaded 39517 existing records. [2025-10-03T18:40:23.995759] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-03T18:40:24.145894] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:24.146131] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-03T18:40:24.146184] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-03T18:40:24.146548] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-03T18:40:24.146608] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-03T18:40:24.548564] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:24.790741] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-03T18:40:25.590732] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-03T18:40:26.121061] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-03T18:40:26.390726] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-03T18:40:27.189210] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-03T18:40:27.193630] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-03T18:40:27.282436] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:40:27.848350] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T18:40:27.990722] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-03T18:40:28.790697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-03T18:40:29.397682] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T18:40:29.590718] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-03T18:40:29.663735] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:40:30.190691] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:40:30.390697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-03T18:40:31.190720] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-03T18:40:31.710764] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T18:40:31.934077] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T18:40:31.990731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-03T18:40:32.790721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-03T18:40:33.172316] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T18:40:33.550969] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:40:33.590730] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-03T18:40:34.390691] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-03T18:40:34.546612] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:40:35.170385] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:40:35.190677] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-03T18:40:35.990622] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-03T18:40:36.488032] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T18:40:36.611450] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:40:36.790702] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-03T18:40:37.590716] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-03T18:40:37.881285] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:40:38.225064] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T18:40:38.390722] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-03T18:40:39.190731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-03T18:40:39.829075] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T18:40:39.990699] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-03T18:40:40.220369] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:40:40.755257] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T18:40:40.790664] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-03T18:40:41.590628] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-03T18:40:41.909339] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:40:42.293829] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:40:42.390703] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-03T18:40:43.190632] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-03T18:40:43.317482] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T18:40:43.990694] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-03T18:40:44.371932] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:40:44.790711] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-03T18:40:45.365377] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T18:40:45.419870] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:40:45.590729] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-03T18:40:46.390731] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-03T18:40:46.517038] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:40:46.519793] [INFO ] [REMOTE ] ELF: Full fetch complete (75289 records). [2025-10-03T18:40:46.519952] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-03T18:40:46.965593] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-03T18:40:46.965717] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-03T18:40:46.966718] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-03T18:40:46.966819] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-03T18:40:46.968420] [DEBUG] [LOCAL ] ELF: Trimmed 75289 records to 52899 (keeping 200 days of data) [2025-10-03T18:40:47.191319] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-03T18:40:47.311310] [DEBUG] [LOCAL ] ELF: Primary data saved (52899 records). [2025-10-03T18:40:47.311518] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-03T18:40:47.311778] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELF took 36.8s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-03T18:40:47.492830] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:47.530697] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:40:47.563742] [DEBUG] [LOCAL ] ELP: Loaded 25797 existing records from primary storage. [2025-10-03T18:40:47.564046] [INFO ] [MAIN ] ELP: Loaded 25797 existing records. [2025-10-03T18:40:47.788024] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:47.788314] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-03T18:40:47.788383] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-03T18:40:47.789350] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-03T18:40:47.789429] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-03T18:40:47.998832] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-03T18:40:48.300767] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:48.400065] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:40:48.655116] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:40:48.658619] [INFO ] [REMOTE ] ELME: Full fetch complete (56095 records). [2025-10-03T18:40:48.658848] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-03T18:40:48.795819] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-03T18:40:49.179867] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-03T18:40:49.179996] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-03T18:40:49.180871] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-03T18:40:49.180946] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-03T18:40:49.182278] [DEBUG] [LOCAL ] ELME: Trimmed 56095 records to 39824 (keeping 200 days of data) [2025-10-03T18:40:49.412980] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:40:49.416406] [INFO ] [REMOTE ] EL: Full fetch complete (76922 records). [2025-10-03T18:40:49.416548] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-03T18:40:49.418379] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:40:49.419032] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:40:49.419709] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:40:49.420033] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-03T18:40:49.420998] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-03T18:40:49.421844] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-10-03T18:40:49.422817] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-10-03T18:40:49.423147] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. EL took 38.9s. Estimated remaining: 3h 49m 30s. Rate: 7.2 symbols/min [2025-10-03T18:40:49.591859] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-03T18:40:49.625095] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:49.626148] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-03T18:40:49.626218] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-03T18:40:49.627798] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-03T18:40:49.628779] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-03T18:40:49.629840] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-03T18:40:49.630402] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-03T18:40:49.932666] [DEBUG] [LOCAL ] ELME: Primary data saved (39824 records). [2025-10-03T18:40:49.956627] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-03T18:40:49.957785] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELME took 26.3s. Estimated remaining: 3h 49m 4s. Rate: 7.2 symbols/min [2025-10-03T18:40:50.174731] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:50.247968] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:50.298028] [DEBUG] [LOCAL ] ELS: Loaded 49822 existing records from primary storage. [2025-10-03T18:40:50.298351] [INFO ] [MAIN ] ELS: Loaded 49822 existing records. [2025-10-03T18:40:50.399250] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-03T18:40:50.502426] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:50.502757] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-03T18:40:50.502814] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-03T18:40:50.504045] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-03T18:40:50.504108] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-03T18:40:50.803293] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-03T18:40:50.930097] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:50.923592] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:40:50.961275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:40:51.190721] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-03T18:40:51.615625] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:40:51.990708] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-03T18:40:52.790680] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-03T18:40:53.106524] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:40:53.117426] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T18:40:53.590686] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-03T18:40:54.390724] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-03T18:40:55.171833] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:40:55.174681] [INFO ] [REMOTE ] ELAN: Full fetch complete (76870 records). [2025-10-03T18:40:55.174821] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-03T18:40:55.197158] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-03T18:40:55.604500] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-03T18:40:55.604668] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-03T18:40:55.605593] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-03T18:40:55.605758] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-03T18:40:55.607421] [DEBUG] [LOCAL ] ELAN: Trimmed 76870 records to 54031 (keeping 200 days of data) [2025-10-03T18:40:55.743186] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:40:55.981365] [DEBUG] [LOCAL ] ELAN: Primary data saved (54031 records). [2025-10-03T18:40:55.981509] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-03T18:40:55.982256] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELAN took 45.4s. Estimated remaining: 3h 48m 50s. Rate: 7.2 symbols/min [2025-10-03T18:40:55.996348] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-03T18:40:56.170753] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:56.228563] [DEBUG] [LOCAL ] ELV: Loaded 50927 existing records from primary storage. [2025-10-03T18:40:56.228954] [INFO ] [MAIN ] ELV: Loaded 50927 existing records. [2025-10-03T18:40:56.430115] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:56.430933] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-03T18:40:56.431007] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-03T18:40:56.432865] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-03T18:40:56.432966] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-03T18:40:56.796128] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-03T18:40:56.831776] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:56.915403] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:40:57.046220] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:40:57.306577] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T18:40:57.590686] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-03T18:40:58.390623] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-03T18:40:58.820090] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:40:59.190707] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-03T18:40:59.710835] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:40:59.990676] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-03T18:41:00.274464] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:41:00.790698] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-03T18:41:01.282713] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:41:01.590684] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-03T18:41:02.283152] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:41:02.390620] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-03T18:41:02.816549] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:41:03.190690] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-03T18:41:03.990685] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-03T18:41:04.225985] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T18:41:04.424338] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:41:04.476722] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T18:41:04.790698] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-03T18:41:05.590794] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-03T18:41:06.121108] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T18:41:06.390707] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-03T18:41:07.190670] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-03T18:41:07.249018] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:41:07.625366] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:41:07.990628] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-03T18:41:08.259045] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:41:08.790680] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-03T18:41:09.121421] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T18:41:09.210143] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-03T18:41:09.590679] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-03T18:41:09.928129] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-03T18:41:10.390729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-03T18:41:11.190720] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-03T18:41:11.438278] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T18:41:11.990711] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-03T18:41:12.231410] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:41:12.384500] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:41:12.385271] [INFO ] [REMOTE ] ELPC: Full fetch complete (1435 records). [2025-10-03T18:41:12.385343] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-03T18:41:12.611506] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-03T18:41:12.611900] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:41:12.611973] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:41:12.612058] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-03T18:41:12.612197] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-03T18:41:12.612258] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-03T18:41:12.612322] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-03T18:41:12.612428] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELPC took 23.2s. Estimated remaining: 3h 49m 1s. Rate: 7.2 symbols/min [2025-10-03T18:41:12.801812] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-03T18:41:12.807580] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:12.807802] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-03T18:41:12.807848] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-03T18:41:12.807960] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-03T18:41:12.808002] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-03T18:41:12.808048] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-03T18:41:12.808101] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-03T18:41:13.208106] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:13.590726] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-03T18:41:13.828315] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:41:13.829954] [INFO ] [REMOTE ] ELP: Full fetch complete (37056 records). [2025-10-03T18:41:13.830037] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-03T18:41:14.241432] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-03T18:41:14.241561] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-03T18:41:14.242234] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-03T18:41:14.242312] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-03T18:41:14.243327] [DEBUG] [LOCAL ] ELP: Trimmed 37056 records to 25951 (keeping 200 days of data) [2025-10-03T18:41:14.390703] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-03T18:41:14.394250] [DEBUG] [LOCAL ] ELP: Primary data saved (25951 records). [2025-10-03T18:41:14.394360] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-03T18:41:14.394447] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. ELP took 27.1s. Estimated remaining: 3h 48m 38s. Rate: 7.2 symbols/min [2025-10-03T18:41:14.577910] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:14.600185] [DEBUG] [LOCAL ] EMD: Loaded 21348 existing records from primary storage. [2025-10-03T18:41:14.600514] [INFO ] [MAIN ] EMD: Loaded 21348 existing records. [2025-10-03T18:41:14.674955] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:41:14.711356] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-03T18:41:14.722357] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:41:14.732745] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-03T18:41:14.737962] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:41:14.763174] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-03T18:41:14.797387] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:14.797625] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-03T18:41:14.797851] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-03T18:41:14.797791] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-03T18:41:14.797945] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-03T18:41:14.798074] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-03T18:41:14.798221] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. EMA took 2.2s. Estimated remaining: 3h 48m 11s. Rate: 7.2 symbols/min [2025-10-03T18:41:14.835104] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-03T18:41:14.871697] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-03T18:41:15.107203] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:15.207087] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-03T18:41:15.439421] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:41:15.462980] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:15.464347] [DEBUG] [LOCAL ] EME: Loaded 31497 existing records from primary storage. [2025-10-03T18:41:15.474064] [INFO ] [MAIN ] EME: Loaded 31497 existing records. [2025-10-03T18:41:15.671836] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:15.672066] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-03T18:41:15.672115] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-03T18:41:15.673222] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-03T18:41:15.673288] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-03T18:41:15.995879] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-03T18:41:16.072507] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:16.790748] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-03T18:41:17.473350] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T18:41:17.590688] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-03T18:41:17.840437] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:41:17.919366] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:41:18.390734] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-03T18:41:19.190755] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-03T18:41:19.309545] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T18:41:19.450443] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:41:19.990719] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-03T18:41:20.192494] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:41:20.790739] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-03T18:41:21.201020] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T18:41:21.590706] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-03T18:41:22.317868] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:41:22.390690] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-03T18:41:23.190700] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-03T18:41:23.745976] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T18:41:23.921834] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:41:23.983490] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:41:23.990615] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-03T18:41:24.790730] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-03T18:41:25.590679] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-03T18:41:25.956462] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T18:41:25.964081] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T18:41:26.390730] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-03T18:41:27.111380] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:41:27.190692] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-03T18:41:27.990735] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-03T18:41:28.389586] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T18:41:28.790737] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-03T18:41:29.003078] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:41:29.204500] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:41:29.590769] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-03T18:41:30.390639] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-03T18:41:30.519784] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:41:31.034818] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T18:41:31.094162] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:41:31.190702] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-03T18:41:31.990639] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-03T18:41:32.310733] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:41:32.790683] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-03T18:41:33.590683] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-03T18:41:33.690212] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:41:33.932892] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:41:34.390696] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-03T18:41:35.196197] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-03T18:41:35.220335] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:41:35.992951] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-03T18:41:35.997615] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:41:36.304523] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:41:36.790703] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-03T18:41:37.460436] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:41:37.590696] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-03T18:41:38.190866] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:41:38.390719] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-03T18:41:39.190719] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-03T18:41:39.490736] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T18:41:39.795716] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:41:39.990706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-03T18:41:40.790744] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-03T18:41:40.817767] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:41:40.820380] [INFO ] [REMOTE ] ELV: Full fetch complete (72793 records). [2025-10-03T18:41:40.820630] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-03T18:41:40.822041] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:41:40.822197] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:41:40.822366] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:41:40.822466] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-03T18:41:40.822618] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-03T18:41:40.822734] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-03T18:41:40.823025] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-03T18:41:40.824299] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 44.8s. Estimated remaining: 3h 48m 43s. Rate: 7.2 symbols/min [2025-10-03T18:41:41.135332] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:41:41.143584] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:41.146629] [INFO ] [REMOTE ] EMD: Full fetch complete (32529 records). [2025-10-03T18:41:41.146765] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-03T18:41:41.283936] [DEBUG] [LOCAL ] EMF: Loaded 3431 existing records from primary storage. [2025-10-03T18:41:41.284905] [INFO ] [MAIN ] EMF: Loaded 3431 existing records. [2025-10-03T18:41:41.595928] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-03T18:41:41.703582] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:41.736967] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-03T18:41:41.742542] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-03T18:41:41.779824] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-03T18:41:41.801636] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-03T18:41:41.936138] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-03T18:41:41.951348] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-03T18:41:41.955047] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-03T18:41:41.955481] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-03T18:41:42.020239] [DEBUG] [LOCAL ] EMD: Trimmed 32529 records to 21522 (keeping 200 days of data) [2025-10-03T18:41:42.363932] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:42.364606] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:41:42.371897] [INFO ] [REMOTE ] ELS: Full fetch complete (70836 records). [2025-10-03T18:41:42.372619] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-03T18:41:42.398693] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-03T18:41:42.853997] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-03T18:41:42.853807] [DEBUG] [LOCAL ] EMD: Primary data saved (21522 records). [2025-10-03T18:41:42.854116] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-03T18:41:42.854243] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. EMD took 28.5s. Estimated remaining: 3h 48m 20s. Rate: 7.2 symbols/min [2025-10-03T18:41:42.854327] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-03T18:41:42.860608] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-03T18:41:42.909968] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-03T18:41:43.028114] [DEBUG] [LOCAL ] ELS: Trimmed 70836 records to 50194 (keeping 200 days of data) [2025-10-03T18:41:43.058944] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:43.133419] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T18:41:43.199820] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-03T18:41:43.202175] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:41:43.364297] [DEBUG] [LOCAL ] EMN: Loaded 50840 existing records from primary storage. [2025-10-03T18:41:43.366050] [INFO ] [MAIN ] EMN: Loaded 50840 existing records. [2025-10-03T18:41:43.654609] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:43.657844] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-03T18:41:43.660200] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-03T18:41:43.662192] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-03T18:41:43.663593] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-03T18:41:43.846353] [DEBUG] [LOCAL ] ELS: Primary data saved (50194 records). [2025-10-03T18:41:43.846928] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-03T18:41:43.862351] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. ELS took 53.9s. Estimated remaining: 3h 47m 55s. Rate: 7.2 symbols/min [2025-10-03T18:41:43.998866] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-03T18:41:44.250671] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:44.282275] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:44.296061] [DEBUG] [LOCAL ] EMO: Loaded 12644 existing records from primary storage. [2025-10-03T18:41:44.296300] [INFO ] [MAIN ] EMO: Loaded 12644 existing records. [2025-10-03T18:41:44.516011] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:44.516553] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-03T18:41:44.516629] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-03T18:41:44.517638] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-03T18:41:44.517738] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-03T18:41:44.803060] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-03T18:41:44.846797] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T18:41:44.960848] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:44.963289] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:41:45.590722] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-03T18:41:46.390718] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-03T18:41:46.574828] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T18:41:46.677499] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:41:46.795694] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-03T18:41:47.190697] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-03T18:41:47.886200] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T18:41:47.990665] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-03T18:41:48.575789] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:41:48.790691] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-03T18:41:49.261851] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T18:41:49.590687] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-03T18:41:50.390711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-03T18:41:50.971014] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:41:50.972865] [INFO ] [REMOTE ] EME: Full fetch complete (46854 records). [2025-10-03T18:41:50.972956] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-03T18:41:51.195755] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-03T18:41:51.419346] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-03T18:41:51.419450] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-03T18:41:51.420192] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-03T18:41:51.420266] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-03T18:41:51.421581] [DEBUG] [LOCAL ] EME: Trimmed 46854 records to 31702 (keeping 200 days of data) [2025-10-03T18:41:51.654258] [DEBUG] [LOCAL ] EME: Primary data saved (31702 records). [2025-10-03T18:41:51.654413] [INFO ] [MAIN ] EME: Full history saved. [2025-10-03T18:41:51.654504] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EME took 36.9s. Estimated remaining: 3h 47m 46s. Rate: 7.2 symbols/min [2025-10-03T18:41:51.844495] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:51.844870] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-03T18:41:51.844973] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-03T18:41:51.845093] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-03T18:41:51.845140] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-03T18:41:51.845188] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-03T18:41:51.845228] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-03T18:41:52.000737] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-03T18:41:52.148866] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:41:52.282179] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T18:41:52.305264] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:52.585731] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:41:52.790699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-03T18:41:53.295293] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T18:41:53.590701] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-03T18:41:54.070556] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T18:41:54.390687] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-03T18:41:55.122799] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:41:55.190704] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-03T18:41:55.990699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-03T18:41:56.521022] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T18:41:56.790693] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-03T18:41:56.939088] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:41:57.513928] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T18:41:57.590695] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-03T18:41:58.056408] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:41:58.390692] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-03T18:41:58.777977] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T18:41:59.190686] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-03T18:41:59.990682] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-03T18:42:00.635779] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:42:00.636585] [INFO ] [REMOTE ] EMF: Full fetch complete (7129 records). [2025-10-03T18:42:00.636700] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-03T18:42:00.799186] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-03T18:42:01.047825] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-03T18:42:01.048074] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-03T18:42:01.048455] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-03T18:42:01.048558] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-03T18:42:01.049594] [DEBUG] [LOCAL ] EMF: Trimmed 7129 records to 3480 (keeping 200 days of data) [2025-10-03T18:42:01.102718] [DEBUG] [LOCAL ] EMF: Primary data saved (3480 records). [2025-10-03T18:42:01.104448] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:01.103423] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-03T18:42:01.115016] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EMF took 20.3s. Estimated remaining: 3h 47m 40s. Rate: 7.2 symbols/min [2025-10-03T18:42:01.339723] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:01.402151] [DEBUG] [LOCAL ] EMR: Loaded 53633 existing records from primary storage. [2025-10-03T18:42:01.402476] [INFO ] [MAIN ] EMR: Loaded 53633 existing records. [2025-10-03T18:42:01.600180] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-03T18:42:01.637524] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:01.639875] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-03T18:42:01.639985] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-03T18:42:01.643969] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-03T18:42:01.644098] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-03T18:42:01.824351] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:42:02.161704] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:02.390703] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-03T18:42:02.888855] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-03T18:42:03.190686] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-03T18:42:03.354871] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:42:03.990704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-03T18:42:04.031104] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T18:42:04.790741] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-03T18:42:05.438279] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:42:05.590711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-03T18:42:06.139322] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:42:06.390718] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-03T18:42:07.190671] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-03T18:42:07.376592] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:42:07.990672] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-03T18:42:08.130231] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T18:42:08.371278] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T18:42:08.790727] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-03T18:42:09.373354] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T18:42:09.590689] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-03T18:42:09.666175] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:42:10.158542] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:42:10.390712] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-03T18:42:11.190684] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-03T18:42:11.347252] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:42:11.773175] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:42:11.990713] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-03T18:42:12.619768] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T18:42:12.790728] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-03T18:42:13.590693] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-03T18:42:14.107028] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:42:14.390711] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-03T18:42:14.554389] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:42:15.190685] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-03T18:42:15.990728] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-03T18:42:16.135421] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T18:42:16.692861] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:42:16.790717] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-03T18:42:16.931711] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T18:42:17.590728] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-03T18:42:18.146628] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:42:18.390678] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-03T18:42:18.756590] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T18:42:19.190713] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-03T18:42:19.990628] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-03T18:42:20.297334] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:20.303270] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:42:20.790760] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-03T18:42:21.453454] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T18:42:21.454301] [INFO ] [REMOTE ] EMP: Full fetch complete (4310 records). [2025-10-03T18:42:21.454382] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-03T18:42:21.592314] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-03T18:42:21.593502] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:42:21.625487] [INFO ] [REMOTE ] EMN: Full fetch complete (72103 records). [2025-10-03T18:42:21.659775] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-03T18:42:22.191861] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-03T18:42:22.227545] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-03T18:42:22.240764] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-03T18:42:22.251224] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-03T18:42:22.260949] [DEBUG] [LOCAL ] EMP: Trimmed 4310 records to 3108 (keeping 200 days of data) [2025-10-03T18:42:22.320555] [DEBUG] [LOCAL ] EMP: Primary data saved (3108 records). [2025-10-03T18:42:22.341400] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-03T18:42:22.341675] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMP took 30.7s. Estimated remaining: 3h 48m 0s. Rate: 7.2 symbols/min [2025-10-03T18:42:22.398270] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-03T18:42:22.622316] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-03T18:42:22.632880] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-03T18:42:22.639323] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-03T18:42:22.639440] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-03T18:42:22.694264] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:22.695879] [DEBUG] [LOCAL ] EMN: Trimmed 72103 records to 51219 (keeping 200 days of data) [2025-10-03T18:42:22.858805] [DEBUG] [LOCAL ] ENB: Loaded 53900 existing records from primary storage. [2025-10-03T18:42:22.860569] [INFO ] [MAIN ] ENB: Loaded 53900 existing records. [2025-10-03T18:42:23.147082] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:23.183573] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-03T18:42:23.186943] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-03T18:42:23.192878] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-03T18:42:23.193750] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-03T18:42:23.441963] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T18:42:23.486165] [INFO ] [REMOTE ] EMO: Full fetch complete (17303 records). [2025-10-03T18:42:23.517005] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-03T18:42:23.745135] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:23.750089] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-03T18:42:24.159317] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-03T18:42:24.164117] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-03T18:42:24.170680] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-03T18:42:24.173932] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-03T18:42:24.187366] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-03T18:42:24.191180] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-03T18:42:24.195114] [DEBUG] [LOCAL ] EMN: Primary data saved (51219 records). [2025-10-03T18:42:24.195556] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-03T18:42:24.195753] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMN took 41.3s. Estimated remaining: 3h 47m 38s. Rate: 7.2 symbols/min [2025-10-03T18:42:24.195410] [DEBUG] [LOCAL ] EMO: Trimmed 17303 records to 12774 (keeping 200 days of data) [2025-10-03T18:42:24.458016] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:24.459034] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-10-03T18:42:24.459338] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-10-03T18:42:24.460026] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-03T18:42:24.460086] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-03T18:42:24.460724] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-10-03T18:42:24.461029] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-03T18:42:24.860458] [DEBUG] [LOCAL ] EMO: Primary data saved (12774 records). [2025-10-03T18:42:24.865089] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-03T18:42:24.884806] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:24.884929] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. EMO took 41.0s. Estimated remaining: 3h 47m 12s. Rate: 7.2 symbols/min [2025-10-03T18:42:24.885243] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-03T18:42:25.082787] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:25.133333] [DEBUG] [LOCAL ] ENIC: Loaded 36637 existing records from primary storage. [2025-10-03T18:42:25.133678] [INFO ] [MAIN ] ENIC: Loaded 36637 existing records. [2025-10-03T18:42:25.357495] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:25.357752] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-03T18:42:25.357808] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-03T18:42:25.359463] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-03T18:42:25.359532] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-03T18:42:25.779868] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:25.780307] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-03T18:42:25.889106] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:42:25.971443] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-03T18:42:26.217935] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:42:26.390691] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-03T18:42:26.843093] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:42:27.190714] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-03T18:42:27.764966] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:42:27.936051] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:42:27.990725] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-03T18:42:28.587963] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T18:42:28.790714] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-03T18:42:29.086336] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-03T18:42:29.590731] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-03T18:42:30.390721] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-03T18:42:31.190735] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-03T18:42:31.780844] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:42:31.807260] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T18:42:31.841340] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T18:42:31.990712] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-03T18:42:32.790760] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-03T18:42:33.590679] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-03T18:42:33.873299] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:42:34.390629] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-03T18:42:34.485917] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:42:34.793547] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:42:34.947184] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:42:35.190688] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-03T18:42:35.990735] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-03T18:42:36.619454] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T18:42:36.790728] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-03T18:42:37.590744] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-03T18:42:37.909292] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T18:42:38.390712] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-03T18:42:38.526425] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:42:39.053904] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:42:39.190730] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-03T18:42:39.990698] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-03T18:42:40.300966] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:40.638594] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:42:40.652002] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T18:42:40.790719] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-03T18:42:41.590722] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-03T18:42:42.306277] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T18:42:42.390703] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-03T18:42:42.709067] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:42:43.190684] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-03T18:42:43.662195] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T18:42:43.878488] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:42:43.990688] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-03T18:42:44.790709] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-03T18:42:45.590706] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-03T18:42:45.681865] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:42:45.684879] [INFO ] [REMOTE ] EMR: Full fetch complete (77103 records). [2025-10-03T18:42:45.684989] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-03T18:42:46.101454] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-03T18:42:46.101544] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-03T18:42:46.102526] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-03T18:42:46.102598] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-03T18:42:46.104181] [DEBUG] [LOCAL ] EMR: Trimmed 77103 records to 54022 (keeping 200 days of data) [2025-10-03T18:42:46.404914] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-03T18:42:46.461575] [DEBUG] [LOCAL ] EMR: Primary data saved (54022 records). [2025-10-03T18:42:46.461775] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-03T18:42:46.462772] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. EMR took 45.3s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-03T18:42:46.657471] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:46.663548] [DEBUG] [LOCAL ] ENO: Loaded 1926 existing records from primary storage. [2025-10-03T18:42:46.663883] [INFO ] [MAIN ] ENO: Loaded 1926 existing records. [2025-10-03T18:42:46.921338] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:46.921694] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-03T18:42:46.921803] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-03T18:42:46.917481] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-03T18:42:46.933452] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-03T18:42:46.939379] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-03T18:42:47.028311] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:42:47.194484] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-03T18:42:47.360724] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:47.370549] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:42:47.990701] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-03T18:42:48.790720] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-03T18:42:49.115110] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T18:42:49.190930] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:42:49.356367] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-03T18:42:49.590922] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-03T18:42:50.390753] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-03T18:42:50.995515] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:42:51.034551] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T18:42:51.035424] [INFO ] [REMOTE ] ENFY: Full fetch complete (5689 records). [2025-10-03T18:42:51.035497] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-03T18:42:51.195848] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-03T18:42:51.484522] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-03T18:42:51.484609] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-03T18:42:51.484819] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-03T18:42:51.484881] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-03T18:42:51.485401] [DEBUG] [LOCAL ] ENFY: Trimmed 5689 records to 3201 (keeping 200 days of data) [2025-10-03T18:42:51.505179] [DEBUG] [LOCAL ] ENFY: Primary data saved (3201 records). [2025-10-03T18:42:51.505320] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-03T18:42:51.505404] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. ENFY took 27.3s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-03T18:42:51.706085] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:51.770172] [DEBUG] [LOCAL ] ENOV: Loaded 45207 existing records from primary storage. [2025-10-03T18:42:51.770676] [INFO ] [MAIN ] ENOV: Loaded 45207 existing records. [2025-10-03T18:42:51.990435] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:51.990901] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-03T18:42:51.990713] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-03T18:42:51.992008] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-03T18:42:51.993538] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-03T18:42:51.993604] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-03T18:42:52.316633] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:42:52.339829] [INFO ] [REMOTE ] ENIC: Full fetch complete (51416 records). [2025-10-03T18:42:52.359964] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-03T18:42:52.419858] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:52.624493] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:42:52.813742] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-03T18:42:52.835111] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-03T18:42:52.835247] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-03T18:42:52.836087] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-03T18:42:52.836157] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-03T18:42:52.837894] [DEBUG] [LOCAL ] ENIC: Trimmed 51416 records to 36843 (keeping 200 days of data) [2025-10-03T18:42:53.058031] [DEBUG] [LOCAL ] ENIC: Primary data saved (36843 records). [2025-10-03T18:42:53.058198] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-03T18:42:53.059980] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENIC took 28.2s. Estimated remaining: 3h 46m 54s. Rate: 7.2 symbols/min [2025-10-03T18:42:53.241792] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:53.284319] [DEBUG] [LOCAL ] ENR: Loaded 43162 existing records from primary storage. [2025-10-03T18:42:53.284676] [INFO ] [MAIN ] ENR: Loaded 43162 existing records. [2025-10-03T18:42:53.473146] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:53.473355] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-03T18:42:53.473403] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-03T18:42:53.473770] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-03T18:42:53.473833] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-03T18:42:53.595738] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-03T18:42:53.857373] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:54.390685] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-03T18:42:54.799956] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:42:55.023717] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T18:42:55.190717] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-03T18:42:55.541885] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T18:42:55.658006] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T18:42:55.990683] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-03T18:42:56.790686] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-03T18:42:57.590635] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-03T18:42:57.933601] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:42:58.037422] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T18:42:58.350389] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:42:58.390696] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-03T18:42:59.190752] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-03T18:42:59.828387] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:42:59.990729] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-03T18:43:00.533337] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:43:00.790734] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-03T18:43:01.590628] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-03T18:43:01.683767] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:43:02.390693] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-03T18:43:02.853195] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:43:02.939671] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:43:03.190723] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-03T18:43:03.990703] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-03T18:43:04.046489] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T18:43:04.790691] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-03T18:43:04.908668] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:43:04.911583] [INFO ] [REMOTE ] ENB: Full fetch complete (77487 records). [2025-10-03T18:43:04.911795] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-03T18:43:05.346862] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-03T18:43:05.347050] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-03T18:43:05.348072] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-03T18:43:05.348178] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-03T18:43:05.350043] [DEBUG] [LOCAL ] ENB: Trimmed 77487 records to 54287 (keeping 200 days of data) [2025-10-03T18:43:05.486093] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:43:05.597375] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-03T18:43:05.721947] [DEBUG] [LOCAL ] ENB: Primary data saved (54287 records). [2025-10-03T18:43:05.722104] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-03T18:43:05.722193] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENB took 43.4s. Estimated remaining: 3h 46m 55s. Rate: 7.2 symbols/min [2025-10-03T18:43:05.913437] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:05.914129] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-03T18:43:05.914183] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-03T18:43:05.914356] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-03T18:43:05.914429] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-03T18:43:05.914489] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-03T18:43:05.914525] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-03T18:43:06.332201] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:06.394854] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-03T18:43:06.399462] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:43:07.190684] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-03T18:43:07.275511] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:43:07.744914] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T18:43:07.779108] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:43:07.990700] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-03T18:43:08.549803] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:43:08.790708] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-03T18:43:09.590720] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-03T18:43:10.021537] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:43:10.370540] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:43:10.390612] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-03T18:43:11.190705] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-03T18:43:11.990699] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-03T18:43:12.223625] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:43:12.790715] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-03T18:43:12.841800] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:43:13.200214] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:43:13.231576] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T18:43:13.590691] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-03T18:43:14.390701] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-03T18:43:15.160999] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T18:43:15.190722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-03T18:43:15.990723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-03T18:43:16.137386] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T18:43:16.615028] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T18:43:16.746775] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:43:16.790690] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-03T18:43:17.590690] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-03T18:43:18.382522] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:43:18.391686] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-03T18:43:19.181872] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:43:19.190607] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-03T18:43:19.960092] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:43:19.990706] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-03T18:43:20.550268] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:43:20.790717] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-03T18:43:21.508793] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:43:21.590738] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-03T18:43:21.998632] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T18:43:22.241127] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T18:43:22.243229] [INFO ] [REMOTE ] ENOV: Full fetch complete (63257 records). [2025-10-03T18:43:22.243323] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-03T18:43:22.397190] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-03T18:43:22.684228] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-03T18:43:22.684414] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-03T18:43:22.685499] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-03T18:43:22.685608] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-03T18:43:22.692171] [DEBUG] [LOCAL ] ENOV: Trimmed 63257 records to 45484 (keeping 200 days of data) [2025-10-03T18:43:22.973025] [DEBUG] [LOCAL ] ENOV: Primary data saved (45484 records). [2025-10-03T18:43:22.973184] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-03T18:43:22.973367] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENOV took 31.5s. Estimated remaining: 3h 47m 6s. Rate: 7.2 symbols/min [2025-10-03T18:43:23.155776] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:23.182783] [DEBUG] [LOCAL ] ENVA: Loaded 25450 existing records from primary storage. [2025-10-03T18:43:23.183116] [INFO ] [MAIN ] ENVA: Loaded 25450 existing records. [2025-10-03T18:43:23.196131] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-03T18:43:23.386148] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:23.386421] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-03T18:43:23.386485] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-03T18:43:23.387561] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-03T18:43:23.387624] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-03T18:43:23.803119] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:23.992265] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-03T18:43:23.995577] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T18:43:24.427745] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T18:43:24.428693] [INFO ] [REMOTE ] ENO: Full fetch complete (3107 records). [2025-10-03T18:43:24.428772] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-03T18:43:24.795703] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-03T18:43:24.854599] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:43:24.895754] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-03T18:43:24.895881] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-03T18:43:24.896084] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-03T18:43:24.896129] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-03T18:43:24.896619] [DEBUG] [LOCAL ] ENO: Trimmed 3107 records to 1938 (keeping 200 days of data) [2025-10-03T18:43:24.914687] [DEBUG] [LOCAL ] ENO: Primary data saved (1938 records). [2025-10-03T18:43:24.914853] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-03T18:43:24.914950] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENO took 38.5s. Estimated remaining: 3h 46m 44s. Rate: 7.2 symbols/min [2025-10-03T18:43:25.128089] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:25.129422] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-03T18:43:25.129476] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-03T18:43:25.129717] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-03T18:43:25.129779] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-03T18:43:25.129850] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-03T18:43:25.129895] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-03T18:43:25.523479] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:25.590845] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-03T18:43:26.127431] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:43:26.390732] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-03T18:43:26.910179] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T18:43:26.913257] [INFO ] [REMOTE ] ENR: Full fetch complete (58789 records). [2025-10-03T18:43:26.913383] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-03T18:43:27.200828] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-03T18:43:27.362119] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-03T18:43:27.362226] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-03T18:43:27.363164] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-03T18:43:27.363230] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-03T18:43:27.366166] [DEBUG] [LOCAL ] ENR: Trimmed 58789 records to 43463 (keeping 200 days of data) [2025-10-03T18:43:27.619276] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:43:27.684720] [DEBUG] [LOCAL ] ENR: Primary data saved (43463 records). [2025-10-03T18:43:27.684864] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-03T18:43:27.685785] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENR took 34.6s. Estimated remaining: 3h 46m 23s. Rate: 7.2 symbols/min [2025-10-03T18:43:27.868392] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:27.926188] [DEBUG] [LOCAL ] EOG: Loaded 53734 existing records from primary storage. [2025-10-03T18:43:27.926574] [INFO ] [MAIN ] EOG: Loaded 53734 existing records. [2025-10-03T18:43:27.995842] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-03T18:43:28.155000] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:28.155261] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-03T18:43:28.155343] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-03T18:43:28.155789] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-03T18:43:28.155901] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-03T18:43:28.556455] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T18:43:28.585918] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:28.790705] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-03T18:43:29.308755] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T18:43:29.590721] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-03T18:43:30.390627] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-03T18:43:30.697741] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T18:43:30.764934] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:43:31.190731] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-03T18:43:31.714306] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:43:31.990693] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-03T18:43:32.121352] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T18:43:32.790745] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-03T18:43:33.330274] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T18:43:33.590717] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-03T18:43:34.390717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-03T18:43:34.410849] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T18:43:34.587966] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T18:43:35.190714] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-03T18:43:35.551510] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:43:35.990631] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-03T18:43:36.074557] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:43:36.790708] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-03T18:43:37.137493] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T18:43:37.590703] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-03T18:43:38.266213] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T18:43:38.390721] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-03T18:43:38.439433] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T18:43:38.441866] [INFO ] [REMOTE ] ENS: Full fetch complete (42239 records). [2025-10-03T18:43:38.442007] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-03T18:43:38.865995] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-03T18:43:38.866095] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-03T18:43:38.866791] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-03T18:43:38.866858] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-03T18:43:38.868052] [DEBUG] [LOCAL ] ENS: Trimmed 42239 records to 29820 (keeping 200 days of data) [2025-10-03T18:43:39.064430] [DEBUG] [LOCAL ] ENS: Primary data saved (29820 records). [2025-10-03T18:43:39.064623] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-03T18:43:39.064743] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENS took 33.3s. Estimated remaining: 3h 46m 22s. Rate: 7.2 symbols/min [2025-10-03T18:43:39.195792] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-03T18:43:39.256909] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:39.271757] [DEBUG] [LOCAL ] EOI: Loaded 10789 existing records from primary storage. [2025-10-03T18:43:39.271999] [INFO ] [MAIN ] EOI: Loaded 10789 existing records. [2025-10-03T18:43:39.470639] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:39.470927] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-03T18:43:39.470979] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-03T18:43:39.471157] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-03T18:43:39.471217] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-03T18:43:39.891020] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:39.990637] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-03T18:43:40.043366] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:43:40.436020] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:43:40.790732] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-03T18:43:40.932503] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T18:43:41.305038] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-03T18:43:41.590637] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-03T18:43:42.390715] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-03T18:43:42.674828] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:43:42.900076] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T18:43:43.190735] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-03T18:43:43.990684] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-03T18:43:44.022328] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:43:44.790675] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-03T18:43:45.060558] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:43:45.590715] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-03T18:43:45.868168] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:43:46.390718] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-03T18:43:46.808084] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:43:47.190633] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-03T18:43:47.351477] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:43:47.990672] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-03T18:43:48.358586] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:43:48.790692] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-03T18:43:49.590628] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-03T18:43:49.991690] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:43:50.018575] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:43:50.390711] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-03T18:43:50.431687] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T18:43:51.190704] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-03T18:43:51.552507] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T18:43:51.554175] [INFO ] [REMOTE ] ENVA: Full fetch complete (36788 records). [2025-10-03T18:43:51.554320] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-03T18:43:51.969368] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-03T18:43:51.969460] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-03T18:43:51.970149] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-03T18:43:51.970218] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-03T18:43:51.971222] [DEBUG] [LOCAL ] ENVA: Trimmed 36788 records to 25618 (keeping 200 days of data) [2025-10-03T18:43:52.022149] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-03T18:43:52.130262] [DEBUG] [LOCAL ] ENVA: Primary data saved (25618 records). [2025-10-03T18:43:52.130411] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-03T18:43:52.130514] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. ENVA took 29.2s. Estimated remaining: 3h 46m 24s. Rate: 7.2 symbols/min [2025-10-03T18:43:52.313765] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:52.313954] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-10-03T18:43:52.314018] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-10-03T18:43:52.314140] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-03T18:43:52.314185] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-03T18:43:52.314231] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-03T18:43:52.314290] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-03T18:43:52.703570] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:52.790666] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-03T18:43:53.044558] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:43:53.045723] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:43:53.590690] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-03T18:43:53.963377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:43:54.181501] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:43:54.390692] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-03T18:43:55.190688] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-03T18:43:55.346765] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T18:43:55.990716] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-03T18:43:56.790716] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-03T18:43:57.006299] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:43:57.206187] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:43:57.590697] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-03T18:43:57.712987] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:43:58.390708] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-03T18:43:59.190631] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-03T18:43:59.351759] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T18:43:59.448930] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:43:59.889115] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T18:43:59.890885] [INFO ] [REMOTE ] EOD: Full fetch complete (20473 records). [2025-10-03T18:43:59.890967] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-03T18:43:59.995863] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-03T18:44:00.320708] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-03T18:44:00.320805] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-03T18:44:00.321277] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-03T18:44:00.321320] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-03T18:44:00.322096] [DEBUG] [LOCAL ] EOD: Trimmed 20473 records to 14703 (keeping 200 days of data) [2025-10-03T18:44:00.420705] [DEBUG] [LOCAL ] EOD: Primary data saved (14703 records). [2025-10-03T18:44:00.420870] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-03T18:44:00.420949] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. EOD took 35.5s. Estimated remaining: 3h 46m 15s. Rate: 7.2 symbols/min [2025-10-03T18:44:00.650534] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:00.664450] [DEBUG] [LOCAL ] EOT: Loaded 6929 existing records from primary storage. [2025-10-03T18:44:00.664703] [INFO ] [MAIN ] EOT: Loaded 6929 existing records. [2025-10-03T18:44:00.795778] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-03T18:44:00.877066] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:00.877525] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-03T18:44:00.877590] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-03T18:44:00.877866] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-03T18:44:00.877975] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-03T18:44:01.270474] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:01.590739] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-03T18:44:01.879003] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:44:02.074309] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T18:44:02.390697] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-03T18:44:02.402941] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T18:44:03.190725] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-03T18:44:03.990668] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-03T18:44:04.062217] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:44:04.177172] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:44:04.546923] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T18:44:04.790681] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-03T18:44:05.590717] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-03T18:44:05.779375] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:44:06.354791] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:44:06.390697] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-03T18:44:07.190737] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-03T18:44:07.230327] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:44:07.929195] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:44:07.990711] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-03T18:44:08.790885] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-03T18:44:09.590719] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-03T18:44:09.600542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T18:44:09.856168] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:44:10.316970] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:44:10.390727] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-03T18:44:11.190689] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-03T18:44:11.990713] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-03T18:44:12.102966] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:44:12.105707] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-03T18:44:12.105821] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-03T18:44:12.271236] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:44:12.553861] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-03T18:44:12.553959] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-03T18:44:12.554901] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-03T18:44:12.554973] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-03T18:44:12.556635] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 54124 (keeping 200 days of data) [2025-10-03T18:44:12.790934] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-03T18:44:12.821845] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T18:44:12.922798] [DEBUG] [LOCAL ] EOG: Primary data saved (54124 records). [2025-10-03T18:44:12.922977] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-03T18:44:12.923921] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOG took 45.2s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-03T18:44:13.112369] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:13.141826] [DEBUG] [LOCAL ] EPAC: Loaded 27163 existing records from primary storage. [2025-10-03T18:44:13.142119] [INFO ] [MAIN ] EPAC: Loaded 27163 existing records. [2025-10-03T18:44:13.347742] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:13.348125] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-03T18:44:13.348178] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-03T18:44:13.348481] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-03T18:44:13.348566] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-03T18:44:13.600860] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-03T18:44:13.715485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T18:44:13.789168] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:14.390713] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-03T18:44:14.428118] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T18:44:15.190719] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-03T18:44:15.794013] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:44:15.990696] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-03T18:44:16.304828] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:44:16.790730] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-03T18:44:16.870205] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T18:44:16.871260] [INFO ] [REMOTE ] EOI: Full fetch complete (16116 records). [2025-10-03T18:44:16.871336] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-03T18:44:16.871803] [FATAL] [VALIDATOR ] EOI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:44:16.871888] [FATAL] [MAIN ] EOI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:44:16.871939] [WARN ] [MAIN ] EOI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:44:16.872018] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-03T18:44:16.872083] [DEBUG] [LOCAL ] EOI: No primary data file found to delete. [2025-10-03T18:44:16.872120] [INFO ] [LOCAL ] EOI: Starting deletion of derivative data. [2025-10-03T18:44:16.872441] [DEBUG] [LOCAL ] EOI: Deleted derivative data file. [2025-10-03T18:44:16.872568] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOI took 37.8s. Estimated remaining: 3h 45m 58s. Rate: 7.2 symbols/min [2025-10-03T18:44:17.060881] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:17.100472] [DEBUG] [LOCAL ] EPAM: Loaded 40032 existing records from primary storage. [2025-10-03T18:44:17.100816] [INFO ] [MAIN ] EPAM: Loaded 40032 existing records. [2025-10-03T18:44:17.293789] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:17.294043] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-03T18:44:17.294099] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-03T18:44:17.294488] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-03T18:44:17.294549] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-03T18:44:17.583276] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:44:17.595848] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-03T18:44:17.618953] [INFO ] [REMOTE ] EOS: Full fetch complete (23256 records). [2025-10-03T18:44:17.619196] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-03T18:44:17.642307] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:44:17.652964] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:44:17.699542] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:44:17.718155] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-03T18:44:17.724821] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:17.725034] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-03T18:44:17.725372] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-03T18:44:17.725439] [DEBUG] [LOCAL ] EOS: No derivative data file found to delete. [2025-10-03T18:44:17.725588] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOS took 25.6s. Estimated remaining: 3h 45m 33s. Rate: 7.2 symbols/min [2025-10-03T18:44:17.926637] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:17.926830] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-03T18:44:17.926921] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-03T18:44:17.927009] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-03T18:44:17.927050] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-03T18:44:17.927094] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-03T18:44:17.927140] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-03T18:44:18.313746] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:18.390729] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-03T18:44:18.972569] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:44:19.190747] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-03T18:44:19.907102] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T18:44:19.990691] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-03T18:44:20.694268] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T18:44:20.790670] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-03T18:44:20.935835] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T18:44:21.590714] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-03T18:44:22.011880] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T18:44:22.197063] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:44:22.390732] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-03T18:44:23.190725] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-03T18:44:23.459598] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T18:44:23.990730] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-03T18:44:24.593135] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:44:24.651821] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:44:24.790712] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-03T18:44:25.590698] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-03T18:44:26.271158] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T18:44:26.390711] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-03T18:44:27.036291] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:44:27.190707] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-03T18:44:27.389315] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:44:27.990736] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-03T18:44:28.624466] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T18:44:28.790730] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-03T18:44:29.468797] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:44:29.590708] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-03T18:44:30.086166] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T18:44:30.390719] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-03T18:44:31.199341] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-03T18:44:31.224097] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:44:31.229741] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:44:31.990727] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-03T18:44:32.687692] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T18:44:32.795776] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-03T18:44:32.810922] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:44:33.590739] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-03T18:44:34.228925] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:44:34.390713] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-03T18:44:35.179262] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:44:35.193025] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-03T18:44:35.562256] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:44:35.990668] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-03T18:44:36.790733] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-03T18:44:36.820278] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:44:37.597210] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-03T18:44:37.622929] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:44:37.649262] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T18:44:38.249852] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:44:38.250909] [INFO ] [REMOTE ] EOT: Full fetch complete (10762 records). [2025-10-03T18:44:38.250997] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-03T18:44:38.395885] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-03T18:44:38.701887] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-03T18:44:38.701978] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-03T18:44:38.702343] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-03T18:44:38.702403] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-03T18:44:38.702941] [DEBUG] [LOCAL ] EOT: Trimmed 10762 records to 6963 (keeping 200 days of data) [2025-10-03T18:44:38.751454] [DEBUG] [LOCAL ] EOT: Primary data saved (6963 records). [2025-10-03T18:44:38.751602] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-03T18:44:38.751726] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EOT took 38.3s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-03T18:44:38.956208] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:39.021580] [DEBUG] [LOCAL ] EPD: Loaded 53999 existing records from primary storage. [2025-10-03T18:44:39.022028] [INFO ] [MAIN ] EPD: Loaded 53999 existing records. [2025-10-03T18:44:39.195879] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-03T18:44:39.242580] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:39.242872] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-03T18:44:39.242928] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-03T18:44:39.244371] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-03T18:44:39.244441] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-03T18:44:39.623004] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:39.990689] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-03T18:44:40.036406] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:44:40.720857] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T18:44:40.790700] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-03T18:44:41.590704] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-03T18:44:41.977161] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:44:42.136553] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:44:42.390709] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-03T18:44:43.190945] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-03T18:44:43.190854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:44:43.577474] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T18:44:43.990701] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-03T18:44:44.790637] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-03T18:44:44.864010] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T18:44:44.866220] [INFO ] [REMOTE ] EPAC: Full fetch complete (38980 records). [2025-10-03T18:44:44.887027] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-03T18:44:44.894827] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T18:44:45.364687] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-03T18:44:45.364782] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-03T18:44:45.365445] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-03T18:44:45.365533] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-03T18:44:45.366583] [DEBUG] [LOCAL ] EPAC: Trimmed 38980 records to 27317 (keeping 200 days of data) [2025-10-03T18:44:45.532697] [DEBUG] [LOCAL ] EPAC: Primary data saved (27317 records). [2025-10-03T18:44:45.532855] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-03T18:44:45.532949] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPAC took 32.6s. Estimated remaining: 3h 45m 40s. Rate: 7.2 symbols/min [2025-10-03T18:44:45.603795] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-03T18:44:45.727707] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:45.784411] [DEBUG] [LOCAL ] EPR: Loaded 44243 existing records from primary storage. [2025-10-03T18:44:45.784783] [INFO ] [MAIN ] EPR: Loaded 44243 existing records. [2025-10-03T18:44:45.986090] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:45.986329] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-03T18:44:45.986390] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-03T18:44:45.987600] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-03T18:44:45.987700] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-03T18:44:46.414214] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:46.407442] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-03T18:44:46.688530] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:44:47.190699] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-03T18:44:47.226356] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T18:44:47.806977] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:44:47.990709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-03T18:44:48.790631] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-03T18:44:48.823924] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:44:49.530156] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T18:44:49.590616] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-03T18:44:50.390702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-03T18:44:50.600760] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:44:51.190701] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-03T18:44:51.343094] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:44:51.646535] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T18:44:51.990677] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-03T18:44:52.374475] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:44:52.377263] [INFO ] [REMOTE ] EPC: Full fetch complete (57009 records). [2025-10-03T18:44:52.377377] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-03T18:44:52.802897] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-03T18:44:52.805962] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-03T18:44:52.806815] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-03T18:44:52.807632] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-03T18:44:52.807829] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-03T18:44:52.809237] [DEBUG] [LOCAL ] EPC: Trimmed 57009 records to 40372 (keeping 200 days of data) [2025-10-03T18:44:53.065798] [DEBUG] [LOCAL ] EPC: Primary data saved (40372 records). [2025-10-03T18:44:53.065936] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-03T18:44:53.066036] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPC took 35.3s. Estimated remaining: 3h 45m 30s. Rate: 7.2 symbols/min [2025-10-03T18:44:53.255455] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:53.313509] [DEBUG] [LOCAL ] EPRT: Loaded 48821 existing records from primary storage. [2025-10-03T18:44:53.313960] [INFO ] [MAIN ] EPRT: Loaded 48821 existing records. [2025-10-03T18:44:53.432813] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T18:44:53.461285] [INFO ] [REMOTE ] EPAM: Full fetch complete (56078 records). [2025-10-03T18:44:53.487180] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-03T18:44:53.558684] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:53.594574] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-03T18:44:53.599920] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-03T18:44:53.594394] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-03T18:44:53.633295] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-03T18:44:53.638450] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-03T18:44:54.269842] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-03T18:44:54.287332] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-03T18:44:54.303214] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-03T18:44:54.308037] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-03T18:44:54.374133] [DEBUG] [LOCAL ] EPAM: Trimmed 56078 records to 40286 (keeping 200 days of data) [2025-10-03T18:44:54.398928] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:54.400229] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-03T18:44:54.520927] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:44:54.688059] [DEBUG] [LOCAL ] EPAM: Primary data saved (40286 records). [2025-10-03T18:44:54.688193] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-03T18:44:54.688321] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPAM took 37.8s. Estimated remaining: 3h 45m 8s. Rate: 7.2 symbols/min [2025-10-03T18:44:54.873317] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:54.873485] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-03T18:44:54.873525] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-03T18:44:54.873636] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-03T18:44:54.873717] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-03T18:44:54.873767] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-03T18:44:54.873802] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-03T18:44:55.194332] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-03T18:44:55.251630] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:55.739464] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T18:44:55.990719] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-03T18:44:56.139208] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:44:56.790632] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-03T18:44:56.941078] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:44:57.590735] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-03T18:44:58.054144] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-03T18:44:58.372143] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:44:58.390628] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-03T18:44:58.970096] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T18:44:59.190729] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-03T18:44:59.680308] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:44:59.990686] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-03T18:45:00.790667] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-03T18:45:00.867047] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T18:45:01.064755] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T18:45:01.590705] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-03T18:45:02.390721] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-03T18:45:02.815125] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:45:03.190730] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-03T18:45:03.223228] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:45:03.471301] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:45:03.990730] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-03T18:45:04.790692] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-03T18:45:04.851609] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:45:05.590680] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-03T18:45:05.976589] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T18:45:06.390626] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-03T18:45:06.485524] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:45:06.743126] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:45:07.190742] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-03T18:45:07.990625] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-03T18:45:08.148350] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T18:45:08.422960] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T18:45:08.790726] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-03T18:45:09.401589] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T18:45:09.590748] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-03T18:45:10.390727] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-03T18:45:10.755443] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:45:11.148847] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:45:11.190688] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-03T18:45:11.348523] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:45:11.990725] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-03T18:45:12.661057] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:45:12.790700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-03T18:45:13.521753] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T18:45:13.590696] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-03T18:45:13.624518] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:45:14.390743] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-03T18:45:15.190674] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-03T18:45:15.284382] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:45:15.990693] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-03T18:45:16.104213] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T18:45:16.416948] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:45:16.790729] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-03T18:45:17.370461] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:45:17.590721] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-03T18:45:18.074410] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:45:18.076819] [INFO ] [REMOTE ] EPR: Full fetch complete (62691 records). [2025-10-03T18:45:18.077025] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-03T18:45:18.078135] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:18.078239] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:18.078286] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:18.078380] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-03T18:45:18.078469] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-03T18:45:18.078566] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-03T18:45:18.078907] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-03T18:45:18.081517] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPR took 32.5s. Estimated remaining: 3h 45m 31s. Rate: 7.2 symbols/min [2025-10-03T18:45:18.301532] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:18.372585] [DEBUG] [LOCAL ] EQH: Loaded 53042 existing records from primary storage. [2025-10-03T18:45:18.372975] [INFO ] [MAIN ] EQH: Loaded 53042 existing records. [2025-10-03T18:45:18.395814] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-03T18:45:18.575312] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:18.575527] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-03T18:45:18.575575] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-03T18:45:18.577226] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-03T18:45:18.577290] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-03T18:45:18.953987] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:19.190715] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-03T18:45:19.311116] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:45:19.314383] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-03T18:45:19.314536] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-03T18:45:19.437444] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T18:45:19.759616] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-03T18:45:19.759748] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-03T18:45:19.760671] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-03T18:45:19.760745] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-03T18:45:19.762362] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 54388 (keeping 200 days of data) [2025-10-03T18:45:19.993099] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-03T18:45:20.110421] [DEBUG] [LOCAL ] EPD: Primary data saved (54388 records). [2025-10-03T18:45:20.110562] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-03T18:45:20.111593] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EPD took 41.4s. Estimated remaining: 3h 45m 9s. Rate: 7.2 symbols/min [2025-10-03T18:45:20.302530] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:20.363100] [DEBUG] [LOCAL ] EQNR: Loaded 53416 existing records from primary storage. [2025-10-03T18:45:20.363516] [INFO ] [MAIN ] EQNR: Loaded 53416 existing records. [2025-10-03T18:45:20.566819] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:20.567068] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-03T18:45:20.567118] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-03T18:45:20.568901] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-03T18:45:20.568964] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-03T18:45:20.798348] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-03T18:45:20.962019] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T18:45:21.003589] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:21.033496] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:45:21.590672] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-03T18:45:22.390755] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-03T18:45:22.660014] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T18:45:23.190725] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-03T18:45:23.556872] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T18:45:23.990731] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-03T18:45:24.199493] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:45:24.790718] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-03T18:45:24.885037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:45:25.590700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-03T18:45:25.863793] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:45:26.182727] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:45:26.189195] [INFO ] [REMOTE ] EPRT: Full fetch complete (68866 records). [2025-10-03T18:45:26.189387] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-03T18:45:26.392393] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-03T18:45:26.400459] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T18:45:26.634166] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-03T18:45:26.634275] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-03T18:45:26.635286] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-03T18:45:26.635363] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-03T18:45:26.636955] [DEBUG] [LOCAL ] EPRT: Trimmed 68866 records to 49188 (keeping 200 days of data) [2025-10-03T18:45:26.945751] [DEBUG] [LOCAL ] EPRT: Primary data saved (49188 records). [2025-10-03T18:45:26.945897] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-03T18:45:26.945985] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPRT took 33.9s. Estimated remaining: 3h 44m 58s. Rate: 7.2 symbols/min [2025-10-03T18:45:27.129606] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:27.178146] [DEBUG] [LOCAL ] EQR: Loaded 51894 existing records from primary storage. [2025-10-03T18:45:27.178482] [INFO ] [MAIN ] EQR: Loaded 51894 existing records. [2025-10-03T18:45:27.200141] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-03T18:45:27.369540] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:27.369799] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-03T18:45:27.369859] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-03T18:45:27.371281] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-03T18:45:27.371349] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-03T18:45:27.799729] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:27.985165] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:45:27.986799] [INFO ] [REMOTE ] EQBK: Full fetch complete (15403 records). [2025-10-03T18:45:27.986903] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-03T18:45:27.987714] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:27.987820] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:27.987907] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:27.988001] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-03T18:45:27.988093] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-03T18:45:27.988155] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-03T18:45:27.988224] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-03T18:45:27.988311] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EQBK took 33.3s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-03T18:45:27.990619] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-03T18:45:28.066597] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T18:45:28.790751] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-03T18:45:29.590744] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-03T18:45:29.762381] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T18:45:30.390776] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-03T18:45:30.540167] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:45:31.190707] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-03T18:45:31.525479] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:45:31.990725] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-03T18:45:32.125301] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:45:32.790735] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-03T18:45:33.179340] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T18:45:33.590760] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-03T18:45:33.910273] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:45:34.390720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-03T18:45:34.524458] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:45:35.190728] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-03T18:45:35.626631] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T18:45:35.990634] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-03T18:45:36.103712] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:45:36.770728] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:45:36.790634] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-03T18:45:37.590751] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-03T18:45:37.770499] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T18:45:38.392338] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-03T18:45:38.395622] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:45:39.190687] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-03T18:45:39.331869] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:45:39.990697] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-03T18:45:40.189337] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:45:40.591457] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:45:40.790693] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-03T18:45:41.590738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-03T18:45:41.946722] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:45:42.390826] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-03T18:45:42.651219] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T18:45:43.190665] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-03T18:45:43.657177] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T18:45:43.990724] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-03T18:45:44.036430] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:45:44.790728] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-03T18:45:45.077436] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:45:45.590762] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-03T18:45:46.059048] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T18:45:46.390709] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-03T18:45:46.608767] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:45:46.938074] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:45:46.942628] [INFO ] [REMOTE ] EQH: Full fetch complete (75994 records). [2025-10-03T18:45:46.942862] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-03T18:45:46.944062] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:46.944201] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:46.944283] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:46.944370] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-03T18:45:46.944493] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-03T18:45:46.944566] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-10-03T18:45:46.944851] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-10-03T18:45:46.945961] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 28.9s. Estimated remaining: 3h 44m 48s. Rate: 7.2 symbols/min [2025-10-03T18:45:47.190712] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-03T18:45:48.172158] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:45:48.186460] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-03T18:45:48.864963] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:45:48.877128] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-03T18:45:50.147929] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T18:45:50.150320] [INFO ] [REMOTE ] EQNR: Full fetch complete (76432 records). [2025-10-03T18:45:50.150469] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-03T18:45:50.151693] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:50.151811] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:50.151858] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:50.151927] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-03T18:45:50.151996] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-03T18:45:50.152033] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-10-03T18:45:50.152218] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-10-03T18:45:50.152846] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQNR took 30.0s. Estimated remaining: 3h 44m 29s. Rate: 7.2 symbols/min [2025-10-03T18:45:50.931526] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:45:50.943795] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-03T18:45:53.921297] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-03T18:45:53.924070] [INFO ] [REMOTE ] EQR: Full fetch complete (74019 records). [2025-10-03T18:45:53.924219] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-03T18:45:54.351029] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-03T18:45:54.351171] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-03T18:45:54.352224] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-03T18:45:54.352356] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-03T18:45:54.354144] [DEBUG] [LOCAL ] EQR: Trimmed 74019 records to 52274 (keeping 200 days of data) [2025-10-03T18:45:54.689837] [DEBUG] [LOCAL ] EQR: Primary data saved (52274 records). [2025-10-03T18:45:54.689983] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-03T18:45:54.690093] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQR took 27.7s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-03T18:45:55.380475] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.389751] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.447793] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-03T18:45:55.449925] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.456747] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-03T18:45:55.459666] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-03T18:45:55.481470] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-03T18:45:55.486618] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.487255] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-03T18:45:55.490687] [DEBUG] [LOCAL ] EQV: Loaded 2747 existing records from primary storage. [2025-10-03T18:45:55.491156] [INFO ] [MAIN ] EQV: Loaded 2747 existing records. [2025-10-03T18:45:55.490463] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-03T18:45:55.979663] [DEBUG] [LOCAL ] ERJ: Loaded 51007 existing records from primary storage. [2025-10-03T18:45:55.977623] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.008186] [INFO ] [MAIN ] ERJ: Loaded 51007 existing records. [2025-10-03T18:45:56.008464] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-03T18:45:56.054309] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-10-03T18:45:56.084322] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-03T18:45:56.107988] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-03T18:45:56.108189] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-03T18:45:56.113733] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-10-03T18:45:56.851248] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:56.945921] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-03T18:45:56.901318] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.945208] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.995985] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-03T18:45:56.979123] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-03T18:45:57.047081] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-03T18:45:57.047320] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-03T18:45:57.054791] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-03T18:45:57.054702] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-03T18:45:57.095544] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-03T18:45:57.111442] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-03T18:45:57.220513] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:57.292506] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-03T18:45:57.622530] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T18:45:57.677162] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-03T18:45:58.002479] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:58.008683] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:58.009144] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-03T18:45:58.009410] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-03T18:45:58.146197] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:45:58.147356] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-03T18:45:58.214243] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T18:45:58.216419] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-03T18:45:58.486761] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:45:58.487848] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-03T18:45:58.838038] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T18:45:58.839042] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-03T18:45:58.962303] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:45:58.965132] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-03T18:45:59.165095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-03T18:45:59.166085] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-03T18:45:59.463133] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T18:45:59.465311] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-03T18:45:59.693060] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T18:45:59.721089] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:45:59.843716] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-03T18:45:59.901255] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:45:59.990691] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-03T18:46:00.484850] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-03T18:46:00.790691] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-03T18:46:01.590737] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-03T18:46:02.395826] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-03T18:46:02.413968] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:46:02.940434] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:46:03.190720] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-03T18:46:03.740880] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T18:46:03.758853] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:46:03.990752] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-03T18:46:04.322966] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T18:46:04.790699] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-03T18:46:05.369248] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:46:05.590723] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-03T18:46:06.390746] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-03T18:46:06.987533] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:46:07.190707] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-03T18:46:07.370280] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:46:07.990700] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-03T18:46:08.569003] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T18:46:08.790706] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-03T18:46:08.846869] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:46:09.590712] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-03T18:46:10.067418] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:46:10.068150] [INFO ] [REMOTE ] EQS: Full fetch complete (2497 records). [2025-10-03T18:46:10.068222] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-03T18:46:10.261883] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-03T18:46:10.262172] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:46:10.262242] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:46:10.262317] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-03T18:46:10.262385] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-03T18:46:10.262423] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-03T18:46:10.262468] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-03T18:46:10.262529] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQS took 15.6s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-03T18:46:10.390695] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-03T18:46:10.452723] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:10.495843] [DEBUG] [LOCAL ] ERO: Loaded 41598 existing records from primary storage. [2025-10-03T18:46:10.496195] [INFO ] [MAIN ] ERO: Loaded 41598 existing records. [2025-10-03T18:46:10.710578] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:10.710941] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-03T18:46:10.711050] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-03T18:46:10.722982] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-03T18:46:10.728172] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-03T18:46:10.808353] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T18:46:11.155382] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:11.190736] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-03T18:46:11.990677] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-03T18:46:12.440429] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T18:46:12.571124] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:46:12.790696] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-03T18:46:13.590719] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-03T18:46:13.737599] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:46:14.247792] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:46:14.390740] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-03T18:46:15.190724] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-03T18:46:15.560463] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:46:15.822418] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:46:15.990694] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-03T18:46:16.387499] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:46:16.790731] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-03T18:46:17.590732] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-03T18:46:17.795748] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:46:18.281332] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:46:18.390694] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-03T18:46:19.150928] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:46:19.190726] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-03T18:46:19.516987] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T18:46:19.911600] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:46:19.990712] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-03T18:46:20.790710] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-03T18:46:21.590736] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-03T18:46:22.117211] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:46:22.283564] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T18:46:22.390711] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-03T18:46:23.190738] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-03T18:46:23.544272] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:46:23.691666] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:46:23.990717] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-03T18:46:24.790673] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-03T18:46:25.320955] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:46:25.319447] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T18:46:25.590635] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-03T18:46:25.778180] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:46:26.390687] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-03T18:46:27.190736] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-03T18:46:27.547303] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:46:27.629705] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:46:27.978950] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:46:27.990534] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-03T18:46:28.790687] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-03T18:46:29.467429] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:46:29.470310] [INFO ] [REMOTE ] ERJ: Full fetch complete (72470 records). [2025-10-03T18:46:29.470426] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-03T18:46:29.595834] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-03T18:46:29.918056] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-03T18:46:29.918153] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-03T18:46:29.919144] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-03T18:46:29.919250] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-03T18:46:29.920991] [DEBUG] [LOCAL ] ERJ: Trimmed 72470 records to 51385 (keeping 200 days of data) [2025-10-03T18:46:30.252326] [DEBUG] [LOCAL ] ERJ: Primary data saved (51385 records). [2025-10-03T18:46:30.252773] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-03T18:46:30.253113] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. ERJ took 35.6s. Estimated remaining: 3h 44m 35s. Rate: 7.2 symbols/min [2025-10-03T18:46:30.391121] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-03T18:46:30.444152] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:30.478432] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:46:30.541822] [DEBUG] [LOCAL ] ES: Loaded 52959 existing records from primary storage. [2025-10-03T18:46:30.542202] [INFO ] [MAIN ] ES: Loaded 52959 existing records. [2025-10-03T18:46:30.732267] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:30.732514] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-03T18:46:30.732579] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-03T18:46:30.734159] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-03T18:46:30.734224] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-03T18:46:30.914337] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:46:30.964990] [INFO ] [REMOTE ] EQV: Full fetch complete (5774 records). [2025-10-03T18:46:30.978766] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-03T18:46:31.194399] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-03T18:46:31.309006] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:31.555268] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-03T18:46:31.555417] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-03T18:46:31.555791] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-03T18:46:31.555915] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-03T18:46:31.557034] [DEBUG] [LOCAL ] EQV: Trimmed 5774 records to 2754 (keeping 200 days of data) [2025-10-03T18:46:31.576020] [DEBUG] [LOCAL ] EQV: Primary data saved (2754 records). [2025-10-03T18:46:31.576408] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-03T18:46:31.576688] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. EQV took 36.9s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-03T18:46:31.755633] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T18:46:31.825112] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:31.860758] [DEBUG] [LOCAL ] ESAB: Loaded 26272 existing records from primary storage. [2025-10-03T18:46:31.861063] [INFO ] [MAIN ] ESAB: Loaded 26272 existing records. [2025-10-03T18:46:31.995760] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-03T18:46:32.054817] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:32.055048] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-03T18:46:32.055107] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-03T18:46:32.056289] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-03T18:46:32.056359] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-03T18:46:32.427056] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:32.789821] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:46:32.798239] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-03T18:46:33.590678] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-03T18:46:33.827349] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:46:33.942947] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T18:46:34.390698] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-03T18:46:35.190688] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-03T18:46:35.361071] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:46:35.363906] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-03T18:46:35.364035] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-03T18:46:35.790490] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-03T18:46:35.790686] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-03T18:46:35.791741] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-03T18:46:35.791896] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-03T18:46:35.793721] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54462 (keeping 200 days of data) [2025-10-03T18:46:35.993552] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-03T18:46:36.096232] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:46:36.227532] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-10-03T18:46:36.227710] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-03T18:46:36.228459] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. EQT took 41.5s. Estimated remaining: 3h 43m 56s. Rate: 7.2 symbols/min [2025-10-03T18:46:36.411322] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:36.430892] [DEBUG] [LOCAL ] ESE: Loaded 16803 existing records from primary storage. [2025-10-03T18:46:36.431178] [INFO ] [MAIN ] ESE: Loaded 16803 existing records. [2025-10-03T18:46:36.644123] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:36.644441] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-03T18:46:36.644495] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-03T18:46:36.645217] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-03T18:46:36.645317] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-03T18:46:36.795924] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-03T18:46:37.107097] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:37.110696] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T18:46:37.171541] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T18:46:37.590738] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-03T18:46:38.317920] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:46:38.322002] [INFO ] [REMOTE ] ERO: Full fetch complete (59575 records). [2025-10-03T18:46:38.322221] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-03T18:46:38.395947] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-03T18:46:38.878968] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:46:39.052426] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-03T18:46:39.052533] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-03T18:46:39.053401] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-03T18:46:39.053473] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-03T18:46:39.055768] [DEBUG] [LOCAL ] ERO: Trimmed 59575 records to 41941 (keeping 200 days of data) [2025-10-03T18:46:39.192764] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-03T18:46:39.346085] [DEBUG] [LOCAL ] ERO: Primary data saved (41941 records). [2025-10-03T18:46:39.346218] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-03T18:46:39.346301] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ERO took 29.1s. Estimated remaining: 3h 43m 37s. Rate: 7.2 symbols/min [2025-10-03T18:46:39.519851] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:39.568989] [DEBUG] [LOCAL ] ESI: Loaded 51102 existing records from primary storage. [2025-10-03T18:46:39.569336] [INFO ] [MAIN ] ESI: Loaded 51102 existing records. [2025-10-03T18:46:39.762621] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:39.762983] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-03T18:46:39.763068] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-03T18:46:39.764946] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-03T18:46:39.765015] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-03T18:46:39.996200] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-03T18:46:40.189638] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:40.218237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:46:40.254875] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:46:40.790683] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-03T18:46:40.855887] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T18:46:41.590705] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-03T18:46:42.295311] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T18:46:42.390725] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-03T18:46:43.190693] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-03T18:46:43.271531] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:46:43.891745] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T18:46:43.973356] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T18:46:43.990686] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-03T18:46:44.790689] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-03T18:46:45.069155] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:46:45.590685] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-03T18:46:46.390702] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-03T18:46:46.626174] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:46:46.915534] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T18:46:47.121615] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T18:46:47.190682] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-03T18:46:47.990713] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-03T18:46:48.302164] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:46:48.790730] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-03T18:46:49.539968] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:46:49.590637] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-03T18:46:49.917863] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T18:46:50.390733] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-03T18:46:50.715882] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:46:51.190698] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-03T18:46:51.990670] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-03T18:46:52.129611] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:46:52.180048] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:46:52.790718] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-03T18:46:53.590699] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-03T18:46:53.631553] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:46:53.861499] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:46:54.390724] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-03T18:46:55.190663] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-03T18:46:55.405699] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:46:55.447492] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:46:55.990714] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-03T18:46:56.790634] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-03T18:46:57.024606] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:46:57.053425] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T18:46:57.590712] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-03T18:46:58.038962] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T18:46:58.390728] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-03T18:46:59.190686] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-03T18:46:59.252071] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:46:59.990712] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-03T18:47:00.212599] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:47:00.613161] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T18:47:00.790710] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-03T18:47:00.817073] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T18:47:01.590727] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-03T18:47:02.390670] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-03T18:47:02.648589] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T18:47:03.190633] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-03T18:47:03.337063] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:47:03.338867] [INFO ] [REMOTE ] ESE: Full fetch complete (22398 records). [2025-10-03T18:47:03.338980] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-03T18:47:03.660162] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T18:47:03.809178] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-03T18:47:03.809263] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-03T18:47:03.809783] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-03T18:47:03.809849] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-03T18:47:03.810679] [DEBUG] [LOCAL ] ESE: Trimmed 22398 records to 16903 (keeping 200 days of data) [2025-10-03T18:47:03.923751] [DEBUG] [LOCAL ] ESE: Primary data saved (16903 records). [2025-10-03T18:47:03.923898] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-03T18:47:03.924008] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ESE took 27.7s. Estimated remaining: 3h 44m 2s. Rate: 7.2 symbols/min [2025-10-03T18:47:03.995868] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-03T18:47:04.114087] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:04.161625] [DEBUG] [LOCAL ] ESNT: Loaded 38632 existing records from primary storage. [2025-10-03T18:47:04.162157] [INFO ] [MAIN ] ESNT: Loaded 38632 existing records. [2025-10-03T18:47:04.361664] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:04.362114] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-03T18:47:04.362177] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-03T18:47:04.363582] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-03T18:47:04.363683] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-03T18:47:04.647872] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:47:04.788697] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:04.790617] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-03T18:47:05.590678] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-03T18:47:05.791513] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:47:06.379828] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:47:06.390610] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-03T18:47:07.190699] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-03T18:47:07.477303] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:47:07.913093] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:47:07.990706] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-03T18:47:08.778931] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T18:47:08.790725] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-03T18:47:09.572306] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:47:09.574940] [INFO ] [REMOTE ] ES: Full fetch complete (76225 records). [2025-10-03T18:47:09.575057] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-03T18:47:09.597298] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-03T18:47:10.003133] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-03T18:47:10.003249] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-03T18:47:10.004590] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-03T18:47:10.004735] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-03T18:47:10.006725] [DEBUG] [LOCAL ] ES: Trimmed 76225 records to 53348 (keeping 200 days of data) [2025-10-03T18:47:10.347971] [DEBUG] [LOCAL ] ES: Primary data saved (53348 records). [2025-10-03T18:47:10.348140] [INFO ] [MAIN ] ES: Full history saved. [2025-10-03T18:47:10.348409] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ES took 40.1s. Estimated remaining: 3h 43m 50s. Rate: 7.2 symbols/min [2025-10-03T18:47:10.397526] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-03T18:47:10.471808] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:47:10.626743] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:10.669931] [DEBUG] [LOCAL ] ESRT: Loaded 46767 existing records from primary storage. [2025-10-03T18:47:10.671058] [INFO ] [MAIN ] ESRT: Loaded 46767 existing records. [2025-10-03T18:47:10.881844] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:10.882086] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-03T18:47:10.882141] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-03T18:47:10.883424] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-03T18:47:10.883523] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-03T18:47:10.964237] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:47:11.012721] [INFO ] [REMOTE ] ESAB: Full fetch complete (35954 records). [2025-10-03T18:47:11.023806] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-03T18:47:11.198558] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-03T18:47:11.679002] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:11.772723] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-03T18:47:11.772832] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-03T18:47:11.773470] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-03T18:47:11.773532] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-03T18:47:11.774736] [DEBUG] [LOCAL ] ESAB: Trimmed 35954 records to 26556 (keeping 200 days of data) [2025-10-03T18:47:11.971356] [DEBUG] [LOCAL ] ESAB: Primary data saved (26556 records). [2025-10-03T18:47:11.971578] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-03T18:47:11.971824] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESAB took 40.4s. Estimated remaining: 3h 43m 27s. Rate: 7.2 symbols/min [2025-10-03T18:47:11.995871] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-03T18:47:12.177336] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:12.199887] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:47:12.248156] [DEBUG] [LOCAL ] ESS: Loaded 30187 existing records from primary storage. [2025-10-03T18:47:12.248426] [INFO ] [MAIN ] ESS: Loaded 30187 existing records. [2025-10-03T18:47:12.443945] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:12.444186] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-03T18:47:12.444239] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-03T18:47:12.445280] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-03T18:47:12.445342] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-03T18:47:12.799181] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-03T18:47:12.848230] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:12.875304] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:47:13.590702] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-03T18:47:13.689421] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T18:47:14.311156] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T18:47:14.313982] [INFO ] [REMOTE ] ESI: Full fetch complete (72711 records). [2025-10-03T18:47:14.314159] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-03T18:47:14.395796] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-03T18:47:14.766300] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-03T18:47:14.766391] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-03T18:47:14.767361] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-03T18:47:14.767430] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-03T18:47:14.769097] [DEBUG] [LOCAL ] ESI: Trimmed 72711 records to 51476 (keeping 200 days of data) [2025-10-03T18:47:15.100500] [DEBUG] [LOCAL ] ESI: Primary data saved (51476 records). [2025-10-03T18:47:15.100830] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-03T18:47:15.101029] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESI took 35.8s. Estimated remaining: 3h 43m 8s. Rate: 7.2 symbols/min [2025-10-03T18:47:15.191690] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-03T18:47:15.324416] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:47:15.328558] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:15.383784] [DEBUG] [LOCAL ] ESTC: Loaded 50315 existing records from primary storage. [2025-10-03T18:47:15.384139] [INFO ] [MAIN ] ESTC: Loaded 50315 existing records. [2025-10-03T18:47:15.593231] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:15.593490] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-03T18:47:15.593540] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-03T18:47:15.594886] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-03T18:47:15.594949] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-03T18:47:16.000316] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-03T18:47:16.064995] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:16.081176] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:47:16.233450] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T18:47:16.790715] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-03T18:47:17.207249] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:47:17.590716] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-03T18:47:18.390636] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-03T18:47:18.512559] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:47:18.878309] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:47:19.190721] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-03T18:47:19.659812] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:47:19.990718] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-03T18:47:20.454864] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T18:47:20.790717] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-03T18:47:21.428819] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:47:21.590722] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-03T18:47:22.380892] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:47:22.391066] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-03T18:47:22.959979] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:47:23.190701] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-03T18:47:23.769540] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:47:23.990707] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-03T18:47:24.790675] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-03T18:47:24.917352] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:47:24.964358] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:47:25.590748] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-03T18:47:26.296075] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:47:26.390710] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-03T18:47:26.917943] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:47:27.190751] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-03T18:47:27.990727] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-03T18:47:28.078147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:47:28.536435] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:47:28.538955] [INFO ] [REMOTE ] ESNT: Full fetch complete (57102 records). [2025-10-03T18:47:28.539090] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-03T18:47:28.798764] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-03T18:47:28.970488] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-03T18:47:28.970587] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-03T18:47:28.971398] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-03T18:47:28.971467] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-03T18:47:28.972903] [DEBUG] [LOCAL ] ESNT: Trimmed 57102 records to 38930 (keeping 200 days of data) [2025-10-03T18:47:29.228541] [DEBUG] [LOCAL ] ESNT: Primary data saved (38930 records). [2025-10-03T18:47:29.228756] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-03T18:47:29.229632] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESNT took 25.3s. Estimated remaining: 3h 43m 12s. Rate: 7.2 symbols/min [2025-10-03T18:47:29.367897] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T18:47:29.451432] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:29.509747] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-03T18:47:29.510118] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-03T18:47:29.596424] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-03T18:47:29.710676] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:29.710888] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-03T18:47:29.710938] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-03T18:47:29.712381] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-03T18:47:29.712458] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-03T18:47:30.141872] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:30.179010] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:47:30.390793] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-03T18:47:31.149200] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:47:31.190706] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-03T18:47:31.990696] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-03T18:47:32.208841] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:47:32.790687] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-03T18:47:33.404124] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:47:33.591540] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-03T18:47:33.594228] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:47:34.293086] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:47:34.390703] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-03T18:47:34.887856] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:47:35.190689] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-03T18:47:35.739057] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T18:47:35.990705] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-03T18:47:36.458085] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:47:36.790692] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-03T18:47:37.590686] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-03T18:47:37.666251] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:47:37.741872] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:47:38.390701] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-03T18:47:38.957930] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:47:39.190701] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-03T18:47:39.990692] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-03T18:47:40.146685] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:47:40.790684] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-03T18:47:41.346147] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:47:41.390431] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T18:47:41.590688] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-03T18:47:42.171627] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:47:42.390681] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-03T18:47:43.190728] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-03T18:47:43.366423] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:47:43.417965] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T18:47:43.990716] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-03T18:47:44.553963] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:47:44.556397] [INFO ] [REMOTE ] ESRT: Full fetch complete (66494 records). [2025-10-03T18:47:44.556518] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-03T18:47:44.795744] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-03T18:47:44.989250] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-03T18:47:44.989350] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-03T18:47:44.990389] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-03T18:47:44.990456] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-03T18:47:44.992212] [DEBUG] [LOCAL ] ESRT: Trimmed 66494 records to 47041 (keeping 200 days of data) [2025-10-03T18:47:45.085128] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:47:45.091350] [INFO ] [REMOTE ] ESS: Full fetch complete (43478 records). [2025-10-03T18:47:45.092577] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-03T18:47:45.618331] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-03T18:47:45.638391] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-03T18:47:45.638558] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-03T18:47:45.639356] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-03T18:47:45.641902] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-03T18:47:45.647618] [DEBUG] [LOCAL ] ESS: Trimmed 43478 records to 30332 (keeping 200 days of data) [2025-10-03T18:47:45.860555] [DEBUG] [LOCAL ] ESRT: Primary data saved (47041 records). [2025-10-03T18:47:45.862614] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-03T18:47:45.863125] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESRT took 35.5s. Estimated remaining: 3h 43m 20s. Rate: 7.2 symbols/min [2025-10-03T18:47:46.110130] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:46.140821] [DEBUG] [LOCAL ] ESS: Primary data saved (30332 records). [2025-10-03T18:47:46.139083] [DEBUG] [LOCAL ] ETB: Loaded 12219 existing records from primary storage. [2025-10-03T18:47:46.141213] [INFO ] [MAIN ] ETB: Loaded 12219 existing records. [2025-10-03T18:47:46.186116] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-03T18:47:46.213627] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESS took 34.2s. Estimated remaining: 3h 42m 55s. Rate: 7.2 symbols/min [2025-10-03T18:47:46.455032] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:46.528231] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-03T18:47:46.533018] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-03T18:47:46.532878] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:46.534532] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-03T18:47:46.534700] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-03T18:47:46.756041] [DEBUG] [LOCAL ] ETD: Loaded 27624 existing records from primary storage. [2025-10-03T18:47:46.772810] [INFO ] [MAIN ] ETD: Loaded 27624 existing records. [2025-10-03T18:47:46.849596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:47:47.020241] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-03T18:47:47.200917] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:47.224148] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:47.224511] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-03T18:47:47.224566] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-03T18:47:47.225485] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-03T18:47:47.226501] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-03T18:47:47.226565] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-03T18:47:47.606871] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:47.637622] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:47:47.990739] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-03T18:47:48.246332] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T18:47:48.728109] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:47:48.730925] [INFO ] [REMOTE ] ESTC: Full fetch complete (72038 records). [2025-10-03T18:47:48.731064] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-03T18:47:48.800483] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-03T18:47:49.179264] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-03T18:47:49.179362] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-03T18:47:49.180299] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-03T18:47:49.180375] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-03T18:47:49.181992] [DEBUG] [LOCAL ] ESTC: Trimmed 72038 records to 50664 (keeping 200 days of data) [2025-10-03T18:47:49.485981] [DEBUG] [LOCAL ] ESTC: Primary data saved (50664 records). [2025-10-03T18:47:49.486126] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-03T18:47:49.486230] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ESTC took 34.4s. Estimated remaining: 3h 42m 36s. Rate: 7.2 symbols/min [2025-10-03T18:47:49.593749] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-03T18:47:49.690294] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:49.690546] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-10-03T18:47:49.690603] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-10-03T18:47:49.690770] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-03T18:47:49.690827] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-03T18:47:49.690875] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-03T18:47:49.690908] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-03T18:47:49.928214] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:47:50.131189] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:50.175336] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T18:47:50.390669] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-03T18:47:50.436180] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:47:51.190693] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-03T18:47:51.990723] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-03T18:47:52.188192] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T18:47:52.603204] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T18:47:52.654938] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:47:52.790725] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-03T18:47:53.590695] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-03T18:47:53.885475] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:47:54.390694] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-03T18:47:55.190676] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-03T18:47:55.341815] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T18:47:55.916545] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T18:47:55.944363] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:47:55.990733] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-03T18:47:56.790710] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-03T18:47:56.920769] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T18:47:57.590721] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-03T18:47:57.655839] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:47:58.390693] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-03T18:47:59.190736] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-03T18:47:59.216431] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:47:59.645895] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T18:47:59.990691] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-03T18:48:00.166229] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T18:48:00.790628] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-03T18:48:00.801230] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T18:48:01.590681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-03T18:48:01.901190] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:48:02.390681] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-03T18:48:03.190716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-03T18:48:03.811364] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:48:03.990737] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-03T18:48:04.266864] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:48:04.779988] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:48:04.790612] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-03T18:48:04.875744] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-03T18:48:05.590702] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-03T18:48:05.682356] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T18:48:06.390716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-03T18:48:07.190680] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-03T18:48:07.515403] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T18:48:07.824074] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T18:48:07.881393] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:48:07.883138] [INFO ] [REMOTE ] ETB: Full fetch complete (18256 records). [2025-10-03T18:48:07.883222] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-03T18:48:07.995805] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-03T18:48:08.313338] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-03T18:48:08.313430] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-03T18:48:08.313885] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-03T18:48:08.313948] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-03T18:48:08.315449] [DEBUG] [LOCAL ] ETB: Trimmed 18256 records to 12368 (keeping 200 days of data) [2025-10-03T18:48:08.393572] [DEBUG] [LOCAL ] ETB: Primary data saved (12368 records). [2025-10-03T18:48:08.393773] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-03T18:48:08.393913] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ETB took 22.5s. Estimated remaining: 3h 42m 50s. Rate: 7.2 symbols/min [2025-10-03T18:48:08.583120] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:08.605705] [DEBUG] [LOCAL ] ETJ: Loaded 16912 existing records from primary storage. [2025-10-03T18:48:08.606018] [INFO ] [MAIN ] ETJ: Loaded 16912 existing records. [2025-10-03T18:48:08.791020] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-03T18:48:08.805252] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:08.806262] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-03T18:48:08.806314] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-03T18:48:08.807019] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-03T18:48:08.807081] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-03T18:48:09.218476] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:09.233684] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:48:09.590733] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-03T18:48:10.349378] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T18:48:10.390688] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-03T18:48:11.039395] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T18:48:11.190713] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-03T18:48:11.372084] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:48:11.990723] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-03T18:48:12.261493] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:48:12.726154] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:48:12.790686] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-03T18:48:13.590735] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-03T18:48:14.390744] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-03T18:48:14.684785] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:48:14.741789] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T18:48:14.747026] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-03T18:48:14.747212] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-03T18:48:15.200298] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-03T18:48:15.229457] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-03T18:48:15.229630] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-03T18:48:15.230992] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-03T18:48:15.231222] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-03T18:48:15.233054] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-10-03T18:48:15.344879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:48:15.610441] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-03T18:48:15.610634] [INFO ] [MAIN ] ET: Full history saved. [2025-10-03T18:48:15.612227] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ET took 46.4s. Estimated remaining: 3h 42m 39s. Rate: 7.2 symbols/min [2025-10-03T18:48:15.793228] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:15.860283] [DEBUG] [LOCAL ] ETN: Loaded 53136 existing records from primary storage. [2025-10-03T18:48:15.860615] [INFO ] [MAIN ] ETN: Loaded 53136 existing records. [2025-10-03T18:48:15.995845] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-03T18:48:16.057078] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:16.057310] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-03T18:48:16.057360] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-03T18:48:16.059211] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-03T18:48:16.059278] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-03T18:48:16.468372] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:16.795744] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-03T18:48:16.807601] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:48:17.152906] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:48:17.590720] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-03T18:48:18.390684] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-03T18:48:18.649508] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:48:18.914236] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T18:48:19.190705] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-03T18:48:19.463219] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:48:19.990638] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-03T18:48:20.094845] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T18:48:20.790673] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-03T18:48:21.590702] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-03T18:48:21.800335] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T18:48:21.828195] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:48:22.356706] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:48:22.358069] [INFO ] [REMOTE ] ETG: Full fetch complete (24863 records). [2025-10-03T18:48:22.358147] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-03T18:48:22.395740] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-03T18:48:22.754256] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-03T18:48:22.754354] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-03T18:48:22.754974] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-03T18:48:22.755041] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-03T18:48:22.756007] [DEBUG] [LOCAL ] ETG: Trimmed 24863 records to 16693 (keeping 200 days of data) [2025-10-03T18:48:22.879165] [DEBUG] [LOCAL ] ETG: Primary data saved (16693 records). [2025-10-03T18:48:22.879332] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-03T18:48:22.879442] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ETG took 33.4s. Estimated remaining: 3h 42m 28s. Rate: 7.2 symbols/min [2025-10-03T18:48:23.114289] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:23.131710] [DEBUG] [LOCAL ] ETO: Loaded 6595 existing records from primary storage. [2025-10-03T18:48:23.132043] [INFO ] [MAIN ] ETO: Loaded 6595 existing records. [2025-10-03T18:48:23.195893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-03T18:48:23.474225] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:23.474699] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-03T18:48:23.474781] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-03T18:48:23.475343] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-03T18:48:23.475422] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-03T18:48:23.967707] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:48:23.994054] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-03T18:48:24.111506] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:24.790746] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-03T18:48:24.899164] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T18:48:25.157585] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T18:48:25.590690] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-03T18:48:26.110551] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:48:26.390686] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-03T18:48:26.456833] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:48:27.190720] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-03T18:48:27.990675] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-03T18:48:28.353374] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:48:28.458893] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T18:48:28.643505] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T18:48:28.790679] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-03T18:48:29.590629] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-03T18:48:29.786336] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:48:29.788012] [INFO ] [REMOTE ] ETD: Full fetch complete (38453 records). [2025-10-03T18:48:29.788092] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-03T18:48:30.202360] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-03T18:48:30.202449] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-03T18:48:30.203097] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-03T18:48:30.203183] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-03T18:48:30.204227] [DEBUG] [LOCAL ] ETD: Trimmed 38453 records to 27784 (keeping 200 days of data) [2025-10-03T18:48:30.388175] [DEBUG] [LOCAL ] ETD: Primary data saved (27784 records). [2025-10-03T18:48:30.388324] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-03T18:48:30.388442] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETD took 44.2s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-03T18:48:30.399615] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-03T18:48:30.577949] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:30.631323] [DEBUG] [LOCAL ] ETR: Loaded 53613 existing records from primary storage. [2025-10-03T18:48:30.631672] [INFO ] [MAIN ] ETR: Loaded 53613 existing records. [2025-10-03T18:48:30.813221] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:30.813434] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-03T18:48:30.813483] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-03T18:48:30.815149] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-03T18:48:30.815213] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-03T18:48:31.182875] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:31.190632] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-03T18:48:31.497030] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:48:31.674197] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:48:31.691722] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T18:48:31.990711] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-03T18:48:32.790677] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-03T18:48:32.920593] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:48:33.459103] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T18:48:33.590681] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-03T18:48:34.217516] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T18:48:34.390702] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-03T18:48:35.190692] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-03T18:48:35.990692] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-03T18:48:36.211447] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:48:36.435310] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T18:48:36.790694] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-03T18:48:37.215145] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:48:37.590695] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-03T18:48:38.390698] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-03T18:48:38.514546] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:48:39.148370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T18:48:39.190671] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-03T18:48:39.471986] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:48:39.884215] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T18:48:39.990695] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-03T18:48:40.725737] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:48:40.790731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-03T18:48:41.490766] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T18:48:41.590700] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-03T18:48:42.390685] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-03T18:48:42.565118] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T18:48:42.566824] [INFO ] [REMOTE ] ETJ: Full fetch complete (25679 records). [2025-10-03T18:48:42.566901] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-03T18:48:42.967810] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-03T18:48:42.967909] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-03T18:48:42.968413] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-03T18:48:42.968478] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-03T18:48:42.969328] [DEBUG] [LOCAL ] ETJ: Trimmed 25679 records to 17112 (keeping 200 days of data) [2025-10-03T18:48:43.077254] [DEBUG] [LOCAL ] ETJ: Primary data saved (17112 records). [2025-10-03T18:48:43.077443] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-03T18:48:43.077544] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETJ took 34.7s. Estimated remaining: 3h 42m 19s. Rate: 7.2 symbols/min [2025-10-03T18:48:43.195823] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-03T18:48:43.271734] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:43.296375] [DEBUG] [LOCAL ] ETV: Loaded 21812 existing records from primary storage. [2025-10-03T18:48:43.296726] [INFO ] [MAIN ] ETV: Loaded 21812 existing records. [2025-10-03T18:48:43.496976] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:43.497244] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-03T18:48:43.497296] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-03T18:48:43.497508] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-03T18:48:43.497599] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-03T18:48:43.994219] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:43.990133] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:48:43.994785] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-03T18:48:44.083011] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:48:44.790692] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-03T18:48:45.154784] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T18:48:45.590727] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-03T18:48:46.322291] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:48:46.367823] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T18:48:46.390690] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-03T18:48:47.190664] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-03T18:48:47.418493] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:48:47.856781] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:48:47.990718] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-03T18:48:48.617816] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T18:48:48.619027] [INFO ] [REMOTE ] ETO: Full fetch complete (9492 records). [2025-10-03T18:48:48.619108] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-03T18:48:48.790853] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-03T18:48:49.012294] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-03T18:48:49.012381] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-03T18:48:49.012634] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-03T18:48:49.012723] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-03T18:48:49.013282] [DEBUG] [LOCAL ] ETO: Trimmed 9492 records to 6702 (keeping 200 days of data) [2025-10-03T18:48:49.057959] [DEBUG] [LOCAL ] ETO: Primary data saved (6702 records). [2025-10-03T18:48:49.058123] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-03T18:48:49.058247] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETO took 26.2s. Estimated remaining: 3h 42m 5s. Rate: 7.2 symbols/min [2025-10-03T18:48:49.244930] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:49.272037] [DEBUG] [LOCAL ] ETW: Loaded 25372 existing records from primary storage. [2025-10-03T18:48:49.272304] [INFO ] [MAIN ] ETW: Loaded 25372 existing records. [2025-10-03T18:48:49.463773] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:49.464014] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-03T18:48:49.464088] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-03T18:48:49.464341] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-03T18:48:49.464401] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-03T18:48:49.595815] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-03T18:48:49.852573] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:49.921424] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:48:50.390685] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-03T18:48:51.190676] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-03T18:48:51.243262] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T18:48:51.750774] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:48:51.990708] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-03T18:48:52.790716] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-03T18:48:53.441872] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T18:48:53.590636] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-03T18:48:53.736258] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:48:53.816953] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T18:48:54.390712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-03T18:48:55.190697] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-03T18:48:55.443339] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:48:55.990631] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-03T18:48:56.043347] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:48:56.284222] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T18:48:56.790674] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-03T18:48:57.001978] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T18:48:57.590744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-03T18:48:58.390710] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-03T18:48:58.704065] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T18:48:58.739711] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:48:59.190695] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-03T18:48:59.325158] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:48:59.990707] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-03T18:49:00.097307] [DEBUG] [REMOTE ] ETV: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T18:49:00.097835] [WARN ] [REMOTE ] ETV: No data returned for month 2025-08 [2025-10-03T18:49:00.097937] [FATAL] [REMOTE ] ETV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:49:00.098037] [FATAL] [MAIN ] ETV: Failed to fetch primary data. [2025-10-03T18:49:00.098104] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:49:00.098180] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-03T18:49:00.098246] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-03T18:49:00.098285] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-03T18:49:00.098614] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-03T18:49:00.098733] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETV took 17.0s. Estimated remaining: 3h 42m 2s. Rate: 7.2 symbols/min [2025-10-03T18:49:00.297150] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:00.305429] [DEBUG] [LOCAL ] ETX: Loaded 5194 existing records from primary storage. [2025-10-03T18:49:00.305691] [INFO ] [MAIN ] ETX: Loaded 5194 existing records. [2025-10-03T18:49:00.454198] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:49:00.523660] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:00.523931] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-03T18:49:00.524106] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-03T18:49:00.524413] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-03T18:49:00.524473] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-03T18:49:00.795824] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-03T18:49:00.905369] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:01.590735] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-03T18:49:02.129566] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:49:02.276116] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T18:49:02.390722] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-03T18:49:03.190690] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-03T18:49:03.990715] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-03T18:49:04.158339] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:49:04.161271] [INFO ] [REMOTE ] ETN: Full fetch complete (76549 records). [2025-10-03T18:49:04.161453] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-03T18:49:04.517758] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-03T18:49:04.659281] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-03T18:49:04.659489] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-03T18:49:04.660516] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-03T18:49:04.660610] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-03T18:49:04.682889] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:49:04.692779] [DEBUG] [LOCAL ] ETN: Trimmed 76549 records to 53510 (keeping 200 days of data) [2025-10-03T18:49:04.790887] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-03T18:49:05.047431] [DEBUG] [LOCAL ] ETN: Primary data saved (53510 records). [2025-10-03T18:49:05.047580] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-03T18:49:05.051968] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETN took 49.4s. Estimated remaining: 3h 41m 47s. Rate: 7.2 symbols/min [2025-10-03T18:49:05.232767] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:05.258227] [DEBUG] [LOCAL ] ETY: Loaded 23009 existing records from primary storage. [2025-10-03T18:49:05.258515] [INFO ] [MAIN ] ETY: Loaded 23009 existing records. [2025-10-03T18:49:05.449164] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:05.449449] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-03T18:49:05.449507] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-03T18:49:05.449786] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-03T18:49:05.449844] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-03T18:49:05.597457] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-03T18:49:05.839815] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:05.896847] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:49:06.390712] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-03T18:49:07.190731] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-03T18:49:07.450384] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:49:07.572810] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T18:49:07.748421] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T18:49:07.990728] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-03T18:49:08.455949] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T18:49:08.790671] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-03T18:49:09.315146] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:49:09.590695] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-03T18:49:10.390631] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-03T18:49:10.787460] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:49:10.943336] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:49:11.190688] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-03T18:49:11.990686] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-03T18:49:12.327076] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T18:49:12.790671] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-03T18:49:13.098436] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T18:49:13.533054] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:49:13.590693] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-03T18:49:14.390726] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-03T18:49:15.190630] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-03T18:49:15.403887] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T18:49:15.632573] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:49:15.810720] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:49:15.990729] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-03T18:49:16.790704] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-03T18:49:17.138194] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T18:49:17.590710] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-03T18:49:18.390624] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-03T18:49:18.606367] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T18:49:18.611294] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:49:18.626868] [INFO ] [REMOTE ] ETW: Full fetch complete (36538 records). [2025-10-03T18:49:18.627448] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-03T18:49:19.048423] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-03T18:49:19.048540] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-03T18:49:19.049198] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-03T18:49:19.049264] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-03T18:49:19.050202] [DEBUG] [LOCAL ] ETW: Trimmed 36538 records to 25554 (keeping 200 days of data) [2025-10-03T18:49:19.192935] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-03T18:49:19.215095] [DEBUG] [LOCAL ] ETW: Primary data saved (25554 records). [2025-10-03T18:49:19.215246] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-03T18:49:19.215334] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETW took 30.2s. Estimated remaining: 3h 41m 50s. Rate: 7.2 symbols/min [2025-10-03T18:49:19.412146] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:19.433071] [DEBUG] [LOCAL ] EVC: Loaded 18719 existing records from primary storage. [2025-10-03T18:49:19.433360] [INFO ] [MAIN ] EVC: Loaded 18719 existing records. [2025-10-03T18:49:19.653097] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:19.654765] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-03T18:49:19.654593] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:49:19.654940] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-03T18:49:19.661263] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-03T18:49:19.661338] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-03T18:49:20.003496] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-03T18:49:20.046486] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:20.755599] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:49:20.758367] [INFO ] [REMOTE ] ETR: Full fetch complete (77094 records). [2025-10-03T18:49:20.758584] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-03T18:49:20.797411] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-03T18:49:20.887860] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T18:49:21.238157] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-03T18:49:21.238256] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-03T18:49:21.239201] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-03T18:49:21.239268] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-03T18:49:21.240873] [DEBUG] [LOCAL ] ETR: Trimmed 77094 records to 54002 (keeping 200 days of data) [2025-10-03T18:49:21.582502] [DEBUG] [LOCAL ] ETR: Primary data saved (54002 records). [2025-10-03T18:49:21.582697] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-03T18:49:21.583801] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETR took 51.2s. Estimated remaining: 3h 41m 30s. Rate: 7.2 symbols/min [2025-10-03T18:49:21.596045] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-03T18:49:21.811247] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:21.845535] [DEBUG] [LOCAL ] EVEX: Loaded 30868 existing records from primary storage. [2025-10-03T18:49:21.845878] [INFO ] [MAIN ] EVEX: Loaded 30868 existing records. [2025-10-03T18:49:22.042626] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:22.043148] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-03T18:49:22.057319] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-03T18:49:22.058622] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:49:22.058724] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-03T18:49:22.064450] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-03T18:49:22.380477] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:49:22.392246] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-03T18:49:22.512317] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:23.190617] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-03T18:49:23.657296] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:49:23.722769] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T18:49:23.723842] [INFO ] [REMOTE ] ETX: Full fetch complete (7089 records). [2025-10-03T18:49:23.723982] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-03T18:49:23.995779] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-03T18:49:24.108710] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-03T18:49:24.108802] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-03T18:49:24.109015] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-03T18:49:24.109057] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-03T18:49:24.109557] [DEBUG] [LOCAL ] ETX: Trimmed 7089 records to 5236 (keeping 200 days of data) [2025-10-03T18:49:24.151501] [DEBUG] [LOCAL ] ETX: Primary data saved (5236 records). [2025-10-03T18:49:24.151672] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-03T18:49:24.151876] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. ETX took 24.1s. Estimated remaining: 3h 41m 10s. Rate: 7.2 symbols/min [2025-10-03T18:49:24.331820] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:24.344728] [DEBUG] [LOCAL ] EVF: Loaded 9459 existing records from primary storage. [2025-10-03T18:49:24.344961] [INFO ] [MAIN ] EVF: Loaded 9459 existing records. [2025-10-03T18:49:24.531620] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:24.531856] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-03T18:49:24.531905] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-03T18:49:24.532083] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-03T18:49:24.532142] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-03T18:49:24.795997] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-03T18:49:24.907669] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:25.419533] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:49:25.590737] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-03T18:49:26.074199] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T18:49:26.219744] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:49:26.390690] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-03T18:49:27.190694] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-03T18:49:27.456383] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:49:27.990699] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-03T18:49:28.570097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:49:28.790680] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-03T18:49:29.122949] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:49:29.590707] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-03T18:49:29.638574] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T18:49:30.192364] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:49:30.390693] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-03T18:49:30.977261] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:49:31.190708] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-03T18:49:31.990677] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-03T18:49:32.223756] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:49:32.734183] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T18:49:32.790693] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-03T18:49:33.590686] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-03T18:49:33.999883] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T18:49:34.343777] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T18:49:34.390638] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-03T18:49:35.190696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-03T18:49:35.442067] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T18:49:35.990707] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-03T18:49:36.248160] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:49:36.790684] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-03T18:49:37.053725] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:49:37.590701] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-03T18:49:37.798036] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:49:38.390627] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-03T18:49:38.690755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T18:49:39.190724] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-03T18:49:39.487099] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T18:49:39.990696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-03T18:49:40.191085] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:49:40.790736] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-03T18:49:40.987919] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:49:41.164348] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T18:49:41.590711] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-03T18:49:42.390749] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-03T18:49:42.792181] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:49:42.852057] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T18:49:43.190702] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-03T18:49:43.990688] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-03T18:49:44.484245] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:49:44.790718] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-03T18:49:44.827374] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T18:49:45.590713] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-03T18:49:46.344308] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:49:46.390698] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-03T18:49:46.648511] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T18:49:47.190740] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-03T18:49:47.409409] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:49:47.990718] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-03T18:49:48.174969] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T18:49:48.790693] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-03T18:49:49.012163] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:49:49.590677] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-03T18:49:49.730538] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T18:49:49.733536] [INFO ] [REMOTE ] ETY: Full fetch complete (34344 records). [2025-10-03T18:49:49.733685] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-03T18:49:50.144797] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-03T18:49:50.144892] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-03T18:49:50.145480] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-03T18:49:50.145543] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-03T18:49:50.146387] [DEBUG] [LOCAL ] ETY: Trimmed 34344 records to 23218 (keeping 200 days of data) [2025-10-03T18:49:50.293308] [DEBUG] [LOCAL ] ETY: Primary data saved (23218 records). [2025-10-03T18:49:50.293443] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-03T18:49:50.293554] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. ETY took 45.2s. Estimated remaining: 3h 41m 37s. Rate: 7.2 symbols/min [2025-10-03T18:49:50.398583] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-03T18:49:50.482140] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:50.491212] [DEBUG] [LOCAL ] EVG: Loaded 5992 existing records from primary storage. [2025-10-03T18:49:50.491493] [INFO ] [MAIN ] EVG: Loaded 5992 existing records. [2025-10-03T18:49:50.692497] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:50.692729] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-03T18:49:50.692791] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-03T18:49:50.692995] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-03T18:49:50.693055] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-03T18:49:51.101390] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:51.108888] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T18:49:51.135699] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:49:51.190712] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-03T18:49:51.990719] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-03T18:49:52.081491] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:49:52.082706] [INFO ] [REMOTE ] EVC: Full fetch complete (29928 records). [2025-10-03T18:49:52.082808] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-03T18:49:52.488968] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-03T18:49:52.489121] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-03T18:49:52.489714] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-03T18:49:52.489778] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-03T18:49:52.490492] [DEBUG] [LOCAL ] EVC: Trimmed 29928 records to 18787 (keeping 200 days of data) [2025-10-03T18:49:52.601152] [DEBUG] [LOCAL ] EVC: Primary data saved (18787 records). [2025-10-03T18:49:52.601304] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-03T18:49:52.601391] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVC took 33.4s. Estimated remaining: 3h 41m 17s. Rate: 7.2 symbols/min [2025-10-03T18:49:52.775017] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:52.790741] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-03T18:49:52.824411] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-10-03T18:49:52.824831] [INFO ] [MAIN ] EVH: Loaded 49734 existing records. [2025-10-03T18:49:53.009881] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:53.010125] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-03T18:49:53.010175] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-03T18:49:53.010410] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-03T18:49:53.010469] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-03T18:49:53.443839] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:53.449305] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:49:53.575674] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:49:53.590612] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-03T18:49:54.390683] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-03T18:49:54.844165] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:49:55.021915] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:49:55.024297] [INFO ] [REMOTE ] EVEX: Full fetch complete (42330 records). [2025-10-03T18:49:55.024383] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-03T18:49:55.196365] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-03T18:49:55.451589] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-03T18:49:55.451739] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-03T18:49:55.452550] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-03T18:49:55.452631] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-03T18:49:55.454166] [DEBUG] [LOCAL ] EVEX: Trimmed 42330 records to 31245 (keeping 200 days of data) [2025-10-03T18:49:55.650590] [DEBUG] [LOCAL ] EVEX: Primary data saved (31245 records). [2025-10-03T18:49:55.650778] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-03T18:49:55.651732] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. EVEX took 34.1s. Estimated remaining: 3h 40m 58s. Rate: 7.2 symbols/min [2025-10-03T18:49:55.841688] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:55.857251] [DEBUG] [LOCAL ] EVN: Loaded 11253 existing records from primary storage. [2025-10-03T18:49:55.857504] [INFO ] [MAIN ] EVN: Loaded 11253 existing records. [2025-10-03T18:49:55.995765] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-03T18:49:56.054586] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:56.054989] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-03T18:49:56.055046] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-03T18:49:56.055298] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-03T18:49:56.055356] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-03T18:49:56.417364] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:56.790635] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-03T18:49:56.801275] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:49:56.802701] [INFO ] [REMOTE ] EVF: Full fetch complete (12349 records). [2025-10-03T18:49:56.802860] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-03T18:49:57.219064] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:49:57.262875] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-03T18:49:57.262976] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-03T18:49:57.263328] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-03T18:49:57.263391] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-03T18:49:57.264131] [DEBUG] [LOCAL ] EVF: Trimmed 12349 records to 9646 (keeping 200 days of data) [2025-10-03T18:49:57.327001] [DEBUG] [LOCAL ] EVF: Primary data saved (9646 records). [2025-10-03T18:49:57.327176] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-03T18:49:57.327362] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVF took 33.2s. Estimated remaining: 3h 40m 36s. Rate: 7.2 symbols/min [2025-10-03T18:49:57.513628] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:57.554983] [DEBUG] [LOCAL ] EVR: Loaded 35117 existing records from primary storage. [2025-10-03T18:49:57.555294] [INFO ] [MAIN ] EVR: Loaded 35117 existing records. [2025-10-03T18:49:57.599477] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-03T18:49:57.738936] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:49:57.765692] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:57.770251] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-03T18:49:57.770329] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-03T18:49:57.770569] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-03T18:49:57.770639] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-03T18:49:58.141337] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:58.311498] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:49:58.390683] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-03T18:49:59.190687] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-03T18:49:59.755085] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:49:59.768782] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:49:59.990702] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-03T18:50:00.790743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-03T18:50:01.401378] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T18:50:01.483291] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:50:01.590728] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-03T18:50:02.390745] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-03T18:50:03.190684] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-03T18:50:03.346000] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:50:03.472868] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:50:03.961619] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T18:50:03.990697] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-03T18:50:04.790997] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-03T18:50:05.549110] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:50:05.590681] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-03T18:50:05.606666] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T18:50:06.390716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-03T18:50:07.190672] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-03T18:50:07.273110] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:50:07.438989] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:50:07.990713] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-03T18:50:08.791474] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:50:08.791603] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-03T18:50:08.890501] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T18:50:09.590680] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-03T18:50:09.680800] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:50:09.970204] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T18:50:10.390716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-03T18:50:11.190716] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-03T18:50:11.262292] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:50:11.990724] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-03T18:50:12.722856] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:50:12.790691] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-03T18:50:12.834834] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:50:13.590630] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-03T18:50:13.746127] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:50:14.181222] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T18:50:14.390667] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-03T18:50:15.119559] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T18:50:15.190672] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-03T18:50:15.990721] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-03T18:50:16.790637] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-03T18:50:16.986820] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:50:16.988256] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:50:17.390939] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:50:17.590717] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-03T18:50:18.098970] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:50:18.100165] [INFO ] [REMOTE ] EVG: Full fetch complete (8254 records). [2025-10-03T18:50:18.100261] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-03T18:50:18.395831] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-03T18:50:18.499322] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-03T18:50:18.499409] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-03T18:50:18.499664] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-03T18:50:18.499726] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-03T18:50:18.500220] [DEBUG] [LOCAL ] EVG: Trimmed 8254 records to 6027 (keeping 200 days of data) [2025-10-03T18:50:18.539086] [DEBUG] [LOCAL ] EVG: Primary data saved (6027 records). [2025-10-03T18:50:18.539228] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-03T18:50:18.539332] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVG took 28.2s. Estimated remaining: 3h 40m 53s. Rate: 7.2 symbols/min [2025-10-03T18:50:18.734832] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:18.754318] [DEBUG] [LOCAL ] EVT: Loaded 17068 existing records from primary storage. [2025-10-03T18:50:18.754743] [INFO ] [MAIN ] EVT: Loaded 17068 existing records. [2025-10-03T18:50:18.958751] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:18.959030] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-03T18:50:18.959084] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-03T18:50:18.959267] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-03T18:50:18.959324] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-03T18:50:19.196771] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-03T18:50:19.346108] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:19.992712] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-03T18:50:19.998193] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T18:50:20.164728] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:50:20.790720] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-03T18:50:21.418113] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T18:50:21.575869] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:50:21.577501] [INFO ] [REMOTE ] EVN: Full fetch complete (17894 records). [2025-10-03T18:50:21.577579] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-03T18:50:21.595758] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-03T18:50:22.022928] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-03T18:50:22.023025] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-03T18:50:22.023587] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-03T18:50:22.023679] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-03T18:50:22.024425] [DEBUG] [LOCAL ] EVN: Trimmed 17894 records to 11412 (keeping 200 days of data) [2025-10-03T18:50:22.096316] [DEBUG] [LOCAL ] EVN: Primary data saved (11412 records). [2025-10-03T18:50:22.096465] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-03T18:50:22.096553] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVN took 26.4s. Estimated remaining: 3h 40m 35s. Rate: 7.2 symbols/min [2025-10-03T18:50:22.295744] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:22.325427] [DEBUG] [LOCAL ] EVTC: Loaded 26492 existing records from primary storage. [2025-10-03T18:50:22.325745] [INFO ] [MAIN ] EVTC: Loaded 26492 existing records. [2025-10-03T18:50:22.395874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-03T18:50:22.530638] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:22.530878] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-03T18:50:22.530929] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-03T18:50:22.531175] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-03T18:50:22.531267] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-03T18:50:22.928746] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:23.018318] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:50:23.190683] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-03T18:50:23.990686] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-03T18:50:24.129729] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:50:24.186271] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:50:24.790723] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-03T18:50:25.503788] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:50:25.590748] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-03T18:50:25.805353] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T18:50:26.390729] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-03T18:50:26.685229] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T18:50:27.190722] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-03T18:50:27.406082] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:50:27.782980] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:50:27.990689] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-03T18:50:28.790631] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-03T18:50:29.104082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:50:29.590688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-03T18:50:30.124699] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T18:50:30.390693] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-03T18:50:30.845355] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T18:50:31.190684] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-03T18:50:31.855219] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:50:31.990686] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-03T18:50:32.294958] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:50:32.297380] [INFO ] [REMOTE ] EVR: Full fetch complete (50820 records). [2025-10-03T18:50:32.297673] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-03T18:50:32.726602] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-03T18:50:32.726727] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-03T18:50:32.727449] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-03T18:50:32.727496] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-03T18:50:32.728795] [DEBUG] [LOCAL ] EVR: Trimmed 50820 records to 35297 (keeping 200 days of data) [2025-10-03T18:50:32.796267] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-03T18:50:32.967224] [DEBUG] [LOCAL ] EVR: Primary data saved (35297 records). [2025-10-03T18:50:32.967413] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-03T18:50:32.967546] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVR took 35.6s. Estimated remaining: 3h 40m 32s. Rate: 7.2 symbols/min [2025-10-03T18:50:33.152119] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:33.191703] [DEBUG] [LOCAL ] EVTL: Loaded 38644 existing records from primary storage. [2025-10-03T18:50:33.192019] [INFO ] [MAIN ] EVTL: Loaded 38644 existing records. [2025-10-03T18:50:33.390460] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:33.390885] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-03T18:50:33.390947] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-03T18:50:33.391200] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-03T18:50:33.391259] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-03T18:50:33.596419] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-03T18:50:33.792066] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:33.833618] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T18:50:34.135088] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T18:50:34.390628] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-03T18:50:34.709949] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T18:50:35.190694] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-03T18:50:35.775786] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:50:35.990735] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-03T18:50:36.181730] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T18:50:36.790700] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-03T18:50:37.159281] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:50:37.590735] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-03T18:50:38.407309] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-03T18:50:38.413772] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:50:38.695381] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:50:39.190709] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-03T18:50:39.990744] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-03T18:50:40.045230] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:50:40.554617] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:50:40.790675] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-03T18:50:40.986805] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T18:50:41.590742] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-03T18:50:42.390724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-03T18:50:42.480006] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:50:43.016422] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:50:43.190708] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-03T18:50:43.407883] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:50:43.990726] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-03T18:50:44.215694] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:50:44.790697] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-03T18:50:44.895376] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T18:50:45.590688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-03T18:50:46.211191] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T18:50:46.214200] [INFO ] [REMOTE ] EVH: Full fetch complete (71786 records). [2025-10-03T18:50:46.214372] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-03T18:50:46.394756] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-03T18:50:46.663550] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-03T18:50:46.663741] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-03T18:50:46.664902] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-03T18:50:46.665010] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-03T18:50:46.666594] [DEBUG] [LOCAL ] EVH: Trimmed 71786 records to 50116 (keeping 200 days of data) [2025-10-03T18:50:46.802259] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:50:46.990837] [DEBUG] [LOCAL ] EVH: Primary data saved (50116 records). [2025-10-03T18:50:46.990993] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-03T18:50:46.991093] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVH took 54.4s. Estimated remaining: 3h 40m 35s. Rate: 7.2 symbols/min [2025-10-03T18:50:47.180133] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:47.194816] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-03T18:50:47.206837] [DEBUG] [LOCAL ] EVTR: Loaded 23911 existing records from primary storage. [2025-10-03T18:50:47.207442] [INFO ] [MAIN ] EVTR: Loaded 23911 existing records. [2025-10-03T18:50:47.413085] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:47.425579] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-03T18:50:47.425766] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-03T18:50:47.426979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:50:47.432152] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-03T18:50:47.432381] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-03T18:50:47.846149] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:47.894233] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T18:50:47.990736] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-03T18:50:48.790701] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-03T18:50:48.944367] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:50:49.478903] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T18:50:49.590706] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-03T18:50:50.390688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-03T18:50:50.529464] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T18:50:51.190691] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-03T18:50:51.619713] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:50:51.990736] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-03T18:50:52.243203] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T18:50:52.790743] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-03T18:50:53.129218] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:50:53.131075] [INFO ] [REMOTE ] EVTC: Full fetch complete (38072 records). [2025-10-03T18:50:53.131208] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-03T18:50:53.550967] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-03T18:50:53.551085] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-03T18:50:53.551777] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-03T18:50:53.551846] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-03T18:50:53.553277] [DEBUG] [LOCAL ] EVTC: Trimmed 38072 records to 26688 (keeping 200 days of data) [2025-10-03T18:50:53.611270] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-03T18:50:53.730989] [DEBUG] [LOCAL ] EVTC: Primary data saved (26688 records). [2025-10-03T18:50:53.731153] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-03T18:50:53.731266] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVTC took 31.6s. Estimated remaining: 3h 40m 23s. Rate: 7.2 symbols/min [2025-10-03T18:50:53.922526] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:53.974850] [DEBUG] [LOCAL ] EW: Loaded 53791 existing records from primary storage. [2025-10-03T18:50:53.975180] [INFO ] [MAIN ] EW: Loaded 53791 existing records. [2025-10-03T18:50:54.176085] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:54.176448] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-03T18:50:54.176591] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-03T18:50:54.177198] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-03T18:50:54.177262] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-03T18:50:54.430744] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-03T18:50:54.595781] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:50:54.693342] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:54.710854] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:50:55.190699] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-03T18:50:55.478253] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T18:50:55.990731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-03T18:50:56.262504] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:50:56.790685] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-03T18:50:57.334566] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:50:57.422015] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:50:57.590699] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-03T18:50:58.390722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-03T18:50:58.656157] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:50:59.190719] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-03T18:50:59.990725] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-03T18:51:00.295511] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:51:00.410250] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T18:51:00.588016] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:51:00.589864] [INFO ] [REMOTE ] EVT: Full fetch complete (25348 records). [2025-10-03T18:51:00.590043] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-03T18:51:00.803351] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-03T18:51:01.025377] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-03T18:51:01.025520] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-03T18:51:01.025998] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-03T18:51:01.026062] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-03T18:51:01.026887] [DEBUG] [LOCAL ] EVT: Trimmed 25348 records to 17194 (keeping 200 days of data) [2025-10-03T18:51:01.139263] [DEBUG] [LOCAL ] EVT: Primary data saved (17194 records). [2025-10-03T18:51:01.139420] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-03T18:51:01.139562] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVT took 42.6s. Estimated remaining: 3h 40m 13s. Rate: 7.2 symbols/min [2025-10-03T18:51:01.321747] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:01.364915] [DEBUG] [LOCAL ] EXG: Loaded 34342 existing records from primary storage. [2025-10-03T18:51:01.365244] [INFO ] [MAIN ] EXG: Loaded 34342 existing records. [2025-10-03T18:51:01.575394] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:01.575663] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-03T18:51:01.575729] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-03T18:51:01.575963] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-03T18:51:01.576022] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-03T18:51:01.599093] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-03T18:51:01.975842] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:02.390697] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-03T18:51:02.896269] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:51:03.190726] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-03T18:51:03.473233] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:51:03.749291] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:51:03.990716] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-03T18:51:04.782514] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:51:04.793626] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-03T18:51:05.278090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:51:05.590694] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-03T18:51:05.726310] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:51:06.390775] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-03T18:51:06.856981] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:51:07.190718] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-03T18:51:07.804264] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:51:07.990718] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-03T18:51:08.640637] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T18:51:08.790728] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-03T18:51:09.230973] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T18:51:09.590722] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-03T18:51:10.262426] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:51:10.390688] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-03T18:51:11.190711] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-03T18:51:11.528005] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:51:11.990718] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-03T18:51:12.327170] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:51:12.329287] [INFO ] [REMOTE ] EVTR: Full fetch complete (32535 records). [2025-10-03T18:51:12.329413] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-03T18:51:12.478155] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T18:51:12.793587] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-03T18:51:12.794038] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-03T18:51:12.795368] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-03T18:51:12.796035] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-03T18:51:12.796106] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-03T18:51:12.797145] [DEBUG] [LOCAL ] EVTR: Trimmed 32535 records to 24179 (keeping 200 days of data) [2025-10-03T18:51:12.967489] [DEBUG] [LOCAL ] EVTR: Primary data saved (24179 records). [2025-10-03T18:51:12.967663] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-03T18:51:12.967795] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTR took 26.0s. Estimated remaining: 3h 40m 11s. Rate: 7.2 symbols/min [2025-10-03T18:51:13.159427] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:13.216500] [DEBUG] [LOCAL ] EXK: Loaded 53526 existing records from primary storage. [2025-10-03T18:51:13.217009] [INFO ] [MAIN ] EXK: Loaded 53526 existing records. [2025-10-03T18:51:13.441583] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:51:13.448493] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:13.456589] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-03T18:51:13.457303] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-03T18:51:13.459232] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-03T18:51:13.459313] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-03T18:51:13.595849] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-03T18:51:13.863990] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:14.390688] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-03T18:51:14.464611] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:51:14.467218] [INFO ] [REMOTE ] EVTL: Full fetch complete (52482 records). [2025-10-03T18:51:14.467311] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-03T18:51:14.878927] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-03T18:51:14.879018] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-03T18:51:14.879703] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-03T18:51:14.879769] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-03T18:51:14.881145] [DEBUG] [LOCAL ] EVTL: Trimmed 52482 records to 39032 (keeping 200 days of data) [2025-10-03T18:51:15.115197] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:51:15.147499] [DEBUG] [LOCAL ] EVTL: Primary data saved (39032 records). [2025-10-03T18:51:15.147678] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-03T18:51:15.147845] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EVTL took 42.2s. Estimated remaining: 3h 39m 50s. Rate: 7.2 symbols/min [2025-10-03T18:51:15.195780] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-03T18:51:15.337203] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:15.370924] [DEBUG] [LOCAL ] EXP: Loaded 29797 existing records from primary storage. [2025-10-03T18:51:15.371195] [INFO ] [MAIN ] EXP: Loaded 29797 existing records. [2025-10-03T18:51:15.562346] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:15.562550] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-03T18:51:15.562672] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-03T18:51:15.563322] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-03T18:51:15.563387] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-03T18:51:15.951936] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:15.990618] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-03T18:51:16.161808] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:51:16.790636] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-03T18:51:16.986855] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:51:17.017949] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T18:51:17.590694] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-03T18:51:17.773901] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:51:18.390766] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-03T18:51:19.190749] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-03T18:51:19.677407] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:51:20.002159] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-03T18:51:20.008245] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T18:51:20.069344] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T18:51:20.790702] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-03T18:51:21.320705] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:51:21.590725] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-03T18:51:22.390685] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-03T18:51:22.537704] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:51:23.190694] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-03T18:51:23.281371] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:51:23.308116] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T18:51:23.310118] [INFO ] [REMOTE ] EXG: Full fetch complete (49960 records). [2025-10-03T18:51:23.310222] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-03T18:51:23.704241] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-03T18:51:23.704362] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-03T18:51:23.705060] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-03T18:51:23.705127] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-03T18:51:23.706306] [DEBUG] [LOCAL ] EXG: Trimmed 49960 records to 34616 (keeping 200 days of data) [2025-10-03T18:51:23.928558] [DEBUG] [LOCAL ] EXG: Primary data saved (34616 records). [2025-10-03T18:51:23.928744] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-03T18:51:23.929743] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EXG took 22.8s. Estimated remaining: 3h 39m 43s. Rate: 7.2 symbols/min [2025-10-03T18:51:23.990713] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-03T18:51:24.648255] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:51:24.790695] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-03T18:51:25.590693] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-03T18:51:25.651520] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:51:25.726735] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T18:51:26.390706] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-03T18:51:27.190672] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-03T18:51:27.520818] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:51:27.786017] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T18:51:27.990698] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-03T18:51:28.790669] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-03T18:51:29.115837] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:51:29.328921] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T18:51:29.590708] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-03T18:51:30.390627] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-03T18:51:30.759019] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:51:31.190674] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-03T18:51:31.255205] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:51:31.797629] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:51:31.990767] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-03T18:51:32.790738] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-03T18:51:33.052202] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:51:33.590717] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-03T18:51:33.739364] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:51:33.805517] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:51:34.390750] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-03T18:51:35.190672] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-03T18:51:35.511588] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T18:51:35.592774] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:51:35.990752] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-03T18:51:36.731116] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:51:36.733824] [INFO ] [REMOTE ] EW: Full fetch complete (77350 records). [2025-10-03T18:51:36.733957] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-03T18:51:36.796273] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-03T18:51:37.164029] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-03T18:51:37.164122] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-03T18:51:37.165022] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-03T18:51:37.165120] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-03T18:51:37.166679] [DEBUG] [LOCAL ] EW: Trimmed 77350 records to 54180 (keeping 200 days of data) [2025-10-03T18:51:37.504948] [DEBUG] [LOCAL ] EW: Primary data saved (54180 records). [2025-10-03T18:51:37.505283] [INFO ] [MAIN ] EW: Full history saved. [2025-10-03T18:51:37.506481] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EW took 43.8s. Estimated remaining: 3h 39m 45s. Rate: 7.2 symbols/min [2025-10-03T18:51:38.013906] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T18:51:38.027521] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-03T18:51:38.048371] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T18:51:38.390750] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-03T18:51:39.486194] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:51:39.489958] [INFO ] [REMOTE ] EXP: Full fetch complete (42910 records). [2025-10-03T18:51:39.490095] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-03T18:51:39.949200] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-03T18:51:39.949388] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-03T18:51:39.950260] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-03T18:51:39.950376] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-03T18:51:39.951754] [DEBUG] [LOCAL ] EXP: Trimmed 42910 records to 29982 (keeping 200 days of data) [2025-10-03T18:51:40.083362] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-03T18:51:40.098000] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-03T18:51:40.206443] [DEBUG] [LOCAL ] EXP: Primary data saved (29982 records). [2025-10-03T18:51:40.206593] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-03T18:51:40.206705] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXP took 25.1s. Estimated remaining: 3h 39m 25s. Rate: 7.2 symbols/min [2025-10-03T18:51:42.082973] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:51:42.095417] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-03T18:51:43.785668] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:51:43.788611] [INFO ] [REMOTE ] EXK: Full fetch complete (76546 records). [2025-10-03T18:51:43.788791] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-03T18:51:44.234448] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-03T18:51:44.234540] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-03T18:51:44.235470] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-03T18:51:44.235555] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-03T18:51:44.237247] [DEBUG] [LOCAL ] EXK: Trimmed 76546 records to 53915 (keeping 200 days of data) [2025-10-03T18:51:44.581141] [DEBUG] [LOCAL ] EXK: Primary data saved (53915 records). [2025-10-03T18:51:44.581332] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-03T18:51:44.581457] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXK took 31.6s. Estimated remaining: 3h 39m 9s. Rate: 7.2 symbols/min [2025-10-03T18:51:45.216527] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.296565] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.389020] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.390026] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.476538] [DEBUG] [LOCAL ] FAF: Loaded 41936 existing records from primary storage. [2025-10-03T18:51:45.491559] [INFO ] [MAIN ] FAF: Loaded 41936 existing records. [2025-10-03T18:51:45.504170] [DEBUG] [LOCAL ] EXR: Loaded 45592 existing records from primary storage. [2025-10-03T18:51:45.551304] [INFO ] [MAIN ] EXR: Loaded 45592 existing records. [2025-10-03T18:51:45.583469] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-03T18:51:45.596146] [DEBUG] [LOCAL ] EXPD: Loaded 48284 existing records from primary storage. [2025-10-03T18:51:45.633832] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-03T18:51:45.634069] [INFO ] [MAIN ] EXPD: Loaded 48284 existing records. [2025-10-03T18:51:46.158974] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.171048] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.176783] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-03T18:51:46.238943] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-03T18:51:46.360451] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-03T18:51:46.461167] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.488506] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.497601] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.497823] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-03T18:51:46.527880] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.539029] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-03T18:51:46.517162] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.560632] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-03T18:51:46.560562] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.581382] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-03T18:51:46.575845] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-03T18:51:46.581501] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-03T18:51:46.618007] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-03T18:51:46.612771] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-03T18:51:46.640668] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-03T18:51:47.698283] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:47.737774] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-03T18:51:48.109953] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.171249] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-03T18:51:48.240233] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.233752] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.240966] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-03T18:51:48.241221] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-03T18:51:49.356532] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T18:51:49.364604] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-03T18:51:49.776473] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:51:49.786937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-03T18:51:49.850724] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:51:49.860338] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-03T18:51:50.477991] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T18:51:50.489812] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-03T18:51:50.677717] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T18:51:50.685410] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-03T18:51:51.002164] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T18:51:51.012784] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-03T18:51:51.435377] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:51:51.445921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-03T18:51:51.726297] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T18:51:51.733852] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-03T18:51:52.524522] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:51:52.534820] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-03T18:51:52.918721] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-03T18:51:52.931336] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-03T18:51:53.010225] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:51:53.019817] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-03T18:51:53.231519] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:51:53.240897] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-03T18:51:54.194574] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:51:54.206144] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-03T18:51:54.303444] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:51:54.390627] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-03T18:51:54.876542] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:51:55.190754] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-03T18:51:55.314903] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T18:51:55.886454] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:51:55.928837] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:51:55.990733] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-03T18:51:56.330793] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T18:51:56.790739] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-03T18:51:57.590714] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-03T18:51:57.689464] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:51:58.347707] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:51:58.390635] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-03T18:51:59.190668] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-03T18:51:59.241442] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:51:59.997968] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-03T18:52:00.015595] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:52:00.790703] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-03T18:52:01.590689] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-03T18:52:01.626309] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:52:01.703956] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T18:52:02.072383] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T18:52:02.390732] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-03T18:52:03.184403] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:52:03.193884] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-03T18:52:03.990723] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-03T18:52:04.790638] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-03T18:52:04.890217] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:52:05.014762] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-03T18:52:05.590688] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-03T18:52:05.704863] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:52:06.220018] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:52:06.390713] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-03T18:52:07.164989] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:52:07.190696] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-03T18:52:07.990738] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-03T18:52:08.726395] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:52:08.729503] [INFO ] [REMOTE ] EXR: Full fetch complete (65879 records). [2025-10-03T18:52:08.729685] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-03T18:52:08.810465] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-03T18:52:09.177785] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-03T18:52:09.178110] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-03T18:52:09.179637] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-03T18:52:09.179844] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-03T18:52:09.181999] [DEBUG] [LOCAL ] EXR: Trimmed 65879 records to 45914 (keeping 200 days of data) [2025-10-03T18:52:09.310827] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-03T18:52:09.350112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:52:09.565563] [DEBUG] [LOCAL ] EXR: Primary data saved (45914 records). [2025-10-03T18:52:09.565746] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-03T18:52:09.565888] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. EXR took 25.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-03T18:52:09.595819] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-03T18:52:09.768320] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:09.819465] [DEBUG] [LOCAL ] FBIN: Loaded 50693 existing records from primary storage. [2025-10-03T18:52:09.819829] [INFO ] [MAIN ] FBIN: Loaded 50693 existing records. [2025-10-03T18:52:10.008059] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:10.008301] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-03T18:52:10.008357] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-03T18:52:10.010487] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-03T18:52:10.010577] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-03T18:52:10.392910] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:10.393153] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-03T18:52:10.448254] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T18:52:11.000930] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:52:11.003408] [INFO ] [REMOTE ] FAF: Full fetch complete (57678 records). [2025-10-03T18:52:11.003601] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-03T18:52:11.190989] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-03T18:52:11.609486] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-03T18:52:11.609608] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-03T18:52:11.610726] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-03T18:52:11.610797] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-03T18:52:11.612250] [DEBUG] [LOCAL ] FAF: Trimmed 57678 records to 42190 (keeping 200 days of data) [2025-10-03T18:52:11.896721] [DEBUG] [LOCAL ] FAF: Primary data saved (42190 records). [2025-10-03T18:52:11.896857] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-03T18:52:11.896945] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. FAF took 27.3s. Estimated remaining: 3h 39m 13s. Rate: 7.2 symbols/min [2025-10-03T18:52:11.998242] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-03T18:52:12.097261] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:12.124702] [DEBUG] [LOCAL ] FBK: Loaded 26281 existing records from primary storage. [2025-10-03T18:52:12.125001] [INFO ] [MAIN ] FBK: Loaded 26281 existing records. [2025-10-03T18:52:12.354560] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:12.354829] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-03T18:52:12.354887] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-03T18:52:12.355158] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-03T18:52:12.355218] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-03T18:52:12.781488] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:12.799162] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-03T18:52:12.826539] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:52:12.871953] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T18:52:13.590668] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-03T18:52:13.714690] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:52:13.885461] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T18:52:14.390740] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-03T18:52:14.857824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:52:14.860274] [INFO ] [REMOTE ] EXPD: Full fetch complete (69321 records). [2025-10-03T18:52:14.860385] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-03T18:52:15.195787] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-03T18:52:15.323018] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-03T18:52:15.323119] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-03T18:52:15.324052] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-03T18:52:15.324122] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-03T18:52:15.327470] [DEBUG] [LOCAL ] EXPD: Trimmed 69321 records to 48594 (keeping 200 days of data) [2025-10-03T18:52:15.642020] [DEBUG] [LOCAL ] EXPD: Primary data saved (48594 records). [2025-10-03T18:52:15.642188] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-03T18:52:15.642321] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXPD took 31.1s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-03T18:52:15.835777] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:15.884921] [DEBUG] [LOCAL ] FBP: Loaded 46270 existing records from primary storage. [2025-10-03T18:52:15.885239] [INFO ] [MAIN ] FBP: Loaded 46270 existing records. [2025-10-03T18:52:15.991517] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-03T18:52:16.079218] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:16.079537] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-03T18:52:16.079614] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-03T18:52:16.079908] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-03T18:52:16.079989] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-03T18:52:16.433266] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:52:16.502508] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:16.790716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-03T18:52:17.046416] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T18:52:17.343488] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T18:52:17.590704] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-03T18:52:17.963182] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:52:18.390638] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-03T18:52:18.514546] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:52:19.190703] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-03T18:52:19.990847] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-03T18:52:19.990757] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:52:20.242589] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:52:20.790691] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-03T18:52:21.590693] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-03T18:52:21.886491] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:52:22.185606] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:52:22.390698] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-03T18:52:23.097316] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:52:23.190687] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-03T18:52:23.460486] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:52:23.990686] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-03T18:52:24.387475] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:52:24.790687] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-03T18:52:25.590693] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-03T18:52:26.392925] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-03T18:52:26.413075] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:52:26.461935] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T18:52:26.847956] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:52:27.190716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-03T18:52:27.718146] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:52:27.990689] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-03T18:52:28.790722] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-03T18:52:28.837081] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T18:52:29.432443] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:52:29.590699] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-03T18:52:30.390630] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-03T18:52:30.757945] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:52:31.175085] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-03T18:52:31.190616] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-03T18:52:31.995422] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-03T18:52:32.002111] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:52:32.790678] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-03T18:52:33.055596] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T18:52:33.444817] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-03T18:52:33.447634] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-03T18:52:33.447829] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-03T18:52:33.600495] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-03T18:52:33.883566] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-03T18:52:33.883696] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-03T18:52:33.884822] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-03T18:52:33.884890] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-03T18:52:33.887073] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-03T18:52:34.242932] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-03T18:52:34.243097] [INFO ] [MAIN ] F: Full history saved. [2025-10-03T18:52:34.243229] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 49.7s. Estimated remaining: 3h 39m 7s. Rate: 7.1 symbols/min [2025-10-03T18:52:34.393220] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-03T18:52:34.455881] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:52:34.474519] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:34.519816] [DEBUG] [LOCAL ] FBRT: Loaded 34942 existing records from primary storage. [2025-10-03T18:52:34.520167] [INFO ] [MAIN ] FBRT: Loaded 34942 existing records. [2025-10-03T18:52:34.699478] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:52:34.734513] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:34.735600] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-03T18:52:34.735878] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-03T18:52:34.735788] [INFO ] [REMOTE ] FBK: Full fetch complete (33840 records). [2025-10-03T18:52:34.736114] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-03T18:52:34.736295] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-03T18:52:34.736430] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-03T18:52:35.195801] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-03T18:52:35.575514] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:35.590554] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-03T18:52:35.590614] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-03T18:52:35.591141] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-03T18:52:35.591199] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-03T18:52:35.592042] [DEBUG] [LOCAL ] FBK: Trimmed 33840 records to 26556 (keeping 200 days of data) [2025-10-03T18:52:35.759432] [DEBUG] [LOCAL ] FBK: Primary data saved (26556 records). [2025-10-03T18:52:35.759575] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-03T18:52:35.759710] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 23.9s. Estimated remaining: 3h 38m 45s. Rate: 7.2 symbols/min [2025-10-03T18:52:35.954744] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:35.971940] [DEBUG] [LOCAL ] FC: Loaded 15565 existing records from primary storage. [2025-10-03T18:52:35.972192] [INFO ] [MAIN ] FC: Loaded 15565 existing records. [2025-10-03T18:52:35.997711] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-03T18:52:36.172999] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:36.173250] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-03T18:52:36.173374] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-03T18:52:36.173745] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-03T18:52:36.173853] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-03T18:52:36.401583] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T18:52:36.617551] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:36.790679] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-03T18:52:36.899545] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:52:37.318612] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T18:52:37.590725] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-03T18:52:38.390699] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-03T18:52:38.422336] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:52:38.489176] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:52:39.190710] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-03T18:52:39.912131] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:52:39.990661] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-03T18:52:40.104772] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T18:52:40.790829] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-03T18:52:41.498638] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:52:41.590695] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-03T18:52:41.671598] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T18:52:42.390782] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-03T18:52:43.190833] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-03T18:52:43.353543] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:52:43.671342] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:52:43.674232] [INFO ] [REMOTE ] FBP: Full fetch complete (66456 records). [2025-10-03T18:52:43.674339] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-03T18:52:43.996159] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-03T18:52:44.130442] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-03T18:52:44.130568] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-03T18:52:44.131731] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-03T18:52:44.131857] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-03T18:52:44.133501] [DEBUG] [LOCAL ] FBP: Trimmed 66456 records to 46650 (keeping 200 days of data) [2025-10-03T18:52:44.248210] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:52:44.473957] [DEBUG] [LOCAL ] FBP: Primary data saved (46650 records). [2025-10-03T18:52:44.474678] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-03T18:52:44.474925] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FBP took 28.8s. Estimated remaining: 3h 38m 37s. Rate: 7.2 symbols/min [2025-10-03T18:52:44.679887] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:44.726354] [DEBUG] [LOCAL ] FCF: Loaded 39650 existing records from primary storage. [2025-10-03T18:52:44.726688] [INFO ] [MAIN ] FCF: Loaded 39650 existing records. [2025-10-03T18:52:44.795900] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-03T18:52:44.966364] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:44.966579] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-03T18:52:44.966626] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-03T18:52:44.966947] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-03T18:52:44.967005] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-03T18:52:45.373411] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:45.408748] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:52:45.590713] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-03T18:52:46.125292] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:52:46.218155] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T18:52:46.390733] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-03T18:52:47.190745] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-03T18:52:47.762729] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T18:52:47.990729] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-03T18:52:48.260382] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:52:48.790759] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-03T18:52:49.483869] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:52:49.590738] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-03T18:52:50.390736] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-03T18:52:50.485275] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:52:51.189499] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:52:51.198342] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-03T18:52:51.221341] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T18:52:51.990711] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-03T18:52:52.750781] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:52:52.790639] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-03T18:52:52.802914] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T18:52:53.590703] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-03T18:52:54.166206] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:52:54.390696] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-03T18:52:54.599902] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:52:55.190714] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-03T18:52:55.665266] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:52:55.990683] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-03T18:52:56.135890] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:52:56.790724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-03T18:52:57.310360] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T18:52:57.590743] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-03T18:52:58.207784] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:52:58.390717] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-03T18:52:58.591340] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T18:52:59.190714] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-03T18:52:59.756694] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:52:59.990690] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-03T18:53:00.790689] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-03T18:53:00.978466] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:53:01.444638] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T18:53:01.590737] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-03T18:53:02.324940] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T18:53:02.324806] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T18:53:02.328775] [INFO ] [REMOTE ] FC: Full fetch complete (21789 records). [2025-10-03T18:53:02.328975] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-03T18:53:02.329263] [INFO ] [REMOTE ] FBIN: Full fetch complete (72661 records). [2025-10-03T18:53:02.370731] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-03T18:53:02.396874] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-03T18:53:03.096844] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-03T18:53:03.113619] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-03T18:53:03.114327] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-03T18:53:03.114414] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-03T18:53:03.146817] [DEBUG] [LOCAL ] FC: Trimmed 21789 records to 15641 (keeping 200 days of data) [2025-10-03T18:53:03.172985] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-03T18:53:03.173327] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-03T18:53:03.174143] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-03T18:53:03.174213] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-03T18:53:03.175931] [DEBUG] [LOCAL ] FBIN: Trimmed 72661 records to 51057 (keeping 200 days of data) [2025-10-03T18:53:03.211746] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-03T18:53:03.378770] [DEBUG] [LOCAL ] FC: Primary data saved (15641 records). [2025-10-03T18:53:03.380430] [INFO ] [MAIN ] FC: Full history saved. [2025-10-03T18:53:03.380817] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FC took 27.6s. Estimated remaining: 3h 38m 49s. Rate: 7.1 symbols/min [2025-10-03T18:53:03.610972] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:03.772615] [DEBUG] [LOCAL ] FCN: Loaded 26094 existing records from primary storage. [2025-10-03T18:53:03.774465] [INFO ] [MAIN ] FCN: Loaded 26094 existing records. [2025-10-03T18:53:04.114216] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:04.114500] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-03T18:53:04.114561] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-03T18:53:04.116612] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-03T18:53:04.125597] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-03T18:53:04.360311] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:53:04.433757] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-03T18:53:04.481254] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:53:04.558348] [INFO ] [REMOTE ] FBRT: Full fetch complete (49035 records). [2025-10-03T18:53:04.573369] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-03T18:53:04.586709] [DEBUG] [LOCAL ] FBIN: Primary data saved (51057 records). [2025-10-03T18:53:04.689048] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-03T18:53:04.733585] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FBIN took 55.2s. Estimated remaining: 3h 38m 27s. Rate: 7.2 symbols/min [2025-10-03T18:53:04.983058] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:05.021508] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-03T18:53:05.339222] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:05.446462] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-03T18:53:05.446554] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-03T18:53:05.447600] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-03T18:53:05.447753] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-03T18:53:05.452402] [DEBUG] [LOCAL ] FBRT: Trimmed 49035 records to 35221 (keeping 200 days of data) [2025-10-03T18:53:05.606828] [DEBUG] [LOCAL ] FCPT: Loaded 37618 existing records from primary storage. [2025-10-03T18:53:05.610541] [INFO ] [MAIN ] FCPT: Loaded 37618 existing records. [2025-10-03T18:53:05.857262] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:05.862423] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:53:05.862672] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-03T18:53:05.873989] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-03T18:53:05.873902] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-03T18:53:05.878210] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-03T18:53:05.878286] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-03T18:53:06.316724] [DEBUG] [LOCAL ] FBRT: Primary data saved (35221 records). [2025-10-03T18:53:06.341590] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-03T18:53:06.377699] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FBRT took 32.1s. Estimated remaining: 3h 38m 6s. Rate: 7.2 symbols/min [2025-10-03T18:53:06.359088] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:53:06.444671] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:06.445628] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-03T18:53:06.618916] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:06.619131] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-03T18:53:06.619172] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-03T18:53:06.619288] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-03T18:53:06.619332] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-03T18:53:06.619374] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-03T18:53:06.619409] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-03T18:53:06.998342] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:07.190733] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-03T18:53:07.396371] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:53:07.589542] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T18:53:07.990694] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-03T18:53:08.541281] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T18:53:08.790698] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-03T18:53:09.013273] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T18:53:09.590709] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-03T18:53:10.132520] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T18:53:10.390728] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-03T18:53:11.013743] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:53:11.190708] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-03T18:53:11.799256] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:53:11.990703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-03T18:53:12.297175] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-03T18:53:12.522720] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:53:12.790689] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-03T18:53:13.208309] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:53:13.590723] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-03T18:53:14.390729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-03T18:53:14.818060] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T18:53:14.892062] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:53:15.190700] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-03T18:53:15.990717] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-03T18:53:16.754279] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:53:16.790719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-03T18:53:17.461305] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:53:17.590691] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-03T18:53:18.334194] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T18:53:18.390692] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-03T18:53:18.939731] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:53:19.190724] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-03T18:53:19.803623] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T18:53:19.990672] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-03T18:53:20.320818] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T18:53:20.579565] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:53:20.790712] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-03T18:53:21.590709] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-03T18:53:22.010825] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:53:22.017613] [INFO ] [REMOTE ] FCF: Full fetch complete (58175 records). [2025-10-03T18:53:22.017789] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-03T18:53:22.082247] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:53:22.398239] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-03T18:53:22.448199] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-03T18:53:22.448283] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-03T18:53:22.449088] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-03T18:53:22.449156] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-03T18:53:22.450507] [DEBUG] [LOCAL ] FCF: Trimmed 58175 records to 39961 (keeping 200 days of data) [2025-10-03T18:53:22.724190] [DEBUG] [LOCAL ] FCF: Primary data saved (39961 records). [2025-10-03T18:53:22.724391] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-03T18:53:22.724510] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FCF took 38.2s. Estimated remaining: 3h 38m 13s. Rate: 7.1 symbols/min [2025-10-03T18:53:22.921979] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:22.939874] [DEBUG] [LOCAL ] FCT: Loaded 14789 existing records from primary storage. [2025-10-03T18:53:22.940157] [INFO ] [MAIN ] FCT: Loaded 14789 existing records. [2025-10-03T18:53:23.155003] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:23.155268] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-03T18:53:23.155340] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-03T18:53:23.155692] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-03T18:53:23.155770] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-03T18:53:23.195777] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-03T18:53:23.553985] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:23.582861] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T18:53:23.990686] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-03T18:53:24.790688] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-03T18:53:25.309991] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:53:25.590747] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-03T18:53:25.792360] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:53:26.390710] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-03T18:53:26.723987] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (4.33 seconds). [2025-10-03T18:53:26.802818] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T18:53:26.972587] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:53:27.190696] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-03T18:53:27.990719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-03T18:53:28.156590] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T18:53:28.790716] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-03T18:53:29.312508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:53:29.470208] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:53:29.590719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-03T18:53:30.390698] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-03T18:53:31.109809] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T18:53:31.190638] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-03T18:53:31.297710] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:53:31.990730] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-03T18:53:32.426461] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T18:53:32.429493] [INFO ] [REMOTE ] FCPT: Full fetch complete (53816 records). [2025-10-03T18:53:32.429709] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-03T18:53:32.797104] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-03T18:53:32.838400] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-03T18:53:32.838532] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-03T18:53:32.839273] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-03T18:53:32.839342] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-03T18:53:32.840677] [DEBUG] [LOCAL ] FCPT: Trimmed 53816 records to 37913 (keeping 200 days of data) [2025-10-03T18:53:33.086910] [DEBUG] [LOCAL ] FCPT: Primary data saved (37913 records). [2025-10-03T18:53:33.087066] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-03T18:53:33.087156] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCPT took 28.3s. Estimated remaining: 3h 38m 8s. Rate: 7.1 symbols/min [2025-10-03T18:53:33.269015] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:33.273210] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T18:53:33.302212] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T18:53:33.350926] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-10-03T18:53:33.351296] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-10-03T18:53:33.533437] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:33.533698] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-03T18:53:33.533756] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-03T18:53:33.533993] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-03T18:53:33.534051] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-03T18:53:33.597591] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-03T18:53:33.902054] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:34.390731] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-03T18:53:34.721669] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T18:53:34.821734] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T18:53:35.190709] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-03T18:53:35.618801] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T18:53:35.990732] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-03T18:53:36.790704] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-03T18:53:36.914894] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:53:37.590635] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-03T18:53:37.669151] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:53:38.390735] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-03T18:53:38.812675] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T18:53:38.813396] [INFO ] [REMOTE ] FCRX: Full fetch complete (1682 records). [2025-10-03T18:53:38.813469] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-03T18:53:39.031722] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-03T18:53:39.032033] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:53:39.032133] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:53:39.032234] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-03T18:53:39.032358] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-03T18:53:39.032434] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-03T18:53:39.032501] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-03T18:53:39.032620] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCRX took 32.6s. Estimated remaining: 3h 37m 55s. Rate: 7.1 symbols/min [2025-10-03T18:53:39.195779] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-03T18:53:39.264229] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:39.298067] [DEBUG] [LOCAL ] FDP: Loaded 30317 existing records from primary storage. [2025-10-03T18:53:39.298380] [INFO ] [MAIN ] FDP: Loaded 30317 existing records. [2025-10-03T18:53:39.494831] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:39.495242] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-03T18:53:39.495374] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-03T18:53:39.495740] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-03T18:53:39.495805] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-03T18:53:39.654588] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T18:53:39.958667] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:39.964807] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:53:39.966971] [INFO ] [REMOTE ] FCN: Full fetch complete (35741 records). [2025-10-03T18:53:39.967079] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-03T18:53:39.995830] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-03T18:53:40.382682] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-03T18:53:40.382781] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-03T18:53:40.383338] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-03T18:53:40.383386] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-03T18:53:40.384431] [DEBUG] [LOCAL ] FCN: Trimmed 35741 records to 26319 (keeping 200 days of data) [2025-10-03T18:53:40.567544] [DEBUG] [LOCAL ] FCN: Primary data saved (26319 records). [2025-10-03T18:53:40.567781] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-03T18:53:40.568020] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FCN took 37.2s. Estimated remaining: 3h 37m 34s. Rate: 7.2 symbols/min [2025-10-03T18:53:40.771126] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:40.790683] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-03T18:53:40.801952] [DEBUG] [LOCAL ] FDS: Loaded 26895 existing records from primary storage. [2025-10-03T18:53:40.802264] [INFO ] [MAIN ] FDS: Loaded 26895 existing records. [2025-10-03T18:53:40.932205] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T18:53:41.020108] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:41.020365] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-03T18:53:41.020418] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-03T18:53:41.020815] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-03T18:53:41.020875] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-03T18:53:41.470453] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:41.590728] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-03T18:53:42.390710] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-03T18:53:42.494763] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:53:42.826986] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-03T18:53:43.190683] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-03T18:53:43.581147] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:53:43.990729] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-03T18:53:44.790732] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-03T18:53:44.926452] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T18:53:45.013267] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:53:45.590631] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-03T18:53:45.658877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:53:46.397102] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-03T18:53:46.403249] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:53:47.190768] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-03T18:53:47.816519] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:53:47.990696] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-03T18:53:48.522264] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:53:48.790747] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-03T18:53:48.976839] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T18:53:49.590695] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-03T18:53:49.625041] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:53:50.390680] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-03T18:53:50.799111] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T18:53:51.190704] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-03T18:53:51.828031] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T18:53:51.990759] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-03T18:53:52.451847] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T18:53:52.597778] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:53:52.790724] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-03T18:53:53.590639] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-03T18:53:53.919825] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T18:53:54.390737] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-03T18:53:55.190726] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-03T18:53:55.871305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T18:53:55.896957] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T18:53:55.990671] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-03T18:53:56.370199] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T18:53:56.790687] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-03T18:53:57.293507] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:53:57.590725] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-03T18:53:57.684206] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:53:57.686395] [INFO ] [REMOTE ] FCT: Full fetch complete (21174 records). [2025-10-03T18:53:57.686532] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-03T18:53:58.124049] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-03T18:53:58.124139] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-03T18:53:58.124586] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-03T18:53:58.124682] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-03T18:53:58.125531] [DEBUG] [LOCAL ] FCT: Trimmed 21174 records to 14890 (keeping 200 days of data) [2025-10-03T18:53:58.218010] [DEBUG] [LOCAL ] FCT: Primary data saved (14890 records). [2025-10-03T18:53:58.218214] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-03T18:53:58.218362] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCT took 35.5s. Estimated remaining: 3h 37m 43s. Rate: 7.1 symbols/min [2025-10-03T18:53:58.397631] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-03T18:53:58.406074] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:58.462291] [DEBUG] [LOCAL ] FDX: Loaded 51922 existing records from primary storage. [2025-10-03T18:53:58.462688] [INFO ] [MAIN ] FDX: Loaded 51922 existing records. [2025-10-03T18:53:58.660335] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:58.660613] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-03T18:53:58.660704] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-03T18:53:58.661005] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-03T18:53:58.661065] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-03T18:53:59.059183] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:59.190704] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-03T18:53:59.512510] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T18:53:59.705488] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:53:59.990729] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-03T18:54:00.790698] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-03T18:54:01.154173] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:54:01.242891] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T18:54:01.590733] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-03T18:54:01.760634] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T18:54:02.390717] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-03T18:54:03.129327] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T18:54:03.190688] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-03T18:54:03.990739] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-03T18:54:04.425165] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:54:04.795804] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-03T18:54:04.813004] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:54:05.318005] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:54:05.590714] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-03T18:54:06.390700] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-03T18:54:06.563401] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T18:54:06.872869] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T18:54:07.190707] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-03T18:54:07.936468] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:54:07.990686] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-03T18:54:08.557464] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:54:08.559698] [INFO ] [REMOTE ] FDS: Full fetch complete (37799 records). [2025-10-03T18:54:08.559834] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-03T18:54:08.795871] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-03T18:54:08.992154] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-03T18:54:08.992258] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-03T18:54:08.992950] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-03T18:54:08.993022] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-03T18:54:08.994124] [DEBUG] [LOCAL ] FDS: Trimmed 37799 records to 27155 (keeping 200 days of data) [2025-10-03T18:54:09.176812] [DEBUG] [LOCAL ] FDS: Primary data saved (27155 records). [2025-10-03T18:54:09.176963] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-03T18:54:09.177060] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FDS took 28.6s. Estimated remaining: 3h 37m 39s. Rate: 7.1 symbols/min [2025-10-03T18:54:09.359776] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:09.411250] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-10-03T18:54:09.411624] [INFO ] [MAIN ] FE: Loaded 53818 existing records. [2025-10-03T18:54:09.597402] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-03T18:54:09.623166] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:09.623626] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-03T18:54:09.623857] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-03T18:54:09.624170] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-03T18:54:09.624232] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-03T18:54:10.031609] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:10.073493] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T18:54:10.390683] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-03T18:54:11.025371] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:54:11.080047] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-03T18:54:11.190715] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-03T18:54:11.990756] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-03T18:54:12.045395] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:54:12.790742] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-03T18:54:13.016347] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:54:13.018948] [INFO ] [REMOTE ] FDP: Full fetch complete (42931 records). [2025-10-03T18:54:13.019130] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-03T18:54:13.474173] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-03T18:54:13.597285] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-03T18:54:13.758545] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-03T18:54:13.758664] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-03T18:54:13.759449] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-03T18:54:13.759533] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-03T18:54:13.760877] [DEBUG] [LOCAL ] FDP: Trimmed 42931 records to 30517 (keeping 200 days of data) [2025-10-03T18:54:13.975671] [DEBUG] [LOCAL ] FDP: Primary data saved (30517 records). [2025-10-03T18:54:13.975835] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-03T18:54:13.975953] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FDP took 34.9s. Estimated remaining: 3h 37m 24s. Rate: 7.1 symbols/min [2025-10-03T18:54:14.168798] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:14.168995] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-03T18:54:14.169048] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-03T18:54:14.169168] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-03T18:54:14.169212] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-03T18:54:14.169260] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-03T18:54:14.169299] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-03T18:54:14.395766] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-03T18:54:14.640353] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:14.736123] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:54:15.190770] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-03T18:54:15.992376] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-03T18:54:15.991039] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-03T18:54:16.038815] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:54:16.458034] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T18:54:16.790690] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-03T18:54:17.119736] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:54:17.590698] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-03T18:54:18.390690] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-03T18:54:18.870549] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:54:18.874074] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:54:18.878950] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-03T18:54:18.879151] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-03T18:54:19.195884] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-03T18:54:19.320996] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-03T18:54:19.321185] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-03T18:54:19.322140] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-03T18:54:19.322309] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-03T18:54:19.324483] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54480 (keeping 200 days of data) [2025-10-03T18:54:19.468134] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-03T18:54:19.605733] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T18:54:19.740344] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-10-03T18:54:19.740499] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-03T18:54:19.741228] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FCX took 46.7s. Estimated remaining: 3h 37m 11s. Rate: 7.2 symbols/min [2025-10-03T18:54:19.928255] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:19.983760] [DEBUG] [LOCAL ] FERG: Loaded 49230 existing records from primary storage. [2025-10-03T18:54:19.984098] [INFO ] [MAIN ] FERG: Loaded 49230 existing records. [2025-10-03T18:54:19.995791] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-03T18:54:20.196778] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:20.197016] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-03T18:54:20.197066] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-03T18:54:20.197301] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-03T18:54:20.197372] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-03T18:54:20.561495] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T18:54:20.606723] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:20.790691] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-03T18:54:21.276636] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:54:21.590713] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-03T18:54:22.390703] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-03T18:54:23.190679] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-03T18:54:23.498844] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:54:23.930427] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:54:23.990734] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-03T18:54:24.790707] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-03T18:54:24.937494] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:54:25.590629] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-03T18:54:25.851166] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:54:26.340824] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:54:26.390621] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-03T18:54:27.190708] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-03T18:54:27.301318] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:54:27.938470] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:54:27.990631] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-03T18:54:28.790687] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-03T18:54:29.040872] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:54:29.232548] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T18:54:29.595888] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-03T18:54:29.602374] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:54:29.946164] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:54:30.390740] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-03T18:54:31.190739] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-03T18:54:31.990694] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-03T18:54:32.148529] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T18:54:32.790734] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-03T18:54:33.131849] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T18:54:33.238558] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:54:33.590706] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-03T18:54:33.791719] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:54:33.936469] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:54:34.390705] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-03T18:54:35.190752] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-03T18:54:35.644978] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:54:35.990693] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-03T18:54:36.273607] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:54:36.790736] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-03T18:54:37.590740] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-03T18:54:37.877908] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T18:54:37.880851] [INFO ] [REMOTE ] FDX: Full fetch complete (74458 records). [2025-10-03T18:54:37.880988] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-03T18:54:37.989697] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T18:54:38.012167] [INFO ] [REMOTE ] FENG: Full fetch complete (2256 records). [2025-10-03T18:54:38.033466] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-03T18:54:38.391324] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-03T18:54:38.420327] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:54:38.426204] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:54:38.431743] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:54:38.437081] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-03T18:54:38.442392] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-03T18:54:38.469744] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-03T18:54:38.480492] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-03T18:54:38.480793] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FENG took 24.5s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-03T18:54:38.535950] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-03T18:54:38.570016] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-03T18:54:38.578912] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-03T18:54:38.605951] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-03T18:54:38.659974] [DEBUG] [LOCAL ] FDX: Trimmed 74458 records to 52286 (keeping 200 days of data) [2025-10-03T18:54:38.778220] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:38.866250] [DEBUG] [LOCAL ] FET: Loaded 12979 existing records from primary storage. [2025-10-03T18:54:38.867593] [INFO ] [MAIN ] FET: Loaded 12979 existing records. [2025-10-03T18:54:38.875157] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:54:39.091172] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:39.092177] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-03T18:54:39.092584] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-03T18:54:39.093233] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-03T18:54:39.093299] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-03T18:54:39.195998] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-03T18:54:39.504812] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:39.722478] [DEBUG] [LOCAL ] FDX: Primary data saved (52286 records). [2025-10-03T18:54:39.722634] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-03T18:54:39.722784] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FDX took 41.5s. Estimated remaining: 3h 37m 0s. Rate: 7.1 symbols/min [2025-10-03T18:54:39.909615] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:39.935627] [DEBUG] [LOCAL ] FF: Loaded 25097 existing records from primary storage. [2025-10-03T18:54:39.935925] [INFO ] [MAIN ] FF: Loaded 25097 existing records. [2025-10-03T18:54:40.002404] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-03T18:54:40.129453] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:40.129943] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-03T18:54:40.130024] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-03T18:54:40.130351] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-03T18:54:40.130504] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-03T18:54:40.510170] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T18:54:40.614604] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:40.790639] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-03T18:54:40.850141] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:54:40.932028] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T18:54:41.590676] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-03T18:54:41.960880] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:54:42.390771] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-03T18:54:43.195261] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-03T18:54:43.197597] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:54:43.362247] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T18:54:43.990744] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-03T18:54:44.790639] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-03T18:54:44.846938] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:54:44.857865] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T18:54:45.590692] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-03T18:54:45.627353] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:54:46.390737] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-03T18:54:46.582805] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T18:54:47.190751] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-03T18:54:47.908445] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:54:47.911566] [INFO ] [REMOTE ] FE: Full fetch complete (77273 records). [2025-10-03T18:54:47.911742] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-03T18:54:47.995814] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-03T18:54:48.277763] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T18:54:48.422731] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-03T18:54:48.422866] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-03T18:54:48.424309] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-03T18:54:48.424384] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-03T18:54:48.426286] [DEBUG] [LOCAL ] FE: Trimmed 77273 records to 54208 (keeping 200 days of data) [2025-10-03T18:54:48.778159] [DEBUG] [LOCAL ] FE: Primary data saved (54208 records). [2025-10-03T18:54:48.778313] [INFO ] [MAIN ] FE: Full history saved. [2025-10-03T18:54:48.778432] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FE took 39.6s. Estimated remaining: 3h 36m 53s. Rate: 7.1 symbols/min [2025-10-03T18:54:48.796014] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-03T18:54:48.975294] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:48.984519] [DEBUG] [LOCAL ] FFA: Loaded 5933 existing records from primary storage. [2025-10-03T18:54:48.984805] [INFO ] [MAIN ] FFA: Loaded 5933 existing records. [2025-10-03T18:54:49.209986] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:49.210399] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-03T18:54:49.210461] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-03T18:54:49.210687] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-03T18:54:49.210757] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-03T18:54:49.599141] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-03T18:54:49.605341] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:49.680278] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T18:54:49.712199] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:54:50.390768] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-03T18:54:51.190678] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-03T18:54:51.623667] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T18:54:51.637969] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T18:54:51.994801] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-03T18:54:52.002388] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T18:54:52.599928] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:54:52.790722] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-03T18:54:53.590776] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-03T18:54:54.390748] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-03T18:54:54.499190] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:54:54.499594] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T18:54:55.190762] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-03T18:54:55.699291] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T18:54:55.932171] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:54:55.990732] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-03T18:54:56.790701] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-03T18:54:57.071004] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:54:57.590730] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-03T18:54:58.351556] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:54:58.354456] [INFO ] [REMOTE ] FERG: Full fetch complete (70934 records). [2025-10-03T18:54:58.354638] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-03T18:54:58.396483] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-03T18:54:58.660990] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:54:58.850392] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-03T18:54:58.850509] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-03T18:54:58.851957] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-03T18:54:58.852030] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-03T18:54:58.854115] [DEBUG] [LOCAL ] FERG: Trimmed 70934 records to 49585 (keeping 200 days of data) [2025-10-03T18:54:59.198610] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-03T18:54:59.226035] [DEBUG] [LOCAL ] FERG: Primary data saved (49585 records). [2025-10-03T18:54:59.226345] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-03T18:54:59.227251] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FERG took 39.5s. Estimated remaining: 3h 36m 48s. Rate: 7.1 symbols/min [2025-10-03T18:54:59.391130] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T18:54:59.431823] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:59.457337] [DEBUG] [LOCAL ] FFC: Loaded 16849 existing records from primary storage. [2025-10-03T18:54:59.457721] [INFO ] [MAIN ] FFC: Loaded 16849 existing records. [2025-10-03T18:54:59.654274] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:59.654678] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-03T18:54:59.654748] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-03T18:54:59.655042] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-03T18:54:59.655102] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-03T18:54:59.853806] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:55:00.006174] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-03T18:55:00.052328] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:00.790746] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-03T18:55:01.232101] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T18:55:01.590746] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-03T18:55:01.830998] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T18:55:02.244857] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-03T18:55:02.390712] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-03T18:55:03.190757] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-03T18:55:03.249929] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:55:03.990732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-03T18:55:04.417378] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T18:55:04.603464] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:55:04.790704] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-03T18:55:05.590729] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-03T18:55:06.109220] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:55:06.206494] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T18:55:06.390722] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-03T18:55:07.190729] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-03T18:55:07.446708] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T18:55:07.990715] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-03T18:55:08.199514] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:55:08.576710] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T18:55:08.790678] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-03T18:55:09.494455] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T18:55:09.495891] [INFO ] [REMOTE ] FET: Full fetch complete (18413 records). [2025-10-03T18:55:09.495980] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-03T18:55:09.595814] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-03T18:55:09.930675] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-03T18:55:09.930782] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-03T18:55:09.931279] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-03T18:55:09.931357] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-03T18:55:09.932630] [DEBUG] [LOCAL ] FET: Trimmed 18413 records to 13092 (keeping 200 days of data) [2025-10-03T18:55:10.018968] [DEBUG] [LOCAL ] FET: Primary data saved (13092 records). [2025-10-03T18:55:10.019121] [INFO ] [MAIN ] FET: Full history saved. [2025-10-03T18:55:10.019225] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FET took 31.5s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-03T18:55:10.222743] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:10.256726] [DEBUG] [LOCAL ] FFWM: Loaded 36004 existing records from primary storage. [2025-10-03T18:55:10.257054] [INFO ] [MAIN ] FFWM: Loaded 36004 existing records. [2025-10-03T18:55:10.395779] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-03T18:55:10.455673] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:10.456009] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-03T18:55:10.456137] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-03T18:55:10.460410] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:55:10.462010] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-03T18:55:10.462348] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-03T18:55:10.495825] [INFO ] [REMOTE ] FF: Full fetch complete (36719 records). [2025-10-03T18:55:10.508102] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-03T18:55:11.194744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-03T18:55:11.233801] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:11.330476] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-03T18:55:11.330565] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-03T18:55:11.331180] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-03T18:55:11.331248] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-03T18:55:11.332802] [DEBUG] [LOCAL ] FF: Trimmed 36719 records to 25223 (keeping 200 days of data) [2025-10-03T18:55:11.451698] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:55:11.518827] [DEBUG] [LOCAL ] FF: Primary data saved (25223 records). [2025-10-03T18:55:11.518985] [INFO ] [MAIN ] FF: Full history saved. [2025-10-03T18:55:11.519084] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FF took 31.8s. Estimated remaining: 3h 36m 23s. Rate: 7.1 symbols/min [2025-10-03T18:55:11.711088] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:11.737999] [DEBUG] [LOCAL ] FG: Loaded 22965 existing records from primary storage. [2025-10-03T18:55:11.738355] [INFO ] [MAIN ] FG: Loaded 22965 existing records. [2025-10-03T18:55:11.882549] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T18:55:11.972171] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:11.972412] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-03T18:55:11.972466] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-03T18:55:11.972830] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-03T18:55:11.972916] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-03T18:55:11.995826] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-03T18:55:12.377877] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:12.790732] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-03T18:55:13.043102] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T18:55:13.590702] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-03T18:55:14.390676] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-03T18:55:14.706274] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:55:14.742778] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:55:14.894039] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T18:55:15.190709] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-03T18:55:15.990683] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-03T18:55:16.658597] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T18:55:16.705817] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T18:55:16.706952] [INFO ] [REMOTE ] FFA: Full fetch complete (8572 records). [2025-10-03T18:55:16.707082] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-03T18:55:16.795766] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-03T18:55:17.156783] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-03T18:55:17.156889] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-03T18:55:17.157176] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-03T18:55:17.157291] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-03T18:55:17.157938] [DEBUG] [LOCAL ] FFA: Trimmed 8572 records to 6012 (keeping 200 days of data) [2025-10-03T18:55:17.198584] [DEBUG] [LOCAL ] FFA: Primary data saved (6012 records). [2025-10-03T18:55:17.198743] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-03T18:55:17.198880] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FFA took 28.4s. Estimated remaining: 3h 36m 10s. Rate: 7.2 symbols/min [2025-10-03T18:55:17.386145] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:17.397397] [DEBUG] [LOCAL ] FGN: Loaded 3909 existing records from primary storage. [2025-10-03T18:55:17.397709] [INFO ] [MAIN ] FGN: Loaded 3909 existing records. [2025-10-03T18:55:17.586237] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:17.586457] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-03T18:55:17.586508] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-03T18:55:17.586837] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-03T18:55:17.586898] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-03T18:55:17.598575] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-03T18:55:17.992074] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:18.144313] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:55:18.390671] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-03T18:55:18.618258] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:55:18.729537] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-03T18:55:19.190673] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-03T18:55:19.990681] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-03T18:55:20.219926] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:55:20.790739] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-03T18:55:21.405290] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:55:21.405512] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T18:55:21.590707] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-03T18:55:22.390728] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-03T18:55:23.088333] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:55:23.158089] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T18:55:23.190700] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-03T18:55:23.990712] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-03T18:55:24.046267] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T18:55:24.790732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-03T18:55:25.323536] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T18:55:25.440150] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:55:25.590730] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-03T18:55:26.390720] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-03T18:55:26.830464] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:55:27.190728] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-03T18:55:27.677762] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:55:27.679918] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:55:27.990734] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-03T18:55:28.570115] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T18:55:28.790732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-03T18:55:29.590713] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-03T18:55:29.842902] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T18:55:30.390724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-03T18:55:30.835221] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T18:55:31.190701] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-03T18:55:31.454762] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:55:31.990693] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-03T18:55:32.317766] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T18:55:32.790735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-03T18:55:33.350811] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T18:55:33.378255] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:55:33.590735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-03T18:55:34.118536] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T18:55:34.390710] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-03T18:55:35.190717] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-03T18:55:35.611162] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:55:35.775808] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:55:35.990742] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-03T18:55:36.790700] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-03T18:55:37.054328] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T18:55:37.056322] [INFO ] [REMOTE ] FFWM: Full fetch complete (51801 records). [2025-10-03T18:55:37.056422] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-03T18:55:37.392391] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:55:37.495021] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-03T18:55:37.495105] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-03T18:55:37.495845] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-03T18:55:37.495912] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-03T18:55:37.497115] [DEBUG] [LOCAL ] FFWM: Trimmed 51801 records to 36233 (keeping 200 days of data) [2025-10-03T18:55:37.595959] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-03T18:55:37.731943] [DEBUG] [LOCAL ] FFWM: Primary data saved (36233 records). [2025-10-03T18:55:37.732129] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-03T18:55:37.732382] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FFWM took 27.7s. Estimated remaining: 3h 36m 24s. Rate: 7.1 symbols/min [2025-10-03T18:55:37.925296] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:37.925497] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-03T18:55:37.925537] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-03T18:55:37.925683] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-03T18:55:37.925741] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-03T18:55:37.925786] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-03T18:55:37.925821] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-03T18:55:38.231348] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:55:38.327154] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:38.390668] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-03T18:55:38.605380] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:55:38.605860] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-03T18:55:38.606024] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:55:38.606104] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-03T18:55:38.606185] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:55:38.606276] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-03T18:55:38.606370] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-03T18:55:38.606431] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-03T18:55:38.606502] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-03T18:55:38.606575] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FGSN took 0.9s. Estimated remaining: 3h 36m 1s. Rate: 7.1 symbols/min [2025-10-03T18:55:38.825910] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:38.866503] [DEBUG] [LOCAL ] FHI: Loaded 40514 existing records from primary storage. [2025-10-03T18:55:38.866853] [INFO ] [MAIN ] FHI: Loaded 40514 existing records. [2025-10-03T18:55:39.066160] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:39.066377] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-03T18:55:39.066427] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-03T18:55:39.066734] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-03T18:55:39.066794] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-03T18:55:39.195802] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-03T18:55:39.454981] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:39.990701] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-03T18:55:40.448784] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T18:55:40.790748] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-03T18:55:41.239032] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:55:41.429794] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:55:41.590703] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-03T18:55:42.108237] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:55:42.109181] [INFO ] [REMOTE ] FGN: Full fetch complete (5774 records). [2025-10-03T18:55:42.109255] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-03T18:55:42.395767] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-03T18:55:42.509992] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-03T18:55:42.510074] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-03T18:55:42.510253] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-03T18:55:42.510295] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-03T18:55:42.511055] [DEBUG] [LOCAL ] FGN: Trimmed 5774 records to 3930 (keeping 200 days of data) [2025-10-03T18:55:42.535672] [DEBUG] [LOCAL ] FGN: Primary data saved (3930 records). [2025-10-03T18:55:42.535808] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-03T18:55:42.535919] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGN took 25.3s. Estimated remaining: 3h 35m 45s. Rate: 7.2 symbols/min [2025-10-03T18:55:42.726567] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:42.793279] [DEBUG] [LOCAL ] FHN: Loaded 53755 existing records from primary storage. [2025-10-03T18:55:42.793696] [INFO ] [MAIN ] FHN: Loaded 53755 existing records. [2025-10-03T18:55:42.991195] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:42.991461] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-03T18:55:42.991521] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-03T18:55:42.991890] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-03T18:55:42.991952] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-03T18:55:43.196467] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-03T18:55:43.394525] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:43.525935] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:55:43.990728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-03T18:55:44.229246] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:55:44.790705] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-03T18:55:45.441925] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:55:45.590717] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-03T18:55:46.390688] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-03T18:55:46.502882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:55:46.991307] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:55:47.118809] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T18:55:47.190703] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-03T18:55:47.990744] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-03T18:55:48.720761] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:55:48.767900] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:55:48.790724] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-03T18:55:49.590732] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-03T18:55:49.619628] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T18:55:49.620967] [INFO ] [REMOTE ] FFC: Full fetch complete (24752 records). [2025-10-03T18:55:49.621055] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-03T18:55:50.037734] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-03T18:55:50.037836] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-03T18:55:50.038357] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-03T18:55:50.038454] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-03T18:55:50.039277] [DEBUG] [LOCAL ] FFC: Trimmed 24752 records to 16957 (keeping 200 days of data) [2025-10-03T18:55:50.147216] [DEBUG] [LOCAL ] FFC: Primary data saved (16957 records). [2025-10-03T18:55:50.147367] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-03T18:55:50.147494] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FFC took 50.9s. Estimated remaining: 3h 35m 35s. Rate: 7.2 symbols/min [2025-10-03T18:55:50.325368] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:50.389375] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-10-03T18:55:50.389840] [INFO ] [MAIN ] FI: Loaded 53888 existing records. [2025-10-03T18:55:50.401852] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-03T18:55:50.593350] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:50.593583] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-03T18:55:50.593635] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-03T18:55:50.593887] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-03T18:55:50.593944] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-03T18:55:50.994344] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:51.190720] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-03T18:55:51.282988] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:55:51.506853] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:55:51.990707] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-03T18:55:52.796230] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-03T18:55:52.810278] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T18:55:53.550461] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:55:53.590629] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-03T18:55:54.392799] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-03T18:55:54.396476] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:55:55.190735] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-03T18:55:55.231471] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:55:55.411785] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:55:55.990719] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-03T18:55:56.790627] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-03T18:55:57.004350] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:55:57.021604] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:55:57.023792] [INFO ] [REMOTE ] FG: Full fetch complete (27769 records). [2025-10-03T18:55:57.023914] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-03T18:55:57.471113] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-03T18:55:57.471196] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-03T18:55:57.471768] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-03T18:55:57.471854] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-03T18:55:57.473247] [DEBUG] [LOCAL ] FG: Trimmed 27769 records to 23125 (keeping 200 days of data) [2025-10-03T18:55:57.591088] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-03T18:55:57.668094] [DEBUG] [LOCAL ] FG: Primary data saved (23125 records). [2025-10-03T18:55:57.668245] [INFO ] [MAIN ] FG: Full history saved. [2025-10-03T18:55:57.668342] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FG took 46.1s. Estimated remaining: 3h 35m 25s. Rate: 7.2 symbols/min [2025-10-03T18:55:57.903054] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:57.930801] [DEBUG] [LOCAL ] FICO: Loaded 20838 existing records from primary storage. [2025-10-03T18:55:57.931170] [INFO ] [MAIN ] FICO: Loaded 20838 existing records. [2025-10-03T18:55:58.223988] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:58.224396] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-03T18:55:58.224471] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-03T18:55:58.225056] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-03T18:55:58.225151] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-03T18:55:58.408450] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-03T18:55:58.417193] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:55:58.842938] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:59.190701] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-03T18:55:59.340877] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:55:59.990662] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-03T18:56:00.233370] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:56:00.254281] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:56:00.790689] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-03T18:56:01.590723] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-03T18:56:01.932763] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T18:56:02.381356] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:56:02.390604] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-03T18:56:03.177947] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T18:56:03.190671] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-03T18:56:03.483054] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T18:56:03.990683] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-03T18:56:04.761185] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T18:56:04.790625] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-03T18:56:05.580090] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T18:56:05.590747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-03T18:56:06.390680] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-03T18:56:06.705198] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T18:56:06.889080] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T18:56:07.190698] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-03T18:56:07.990699] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-03T18:56:08.159610] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T18:56:08.262584] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:56:08.790688] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-03T18:56:09.547141] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:56:09.590619] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-03T18:56:10.037205] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T18:56:10.390682] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-03T18:56:11.190692] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-03T18:56:11.251208] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:56:11.661754] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:56:11.990682] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-03T18:56:12.735571] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T18:56:12.790675] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-03T18:56:13.464241] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:56:13.590683] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-03T18:56:14.216526] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:56:14.218607] [INFO ] [REMOTE ] FHI: Full fetch complete (57701 records). [2025-10-03T18:56:14.218740] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-03T18:56:14.396729] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-03T18:56:14.630455] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-03T18:56:14.630539] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-03T18:56:14.631418] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-03T18:56:14.631493] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-03T18:56:14.632915] [DEBUG] [LOCAL ] FHI: Trimmed 57701 records to 40721 (keeping 200 days of data) [2025-10-03T18:56:14.911353] [DEBUG] [LOCAL ] FHI: Primary data saved (40721 records). [2025-10-03T18:56:14.911479] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-03T18:56:14.911561] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 36.3s. Estimated remaining: 3h 35m 33s. Rate: 7.1 symbols/min [2025-10-03T18:56:15.105422] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:15.105758] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-03T18:56:15.105942] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-03T18:56:15.106127] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-03T18:56:15.106189] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-03T18:56:15.106243] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-03T18:56:15.106279] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-03T18:56:15.197768] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-03T18:56:15.508636] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:15.541140] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:56:15.990640] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-03T18:56:16.472311] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T18:56:16.581241] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:56:16.790685] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-03T18:56:17.176410] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-03T18:56:17.472535] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:56:17.590698] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-03T18:56:18.390730] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-03T18:56:18.624438] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-03T18:56:19.190678] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-03T18:56:19.501947] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T18:56:19.745953] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T18:56:19.990732] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-03T18:56:20.302986] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-03T18:56:20.790701] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-03T18:56:21.241015] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T18:56:21.590706] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-03T18:56:21.908565] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T18:56:22.390710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-03T18:56:23.190722] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-03T18:56:23.529100] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:56:23.529462] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-03T18:56:23.529564] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:56:23.529670] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-03T18:56:23.529745] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:56:23.529818] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-03T18:56:23.529914] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-03T18:56:23.529983] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-03T18:56:23.530068] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-03T18:56:23.530141] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FIG took 8.6s. Estimated remaining: 3h 35m 25s. Rate: 7.1 symbols/min [2025-10-03T18:56:23.676594] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:56:23.770272] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:23.826520] [DEBUG] [LOCAL ] FIGS: Loaded 49208 existing records from primary storage. [2025-10-03T18:56:23.826908] [INFO ] [MAIN ] FIGS: Loaded 49208 existing records. [2025-10-03T18:56:23.996905] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-03T18:56:24.020832] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:24.021205] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-03T18:56:24.021263] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-03T18:56:24.021786] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-03T18:56:24.021849] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-03T18:56:24.426599] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:24.790683] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-03T18:56:25.590731] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-03T18:56:25.877707] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:56:26.390729] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-03T18:56:26.818697] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T18:56:26.867309] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:56:26.869352] [INFO ] [REMOTE ] FICO: Full fetch complete (28894 records). [2025-10-03T18:56:26.869445] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-03T18:56:27.195827] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-03T18:56:27.320466] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-03T18:56:27.320682] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-03T18:56:27.321504] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-03T18:56:27.321582] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-03T18:56:27.322841] [DEBUG] [LOCAL ] FICO: Trimmed 28894 records to 21102 (keeping 200 days of data) [2025-10-03T18:56:27.465111] [DEBUG] [LOCAL ] FICO: Primary data saved (21102 records). [2025-10-03T18:56:27.465265] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-03T18:56:27.465464] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FICO took 29.8s. Estimated remaining: 3h 35m 8s. Rate: 7.1 symbols/min [2025-10-03T18:56:27.672197] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:27.720942] [DEBUG] [LOCAL ] FIHL: Loaded 40141 existing records from primary storage. [2025-10-03T18:56:27.721276] [INFO ] [MAIN ] FIHL: Loaded 40141 existing records. [2025-10-03T18:56:27.925026] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:27.931661] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-03T18:56:27.931784] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-03T18:56:27.932712] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:56:27.932766] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-03T18:56:27.934948] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-03T18:56:27.968721] [INFO ] [REMOTE ] FHN: Full fetch complete (77282 records). [2025-10-03T18:56:28.003731] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-03T18:56:27.994506] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-03T18:56:28.658034] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:28.787129] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-03T18:56:28.787269] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-03T18:56:28.788506] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-03T18:56:28.788687] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-03T18:56:28.790849] [DEBUG] [LOCAL ] FHN: Trimmed 77282 records to 54145 (keeping 200 days of data) [2025-10-03T18:56:28.790680] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-03T18:56:28.937301] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T18:56:29.197985] [DEBUG] [LOCAL ] FHN: Primary data saved (54145 records). [2025-10-03T18:56:29.198150] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-03T18:56:29.198258] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FHN took 46.7s. Estimated remaining: 3h 34m 48s. Rate: 7.2 symbols/min [2025-10-03T18:56:29.385532] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:29.396752] [DEBUG] [LOCAL ] FINS: Loaded 8316 existing records from primary storage. [2025-10-03T18:56:29.396989] [INFO ] [MAIN ] FINS: Loaded 8316 existing records. [2025-10-03T18:56:29.593161] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:29.593233] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-03T18:56:29.593553] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-03T18:56:29.594351] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-03T18:56:29.594565] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-03T18:56:29.594624] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-03T18:56:30.070200] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:30.072203] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:56:30.104772] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T18:56:30.390689] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-03T18:56:31.190725] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-03T18:56:31.582492] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T18:56:31.585921] [INFO ] [REMOTE ] FI: Full fetch complete (77195 records). [2025-10-03T18:56:31.586068] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-03T18:56:31.990867] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-03T18:56:32.040789] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-03T18:56:32.041705] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-03T18:56:32.042761] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-03T18:56:32.042891] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-03T18:56:32.076080] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:56:32.075041] [DEBUG] [LOCAL ] FI: Trimmed 77195 records to 54278 (keeping 200 days of data) [2025-10-03T18:56:32.190132] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:56:32.472798] [DEBUG] [LOCAL ] FI: Primary data saved (54278 records). [2025-10-03T18:56:32.473221] [INFO ] [MAIN ] FI: Full history saved. [2025-10-03T18:56:32.474767] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FI took 42.3s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-03T18:56:32.665161] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:32.715196] [DEBUG] [LOCAL ] FINV: Loaded 45625 existing records from primary storage. [2025-10-03T18:56:32.715566] [INFO ] [MAIN ] FINV: Loaded 45625 existing records. [2025-10-03T18:56:32.797240] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-03T18:56:32.907604] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:32.907868] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-03T18:56:32.907917] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-03T18:56:32.908504] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-03T18:56:32.908563] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-03T18:56:33.316105] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:33.335060] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:56:33.590704] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-03T18:56:33.966380] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:56:34.363047] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T18:56:34.390622] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-03T18:56:35.094795] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T18:56:35.190745] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-03T18:56:35.990700] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-03T18:56:36.589165] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:56:36.597601] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T18:56:36.790682] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-03T18:56:37.590718] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-03T18:56:38.231517] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:56:38.390702] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-03T18:56:38.866008] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:56:39.190742] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-03T18:56:39.744001] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:56:39.985473] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:56:39.990604] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-03T18:56:40.760736] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:56:40.790738] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-03T18:56:41.590744] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-03T18:56:42.292434] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T18:56:42.390732] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-03T18:56:43.190696] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-03T18:56:43.241533] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:56:43.272676] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:56:43.990724] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-03T18:56:44.790636] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-03T18:56:44.967124] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T18:56:45.453630] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:56:45.590737] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-03T18:56:46.343610] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T18:56:46.372898] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:56:46.390625] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-03T18:56:47.190719] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-03T18:56:47.871516] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T18:56:47.990689] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-03T18:56:48.268885] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T18:56:48.790699] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-03T18:56:49.470803] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T18:56:49.545218] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:56:49.590622] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-03T18:56:50.390734] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-03T18:56:50.960506] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T18:56:51.190728] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-03T18:56:51.956179] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T18:56:51.990714] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-03T18:56:52.512987] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:56:52.513884] [INFO ] [REMOTE ] FINS: Full fetch complete (12195 records). [2025-10-03T18:56:52.513958] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-03T18:56:52.693382] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:56:52.795710] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-03T18:56:52.941059] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-03T18:56:52.941140] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-03T18:56:52.941414] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-03T18:56:52.941454] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-03T18:56:52.942075] [DEBUG] [LOCAL ] FINS: Trimmed 12195 records to 8348 (keeping 200 days of data) [2025-10-03T18:56:52.999876] [DEBUG] [LOCAL ] FINS: Primary data saved (8348 records). [2025-10-03T18:56:53.000011] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-03T18:56:53.000109] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FINS took 23.8s. Estimated remaining: 3h 34m 44s. Rate: 7.1 symbols/min [2025-10-03T18:56:53.183982] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:53.235576] [DEBUG] [LOCAL ] FIS: Loaded 53751 existing records from primary storage. [2025-10-03T18:56:53.235965] [INFO ] [MAIN ] FIS: Loaded 53751 existing records. [2025-10-03T18:56:53.430148] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:53.430393] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-03T18:56:53.430443] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-03T18:56:53.430961] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-03T18:56:53.431023] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-03T18:56:53.595792] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-03T18:56:53.839142] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:54.384889] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:56:54.395605] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-03T18:56:54.770963] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T18:56:55.190707] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-03T18:56:55.990711] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-03T18:56:56.183385] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:56:56.388291] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:56:56.790683] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-03T18:56:57.590690] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-03T18:56:57.866183] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:56:58.397123] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-03T18:56:58.412348] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T18:56:59.190687] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-03T18:56:59.256391] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T18:56:59.896050] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T18:56:59.990671] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-03T18:57:00.776396] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:57:00.790568] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-03T18:57:01.590638] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-03T18:57:02.380073] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:57:02.384023] [INFO ] [REMOTE ] FIGS: Full fetch complete (71007 records). [2025-10-03T18:57:02.384140] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-03T18:57:02.418207] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-03T18:57:02.842950] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-03T18:57:02.900201] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-03T18:57:02.900874] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-03T18:57:02.901863] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-03T18:57:02.901929] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-03T18:57:02.903381] [DEBUG] [LOCAL ] FIGS: Trimmed 71007 records to 49571 (keeping 200 days of data) [2025-10-03T18:57:03.188436] [DEBUG] [LOCAL ] FIGS: Primary data saved (49571 records). [2025-10-03T18:57:03.188582] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-03T18:57:03.188705] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FIGS took 39.7s. Estimated remaining: 3h 34m 39s. Rate: 7.1 symbols/min [2025-10-03T18:57:03.202924] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-03T18:57:03.385443] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:03.418211] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:57:03.456268] [DEBUG] [LOCAL ] FIX: Loaded 29974 existing records from primary storage. [2025-10-03T18:57:03.456630] [INFO ] [MAIN ] FIX: Loaded 29974 existing records. [2025-10-03T18:57:03.665667] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:03.666091] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-03T18:57:03.666173] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-03T18:57:03.666482] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-03T18:57:03.666603] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-03T18:57:03.809987] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:57:03.998148] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-03T18:57:04.135812] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:04.790726] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-03T18:57:05.006729] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:57:05.590695] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-03T18:57:05.703184] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T18:57:05.843707] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:57:06.390686] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-03T18:57:07.098105] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:57:07.190678] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-03T18:57:07.950762] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:57:07.990692] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-03T18:57:08.634303] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T18:57:08.642521] [INFO ] [REMOTE ] FINV: Full fetch complete (63637 records). [2025-10-03T18:57:08.642742] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-03T18:57:08.796142] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-03T18:57:09.086742] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-03T18:57:09.086836] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-03T18:57:09.087591] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-03T18:57:09.087636] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-03T18:57:09.089173] [DEBUG] [LOCAL ] FINV: Trimmed 63637 records to 45997 (keeping 200 days of data) [2025-10-03T18:57:09.196116] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:57:09.203203] [INFO ] [REMOTE ] FIHL: Full fetch complete (55851 records). [2025-10-03T18:57:09.205097] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-03T18:57:09.595532] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-03T18:57:09.766872] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-03T18:57:09.767549] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-03T18:57:09.768804] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-03T18:57:09.769184] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-03T18:57:09.772880] [DEBUG] [LOCAL ] FIHL: Trimmed 55851 records to 40409 (keeping 200 days of data) [2025-10-03T18:57:09.906253] [DEBUG] [LOCAL ] FINV: Primary data saved (45997 records). [2025-10-03T18:57:09.906955] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-03T18:57:09.907875] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FINV took 37.4s. Estimated remaining: 3h 34m 27s. Rate: 7.1 symbols/min [2025-10-03T18:57:10.064061] [DEBUG] [LOCAL ] FIHL: Primary data saved (40409 records). [2025-10-03T18:57:10.064188] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-03T18:57:10.064270] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FIHL took 42.6s. Estimated remaining: 3h 34m 4s. Rate: 7.2 symbols/min [2025-10-03T18:57:10.678102] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:57:10.690262] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-03T18:57:10.751488] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T18:57:11.190679] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-03T18:57:12.317596] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:57:12.333351] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-03T18:57:12.808022] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T18:57:12.816429] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-03T18:57:14.111760] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:57:14.124585] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-03T18:57:14.209274] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T18:57:14.390773] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-03T18:57:16.016880] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:57:16.029305] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-03T18:57:16.067067] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:57:16.076175] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-03T18:57:17.120304] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:57:17.127821] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-03T18:57:18.057903] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:57:18.070619] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-03T18:57:18.089071] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T18:57:18.390746] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-03T18:57:19.702324] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:57:19.705104] [INFO ] [REMOTE ] FIS: Full fetch complete (77185 records). [2025-10-03T18:57:19.705241] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-03T18:57:20.025738] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:57:20.061820] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-03T18:57:20.166778] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-03T18:57:20.166873] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-03T18:57:20.167754] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-03T18:57:20.167822] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-03T18:57:20.169395] [DEBUG] [LOCAL ] FIS: Trimmed 77185 records to 54138 (keeping 200 days of data) [2025-10-03T18:57:20.516532] [DEBUG] [LOCAL ] FIS: Primary data saved (54138 records). [2025-10-03T18:57:20.516716] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-03T18:57:20.516830] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIS took 27.5s. Estimated remaining: 3h 33m 59s. Rate: 7.2 symbols/min [2025-10-03T18:57:21.804149] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:57:21.810916] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-03T18:57:23.129584] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:57:23.136674] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-03T18:57:24.366032] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:57:24.367784] [INFO ] [REMOTE ] FIX: Full fetch complete (45446 records). [2025-10-03T18:57:24.367868] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-03T18:57:24.773772] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-03T18:57:24.773866] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-03T18:57:24.774562] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-03T18:57:24.774611] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-03T18:57:24.775896] [DEBUG] [LOCAL ] FIX: Trimmed 45446 records to 30134 (keeping 200 days of data) [2025-10-03T18:57:24.975555] [DEBUG] [LOCAL ] FIX: Primary data saved (30134 records). [2025-10-03T18:57:24.975754] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-03T18:57:24.975861] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIX took 21.8s. Estimated remaining: 3h 33m 44s. Rate: 7.2 symbols/min [2025-10-03T18:57:25.602743] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.656274] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-03T18:57:25.666713] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-03T18:57:25.740850] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-03T18:57:25.739211] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.740526] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.747929] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-03T18:57:25.763813] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-03T18:57:25.768052] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.768164] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-03T18:57:25.879946] [DEBUG] [LOCAL ] FLC: Loaded 5441 existing records from primary storage. [2025-10-03T18:57:25.892358] [INFO ] [MAIN ] FLC: Loaded 5441 existing records. [2025-10-03T18:57:26.092739] [DEBUG] [LOCAL ] FLNG: Loaded 33928 existing records from primary storage. [2025-10-03T18:57:26.138006] [INFO ] [MAIN ] FLNG: Loaded 33928 existing records. [2025-10-03T18:57:26.152180] [DEBUG] [LOCAL ] FLG: Loaded 53710 existing records from primary storage. [2025-10-03T18:57:26.236124] [INFO ] [MAIN ] FLG: Loaded 53710 existing records. [2025-10-03T18:57:26.382719] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.435788] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-03T18:57:26.508503] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-03T18:57:26.562832] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-03T18:57:26.582954] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-03T18:57:26.880479] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.856522] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:26.914520] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-03T18:57:26.927785] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-03T18:57:26.958761] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.959238] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-03T18:57:26.986430] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-03T18:57:26.986566] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-03T18:57:27.002634] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-03T18:57:27.007915] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-03T18:57:27.041637] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-03T18:57:27.142438] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-03T18:57:27.186127] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:57:27.238048] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-03T18:57:27.238180] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:57:27.238226] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-03T18:57:27.238263] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:57:27.357627] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-03T18:57:27.406438] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-03T18:57:27.486910] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-03T18:57:27.570853] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-03T18:57:27.666344] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-03T18:57:27.759527] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:27.815363] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-03T18:57:28.157373] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.209804] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:28.231557] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-03T18:57:28.272397] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.274302] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-03T18:57:28.331136] [DEBUG] [LOCAL ] FLO: Loaded 52293 existing records from primary storage. [2025-10-03T18:57:28.331478] [INFO ] [MAIN ] FLO: Loaded 52293 existing records. [2025-10-03T18:57:28.444939] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:57:28.463488] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-03T18:57:28.531799] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:28.532031] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-03T18:57:28.532084] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-03T18:57:28.534477] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-03T18:57:28.534565] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-03T18:57:28.907747] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.908063] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-03T18:57:29.149771] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T18:57:29.151596] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-03T18:57:29.675507] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:57:29.683832] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-03T18:57:29.700257] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T18:57:29.702348] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-03T18:57:30.025954] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:57:30.037431] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-03T18:57:30.383380] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T18:57:30.385434] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-03T18:57:30.672183] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:57:30.683440] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-03T18:57:30.802161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T18:57:31.056474] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:57:31.190704] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-03T18:57:31.868170] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:57:31.990730] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-03T18:57:32.305896] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:57:32.474602] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:57:32.564816] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:57:32.790728] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-03T18:57:33.373893] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:57:33.590718] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-03T18:57:34.390701] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-03T18:57:35.190704] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-03T18:57:35.224923] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:57:35.990633] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-03T18:57:36.248511] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T18:57:36.611587] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T18:57:36.639862] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T18:57:36.790685] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-03T18:57:37.274099] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T18:57:37.590689] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-03T18:57:38.390684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-03T18:57:39.190705] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-03T18:57:39.437094] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:57:39.754800] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:57:39.990677] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-03T18:57:40.080538] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:57:40.790739] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-03T18:57:41.590685] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-03T18:57:41.784553] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:57:42.149437] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:57:42.390729] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-03T18:57:43.190637] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-03T18:57:43.271783] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:57:43.672956] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:57:43.673874] [INFO ] [REMOTE ] FLC: Full fetch complete (7928 records). [2025-10-03T18:57:43.673968] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-03T18:57:43.991801] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-03T18:57:44.085322] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-03T18:57:44.085429] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-03T18:57:44.085837] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-03T18:57:44.085956] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-03T18:57:44.086813] [DEBUG] [LOCAL ] FLC: Trimmed 7928 records to 5459 (keeping 200 days of data) [2025-10-03T18:57:44.123996] [DEBUG] [LOCAL ] FLC: Primary data saved (5459 records). [2025-10-03T18:57:44.124140] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-03T18:57:44.124246] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLC took 19.1s. Estimated remaining: 3h 33m 31s. Rate: 7.2 symbols/min [2025-10-03T18:57:44.270218] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:57:44.354196] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:44.354369] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-03T18:57:44.354408] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-03T18:57:44.354518] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-03T18:57:44.354561] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-03T18:57:44.354603] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-03T18:57:44.354679] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-03T18:57:44.729986] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:44.790676] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-03T18:57:44.997777] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:57:44.998180] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-03T18:57:44.998308] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:57:44.998417] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-03T18:57:44.998502] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:57:44.998594] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-03T18:57:44.998770] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-03T18:57:44.998843] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-03T18:57:44.998911] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-03T18:57:44.999019] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 33m 9s. Rate: 7.2 symbols/min [2025-10-03T18:57:45.193956] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:45.255217] [DEBUG] [LOCAL ] FLR: Loaded 53509 existing records from primary storage. [2025-10-03T18:57:45.255579] [INFO ] [MAIN ] FLR: Loaded 53509 existing records. [2025-10-03T18:57:45.461450] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:45.461970] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-03T18:57:45.462094] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-03T18:57:45.464567] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-03T18:57:45.464781] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-03T18:57:45.596935] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-03T18:57:45.693428] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:57:45.915018] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:46.390697] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-03T18:57:47.053377] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:57:47.190684] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-03T18:57:47.950879] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T18:57:47.990680] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-03T18:57:48.790636] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-03T18:57:48.970308] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:57:49.377571] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:57:49.590688] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-03T18:57:50.390735] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-03T18:57:50.638389] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:57:51.072066] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T18:57:51.190731] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-03T18:57:51.990697] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-03T18:57:52.220350] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:57:52.749250] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:57:52.790706] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-03T18:57:53.590739] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-03T18:57:53.650089] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:57:54.289308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:57:54.390688] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-03T18:57:55.190696] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-03T18:57:55.278664] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:57:55.826159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T18:57:55.990724] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-03T18:57:56.790628] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-03T18:57:57.062259] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:57:57.164883] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:57:57.166912] [INFO ] [REMOTE ] FLNG: Full fetch complete (50613 records). [2025-10-03T18:57:57.167042] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-03T18:57:57.594381] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-03T18:57:57.595681] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-03T18:57:57.595781] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-03T18:57:57.596710] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-03T18:57:57.596899] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-03T18:57:57.598187] [DEBUG] [LOCAL ] FLNG: Trimmed 50613 records to 34143 (keeping 200 days of data) [2025-10-03T18:57:57.818590] [DEBUG] [LOCAL ] FLNG: Primary data saved (34143 records). [2025-10-03T18:57:57.818772] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-03T18:57:57.818867] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLNG took 32.8s. Estimated remaining: 3h 33m 9s. Rate: 7.2 symbols/min [2025-10-03T18:57:58.006671] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:58.057734] [DEBUG] [LOCAL ] FLS: Loaded 50554 existing records from primary storage. [2025-10-03T18:57:58.058089] [INFO ] [MAIN ] FLS: Loaded 50554 existing records. [2025-10-03T18:57:58.248940] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:58.249153] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-03T18:57:58.249203] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-03T18:57:58.251264] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-03T18:57:58.251333] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-03T18:57:58.406514] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-03T18:57:58.685247] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:59.183016] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-03T18:57:59.194687] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-03T18:57:59.279918] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:57:59.990631] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-03T18:58:00.313897] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:58:00.611543] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:58:00.790728] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-03T18:58:01.357749] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:58:01.360966] [INFO ] [REMOTE ] FLG: Full fetch complete (77309 records). [2025-10-03T18:58:01.361245] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-03T18:58:01.595959] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-03T18:58:01.925732] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-03T18:58:01.925838] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-03T18:58:01.926794] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-03T18:58:01.926869] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-03T18:58:01.928948] [DEBUG] [LOCAL ] FLG: Trimmed 77309 records to 54100 (keeping 200 days of data) [2025-10-03T18:58:02.314769] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:58:02.338005] [DEBUG] [LOCAL ] FLG: Primary data saved (54100 records). [2025-10-03T18:58:02.338161] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-03T18:58:02.340188] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLG took 37.4s. Estimated remaining: 3h 32m 54s. Rate: 7.2 symbols/min [2025-10-03T18:58:02.402639] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-03T18:58:02.553945] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:02.612669] [DEBUG] [LOCAL ] FLUT: Loaded 51173 existing records from primary storage. [2025-10-03T18:58:02.613045] [INFO ] [MAIN ] FLUT: Loaded 51173 existing records. [2025-10-03T18:58:02.802405] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:02.802620] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-03T18:58:02.802700] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-03T18:58:02.804321] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-03T18:58:02.804387] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-03T18:58:03.192252] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-03T18:58:03.214754] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:03.474471] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T18:58:03.947949] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:58:03.990718] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-03T18:58:04.664815] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:58:04.790691] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-03T18:58:05.590629] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-03T18:58:05.658184] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:58:06.390693] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-03T18:58:06.548555] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:58:07.165950] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:58:07.168583] [INFO ] [REMOTE ] FLO: Full fetch complete (75010 records). [2025-10-03T18:58:07.168733] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-03T18:58:07.202896] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-03T18:58:07.619753] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-03T18:58:07.619979] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-03T18:58:07.621138] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-03T18:58:07.621218] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-03T18:58:07.622877] [DEBUG] [LOCAL ] FLO: Trimmed 75010 records to 52669 (keeping 200 days of data) [2025-10-03T18:58:07.959259] [DEBUG] [LOCAL ] FLO: Primary data saved (52669 records). [2025-10-03T18:58:07.959441] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-03T18:58:07.959587] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLO took 40.2s. Estimated remaining: 3h 32m 40s. Rate: 7.2 symbols/min [2025-10-03T18:58:08.007211] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-03T18:58:08.155675] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:08.190168] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:58:08.217017] [DEBUG] [LOCAL ] FLXR: Loaded 20621 existing records from primary storage. [2025-10-03T18:58:08.217291] [INFO ] [MAIN ] FLXR: Loaded 20621 existing records. [2025-10-03T18:58:08.416438] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:08.416689] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-03T18:58:08.416750] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-03T18:58:08.417745] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-03T18:58:08.417811] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-03T18:58:08.795880] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-03T18:58:08.837872] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:09.100558] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:58:09.590676] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-03T18:58:09.736482] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:58:10.327105] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T18:58:10.390690] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-03T18:58:10.477323] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:58:11.132812] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:58:11.190708] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-03T18:58:11.990738] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-03T18:58:12.740512] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T18:58:12.790692] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-03T18:58:13.126427] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:58:13.590704] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-03T18:58:14.390686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-03T18:58:14.425952] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:58:14.616550] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:58:15.190718] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-03T18:58:15.990699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-03T18:58:16.256697] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:58:16.375175] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T18:58:16.790759] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-03T18:58:17.590733] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-03T18:58:17.740595] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:58:18.029138] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T18:58:18.390739] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-03T18:58:19.190700] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-03T18:58:19.472521] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T18:58:19.475020] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:58:19.990702] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-03T18:58:20.742608] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T18:58:20.790719] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-03T18:58:21.585799] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:58:21.588633] [INFO ] [REMOTE ] FLR: Full fetch complete (76472 records). [2025-10-03T18:58:21.588792] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-03T18:58:21.595756] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-03T18:58:22.076187] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-03T18:58:22.076321] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-03T18:58:22.077373] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-03T18:58:22.077466] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-03T18:58:22.079550] [DEBUG] [LOCAL ] FLR: Trimmed 76472 records to 53897 (keeping 200 days of data) [2025-10-03T18:58:22.395431] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-03T18:58:22.424565] [DEBUG] [LOCAL ] FLR: Primary data saved (53897 records). [2025-10-03T18:58:22.424779] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-03T18:58:22.424907] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLR took 37.4s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-10-03T18:58:22.631315] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:22.675767] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:58:22.687410] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T18:58:22.748777] [DEBUG] [LOCAL ] FMC: Loaded 52171 existing records from primary storage. [2025-10-03T18:58:22.749129] [INFO ] [MAIN ] FMC: Loaded 52171 existing records. [2025-10-03T18:58:22.953428] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:22.953668] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-03T18:58:22.953736] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-03T18:58:22.956444] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-03T18:58:22.956517] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-03T18:58:23.195878] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-03T18:58:23.349873] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:23.990637] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-03T18:58:24.048225] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:58:24.790732] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-03T18:58:24.968160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T18:58:25.022318] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:58:25.590710] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-03T18:58:26.390671] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-03T18:58:26.656014] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T18:58:27.190730] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-03T18:58:27.441745] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:58:27.554569] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:58:27.990701] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-03T18:58:28.711704] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:58:28.744459] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:58:28.746186] [INFO ] [REMOTE ] FLXR: Full fetch complete (25826 records). [2025-10-03T18:58:28.746268] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-03T18:58:28.795871] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-03T18:58:29.149371] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-03T18:58:29.149473] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-03T18:58:29.149978] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-03T18:58:29.150042] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-03T18:58:29.150778] [DEBUG] [LOCAL ] FLXR: Trimmed 25826 records to 20820 (keeping 200 days of data) [2025-10-03T18:58:29.282027] [DEBUG] [LOCAL ] FLXR: Primary data saved (20820 records). [2025-10-03T18:58:29.282151] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-03T18:58:29.282252] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLXR took 21.3s. Estimated remaining: 3h 32m 32s. Rate: 7.2 symbols/min [2025-10-03T18:58:29.476855] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:29.485121] [DEBUG] [LOCAL ] FMN: Loaded 5624 existing records from primary storage. [2025-10-03T18:58:29.485338] [INFO ] [MAIN ] FMN: Loaded 5624 existing records. [2025-10-03T18:58:29.598101] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-03T18:58:29.689608] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:29.689848] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-03T18:58:29.689901] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-03T18:58:29.690243] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-03T18:58:29.690308] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-03T18:58:30.087104] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:30.390732] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-03T18:58:30.526389] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T18:58:31.142260] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T18:58:31.190699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-03T18:58:31.349846] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:58:31.990726] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-03T18:58:32.463160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:58:32.469844] [INFO ] [REMOTE ] FLS: Full fetch complete (71683 records). [2025-10-03T18:58:32.469969] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-03T18:58:32.792425] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-03T18:58:32.894010] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-03T18:58:32.894107] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-03T18:58:32.895062] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-03T18:58:32.895142] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-03T18:58:32.896773] [DEBUG] [LOCAL ] FLS: Trimmed 71683 records to 50938 (keeping 200 days of data) [2025-10-03T18:58:33.236837] [DEBUG] [LOCAL ] FLS: Primary data saved (50938 records). [2025-10-03T18:58:33.236981] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-03T18:58:33.237103] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLS took 35.4s. Estimated remaining: 3h 32m 15s. Rate: 7.2 symbols/min [2025-10-03T18:58:33.434880] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:33.466399] [DEBUG] [LOCAL ] FMS: Loaded 30247 existing records from primary storage. [2025-10-03T18:58:33.466795] [INFO ] [MAIN ] FMS: Loaded 30247 existing records. [2025-10-03T18:58:33.595534] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-03T18:58:33.646396] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:58:33.740437] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:33.740692] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-03T18:58:33.740753] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-03T18:58:33.741777] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-03T18:58:33.741840] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-03T18:58:34.149298] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:34.349470] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:58:34.381022] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:58:34.390605] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-03T18:58:35.130228] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:58:35.190714] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-03T18:58:35.990711] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-03T18:58:36.033316] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T18:58:36.790736] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-03T18:58:37.590739] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-03T18:58:37.950666] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T18:58:38.390712] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-03T18:58:38.532003] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:58:38.864263] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:58:39.176338] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:58:39.190617] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-03T18:58:39.785799] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:58:39.990732] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-03T18:58:40.790706] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-03T18:58:41.199178] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:58:41.590733] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-03T18:58:42.390729] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-03T18:58:42.618453] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:58:42.980352] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:58:43.190724] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-03T18:58:43.414468] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:58:43.990723] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-03T18:58:44.790635] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-03T18:58:45.044381] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:58:45.558974] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T18:58:45.590668] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-03T18:58:45.898743] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:58:46.263871] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T18:58:46.390696] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-03T18:58:47.190724] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-03T18:58:47.615185] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T18:58:47.990702] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-03T18:58:48.473554] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T18:58:48.790754] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-03T18:58:49.377529] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T18:58:49.465079] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:58:49.590745] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-03T18:58:50.195121] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:58:50.390702] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-03T18:58:50.903451] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:58:50.904360] [INFO ] [REMOTE ] FMN: Full fetch complete (9937 records). [2025-10-03T18:58:50.904444] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-03T18:58:51.195872] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-03T18:58:51.316839] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-03T18:58:51.316946] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-03T18:58:51.317230] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-03T18:58:51.317278] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-03T18:58:51.317761] [DEBUG] [LOCAL ] FMN: Trimmed 9937 records to 5644 (keeping 200 days of data) [2025-10-03T18:58:51.354581] [DEBUG] [LOCAL ] FMN: Primary data saved (5644 records). [2025-10-03T18:58:51.354729] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-03T18:58:51.354823] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FMN took 22.1s. Estimated remaining: 3h 32m 24s. Rate: 7.2 symbols/min [2025-10-03T18:58:51.542375] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:51.589379] [DEBUG] [LOCAL ] FMX: Loaded 40981 existing records from primary storage. [2025-10-03T18:58:51.589784] [INFO ] [MAIN ] FMX: Loaded 40981 existing records. [2025-10-03T18:58:51.784742] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:51.784982] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-03T18:58:51.785031] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-03T18:58:51.787051] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-03T18:58:51.787124] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-03T18:58:51.995796] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-03T18:58:52.196013] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:52.787684] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:58:52.790633] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-03T18:58:52.790871] [INFO ] [REMOTE ] FLUT: Full fetch complete (72921 records). [2025-10-03T18:58:52.791169] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-03T18:58:53.262804] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-03T18:58:53.262938] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-03T18:58:53.264588] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-03T18:58:53.264743] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-03T18:58:53.266983] [DEBUG] [LOCAL ] FLUT: Trimmed 72921 records to 51557 (keeping 200 days of data) [2025-10-03T18:58:53.590971] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-03T18:58:53.721722] [DEBUG] [LOCAL ] FLUT: Primary data saved (51557 records). [2025-10-03T18:58:53.721931] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-03T18:58:53.722059] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FLUT took 51.4s. Estimated remaining: 3h 32m 5s. Rate: 7.2 symbols/min [2025-10-03T18:58:53.882279] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:58:54.049805] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:54.053206] [DEBUG] [LOCAL ] FMY: Loaded 1399 existing records from primary storage. [2025-10-03T18:58:54.053394] [INFO ] [MAIN ] FMY: Loaded 1399 existing records. [2025-10-03T18:58:54.315735] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:54.316313] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-03T18:58:54.316501] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-03T18:58:54.317003] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-03T18:58:54.317086] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-03T18:58:54.395970] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-03T18:58:54.772747] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:58:54.816832] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:54.877972] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:58:55.190704] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-03T18:58:55.990715] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-03T18:58:56.182697] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:58:56.579272] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:58:56.610504] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T18:58:56.790699] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-03T18:58:57.590709] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-03T18:58:58.048146] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:58:58.390702] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-03T18:58:58.932981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:58:59.190707] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-03T18:58:59.990631] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-03T18:59:00.068552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:59:00.197788] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:59:00.790707] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-03T18:59:01.534416] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:59:01.590721] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-03T18:59:02.101173] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:59:02.390721] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-03T18:59:03.137114] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:59:03.140025] [INFO ] [REMOTE ] FMC: Full fetch complete (75115 records). [2025-10-03T18:59:03.140160] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-03T18:59:03.201486] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-03T18:59:03.581614] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-03T18:59:03.581851] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-03T18:59:03.583139] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-03T18:59:03.583218] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-03T18:59:03.584878] [DEBUG] [LOCAL ] FMC: Trimmed 75115 records to 52558 (keeping 200 days of data) [2025-10-03T18:59:03.823382] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:59:03.953824] [DEBUG] [LOCAL ] FMC: Primary data saved (52558 records). [2025-10-03T18:59:03.953986] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-03T18:59:03.954132] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMC took 41.5s. Estimated remaining: 3h 32m 0s. Rate: 7.2 symbols/min [2025-10-03T18:59:04.000789] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-03T18:59:04.142884] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:04.182543] [DEBUG] [LOCAL ] FN: Loaded 38785 existing records from primary storage. [2025-10-03T18:59:04.182881] [INFO ] [MAIN ] FN: Loaded 38785 existing records. [2025-10-03T18:59:04.380474] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:04.380781] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-03T18:59:04.380849] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-03T18:59:04.382379] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-03T18:59:04.382444] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-03T18:59:04.795784] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-03T18:59:04.802218] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:04.868292] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:59:05.122421] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:59:05.124926] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:59:05.127981] [INFO ] [REMOTE ] FMS: Full fetch complete (42413 records). [2025-10-03T18:59:05.128087] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-03T18:59:05.550271] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-03T18:59:05.550579] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-03T18:59:05.551282] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-03T18:59:05.551350] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-03T18:59:05.552434] [DEBUG] [LOCAL ] FMS: Trimmed 42413 records to 30400 (keeping 200 days of data) [2025-10-03T18:59:05.605482] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-03T18:59:05.743572] [DEBUG] [LOCAL ] FMS: Primary data saved (30400 records). [2025-10-03T18:59:05.743757] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-03T18:59:05.743907] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMS took 32.5s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-03T18:59:05.926948] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:05.981854] [DEBUG] [LOCAL ] FNB: Loaded 52848 existing records from primary storage. [2025-10-03T18:59:05.982223] [INFO ] [MAIN ] FNB: Loaded 52848 existing records. [2025-10-03T18:59:06.176757] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:06.177050] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-03T18:59:06.177102] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-03T18:59:06.180471] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-03T18:59:06.180537] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-03T18:59:06.397040] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-03T18:59:06.566581] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:07.120567] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:59:07.190676] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-03T18:59:07.611060] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T18:59:07.923502] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:59:07.990726] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-03T18:59:08.790681] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-03T18:59:09.590725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-03T18:59:09.643503] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:59:10.191307] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:59:10.230442] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:59:10.390702] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-03T18:59:11.190725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-03T18:59:11.606144] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T18:59:11.990715] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-03T18:59:12.135050] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T18:59:12.790725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-03T18:59:13.143856] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T18:59:13.343973] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T18:59:13.590729] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-03T18:59:14.390717] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-03T18:59:14.750188] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-03T18:59:15.157039] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:59:15.190676] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-03T18:59:15.991847] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-03T18:59:16.790727] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-03T18:59:17.033931] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:59:17.117262] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T18:59:17.227952] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T18:59:17.590722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-03T18:59:18.390727] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-03T18:59:19.124967] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T18:59:19.190675] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-03T18:59:19.957629] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:59:19.990624] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-03T18:59:20.775767] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T18:59:20.790617] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-03T18:59:21.590692] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-03T18:59:21.836889] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:59:22.129558] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:59:22.390750] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-03T18:59:23.142847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:59:23.190697] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-03T18:59:23.990668] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-03T18:59:24.241002] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:59:24.301936] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:59:24.340351] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:59:24.790759] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-03T18:59:25.590720] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-03T18:59:26.031703] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:59:26.390726] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-03T18:59:26.498421] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:59:27.190688] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-03T18:59:27.828724] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:59:27.990683] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-03T18:59:28.790633] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-03T18:59:28.868256] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:59:29.170963] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T18:59:29.204248] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T18:59:29.204949] [INFO ] [REMOTE ] FMY: Full fetch complete (1968 records). [2025-10-03T18:59:29.205020] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-03T18:59:29.604377] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-03T18:59:29.613970] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-03T18:59:29.614039] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-03T18:59:29.614152] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-03T18:59:29.614197] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-03T18:59:29.614899] [DEBUG] [LOCAL ] FMY: Trimmed 1968 records to 1401 (keeping 200 days of data) [2025-10-03T18:59:29.625329] [DEBUG] [LOCAL ] FMY: Primary data saved (1401 records). [2025-10-03T18:59:29.625446] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-03T18:59:29.625555] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMY took 35.9s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-03T18:59:29.817635] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:29.881011] [DEBUG] [LOCAL ] FND: Loaded 52478 existing records from primary storage. [2025-10-03T18:59:29.881386] [INFO ] [MAIN ] FND: Loaded 52478 existing records. [2025-10-03T18:59:30.069277] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:30.069510] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-03T18:59:30.069561] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-03T18:59:30.071093] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-03T18:59:30.071157] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-03T18:59:30.404902] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-03T18:59:30.449016] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:30.992081] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:59:30.995142] [INFO ] [REMOTE ] FMX: Full fetch complete (57818 records). [2025-10-03T18:59:30.995236] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-03T18:59:31.199321] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-03T18:59:31.406252] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-03T18:59:31.406336] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-03T18:59:31.407067] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-03T18:59:31.407132] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-03T18:59:31.408498] [DEBUG] [LOCAL ] FMX: Trimmed 57818 records to 41194 (keeping 200 days of data) [2025-10-03T18:59:31.675378] [DEBUG] [LOCAL ] FMX: Primary data saved (41194 records). [2025-10-03T18:59:31.675511] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-03T18:59:31.677001] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FMX took 40.3s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-03T18:59:31.898312] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:31.922012] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T18:59:31.982591] [DEBUG] [LOCAL ] FNF: Loaded 49364 existing records from primary storage. [2025-10-03T18:59:31.982949] [INFO ] [MAIN ] FNF: Loaded 49364 existing records. [2025-10-03T18:59:31.990668] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-03T18:59:32.176337] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:32.176637] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-03T18:59:32.176725] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-03T18:59:32.178170] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-03T18:59:32.178232] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-03T18:59:32.569562] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:32.790734] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-03T18:59:32.993792] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:59:33.274633] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:59:33.276449] [INFO ] [REMOTE ] FN: Full fetch complete (56283 records). [2025-10-03T18:59:33.276553] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-03T18:59:33.595839] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-03T18:59:33.702731] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-03T18:59:33.702852] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-03T18:59:33.704130] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-03T18:59:33.704208] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-03T18:59:33.705991] [DEBUG] [LOCAL ] FN: Trimmed 56283 records to 39003 (keeping 200 days of data) [2025-10-03T18:59:33.952056] [DEBUG] [LOCAL ] FN: Primary data saved (39003 records). [2025-10-03T18:59:33.952212] [INFO ] [MAIN ] FN: Full history saved. [2025-10-03T18:59:33.952298] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FN took 30.0s. Estimated remaining: 3h 31m 20s. Rate: 7.2 symbols/min [2025-10-03T18:59:34.134446] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:34.181576] [DEBUG] [LOCAL ] FNV: Loaded 46489 existing records from primary storage. [2025-10-03T18:59:34.181934] [INFO ] [MAIN ] FNV: Loaded 46489 existing records. [2025-10-03T18:59:34.377684] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:34.378019] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-03T18:59:34.378158] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-03T18:59:34.388210] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-03T18:59:34.394247] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-03T18:59:34.394088] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-03T18:59:34.471829] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T18:59:34.814246] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:35.190693] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-03T18:59:35.351585] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:59:35.990671] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-03T18:59:36.075034] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T18:59:36.739585] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:59:36.790629] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-03T18:59:37.591524] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-03T18:59:37.591433] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T18:59:38.390710] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-03T18:59:38.490256] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:59:39.167080] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T18:59:39.190678] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-03T18:59:39.990695] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-03T18:59:40.178986] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:59:40.800124] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-03T18:59:40.826799] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:59:41.550745] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:59:41.590611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-03T18:59:42.390679] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-03T18:59:42.488110] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:59:43.116969] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:59:43.190628] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-03T18:59:43.990677] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-03T18:59:44.183960] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:59:44.790723] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-03T18:59:44.934031] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:59:45.420885] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T18:59:45.590735] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-03T18:59:46.353175] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:59:46.390739] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-03T18:59:47.123554] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T18:59:47.126329] [INFO ] [REMOTE ] FNB: Full fetch complete (75870 records). [2025-10-03T18:59:47.126491] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-03T18:59:47.201721] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-03T18:59:47.556334] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-03T18:59:47.556426] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-03T18:59:47.557387] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-03T18:59:47.557458] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-03T18:59:47.559144] [DEBUG] [LOCAL ] FNB: Trimmed 75870 records to 53238 (keeping 200 days of data) [2025-10-03T18:59:47.900124] [DEBUG] [LOCAL ] FNB: Primary data saved (53238 records). [2025-10-03T18:59:47.900278] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-03T18:59:47.900681] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FNB took 42.2s. Estimated remaining: 3h 31m 22s. Rate: 7.2 symbols/min [2025-10-03T18:59:47.998118] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-03T18:59:48.090026] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:48.125732] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T18:59:48.141766] [DEBUG] [LOCAL ] FOA: Loaded 13189 existing records from primary storage. [2025-10-03T18:59:48.142114] [INFO ] [MAIN ] FOA: Loaded 13189 existing records. [2025-10-03T18:59:48.331741] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:48.331980] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-03T18:59:48.332038] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-03T18:59:48.332597] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-03T18:59:48.332705] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-03T18:59:48.711517] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:48.790634] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-03T18:59:49.556990] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T18:59:49.590707] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-03T18:59:49.844147] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:59:49.890440] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T18:59:50.390706] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-03T18:59:51.117037] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T18:59:51.190690] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-03T18:59:51.543215] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:59:51.990717] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-03T18:59:52.790631] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-03T18:59:52.912705] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T18:59:52.973721] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T18:59:53.590705] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-03T18:59:54.171052] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:59:54.390732] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-03T18:59:55.193219] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-03T18:59:55.200700] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T18:59:55.719256] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:59:55.990755] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-03T18:59:56.790701] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-03T18:59:56.865625] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:59:57.590722] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-03T18:59:57.683895] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:59:58.390633] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-03T18:59:58.491701] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:59:58.672248] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T18:59:59.190708] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-03T18:59:59.961636] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:59:59.990637] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-03T19:00:00.790635] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-03T19:00:00.878177] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:00:01.420886] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:00:01.423858] [INFO ] [REMOTE ] FNF: Full fetch complete (69673 records). [2025-10-03T19:00:01.424049] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-03T19:00:01.600948] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-03T19:00:01.990728] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-03T19:00:01.990956] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-03T19:00:01.992458] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-03T19:00:01.992636] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-03T19:00:01.994790] [DEBUG] [LOCAL ] FNF: Trimmed 69673 records to 49705 (keeping 200 days of data) [2025-10-03T19:00:02.126525] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:00:02.363232] [DEBUG] [LOCAL ] FNF: Primary data saved (49705 records). [2025-10-03T19:00:02.363438] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-03T19:00:02.364183] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FNF took 30.7s. Estimated remaining: 3h 31m 24s. Rate: 7.2 symbols/min [2025-10-03T19:00:02.395905] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-03T19:00:02.565791] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:02.578614] [DEBUG] [LOCAL ] FOF: Loaded 8487 existing records from primary storage. [2025-10-03T19:00:02.578882] [INFO ] [MAIN ] FOF: Loaded 8487 existing records. [2025-10-03T19:00:02.781797] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:02.781998] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-03T19:00:02.782048] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-03T19:00:02.782457] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-03T19:00:02.782518] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-03T19:00:03.178534] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:03.190609] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-03T19:00:03.412629] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:00:03.990669] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-03T19:00:04.028169] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:00:04.280776] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T19:00:04.790748] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-03T19:00:05.515166] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:00:05.517574] [INFO ] [REMOTE ] FNV: Full fetch complete (66339 records). [2025-10-03T19:00:05.517757] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-03T19:00:05.595929] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-03T19:00:05.952405] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-03T19:00:05.952508] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-03T19:00:05.953357] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-03T19:00:05.953474] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-03T19:00:05.955389] [DEBUG] [LOCAL ] FNV: Trimmed 66339 records to 46785 (keeping 200 days of data) [2025-10-03T19:00:06.262968] [DEBUG] [LOCAL ] FNV: Primary data saved (46785 records). [2025-10-03T19:00:06.263110] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-03T19:00:06.263214] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FNV took 32.3s. Estimated remaining: 3h 31m 8s. Rate: 7.2 symbols/min [2025-10-03T19:00:06.393677] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-03T19:00:06.467838] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:06.490254] [DEBUG] [LOCAL ] FOR: Loaded 19927 existing records from primary storage. [2025-10-03T19:00:06.490538] [INFO ] [MAIN ] FOR: Loaded 19927 existing records. [2025-10-03T19:00:06.626304] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T19:00:06.721056] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:06.721347] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-03T19:00:06.721541] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-03T19:00:06.737619] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-03T19:00:06.759178] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-03T19:00:06.838916] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T19:00:07.168095] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:07.190638] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-03T19:00:07.221491] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:00:07.958945] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:00:07.990711] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-03T19:00:08.790686] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-03T19:00:09.049509] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T19:00:09.590743] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-03T19:00:10.171545] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:00:10.174226] [INFO ] [REMOTE ] FND: Full fetch complete (74640 records). [2025-10-03T19:00:10.174357] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-03T19:00:10.398515] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-03T19:00:10.605075] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-03T19:00:10.605162] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-03T19:00:10.606121] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-03T19:00:10.606207] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-03T19:00:10.607785] [DEBUG] [LOCAL ] FND: Trimmed 74640 records to 52854 (keeping 200 days of data) [2025-10-03T19:00:10.925613] [DEBUG] [LOCAL ] FND: Primary data saved (52854 records). [2025-10-03T19:00:10.925852] [INFO ] [MAIN ] FND: Full history saved. [2025-10-03T19:00:10.926038] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FND took 41.3s. Estimated remaining: 3h 30m 53s. Rate: 7.2 symbols/min [2025-10-03T19:00:11.114092] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T19:00:11.147561] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:11.195115] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-03T19:00:11.197058] [DEBUG] [LOCAL ] FOUR: Loaded 49921 existing records from primary storage. [2025-10-03T19:00:11.197416] [INFO ] [MAIN ] FOUR: Loaded 49921 existing records. [2025-10-03T19:00:11.366059] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T19:00:11.426856] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:11.427090] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-03T19:00:11.427141] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-03T19:00:11.428493] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-03T19:00:11.428556] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-03T19:00:11.832028] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:11.990699] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-03T19:00:12.377909] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T19:00:12.790694] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-03T19:00:12.935942] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:00:13.590729] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-03T19:00:14.061322] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:00:14.390734] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-03T19:00:15.190663] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-03T19:00:15.270614] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:00:15.717277] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:00:15.912938] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:00:15.990710] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-03T19:00:16.789451] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:00:16.792460] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-03T19:00:17.590742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-03T19:00:17.903847] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:00:18.390738] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-03T19:00:18.904393] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T19:00:19.190623] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-03T19:00:19.275957] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:00:19.990701] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-03T19:00:20.183434] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:00:20.790682] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-03T19:00:21.590696] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-03T19:00:21.796178] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:00:21.828503] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:00:22.390632] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-03T19:00:22.544740] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:00:22.825306] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T19:00:23.190699] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-03T19:00:23.990700] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-03T19:00:24.773010] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:00:24.774581] [INFO ] [REMOTE ] FOA: Full fetch complete (22315 records). [2025-10-03T19:00:24.774783] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-03T19:00:24.798707] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-03T19:00:25.137557] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:00:25.230843] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-03T19:00:25.230936] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-03T19:00:25.231379] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-03T19:00:25.231422] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-03T19:00:25.232044] [DEBUG] [LOCAL ] FOA: Trimmed 22315 records to 13268 (keeping 200 days of data) [2025-10-03T19:00:25.311975] [DEBUG] [LOCAL ] FOA: Primary data saved (13268 records). [2025-10-03T19:00:25.312152] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-03T19:00:25.312268] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FOA took 37.4s. Estimated remaining: 3h 30m 55s. Rate: 7.2 symbols/min [2025-10-03T19:00:25.500336] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:25.520335] [DEBUG] [LOCAL ] FPF: Loaded 18405 existing records from primary storage. [2025-10-03T19:00:25.520622] [INFO ] [MAIN ] FPF: Loaded 18405 existing records. [2025-10-03T19:00:25.595831] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-03T19:00:25.721572] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:25.721929] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-03T19:00:25.722047] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-03T19:00:25.723339] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-03T19:00:25.723403] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-03T19:00:26.001989] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T19:00:26.131626] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:26.390721] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-03T19:00:27.190636] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-03T19:00:27.379079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:00:27.562686] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:00:27.990697] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-03T19:00:28.174941] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:00:28.790731] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-03T19:00:28.968148] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:00:29.590714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-03T19:00:30.310258] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:00:30.390694] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-03T19:00:30.561497] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:00:31.188879] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T19:00:31.190249] [INFO ] [REMOTE ] FOR: Full fetch complete (29877 records). [2025-10-03T19:00:31.190334] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-03T19:00:31.195855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-03T19:00:31.589672] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-03T19:00:31.589807] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-03T19:00:31.590840] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-03T19:00:31.590926] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-03T19:00:31.592242] [DEBUG] [LOCAL ] FOR: Trimmed 29877 records to 20020 (keeping 200 days of data) [2025-10-03T19:00:31.725213] [DEBUG] [LOCAL ] FOR: Primary data saved (20020 records). [2025-10-03T19:00:31.725379] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-03T19:00:31.725491] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FOR took 25.5s. Estimated remaining: 3h 30m 43s. Rate: 7.2 symbols/min [2025-10-03T19:00:31.917192] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:31.937075] [DEBUG] [LOCAL ] FPH: Loaded 19546 existing records from primary storage. [2025-10-03T19:00:31.937355] [INFO ] [MAIN ] FPH: Loaded 19546 existing records. [2025-10-03T19:00:31.995877] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-03T19:00:32.136385] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:32.136662] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-03T19:00:32.136750] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-03T19:00:32.137457] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-03T19:00:32.137527] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-03T19:00:32.269787] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:00:32.555417] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:32.567189] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:00:32.790698] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-03T19:00:33.595721] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-03T19:00:33.600131] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T19:00:34.390722] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-03T19:00:35.190723] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-03T19:00:35.341524] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:00:35.429745] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T19:00:35.990735] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-03T19:00:36.358154] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:00:36.790709] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-03T19:00:36.810607] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:00:37.590746] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-03T19:00:37.826684] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T19:00:38.390759] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-03T19:00:39.194705] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-03T19:00:39.205494] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:00:39.382761] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:00:39.890546] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:00:39.891474] [INFO ] [REMOTE ] FOF: Full fetch complete (11872 records). [2025-10-03T19:00:39.891549] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-03T19:00:39.996762] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-03T19:00:40.298720] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-03T19:00:40.298816] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-03T19:00:40.299158] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-03T19:00:40.299200] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-03T19:00:40.299854] [DEBUG] [LOCAL ] FOF: Trimmed 11872 records to 8526 (keeping 200 days of data) [2025-10-03T19:00:40.356503] [DEBUG] [LOCAL ] FOF: Primary data saved (8526 records). [2025-10-03T19:00:40.356699] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-03T19:00:40.356822] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FOF took 38.0s. Estimated remaining: 3h 30m 35s. Rate: 7.2 symbols/min [2025-10-03T19:00:40.562383] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:40.603619] [DEBUG] [LOCAL ] FPI: Loaded 31264 existing records from primary storage. [2025-10-03T19:00:40.603934] [INFO ] [MAIN ] FPI: Loaded 31264 existing records. [2025-10-03T19:00:40.798969] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:40.794270] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-03T19:00:40.800117] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-03T19:00:40.800183] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-03T19:00:40.801286] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-03T19:00:40.801355] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-03T19:00:41.216510] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:41.313228] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:00:41.590627] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-03T19:00:41.827918] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:00:42.390708] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-03T19:00:42.597857] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:00:43.190735] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-03T19:00:43.368781] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:00:43.990666] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-03T19:00:44.280495] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T19:00:44.790666] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-03T19:00:45.055442] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T19:00:45.590682] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-03T19:00:45.658448] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T19:00:46.390707] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-03T19:00:47.002514] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:00:47.075748] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T19:00:47.190677] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-03T19:00:47.990701] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-03T19:00:48.119707] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T19:00:48.121480] [INFO ] [REMOTE ] FPF: Full fetch complete (26678 records). [2025-10-03T19:00:48.121619] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-03T19:00:48.541439] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-03T19:00:48.541524] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-03T19:00:48.542085] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-03T19:00:48.542152] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-03T19:00:48.542935] [DEBUG] [LOCAL ] FPF: Trimmed 26678 records to 18584 (keeping 200 days of data) [2025-10-03T19:00:48.663964] [DEBUG] [LOCAL ] FPF: Primary data saved (18584 records). [2025-10-03T19:00:48.664104] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-03T19:00:48.664218] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPF took 23.4s. Estimated remaining: 3h 30m 27s. Rate: 7.2 symbols/min [2025-10-03T19:00:48.795762] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-03T19:00:48.854639] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:48.906751] [DEBUG] [LOCAL ] FR: Loaded 46743 existing records from primary storage. [2025-10-03T19:00:48.907105] [INFO ] [MAIN ] FR: Loaded 46743 existing records. [2025-10-03T19:00:49.046021] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:00:49.118540] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:49.118801] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-03T19:00:49.118854] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-03T19:00:49.120104] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-03T19:00:49.120167] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-03T19:00:49.503447] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:49.590685] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-03T19:00:50.036735] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T19:00:50.390704] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-03T19:00:50.582380] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:00:51.190678] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-03T19:00:51.500067] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:00:51.990676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-03T19:00:52.382394] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T19:00:52.790687] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-03T19:00:53.242618] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:00:53.590786] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-03T19:00:54.390708] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-03T19:00:54.656849] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:00:55.016142] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:00:55.169041] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:00:55.190623] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-03T19:00:55.990686] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-03T19:00:56.570207] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:00:56.790716] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-03T19:00:57.590710] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-03T19:00:57.773953] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T19:00:57.850984] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:00:58.390684] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-03T19:00:58.909539] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T19:00:59.190693] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-03T19:00:59.990676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-03T19:01:00.055437] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:01:00.790689] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-03T19:01:01.042494] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:01:01.103140] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:01:01.590729] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-03T19:01:01.871442] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:01:01.874461] [INFO ] [REMOTE ] FPH: Full fetch complete (31357 records). [2025-10-03T19:01:01.874551] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-03T19:01:02.322196] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-03T19:01:02.322279] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-03T19:01:02.322866] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-03T19:01:02.322932] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-03T19:01:02.323765] [DEBUG] [LOCAL ] FPH: Trimmed 31357 records to 19674 (keeping 200 days of data) [2025-10-03T19:01:02.408130] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-03T19:01:02.443327] [DEBUG] [LOCAL ] FPH: Primary data saved (19674 records). [2025-10-03T19:01:02.443470] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-03T19:01:02.443558] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FPH took 30.7s. Estimated remaining: 3h 30m 28s. Rate: 7.2 symbols/min [2025-10-03T19:01:02.628798] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:02.644625] [DEBUG] [LOCAL ] FRA: Loaded 14628 existing records from primary storage. [2025-10-03T19:01:02.644888] [INFO ] [MAIN ] FRA: Loaded 14628 existing records. [2025-10-03T19:01:02.830858] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:02.831097] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-03T19:01:02.831154] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-03T19:01:02.831861] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-03T19:01:02.832103] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-03T19:01:03.195813] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-03T19:01:03.253873] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:03.557956] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T19:01:03.560838] [INFO ] [REMOTE ] FOUR: Full fetch complete (72027 records). [2025-10-03T19:01:03.561121] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-03T19:01:03.957887] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:01:03.997972] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-03T19:01:04.024008] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-03T19:01:04.025439] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-03T19:01:04.026406] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-03T19:01:04.026566] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-03T19:01:04.028013] [DEBUG] [LOCAL ] FOUR: Trimmed 72027 records to 50298 (keeping 200 days of data) [2025-10-03T19:01:04.345279] [DEBUG] [LOCAL ] FOUR: Primary data saved (50298 records). [2025-10-03T19:01:04.345436] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-03T19:01:04.345541] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FOUR took 53.4s. Estimated remaining: 3h 30m 8s. Rate: 7.2 symbols/min [2025-10-03T19:01:04.535961] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:04.556717] [DEBUG] [LOCAL ] FRGE: Loaded 17758 existing records from primary storage. [2025-10-03T19:01:04.557036] [INFO ] [MAIN ] FRGE: Loaded 17758 existing records. [2025-10-03T19:01:04.750184] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:04.750456] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-03T19:01:04.750561] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-03T19:01:04.751333] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-03T19:01:04.751395] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-03T19:01:04.794387] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-03T19:01:05.181314] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:01:05.222473] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:01:05.220415] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:05.590724] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-03T19:01:05.901222] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T19:01:06.390721] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-03T19:01:06.962445] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:01:07.190708] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-03T19:01:07.550305] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T19:01:07.990717] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-03T19:01:08.564563] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:01:08.790727] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-03T19:01:09.590724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-03T19:01:09.734422] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:01:10.026621] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:01:10.390622] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-03T19:01:10.790093] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:01:11.190756] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-03T19:01:11.959716] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:01:11.990633] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-03T19:01:12.009019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T19:01:12.790697] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-03T19:01:13.369330] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:01:13.590732] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-03T19:01:13.666172] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:01:13.667974] [INFO ] [REMOTE ] FPI: Full fetch complete (44314 records). [2025-10-03T19:01:13.668065] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-03T19:01:14.081902] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-03T19:01:14.081986] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-03T19:01:14.082721] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-03T19:01:14.082787] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-03T19:01:14.083867] [DEBUG] [LOCAL ] FPI: Trimmed 44314 records to 31480 (keeping 200 days of data) [2025-10-03T19:01:14.279894] [DEBUG] [LOCAL ] FPI: Primary data saved (31480 records). [2025-10-03T19:01:14.280036] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-03T19:01:14.281124] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FPI took 33.9s. Estimated remaining: 3h 30m 3s. Rate: 7.2 symbols/min [2025-10-03T19:01:14.395976] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-03T19:01:14.474336] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:14.528738] [DEBUG] [LOCAL ] FRO: Loaded 52117 existing records from primary storage. [2025-10-03T19:01:14.529064] [INFO ] [MAIN ] FRO: Loaded 52117 existing records. [2025-10-03T19:01:14.739733] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:14.740095] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-03T19:01:14.740292] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-03T19:01:14.741900] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-03T19:01:14.741964] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-03T19:01:15.191158] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:15.191319] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-03T19:01:15.193575] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:01:15.363867] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:01:15.990626] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-03T19:01:16.145891] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:01:16.790717] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-03T19:01:17.590683] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-03T19:01:17.697694] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:01:17.724133] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T19:01:18.390717] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-03T19:01:19.190688] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-03T19:01:19.473914] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T19:01:19.604428] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T19:01:19.990630] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-03T19:01:20.047476] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T19:01:20.669726] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T19:01:20.790724] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-03T19:01:21.590740] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-03T19:01:22.386754] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:01:22.399978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-03T19:01:23.190621] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-03T19:01:23.350377] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:01:23.690735] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T19:01:23.990739] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-03T19:01:24.543400] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:01:24.790706] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-03T19:01:24.971442] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:01:25.590682] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-03T19:01:25.868232] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:01:26.390727] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-03T19:01:27.190742] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-03T19:01:27.216440] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T19:01:27.459775] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:01:27.990688] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-03T19:01:28.593464] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:01:28.596146] [INFO ] [REMOTE ] FR: Full fetch complete (66739 records). [2025-10-03T19:01:28.596288] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-03T19:01:28.811946] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-03T19:01:29.034956] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-03T19:01:29.035055] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-03T19:01:29.036022] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-03T19:01:29.036094] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-03T19:01:29.037698] [DEBUG] [LOCAL ] FR: Trimmed 66739 records to 47072 (keeping 200 days of data) [2025-10-03T19:01:29.341880] [DEBUG] [LOCAL ] FR: Primary data saved (47072 records). [2025-10-03T19:01:29.342031] [INFO ] [MAIN ] FR: Full history saved. [2025-10-03T19:01:29.342131] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 40.7s. Estimated remaining: 3h 30m 6s. Rate: 7.1 symbols/min [2025-10-03T19:01:29.532720] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:29.532927] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-10-03T19:01:29.532984] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-10-03T19:01:29.533107] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-03T19:01:29.533284] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-03T19:01:29.533342] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-03T19:01:29.533381] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-03T19:01:29.608239] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-03T19:01:29.927722] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T19:01:29.973028] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:30.041415] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T19:01:30.390697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-03T19:01:30.629188] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T19:01:30.630346] [INFO ] [REMOTE ] FRGE: Full fetch complete (32274 records). [2025-10-03T19:01:30.630421] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-03T19:01:31.028016] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-03T19:01:31.028102] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-03T19:01:31.028706] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-03T19:01:31.028770] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-03T19:01:31.029486] [DEBUG] [LOCAL ] FRGE: Trimmed 32274 records to 17810 (keeping 200 days of data) [2025-10-03T19:01:31.147559] [DEBUG] [LOCAL ] FRGE: Primary data saved (17810 records). [2025-10-03T19:01:31.147806] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-03T19:01:31.147938] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRGE took 26.8s. Estimated remaining: 3h 29m 46s. Rate: 7.2 symbols/min [2025-10-03T19:01:31.195765] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-03T19:01:31.361272] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:31.408305] [DEBUG] [LOCAL ] FSCO: Loaded 37913 existing records from primary storage. [2025-10-03T19:01:31.408963] [INFO ] [MAIN ] FSCO: Loaded 37913 existing records. [2025-10-03T19:01:31.610793] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:31.611178] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-03T19:01:31.611252] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-03T19:01:31.611936] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-03T19:01:31.612011] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-03T19:01:32.005456] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-03T19:01:32.011974] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:32.035575] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:01:32.790707] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-03T19:01:32.976492] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T19:01:33.234731] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:01:33.590701] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-03T19:01:34.367407] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:01:34.390623] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-03T19:01:35.190629] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-03T19:01:35.604342] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:01:35.844027] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:01:35.861392] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T19:01:35.990673] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-03T19:01:36.790723] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-03T19:01:37.543008] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:01:37.544246] [INFO ] [REMOTE ] FRA: Full fetch complete (24005 records). [2025-10-03T19:01:37.544358] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-03T19:01:37.595772] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-03T19:01:37.952965] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T19:01:38.029394] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-03T19:01:38.029517] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-03T19:01:38.030195] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-03T19:01:38.030263] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-03T19:01:38.031019] [DEBUG] [LOCAL ] FRA: Trimmed 24005 records to 14755 (keeping 200 days of data) [2025-10-03T19:01:38.129174] [DEBUG] [LOCAL ] FRA: Primary data saved (14755 records). [2025-10-03T19:01:38.129325] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-03T19:01:38.129465] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FRA took 35.7s. Estimated remaining: 3h 29m 35s. Rate: 7.2 symbols/min [2025-10-03T19:01:38.307743] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:38.361098] [DEBUG] [LOCAL ] FSK: Loaded 49800 existing records from primary storage. [2025-10-03T19:01:38.361434] [INFO ] [MAIN ] FSK: Loaded 49800 existing records. [2025-10-03T19:01:38.395883] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-03T19:01:38.555324] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:38.556439] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-03T19:01:38.556512] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-03T19:01:38.557191] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-03T19:01:38.557250] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-03T19:01:38.927933] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:39.190767] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-03T19:01:39.765242] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T19:01:39.990680] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-03T19:01:40.065866] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T19:01:40.552580] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:01:40.790684] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-03T19:01:41.590683] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-03T19:01:41.907310] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T19:01:42.397673] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-03T19:01:42.414828] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:01:43.190712] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-03T19:01:43.313302] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:01:43.777448] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:01:43.990676] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-03T19:01:44.801609] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-03T19:01:44.808373] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:01:45.349857] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:01:45.590694] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-03T19:01:46.390749] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-03T19:01:46.480518] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:01:46.744786] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T19:01:47.190686] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-03T19:01:47.694206] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T19:01:47.990735] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-03T19:01:48.528752] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T19:01:48.790705] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-03T19:01:49.450015] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:01:49.590695] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-03T19:01:50.129520] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:01:50.390738] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-03T19:01:51.190691] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-03T19:01:51.654175] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T19:01:51.990728] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-03T19:01:52.133585] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:01:52.212099] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:01:52.790698] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-03T19:01:53.423691] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:01:53.426355] [INFO ] [REMOTE ] FRO: Full fetch complete (75219 records). [2025-10-03T19:01:53.426468] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-03T19:01:53.595564] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-03T19:01:53.894313] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-03T19:01:53.894401] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-03T19:01:53.895398] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-03T19:01:53.895467] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-03T19:01:53.897280] [DEBUG] [LOCAL ] FRO: Trimmed 75219 records to 52466 (keeping 200 days of data) [2025-10-03T19:01:54.164868] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:01:54.276281] [DEBUG] [LOCAL ] FRO: Primary data saved (52466 records). [2025-10-03T19:01:54.276433] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-03T19:01:54.277136] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRO took 40.0s. Estimated remaining: 3h 29m 40s. Rate: 7.1 symbols/min [2025-10-03T19:01:54.394331] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-03T19:01:54.476667] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:54.535337] [DEBUG] [LOCAL ] FSLY: Loaded 51615 existing records from primary storage. [2025-10-03T19:01:54.535742] [INFO ] [MAIN ] FSLY: Loaded 51615 existing records. [2025-10-03T19:01:54.763035] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:54.763282] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-03T19:01:54.763332] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-03T19:01:54.765320] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-03T19:01:54.765384] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-03T19:01:55.154491] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:55.190762] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-03T19:01:55.505214] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:01:55.875473] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:01:55.990713] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-03T19:01:56.790687] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-03T19:01:57.187821] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:01:57.498571] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T19:01:57.590689] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-03T19:01:58.390698] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-03T19:01:58.434492] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:01:59.161523] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T19:01:59.190639] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-03T19:01:59.990629] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-03T19:02:00.098803] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:02:00.772277] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:02:00.774910] [INFO ] [REMOTE ] FSCO: Full fetch complete (54519 records). [2025-10-03T19:02:00.775056] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-03T19:02:00.799775] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-03T19:02:01.201800] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-03T19:02:01.201893] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-03T19:02:01.202814] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-03T19:02:01.202882] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-03T19:02:01.204133] [DEBUG] [LOCAL ] FSCO: Trimmed 54519 records to 38288 (keeping 200 days of data) [2025-10-03T19:02:01.446152] [DEBUG] [LOCAL ] FSCO: Primary data saved (38288 records). [2025-10-03T19:02:01.446297] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-03T19:02:01.446432] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FSCO took 30.3s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-03T19:02:01.603677] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-03T19:02:01.633614] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:01.696146] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:02:01.724789] [DEBUG] [LOCAL ] FSM: Loaded 53680 existing records from primary storage. [2025-10-03T19:02:01.725146] [INFO ] [MAIN ] FSM: Loaded 53680 existing records. [2025-10-03T19:02:01.918977] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:01.919214] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-03T19:02:01.919262] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-03T19:02:01.919475] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-03T19:02:01.919568] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-03T19:02:02.355998] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:02.390623] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-03T19:02:02.537634] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:02:03.190706] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-03T19:02:03.320143] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:02:03.990739] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-03T19:02:04.051953] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:02:04.767769] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:02:04.790634] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-03T19:02:05.590690] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-03T19:02:05.629209] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:02:06.390704] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-03T19:02:06.491747] [DEBUG] [REMOTE ] FRT: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-03T19:02:06.492076] [WARN ] [REMOTE ] FRT: No data returned for month 2025-10 [2025-10-03T19:02:06.492170] [FATAL] [REMOTE ] FRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:02:06.492253] [FATAL] [MAIN ] FRT: Failed to fetch primary data. [2025-10-03T19:02:06.492318] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:02:06.492390] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-03T19:02:06.492500] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-03T19:02:06.492557] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-10-03T19:02:06.492632] [DEBUG] [LOCAL ] FRT: No derivative data file found to delete. [2025-10-03T19:02:06.492749] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FRT took 37.2s. Estimated remaining: 3h 29m 15s. Rate: 7.2 symbols/min [2025-10-03T19:02:06.713903] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:06.736780] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:02:06.784900] [DEBUG] [LOCAL ] FSS: Loaded 34339 existing records from primary storage. [2025-10-03T19:02:06.785205] [INFO ] [MAIN ] FSS: Loaded 34339 existing records. [2025-10-03T19:02:06.981249] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:06.981546] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-03T19:02:06.981597] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-03T19:02:06.983201] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-03T19:02:06.983266] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-03T19:02:07.201403] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-03T19:02:07.391915] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:07.425878] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T19:02:07.990729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-03T19:02:08.790719] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-03T19:02:08.951110] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:02:09.590726] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-03T19:02:09.770875] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:02:10.390706] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-03T19:02:10.629378] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T19:02:11.121190] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T19:02:11.190720] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-03T19:02:11.990680] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-03T19:02:12.181748] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:02:12.323073] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:02:12.790736] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-03T19:02:13.590683] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-03T19:02:13.759317] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:02:14.390748] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-03T19:02:14.589211] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:02:14.634828] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:02:15.190689] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-03T19:02:15.990749] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-03T19:02:16.003093] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T19:02:16.006458] [INFO ] [REMOTE ] FSK: Full fetch complete (71586 records). [2025-10-03T19:02:16.006615] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-03T19:02:16.443754] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-03T19:02:16.443897] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-03T19:02:16.444898] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-03T19:02:16.445010] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-03T19:02:16.446636] [DEBUG] [LOCAL ] FSK: Trimmed 71586 records to 50184 (keeping 200 days of data) [2025-10-03T19:02:16.778105] [DEBUG] [LOCAL ] FSK: Primary data saved (50184 records). [2025-10-03T19:02:16.778410] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-03T19:02:16.778572] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FSK took 38.6s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-03T19:02:16.806712] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-03T19:02:16.991504] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:17.029441] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:02:17.033085] [DEBUG] [LOCAL ] FT: Loaded 6571 existing records from primary storage. [2025-10-03T19:02:17.043482] [INFO ] [MAIN ] FT: Loaded 6571 existing records. [2025-10-03T19:02:17.244854] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:17.245138] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-03T19:02:17.245206] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-03T19:02:17.245676] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-03T19:02:17.245767] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-03T19:02:17.559905] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:02:17.592298] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-03T19:02:17.692305] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:18.390734] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-03T19:02:18.610069] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:02:19.084879] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T19:02:19.190701] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-03T19:02:19.469293] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:02:19.990729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-03T19:02:20.737893] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:02:20.790731] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-03T19:02:21.590726] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-03T19:02:21.744559] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:02:22.390745] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-03T19:02:22.563556] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:02:23.010718] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T19:02:23.060585] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:02:23.190729] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-03T19:02:23.990740] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-03T19:02:24.563976] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:02:24.599138] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:02:24.790726] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-03T19:02:25.372427] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T19:02:25.590701] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-03T19:02:26.390713] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-03T19:02:27.080680] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T19:02:27.190707] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-03T19:02:27.605725] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:02:27.990680] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-03T19:02:28.589429] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:02:28.790733] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-03T19:02:29.592211] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-03T19:02:29.595555] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:02:29.598791] [INFO ] [REMOTE ] FSLY: Full fetch complete (74892 records). [2025-10-03T19:02:29.598931] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-03T19:02:30.037981] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-03T19:02:30.038150] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-03T19:02:30.039482] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-03T19:02:30.039553] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-03T19:02:30.041495] [DEBUG] [LOCAL ] FSLY: Trimmed 74892 records to 52001 (keeping 200 days of data) [2025-10-03T19:02:30.343723] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:02:30.390759] [DEBUG] [LOCAL ] FSLY: Primary data saved (52001 records). [2025-10-03T19:02:30.390851] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-03T19:02:30.391125] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-03T19:02:30.392615] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSLY took 36.1s. Estimated remaining: 3h 29m 11s. Rate: 7.1 symbols/min [2025-10-03T19:02:30.578201] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:30.592974] [DEBUG] [LOCAL ] FTHY: Loaded 12100 existing records from primary storage. [2025-10-03T19:02:30.593215] [INFO ] [MAIN ] FTHY: Loaded 12100 existing records. [2025-10-03T19:02:30.788537] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:30.788801] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-03T19:02:30.788853] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-03T19:02:30.789576] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-03T19:02:30.789693] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-03T19:02:31.191323] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-03T19:02:31.203020] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:31.423773] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:02:31.747269] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:02:31.981828] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:02:31.990632] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-03T19:02:32.579746] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:02:32.790696] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-03T19:02:33.590728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-03T19:02:34.390722] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-03T19:02:34.573410] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:02:34.635380] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:02:35.190628] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-03T19:02:35.504701] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:02:35.916364] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:02:35.990711] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-03T19:02:36.790693] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-03T19:02:37.527951] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T19:02:37.590631] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-03T19:02:37.857667] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T19:02:38.074872] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:02:38.390691] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-03T19:02:39.190706] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-03T19:02:39.883291] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T19:02:39.884497] [INFO ] [REMOTE ] FT: Full fetch complete (9180 records). [2025-10-03T19:02:39.884600] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-03T19:02:39.999190] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-03T19:02:40.175709] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-03T19:02:40.234344] [INFO ] [REMOTE ] FSM: Full fetch complete (76772 records). [2025-10-03T19:02:40.253526] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-03T19:02:40.755862] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-03T19:02:40.797893] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-03T19:02:40.803217] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-03T19:02:40.835318] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-03T19:02:40.845948] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-03T19:02:40.874019] [DEBUG] [LOCAL ] FT: Trimmed 9180 records to 6616 (keeping 200 days of data) [2025-10-03T19:02:41.141304] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-03T19:02:41.141422] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-03T19:02:41.142801] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-03T19:02:41.142887] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-03T19:02:41.148768] [DEBUG] [LOCAL ] FSM: Trimmed 76772 records to 54070 (keeping 200 days of data) [2025-10-03T19:02:41.151294] [DEBUG] [LOCAL ] FT: Primary data saved (6616 records). [2025-10-03T19:02:41.151831] [INFO ] [MAIN ] FT: Full history saved. [2025-10-03T19:02:41.152021] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FT took 24.4s. Estimated remaining: 3h 29m 7s. Rate: 7.1 symbols/min [2025-10-03T19:02:41.488773] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:41.654981] [DEBUG] [LOCAL ] FTI: Loaded 53689 existing records from primary storage. [2025-10-03T19:02:41.656519] [INFO ] [MAIN ] FTI: Loaded 53689 existing records. [2025-10-03T19:02:41.889057] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:41.896318] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-03T19:02:41.896467] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-03T19:02:41.930859] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-03T19:02:41.937503] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-03T19:02:42.099924] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:02:42.128968] [INFO ] [REMOTE ] FSS: Full fetch complete (48434 records). [2025-10-03T19:02:42.138859] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-03T19:02:42.193195] [DEBUG] [LOCAL ] FSM: Primary data saved (54070 records). [2025-10-03T19:02:42.316748] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-03T19:02:42.338069] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FSM took 40.9s. Estimated remaining: 3h 28m 46s. Rate: 7.2 symbols/min [2025-10-03T19:02:42.737378] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:42.769512] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-03T19:02:42.913134] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-03T19:02:42.913351] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-03T19:02:42.914162] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-03T19:02:42.914234] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-03T19:02:42.915495] [DEBUG] [LOCAL ] FSS: Trimmed 48434 records to 34548 (keeping 200 days of data) [2025-10-03T19:02:43.128924] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-10-03T19:02:43.142817] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-03T19:02:43.168026] [DEBUG] [LOCAL ] FSS: Primary data saved (34548 records). [2025-10-03T19:02:43.168201] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-03T19:02:43.168299] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FSS took 36.7s. Estimated remaining: 3h 28m 25s. Rate: 7.2 symbols/min [2025-10-03T19:02:43.901575] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:02:43.904475] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-03T19:02:44.632900] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:02:44.646257] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-03T19:02:44.654026] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:02:44.790745] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-03T19:02:45.819990] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T19:02:45.825493] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-03T19:02:46.388308] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:02:46.400708] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-03T19:02:46.566508] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T19:02:47.190694] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-03T19:02:47.781329] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:02:47.990742] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-03T19:02:48.023157] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:02:48.790675] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-03T19:02:48.860027] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T19:02:49.590719] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-03T19:02:50.416956] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T19:02:50.420986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-03T19:02:50.622051] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:02:51.190713] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-03T19:02:51.222595] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:02:51.990692] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-03T19:02:52.692187] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:02:52.693950] [INFO ] [REMOTE ] FTHY: Full fetch complete (17667 records). [2025-10-03T19:02:52.694030] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-03T19:02:53.112112] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-03T19:02:53.112285] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-03T19:02:53.112757] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-03T19:02:53.112956] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-03T19:02:53.113899] [DEBUG] [LOCAL ] FTHY: Trimmed 17667 records to 12277 (keeping 200 days of data) [2025-10-03T19:02:53.203406] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:02:53.218308] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-03T19:02:53.240728] [DEBUG] [LOCAL ] FTHY: Primary data saved (12277 records). [2025-10-03T19:02:53.240845] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-03T19:02:53.240949] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTHY took 22.8s. Estimated remaining: 3h 28m 19s. Rate: 7.2 symbols/min [2025-10-03T19:02:54.780886] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:02:54.793448] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-03T19:03:06.152555] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (11.36 seconds). [2025-10-03T19:03:06.164444] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-03T19:03:07.994933] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:03:08.007285] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-03T19:03:09.897617] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:03:09.909732] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-03T19:03:11.806591] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T19:03:11.819340] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-03T19:03:13.517316] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T19:03:13.520715] [INFO ] [REMOTE ] FTI: Full fetch complete (77136 records). [2025-10-03T19:03:13.520892] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-03T19:03:14.022168] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-03T19:03:14.022262] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-03T19:03:14.023271] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-03T19:03:14.023351] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-03T19:03:14.024989] [DEBUG] [LOCAL ] FTI: Trimmed 77136 records to 54076 (keeping 200 days of data) [2025-10-03T19:03:14.368247] [DEBUG] [LOCAL ] FTI: Primary data saved (54076 records). [2025-10-03T19:03:14.368432] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-03T19:03:14.368541] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 33.2s. Estimated remaining: 3h 28m 32s. Rate: 7.1 symbols/min [2025-10-03T19:03:15.020053] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.083407] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.087947] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.148276] [DEBUG] [LOCAL ] FTWO: Loaded 1836 existing records from primary storage. [2025-10-03T19:03:15.153883] [INFO ] [MAIN ] FTWO: Loaded 1836 existing records. [2025-10-03T19:03:15.176549] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.410708] [DEBUG] [LOCAL ] FTK: Loaded 32441 existing records from primary storage. [2025-10-03T19:03:15.430099] [DEBUG] [LOCAL ] FTS: Loaded 42461 existing records from primary storage. [2025-10-03T19:03:15.434335] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:15.434950] [INFO ] [MAIN ] FTS: Loaded 42461 existing records. [2025-10-03T19:03:15.449943] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-03T19:03:15.449695] [INFO ] [MAIN ] FTK: Loaded 32441 existing records. [2025-10-03T19:03:15.455380] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-03T19:03:15.535570] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-03T19:03:15.606032] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-03T19:03:15.728394] [DEBUG] [LOCAL ] FTV: Loaded 53318 existing records from primary storage. [2025-10-03T19:03:15.750989] [INFO ] [MAIN ] FTV: Loaded 53318 existing records. [2025-10-03T19:03:16.054458] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.096325] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.096138] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.122672] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.112257] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-03T19:03:16.159234] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-03T19:03:16.153778] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-03T19:03:16.191637] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-03T19:03:16.191234] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-03T19:03:16.217599] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-03T19:03:16.510472] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.586730] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.596910] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-03T19:03:16.616870] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-03T19:03:16.622209] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-03T19:03:17.117951] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.301792] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-03T19:03:17.689243] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.721933] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-03T19:03:17.729351] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.747100] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-03T19:03:17.825991] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.826342] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-03T19:03:18.361837] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T19:03:18.363482] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-03T19:03:18.630900] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T19:03:18.636679] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-03T19:03:18.702263] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:03:18.704032] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-03T19:03:19.338032] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:03:19.347731] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-03T19:03:19.456265] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:03:19.458399] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-03T19:03:19.504631] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:03:19.517261] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-03T19:03:19.537040] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T19:03:19.545303] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-03T19:03:19.817927] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T19:03:19.819280] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-03T19:03:20.274505] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:03:20.275761] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-03T19:03:20.366924] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:03:20.376000] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-03T19:03:20.548008] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:03:20.555524] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-03T19:03:21.434692] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:03:21.435946] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-03T19:03:21.774326] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T19:03:21.781954] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-03T19:03:22.050398] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:03:22.059338] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-03T19:03:22.212159] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:03:22.213558] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-03T19:03:22.581542] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-10-03T19:03:22.593584] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-03T19:03:22.630374] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:03:22.635859] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-03T19:03:22.646083] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T19:03:22.647416] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-03T19:03:23.094799] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:03:23.096117] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-03T19:03:23.612677] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T19:03:23.614349] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-03T19:03:23.651893] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:03:23.665510] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-03T19:03:24.120181] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:03:24.121323] [INFO ] [REMOTE ] FTWO: Full fetch complete (3341 records). [2025-10-03T19:03:24.121440] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-03T19:03:24.247472] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:03:24.313341] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-03T19:03:24.593632] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-03T19:03:24.627987] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-03T19:03:24.655498] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-03T19:03:24.655582] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-03T19:03:24.655763] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-03T19:03:24.655828] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-03T19:03:24.656211] [DEBUG] [LOCAL ] FTWO: Trimmed 3341 records to 1873 (keeping 200 days of data) [2025-10-03T19:03:24.669472] [DEBUG] [LOCAL ] FTWO: Primary data saved (1873 records). [2025-10-03T19:03:24.669565] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-03T19:03:24.669693] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 10.3s. Estimated remaining: 3h 28m 27s. Rate: 7.1 symbols/min [2025-10-03T19:03:24.854588] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:24.917751] [DEBUG] [LOCAL ] FUBO: Loaded 54087 existing records from primary storage. [2025-10-03T19:03:24.918148] [INFO ] [MAIN ] FUBO: Loaded 54087 existing records. [2025-10-03T19:03:25.134337] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:25.134637] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-03T19:03:25.134823] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-03T19:03:25.135915] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-03T19:03:25.135978] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-03T19:03:25.601019] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:25.601852] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-03T19:03:25.606981] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T19:03:25.622048] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-03T19:03:25.724134] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:03:25.733973] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-03T19:03:26.359184] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:03:26.370861] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-03T19:03:27.050017] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T19:03:27.059894] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-03T19:03:27.134850] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:03:27.144789] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-03T19:03:27.528201] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T19:03:27.540474] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-03T19:03:27.686716] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T19:03:27.698517] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-03T19:03:28.221725] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:03:28.231192] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-03T19:03:28.635324] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T19:03:28.643539] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-03T19:03:29.175718] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:03:29.188132] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-03T19:03:29.804041] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T19:03:29.817283] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-03T19:03:29.849407] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:03:29.860779] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-03T19:03:29.896203] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T19:03:29.904590] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-03T19:03:30.528248] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T19:03:30.540119] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-03T19:03:31.081585] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:03:31.083698] [INFO ] [REMOTE ] FTK: Full fetch complete (43230 records). [2025-10-03T19:03:31.083810] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-03T19:03:31.538829] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T19:03:31.551234] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-03T19:03:31.551515] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-03T19:03:31.552376] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-03T19:03:31.552514] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-03T19:03:31.552994] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-03T19:03:31.555264] [DEBUG] [LOCAL ] FTK: Trimmed 43230 records to 32705 (keeping 200 days of data) [2025-10-03T19:03:31.760402] [DEBUG] [LOCAL ] FTK: Primary data saved (32705 records). [2025-10-03T19:03:31.760551] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-03T19:03:31.760692] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTK took 17.4s. Estimated remaining: 3h 28m 17s. Rate: 7.1 symbols/min [2025-10-03T19:03:31.973780] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:32.025275] [DEBUG] [LOCAL ] FUL: Loaded 33213 existing records from primary storage. [2025-10-03T19:03:32.025571] [INFO ] [MAIN ] FUL: Loaded 33213 existing records. [2025-10-03T19:03:32.226863] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:32.227699] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-03T19:03:32.227931] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-03T19:03:32.228631] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-03T19:03:32.228774] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-03T19:03:32.404897] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-03T19:03:32.462218] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-03T19:03:32.790873] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T19:03:32.855451] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-03T19:03:32.990076] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:33.032411] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T19:03:33.590728] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-03T19:03:34.390675] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-03T19:03:34.754963] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T19:03:34.772617] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T19:03:34.800852] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:03:35.190727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-03T19:03:35.607171] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:03:35.610153] [INFO ] [REMOTE ] FTS: Full fetch complete (60211 records). [2025-10-03T19:03:35.610268] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-03T19:03:36.002573] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-03T19:03:36.048454] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-03T19:03:36.048563] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-03T19:03:36.049493] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-03T19:03:36.049559] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-03T19:03:36.052218] [DEBUG] [LOCAL ] FTS: Trimmed 60211 records to 42797 (keeping 200 days of data) [2025-10-03T19:03:36.331553] [DEBUG] [LOCAL ] FTS: Primary data saved (42797 records). [2025-10-03T19:03:36.331725] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-03T19:03:36.331828] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FTS took 22.0s. Estimated remaining: 3h 28m 2s. Rate: 7.1 symbols/min [2025-10-03T19:03:36.542181] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:36.571454] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:03:36.644880] [DEBUG] [LOCAL ] FUN: Loaded 51989 existing records from primary storage. [2025-10-03T19:03:36.645296] [INFO ] [MAIN ] FUN: Loaded 51989 existing records. [2025-10-03T19:03:36.804544] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-03T19:03:36.852385] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:36.852746] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-03T19:03:36.852991] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-03T19:03:36.853432] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-03T19:03:36.853492] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-03T19:03:37.259096] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:37.590720] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-03T19:03:38.174169] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T19:03:38.390683] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-03T19:03:38.613408] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:03:39.190679] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-03T19:03:39.459895] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:03:39.990725] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-03T19:03:40.700745] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-03T19:03:40.790704] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-03T19:03:41.354111] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-03T19:03:41.357169] [INFO ] [REMOTE ] FTV: Full fetch complete (76349 records). [2025-10-03T19:03:41.357346] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-03T19:03:41.595623] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-03T19:03:41.854843] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-03T19:03:41.855009] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-03T19:03:41.856090] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-03T19:03:41.856217] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-03T19:03:41.858632] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T19:03:41.869512] [DEBUG] [LOCAL ] FTV: Trimmed 76349 records to 53708 (keeping 200 days of data) [2025-10-03T19:03:42.232630] [DEBUG] [LOCAL ] FTV: Primary data saved (53708 records). [2025-10-03T19:03:42.232998] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-03T19:03:42.233966] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 27.9s. Estimated remaining: 3h 27m 49s. Rate: 7.2 symbols/min [2025-10-03T19:03:42.401026] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-03T19:03:42.432178] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:42.461437] [DEBUG] [LOCAL ] FVR: Loaded 21880 existing records from primary storage. [2025-10-03T19:03:42.461728] [INFO ] [MAIN ] FVR: Loaded 21880 existing records. [2025-10-03T19:03:42.671814] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:42.672117] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-03T19:03:42.672229] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-03T19:03:42.673139] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-03T19:03:42.673396] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-03T19:03:42.973766] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-03T19:03:43.148486] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:03:43.155011] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:43.190664] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-03T19:03:43.990684] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-03T19:03:44.078945] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:03:44.676817] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:03:44.790699] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-03T19:03:45.188598] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:03:45.590713] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-03T19:03:46.390688] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-03T19:03:46.872549] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T19:03:47.190677] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-03T19:03:47.280934] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:03:47.771600] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:03:47.990711] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-03T19:03:48.790681] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-03T19:03:49.160825] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T19:03:49.602540] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-03T19:03:49.608794] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:03:49.741330] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:03:50.390759] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-03T19:03:50.757690] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:03:51.190703] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-03T19:03:51.335707] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:03:51.990735] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-03T19:03:52.790760] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-03T19:03:53.378128] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T19:03:53.590695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-03T19:03:53.701620] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:03:54.152069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:03:54.390715] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-03T19:03:55.190672] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-03T19:03:55.500902] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:03:55.589613] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T19:03:55.592960] [INFO ] [REMOTE ] FUBO: Full fetch complete (77768 records). [2025-10-03T19:03:55.593132] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-03T19:03:55.995879] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-03T19:03:56.092355] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-03T19:03:56.092469] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-03T19:03:56.093749] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-03T19:03:56.093830] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-03T19:03:56.095723] [DEBUG] [LOCAL ] FUBO: Trimmed 77768 records to 54477 (keeping 200 days of data) [2025-10-03T19:03:56.453163] [DEBUG] [LOCAL ] FUBO: Primary data saved (54477 records). [2025-10-03T19:03:56.453350] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-03T19:03:56.453449] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUBO took 31.8s. Estimated remaining: 3h 27m 50s. Rate: 7.1 symbols/min [2025-10-03T19:03:56.666929] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:56.709813] [DEBUG] [LOCAL ] FVRR: Loaded 40323 existing records from primary storage. [2025-10-03T19:03:56.710137] [INFO ] [MAIN ] FVRR: Loaded 40323 existing records. [2025-10-03T19:03:56.793797] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-03T19:03:56.916161] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:56.916607] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-03T19:03:56.916783] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-03T19:03:56.928713] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-03T19:03:56.946167] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-03T19:03:57.011886] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:03:57.374484] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:57.547423] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:03:57.590628] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-03T19:03:57.851921] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:03:58.390748] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-03T19:03:58.810418] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T19:03:59.074981] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T19:03:59.190694] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-03T19:03:59.990710] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-03T19:04:00.790671] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-03T19:04:00.989915] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:04:01.126075] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T19:04:01.590687] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-03T19:04:02.378091] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:04:02.391038] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-03T19:04:03.190735] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-03T19:04:03.379204] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:04:03.820851] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:04:03.917193] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:04:03.990721] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-03T19:04:04.790720] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-03T19:04:05.089899] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:04:05.590709] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-03T19:04:06.266430] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T19:04:06.390678] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-03T19:04:06.476535] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:04:07.088595] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:04:07.090160] [INFO ] [REMOTE ] FVR: Full fetch complete (30227 records). [2025-10-03T19:04:07.090241] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-03T19:04:07.195883] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-03T19:04:07.510198] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-03T19:04:07.510285] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-03T19:04:07.510891] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-03T19:04:07.510955] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-03T19:04:07.511842] [DEBUG] [LOCAL ] FVR: Trimmed 30227 records to 21967 (keeping 200 days of data) [2025-10-03T19:04:07.649999] [DEBUG] [LOCAL ] FVR: Primary data saved (21967 records). [2025-10-03T19:04:07.650128] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-03T19:04:07.650212] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FVR took 25.4s. Estimated remaining: 3h 27m 47s. Rate: 7.1 symbols/min [2025-10-03T19:04:07.849718] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:07.853403] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-03T19:04:07.853538] [INFO ] [MAIN ] FXED: Loaded 1253 existing records. [2025-10-03T19:04:08.004633] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-03T19:04:08.050975] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:08.051235] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-03T19:04:08.051289] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-03T19:04:08.051592] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-03T19:04:08.051678] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-03T19:04:08.444071] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:08.790673] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-03T19:04:09.077375] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T19:04:09.367969] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:04:09.369996] [INFO ] [REMOTE ] FUL: Full fetch complete (47714 records). [2025-10-03T19:04:09.370115] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-03T19:04:09.599432] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-03T19:04:09.832591] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-03T19:04:09.832716] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-03T19:04:09.833456] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-03T19:04:09.833523] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-03T19:04:09.834909] [DEBUG] [LOCAL ] FUL: Trimmed 47714 records to 33460 (keeping 200 days of data) [2025-10-03T19:04:10.054603] [DEBUG] [LOCAL ] FUL: Primary data saved (33460 records). [2025-10-03T19:04:10.054783] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-03T19:04:10.054927] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FUL took 38.3s. Estimated remaining: 3h 27m 28s. Rate: 7.1 symbols/min [2025-10-03T19:04:10.240176] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:10.266814] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:04:10.321241] [DEBUG] [LOCAL ] G: Loaded 50210 existing records from primary storage. [2025-10-03T19:04:10.321693] [INFO ] [MAIN ] G: Loaded 50210 existing records. [2025-10-03T19:04:10.396949] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-03T19:04:10.537967] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:10.538210] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-03T19:04:10.538266] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-03T19:04:10.541218] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-03T19:04:10.541290] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-03T19:04:10.967226] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:11.079149] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T19:04:11.082119] [INFO ] [REMOTE ] FUN: Full fetch complete (72918 records). [2025-10-03T19:04:11.082237] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-03T19:04:11.195856] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-03T19:04:11.549320] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-03T19:04:11.549592] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-03T19:04:11.550611] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-03T19:04:11.550704] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-03T19:04:11.552420] [DEBUG] [LOCAL ] FUN: Trimmed 72918 records to 52377 (keeping 200 days of data) [2025-10-03T19:04:11.877546] [DEBUG] [LOCAL ] FUN: Primary data saved (52377 records). [2025-10-03T19:04:11.877716] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-03T19:04:11.877815] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FUN took 35.5s. Estimated remaining: 3h 27m 9s. Rate: 7.2 symbols/min [2025-10-03T19:04:11.997864] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-03T19:04:12.083114] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:12.110480] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:04:12.145292] [DEBUG] [LOCAL ] GAB: Loaded 28112 existing records from primary storage. [2025-10-03T19:04:12.145579] [INFO ] [MAIN ] GAB: Loaded 28112 existing records. [2025-10-03T19:04:12.351867] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:12.352153] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-03T19:04:12.352235] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-03T19:04:12.352737] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-03T19:04:12.352798] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-03T19:04:12.451054] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T19:04:12.800191] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-03T19:04:12.807760] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:12.833799] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:04:13.590697] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-03T19:04:14.269769] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:04:14.390735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-03T19:04:15.024616] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:04:15.190723] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-03T19:04:15.606558] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:04:15.990681] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-03T19:04:16.081104] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T19:04:16.790639] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-03T19:04:17.037883] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:04:17.180663] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T19:04:17.590735] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-03T19:04:18.011543] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-03T19:04:18.390633] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-03T19:04:19.190730] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-03T19:04:19.606283] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T19:04:19.776100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:04:19.990676] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-03T19:04:20.271440] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-03T19:04:20.790698] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-03T19:04:21.175972] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-03T19:04:21.590697] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-03T19:04:22.390708] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-03T19:04:23.195780] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-03T19:04:23.219107] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:04:23.270758] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:04:23.990731] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-03T19:04:24.644291] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:04:24.790710] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-03T19:04:25.590745] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-03T19:04:25.646116] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:04:26.033987] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:04:26.390737] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-03T19:04:26.492493] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:04:26.826264] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:04:27.190692] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-03T19:04:27.990712] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-03T19:04:28.541828] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T19:04:28.587813] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T19:04:28.790699] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-03T19:04:29.590709] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-03T19:04:30.210821] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:04:30.390692] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-03T19:04:31.190719] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-03T19:04:31.340833] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T19:04:31.574200] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T19:04:31.574955] [INFO ] [REMOTE ] FXED: Full fetch complete (1802 records). [2025-10-03T19:04:31.575060] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-03T19:04:31.969302] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-03T19:04:31.969436] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-03T19:04:31.969895] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-03T19:04:31.970132] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-03T19:04:31.970792] [DEBUG] [LOCAL ] FXED: Trimmed 1802 records to 1259 (keeping 200 days of data) [2025-10-03T19:04:31.980232] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-03T19:04:31.994285] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-03T19:04:31.988527] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-03T19:04:32.005556] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 24.4s. Estimated remaining: 3h 27m 20s. Rate: 7.1 symbols/min [2025-10-03T19:04:32.007154] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:04:32.208453] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:32.216243] [DEBUG] [LOCAL ] GAM: Loaded 4081 existing records from primary storage. [2025-10-03T19:04:32.216413] [INFO ] [MAIN ] GAM: Loaded 4081 existing records. [2025-10-03T19:04:32.409846] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:32.410094] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-03T19:04:32.410156] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-03T19:04:32.410368] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-03T19:04:32.410428] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-03T19:04:32.803280] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-03T19:04:32.809431] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:33.590720] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-03T19:04:33.793991] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:04:34.002672] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:04:34.347498] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:04:34.390701] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-03T19:04:35.057279] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T19:04:35.190697] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-03T19:04:35.990684] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-03T19:04:36.343047] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T19:04:36.345469] [INFO ] [REMOTE ] FVRR: Full fetch complete (59069 records). [2025-10-03T19:04:36.345563] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-03T19:04:36.796872] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-03T19:04:36.797820] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-03T19:04:36.798956] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-03T19:04:36.799881] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-03T19:04:36.800051] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-03T19:04:36.801499] [DEBUG] [LOCAL ] FVRR: Trimmed 59069 records to 40657 (keeping 200 days of data) [2025-10-03T19:04:37.031044] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:04:37.078539] [DEBUG] [LOCAL ] FVRR: Primary data saved (40657 records). [2025-10-03T19:04:37.078698] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-03T19:04:37.078818] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. FVRR took 40.6s. Estimated remaining: 3h 27m 6s. Rate: 7.1 symbols/min [2025-10-03T19:04:37.263344] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:37.318857] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-10-03T19:04:37.319196] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-10-03T19:04:37.514301] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:37.519387] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:04:37.521596] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-03T19:04:37.521683] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-03T19:04:37.522142] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-03T19:04:37.522203] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-03T19:04:37.595743] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-03T19:04:37.911587] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:38.390686] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-03T19:04:39.190688] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-03T19:04:39.340626] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:04:39.398070] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:04:39.990675] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-03T19:04:40.786554] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:04:40.790585] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-03T19:04:40.991540] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:04:41.411600] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T19:04:41.590691] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-03T19:04:42.390694] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-03T19:04:42.741223] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:04:43.190686] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-03T19:04:43.990698] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-03T19:04:44.139057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:04:44.780132] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:04:44.790816] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-03T19:04:45.235319] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T19:04:45.590735] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-03T19:04:46.354118] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:04:46.390717] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-03T19:04:47.022011] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T19:04:47.175402] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:04:47.190622] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-03T19:04:47.990706] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-03T19:04:48.172703] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:04:48.174227] [INFO ] [REMOTE ] GAB: Full fetch complete (39614 records). [2025-10-03T19:04:48.174312] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-03T19:04:48.598270] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-03T19:04:48.598405] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-03T19:04:48.599542] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-03T19:04:48.599608] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-03T19:04:48.600740] [DEBUG] [LOCAL ] GAB: Trimmed 39614 records to 28299 (keeping 200 days of data) [2025-10-03T19:04:48.773513] [DEBUG] [LOCAL ] GAB: Primary data saved (28299 records). [2025-10-03T19:04:48.774009] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-03T19:04:48.774174] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 36.9s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-03T19:04:48.797543] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-03T19:04:48.971754] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:48.993837] [DEBUG] [LOCAL ] GATX: Loaded 18259 existing records from primary storage. [2025-10-03T19:04:48.994101] [INFO ] [MAIN ] GATX: Loaded 18259 existing records. [2025-10-03T19:04:49.194660] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:49.194973] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-03T19:04:49.195032] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-03T19:04:49.195325] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-03T19:04:49.195405] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-03T19:04:49.604215] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:49.598462] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-03T19:04:49.640380] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:04:50.160956] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:04:50.390751] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-03T19:04:50.816877] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T19:04:51.016557] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:04:51.190694] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-03T19:04:51.990701] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-03T19:04:52.269011] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:04:52.790734] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-03T19:04:53.590730] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-03T19:04:53.967430] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:04:54.390703] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-03T19:04:54.471027] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:04:54.618636] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:04:55.010202] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T19:04:55.190683] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-03T19:04:55.990632] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-03T19:04:56.105191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:04:56.790712] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-03T19:04:57.263842] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T19:04:57.432242] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:04:57.438274] [INFO ] [REMOTE ] G: Full fetch complete (71663 records). [2025-10-03T19:04:57.438511] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-03T19:04:57.595772] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-03T19:04:57.880386] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-03T19:04:57.880477] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-03T19:04:57.881539] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-03T19:04:57.881613] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-03T19:04:57.883262] [DEBUG] [LOCAL ] G: Trimmed 71663 records to 50591 (keeping 200 days of data) [2025-10-03T19:04:58.209398] [DEBUG] [LOCAL ] G: Primary data saved (50591 records). [2025-10-03T19:04:58.209540] [INFO ] [MAIN ] G: Full history saved. [2025-10-03T19:04:58.209660] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. G took 48.2s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-03T19:04:58.397074] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-03T19:04:58.401276] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:58.419056] [DEBUG] [LOCAL ] GBAB: Loaded 13143 existing records from primary storage. [2025-10-03T19:04:58.419358] [INFO ] [MAIN ] GBAB: Loaded 13143 existing records. [2025-10-03T19:04:58.624899] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:58.625113] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-03T19:04:58.625162] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-03T19:04:58.625365] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-03T19:04:58.625439] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-03T19:04:59.024281] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:59.190734] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-03T19:04:59.366396] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T19:04:59.438840] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:04:59.920061] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:04:59.990706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-03T19:05:00.790699] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-03T19:05:01.185815] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T19:05:01.590711] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-03T19:05:01.615687] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:05:02.390624] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-03T19:05:02.704174] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:05:03.190722] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-03T19:05:03.329039] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:05:03.639068] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T19:05:03.640045] [INFO ] [REMOTE ] GAM: Full fetch complete (6733 records). [2025-10-03T19:05:03.640119] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-03T19:05:03.999276] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-03T19:05:04.050976] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-03T19:05:04.051083] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-03T19:05:04.051313] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-03T19:05:04.051409] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-03T19:05:04.052058] [DEBUG] [LOCAL ] GAM: Trimmed 6733 records to 4101 (keeping 200 days of data) [2025-10-03T19:05:04.078416] [DEBUG] [LOCAL ] GAM: Primary data saved (4101 records). [2025-10-03T19:05:04.078599] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-03T19:05:04.078753] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. GAM took 32.1s. Estimated remaining: 3h 26m 44s. Rate: 7.1 symbols/min [2025-10-03T19:05:04.270713] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:04.323922] [DEBUG] [LOCAL ] GBCI: Loaded 40436 existing records from primary storage. [2025-10-03T19:05:04.324289] [INFO ] [MAIN ] GBCI: Loaded 40436 existing records. [2025-10-03T19:05:04.553275] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:04.553561] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-03T19:05:04.553669] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-03T19:05:04.554197] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-03T19:05:04.554257] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-03T19:05:04.795821] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-03T19:05:05.000201] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:05.590733] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-03T19:05:05.699301] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:05:06.122418] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T19:05:06.390708] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-03T19:05:07.153062] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:05:07.190626] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-03T19:05:07.299896] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T19:05:07.990666] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-03T19:05:08.700964] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:05:08.790732] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-03T19:05:09.590698] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-03T19:05:09.633973] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:05:09.867834] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:05:10.390727] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-03T19:05:10.890120] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:05:11.185564] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:05:11.190609] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-03T19:05:11.990675] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-03T19:05:12.143259] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T19:05:12.694171] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T19:05:12.790706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-03T19:05:13.590720] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-03T19:05:13.774211] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:05:14.390787] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-03T19:05:15.190670] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-03T19:05:15.229426] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:05:15.431633] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:05:15.990729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-03T19:05:16.790696] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-03T19:05:16.966628] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:05:17.590725] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-03T19:05:17.648767] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:05:17.667021] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:05:17.668317] [INFO ] [REMOTE ] GATX: Full fetch complete (25184 records). [2025-10-03T19:05:17.668433] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-03T19:05:18.077448] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-03T19:05:18.077552] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-03T19:05:18.078150] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-03T19:05:18.078219] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-03T19:05:18.079217] [DEBUG] [LOCAL ] GATX: Trimmed 25184 records to 18362 (keeping 200 days of data) [2025-10-03T19:05:18.202590] [DEBUG] [LOCAL ] GATX: Primary data saved (18362 records). [2025-10-03T19:05:18.202799] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-03T19:05:18.202936] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GATX took 29.4s. Estimated remaining: 3h 26m 45s. Rate: 7.1 symbols/min [2025-10-03T19:05:18.394636] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-03T19:05:18.396604] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:18.398353] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-03T19:05:18.398417] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-03T19:05:18.398551] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-03T19:05:18.398595] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-03T19:05:18.398638] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-03T19:05:18.398763] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-03T19:05:18.791383] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:19.190700] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-03T19:05:19.384210] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T19:05:19.994166] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-03T19:05:20.000801] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:05:20.174836] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:05:20.790758] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-03T19:05:21.265803] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:05:21.590742] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-03T19:05:21.773076] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:05:21.776194] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-10-03T19:05:21.776492] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-03T19:05:22.208883] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-03T19:05:22.209002] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-03T19:05:22.210340] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-03T19:05:22.210442] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-03T19:05:22.212608] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54434 (keeping 200 days of data) [2025-10-03T19:05:22.411291] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-03T19:05:22.577523] [DEBUG] [LOCAL ] GAP: Primary data saved (54434 records). [2025-10-03T19:05:22.577821] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-03T19:05:22.578018] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GAP took 45.5s. Estimated remaining: 3h 26m 30s. Rate: 7.1 symbols/min [2025-10-03T19:05:22.762054] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:22.787327] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T19:05:22.832295] [DEBUG] [LOCAL ] GBTG: Loaded 40317 existing records from primary storage. [2025-10-03T19:05:22.832761] [INFO ] [MAIN ] GBTG: Loaded 40317 existing records. [2025-10-03T19:05:23.014827] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:23.015310] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-03T19:05:23.015398] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-03T19:05:23.016604] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-03T19:05:23.016935] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-03T19:05:23.195207] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-03T19:05:23.391112] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:05:23.476930] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:23.990713] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-03T19:05:24.327343] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:05:24.790688] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-03T19:05:24.921596] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T19:05:25.112140] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-03T19:05:25.590739] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-03T19:05:26.342926] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:05:26.390693] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-03T19:05:27.047392] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T19:05:27.049145] [INFO ] [REMOTE ] GBAB: Full fetch complete (19627 records). [2025-10-03T19:05:27.049275] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-03T19:05:27.195754] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-03T19:05:27.471516] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-03T19:05:27.471624] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-03T19:05:27.472337] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-03T19:05:27.472393] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-03T19:05:27.473136] [DEBUG] [LOCAL ] GBAB: Trimmed 19627 records to 13203 (keeping 200 days of data) [2025-10-03T19:05:27.559952] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T19:05:27.578836] [DEBUG] [LOCAL ] GBAB: Primary data saved (13203 records). [2025-10-03T19:05:27.579072] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-03T19:05:27.579190] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBAB took 29.4s. Estimated remaining: 3h 26m 16s. Rate: 7.1 symbols/min [2025-10-03T19:05:27.754717] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:27.792575] [DEBUG] [LOCAL ] GBX: Loaded 29327 existing records from primary storage. [2025-10-03T19:05:27.793087] [INFO ] [MAIN ] GBX: Loaded 29327 existing records. [2025-10-03T19:05:27.980601] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:27.980934] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-03T19:05:27.980988] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-03T19:05:27.981352] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-03T19:05:27.981411] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-03T19:05:27.995744] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-03T19:05:28.375677] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:28.790704] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-03T19:05:29.209304] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T19:05:29.398613] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:05:29.590698] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-03T19:05:29.933161] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T19:05:30.390719] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-03T19:05:30.616368] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-03T19:05:31.190701] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-03T19:05:31.990729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-03T19:05:32.262119] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:05:32.790722] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-03T19:05:33.048442] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-03T19:05:33.426374] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:05:33.590714] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-03T19:05:34.390734] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-03T19:05:34.930713] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:05:35.190762] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-03T19:05:35.689871] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T19:05:35.990668] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-03T19:05:36.234832] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:05:36.237986] [INFO ] [REMOTE ] GBCI: Full fetch complete (58408 records). [2025-10-03T19:05:36.238104] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-03T19:05:36.666921] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-03T19:05:36.667044] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-03T19:05:36.668453] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-03T19:05:36.668555] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-03T19:05:36.670436] [DEBUG] [LOCAL ] GBCI: Trimmed 58408 records to 40821 (keeping 200 days of data) [2025-10-03T19:05:36.790874] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-03T19:05:36.958915] [DEBUG] [LOCAL ] GBCI: Primary data saved (40821 records). [2025-10-03T19:05:36.959082] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-03T19:05:36.959823] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBCI took 32.9s. Estimated remaining: 3h 26m 9s. Rate: 7.1 symbols/min [2025-10-03T19:05:37.145618] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:37.199887] [DEBUG] [LOCAL ] GCI: Loaded 44426 existing records from primary storage. [2025-10-03T19:05:37.200197] [INFO ] [MAIN ] GCI: Loaded 44426 existing records. [2025-10-03T19:05:37.413885] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:37.414519] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-03T19:05:37.414594] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-03T19:05:37.420907] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-03T19:05:37.432562] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-03T19:05:37.439883] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:05:37.595766] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-03T19:05:37.844541] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:38.079816] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:05:38.104585] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:05:38.390684] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-03T19:05:39.190683] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-03T19:05:39.565845] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-03T19:05:39.712250] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T19:05:39.990638] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-03T19:05:40.346002] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T19:05:40.346911] [INFO ] [REMOTE ] GBLI: Full fetch complete (1327 records). [2025-10-03T19:05:40.347006] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-03T19:05:40.563220] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-03T19:05:40.563470] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:05:40.563542] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:05:40.563627] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-03T19:05:40.563734] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-03T19:05:40.563784] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-03T19:05:40.563829] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-03T19:05:40.563903] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GBLI took 22.4s. Estimated remaining: 3h 25m 53s. Rate: 7.1 symbols/min [2025-10-03T19:05:40.751228] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:40.777417] [DEBUG] [LOCAL ] GCO: Loaded 24786 existing records from primary storage. [2025-10-03T19:05:40.777725] [INFO ] [MAIN ] GCO: Loaded 24786 existing records. [2025-10-03T19:05:40.799721] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-03T19:05:40.975033] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:40.975342] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-03T19:05:40.975411] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-03T19:05:40.975679] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-03T19:05:40.975752] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-03T19:05:41.377015] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:41.590737] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-03T19:05:42.035337] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:05:42.390737] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-03T19:05:42.571078] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:05:43.190689] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-03T19:05:43.723760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T19:05:43.990628] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-03T19:05:44.384271] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T19:05:44.790725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-03T19:05:45.485001] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:05:45.573790] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:05:45.590614] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-03T19:05:46.390713] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-03T19:05:46.745400] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:05:47.190734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-03T19:05:47.876304] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:05:47.990712] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-03T19:05:48.546011] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:05:48.790624] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-03T19:05:49.181308] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:05:49.590715] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-03T19:05:50.090268] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:05:50.390633] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-03T19:05:50.718467] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:05:51.190747] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-03T19:05:51.929155] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T19:05:51.990726] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-03T19:05:52.707931] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T19:05:52.790676] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-03T19:05:53.598746] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-03T19:05:53.604703] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:05:54.187143] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:05:54.390739] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-03T19:05:54.639739] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T19:05:55.190722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-03T19:05:55.416142] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:05:55.990683] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-03T19:05:56.297852] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T19:05:56.790726] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-03T19:05:57.069244] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:05:57.590726] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-03T19:05:58.403883] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-03T19:05:58.411076] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:05:58.965453] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T19:05:59.190637] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-03T19:05:59.516772] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:05:59.990715] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-03T19:06:00.408888] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:06:00.790681] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-03T19:06:00.875373] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T19:06:01.590714] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-03T19:06:01.813139] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:06:02.390722] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-03T19:06:02.771381] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:06:02.774245] [INFO ] [REMOTE ] GBTG: Full fetch complete (56556 records). [2025-10-03T19:06:02.774434] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-03T19:06:03.194271] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-03T19:06:03.215583] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-03T19:06:03.215710] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-03T19:06:03.216512] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-03T19:06:03.216558] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-03T19:06:03.218167] [DEBUG] [LOCAL ] GBTG: Trimmed 56556 records to 40575 (keeping 200 days of data) [2025-10-03T19:06:03.458998] [DEBUG] [LOCAL ] GBTG: Primary data saved (40575 records). [2025-10-03T19:06:03.459125] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-03T19:06:03.459227] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GBTG took 40.9s. Estimated remaining: 3h 26m 8s. Rate: 7.1 symbols/min [2025-10-03T19:06:03.646036] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:03.668604] [DEBUG] [LOCAL ] GCTS: Loaded 20086 existing records from primary storage. [2025-10-03T19:06:03.668920] [INFO ] [MAIN ] GCTS: Loaded 20086 existing records. [2025-10-03T19:06:03.879505] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:03.879871] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-03T19:06:03.879930] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-03T19:06:03.880153] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-03T19:06:03.880212] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-03T19:06:03.991580] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-03T19:06:04.213834] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:06:04.266585] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:06:04.293717] [INFO ] [REMOTE ] GBX: Full fetch complete (42832 records). [2025-10-03T19:06:04.318193] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-03T19:06:04.430841] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:04.805734] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-03T19:06:04.810151] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-03T19:06:04.810238] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-03T19:06:04.811058] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-03T19:06:04.811238] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-03T19:06:04.812666] [DEBUG] [LOCAL ] GBX: Trimmed 42832 records to 29520 (keeping 200 days of data) [2025-10-03T19:06:05.007293] [DEBUG] [LOCAL ] GBX: Primary data saved (29520 records). [2025-10-03T19:06:05.007450] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-03T19:06:05.007560] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GBX took 37.4s. Estimated remaining: 3h 25m 49s. Rate: 7.1 symbols/min [2025-10-03T19:06:05.202262] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:05.225139] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:06:05.236373] [DEBUG] [LOCAL ] GCV: Loaded 7454 existing records from primary storage. [2025-10-03T19:06:05.236674] [INFO ] [MAIN ] GCV: Loaded 7454 existing records. [2025-10-03T19:06:05.426445] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:05.426684] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-03T19:06:05.426745] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-03T19:06:05.426956] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-03T19:06:05.427029] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-03T19:06:05.600583] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-03T19:06:05.851331] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:06.390625] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-03T19:06:06.444020] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:06:06.704133] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T19:06:07.190723] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-03T19:06:07.522471] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T19:06:07.990628] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-03T19:06:08.134932] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:06:08.790714] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-03T19:06:08.894752] [DEBUG] [REMOTE ] GCV: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-03T19:06:08.895094] [WARN ] [REMOTE ] GCV: No data returned for month 2024-12 [2025-10-03T19:06:08.895213] [FATAL] [REMOTE ] GCV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:06:08.895311] [FATAL] [MAIN ] GCV: Failed to fetch primary data. [2025-10-03T19:06:08.895425] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:06:08.895527] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-03T19:06:08.895686] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-10-03T19:06:08.895746] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-10-03T19:06:08.896168] [DEBUG] [LOCAL ] GCV: Deleted derivative data file. [2025-10-03T19:06:08.896271] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GCV took 3.9s. Estimated remaining: 3h 25m 33s. Rate: 7.1 symbols/min [2025-10-03T19:06:09.117690] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:09.134025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T19:06:09.182473] [DEBUG] [LOCAL ] GD: Loaded 47468 existing records from primary storage. [2025-10-03T19:06:09.182833] [INFO ] [MAIN ] GD: Loaded 47468 existing records. [2025-10-03T19:06:09.372855] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:09.373096] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-03T19:06:09.373154] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-03T19:06:09.374760] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-03T19:06:09.374823] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-03T19:06:09.595790] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-03T19:06:09.757481] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:10.390709] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-03T19:06:11.190708] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-03T19:06:11.260354] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:06:11.305949] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T19:06:11.990714] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-03T19:06:12.790725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-03T19:06:12.865260] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T19:06:13.527420] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:06:13.553097] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:06:13.590623] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-03T19:06:14.390734] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-03T19:06:14.416145] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:06:14.417548] [INFO ] [REMOTE ] GCO: Full fetch complete (35378 records). [2025-10-03T19:06:14.417631] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-03T19:06:14.844368] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-03T19:06:14.844463] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-03T19:06:14.845128] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-03T19:06:14.845197] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-03T19:06:14.846292] [DEBUG] [LOCAL ] GCO: Trimmed 35378 records to 24918 (keeping 200 days of data) [2025-10-03T19:06:15.009243] [DEBUG] [LOCAL ] GCO: Primary data saved (24918 records). [2025-10-03T19:06:15.009400] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-03T19:06:15.009549] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCO took 34.4s. Estimated remaining: 3h 25m 21s. Rate: 7.1 symbols/min [2025-10-03T19:06:15.198580] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-03T19:06:15.202592] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:15.259159] [DEBUG] [LOCAL ] GDDY: Loaded 50069 existing records from primary storage. [2025-10-03T19:06:15.259499] [INFO ] [MAIN ] GDDY: Loaded 50069 existing records. [2025-10-03T19:06:15.469796] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:15.470091] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-03T19:06:15.470142] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-03T19:06:15.471810] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-03T19:06:15.471877] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-03T19:06:15.584585] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:06:15.613124] [INFO ] [REMOTE ] GCI: Full fetch complete (63174 records). [2025-10-03T19:06:15.623723] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-03T19:06:16.024146] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-03T19:06:16.223534] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:16.297936] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:06:16.402003] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-03T19:06:16.402093] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-03T19:06:16.402868] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-03T19:06:16.402936] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-03T19:06:16.404352] [DEBUG] [LOCAL ] GCI: Trimmed 63174 records to 44716 (keeping 200 days of data) [2025-10-03T19:06:16.669761] [DEBUG] [LOCAL ] GCI: Primary data saved (44716 records). [2025-10-03T19:06:16.669919] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-03T19:06:16.671587] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GCI took 39.7s. Estimated remaining: 3h 25m 2s. Rate: 7.2 symbols/min [2025-10-03T19:06:16.795873] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-03T19:06:16.865586] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:16.874136] [DEBUG] [LOCAL ] GDIV: Loaded 3648 existing records from primary storage. [2025-10-03T19:06:16.874366] [INFO ] [MAIN ] GDIV: Loaded 3648 existing records. [2025-10-03T19:06:17.068120] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:17.068366] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-03T19:06:17.068425] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-03T19:06:17.068687] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-03T19:06:17.068746] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-03T19:06:17.467041] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:17.590745] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-03T19:06:17.802393] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T19:06:17.803570] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:06:18.274383] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T19:06:18.390695] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-03T19:06:19.190727] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-03T19:06:20.000298] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-03T19:06:20.020421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:06:20.454520] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:06:20.561167] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T19:06:20.790747] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-03T19:06:21.590704] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-03T19:06:22.179099] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:06:22.390714] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-03T19:06:23.190694] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-03T19:06:23.346422] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:06:23.756564] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:06:23.997487] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-03T19:06:24.006269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T19:06:24.790701] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-03T19:06:25.425742] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:06:25.590713] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-03T19:06:25.806630] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T19:06:26.390693] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-03T19:06:27.006447] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T19:06:27.190719] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-03T19:06:27.458268] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:06:27.752717] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:06:27.990797] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-03T19:06:28.790699] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-03T19:06:29.590694] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-03T19:06:29.971719] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:06:30.390679] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-03T19:06:30.567512] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:06:30.685316] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:06:30.940993] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T19:06:31.190703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-03T19:06:31.990690] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-03T19:06:32.790698] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-03T19:06:32.884138] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:06:33.074870] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:06:33.363436] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:06:33.590706] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-03T19:06:34.390637] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-03T19:06:34.710065] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:06:35.190682] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-03T19:06:36.000393] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-03T19:06:36.009028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:06:36.203312] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:06:36.204697] [INFO ] [REMOTE ] GCTS: Full fetch complete (26901 records). [2025-10-03T19:06:36.204822] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-03T19:06:36.605547] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T19:06:36.640287] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-03T19:06:36.640447] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-03T19:06:36.641501] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-03T19:06:36.641735] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-03T19:06:36.643238] [DEBUG] [LOCAL ] GCTS: Trimmed 26901 records to 20197 (keeping 200 days of data) [2025-10-03T19:06:36.775322] [DEBUG] [LOCAL ] GCTS: Primary data saved (20197 records). [2025-10-03T19:06:36.775453] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-03T19:06:36.775566] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCTS took 33.3s. Estimated remaining: 3h 25m 12s. Rate: 7.1 symbols/min [2025-10-03T19:06:36.797577] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-03T19:06:36.969404] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:36.974404] [DEBUG] [LOCAL ] GDL: Loaded 2576 existing records from primary storage. [2025-10-03T19:06:36.974593] [INFO ] [MAIN ] GDL: Loaded 2576 existing records. [2025-10-03T19:06:37.181962] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:37.182272] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-03T19:06:37.182365] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-03T19:06:37.182847] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-03T19:06:37.182909] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-03T19:06:37.567121] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:37.590619] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-03T19:06:38.071722] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:06:38.390636] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-03T19:06:38.649593] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:06:38.855321] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T19:06:39.190727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-03T19:06:39.700379] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:06:39.990688] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-03T19:06:40.479600] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T19:06:40.790708] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-03T19:06:41.590709] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-03T19:06:42.390706] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-03T19:06:42.595150] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:06:42.815419] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:06:43.020875] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T19:06:43.190751] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-03T19:06:43.783745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:06:43.784688] [INFO ] [REMOTE ] GDIV: Full fetch complete (5468 records). [2025-10-03T19:06:43.784782] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-03T19:06:43.995843] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-03T19:06:44.182465] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-03T19:06:44.182552] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-03T19:06:44.182749] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-03T19:06:44.182830] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-03T19:06:44.183273] [DEBUG] [LOCAL ] GDIV: Trimmed 5468 records to 3667 (keeping 200 days of data) [2025-10-03T19:06:44.211169] [DEBUG] [LOCAL ] GDIV: Primary data saved (3667 records). [2025-10-03T19:06:44.211322] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-03T19:06:44.211429] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDIV took 27.5s. Estimated remaining: 3h 25m 2s. Rate: 7.1 symbols/min [2025-10-03T19:06:44.397201] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:44.406803] [DEBUG] [LOCAL ] GDO: Loaded 6027 existing records from primary storage. [2025-10-03T19:06:44.407080] [INFO ] [MAIN ] GDO: Loaded 6027 existing records. [2025-10-03T19:06:44.576968] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T19:06:44.632888] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:44.633111] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-03T19:06:44.633162] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-03T19:06:44.633570] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-03T19:06:44.633634] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-03T19:06:44.799899] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-03T19:06:45.011293] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:45.590685] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-03T19:06:46.020122] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T19:06:46.390712] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-03T19:06:46.785097] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:06:47.190729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-03T19:06:47.971451] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:06:47.990605] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-03T19:06:48.084342] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:06:48.384303] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T19:06:48.790702] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-03T19:06:49.590730] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-03T19:06:50.218380] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:06:50.395801] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-03T19:06:50.409956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:06:51.116449] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T19:06:51.190626] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-03T19:06:51.990692] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-03T19:06:52.451990] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T19:06:52.790675] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-03T19:06:52.911254] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:06:53.590735] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-03T19:06:54.390633] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-03T19:06:54.447636] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:06:54.954202] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:06:55.108597] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:06:55.111588] [INFO ] [REMOTE ] GD: Full fetch complete (70233 records). [2025-10-03T19:06:55.111736] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-03T19:06:55.195971] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-03T19:06:55.576827] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-03T19:06:55.576941] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-03T19:06:55.578197] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-03T19:06:55.578273] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-03T19:06:55.579827] [DEBUG] [LOCAL ] GD: Trimmed 70233 records to 47780 (keeping 200 days of data) [2025-10-03T19:06:55.703243] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:06:55.916130] [DEBUG] [LOCAL ] GD: Primary data saved (47780 records). [2025-10-03T19:06:55.916276] [INFO ] [MAIN ] GD: Full history saved. [2025-10-03T19:06:55.916367] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GD took 47.0s. Estimated remaining: 3h 24m 59s. Rate: 7.1 symbols/min [2025-10-03T19:06:55.995872] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-03T19:06:56.101172] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:56.137551] [DEBUG] [LOCAL ] GDOT: Loaded 38623 existing records from primary storage. [2025-10-03T19:06:56.137874] [INFO ] [MAIN ] GDOT: Loaded 38623 existing records. [2025-10-03T19:06:56.337890] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:56.338129] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-03T19:06:56.338184] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-03T19:06:56.339430] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-03T19:06:56.339491] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-03T19:06:56.712840] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T19:06:56.726811] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:56.790720] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-03T19:06:57.590728] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-03T19:06:58.091752] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:06:58.390719] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-03T19:06:59.100134] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T19:06:59.190735] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-03T19:06:59.272269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:06:59.990741] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-03T19:07:00.538382] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:07:00.539160] [INFO ] [REMOTE ] GDL: Full fetch complete (3632 records). [2025-10-03T19:07:00.539265] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-03T19:07:00.674601] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:07:00.798294] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-03T19:07:00.964485] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-03T19:07:00.964566] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-03T19:07:00.964721] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-03T19:07:00.964783] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-03T19:07:00.965170] [DEBUG] [LOCAL ] GDL: Trimmed 3632 records to 2587 (keeping 200 days of data) [2025-10-03T19:07:00.981934] [DEBUG] [LOCAL ] GDL: Primary data saved (2587 records). [2025-10-03T19:07:00.982030] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-03T19:07:00.982154] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDL took 24.2s. Estimated remaining: 3h 24m 45s. Rate: 7.1 symbols/min [2025-10-03T19:07:01.170223] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:01.192318] [DEBUG] [LOCAL ] GDV: Loaded 19585 existing records from primary storage. [2025-10-03T19:07:01.192611] [INFO ] [MAIN ] GDV: Loaded 19585 existing records. [2025-10-03T19:07:01.384460] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:01.384739] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-03T19:07:01.384805] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-03T19:07:01.385034] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-03T19:07:01.385093] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-03T19:07:01.516784] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:07:01.594139] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-03T19:07:01.812429] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:02.390752] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-03T19:07:03.016515] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T19:07:03.016324] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T19:07:03.190725] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-03T19:07:03.778246] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T19:07:03.990715] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-03T19:07:04.790703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-03T19:07:05.076732] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:07:05.590743] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-03T19:07:06.254468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:07:06.261197] [INFO ] [REMOTE ] GDDY: Full fetch complete (71580 records). [2025-10-03T19:07:06.261370] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-03T19:07:06.382950] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:07:06.395761] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-03T19:07:06.717958] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-03T19:07:06.718047] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-03T19:07:06.718974] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-03T19:07:06.719045] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-03T19:07:06.720579] [DEBUG] [LOCAL ] GDDY: Trimmed 71580 records to 50457 (keeping 200 days of data) [2025-10-03T19:07:07.040978] [DEBUG] [LOCAL ] GDDY: Primary data saved (50457 records). [2025-10-03T19:07:07.041135] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-03T19:07:07.041227] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GDDY took 52.0s. Estimated remaining: 3h 24m 33s. Rate: 7.1 symbols/min [2025-10-03T19:07:07.197861] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-03T19:07:07.235312] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:07.295690] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-10-03T19:07:07.296076] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-10-03T19:07:07.487698] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:07.487959] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-03T19:07:07.488006] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-03T19:07:07.488511] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-03T19:07:07.488571] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-03T19:07:07.881471] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:07.915267] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:07:07.990686] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-03T19:07:08.228849] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:07:08.590542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T19:07:08.790716] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-03T19:07:09.590695] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-03T19:07:10.203248] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T19:07:10.390688] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-03T19:07:11.190689] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-03T19:07:11.359389] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T19:07:11.605853] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T19:07:11.990706] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-03T19:07:12.549827] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:07:12.551116] [INFO ] [REMOTE ] GDO: Full fetch complete (9108 records). [2025-10-03T19:07:12.551226] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-03T19:07:12.794690] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-03T19:07:12.889463] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:07:13.013282] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-03T19:07:13.013360] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-03T19:07:13.013580] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-03T19:07:13.013620] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-03T19:07:13.014108] [DEBUG] [LOCAL ] GDO: Trimmed 9108 records to 6068 (keeping 200 days of data) [2025-10-03T19:07:13.053876] [DEBUG] [LOCAL ] GDO: Primary data saved (6068 records). [2025-10-03T19:07:13.054012] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-03T19:07:13.054148] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDO took 28.8s. Estimated remaining: 3h 24m 21s. Rate: 7.1 symbols/min [2025-10-03T19:07:13.229400] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:13.252800] [DEBUG] [LOCAL ] GEF: Loaded 20830 existing records from primary storage. [2025-10-03T19:07:13.253080] [INFO ] [MAIN ] GEF: Loaded 20830 existing records. [2025-10-03T19:07:13.444512] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:13.444783] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-03T19:07:13.444837] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-03T19:07:13.445067] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-03T19:07:13.445125] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-03T19:07:13.604198] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-03T19:07:13.839948] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:13.942224] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T19:07:14.390711] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-03T19:07:15.190725] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-03T19:07:15.529409] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:07:15.708349] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T19:07:15.990716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-03T19:07:16.618301] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:07:16.790689] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-03T19:07:17.235916] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T19:07:17.590713] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-03T19:07:17.801827] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:07:18.390686] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-03T19:07:19.190628] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-03T19:07:19.418468] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:07:19.695829] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T19:07:19.990729] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-03T19:07:20.764100] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T19:07:20.790739] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-03T19:07:21.590686] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-03T19:07:22.086084] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T19:07:22.199733] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:07:22.390717] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-03T19:07:22.498286] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:07:23.190686] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-03T19:07:23.990691] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-03T19:07:24.210564] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:07:24.349893] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:07:24.790735] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-03T19:07:25.520238] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:07:25.590675] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-03T19:07:25.881898] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:07:26.390689] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-03T19:07:26.756316] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:07:26.758640] [INFO ] [REMOTE ] GDOT: Full fetch complete (53187 records). [2025-10-03T19:07:26.758792] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-03T19:07:27.195785] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-03T19:07:27.218336] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-03T19:07:27.218421] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-03T19:07:27.219355] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-03T19:07:27.219425] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-03T19:07:27.220834] [DEBUG] [LOCAL ] GDOT: Trimmed 53187 records to 38866 (keeping 200 days of data) [2025-10-03T19:07:27.447735] [DEBUG] [LOCAL ] GDOT: Primary data saved (38866 records). [2025-10-03T19:07:27.447879] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-03T19:07:27.447985] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDOT took 31.5s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-03T19:07:27.629262] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:07:27.650306] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:27.690804] [DEBUG] [LOCAL ] GEL: Loaded 33312 existing records from primary storage. [2025-10-03T19:07:27.691093] [INFO ] [MAIN ] GEL: Loaded 33312 existing records. [2025-10-03T19:07:27.887304] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:27.887513] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-03T19:07:27.887562] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-03T19:07:27.887827] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-03T19:07:27.887920] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-03T19:07:27.994337] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-03T19:07:28.284530] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:28.296203] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:07:28.790680] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-03T19:07:29.590693] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-03T19:07:29.982860] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:07:30.311186] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-03T19:07:30.390674] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-03T19:07:30.663386] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T19:07:31.190692] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-03T19:07:31.990665] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-03T19:07:32.102968] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:07:32.406808] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T19:07:32.790693] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-03T19:07:32.927265] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:07:33.590716] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-03T19:07:33.664464] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T19:07:34.390713] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-03T19:07:35.190696] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-03T19:07:35.722016] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T19:07:35.792452] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T19:07:35.990618] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-03T19:07:36.243154] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:07:36.790708] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-03T19:07:37.590696] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-03T19:07:38.026972] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:07:38.202055] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T19:07:38.265880] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:07:38.267411] [INFO ] [REMOTE ] GDV: Full fetch complete (28597 records). [2025-10-03T19:07:38.267512] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-03T19:07:38.395868] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-03T19:07:38.695568] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-03T19:07:38.695720] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-03T19:07:38.696346] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-03T19:07:38.696436] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-03T19:07:38.697883] [DEBUG] [LOCAL ] GDV: Trimmed 28597 records to 19748 (keeping 200 days of data) [2025-10-03T19:07:38.822630] [DEBUG] [LOCAL ] GDV: Primary data saved (19748 records). [2025-10-03T19:07:38.822809] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-03T19:07:38.822920] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GDV took 37.8s. Estimated remaining: 3h 24m 19s. Rate: 7.1 symbols/min [2025-10-03T19:07:39.011365] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:39.075956] [DEBUG] [LOCAL ] GENI: Loaded 53320 existing records from primary storage. [2025-10-03T19:07:39.076379] [INFO ] [MAIN ] GENI: Loaded 53320 existing records. [2025-10-03T19:07:39.195848] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-03T19:07:39.322297] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:39.322510] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-03T19:07:39.322559] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-03T19:07:39.322804] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-03T19:07:39.322865] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-03T19:07:39.734473] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:39.990683] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-03T19:07:40.588088] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T19:07:40.648406] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:07:40.790688] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-03T19:07:41.595758] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-03T19:07:41.615603] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T19:07:42.390696] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-03T19:07:42.789216] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T19:07:42.791925] [INFO ] [REMOTE ] GE: Full fetch complete (77779 records). [2025-10-03T19:07:42.792038] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-03T19:07:43.111234] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:07:43.212694] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-03T19:07:43.275401] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-03T19:07:43.275515] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-03T19:07:43.289341] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-03T19:07:43.290118] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-03T19:07:43.290706] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:07:43.297831] [DEBUG] [LOCAL ] GE: Trimmed 77779 records to 54493 (keeping 200 days of data) [2025-10-03T19:07:43.661530] [DEBUG] [LOCAL ] GE: Primary data saved (54493 records). [2025-10-03T19:07:43.661800] [INFO ] [MAIN ] GE: Full history saved. [2025-10-03T19:07:43.661924] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GE took 36.6s. Estimated remaining: 3h 24m 5s. Rate: 7.1 symbols/min [2025-10-03T19:07:43.851313] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:43.902358] [DEBUG] [LOCAL ] GEO: Loaded 52324 existing records from primary storage. [2025-10-03T19:07:43.902701] [INFO ] [MAIN ] GEO: Loaded 52324 existing records. [2025-10-03T19:07:43.995873] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-03T19:07:44.098238] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:44.098464] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-03T19:07:44.098512] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-03T19:07:44.098808] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-03T19:07:44.098866] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-03T19:07:44.484158] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:44.790688] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-03T19:07:44.917448] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:07:45.280831] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:07:45.590739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-03T19:07:45.720077] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:07:46.390719] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-03T19:07:47.197509] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-03T19:07:47.204128] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:07:47.990680] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-03T19:07:48.256901] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:07:48.461075] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T19:07:48.790713] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-03T19:07:49.535090] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T19:07:49.590721] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-03T19:07:50.390624] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-03T19:07:50.737398] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:07:51.190638] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-03T19:07:51.442781] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:07:51.447519] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T19:07:51.447773] [INFO ] [REMOTE ] GEF: Full fetch complete (29533 records). [2025-10-03T19:07:51.459391] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-03T19:07:51.885305] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-03T19:07:51.885409] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-03T19:07:51.886075] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-03T19:07:51.886143] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-03T19:07:51.887153] [DEBUG] [LOCAL ] GEF: Trimmed 29533 records to 20967 (keeping 200 days of data) [2025-10-03T19:07:51.990882] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-03T19:07:52.028260] [DEBUG] [LOCAL ] GEF: Primary data saved (20967 records). [2025-10-03T19:07:52.030934] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-03T19:07:52.031109] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GEF took 39.0s. Estimated remaining: 3h 23m 56s. Rate: 7.1 symbols/min [2025-10-03T19:07:52.210680] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:52.257316] [DEBUG] [LOCAL ] GES: Loaded 39655 existing records from primary storage. [2025-10-03T19:07:52.257720] [INFO ] [MAIN ] GES: Loaded 39655 existing records. [2025-10-03T19:07:52.442816] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:52.443033] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-03T19:07:52.443081] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-03T19:07:52.443433] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-03T19:07:52.443493] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-03T19:07:52.802927] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-03T19:07:52.825425] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:52.882105] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:07:53.442579] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:07:53.590716] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-03T19:07:54.390720] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-03T19:07:54.575069] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:07:54.836843] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:07:55.190697] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-03T19:07:55.795859] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:07:55.990686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-03T19:07:56.790726] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-03T19:07:56.846394] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T19:07:57.599375] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-03T19:07:57.621332] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:07:57.817834] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:07:58.390714] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-03T19:07:59.190673] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-03T19:07:59.412165] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:07:59.639193] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T19:07:59.990724] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-03T19:08:00.233735] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:08:00.235338] [INFO ] [REMOTE ] GEL: Full fetch complete (48489 records). [2025-10-03T19:08:00.235424] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-03T19:08:00.636094] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-03T19:08:00.636178] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-03T19:08:00.636863] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-03T19:08:00.636928] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-03T19:08:00.637925] [DEBUG] [LOCAL ] GEL: Trimmed 48489 records to 33461 (keeping 200 days of data) [2025-10-03T19:08:00.799009] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-03T19:08:00.852676] [DEBUG] [LOCAL ] GEL: Primary data saved (33461 records). [2025-10-03T19:08:00.852892] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-03T19:08:00.853175] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GEL took 33.4s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-10-03T19:08:01.037860] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:01.079287] [DEBUG] [LOCAL ] GETY: Loaded 35780 existing records from primary storage. [2025-10-03T19:08:01.079586] [INFO ] [MAIN ] GETY: Loaded 35780 existing records. [2025-10-03T19:08:01.272056] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:01.272266] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-03T19:08:01.272314] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-03T19:08:01.272602] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-03T19:08:01.272709] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-03T19:08:01.592338] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-03T19:08:01.689232] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:01.719870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T19:08:02.390685] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-03T19:08:02.446433] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:08:03.190693] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-03T19:08:03.360720] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T19:08:03.824151] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:08:03.990696] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-03T19:08:04.596259] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T19:08:04.790720] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-03T19:08:05.590681] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-03T19:08:05.665810] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:08:06.390710] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-03T19:08:06.636895] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:08:07.193991] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-03T19:08:07.202186] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T19:08:07.990625] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-03T19:08:08.100885] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:08:08.587689] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T19:08:08.591000] [INFO ] [REMOTE ] GENI: Full fetch complete (75515 records). [2025-10-03T19:08:08.591132] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-03T19:08:08.795762] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-03T19:08:09.038240] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-03T19:08:09.038368] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-03T19:08:09.039340] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-03T19:08:09.039410] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-03T19:08:09.041197] [DEBUG] [LOCAL ] GENI: Trimmed 75515 records to 53710 (keeping 200 days of data) [2025-10-03T19:08:09.381444] [DEBUG] [LOCAL ] GENI: Primary data saved (53710 records). [2025-10-03T19:08:09.381600] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-03T19:08:09.381734] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GENI took 30.6s. Estimated remaining: 3h 23m 40s. Rate: 7.1 symbols/min [2025-10-03T19:08:09.566715] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:09.600799] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-03T19:08:09.623192] [DEBUG] [LOCAL ] GEV: Loaded 53424 existing records from primary storage. [2025-10-03T19:08:09.623522] [INFO ] [MAIN ] GEV: Loaded 53424 existing records. [2025-10-03T19:08:09.828668] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:09.829087] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-03T19:08:09.829162] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-03T19:08:09.829552] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-03T19:08:09.829615] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-03T19:08:10.121765] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T19:08:10.269929] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:10.390711] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-03T19:08:10.441430] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:08:11.035277] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:08:11.190714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-03T19:08:11.990633] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-03T19:08:12.380572] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T19:08:12.790736] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-03T19:08:12.857680] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:08:13.604504] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-03T19:08:13.633752] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:08:14.242480] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:08:14.245131] [INFO ] [REMOTE ] GEO: Full fetch complete (75458 records). [2025-10-03T19:08:14.245240] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-03T19:08:14.404913] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-03T19:08:14.691390] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-03T19:08:14.691489] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-03T19:08:14.692490] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-03T19:08:14.692561] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-03T19:08:14.694286] [DEBUG] [LOCAL ] GEO: Trimmed 75458 records to 52673 (keeping 200 days of data) [2025-10-03T19:08:15.031957] [DEBUG] [LOCAL ] GEO: Primary data saved (52673 records). [2025-10-03T19:08:15.032361] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-03T19:08:15.032508] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GEO took 31.4s. Estimated remaining: 3h 23m 27s. Rate: 7.1 symbols/min [2025-10-03T19:08:15.199432] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-03T19:08:15.235834] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:15.265441] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:08:15.277576] [DEBUG] [LOCAL ] GF: Loaded 2981 existing records from primary storage. [2025-10-03T19:08:15.278580] [INFO ] [MAIN ] GF: Loaded 2981 existing records. [2025-10-03T19:08:15.484027] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:15.484393] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-03T19:08:15.484459] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-03T19:08:15.484618] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-03T19:08:15.484761] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-03T19:08:15.908463] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:15.990686] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-03T19:08:16.056988] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T19:08:16.790718] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-03T19:08:17.590734] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-03T19:08:17.657797] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-03T19:08:17.713243] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:08:18.216032] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T19:08:18.239770] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:08:18.390710] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-03T19:08:18.985871] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:08:19.190704] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-03T19:08:19.762852] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:08:19.990707] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-03T19:08:20.790747] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-03T19:08:21.473997] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:08:21.590686] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-03T19:08:22.390699] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-03T19:08:23.065069] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:08:23.089932] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:08:23.129041] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T19:08:23.190698] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-03T19:08:23.990703] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-03T19:08:24.790721] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-03T19:08:25.316613] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:08:25.537772] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-03T19:08:25.586383] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:08:25.594729] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-03T19:08:26.390700] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-03T19:08:27.056597] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:08:27.190693] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-03T19:08:27.843921] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T19:08:27.867605] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:08:27.990713] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-03T19:08:28.790704] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-03T19:08:29.393243] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:08:29.590723] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-03T19:08:30.176716] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:08:30.390697] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-03T19:08:31.190715] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-03T19:08:31.600133] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:08:31.602732] [INFO ] [REMOTE ] GES: Full fetch complete (59391 records). [2025-10-03T19:08:31.603021] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-03T19:08:31.857272] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T19:08:31.998388] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-03T19:08:32.104208] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-03T19:08:32.104299] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-03T19:08:32.105190] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-03T19:08:32.105258] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-03T19:08:32.106679] [DEBUG] [LOCAL ] GES: Trimmed 59391 records to 39908 (keeping 200 days of data) [2025-10-03T19:08:32.379104] [DEBUG] [LOCAL ] GES: Primary data saved (39908 records). [2025-10-03T19:08:32.379320] [INFO ] [MAIN ] GES: Full history saved. [2025-10-03T19:08:32.380289] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GES took 40.3s. Estimated remaining: 3h 23m 33s. Rate: 7.1 symbols/min [2025-10-03T19:08:32.508690] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T19:08:32.790676] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-03T19:08:33.273426] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T19:08:33.590718] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-03T19:08:34.037190] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:08:34.390678] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-03T19:08:34.492500] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-03T19:08:35.190734] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-03T19:08:35.602282] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:08:35.604411] [INFO ] [REMOTE ] GETY: Full fetch complete (55522 records). [2025-10-03T19:08:35.604520] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-03T19:08:35.700691] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:08:35.990697] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-03T19:08:36.048159] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-03T19:08:36.048248] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-03T19:08:36.049374] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-03T19:08:36.049597] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-03T19:08:36.051185] [DEBUG] [LOCAL ] GETY: Trimmed 55522 records to 36087 (keeping 200 days of data) [2025-10-03T19:08:36.265947] [DEBUG] [LOCAL ] GETY: Primary data saved (36087 records). [2025-10-03T19:08:36.266107] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-03T19:08:36.266199] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GETY took 35.4s. Estimated remaining: 3h 23m 18s. Rate: 7.1 symbols/min [2025-10-03T19:08:36.790713] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-03T19:08:37.197737] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T19:08:37.590763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-03T19:08:38.068690] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T19:08:38.069405] [INFO ] [REMOTE ] GF: Full fetch complete (5155 records). [2025-10-03T19:08:38.069476] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-03T19:08:38.510260] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-03T19:08:38.510373] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-03T19:08:38.510585] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-03T19:08:38.510728] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-03T19:08:38.511559] [DEBUG] [LOCAL ] GF: Trimmed 5155 records to 2996 (keeping 200 days of data) [2025-10-03T19:08:38.574133] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-03T19:08:38.593144] [DEBUG] [LOCAL ] GF: Primary data saved (2996 records). [2025-10-03T19:08:38.593265] [INFO ] [MAIN ] GF: Full history saved. [2025-10-03T19:08:38.593418] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GF took 23.6s. Estimated remaining: 3h 22m 60s. Rate: 7.1 symbols/min [2025-10-03T19:08:38.593047] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-03T19:08:40.937386] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T19:08:40.950072] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-03T19:08:43.395989] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-03T19:08:43.419575] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-03T19:08:45.843060] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-03T19:08:45.855220] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-03T19:08:48.097244] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-03T19:08:48.100074] [INFO ] [REMOTE ] GEV: Full fetch complete (76913 records). [2025-10-03T19:08:48.100195] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-03T19:08:48.537559] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-03T19:08:48.537679] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-03T19:08:48.538903] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-03T19:08:48.538973] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-03T19:08:48.540600] [DEBUG] [LOCAL ] GEV: Trimmed 76913 records to 53810 (keeping 200 days of data) [2025-10-03T19:08:48.896869] [DEBUG] [LOCAL ] GEV: Primary data saved (53810 records). [2025-10-03T19:08:48.897017] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-03T19:08:48.897102] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 39.5s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-03T19:08:49.646141] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.692976] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.635179] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.694681] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.710066] [DEBUG] [LOCAL ] GFR: Loaded 8355 existing records from primary storage. [2025-10-03T19:08:49.710532] [INFO ] [MAIN ] GFR: Loaded 8355 existing records. [2025-10-03T19:08:49.940548] [DEBUG] [LOCAL ] GFF: Loaded 30582 existing records from primary storage. [2025-10-03T19:08:49.966946] [INFO ] [MAIN ] GFF: Loaded 30582 existing records. [2025-10-03T19:08:49.966015] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.069919] [DEBUG] [LOCAL ] GFI: Loaded 53491 existing records from primary storage. [2025-10-03T19:08:50.068988] [DEBUG] [LOCAL ] GFL: Loaded 48290 existing records from primary storage. [2025-10-03T19:08:49.997282] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.085820] [INFO ] [MAIN ] GFL: Loaded 48290 existing records. [2025-10-03T19:08:50.096345] [INFO ] [MAIN ] GFI: Loaded 53491 existing records. [2025-10-03T19:08:50.108113] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-03T19:08:50.326291] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-03T19:08:50.348862] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-03T19:08:50.647076] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.676680] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.703989] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.697201] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.704250] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-03T19:08:50.704579] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.719887] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.720050] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-03T19:08:50.720164] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-03T19:08:50.720450] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-03T19:08:50.720381] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-03T19:08:50.742904] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-03T19:08:50.759728] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-03T19:08:50.770230] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-03T19:08:50.759821] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-03T19:08:51.961751] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.009077] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-03T19:08:52.125967] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.140125] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-03T19:08:52.196773] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.220017] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-03T19:08:52.245071] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.245579] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-03T19:08:52.810028] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:08:52.813816] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-03T19:08:53.070731] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T19:08:53.076948] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-03T19:08:53.313435] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:08:53.322902] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-03T19:08:53.559718] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:08:53.562244] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-03T19:08:53.811701] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:08:53.822837] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-03T19:08:54.286440] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:08:54.289144] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-03T19:08:54.491188] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:08:54.497940] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-03T19:08:54.816512] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:08:54.826445] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-03T19:08:55.155281] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T19:08:55.158635] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-03T19:08:55.303381] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:08:55.314442] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-03T19:08:55.535928] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:08:55.542822] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-03T19:08:55.650982] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T19:08:55.654546] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-03T19:08:56.174358] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:08:56.184872] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-03T19:08:56.414938] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:08:56.419895] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-03T19:08:56.445742] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:08:56.454021] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-03T19:08:57.016212] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:08:57.027347] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-03T19:08:57.159812] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:08:57.565710] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T19:08:57.603259] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-03T19:08:57.609996] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:08:58.224808] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T19:08:58.390681] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-03T19:08:58.853524] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:08:59.190739] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-03T19:08:59.995777] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-03T19:09:00.012852] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:09:00.649733] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T19:09:00.790717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-03T19:09:01.408379] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T19:09:01.458593] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T19:09:01.590724] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-03T19:09:02.390725] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-03T19:09:02.873002] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:09:02.920795] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:09:02.921828] [INFO ] [REMOTE ] GFR: Full fetch complete (12490 records). [2025-10-03T19:09:02.921903] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-03T19:09:03.195911] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-03T19:09:03.318191] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-03T19:09:03.318271] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-03T19:09:03.318578] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-03T19:09:03.318637] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-03T19:09:03.319162] [DEBUG] [LOCAL ] GFR: Trimmed 12490 records to 8439 (keeping 200 days of data) [2025-10-03T19:09:03.367505] [DEBUG] [LOCAL ] GFR: Primary data saved (8439 records). [2025-10-03T19:09:03.367691] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-03T19:09:03.367811] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 14.5s. Estimated remaining: 3h 22m 55s. Rate: 7.1 symbols/min [2025-10-03T19:09:03.552946] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:03.614885] [DEBUG] [LOCAL ] GGB: Loaded 51478 existing records from primary storage. [2025-10-03T19:09:03.615281] [INFO ] [MAIN ] GGB: Loaded 51478 existing records. [2025-10-03T19:09:03.809300] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:03.809551] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-03T19:09:03.809599] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-03T19:09:03.810121] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-03T19:09:03.810183] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-03T19:09:04.001437] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-03T19:09:04.203720] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:04.790630] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-03T19:09:04.839103] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:09:05.305063] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:09:05.590742] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-03T19:09:06.390708] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-03T19:09:06.633105] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:09:06.811616] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T19:09:07.190701] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-03T19:09:07.990674] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-03T19:09:08.126722] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:09:08.539083] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T19:09:08.790733] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-03T19:09:09.590625] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-03T19:09:10.068095] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:09:10.124272] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T19:09:10.390702] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-03T19:09:11.190632] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-03T19:09:11.303075] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:09:11.899125] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:09:11.990689] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-03T19:09:12.790621] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-03T19:09:12.910463] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:09:13.471285] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T19:09:13.590708] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-03T19:09:14.269318] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:09:14.390743] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-03T19:09:15.190908] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-03T19:09:15.245744] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:09:15.879251] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:09:15.990722] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-03T19:09:16.371307] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T19:09:16.790733] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-03T19:09:17.590674] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-03T19:09:17.799247] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:09:17.802941] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:09:17.814615] [INFO ] [REMOTE ] GFF: Full fetch complete (44237 records). [2025-10-03T19:09:17.815233] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-03T19:09:18.248290] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-03T19:09:18.248455] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-03T19:09:18.249224] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-03T19:09:18.249291] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-03T19:09:18.250316] [DEBUG] [LOCAL ] GFF: Trimmed 44237 records to 30788 (keeping 200 days of data) [2025-10-03T19:09:18.423526] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-03T19:09:18.469074] [DEBUG] [LOCAL ] GFF: Primary data saved (30788 records). [2025-10-03T19:09:18.469251] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-03T19:09:18.469395] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GFF took 29.6s. Estimated remaining: 3h 22m 58s. Rate: 7.1 symbols/min [2025-10-03T19:09:18.650458] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:18.690887] [DEBUG] [LOCAL ] GGG: Loaded 41247 existing records from primary storage. [2025-10-03T19:09:18.691232] [INFO ] [MAIN ] GGG: Loaded 41247 existing records. [2025-10-03T19:09:18.883917] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:18.884327] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-03T19:09:18.884388] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-03T19:09:18.884732] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-03T19:09:18.884792] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-03T19:09:19.089367] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T19:09:19.200453] [INFO ] [REMOTE ] GFL: Full fetch complete (69258 records). [2025-10-03T19:09:19.200050] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-03T19:09:19.205549] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-03T19:09:19.401852] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:19.739456] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-03T19:09:19.739555] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-03T19:09:19.740549] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-03T19:09:19.740619] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-03T19:09:19.742290] [DEBUG] [LOCAL ] GFL: Trimmed 69258 records to 48679 (keeping 200 days of data) [2025-10-03T19:09:19.990678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-03T19:09:20.051408] [DEBUG] [LOCAL ] GFL: Primary data saved (48679 records). [2025-10-03T19:09:20.051579] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-03T19:09:20.051742] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 31.2s. Estimated remaining: 3h 22m 38s. Rate: 7.1 symbols/min [2025-10-03T19:09:20.244557] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:20.262299] [DEBUG] [LOCAL ] GGT: Loaded 14175 existing records from primary storage. [2025-10-03T19:09:20.262555] [INFO ] [MAIN ] GGT: Loaded 14175 existing records. [2025-10-03T19:09:20.498857] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:20.502311] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-03T19:09:20.502393] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-03T19:09:20.502064] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T19:09:20.513515] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-03T19:09:20.514038] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-03T19:09:20.796882] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-03T19:09:20.912751] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:21.363633] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T19:09:21.406036] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:09:21.590718] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-03T19:09:22.390735] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-03T19:09:22.560216] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:09:23.190676] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-03T19:09:23.493414] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:09:23.496295] [INFO ] [REMOTE ] GFI: Full fetch complete (76435 records). [2025-10-03T19:09:23.496444] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-03T19:09:23.920587] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-03T19:09:23.920722] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-03T19:09:23.921720] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-03T19:09:23.921814] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-03T19:09:23.949346] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:09:23.949539] [DEBUG] [LOCAL ] GFI: Trimmed 76435 records to 53875 (keeping 200 days of data) [2025-10-03T19:09:24.024888] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-03T19:09:24.323786] [DEBUG] [LOCAL ] GFI: Primary data saved (53875 records). [2025-10-03T19:09:24.323947] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-03T19:09:24.324053] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 35.4s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-03T19:09:24.517059] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:24.517277] [DEBUG] [LOCAL ] GGZ: No existing data file found in primary storage. [2025-10-03T19:09:24.517324] [WARN ] [MAIN ] GGZ: No existing data found, performing full refresh instead. [2025-10-03T19:09:24.517439] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-03T19:09:24.517487] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-03T19:09:24.517531] [DEBUG] [LOCAL ] GGZ: No primary data file found to delete. [2025-10-03T19:09:24.517622] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-03T19:09:24.797018] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-03T19:09:24.814586] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:09:24.934976] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:09:24.983763] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:25.590698] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-03T19:09:26.395804] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-03T19:09:26.416084] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:09:26.998814] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T19:09:27.190676] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-03T19:09:27.482006] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:09:27.732898] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:09:27.990677] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-03T19:09:28.790697] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-03T19:09:29.468833] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T19:09:29.529011] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:09:29.590692] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-03T19:09:30.390630] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-03T19:09:30.824213] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T19:09:31.041269] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:09:31.190728] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-03T19:09:31.626007] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T19:09:31.990715] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-03T19:09:32.790713] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-03T19:09:33.590634] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-03T19:09:33.630142] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:09:34.044882] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T19:09:34.251783] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:09:34.390711] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-03T19:09:35.190714] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-03T19:09:35.224622] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T19:09:35.990729] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-03T19:09:36.524366] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:09:36.680662] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T19:09:36.683482] [INFO ] [REMOTE ] GGB: Full fetch complete (74084 records). [2025-10-03T19:09:36.683621] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-03T19:09:36.795768] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-03T19:09:37.141151] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-03T19:09:37.141245] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-03T19:09:37.142286] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-03T19:09:37.142359] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-03T19:09:37.144377] [DEBUG] [LOCAL ] GGB: Trimmed 74084 records to 51859 (keeping 200 days of data) [2025-10-03T19:09:37.476254] [DEBUG] [LOCAL ] GGB: Primary data saved (51859 records). [2025-10-03T19:09:37.476413] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-03T19:09:37.476545] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGB took 34.1s. Estimated remaining: 3h 22m 23s. Rate: 7.1 symbols/min [2025-10-03T19:09:37.593021] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-03T19:09:37.671179] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:37.676916] [DEBUG] [LOCAL ] GHC: Loaded 2690 existing records from primary storage. [2025-10-03T19:09:37.677108] [INFO ] [MAIN ] GHC: Loaded 2690 existing records. [2025-10-03T19:09:37.883151] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:37.891668] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-03T19:09:37.891762] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-03T19:09:37.892921] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-03T19:09:37.892853] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:09:37.893060] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-03T19:09:38.296069] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:38.390669] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-03T19:09:39.006755] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:09:39.039491] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:09:39.190715] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-03T19:09:39.748281] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:09:39.990688] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-03T19:09:40.790709] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-03T19:09:40.987738] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:09:41.590710] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-03T19:09:41.845369] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T19:09:42.390716] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-03T19:09:42.550126] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:09:42.826853] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:09:43.190722] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-03T19:09:43.681171] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T19:09:43.990719] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-03T19:09:44.492501] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T19:09:44.790669] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-03T19:09:45.285059] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T19:09:45.590740] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-03T19:09:46.036874] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:09:46.390681] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-03T19:09:47.190685] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-03T19:09:47.836773] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:09:47.990621] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-03T19:09:48.152846] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:09:48.370580] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T19:09:48.790670] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-03T19:09:49.241297] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:09:49.590712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-03T19:09:50.390678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-03T19:09:50.446260] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:09:51.190726] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-03T19:09:51.647165] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T19:09:51.857428] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T19:09:51.990707] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-03T19:09:52.790696] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-03T19:09:53.163414] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T19:09:53.164227] [INFO ] [REMOTE ] GGZ: Full fetch complete (4150 records). [2025-10-03T19:09:53.164304] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-03T19:09:53.487479] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:09:53.579873] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-03T19:09:53.579957] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-03T19:09:53.580093] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-03T19:09:53.580133] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-03T19:09:53.580530] [DEBUG] [LOCAL ] GGZ: Trimmed 4150 records to 2447 (keeping 200 days of data) [2025-10-03T19:09:53.592246] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-03T19:09:53.599443] [DEBUG] [LOCAL ] GGZ: Primary data saved (2447 records). [2025-10-03T19:09:53.599557] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-03T19:09:53.599670] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGZ took 29.3s. Estimated remaining: 3h 22m 26s. Rate: 7.1 symbols/min [2025-10-03T19:09:53.799521] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:53.805884] [DEBUG] [LOCAL ] GHG: Loaded 3197 existing records from primary storage. [2025-10-03T19:09:53.806104] [INFO ] [MAIN ] GHG: Loaded 3197 existing records. [2025-10-03T19:09:53.997434] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:53.997676] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-03T19:09:53.997738] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-03T19:09:53.997969] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-03T19:09:53.998030] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-03T19:09:54.397868] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:54.397976] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-03T19:09:54.604077] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:09:54.914877] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T19:09:55.190723] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-03T19:09:55.777732] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:09:55.990747] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-03T19:09:56.790717] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-03T19:09:57.151966] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T19:09:57.154211] [INFO ] [REMOTE ] GGG: Full fetch complete (59407 records). [2025-10-03T19:09:57.154332] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-03T19:09:57.268696] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:09:57.580969] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-03T19:09:57.581084] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-03T19:09:57.581866] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-03T19:09:57.581946] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-03T19:09:57.583203] [DEBUG] [LOCAL ] GGG: Trimmed 59407 records to 41546 (keeping 200 days of data) [2025-10-03T19:09:57.640866] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-03T19:09:57.854891] [DEBUG] [LOCAL ] GGG: Primary data saved (41546 records). [2025-10-03T19:09:57.855020] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-03T19:09:57.856133] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGG took 39.4s. Estimated remaining: 3h 22m 11s. Rate: 7.1 symbols/min [2025-10-03T19:09:58.043375] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:58.055041] [DEBUG] [LOCAL ] GHI: Loaded 7089 existing records from primary storage. [2025-10-03T19:09:58.057462] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:09:58.058927] [INFO ] [MAIN ] GHI: Loaded 7089 existing records. [2025-10-03T19:09:58.247225] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:58.247483] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-03T19:09:58.247536] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-03T19:09:58.247775] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-03T19:09:58.247867] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-03T19:09:58.395739] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-03T19:09:58.624826] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:58.872872] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T19:09:59.190765] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-03T19:09:59.990636] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-03T19:10:00.122540] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:10:00.456719] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T19:10:00.790690] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-03T19:10:01.516711] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:10:01.590735] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-03T19:10:02.390738] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-03T19:10:02.441945] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:10:03.011522] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T19:10:03.190702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-03T19:10:03.759173] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T19:10:03.990702] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-03T19:10:04.771758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T19:10:04.790691] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-03T19:10:05.590632] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-03T19:10:05.666964] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:10:06.178105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:10:06.390738] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-03T19:10:07.182739] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T19:10:07.184035] [INFO ] [REMOTE ] GGT: Full fetch complete (18813 records). [2025-10-03T19:10:07.184112] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-03T19:10:07.195817] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-03T19:10:07.588704] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-03T19:10:07.588788] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-03T19:10:07.589236] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-03T19:10:07.589304] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-03T19:10:07.589994] [DEBUG] [LOCAL ] GGT: Trimmed 18813 records to 14275 (keeping 200 days of data) [2025-10-03T19:10:07.681240] [DEBUG] [LOCAL ] GGT: Primary data saved (14275 records). [2025-10-03T19:10:07.681389] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-03T19:10:07.681478] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GGT took 47.6s. Estimated remaining: 3h 22m 5s. Rate: 7.1 symbols/min [2025-10-03T19:10:07.868860] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:07.869078] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:10:07.870957] [INFO ] [REMOTE ] GHC: Full fetch complete (3380 records). [2025-10-03T19:10:07.871179] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-03T19:10:07.963948] [DEBUG] [LOCAL ] GHLD: Loaded 4203 existing records from primary storage. [2025-10-03T19:10:07.994486] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-03T19:10:07.984601] [INFO ] [MAIN ] GHLD: Loaded 4203 existing records. [2025-10-03T19:10:08.382718] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:08.400493] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-03T19:10:08.424991] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-03T19:10:08.429573] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-03T19:10:08.435063] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-03T19:10:08.642584] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-03T19:10:08.653983] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-03T19:10:08.670161] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-03T19:10:08.702087] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-03T19:10:08.736477] [DEBUG] [LOCAL ] GHC: Trimmed 3380 records to 2749 (keeping 200 days of data) [2025-10-03T19:10:08.794541] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-03T19:10:08.821517] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T19:10:08.867409] [DEBUG] [LOCAL ] GHC: Primary data saved (2749 records). [2025-10-03T19:10:08.875732] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-03T19:10:08.875911] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHC took 31.4s. Estimated remaining: 3h 21m 46s. Rate: 7.1 symbols/min [2025-10-03T19:10:09.143363] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:09.179207] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:09.196320] [DEBUG] [LOCAL ] GHM: Loaded 14163 existing records from primary storage. [2025-10-03T19:10:09.196568] [INFO ] [MAIN ] GHM: Loaded 14163 existing records. [2025-10-03T19:10:09.310448] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T19:10:09.397314] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:09.397566] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-03T19:10:09.397624] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-03T19:10:09.397865] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-03T19:10:09.397966] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-03T19:10:09.596173] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-03T19:10:09.823190] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:10.390671] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-03T19:10:10.430509] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T19:10:10.929512] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T19:10:11.190688] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-03T19:10:11.607443] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T19:10:11.990684] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-03T19:10:12.790636] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-03T19:10:12.867507] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T19:10:13.460232] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T19:10:13.590697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-03T19:10:14.014190] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:10:14.390750] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-03T19:10:14.871980] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T19:10:15.190727] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-03T19:10:15.826554] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T19:10:15.990694] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-03T19:10:16.541545] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:10:16.542426] [INFO ] [REMOTE ] GHG: Full fetch complete (4054 records). [2025-10-03T19:10:16.542517] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-03T19:10:16.795812] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-03T19:10:16.971623] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-03T19:10:16.971735] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-03T19:10:16.971885] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-03T19:10:16.971927] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-03T19:10:16.972310] [DEBUG] [LOCAL ] GHG: Trimmed 4054 records to 3234 (keeping 200 days of data) [2025-10-03T19:10:16.990547] [DEBUG] [LOCAL ] GHG: Primary data saved (3234 records). [2025-10-03T19:10:16.990634] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-03T19:10:16.990757] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHG took 23.4s. Estimated remaining: 3h 21m 37s. Rate: 7.1 symbols/min [2025-10-03T19:10:17.186913] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:17.208873] [DEBUG] [LOCAL ] GHY: Loaded 20989 existing records from primary storage. [2025-10-03T19:10:17.209170] [INFO ] [MAIN ] GHY: Loaded 20989 existing records. [2025-10-03T19:10:17.402701] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:17.403028] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-03T19:10:17.403148] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-03T19:10:17.403961] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-03T19:10:17.404025] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-03T19:10:17.533715] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:10:17.591866] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-03T19:10:17.838851] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:18.003990] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T19:10:18.390739] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-03T19:10:19.158561] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:10:19.190623] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-03T19:10:19.904425] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T19:10:19.990678] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-03T19:10:20.663585] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T19:10:20.790689] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-03T19:10:21.375223] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T19:10:21.376304] [INFO ] [REMOTE ] GHI: Full fetch complete (11625 records). [2025-10-03T19:10:21.376376] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-03T19:10:21.597441] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-03T19:10:21.777315] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-03T19:10:21.777437] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-03T19:10:21.777798] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-03T19:10:21.777864] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-03T19:10:21.778638] [DEBUG] [LOCAL ] GHI: Trimmed 11625 records to 7159 (keeping 200 days of data) [2025-10-03T19:10:21.828971] [DEBUG] [LOCAL ] GHI: Primary data saved (7159 records). [2025-10-03T19:10:21.829128] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-03T19:10:21.829221] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHI took 24.0s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-03T19:10:22.028189] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:22.067315] [DEBUG] [LOCAL ] GIB: Loaded 32317 existing records from primary storage. [2025-10-03T19:10:22.067716] [INFO ] [MAIN ] GIB: Loaded 32317 existing records. [2025-10-03T19:10:22.301498] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:22.301779] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-03T19:10:22.301841] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-03T19:10:22.303167] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-03T19:10:22.303232] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-03T19:10:22.395805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-03T19:10:22.726571] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:22.740232] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T19:10:22.908281] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T19:10:23.190701] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-03T19:10:23.990685] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-03T19:10:24.285545] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:10:24.467584] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T19:10:24.790689] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-03T19:10:25.045843] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-03T19:10:25.590697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-03T19:10:26.172192] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T19:10:26.390688] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-03T19:10:27.190704] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-03T19:10:27.650193] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:10:27.766822] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T19:10:27.990677] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-03T19:10:28.790671] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-03T19:10:29.032515] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:10:29.185286] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-03T19:10:29.590693] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-03T19:10:30.390711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-03T19:10:30.488709] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T19:10:31.190712] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-03T19:10:31.678329] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:10:31.990737] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-03T19:10:32.221453] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:10:32.796721] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-03T19:10:32.799097] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:10:33.590712] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-03T19:10:33.829956] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:10:34.196000] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T19:10:34.390709] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-03T19:10:35.190736] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-03T19:10:35.380268] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:10:35.990625] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-03T19:10:36.316056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:10:36.790692] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-03T19:10:36.837669] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:10:37.590708] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-03T19:10:37.790713] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:10:38.390707] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-03T19:10:39.042033] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T19:10:39.068121] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:10:39.190716] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-03T19:10:39.778553] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:10:39.779404] [INFO ] [REMOTE ] GHLD: Full fetch complete (4808 records). [2025-10-03T19:10:39.779480] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-03T19:10:39.997919] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-03T19:10:40.187842] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-03T19:10:40.188137] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-03T19:10:40.188346] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-03T19:10:40.188410] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-03T19:10:40.188950] [DEBUG] [LOCAL ] GHLD: Trimmed 4808 records to 4227 (keeping 200 days of data) [2025-10-03T19:10:40.219725] [DEBUG] [LOCAL ] GHLD: Primary data saved (4227 records). [2025-10-03T19:10:40.219862] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-03T19:10:40.219999] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHLD took 32.5s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-03T19:10:40.406905] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:40.422831] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-03T19:10:40.423114] [INFO ] [MAIN ] GIC: Loaded 13577 existing records. [2025-10-03T19:10:40.626978] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:40.627247] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-03T19:10:40.627299] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-03T19:10:40.627917] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-03T19:10:40.627980] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-03T19:10:40.790764] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-03T19:10:41.040706] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T19:10:41.047482] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:41.590708] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-03T19:10:41.884671] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:10:42.390737] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-03T19:10:42.559538] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:10:43.190731] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-03T19:10:43.355391] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:10:43.990680] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-03T19:10:44.141450] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:10:44.790701] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-03T19:10:44.962728] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:10:45.590707] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-03T19:10:45.635635] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T19:10:46.390696] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-03T19:10:46.530458] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T19:10:47.190634] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-03T19:10:47.337039] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:10:47.990699] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-03T19:10:48.635412] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:10:48.790698] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-03T19:10:48.824212] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:10:48.826020] [INFO ] [REMOTE ] GHY: Full fetch complete (32283 records). [2025-10-03T19:10:48.826103] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-03T19:10:49.264359] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-03T19:10:49.264449] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-03T19:10:49.265076] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-03T19:10:49.265147] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-03T19:10:49.266059] [DEBUG] [LOCAL ] GHY: Trimmed 32283 records to 21190 (keeping 200 days of data) [2025-10-03T19:10:49.404511] [DEBUG] [LOCAL ] GHY: Primary data saved (21190 records). [2025-10-03T19:10:49.404673] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-03T19:10:49.404796] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GHY took 32.4s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-03T19:10:49.594490] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-03T19:10:49.594411] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:49.639886] [DEBUG] [LOCAL ] GIL: Loaded 43689 existing records from primary storage. [2025-10-03T19:10:49.640309] [INFO ] [MAIN ] GIL: Loaded 43689 existing records. [2025-10-03T19:10:49.840837] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:49.851607] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-03T19:10:49.851763] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-03T19:10:49.852919] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:10:49.857538] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-03T19:10:49.857682] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-03T19:10:50.244250] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:50.390682] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-03T19:10:50.593900] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T19:10:51.190733] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-03T19:10:51.203392] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:10:51.990674] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-03T19:10:52.380115] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:10:52.550949] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T19:10:52.790720] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-03T19:10:53.590738] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-03T19:10:54.015740] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:10:54.390695] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-03T19:10:54.535426] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:10:55.190683] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-03T19:10:55.687125] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:10:55.990758] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-03T19:10:56.004137] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:10:56.790720] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-03T19:10:57.501077] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:10:57.519468] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T19:10:57.520631] [INFO ] [REMOTE ] GHM: Full fetch complete (21801 records). [2025-10-03T19:10:57.520748] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-03T19:10:57.595864] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-03T19:10:57.928471] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-03T19:10:57.928554] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-03T19:10:57.929263] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-03T19:10:57.929341] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-03T19:10:57.930039] [DEBUG] [LOCAL ] GHM: Trimmed 21801 records to 14245 (keeping 200 days of data) [2025-10-03T19:10:58.016129] [DEBUG] [LOCAL ] GHM: Primary data saved (14245 records). [2025-10-03T19:10:58.016297] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-03T19:10:58.016482] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GHM took 49.1s. Estimated remaining: 3h 21m 14s. Rate: 7.1 symbols/min [2025-10-03T19:10:58.194635] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:58.251247] [DEBUG] [LOCAL ] GIS: Loaded 54062 existing records from primary storage. [2025-10-03T19:10:58.251631] [INFO ] [MAIN ] GIS: Loaded 54062 existing records. [2025-10-03T19:10:58.399942] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-03T19:10:58.446329] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:58.446576] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-03T19:10:58.446626] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-03T19:10:58.449659] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-03T19:10:58.449781] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-03T19:10:58.843742] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:58.950026] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T19:10:59.190708] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-03T19:10:59.334788] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T19:10:59.990712] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-03T19:11:00.790701] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-03T19:11:00.943600] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:11:01.186019] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:11:01.590715] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-03T19:11:02.309394] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T19:11:02.354978] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:11:02.390713] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-03T19:11:03.190741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-03T19:11:03.816079] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:11:03.817197] [INFO ] [REMOTE ] GIC: Full fetch complete (20159 records). [2025-10-03T19:11:03.817281] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-03T19:11:03.993539] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-03T19:11:04.292973] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-03T19:11:04.293245] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-03T19:11:04.294012] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-03T19:11:04.294433] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-03T19:11:04.296588] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T19:11:04.308830] [DEBUG] [LOCAL ] GIC: Trimmed 20159 records to 13632 (keeping 200 days of data) [2025-10-03T19:11:04.397409] [DEBUG] [LOCAL ] GIC: Primary data saved (13632 records). [2025-10-03T19:11:04.397561] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-03T19:11:04.397692] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GIC took 24.2s. Estimated remaining: 3h 21m 3s. Rate: 7.1 symbols/min [2025-10-03T19:11:04.585464] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:04.630009] [DEBUG] [LOCAL ] GKOS: Loaded 42984 existing records from primary storage. [2025-10-03T19:11:04.630334] [INFO ] [MAIN ] GKOS: Loaded 42984 existing records. [2025-10-03T19:11:04.795811] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-03T19:11:04.826496] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:04.827842] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-03T19:11:04.827939] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-03T19:11:04.829197] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-03T19:11:04.829264] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-03T19:11:05.235771] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:05.459715] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T19:11:05.590700] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-03T19:11:06.390678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-03T19:11:06.498509] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:11:07.031945] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:11:07.190748] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-03T19:11:07.830238] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T19:11:07.990737] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-03T19:11:08.579893] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:11:08.790714] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-03T19:11:09.590686] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-03T19:11:09.784485] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:11:09.972926] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:11:09.974894] [INFO ] [REMOTE ] GIB: Full fetch complete (45738 records). [2025-10-03T19:11:09.974991] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-03T19:11:10.383185] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-03T19:11:10.383276] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-03T19:11:10.384014] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-03T19:11:10.384083] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-03T19:11:10.385216] [DEBUG] [LOCAL ] GIB: Trimmed 45738 records to 32516 (keeping 200 days of data) [2025-10-03T19:11:10.390702] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-03T19:11:10.615258] [DEBUG] [LOCAL ] GIB: Primary data saved (32516 records). [2025-10-03T19:11:10.615428] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-03T19:11:10.617773] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIB took 48.8s. Estimated remaining: 3h 20m 51s. Rate: 7.1 symbols/min [2025-10-03T19:11:10.796626] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:10.841626] [DEBUG] [LOCAL ] GL: Loaded 38054 existing records from primary storage. [2025-10-03T19:11:10.841990] [INFO ] [MAIN ] GL: Loaded 38054 existing records. [2025-10-03T19:11:11.032812] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:11.033169] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-03T19:11:11.033220] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-03T19:11:11.034436] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-03T19:11:11.034499] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-03T19:11:11.201357] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-03T19:11:11.440792] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:11.471863] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:11:11.960094] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T19:11:11.990627] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-03T19:11:12.653519] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:11:12.790730] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-03T19:11:13.556973] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:11:13.590690] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-03T19:11:14.390675] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-03T19:11:14.676550] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:11:14.923259] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:11:15.190694] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-03T19:11:15.893844] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T19:11:15.990697] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-03T19:11:16.262729] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:11:16.790693] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-03T19:11:17.410169] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:11:17.590700] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-03T19:11:18.319607] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:11:18.390716] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-03T19:11:18.900838] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:11:19.190730] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-03T19:11:19.990704] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-03T19:11:20.282660] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:11:20.706296] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:11:20.790678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-03T19:11:21.590707] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-03T19:11:21.656231] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:11:22.225363] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:11:22.390691] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-03T19:11:23.190667] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-03T19:11:23.243572] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:11:23.713296] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:11:23.990694] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-03T19:11:24.790686] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-03T19:11:24.997975] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:11:25.038228] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T19:11:25.590679] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-03T19:11:25.870398] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T19:11:26.390704] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-03T19:11:26.955667] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:11:27.190699] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-03T19:11:27.352368] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:11:27.355133] [INFO ] [REMOTE ] GIL: Full fetch complete (61556 records). [2025-10-03T19:11:27.355287] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-03T19:11:27.814352] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-03T19:11:27.814452] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-03T19:11:27.815267] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-03T19:11:27.815335] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-03T19:11:27.816700] [DEBUG] [LOCAL ] GIL: Trimmed 61556 records to 44048 (keeping 200 days of data) [2025-10-03T19:11:27.995925] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-03T19:11:28.096685] [DEBUG] [LOCAL ] GIL: Primary data saved (44048 records). [2025-10-03T19:11:28.096837] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-03T19:11:28.096935] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GIL took 38.7s. Estimated remaining: 3h 20m 57s. Rate: 7.1 symbols/min [2025-10-03T19:11:28.287328] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:28.332822] [DEBUG] [LOCAL ] GLOB: Loaded 47963 existing records from primary storage. [2025-10-03T19:11:28.333160] [INFO ] [MAIN ] GLOB: Loaded 47963 existing records. [2025-10-03T19:11:28.539201] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:28.539420] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-03T19:11:28.539469] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-03T19:11:28.541333] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-03T19:11:28.541398] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-03T19:11:28.795362] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-03T19:11:28.980858] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:29.052233] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:11:29.089484] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T19:11:29.590730] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-03T19:11:30.079541] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:11:30.082016] [INFO ] [REMOTE ] GKOS: Full fetch complete (60060 records). [2025-10-03T19:11:30.082133] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-03T19:11:30.395757] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-03T19:11:30.510867] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-03T19:11:30.510957] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-03T19:11:30.511785] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-03T19:11:30.511908] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-03T19:11:30.513332] [DEBUG] [LOCAL ] GKOS: Trimmed 60060 records to 43313 (keeping 200 days of data) [2025-10-03T19:11:30.799730] [DEBUG] [LOCAL ] GKOS: Primary data saved (43313 records). [2025-10-03T19:11:30.799863] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-03T19:11:30.799967] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GKOS took 26.4s. Estimated remaining: 3h 20m 40s. Rate: 7.1 symbols/min [2025-10-03T19:11:30.940416] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:11:31.012048] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:31.012246] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-10-03T19:11:31.012286] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-10-03T19:11:31.012428] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-03T19:11:31.012497] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-03T19:11:31.012557] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-10-03T19:11:31.012594] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-03T19:11:31.206589] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-03T19:11:31.421114] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:31.767732] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:11:31.770905] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-03T19:11:31.771075] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-03T19:11:31.999882] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-03T19:11:32.207704] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-03T19:11:32.207807] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-03T19:11:32.208820] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-03T19:11:32.208918] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-03T19:11:32.210676] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54452 (keeping 200 days of data) [2025-10-03T19:11:32.340392] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:11:32.609684] [DEBUG] [LOCAL ] GIS: Primary data saved (54452 records). [2025-10-03T19:11:32.610139] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-03T19:11:32.610331] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GIS took 34.6s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-03T19:11:32.797715] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-03T19:11:32.802222] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:32.856538] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-03T19:11:32.856994] [INFO ] [MAIN ] GLW: Loaded 54026 existing records. [2025-10-03T19:11:32.992050] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T19:11:33.088282] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:33.088670] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-03T19:11:33.088746] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-03T19:11:33.089099] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-03T19:11:33.089158] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-03T19:11:33.468562] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:33.590703] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-03T19:11:34.346971] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:11:34.390697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-03T19:11:35.190675] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-03T19:11:35.454491] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:11:35.820564] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:11:35.990740] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-03T19:11:36.575974] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:11:36.790676] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-03T19:11:37.471678] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T19:11:37.590729] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-03T19:11:38.308840] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:11:38.390733] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-03T19:11:38.869334] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:11:39.190705] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-03T19:11:39.947886] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T19:11:39.990715] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-03T19:11:40.025772] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:11:40.790709] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-03T19:11:41.590709] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-03T19:11:41.867136] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:11:42.099191] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:11:42.207594] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:11:42.390729] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-03T19:11:43.136251] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:11:43.190705] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-03T19:11:43.990749] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-03T19:11:44.738811] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:11:44.790721] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-03T19:11:45.590699] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-03T19:11:45.696243] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:11:46.247745] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:11:46.390689] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-03T19:11:46.984450] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:11:47.190723] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-03T19:11:47.990704] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-03T19:11:48.039621] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:11:48.380917] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T19:11:48.790715] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-03T19:11:49.429969] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:11:49.590695] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-03T19:11:50.390721] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-03T19:11:50.769678] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:11:50.769450] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:11:50.783827] [INFO ] [REMOTE ] GL: Full fetch complete (55387 records). [2025-10-03T19:11:50.784020] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-03T19:11:51.197252] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-03T19:11:51.224881] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:11:51.231709] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-03T19:11:51.231812] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-03T19:11:51.232852] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-03T19:11:51.232924] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-03T19:11:51.236782] [DEBUG] [LOCAL ] GL: Trimmed 55387 records to 38326 (keeping 200 days of data) [2025-10-03T19:11:51.503434] [DEBUG] [LOCAL ] GL: Primary data saved (38326 records). [2025-10-03T19:11:51.503589] [INFO ] [MAIN ] GL: Full history saved. [2025-10-03T19:11:51.504408] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GL took 40.9s. Estimated remaining: 3h 20m 29s. Rate: 7.1 symbols/min [2025-10-03T19:11:51.734537] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:51.796867] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-10-03T19:11:51.797234] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-10-03T19:11:51.991789] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-03T19:11:51.995882] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:51.997317] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-03T19:11:51.997372] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-03T19:11:51.997839] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-03T19:11:51.997990] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-03T19:11:52.391349] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:52.741750] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:11:52.790625] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-03T19:11:53.590639] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-03T19:11:54.069792] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-03T19:11:54.336732] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:11:54.363746] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:11:54.390701] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-03T19:11:55.016022] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:11:55.190713] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-03T19:11:55.990734] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-03T19:11:56.774057] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:11:56.790606] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-03T19:11:57.590689] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-03T19:11:57.863035] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:11:58.024679] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T19:11:58.390667] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-03T19:11:58.646557] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:11:59.190725] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-03T19:11:59.990857] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-03T19:12:00.289585] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:12:00.791423] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-03T19:12:00.799288] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:12:01.079455] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:12:01.590719] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-03T19:12:02.374501] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:12:02.375532] [INFO ] [REMOTE ] GLP: Full fetch complete (14287 records). [2025-10-03T19:12:02.375611] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-03T19:12:02.398763] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-03T19:12:02.816825] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-03T19:12:02.817077] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-03T19:12:02.817460] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-03T19:12:02.817532] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-03T19:12:02.818606] [DEBUG] [LOCAL ] GLP: Trimmed 14287 records to 9445 (keeping 200 days of data) [2025-10-03T19:12:02.906899] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T19:12:02.929681] [DEBUG] [LOCAL ] GLP: Primary data saved (9445 records). [2025-10-03T19:12:02.929839] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-03T19:12:02.929945] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GLP took 32.1s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-10-03T19:12:03.127808] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:03.190624] [DEBUG] [LOCAL ] GME: Loaded 54152 existing records from primary storage. [2025-10-03T19:12:03.190750] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-03T19:12:03.192228] [INFO ] [MAIN ] GME: Loaded 54152 existing records. [2025-10-03T19:12:03.400537] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:03.400800] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-03T19:12:03.400856] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-03T19:12:03.402612] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-03T19:12:03.402703] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-03T19:12:03.808405] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:03.990689] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-03T19:12:04.125936] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:12:04.790697] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-03T19:12:05.285051] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:12:05.590734] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-03T19:12:06.384357] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T19:12:06.395926] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-03T19:12:06.562572] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:12:07.190756] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-03T19:12:07.199123] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T19:12:07.204385] [INFO ] [REMOTE ] GLOB: Full fetch complete (64350 records). [2025-10-03T19:12:07.204560] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-03T19:12:07.653486] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-03T19:12:07.653574] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-03T19:12:07.654434] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-03T19:12:07.654503] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-03T19:12:07.656394] [DEBUG] [LOCAL ] GLOB: Trimmed 64350 records to 48346 (keeping 200 days of data) [2025-10-03T19:12:07.974867] [DEBUG] [LOCAL ] GLOB: Primary data saved (48346 records). [2025-10-03T19:12:07.975021] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-03T19:12:07.975164] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GLOB took 39.9s. Estimated remaining: 3h 20m 11s. Rate: 7.1 symbols/min [2025-10-03T19:12:08.009308] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-03T19:12:08.179549] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:08.228216] [DEBUG] [LOCAL ] GMED: Loaded 48729 existing records from primary storage. [2025-10-03T19:12:08.228639] [INFO ] [MAIN ] GMED: Loaded 48729 existing records. [2025-10-03T19:12:08.433630] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:08.434243] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-03T19:12:08.434309] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-03T19:12:08.435958] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-03T19:12:08.436040] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-03T19:12:08.757090] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-03T19:12:08.826954] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-03T19:12:08.889413] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:09.518516] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T19:12:09.590705] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-03T19:12:09.965442] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:12:10.390695] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-03T19:12:10.975145] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-03T19:12:10.978929] [INFO ] [REMOTE ] GLW: Full fetch complete (77618 records). [2025-10-03T19:12:10.979086] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-03T19:12:11.204120] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-03T19:12:11.433529] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-03T19:12:11.433915] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-03T19:12:11.435013] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-03T19:12:11.435181] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-03T19:12:11.437107] [DEBUG] [LOCAL ] GLW: Trimmed 77618 records to 54416 (keeping 200 days of data) [2025-10-03T19:12:11.704200] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:12:11.753813] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-03T19:12:11.887986] [DEBUG] [LOCAL ] GLW: Primary data saved (54416 records). [2025-10-03T19:12:11.888146] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-03T19:12:11.888286] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLW took 39.3s. Estimated remaining: 3h 19m 56s. Rate: 7.1 symbols/min [2025-10-03T19:12:11.995850] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-03T19:12:12.080403] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:12.118277] [DEBUG] [LOCAL ] GMRE: Loaded 37572 existing records from primary storage. [2025-10-03T19:12:12.118623] [INFO ] [MAIN ] GMRE: Loaded 37572 existing records. [2025-10-03T19:12:12.326959] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:12.327195] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-03T19:12:12.327244] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-03T19:12:12.327532] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-03T19:12:12.327592] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-03T19:12:12.727429] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:12.790680] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-03T19:12:13.319558] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-03T19:12:13.590681] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-03T19:12:14.059521] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:12:14.390673] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-03T19:12:14.644463] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-03T19:12:15.073274] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:12:15.190704] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-03T19:12:15.990692] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-03T19:12:16.238005] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T19:12:16.720110] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:12:16.790717] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-03T19:12:17.504928] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:12:17.590704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-03T19:12:18.390740] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-03T19:12:18.778411] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:12:19.190698] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-03T19:12:19.533782] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:12:19.990670] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-03T19:12:20.159140] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-03T19:12:20.790701] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-03T19:12:21.173824] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T19:12:21.280193] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:12:21.590720] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-03T19:12:22.120131] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T19:12:22.390690] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-03T19:12:23.192138] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-03T19:12:23.198009] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:12:23.990731] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-03T19:12:24.663747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:12:24.790670] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-03T19:12:24.997703] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-03T19:12:25.590734] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-03T19:12:25.652018] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:12:26.390736] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-03T19:12:26.802363] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T19:12:27.190740] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-03T19:12:27.769984] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-03T19:12:27.881168] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:12:27.990714] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-03T19:12:28.790686] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-03T19:12:28.836107] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T19:12:28.838932] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-03T19:12:28.839063] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-03T19:12:29.306395] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-03T19:12:29.306488] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-03T19:12:29.307634] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-03T19:12:29.307726] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-03T19:12:29.309326] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-10-03T19:12:29.563813] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:12:29.590677] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-03T19:12:29.694925] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-10-03T19:12:29.695087] [INFO ] [MAIN ] GM: Full history saved. [2025-10-03T19:12:29.695703] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GM took 38.2s. Estimated remaining: 3h 20m 2s. Rate: 7.1 symbols/min [2025-10-03T19:12:29.883803] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:29.903331] [DEBUG] [LOCAL ] GNE: Loaded 17926 existing records from primary storage. [2025-10-03T19:12:29.903588] [INFO ] [MAIN ] GNE: Loaded 17926 existing records. [2025-10-03T19:12:30.100250] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:30.100511] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-03T19:12:30.100587] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-03T19:12:30.101297] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-03T19:12:30.101358] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-03T19:12:30.398412] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-03T19:12:30.488167] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:31.182397] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T19:12:31.195343] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-03T19:12:31.405126] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:12:31.692132] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T19:12:31.995753] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-03T19:12:32.014362] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:12:32.790728] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-03T19:12:33.406359] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:12:33.528864] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T19:12:33.590703] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-03T19:12:34.390718] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-03T19:12:35.051859] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:12:35.190728] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-03T19:12:35.990681] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-03T19:12:36.541357] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T19:12:36.581207] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T19:12:36.790736] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-03T19:12:37.050453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T19:12:37.053343] [INFO ] [REMOTE ] GMED: Full fetch complete (69707 records). [2025-10-03T19:12:37.053486] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-03T19:12:37.495002] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-03T19:12:37.495093] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-03T19:12:37.496106] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-03T19:12:37.496182] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-03T19:12:37.498065] [DEBUG] [LOCAL ] GMED: Trimmed 69707 records to 49085 (keeping 200 days of data) [2025-10-03T19:12:37.590854] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-03T19:12:37.803603] [DEBUG] [LOCAL ] GMED: Primary data saved (49085 records). [2025-10-03T19:12:37.803781] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-03T19:12:37.803887] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GMED took 29.8s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-03T19:12:37.996869] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:38.036094] [DEBUG] [LOCAL ] GNK: Loaded 40592 existing records from primary storage. [2025-10-03T19:12:38.036443] [INFO ] [MAIN ] GNK: Loaded 40592 existing records. [2025-10-03T19:12:38.242382] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:38.242990] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-03T19:12:38.243173] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-03T19:12:38.243456] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-03T19:12:38.243596] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-03T19:12:38.395852] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-03T19:12:38.505384] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:12:38.529834] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:12:38.728589] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:39.190725] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-03T19:12:39.965782] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:12:39.990629] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-03T19:12:40.610859] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T19:12:40.790732] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-03T19:12:41.513064] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:12:41.590734] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-03T19:12:42.166881] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:12:42.390729] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-03T19:12:42.534465] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T19:12:42.535977] [INFO ] [REMOTE ] GMRE: Full fetch complete (53233 records). [2025-10-03T19:12:42.536057] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-03T19:12:42.960735] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-03T19:12:42.960848] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-03T19:12:42.961699] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-03T19:12:42.961763] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-03T19:12:42.962979] [DEBUG] [LOCAL ] GMRE: Trimmed 53233 records to 37705 (keeping 200 days of data) [2025-10-03T19:12:43.191005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-03T19:12:43.199009] [DEBUG] [LOCAL ] GMRE: Primary data saved (37705 records). [2025-10-03T19:12:43.199118] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-03T19:12:43.199220] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GMRE took 31.3s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-03T19:12:43.283183] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:12:43.392277] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:43.434395] [DEBUG] [LOCAL ] GNL: Loaded 47148 existing records from primary storage. [2025-10-03T19:12:43.434766] [INFO ] [MAIN ] GNL: Loaded 47148 existing records. [2025-10-03T19:12:43.637737] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:43.638059] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-03T19:12:43.638122] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-03T19:12:43.638442] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-03T19:12:43.638501] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-03T19:12:44.010860] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-03T19:12:44.017412] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:44.790723] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-03T19:12:45.326075] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:12:45.392299] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-03T19:12:45.395026] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-03T19:12:45.395172] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-03T19:12:45.600888] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-03T19:12:45.822243] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-03T19:12:45.822356] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-03T19:12:45.823331] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-03T19:12:45.823397] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-03T19:12:45.825526] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54542 (keeping 200 days of data) [2025-10-03T19:12:46.182404] [DEBUG] [LOCAL ] GME: Primary data saved (54542 records). [2025-10-03T19:12:46.182619] [INFO ] [MAIN ] GME: Full history saved. [2025-10-03T19:12:46.182809] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GME took 43.3s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-03T19:12:46.361250] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:46.391594] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:12:46.391709] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-03T19:12:46.441876] [DEBUG] [LOCAL ] GNRC: Loaded 45434 existing records from primary storage. [2025-10-03T19:12:46.442204] [INFO ] [MAIN ] GNRC: Loaded 45434 existing records. [2025-10-03T19:12:46.641938] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:46.642167] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-03T19:12:46.642217] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-03T19:12:46.642455] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-03T19:12:46.642515] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-03T19:12:47.048884] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:47.086149] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:12:47.190716] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-03T19:12:47.366535] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T19:12:47.990737] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-03T19:12:48.790705] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-03T19:12:48.867407] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:12:49.524526] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:12:49.590678] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-03T19:12:50.111510] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T19:12:50.353623] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:12:50.390693] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-03T19:12:51.190717] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-03T19:12:51.494680] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T19:12:51.990697] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-03T19:12:52.650253] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:12:52.790690] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-03T19:12:52.967401] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:12:53.590734] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-03T19:12:54.337940] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T19:12:54.390624] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-03T19:12:55.028226] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:12:55.067467] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T19:12:55.190719] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-03T19:12:55.990695] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-03T19:12:56.639832] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:12:56.790719] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-03T19:12:57.314579] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:12:57.590745] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-03T19:12:58.354811] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:12:58.390631] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-03T19:12:59.182571] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:12:59.192519] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-03T19:12:59.990683] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-03T19:13:00.076119] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:13:00.545134] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:13:00.790712] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-03T19:13:00.977048] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:13:00.978378] [INFO ] [REMOTE ] GNE: Full fetch complete (22497 records). [2025-10-03T19:13:00.978459] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-03T19:13:01.376856] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-03T19:13:01.376983] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-03T19:13:01.377545] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-03T19:13:01.377612] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-03T19:13:01.378341] [DEBUG] [LOCAL ] GNE: Trimmed 22497 records to 18024 (keeping 200 days of data) [2025-10-03T19:13:01.513677] [DEBUG] [LOCAL ] GNE: Primary data saved (18024 records). [2025-10-03T19:13:01.513876] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-03T19:13:01.514030] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GNE took 31.8s. Estimated remaining: 3h 19m 25s. Rate: 7.1 symbols/min [2025-10-03T19:13:01.598337] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-03T19:13:01.725419] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:01.737944] [DEBUG] [LOCAL ] GNT: Loaded 8217 existing records from primary storage. [2025-10-03T19:13:01.738263] [INFO ] [MAIN ] GNT: Loaded 8217 existing records. [2025-10-03T19:13:01.938052] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:01.938282] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-03T19:13:01.938372] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-03T19:13:01.938626] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-03T19:13:01.938724] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-03T19:13:02.336347] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:02.362142] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:13:02.390626] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-03T19:13:03.010283] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:13:03.192853] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-03T19:13:03.195901] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:13:03.990713] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-03T19:13:04.790709] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-03T19:13:04.835858] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:13:05.424314] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:13:05.590700] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-03T19:13:06.389281] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:13:06.398590] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-03T19:13:07.048722] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T19:13:07.190729] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-03T19:13:07.403709] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:13:07.830134] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T19:13:07.990684] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-03T19:13:08.576502] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T19:13:08.790696] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-03T19:13:09.590739] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-03T19:13:09.884137] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T19:13:09.886834] [INFO ] [REMOTE ] GNK: Full fetch complete (57192 records). [2025-10-03T19:13:09.887038] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-03T19:13:10.393245] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-03T19:13:10.416295] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-03T19:13:10.416400] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-03T19:13:10.417359] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-03T19:13:10.417588] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-03T19:13:10.419064] [DEBUG] [LOCAL ] GNK: Trimmed 57192 records to 40862 (keeping 200 days of data) [2025-10-03T19:13:10.681858] [DEBUG] [LOCAL ] GNK: Primary data saved (40862 records). [2025-10-03T19:13:10.681996] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-03T19:13:10.682111] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNK took 32.9s. Estimated remaining: 3h 19m 18s. Rate: 7.1 symbols/min [2025-10-03T19:13:10.889202] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:10.937405] [DEBUG] [LOCAL ] GNW: Loaded 51722 existing records from primary storage. [2025-10-03T19:13:10.937783] [INFO ] [MAIN ] GNW: Loaded 51722 existing records. [2025-10-03T19:13:11.131880] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:11.132265] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-03T19:13:11.132503] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-03T19:13:11.133083] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-03T19:13:11.133186] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-03T19:13:11.201619] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-03T19:13:11.255469] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:13:11.384002] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:13:11.590539] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:11.990711] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-03T19:13:12.790697] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-03T19:13:13.058460] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:13:13.590739] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-03T19:13:13.623944] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:13:14.179750] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:13:14.390723] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-03T19:13:14.737272] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:13:15.190701] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-03T19:13:15.909074] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:13:15.990690] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-03T19:13:16.073448] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:13:16.790723] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-03T19:13:17.590703] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-03T19:13:17.744393] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:13:18.308526] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:13:18.396629] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-03T19:13:18.418222] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:13:19.190708] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-03T19:13:19.887009] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T19:13:19.916985] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:13:19.990699] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-03T19:13:20.620879] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:13:20.790678] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-03T19:13:21.590708] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-03T19:13:22.017033] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:13:22.019543] [INFO ] [REMOTE ] GNRC: Full fetch complete (65292 records). [2025-10-03T19:13:22.019691] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-03T19:13:22.395880] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-03T19:13:22.446887] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-03T19:13:22.447058] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-03T19:13:22.456710] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-03T19:13:22.457107] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:13:22.457303] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-03T19:13:22.462357] [DEBUG] [LOCAL ] GNRC: Trimmed 65292 records to 45779 (keeping 200 days of data) [2025-10-03T19:13:22.754300] [DEBUG] [LOCAL ] GNRC: Primary data saved (45779 records). [2025-10-03T19:13:22.754461] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-03T19:13:22.754687] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNRC took 36.6s. Estimated remaining: 3h 19m 15s. Rate: 7.1 symbols/min [2025-10-03T19:13:22.944805] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:22.990324] [DEBUG] [LOCAL ] GOF: Loaded 42879 existing records from primary storage. [2025-10-03T19:13:22.990678] [INFO ] [MAIN ] GOF: Loaded 42879 existing records. [2025-10-03T19:13:23.185671] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:23.185929] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-03T19:13:23.185979] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-03T19:13:23.186325] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-03T19:13:23.186437] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-03T19:13:23.198124] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-03T19:13:23.590459] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:23.990706] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-03T19:13:24.211218] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T19:13:24.479384] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:13:24.528581] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T19:13:24.529688] [INFO ] [REMOTE ] GNT: Full fetch complete (10864 records). [2025-10-03T19:13:24.529764] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-03T19:13:24.795899] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-03T19:13:24.916210] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-03T19:13:24.916289] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-03T19:13:24.916586] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-03T19:13:24.916676] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-03T19:13:24.917152] [DEBUG] [LOCAL ] GNT: Trimmed 10864 records to 8269 (keeping 200 days of data) [2025-10-03T19:13:24.966963] [DEBUG] [LOCAL ] GNT: Primary data saved (8269 records). [2025-10-03T19:13:24.967112] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-03T19:13:24.967202] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNT took 23.5s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-10-03T19:13:25.157833] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:25.198494] [DEBUG] [LOCAL ] GOLF: Loaded 31420 existing records from primary storage. [2025-10-03T19:13:25.198805] [INFO ] [MAIN ] GOLF: Loaded 31420 existing records. [2025-10-03T19:13:25.398004] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:25.398253] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-03T19:13:25.398339] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-03T19:13:25.398583] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-03T19:13:25.398681] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-03T19:13:25.593885] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-03T19:13:25.842910] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:26.390686] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-03T19:13:26.508910] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:13:27.190813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-03T19:13:27.196667] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T19:13:27.990637] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-03T19:13:28.150548] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:13:28.787799] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:13:28.796538] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-03T19:13:29.059481] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:13:29.062096] [INFO ] [REMOTE ] GNL: Full fetch complete (68259 records). [2025-10-03T19:13:29.062236] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-03T19:13:29.504004] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-03T19:13:29.504236] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-03T19:13:29.505379] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-03T19:13:29.505491] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-03T19:13:29.507363] [DEBUG] [LOCAL ] GNL: Trimmed 68259 records to 47502 (keeping 200 days of data) [2025-10-03T19:13:29.599190] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-03T19:13:29.623418] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T19:13:29.828809] [DEBUG] [LOCAL ] GNL: Primary data saved (47502 records). [2025-10-03T19:13:29.828950] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-03T19:13:29.829036] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNL took 46.6s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-03T19:13:30.023381] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:30.072704] [DEBUG] [LOCAL ] GOOS: Loaded 45342 existing records from primary storage. [2025-10-03T19:13:30.073016] [INFO ] [MAIN ] GOOS: Loaded 45342 existing records. [2025-10-03T19:13:30.264888] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:30.265097] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-03T19:13:30.265147] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-03T19:13:30.265464] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-03T19:13:30.265544] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-03T19:13:30.395867] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-03T19:13:30.669197] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:31.190668] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-03T19:13:31.269815] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:13:31.809603] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:13:31.990728] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-03T19:13:32.790695] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-03T19:13:32.909876] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:13:33.590735] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-03T19:13:33.763312] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:13:34.390671] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-03T19:13:34.469981] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T19:13:35.134886] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:13:35.190705] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-03T19:13:35.990688] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-03T19:13:36.063004] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:13:36.505856] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T19:13:36.790672] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-03T19:13:37.115366] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:13:37.590749] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-03T19:13:38.395817] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-03T19:13:38.415629] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:13:38.957265] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:13:39.190698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-03T19:13:39.990634] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-03T19:13:40.087799] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:13:40.707213] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:13:40.790727] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-03T19:13:41.569811] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:13:41.590705] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-03T19:13:42.290134] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T19:13:42.390715] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-03T19:13:43.203027] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-03T19:13:43.211120] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:13:43.815410] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:13:43.990684] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-03T19:13:44.791396] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-03T19:13:44.794896] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:13:45.590672] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-03T19:13:45.726039] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:13:45.797150] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:13:46.390728] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-03T19:13:47.195831] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-03T19:13:47.218233] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T19:13:47.990623] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-03T19:13:48.066819] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T19:13:48.069617] [INFO ] [REMOTE ] GNW: Full fetch complete (73604 records). [2025-10-03T19:13:48.069788] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-03T19:13:48.488518] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-03T19:13:48.488616] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-03T19:13:48.489660] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-03T19:13:48.489737] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-03T19:13:48.491323] [DEBUG] [LOCAL ] GNW: Trimmed 73604 records to 52096 (keeping 200 days of data) [2025-10-03T19:13:48.790897] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-03T19:13:48.809013] [DEBUG] [LOCAL ] GNW: Primary data saved (52096 records). [2025-10-03T19:13:48.809166] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-03T19:13:48.809255] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GNW took 38.1s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-03T19:13:49.019157] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:13:49.036873] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:49.069845] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:13:49.110959] [DEBUG] [LOCAL ] GOTU: Loaded 38626 existing records from primary storage. [2025-10-03T19:13:49.111282] [INFO ] [MAIN ] GOTU: Loaded 38626 existing records. [2025-10-03T19:13:49.309726] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:49.310578] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-03T19:13:49.310638] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-03T19:13:49.311074] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-03T19:13:49.311134] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-03T19:13:49.595974] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-03T19:13:49.703047] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:50.390690] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-03T19:13:50.452610] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:13:51.047276] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:13:51.190739] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-03T19:13:51.661256] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:13:51.990704] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-03T19:13:52.790637] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-03T19:13:52.909452] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:13:53.586754] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:13:53.596336] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-03T19:13:54.277617] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:13:54.390690] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-03T19:13:54.532209] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:13:55.190706] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-03T19:13:55.990626] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-03T19:13:56.078480] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:13:56.340522] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T19:13:56.790742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-03T19:13:57.590697] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-03T19:13:57.689234] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:13:58.147933] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:13:58.150768] [INFO ] [REMOTE ] GOF: Full fetch complete (62105 records). [2025-10-03T19:13:58.150912] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-03T19:13:58.392311] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-03T19:13:58.637544] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-03T19:13:58.638234] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-03T19:13:58.639313] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-03T19:13:58.639677] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-03T19:13:58.639554] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:13:58.642792] [INFO ] [REMOTE ] GOLF: Full fetch complete (45146 records). [2025-10-03T19:13:58.643042] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-03T19:13:58.649274] [DEBUG] [LOCAL ] GOF: Trimmed 62105 records to 43182 (keeping 200 days of data) [2025-10-03T19:13:59.229634] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-03T19:13:59.256078] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-03T19:13:59.286987] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-03T19:13:59.291632] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-03T19:13:59.292094] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-03T19:13:59.297972] [DEBUG] [LOCAL ] GOLF: Trimmed 45146 records to 31654 (keeping 200 days of data) [2025-10-03T19:13:59.464205] [DEBUG] [LOCAL ] GOF: Primary data saved (43182 records). [2025-10-03T19:13:59.464942] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-03T19:13:59.468355] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOF took 36.7s. Estimated remaining: 3h 18m 46s. Rate: 7.1 symbols/min [2025-10-03T19:13:59.713203] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:59.753535] [DEBUG] [LOCAL ] GOLF: Primary data saved (31654 records). [2025-10-03T19:13:59.753749] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-03T19:13:59.754747] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GOLF took 34.8s. Estimated remaining: 3h 18m 26s. Rate: 7.1 symbols/min [2025-10-03T19:13:59.971991] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:59.992457] [DEBUG] [LOCAL ] GPC: Loaded 46702 existing records from primary storage. [2025-10-03T19:13:59.992881] [INFO ] [MAIN ] GPC: Loaded 46702 existing records. [2025-10-03T19:14:00.134796] [DEBUG] [LOCAL ] GPI: Loaded 14747 existing records from primary storage. [2025-10-03T19:14:00.150966] [INFO ] [MAIN ] GPI: Loaded 14747 existing records. [2025-10-03T19:14:00.234085] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:00.309068] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-03T19:14:00.339357] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-03T19:14:00.376332] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-03T19:14:00.389212] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T19:14:00.389343] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-03T19:14:00.511020] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:00.526088] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-03T19:14:00.540955] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-03T19:14:00.570119] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-03T19:14:00.600824] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-03T19:14:00.611789] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-03T19:14:01.157658] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:01.194742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-03T19:14:01.313269] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:01.353198] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T19:14:01.590737] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-03T19:14:02.148833] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:14:02.390770] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-03T19:14:03.023462] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:14:03.130042] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:14:03.190683] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-03T19:14:03.231528] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:14:03.990685] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-03T19:14:04.790630] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-03T19:14:04.832179] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:14:05.304922] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T19:14:05.308186] [INFO ] [REMOTE ] GOOS: Full fetch complete (65438 records). [2025-10-03T19:14:05.308344] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-03T19:14:05.598979] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-03T19:14:05.743894] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-03T19:14:05.743981] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-03T19:14:05.744903] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-03T19:14:05.744971] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-03T19:14:05.746409] [DEBUG] [LOCAL ] GOOS: Trimmed 65438 records to 45626 (keeping 200 days of data) [2025-10-03T19:14:06.045120] [DEBUG] [LOCAL ] GOOS: Primary data saved (45626 records). [2025-10-03T19:14:06.045259] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-03T19:14:06.045351] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOOS took 36.2s. Estimated remaining: 3h 18m 14s. Rate: 7.1 symbols/min [2025-10-03T19:14:06.241306] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:06.248782] [DEBUG] [LOCAL ] GPJA: Loaded 4260 existing records from primary storage. [2025-10-03T19:14:06.249057] [INFO ] [MAIN ] GPJA: Loaded 4260 existing records. [2025-10-03T19:14:06.392360] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-03T19:14:06.457788] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:06.458392] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-03T19:14:06.458527] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-03T19:14:06.458999] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-03T19:14:06.459351] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-03T19:14:06.544168] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:14:06.816301] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:14:06.917853] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:07.190711] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-03T19:14:07.990667] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-03T19:14:08.107681] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:14:08.521276] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:14:08.790688] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-03T19:14:08.865853] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:14:09.590690] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-03T19:14:10.390714] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-03T19:14:10.473258] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:14:10.627971] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T19:14:11.190681] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-03T19:14:11.346594] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:14:11.990709] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-03T19:14:12.790697] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-03T19:14:12.931469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:14:13.379105] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:14:13.394305] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T19:14:13.590690] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-03T19:14:13.699299] [DEBUG] [REMOTE ] GPC: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T19:14:13.699621] [WARN ] [REMOTE ] GPC: No data returned for month 2025-05 [2025-10-03T19:14:13.699736] [FATAL] [REMOTE ] GPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:14:13.699848] [FATAL] [MAIN ] GPC: Failed to fetch primary data. [2025-10-03T19:14:13.699932] [WARN ] [MAIN ] GPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:14:13.700023] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-03T19:14:13.700109] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-03T19:14:13.700164] [INFO ] [LOCAL ] GPC: Starting deletion of derivative data. [2025-10-03T19:14:13.700536] [DEBUG] [LOCAL ] GPC: Deleted derivative data file. [2025-10-03T19:14:13.700679] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GPC took 14.2s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-03T19:14:14.390707] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-03T19:14:15.190678] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-03T19:14:15.826230] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:14:15.958592] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:14:15.990606] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-03T19:14:16.542398] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T19:14:16.790690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-03T19:14:17.349879] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T19:14:17.590704] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-03T19:14:18.390689] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-03T19:14:18.871893] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:14:18.874725] [INFO ] [REMOTE ] GOTU: Full fetch complete (58991 records). [2025-10-03T19:14:18.874903] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-03T19:14:19.199422] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-03T19:14:19.199344] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:14:19.315411] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-03T19:14:19.315507] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-03T19:14:19.316965] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-03T19:14:19.317035] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-03T19:14:19.319487] [DEBUG] [LOCAL ] GOTU: Trimmed 58991 records to 38853 (keeping 200 days of data) [2025-10-03T19:14:19.550954] [DEBUG] [LOCAL ] GOTU: Primary data saved (38853 records). [2025-10-03T19:14:19.551107] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-03T19:14:19.551216] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GOTU took 30.7s. Estimated remaining: 3h 17m 52s. Rate: 7.1 symbols/min [2025-10-03T19:14:19.990749] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-03T19:14:20.294747] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:14:20.455296] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T19:14:20.790716] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-03T19:14:21.590710] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-03T19:14:21.684036] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T19:14:22.172058] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T19:14:22.390690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-03T19:14:22.956239] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:14:23.190731] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-03T19:14:23.990731] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-03T19:14:24.095686] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T19:14:24.573747] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T19:14:24.790727] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-03T19:14:25.495306] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T19:14:25.590703] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-03T19:14:26.124779] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:14:26.125601] [INFO ] [REMOTE ] GPJA: Full fetch complete (7320 records). [2025-10-03T19:14:26.125703] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-03T19:14:26.396816] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-03T19:14:26.530944] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-03T19:14:26.531027] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-03T19:14:26.531229] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-03T19:14:26.531274] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-03T19:14:26.531815] [DEBUG] [LOCAL ] GPJA: Trimmed 7320 records to 4272 (keeping 200 days of data) [2025-10-03T19:14:26.559573] [DEBUG] [LOCAL ] GPJA: Primary data saved (4272 records). [2025-10-03T19:14:26.559744] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-03T19:14:26.559855] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPJA took 20.5s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-03T19:14:27.447663] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:14:27.452839] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-03T19:14:28.105104] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T19:14:28.108977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-03T19:14:29.016316] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T19:14:29.020521] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-03T19:14:29.793054] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T19:14:29.794865] [INFO ] [REMOTE ] GPI: Full fetch complete (21080 records). [2025-10-03T19:14:29.794959] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-03T19:14:30.196503] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-03T19:14:30.196591] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-03T19:14:30.197099] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-03T19:14:30.197166] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-03T19:14:30.197795] [DEBUG] [LOCAL ] GPI: Trimmed 21080 records to 14844 (keeping 200 days of data) [2025-10-03T19:14:30.293514] [DEBUG] [LOCAL ] GPI: Primary data saved (14844 records). [2025-10-03T19:14:30.293688] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-03T19:14:30.293816] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GPI took 30.5s. Estimated remaining: 3h 17m 27s. Rate: 7.1 symbols/min [2025-10-03T19:14:30.859178] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.009358] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.038268] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.100943] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.140457] [DEBUG] [LOCAL ] GPMT: Loaded 26208 existing records from primary storage. [2025-10-03T19:14:31.141329] [INFO ] [MAIN ] GPMT: Loaded 26208 existing records. [2025-10-03T19:14:31.296008] [DEBUG] [LOCAL ] GPOR: Loaded 23347 existing records from primary storage. [2025-10-03T19:14:31.333828] [INFO ] [MAIN ] GPOR: Loaded 23347 existing records. [2025-10-03T19:14:31.295024] [DEBUG] [LOCAL ] GPK: Loaded 53044 existing records from primary storage. [2025-10-03T19:14:31.340100] [INFO ] [MAIN ] GPK: Loaded 53044 existing records. [2025-10-03T19:14:31.615834] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:31.610085] [DEBUG] [LOCAL ] GPN: Loaded 52423 existing records from primary storage. [2025-10-03T19:14:31.680452] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-03T19:14:31.701422] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-03T19:14:31.669366] [INFO ] [MAIN ] GPN: Loaded 52423 existing records. [2025-10-03T19:14:31.808769] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-03T19:14:31.842809] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:31.889780] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-03T19:14:31.900019] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-03T19:14:31.905416] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-03T19:14:32.093066] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-03T19:14:32.102116] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-03T19:14:32.101854] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:32.229404] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-03T19:14:32.251866] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-03T19:14:32.319915] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-03T19:14:32.320107] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-03T19:14:32.309461] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:32.420545] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-03T19:14:32.494216] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-03T19:14:32.586928] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-03T19:14:32.647173] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-03T19:14:33.390831] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.457574] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-03T19:14:33.498327] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.542965] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-03T19:14:33.657024] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.690974] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-03T19:14:33.821715] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.822087] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-03T19:14:34.847319] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:14:34.854633] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-03T19:14:34.932722] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:14:34.939613] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-03T19:14:35.565372] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:14:35.578933] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-03T19:14:35.616235] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:14:35.627828] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-03T19:14:35.690590] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:14:35.903685] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:14:35.990706] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-03T19:14:36.790664] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-03T19:14:36.957232] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T19:14:37.031962] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:14:37.210453] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:14:37.538807] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:14:37.590706] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-03T19:14:38.390697] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-03T19:14:39.190730] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-03T19:14:39.261878] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:14:39.990630] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-03T19:14:40.048039] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:14:40.322219] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T19:14:40.790742] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-03T19:14:41.590730] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-03T19:14:41.676288] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:14:41.886411] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:14:42.390732] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-03T19:14:43.190702] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-03T19:14:43.381140] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:14:43.990631] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-03T19:14:44.110292] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:14:44.253567] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:14:44.790633] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-03T19:14:44.854375] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T19:14:45.590680] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-03T19:14:45.891143] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:14:46.390683] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-03T19:14:46.646076] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:14:47.190734] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-03T19:14:47.534920] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T19:14:47.990763] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-03T19:14:48.517248] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T19:14:48.790764] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-03T19:14:49.590722] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-03T19:14:49.724259] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:14:50.220568] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:14:50.390707] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-03T19:14:50.707527] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:14:51.190719] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-03T19:14:51.446027] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T19:14:51.990733] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-03T19:14:52.457147] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T19:14:52.790710] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-03T19:14:53.137985] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:14:53.590755] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-03T19:14:53.871359] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:14:53.873250] [INFO ] [REMOTE ] GPOR: Full fetch complete (35067 records). [2025-10-03T19:14:53.873340] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-03T19:14:54.396816] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-03T19:14:54.400038] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-03T19:14:54.401717] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-03T19:14:54.403685] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-03T19:14:54.403973] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-03T19:14:54.405575] [DEBUG] [LOCAL ] GPOR: Trimmed 35067 records to 23529 (keeping 200 days of data) [2025-10-03T19:14:54.565317] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:14:54.645082] [DEBUG] [LOCAL ] GPOR: Primary data saved (23529 records). [2025-10-03T19:14:54.645291] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-03T19:14:54.645478] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPOR took 24.3s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-03T19:14:54.935627] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:54.988258] [DEBUG] [LOCAL ] GPRK: Loaded 39690 existing records from primary storage. [2025-10-03T19:14:54.988753] [INFO ] [MAIN ] GPRK: Loaded 39690 existing records. [2025-10-03T19:14:55.193874] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-03T19:14:55.219029] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:55.220504] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-03T19:14:55.220635] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-03T19:14:55.221097] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-03T19:14:55.221173] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-03T19:14:55.633449] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:55.990719] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-03T19:14:56.063377] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:14:56.095925] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:14:56.097487] [INFO ] [REMOTE ] GPMT: Full fetch complete (37202 records). [2025-10-03T19:14:56.097713] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-03T19:14:56.511285] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-03T19:14:56.511388] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-03T19:14:56.512101] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-03T19:14:56.512168] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-03T19:14:56.513182] [DEBUG] [LOCAL ] GPMT: Trimmed 37202 records to 26308 (keeping 200 days of data) [2025-10-03T19:14:56.691755] [DEBUG] [LOCAL ] GPMT: Primary data saved (26308 records). [2025-10-03T19:14:56.691936] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-03T19:14:56.692078] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPMT took 26.4s. Estimated remaining: 3h 17m 24s. Rate: 7.1 symbols/min [2025-10-03T19:14:56.799353] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-03T19:14:56.889093] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:56.916609] [DEBUG] [LOCAL ] GRBK: Loaded 27074 existing records from primary storage. [2025-10-03T19:14:56.916962] [INFO ] [MAIN ] GRBK: Loaded 27074 existing records. [2025-10-03T19:14:57.113714] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:57.114000] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-03T19:14:57.114259] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-03T19:14:57.114612] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-03T19:14:57.114728] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-03T19:14:57.238235] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T19:14:57.563169] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:57.590633] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-03T19:14:58.390639] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-03T19:14:58.596383] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:14:58.718472] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:14:59.190717] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-03T19:14:59.470190] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:14:59.990701] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-03T19:15:00.553070] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:15:00.790748] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-03T19:15:01.590765] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-03T19:15:02.023608] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:15:02.160376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:15:02.390707] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-03T19:15:03.190728] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-03T19:15:03.335040] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T19:15:03.990678] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-03T19:15:04.289759] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:15:04.561107] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T19:15:04.790720] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-03T19:15:05.464461] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:15:05.590711] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-03T19:15:06.390629] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-03T19:15:06.587080] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:15:06.875048] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:15:07.190718] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-03T19:15:07.734726] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:15:07.990706] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-03T19:15:08.648073] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:15:08.650999] [INFO ] [REMOTE ] GPK: Full fetch complete (75586 records). [2025-10-03T19:15:08.651146] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-03T19:15:08.795742] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-03T19:15:09.087053] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-03T19:15:09.087184] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-03T19:15:09.088250] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-03T19:15:09.088380] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-03T19:15:09.090177] [DEBUG] [LOCAL ] GPK: Trimmed 75586 records to 53416 (keeping 200 days of data) [2025-10-03T19:15:09.443588] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:15:09.476338] [DEBUG] [LOCAL ] GPK: Primary data saved (53416 records). [2025-10-03T19:15:09.476503] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-03T19:15:09.476622] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 39.2s. Estimated remaining: 3h 17m 22s. Rate: 7.1 symbols/min [2025-10-03T19:15:09.595749] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-03T19:15:09.662953] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:09.674054] [DEBUG] [LOCAL ] GRC: Loaded 9062 existing records from primary storage. [2025-10-03T19:15:09.674278] [INFO ] [MAIN ] GRC: Loaded 9062 existing records. [2025-10-03T19:15:09.860233] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:09.860486] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-03T19:15:09.860537] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-03T19:15:09.860752] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-03T19:15:09.860814] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-03T19:15:10.251580] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:10.390631] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-03T19:15:10.828435] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:15:10.997770] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:15:11.187180] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:15:11.190614] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-03T19:15:11.990690] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-03T19:15:12.033411] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:15:12.790696] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-03T19:15:13.320971] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:15:13.590693] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-03T19:15:14.262601] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T19:15:14.390688] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-03T19:15:14.496195] [DEBUG] [REMOTE ] GPRK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T19:15:14.496559] [WARN ] [REMOTE ] GPRK: No data returned for month 2025-07 [2025-10-03T19:15:14.496685] [FATAL] [REMOTE ] GPRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:15:14.496784] [FATAL] [MAIN ] GPRK: Failed to fetch primary data. [2025-10-03T19:15:14.496827] [WARN ] [MAIN ] GPRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:15:14.496895] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-03T19:15:14.496978] [DEBUG] [LOCAL ] GPRK: No primary data file found to delete. [2025-10-03T19:15:14.497034] [INFO ] [LOCAL ] GPRK: Starting deletion of derivative data. [2025-10-03T19:15:14.497315] [DEBUG] [LOCAL ] GPRK: Deleted derivative data file. [2025-10-03T19:15:14.498028] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPRK took 19.9s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-03T19:15:14.689052] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:14.712782] [DEBUG] [LOCAL ] GRDN: Loaded 20716 existing records from primary storage. [2025-10-03T19:15:14.713103] [INFO ] [MAIN ] GRDN: Loaded 20716 existing records. [2025-10-03T19:15:14.935215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T19:15:14.948455] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:14.949536] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-03T19:15:14.949620] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-03T19:15:14.950386] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-03T19:15:14.950453] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-03T19:15:15.197016] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-03T19:15:15.325235] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:15.990621] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-03T19:15:16.513320] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:15:16.790732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-03T19:15:17.564897] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:15:17.590714] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-03T19:15:17.753737] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:15:18.390744] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-03T19:15:18.851487] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:15:19.190746] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-03T19:15:19.990634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-03T19:15:20.139936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:15:20.306707] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T19:15:20.790721] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-03T19:15:20.924230] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T19:15:21.575977] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:15:21.590619] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-03T19:15:22.390693] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-03T19:15:22.440138] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:15:23.181401] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:15:23.190611] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-03T19:15:23.964389] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:15:23.990635] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-03T19:15:24.790713] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-03T19:15:24.892538] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:15:25.590704] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-03T19:15:26.153420] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:15:26.332198] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:15:26.335085] [INFO ] [REMOTE ] GPN: Full fetch complete (74907 records). [2025-10-03T19:15:26.335226] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-03T19:15:26.399405] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-03T19:15:26.764729] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-03T19:15:26.764859] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-03T19:15:26.765898] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-03T19:15:26.765968] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-03T19:15:26.767547] [DEBUG] [LOCAL ] GPN: Trimmed 74907 records to 52797 (keeping 200 days of data) [2025-10-03T19:15:27.137117] [DEBUG] [LOCAL ] GPN: Primary data saved (52797 records). [2025-10-03T19:15:27.137357] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-03T19:15:27.137488] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPN took 56.8s. Estimated remaining: 3h 17m 6s. Rate: 7.1 symbols/min [2025-10-03T19:15:27.195834] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-03T19:15:27.324384] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:27.383680] [DEBUG] [LOCAL ] GRMN: Loaded 41310 existing records from primary storage. [2025-10-03T19:15:27.390157] [INFO ] [MAIN ] GRMN: Loaded 41310 existing records. [2025-10-03T19:15:27.389940] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T19:15:27.583338] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:27.583627] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-03T19:15:27.583718] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-03T19:15:27.584248] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-03T19:15:27.584336] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-03T19:15:27.749955] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T19:15:27.979159] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:27.990613] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-03T19:15:28.790757] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-03T19:15:29.523415] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:15:29.590638] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-03T19:15:29.996634] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:15:30.390737] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-03T19:15:30.673423] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T19:15:31.190736] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-03T19:15:31.894573] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:15:31.990705] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-03T19:15:32.185930] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T19:15:32.756246] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:15:32.790672] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-03T19:15:33.590740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-03T19:15:34.279281] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:15:34.390710] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-03T19:15:34.686678] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:15:34.689137] [INFO ] [REMOTE ] GRBK: Full fetch complete (40565 records). [2025-10-03T19:15:34.689362] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-03T19:15:35.146556] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-03T19:15:35.146678] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-03T19:15:35.147339] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-03T19:15:35.147384] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-03T19:15:35.148625] [DEBUG] [LOCAL ] GRBK: Trimmed 40565 records to 27305 (keeping 200 days of data) [2025-10-03T19:15:35.197217] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-03T19:15:35.316476] [DEBUG] [LOCAL ] GRBK: Primary data saved (27305 records). [2025-10-03T19:15:35.316629] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-03T19:15:35.316790] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 38.6s. Estimated remaining: 3h 16m 57s. Rate: 7.1 symbols/min [2025-10-03T19:15:35.499395] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:35.548667] [DEBUG] [LOCAL ] GRND: Loaded 50304 existing records from primary storage. [2025-10-03T19:15:35.549038] [INFO ] [MAIN ] GRND: Loaded 50304 existing records. [2025-10-03T19:15:35.770743] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:35.770977] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-03T19:15:35.771031] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-03T19:15:35.771326] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-03T19:15:35.771410] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-03T19:15:35.997561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-03T19:15:36.181290] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:15:36.253229] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:36.279875] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T19:15:36.790631] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-03T19:15:36.849784] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:15:37.590694] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-03T19:15:37.940510] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:15:38.390692] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-03T19:15:39.190702] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-03T19:15:39.259918] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:15:39.988757] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:15:39.991268] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-03T19:15:40.159726] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:15:40.790715] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-03T19:15:41.189625] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:15:41.590759] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-03T19:15:41.824515] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:15:42.390721] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-03T19:15:43.101934] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:15:43.190743] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-03T19:15:43.463509] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:15:43.465242] [INFO ] [REMOTE ] GRDN: Full fetch complete (26332 records). [2025-10-03T19:15:43.465325] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-03T19:15:43.904495] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-03T19:15:43.904578] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-03T19:15:43.905193] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-03T19:15:43.905296] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-03T19:15:43.906127] [DEBUG] [LOCAL ] GRDN: Trimmed 26332 records to 20872 (keeping 200 days of data) [2025-10-03T19:15:43.993080] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-03T19:15:44.033264] [DEBUG] [LOCAL ] GRDN: Primary data saved (20872 records). [2025-10-03T19:15:44.033409] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-03T19:15:44.033520] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRDN took 29.5s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-03T19:15:44.213954] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:44.253999] [DEBUG] [LOCAL ] GRNT: Loaded 34012 existing records from primary storage. [2025-10-03T19:15:44.254303] [INFO ] [MAIN ] GRNT: Loaded 34012 existing records. [2025-10-03T19:15:44.451131] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:44.451764] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-03T19:15:44.451869] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-03T19:15:44.452479] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-03T19:15:44.452545] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-03T19:15:44.793152] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-03T19:15:44.875328] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:15:44.879521] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:45.152945] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:15:45.566921] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T19:15:45.568965] [INFO ] [REMOTE ] GRC: Full fetch complete (13211 records). [2025-10-03T19:15:45.569071] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-03T19:15:45.595766] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-03T19:15:45.996779] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-03T19:15:45.996863] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-03T19:15:45.997208] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-03T19:15:45.997258] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-03T19:15:45.997885] [DEBUG] [LOCAL ] GRC: Trimmed 13211 records to 9165 (keeping 200 days of data) [2025-10-03T19:15:46.061816] [DEBUG] [LOCAL ] GRC: Primary data saved (9165 records). [2025-10-03T19:15:46.061986] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-03T19:15:46.062115] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRC took 36.6s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-03T19:15:46.254503] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:46.267375] [DEBUG] [LOCAL ] GROV: Loaded 8931 existing records from primary storage. [2025-10-03T19:15:46.267732] [INFO ] [MAIN ] GROV: Loaded 8931 existing records. [2025-10-03T19:15:46.395900] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-03T19:15:46.482599] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:46.483056] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-03T19:15:46.483138] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-03T19:15:46.483367] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-03T19:15:46.483427] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-03T19:15:47.077862] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:47.190742] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-03T19:15:47.276836] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:15:47.777514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:15:47.990717] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-03T19:15:48.401919] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:15:48.790638] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-03T19:15:49.266145] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T19:15:49.590745] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-03T19:15:49.708386] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T19:15:50.390693] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-03T19:15:51.151202] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:15:51.190708] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-03T19:15:51.574860] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T19:15:51.702460] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T19:15:51.990713] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-03T19:15:52.727923] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T19:15:52.790736] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-03T19:15:53.573984] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:15:53.590623] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-03T19:15:54.342813] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T19:15:54.390709] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-03T19:15:55.190725] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-03T19:15:55.971004] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:15:55.990633] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-03T19:15:56.622210] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:15:56.790712] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-03T19:15:57.233835] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:15:57.240688] [INFO ] [REMOTE ] GRMN: Full fetch complete (60012 records). [2025-10-03T19:15:57.240870] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-03T19:15:57.592838] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-03T19:15:57.604727] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:15:57.685383] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-03T19:15:57.685515] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-03T19:15:57.686468] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-03T19:15:57.686540] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-03T19:15:57.690425] [DEBUG] [LOCAL ] GRMN: Trimmed 60012 records to 41621 (keeping 200 days of data) [2025-10-03T19:15:57.982889] [DEBUG] [LOCAL ] GRMN: Primary data saved (41621 records). [2025-10-03T19:15:57.983026] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-03T19:15:57.983156] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRMN took 30.8s. Estimated remaining: 3h 16m 28s. Rate: 7.1 symbols/min [2025-10-03T19:15:58.168566] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:58.177209] [DEBUG] [LOCAL ] GRX: Loaded 4740 existing records from primary storage. [2025-10-03T19:15:58.177445] [INFO ] [MAIN ] GRX: Loaded 4740 existing records. [2025-10-03T19:15:58.386383] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:58.386701] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-03T19:15:58.386761] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-03T19:15:58.386982] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-03T19:15:58.387040] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-03T19:15:58.399180] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-03T19:15:58.779426] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:59.190694] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-03T19:15:59.206110] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:15:59.337140] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:15:59.990711] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-03T19:16:00.483722] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-03T19:16:00.488147] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T19:16:00.790715] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-03T19:16:01.590726] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-03T19:16:02.390697] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-03T19:16:02.533380] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:16:02.795476] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:16:03.016454] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:16:03.190721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-03T19:16:03.975381] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:16:03.990627] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-03T19:16:04.790694] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-03T19:16:05.292364] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:16:05.379246] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:16:05.590683] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-03T19:16:06.148682] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:16:06.149815] [INFO ] [REMOTE ] GROV: Full fetch complete (14318 records). [2025-10-03T19:16:06.150133] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-03T19:16:06.395732] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-03T19:16:06.555458] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-03T19:16:06.555548] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-03T19:16:06.555973] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-03T19:16:06.556039] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-03T19:16:06.556676] [DEBUG] [LOCAL ] GROV: Trimmed 14318 records to 8965 (keeping 200 days of data) [2025-10-03T19:16:06.617448] [DEBUG] [LOCAL ] GROV: Primary data saved (8965 records). [2025-10-03T19:16:06.617600] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-03T19:16:06.617743] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 20.6s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-03T19:16:06.798686] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:06.860056] [DEBUG] [LOCAL ] GS: Loaded 52244 existing records from primary storage. [2025-10-03T19:16:06.860388] [INFO ] [MAIN ] GS: Loaded 52244 existing records. [2025-10-03T19:16:07.050913] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:07.051199] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-03T19:16:07.051261] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-03T19:16:07.051614] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-03T19:16:07.051714] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-03T19:16:07.195837] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-03T19:16:07.457216] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:07.481295] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:16:07.990694] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-03T19:16:08.790685] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-03T19:16:08.867144] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:16:09.389072] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:16:09.390626] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:16:09.590711] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-03T19:16:10.061555] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T19:16:10.390703] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-03T19:16:11.190738] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-03T19:16:11.733186] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T19:16:11.990690] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-03T19:16:12.070338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:16:12.790723] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-03T19:16:13.344695] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:16:13.590727] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-03T19:16:14.390720] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-03T19:16:14.437572] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:16:14.461339] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T19:16:14.463453] [INFO ] [REMOTE ] GRNT: Full fetch complete (48503 records). [2025-10-03T19:16:14.463552] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-03T19:16:14.875211] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-03T19:16:14.875293] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-03T19:16:14.876079] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-03T19:16:14.876147] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-03T19:16:14.877265] [DEBUG] [LOCAL ] GRNT: Trimmed 48503 records to 34272 (keeping 200 days of data) [2025-10-03T19:16:15.090411] [DEBUG] [LOCAL ] GRNT: Primary data saved (34272 records). [2025-10-03T19:16:15.090557] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-03T19:16:15.091689] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRNT took 31.1s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-03T19:16:15.198776] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-03T19:16:15.280224] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:15.330091] [DEBUG] [LOCAL ] GSBD: Loaded 39460 existing records from primary storage. [2025-10-03T19:16:15.330425] [INFO ] [MAIN ] GSBD: Loaded 39460 existing records. [2025-10-03T19:16:15.519280] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:15.519563] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-03T19:16:15.519617] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-03T19:16:15.519973] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-03T19:16:15.520034] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-03T19:16:15.906492] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:15.990704] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-03T19:16:16.595523] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T19:16:16.597499] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T19:16:16.669435] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T19:16:16.790710] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-03T19:16:17.345563] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T19:16:17.590689] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-03T19:16:18.390672] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-03T19:16:19.190738] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-03T19:16:19.331717] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:16:19.562322] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:16:19.568392] [INFO ] [REMOTE ] GRND: Full fetch complete (71022 records). [2025-10-03T19:16:19.568547] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-03T19:16:20.001572] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-03T19:16:20.005269] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-03T19:16:20.006148] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-03T19:16:20.007222] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-03T19:16:20.007426] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-03T19:16:20.014966] [DEBUG] [LOCAL ] GRND: Trimmed 71022 records to 50674 (keeping 200 days of data) [2025-10-03T19:16:20.343185] [DEBUG] [LOCAL ] GRND: Primary data saved (50674 records). [2025-10-03T19:16:20.343387] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-03T19:16:20.343547] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRND took 45.0s. Estimated remaining: 3h 15m 59s. Rate: 7.1 symbols/min [2025-10-03T19:16:20.530510] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:20.588073] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-10-03T19:16:20.588522] [INFO ] [MAIN ] GSK: Loaded 53882 existing records. [2025-10-03T19:16:20.670579] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:16:20.795041] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-03T19:16:20.799289] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:20.800034] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-03T19:16:20.801048] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-03T19:16:20.802211] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-03T19:16:20.802279] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-03T19:16:21.198331] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:21.334109] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T19:16:21.590687] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-03T19:16:22.246130] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:16:22.390730] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-03T19:16:23.190705] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-03T19:16:23.682415] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T19:16:23.990732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-03T19:16:24.215486] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T19:16:24.376942] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-03T19:16:24.600908] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T19:16:24.790719] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-03T19:16:25.590735] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-03T19:16:26.390727] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-03T19:16:27.080975] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T19:16:27.190717] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-03T19:16:27.320270] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:16:27.837869] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:16:27.990694] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-03T19:16:28.622192] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:16:28.790618] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-03T19:16:28.979836] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T19:16:29.590727] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-03T19:16:30.390700] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-03T19:16:30.458512] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:16:30.464105] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:16:31.190732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-03T19:16:31.855484] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:16:31.898771] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:16:31.899838] [INFO ] [REMOTE ] GRX: Full fetch complete (6677 records). [2025-10-03T19:16:31.899937] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-03T19:16:31.995784] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-03T19:16:32.307074] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-03T19:16:32.307153] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-03T19:16:32.307352] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-03T19:16:32.307413] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-03T19:16:32.307899] [DEBUG] [LOCAL ] GRX: Trimmed 6677 records to 4787 (keeping 200 days of data) [2025-10-03T19:16:32.337623] [DEBUG] [LOCAL ] GRX: Primary data saved (4787 records). [2025-10-03T19:16:32.337808] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-03T19:16:32.337928] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRX took 34.4s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-03T19:16:32.555017] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:32.597919] [DEBUG] [LOCAL ] GSL: Loaded 33513 existing records from primary storage. [2025-10-03T19:16:32.598216] [INFO ] [MAIN ] GSL: Loaded 33513 existing records. [2025-10-03T19:16:32.787549] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:32.787825] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-03T19:16:32.788067] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-03T19:16:32.788334] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-03T19:16:32.788393] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-03T19:16:32.796339] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-03T19:16:33.180910] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:33.541057] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T19:16:33.590663] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-03T19:16:34.390725] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-03T19:16:34.536145] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:16:34.881890] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:16:35.190731] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-03T19:16:35.737563] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:16:35.990722] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-03T19:16:36.790732] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-03T19:16:37.227496] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:16:37.440966] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:16:37.590729] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-03T19:16:38.390717] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-03T19:16:38.694720] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:16:39.094888] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T19:16:39.154598] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:16:39.190696] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-03T19:16:39.990757] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-03T19:16:40.790627] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-03T19:16:41.053282] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:16:41.590693] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-03T19:16:41.752305] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:16:42.130669] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:16:42.390729] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-03T19:16:42.898455] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:16:43.190701] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-03T19:16:43.990728] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-03T19:16:44.683762] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T19:16:44.790733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-03T19:16:45.178851] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:16:45.229220] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:16:45.590678] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-03T19:16:46.390704] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-03T19:16:46.866246] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T19:16:46.983425] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:16:47.190708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-03T19:16:47.926701] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:16:47.990718] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-03T19:16:48.790687] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-03T19:16:49.081787] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:16:49.590690] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-03T19:16:49.939785] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T19:16:50.026585] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:16:50.029107] [INFO ] [REMOTE ] GSBD: Full fetch complete (58502 records). [2025-10-03T19:16:50.029235] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-03T19:16:50.399821] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-03T19:16:50.449259] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-03T19:16:50.449352] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-03T19:16:50.450338] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-03T19:16:50.450432] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-03T19:16:50.451812] [DEBUG] [LOCAL ] GSBD: Trimmed 58502 records to 39772 (keeping 200 days of data) [2025-10-03T19:16:50.732290] [DEBUG] [LOCAL ] GSBD: Primary data saved (39772 records). [2025-10-03T19:16:50.732482] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-03T19:16:50.733284] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GSBD took 35.6s. Estimated remaining: 3h 16m 2s. Rate: 7.1 symbols/min [2025-10-03T19:16:50.923109] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:50.975294] [DEBUG] [LOCAL ] GTES: Loaded 50882 existing records from primary storage. [2025-10-03T19:16:50.975637] [INFO ] [MAIN ] GTES: Loaded 50882 existing records. [2025-10-03T19:16:51.162273] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:51.162482] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-03T19:16:51.162530] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-03T19:16:51.162831] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-03T19:16:51.162891] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-03T19:16:51.195795] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-03T19:16:51.579100] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:51.615254] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:16:51.778875] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:16:51.781622] [INFO ] [REMOTE ] GS: Full fetch complete (75694 records). [2025-10-03T19:16:51.781783] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-03T19:16:51.996077] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-03T19:16:52.250534] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-03T19:16:52.250753] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-03T19:16:52.252050] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-03T19:16:52.252166] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-03T19:16:52.254351] [DEBUG] [LOCAL ] GS: Trimmed 75694 records to 52615 (keeping 200 days of data) [2025-10-03T19:16:52.276802] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T19:16:52.640636] [DEBUG] [LOCAL ] GS: Primary data saved (52615 records). [2025-10-03T19:16:52.640810] [INFO ] [MAIN ] GS: Full history saved. [2025-10-03T19:16:52.640910] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GS took 46.0s. Estimated remaining: 3h 15m 44s. Rate: 7.1 symbols/min [2025-10-03T19:16:52.797263] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-03T19:16:52.832152] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:52.832525] [DEBUG] [LOCAL ] GTLS: No existing data file found in primary storage. [2025-10-03T19:16:52.832639] [WARN ] [MAIN ] GTLS: No existing data found, performing full refresh instead. [2025-10-03T19:16:52.832866] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-03T19:16:52.832923] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-03T19:16:52.832971] [DEBUG] [LOCAL ] GTLS: No primary data file found to delete. [2025-10-03T19:16:52.833043] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-03T19:16:53.220665] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:53.438554] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:16:53.442017] [INFO ] [REMOTE ] GSK: Full fetch complete (77472 records). [2025-10-03T19:16:53.442203] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-03T19:16:53.605738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-03T19:16:53.899810] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-03T19:16:53.899910] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-03T19:16:53.901097] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-03T19:16:53.901169] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-03T19:16:53.902880] [DEBUG] [LOCAL ] GSK: Trimmed 77472 records to 54272 (keeping 200 days of data) [2025-10-03T19:16:54.262858] [DEBUG] [LOCAL ] GSK: Primary data saved (54272 records). [2025-10-03T19:16:54.263048] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-03T19:16:54.263171] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 33.9s. Estimated remaining: 3h 15m 26s. Rate: 7.1 symbols/min [2025-10-03T19:16:54.391983] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-03T19:16:54.464054] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:54.507911] [DEBUG] [LOCAL ] GTN: Loaded 45825 existing records from primary storage. [2025-10-03T19:16:54.508239] [INFO ] [MAIN ] GTN: Loaded 45825 existing records. [2025-10-03T19:16:54.707343] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:54.707579] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-03T19:16:54.707874] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-03T19:16:54.718361] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-03T19:16:54.737463] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-03T19:16:54.786939] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T19:16:55.161177] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:55.190689] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-03T19:16:55.352258] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T19:16:55.790266] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:16:55.990710] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-03T19:16:56.790673] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-03T19:16:56.857638] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:16:57.362670] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:16:57.590729] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-03T19:16:58.047018] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T19:16:58.390733] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-03T19:16:59.190681] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-03T19:16:59.231508] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:16:59.748572] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:16:59.990710] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-03T19:17:00.790699] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-03T19:17:01.074423] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:17:01.590684] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-03T19:17:01.742715] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T19:17:02.390680] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-03T19:17:02.465041] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:17:03.155250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:17:03.190693] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-03T19:17:03.397982] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:17:03.990699] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-03T19:17:04.520663] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:17:04.790697] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-03T19:17:05.110466] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T19:17:05.112422] [INFO ] [REMOTE ] GSL: Full fetch complete (47895 records). [2025-10-03T19:17:05.112720] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-03T19:17:05.543251] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-03T19:17:05.543348] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-03T19:17:05.544233] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-03T19:17:05.544303] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-03T19:17:05.545519] [DEBUG] [LOCAL ] GSL: Trimmed 47895 records to 33701 (keeping 200 days of data) [2025-10-03T19:17:05.605179] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-03T19:17:05.795512] [DEBUG] [LOCAL ] GSL: Primary data saved (33701 records). [2025-10-03T19:17:05.795687] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-03T19:17:05.795834] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 33.5s. Estimated remaining: 3h 15m 22s. Rate: 7.1 symbols/min [2025-10-03T19:17:05.994169] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:06.026771] [DEBUG] [LOCAL ] GTY: Loaded 30501 existing records from primary storage. [2025-10-03T19:17:06.027081] [INFO ] [MAIN ] GTY: Loaded 30501 existing records. [2025-10-03T19:17:06.234861] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:06.235142] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-03T19:17:06.236238] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-03T19:17:06.236470] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-03T19:17:06.236529] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-03T19:17:06.397499] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-03T19:17:06.700685] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:06.704794] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:17:07.190694] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-03T19:17:07.316478] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:17:07.990630] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-03T19:17:08.078519] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:17:08.111385] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:17:08.790738] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-03T19:17:09.598635] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-03T19:17:09.621103] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T19:17:10.289461] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:17:10.390695] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-03T19:17:11.190680] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-03T19:17:11.419094] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T19:17:11.455630] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:17:11.990696] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-03T19:17:12.574755] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:17:12.790670] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-03T19:17:13.396890] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:17:13.590738] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-03T19:17:14.402283] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-03T19:17:14.405247] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:17:14.962204] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:17:15.190684] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-03T19:17:15.463616] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:17:15.990741] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-03T19:17:16.783336] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:17:16.796556] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-03T19:17:17.302092] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T19:17:17.590722] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-03T19:17:18.390851] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-03T19:17:18.446157] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:17:19.108294] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:17:19.190728] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-03T19:17:19.450476] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:17:19.990702] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-03T19:17:20.790467] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:17:20.801176] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-03T19:17:21.590632] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-03T19:17:21.707724] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:17:22.390701] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-03T19:17:22.498755] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:17:22.947082] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:17:23.190732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-03T19:17:23.990678] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-03T19:17:24.088548] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:17:24.295397] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:17:24.790722] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-03T19:17:25.549574] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:17:25.590739] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-03T19:17:26.389326] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:17:26.398808] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-03T19:17:26.867430] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:17:26.870299] [INFO ] [REMOTE ] GTES: Full fetch complete (73873 records). [2025-10-03T19:17:26.870422] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-03T19:17:27.196001] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-03T19:17:27.316824] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-03T19:17:27.316925] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-03T19:17:27.317920] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-03T19:17:27.317987] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-03T19:17:27.319510] [DEBUG] [LOCAL ] GTES: Trimmed 73873 records to 51249 (keeping 200 days of data) [2025-10-03T19:17:27.640278] [DEBUG] [LOCAL ] GTES: Primary data saved (51249 records). [2025-10-03T19:17:27.640454] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-03T19:17:27.640578] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 36.9s. Estimated remaining: 3h 15m 32s. Rate: 7.1 symbols/min [2025-10-03T19:17:27.837769] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:27.859337] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T19:17:27.879373] [DEBUG] [LOCAL ] GUG: Loaded 12171 existing records from primary storage. [2025-10-03T19:17:27.879599] [INFO ] [MAIN ] GUG: Loaded 12171 existing records. [2025-10-03T19:17:27.994123] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-03T19:17:28.077887] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:28.078108] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-03T19:17:28.078157] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-03T19:17:28.078504] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-03T19:17:28.078564] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-03T19:17:28.487002] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:28.495968] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:17:28.499567] [INFO ] [REMOTE ] GTLS: Full fetch complete (61408 records). [2025-10-03T19:17:28.499809] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-03T19:17:28.797419] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-03T19:17:28.948060] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-03T19:17:28.948141] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-03T19:17:28.949076] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-03T19:17:28.949141] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-03T19:17:28.950371] [DEBUG] [LOCAL ] GTLS: Trimmed 61408 records to 43398 (keeping 200 days of data) [2025-10-03T19:17:29.219760] [DEBUG] [LOCAL ] GTLS: Primary data saved (43398 records). [2025-10-03T19:17:29.219899] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-03T19:17:29.219985] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTLS took 36.6s. Estimated remaining: 3h 15m 14s. Rate: 7.1 symbols/min [2025-10-03T19:17:29.400496] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:29.422239] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T19:17:29.441978] [DEBUG] [LOCAL ] GUT: Loaded 15401 existing records from primary storage. [2025-10-03T19:17:29.442227] [INFO ] [MAIN ] GUT: Loaded 15401 existing records. [2025-10-03T19:17:29.595910] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-03T19:17:29.643818] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:29.644051] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-03T19:17:29.644101] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-03T19:17:29.644367] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-03T19:17:29.644433] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-03T19:17:30.050175] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:30.231128] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:17:30.390685] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-03T19:17:30.883501] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T19:17:31.190731] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-03T19:17:31.720638] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:17:31.723030] [INFO ] [REMOTE ] GTN: Full fetch complete (66395 records). [2025-10-03T19:17:31.723141] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-03T19:17:32.009728] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-03T19:17:32.096865] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T19:17:32.233208] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-03T19:17:32.233290] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-03T19:17:32.234271] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-03T19:17:32.234339] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-03T19:17:32.235814] [DEBUG] [LOCAL ] GTN: Trimmed 66395 records to 46115 (keeping 200 days of data) [2025-10-03T19:17:32.521239] [DEBUG] [LOCAL ] GTN: Primary data saved (46115 records). [2025-10-03T19:17:32.521380] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-03T19:17:32.521469] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTN took 38.3s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-03T19:17:32.696408] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:32.730867] [DEBUG] [LOCAL ] GVA: Loaded 33350 existing records from primary storage. [2025-10-03T19:17:32.731152] [INFO ] [MAIN ] GVA: Loaded 33350 existing records. [2025-10-03T19:17:32.802803] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-03T19:17:32.932358] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:32.932590] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-03T19:17:32.932667] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-03T19:17:32.932939] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-03T19:17:32.933000] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-03T19:17:33.252777] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:17:33.284071] [INFO ] [REMOTE ] GTY: Full fetch complete (43601 records). [2025-10-03T19:17:33.301320] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-03T19:17:33.339899] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:33.595868] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-03T19:17:33.755823] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-03T19:17:33.756024] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-03T19:17:33.756918] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-03T19:17:33.757012] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-03T19:17:33.758404] [DEBUG] [LOCAL ] GTY: Trimmed 43601 records to 30751 (keeping 200 days of data) [2025-10-03T19:17:33.890834] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:17:33.982288] [DEBUG] [LOCAL ] GTY: Primary data saved (30751 records). [2025-10-03T19:17:33.982489] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-03T19:17:33.982606] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTY took 28.2s. Estimated remaining: 3h 14m 40s. Rate: 7.1 symbols/min [2025-10-03T19:17:34.170354] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:34.189407] [DEBUG] [LOCAL ] GWH: Loaded 16198 existing records from primary storage. [2025-10-03T19:17:34.189674] [INFO ] [MAIN ] GWH: Loaded 16198 existing records. [2025-10-03T19:17:34.389399] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:34.389622] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-03T19:17:34.389706] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-03T19:17:34.389931] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-03T19:17:34.389991] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-03T19:17:34.398720] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-03T19:17:34.797602] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:34.810377] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T19:17:35.190717] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-03T19:17:35.935007] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:17:35.977375] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T19:17:35.990608] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-03T19:17:36.785323] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:17:36.790614] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-03T19:17:37.590696] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-03T19:17:37.718755] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T19:17:38.390698] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-03T19:17:38.452239] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:17:38.919674] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T19:17:39.190733] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-03T19:17:39.990701] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-03T19:17:40.536887] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:17:40.756171] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:17:40.790617] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-03T19:17:41.590716] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-03T19:17:41.610731] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T19:17:42.390729] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-03T19:17:43.190682] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-03T19:17:43.344766] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:17:43.931412] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:17:43.990701] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-03T19:17:44.790688] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-03T19:17:44.949498] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:17:45.588349] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T19:17:45.590837] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-03T19:17:45.931618] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (4.34 seconds). [2025-10-03T19:17:46.390749] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-03T19:17:46.580633] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:17:47.190680] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-03T19:17:47.409032] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:17:47.990698] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-03T19:17:48.321069] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:17:48.790633] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-03T19:17:49.017735] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T19:17:49.590704] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-03T19:17:50.390743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-03T19:17:50.452512] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:17:50.499744] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:17:51.190798] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-03T19:17:51.206770] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:17:51.990740] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-03T19:17:52.194323] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T19:17:52.771222] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T19:17:52.790691] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-03T19:17:53.503665] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:17:53.504897] [INFO ] [REMOTE ] GUG: Full fetch complete (19781 records). [2025-10-03T19:17:53.504974] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-03T19:17:53.595870] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-03T19:17:53.961905] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-03T19:17:53.961992] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-03T19:17:53.962505] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-03T19:17:53.962550] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-03T19:17:53.963272] [DEBUG] [LOCAL ] GUG: Trimmed 19781 records to 12272 (keeping 200 days of data) [2025-10-03T19:17:54.049131] [DEBUG] [LOCAL ] GUG: Primary data saved (12272 records). [2025-10-03T19:17:54.049303] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-03T19:17:54.049457] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 26.4s. Estimated remaining: 3h 14m 48s. Rate: 7.1 symbols/min [2025-10-03T19:17:54.243774] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:54.243944] [DEBUG] [LOCAL ] GWRE: No existing data file found in primary storage. [2025-10-03T19:17:54.243984] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-10-03T19:17:54.244109] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-03T19:17:54.244153] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-03T19:17:54.244197] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-03T19:17:54.244231] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-03T19:17:54.397379] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-03T19:17:54.643087] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:54.901298] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:17:55.040737] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T19:17:55.190692] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-03T19:17:55.990702] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-03T19:17:56.644232] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:17:56.667737] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:17:56.790703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-03T19:17:57.590683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-03T19:17:57.855781] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T19:17:58.390698] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-03T19:17:58.921929] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T19:17:59.190707] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-03T19:17:59.480044] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:17:59.990694] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-03T19:18:00.707905] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:18:00.790697] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-03T19:18:00.947385] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:18:01.590701] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-03T19:18:02.270784] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:18:02.390680] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-03T19:18:02.625735] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:18:03.190708] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-03T19:18:03.703735] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:18:03.990692] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-03T19:18:04.314201] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:18:04.775315] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:18:04.777018] [INFO ] [REMOTE ] GUT: Full fetch complete (22679 records). [2025-10-03T19:18:04.777176] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-03T19:18:04.795754] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-03T19:18:05.201872] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-03T19:18:05.202007] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-03T19:18:05.202548] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-03T19:18:05.202597] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-03T19:18:05.203284] [DEBUG] [LOCAL ] GUT: Trimmed 22679 records to 15460 (keeping 200 days of data) [2025-10-03T19:18:05.296875] [DEBUG] [LOCAL ] GUT: Primary data saved (15460 records). [2025-10-03T19:18:05.297029] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-03T19:18:05.297154] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GUT took 36.1s. Estimated remaining: 3h 14m 44s. Rate: 7.1 symbols/min [2025-10-03T19:18:05.474540] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:05.474759] [DEBUG] [LOCAL ] GWW: No existing data file found in primary storage. [2025-10-03T19:18:05.474807] [WARN ] [MAIN ] GWW: No existing data found, performing full refresh instead. [2025-10-03T19:18:05.474923] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-03T19:18:05.474967] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-03T19:18:05.475009] [DEBUG] [LOCAL ] GWW: No primary data file found to delete. [2025-10-03T19:18:05.475044] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-03T19:18:05.595851] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-03T19:18:05.869936] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:06.390633] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-03T19:18:06.427465] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:18:06.729557] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:18:06.731088] [INFO ] [REMOTE ] GWH: Full fetch complete (21396 records). [2025-10-03T19:18:06.731162] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-03T19:18:07.143537] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-03T19:18:07.143618] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-03T19:18:07.144176] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-03T19:18:07.144242] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-03T19:18:07.144935] [DEBUG] [LOCAL ] GWH: Trimmed 21396 records to 16446 (keeping 200 days of data) [2025-10-03T19:18:07.192044] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-03T19:18:07.247294] [DEBUG] [LOCAL ] GWH: Primary data saved (16446 records). [2025-10-03T19:18:07.247459] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-03T19:18:07.247555] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GWH took 33.3s. Estimated remaining: 3h 14m 26s. Rate: 7.1 symbols/min [2025-10-03T19:18:07.443478] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:07.443974] [DEBUG] [LOCAL ] GXO: No existing data file found in primary storage. [2025-10-03T19:18:07.444207] [WARN ] [MAIN ] GXO: No existing data found, performing full refresh instead. [2025-10-03T19:18:07.444524] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-03T19:18:07.450461] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-03T19:18:07.458724] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-03T19:18:07.458805] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-03T19:18:07.496316] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:18:07.867963] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:07.990721] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-03T19:18:08.551253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:18:08.790683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-03T19:18:09.063787] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T19:18:09.590712] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-03T19:18:10.351328] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:18:10.390733] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-03T19:18:10.977929] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:18:11.190701] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-03T19:18:11.476487] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:18:11.990717] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-03T19:18:12.416443] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T19:18:12.790679] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-03T19:18:13.162677] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:18:13.590731] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-03T19:18:14.390700] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-03T19:18:14.446124] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:18:14.916374] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:18:15.190677] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-03T19:18:15.569915] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T19:18:15.990704] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-03T19:18:16.070489] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:18:16.072480] [INFO ] [REMOTE ] GVA: Full fetch complete (48554 records). [2025-10-03T19:18:16.072603] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-03T19:18:16.519916] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-03T19:18:16.520095] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-03T19:18:16.520931] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-03T19:18:16.521006] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-03T19:18:16.522304] [DEBUG] [LOCAL ] GVA: Trimmed 48554 records to 33604 (keeping 200 days of data) [2025-10-03T19:18:16.743540] [DEBUG] [LOCAL ] GVA: Primary data saved (33604 records). [2025-10-03T19:18:16.743738] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-03T19:18:16.743849] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GVA took 44.2s. Estimated remaining: 3h 14m 20s. Rate: 7.1 symbols/min [2025-10-03T19:18:16.795800] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-03T19:18:16.931759] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:16.932046] [DEBUG] [LOCAL ] GYLD: No existing data file found in primary storage. [2025-10-03T19:18:16.932090] [WARN ] [MAIN ] GYLD: No existing data found, performing full refresh instead. [2025-10-03T19:18:16.932165] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-03T19:18:16.932203] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-03T19:18:16.932243] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-03T19:18:16.932276] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-03T19:18:17.337594] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:17.367800] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:18:17.590738] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-03T19:18:18.056059] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T19:18:18.390733] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-03T19:18:19.053419] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T19:18:19.190711] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-03T19:18:19.990720] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-03T19:18:20.155562] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:18:20.179760] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:18:20.790736] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-03T19:18:21.071219] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-03T19:18:21.356314] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:18:21.590739] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-03T19:18:22.390718] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-03T19:18:22.997135] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T19:18:23.190670] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-03T19:18:23.424159] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:18:23.990693] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-03T19:18:24.587366] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:18:24.790683] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-03T19:18:25.161260] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:18:25.590692] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-03T19:18:26.390636] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-03T19:18:26.635213] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:18:26.713551] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:18:26.746722] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T19:18:27.190701] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-03T19:18:27.990700] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-03T19:18:28.677534] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:18:28.757167] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:18:28.790707] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-03T19:18:29.590769] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-03T19:18:30.368169] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:18:30.390705] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-03T19:18:30.752683] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-03T19:18:31.038586] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:18:31.040953] [INFO ] [REMOTE ] GWRE: Full fetch complete (60963 records). [2025-10-03T19:18:31.041135] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-03T19:18:31.199089] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-03T19:18:31.478000] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-03T19:18:31.478393] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-03T19:18:31.479670] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-03T19:18:31.479916] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-03T19:18:31.481500] [DEBUG] [LOCAL ] GWRE: Trimmed 60963 records to 41111 (keeping 200 days of data) [2025-10-03T19:18:31.763028] [DEBUG] [LOCAL ] GWRE: Primary data saved (41111 records). [2025-10-03T19:18:31.763163] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-03T19:18:31.763278] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 37.7s. Estimated remaining: 3h 14m 20s. Rate: 7.1 symbols/min [2025-10-03T19:18:31.947935] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:31.948134] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-03T19:18:31.948190] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-03T19:18:31.948408] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-03T19:18:31.948465] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-03T19:18:31.948536] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-03T19:18:31.948573] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-03T19:18:31.995768] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-03T19:18:32.251552] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:18:32.284743] [INFO ] [REMOTE ] GWW: Full fetch complete (29244 records). [2025-10-03T19:18:32.290086] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-03T19:18:32.481422] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:32.529014] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T19:18:32.783689] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-03T19:18:32.783808] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-03T19:18:32.784442] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-03T19:18:32.784487] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-03T19:18:32.785413] [DEBUG] [LOCAL ] GWW: Trimmed 29244 records to 19715 (keeping 200 days of data) [2025-10-03T19:18:32.790694] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-03T19:18:32.924386] [DEBUG] [LOCAL ] GWW: Primary data saved (19715 records). [2025-10-03T19:18:32.924578] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-03T19:18:32.924683] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 27.6s. Estimated remaining: 3h 14m 2s. Rate: 7.1 symbols/min [2025-10-03T19:18:33.109610] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:33.109853] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-03T19:18:33.109904] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-03T19:18:33.109993] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-03T19:18:33.110040] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-03T19:18:33.110092] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-03T19:18:33.110137] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-03T19:18:33.489958] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:33.590697] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-03T19:18:34.390632] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-03T19:18:34.425958] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:18:34.815855] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T19:18:34.956629] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:18:35.190691] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-03T19:18:35.553488] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-03T19:18:35.990716] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-03T19:18:36.790709] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-03T19:18:37.402151] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:18:37.590700] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-03T19:18:38.003181] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T19:18:38.391966] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-03T19:18:38.397384] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:18:39.190738] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-03T19:18:39.880938] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:18:39.990717] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-03T19:18:40.146777] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:18:40.790738] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-03T19:18:41.187771] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T19:18:41.590714] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-03T19:18:42.037570] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:18:42.105634] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:18:42.390725] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-03T19:18:43.190738] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-03T19:18:43.961751] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:18:43.990663] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-03T19:18:44.790723] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-03T19:18:44.967952] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:18:45.112756] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:18:45.228963] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:18:45.590692] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-03T19:18:46.390705] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-03T19:18:47.190734] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-03T19:18:47.261061] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:18:47.628783] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:18:47.631177] [INFO ] [REMOTE ] GXO: Full fetch complete (69912 records). [2025-10-03T19:18:47.631288] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-03T19:18:47.703844] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T19:18:47.995770] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-03T19:18:48.059541] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-03T19:18:48.059634] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-03T19:18:48.061269] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-03T19:18:48.061347] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-03T19:18:48.066157] [DEBUG] [LOCAL ] GXO: Trimmed 69912 records to 48019 (keeping 200 days of data) [2025-10-03T19:18:48.369315] [DEBUG] [LOCAL ] GXO: Primary data saved (48019 records). [2025-10-03T19:18:48.369473] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-03T19:18:48.369568] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GXO took 41.1s. Estimated remaining: 3h 14m 3s. Rate: 7.1 symbols/min [2025-10-03T19:18:48.559630] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:48.559839] [DEBUG] [LOCAL ] HAFN: No existing data file found in primary storage. [2025-10-03T19:18:48.559902] [WARN ] [MAIN ] HAFN: No existing data found, performing full refresh instead. [2025-10-03T19:18:48.560020] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-03T19:18:48.560063] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-03T19:18:48.560106] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-03T19:18:48.560139] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-03T19:18:48.797410] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-03T19:18:48.988206] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:49.590691] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-03T19:18:49.642306] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:18:49.999202] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T19:18:49.999978] [INFO ] [REMOTE ] GYLD: Full fetch complete (2073 records). [2025-10-03T19:18:50.000054] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-03T19:18:50.392001] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-03T19:18:50.391681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-03T19:18:50.392303] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-03T19:18:50.392750] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-03T19:18:50.393715] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-03T19:18:50.394543] [DEBUG] [LOCAL ] GYLD: Trimmed 2073 records to 1558 (keeping 200 days of data) [2025-10-03T19:18:50.405406] [DEBUG] [LOCAL ] GYLD: Primary data saved (1558 records). [2025-10-03T19:18:50.405482] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-03T19:18:50.405551] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. GYLD took 33.7s. Estimated remaining: 3h 13m 46s. Rate: 7.1 symbols/min [2025-10-03T19:18:50.597638] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:50.598169] [DEBUG] [LOCAL ] HAL: No existing data file found in primary storage. [2025-10-03T19:18:50.598226] [WARN ] [MAIN ] HAL: No existing data found, performing full refresh instead. [2025-10-03T19:18:50.607760] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-03T19:18:50.624073] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-03T19:18:50.625896] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-03T19:18:50.625807] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:18:50.626022] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-03T19:18:51.029223] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:51.190700] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-03T19:18:51.883792] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:18:51.990728] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-03T19:18:52.575676] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:18:52.790694] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-03T19:18:53.590700] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-03T19:18:53.731873] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:18:54.390710] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-03T19:18:54.690017] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:18:54.774899] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T19:18:55.190696] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-03T19:18:55.990695] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-03T19:18:56.182537] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T19:18:56.737606] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:18:56.790688] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-03T19:18:57.446785] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:18:57.590698] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-03T19:18:58.390681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-03T19:18:58.493562] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:18:59.190631] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-03T19:18:59.366076] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:18:59.439258] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:18:59.990697] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-03T19:19:00.790684] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-03T19:19:00.946994] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:19:01.530950] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:19:01.590634] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-03T19:19:02.390671] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-03T19:19:02.509151] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:19:03.190683] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-03T19:19:03.570181] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T19:19:03.990638] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-03T19:19:04.167945] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:19:04.790673] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-03T19:19:04.829145] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:19:05.590639] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-03T19:19:05.709429] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:19:06.390634] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-03T19:19:06.422399] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:19:07.190693] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-03T19:19:07.761481] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T19:19:07.809611] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T19:19:07.812237] [INFO ] [REMOTE ] HAE: Full fetch complete (58368 records). [2025-10-03T19:19:07.812397] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-03T19:19:08.005060] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-03T19:19:08.239552] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-03T19:19:08.239635] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-03T19:19:08.240554] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-03T19:19:08.240619] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-03T19:19:08.242226] [DEBUG] [LOCAL ] HAE: Trimmed 58368 records to 40132 (keeping 200 days of data) [2025-10-03T19:19:08.486590] [DEBUG] [LOCAL ] HAE: Primary data saved (40132 records). [2025-10-03T19:19:08.486753] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-03T19:19:08.486838] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 35.6s. Estimated remaining: 3h 13m 51s. Rate: 7.1 symbols/min [2025-10-03T19:19:08.679275] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:08.679563] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-10-03T19:19:08.679671] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-10-03T19:19:08.679865] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-03T19:19:08.679912] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-03T19:19:08.679954] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-03T19:19:08.679987] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-03T19:19:08.791152] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-03T19:19:09.103607] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:09.106500] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T19:19:09.590729] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-03T19:19:09.846097] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:19:10.218290] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:19:10.221107] [INFO ] [REMOTE ] H: Full fetch complete (62289 records). [2025-10-03T19:19:10.221232] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-03T19:19:10.402002] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-03T19:19:10.637828] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-03T19:19:10.637955] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-03T19:19:10.638847] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-03T19:19:10.638911] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-03T19:19:10.640322] [DEBUG] [LOCAL ] H: Trimmed 62289 records to 45308 (keeping 200 days of data) [2025-10-03T19:19:10.938032] [DEBUG] [LOCAL ] H: Primary data saved (45308 records). [2025-10-03T19:19:10.938170] [INFO ] [MAIN ] H: Full history saved. [2025-10-03T19:19:10.938252] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. H took 39.2s. Estimated remaining: 3h 13m 34s. Rate: 7.1 symbols/min [2025-10-03T19:19:11.130468] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:11.130678] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-10-03T19:19:11.130844] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-10-03T19:19:11.131109] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-03T19:19:11.131169] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-03T19:19:11.131269] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-03T19:19:11.131430] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-03T19:19:11.210716] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-03T19:19:11.449296] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:19:11.581069] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:11.990677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-03T19:19:12.145533] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:19:12.790756] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-03T19:19:13.220001] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:19:13.437945] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:19:13.590727] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-03T19:19:14.390707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-03T19:19:14.560245] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:19:15.190738] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-03T19:19:15.713766] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:19:15.757931] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:19:15.990688] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-03T19:19:16.738204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:19:16.790697] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-03T19:19:17.520134] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:19:17.590727] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-03T19:19:18.390732] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-03T19:19:18.470424] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:19:19.101730] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:19:19.190688] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-03T19:19:19.656049] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:19:19.990726] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-03T19:19:20.790710] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-03T19:19:21.205306] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:19:21.600222] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-03T19:19:21.638047] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:19:22.135544] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:19:22.390730] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-03T19:19:23.190702] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-03T19:19:23.661892] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T19:19:23.990637] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-03T19:19:24.044734] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:19:24.538018] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T19:19:24.790714] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-03T19:19:25.590707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-03T19:19:25.758068] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T19:19:25.763333] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-03T19:19:25.763459] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-03T19:19:26.218507] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-03T19:19:26.218763] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-03T19:19:26.219894] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-03T19:19:26.220009] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-03T19:19:26.232191] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-10-03T19:19:26.255057] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:19:26.390782] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-03T19:19:26.627368] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-03T19:19:26.627628] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-03T19:19:26.627794] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAL took 36.2s. Estimated remaining: 3h 13m 36s. Rate: 7.1 symbols/min [2025-10-03T19:19:26.811798] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:26.811982] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-03T19:19:26.812040] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-03T19:19:26.812169] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-03T19:19:26.812213] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-03T19:19:26.812257] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-03T19:19:26.812305] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-03T19:19:27.099242] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T19:19:27.133412] [INFO ] [REMOTE ] HAFN: Full fetch complete (65458 records). [2025-10-03T19:19:27.138774] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-03T19:19:27.207138] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-03T19:19:27.289101] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:27.636353] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-03T19:19:27.636437] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-03T19:19:27.637458] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-03T19:19:27.637529] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-03T19:19:27.639154] [DEBUG] [LOCAL ] HAFN: Trimmed 65458 records to 43932 (keeping 200 days of data) [2025-10-03T19:19:27.918883] [DEBUG] [LOCAL ] HAFN: Primary data saved (43932 records). [2025-10-03T19:19:27.919060] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-03T19:19:27.919215] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HAFN took 39.5s. Estimated remaining: 3h 13m 18s. Rate: 7.1 symbols/min [2025-10-03T19:19:27.991531] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-03T19:19:28.116270] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:28.116551] [DEBUG] [LOCAL ] HBI: No existing data file found in primary storage. [2025-10-03T19:19:28.116859] [WARN ] [MAIN ] HBI: No existing data found, performing full refresh instead. [2025-10-03T19:19:28.117032] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-03T19:19:28.131959] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-03T19:19:28.142787] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-03T19:19:28.142870] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-03T19:19:28.208016] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:19:28.559692] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:28.790670] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-03T19:19:28.824019] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T19:19:29.030812] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:19:29.590722] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-03T19:19:30.391374] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-03T19:19:30.391279] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:19:31.080624] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T19:19:31.190720] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-03T19:19:31.274542] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:19:31.990681] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-03T19:19:32.790703] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-03T19:19:32.852678] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T19:19:33.430105] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T19:19:33.590738] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-03T19:19:33.663386] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:19:34.275300] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T19:19:34.390669] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-03T19:19:35.190717] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-03T19:19:35.268917] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T19:19:35.990737] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-03T19:19:36.478816] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:19:36.790716] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-03T19:19:37.590696] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-03T19:19:37.641386] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:19:38.379994] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:19:38.390604] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-03T19:19:38.641668] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T19:19:38.986838] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T19:19:39.190722] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-03T19:19:39.990704] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-03T19:19:40.597371] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:19:40.790698] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-03T19:19:41.148030] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:19:41.590693] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-03T19:19:42.390722] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-03T19:19:42.513252] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:19:42.823386] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T19:19:43.190632] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-03T19:19:43.261693] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T19:19:43.990699] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-03T19:19:44.801549] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-03T19:19:44.809785] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:19:45.365835] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T19:19:45.590665] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-03T19:19:45.645865] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:19:46.390693] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-03T19:19:47.190630] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-03T19:19:47.310341] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:19:47.807532] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T19:19:47.810517] [INFO ] [REMOTE ] HASI: Full fetch complete (68123 records). [2025-10-03T19:19:47.810705] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-03T19:19:47.992952] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-03T19:19:48.249363] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-03T19:19:48.249457] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-03T19:19:48.250452] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-03T19:19:48.250527] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-03T19:19:48.252436] [DEBUG] [LOCAL ] HASI: Trimmed 68123 records to 47850 (keeping 200 days of data) [2025-10-03T19:19:48.568732] [DEBUG] [LOCAL ] HASI: Primary data saved (47850 records). [2025-10-03T19:19:48.568930] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-03T19:19:48.569104] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HASI took 40.1s. Estimated remaining: 3h 13m 26s. Rate: 7.1 symbols/min [2025-10-03T19:19:48.750697] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T19:19:48.810278] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-03T19:19:48.810212] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:48.811513] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-03T19:19:48.811574] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-03T19:19:48.811713] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-03T19:19:48.811766] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-03T19:19:48.811812] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-03T19:19:48.811847] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-03T19:19:49.237275] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:49.412155] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T19:19:49.413055] [INFO ] [REMOTE ] HBB: Full fetch complete (9516 records). [2025-10-03T19:19:49.413144] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-03T19:19:49.572379] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:19:49.607727] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-03T19:19:49.620232] [INFO ] [REMOTE ] HAYW: Full fetch complete (70874 records). [2025-10-03T19:19:49.667346] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-03T19:19:49.998900] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-03T19:19:50.008043] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-03T19:19:50.035744] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-03T19:19:50.093353] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-03T19:19:50.160453] [DEBUG] [LOCAL ] HBB: Trimmed 9516 records to 6659 (keeping 200 days of data) [2025-10-03T19:19:50.317876] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-03T19:19:50.318215] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-03T19:19:50.319430] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-03T19:19:50.319887] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-03T19:19:50.324792] [DEBUG] [LOCAL ] HAYW: Trimmed 70874 records to 49424 (keeping 200 days of data) [2025-10-03T19:19:50.331373] [DEBUG] [LOCAL ] HBB: Primary data saved (6659 records). [2025-10-03T19:19:50.331509] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-03T19:19:50.331600] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HBB took 23.7s. Estimated remaining: 3h 13m 8s. Rate: 7.1 symbols/min [2025-10-03T19:19:50.394783] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-03T19:19:50.632141] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:50.634704] [DEBUG] [LOCAL ] HCA: No existing data file found in primary storage. [2025-10-03T19:19:50.635110] [WARN ] [MAIN ] HCA: No existing data found, performing full refresh instead. [2025-10-03T19:19:50.636362] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-03T19:19:50.637066] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-03T19:19:50.637157] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-03T19:19:50.637474] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-03T19:19:51.057474] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:51.212103] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-03T19:19:51.252817] [DEBUG] [LOCAL ] HAYW: Primary data saved (49424 records). [2025-10-03T19:19:51.252996] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-03T19:19:51.253100] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HAYW took 40.3s. Estimated remaining: 3h 12m 50s. Rate: 7.1 symbols/min [2025-10-03T19:19:51.442167] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:51.442481] [DEBUG] [LOCAL ] HCC: No existing data file found in primary storage. [2025-10-03T19:19:51.442563] [WARN ] [MAIN ] HCC: No existing data found, performing full refresh instead. [2025-10-03T19:19:51.442755] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-03T19:19:51.442805] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-03T19:19:51.442852] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-03T19:19:51.442888] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-03T19:19:51.672959] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T19:19:51.878244] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:51.990633] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-03T19:19:52.157580] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T19:19:52.790634] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-03T19:19:53.045205] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:19:53.441425] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T19:19:53.590693] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-03T19:19:54.390631] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-03T19:19:54.635378] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:19:55.190706] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-03T19:19:55.429228] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:19:55.912580] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:19:55.990731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-03T19:19:56.751566] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:19:56.790669] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-03T19:19:57.590685] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-03T19:19:57.724121] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:19:58.390666] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-03T19:19:58.497584] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:19:59.190676] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-03T19:19:59.226817] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:19:59.932308] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:19:59.935077] [INFO ] [REMOTE ] HBI: Full fetch complete (76889 records). [2025-10-03T19:19:59.935463] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-03T19:19:59.995744] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-03T19:20:00.407179] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-03T19:20:00.407272] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-03T19:20:00.408317] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-03T19:20:00.408385] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-03T19:20:00.410016] [DEBUG] [LOCAL ] HBI: Trimmed 76889 records to 53763 (keeping 200 days of data) [2025-10-03T19:20:00.728009] [DEBUG] [LOCAL ] HBI: Primary data saved (53763 records). [2025-10-03T19:20:00.728168] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-03T19:20:00.728277] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HBI took 32.8s. Estimated remaining: 3h 12m 43s. Rate: 7.1 symbols/min [2025-10-03T19:20:00.790705] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-03T19:20:01.061320] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:20:01.590728] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-03T19:20:01.953305] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:20:02.039904] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T19:20:02.390713] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-03T19:20:03.189252] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T19:20:03.199869] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-03T19:20:03.768008] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:20:03.990729] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-03T19:20:04.790637] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-03T19:20:04.883055] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:20:05.590729] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-03T19:20:05.746875] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:20:06.390680] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-03T19:20:06.576307] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T19:20:07.190620] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-03T19:20:07.237323] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:20:07.990673] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-03T19:20:08.034081] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:20:08.798410] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-03T19:20:08.802757] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:20:09.590635] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-03T19:20:09.684550] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:20:10.390665] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-03T19:20:10.690379] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:20:11.035180] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:20:11.190709] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-03T19:20:11.706290] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T19:20:11.990726] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-03T19:20:12.790724] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-03T19:20:12.962035] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:20:13.595745] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-03T19:20:13.613884] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:20:14.390683] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-03T19:20:14.550798] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:20:15.190665] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-03T19:20:15.326099] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T19:20:15.329200] [INFO ] [REMOTE ] HBM: Full fetch complete (76234 records). [2025-10-03T19:20:15.329353] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-03T19:20:15.764858] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-03T19:20:15.764952] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-03T19:20:15.765908] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-03T19:20:15.765980] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-03T19:20:15.767608] [DEBUG] [LOCAL ] HBM: Trimmed 76234 records to 53680 (keeping 200 days of data) [2025-10-03T19:20:16.121701] [DEBUG] [LOCAL ] HBM: Primary data saved (53680 records). [2025-10-03T19:20:16.121971] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-03T19:20:16.122113] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HBM took 27.6s. Estimated remaining: 3h 12m 44s. Rate: 7.1 symbols/min [2025-10-03T19:20:16.156724] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:20:16.168690] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-03T19:20:16.887223] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:20:16.898094] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-03T19:20:17.633544] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:20:17.643538] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-03T19:20:19.161511] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:20:19.171673] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-03T19:20:19.950450] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-03T19:20:19.953022] [INFO ] [REMOTE ] HCA: Full fetch complete (68831 records). [2025-10-03T19:20:19.953152] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-03T19:20:20.400286] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-03T19:20:20.400384] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-03T19:20:20.401410] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-03T19:20:20.401485] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-03T19:20:20.405302] [DEBUG] [LOCAL ] HCA: Trimmed 68831 records to 47538 (keeping 200 days of data) [2025-10-03T19:20:20.615074] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:20:20.645705] [INFO ] [REMOTE ] HCC: Full fetch complete (64636 records). [2025-10-03T19:20:20.646099] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-03T19:20:21.134256] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-03T19:20:21.134743] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-03T19:20:21.137338] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-03T19:20:21.137428] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-03T19:20:21.141972] [DEBUG] [LOCAL ] HCC: Trimmed 64636 records to 46016 (keeping 200 days of data) [2025-10-03T19:20:21.323090] [DEBUG] [LOCAL ] HCA: Primary data saved (47538 records). [2025-10-03T19:20:21.323765] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-03T19:20:21.324380] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HCA took 31.0s. Estimated remaining: 3h 12m 31s. Rate: 7.1 symbols/min [2025-10-03T19:20:21.495917] [DEBUG] [LOCAL ] HCC: Primary data saved (46016 records). [2025-10-03T19:20:21.496059] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-03T19:20:21.496156] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HCC took 30.2s. Estimated remaining: 3h 12m 11s. Rate: 7.1 symbols/min [2025-10-03T19:20:22.103576] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.184450] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-03T19:20:22.194443] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.253291] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.255380] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.254489] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.255586] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-10-03T19:20:22.256150] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.255694] [DEBUG] [LOCAL ] HD: No existing data file found in primary storage. [2025-10-03T19:20:22.255934] [DEBUG] [LOCAL ] HDB: No existing data file found in primary storage. [2025-10-03T19:20:22.256382] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-03T19:20:22.256515] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.256840] [WARN ] [MAIN ] HDB: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.256964] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-03T19:20:22.256786] [WARN ] [MAIN ] HD: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.257462] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-03T19:20:22.257231] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.269002] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-03T19:20:22.262758] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.274547] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-03T19:20:22.280264] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.280206] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-03T19:20:22.289971] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-03T19:20:22.352487] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-03T19:20:22.300449] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-03T19:20:22.368201] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-03T19:20:22.415336] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-03T19:20:22.459363] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-03T19:20:23.692247] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.698211] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-03T19:20:23.873253] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.944119] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-03T19:20:23.943802] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.950959] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-03T19:20:24.048881] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:24.049240] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-03T19:20:24.233523] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-03T19:20:24.234587] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-03T19:20:24.461266] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-03T19:20:24.462188] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-03T19:20:24.693974] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-03T19:20:24.694956] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-03T19:20:24.879117] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:20:24.882907] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-03T19:20:24.930281] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-03T19:20:25.406497] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:20:25.427881] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:20:25.600049] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-03T19:20:25.634056] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:20:26.390737] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-03T19:20:26.431135] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T19:20:27.190678] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-03T19:20:27.420168] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-03T19:20:27.990634] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-03T19:20:28.040864] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T19:20:28.790701] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-03T19:20:28.921840] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T19:20:29.590751] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-03T19:20:29.815613] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-03T19:20:30.390725] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-03T19:20:30.798997] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-03T19:20:31.190706] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-03T19:20:31.426391] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-03T19:20:31.990687] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-03T19:20:32.170743] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:20:32.790689] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-03T19:20:33.590721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-03T19:20:33.756357] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:20:34.005831] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T19:20:34.390709] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-03T19:20:35.190735] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-03T19:20:35.427757] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-03T19:20:35.512994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T19:20:35.990714] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-03T19:20:36.230436] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-03T19:20:36.609973] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T19:20:36.790724] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-03T19:20:37.040379] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T19:20:37.590684] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-03T19:20:37.912226] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-03T19:20:37.912922] [INFO ] [REMOTE ] HCXY: Full fetch complete (570 records). [2025-10-03T19:20:37.912994] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-03T19:20:38.098867] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-03T19:20:38.099073] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:20:38.099141] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:20:38.099214] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-03T19:20:38.099312] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-03T19:20:38.099368] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-03T19:20:38.099491] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-03T19:20:38.099587] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 16.6s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-03T19:20:38.283541] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:38.283766] [DEBUG] [LOCAL ] HE: No existing data file found in primary storage. [2025-10-03T19:20:38.283814] [WARN ] [MAIN ] HE: No existing data found, performing full refresh instead. [2025-10-03T19:20:38.283932] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-03T19:20:38.283976] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-03T19:20:38.284020] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-03T19:20:38.284054] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-03T19:20:38.393993] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-03T19:20:38.679595] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:39.190692] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-03T19:20:39.990672] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-03T19:20:40.271801] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:20:40.790689] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-03T19:20:41.005011] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:20:41.590689] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-03T19:20:42.055049] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-03T19:20:42.390705] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-03T19:20:42.508527] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:20:43.190707] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-03T19:20:43.426235] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:20:43.990759] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-03T19:20:44.103297] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:20:44.139149] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T19:20:44.790728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-03T19:20:45.590686] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-03T19:20:45.680292] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:20:46.348323] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:20:46.390754] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-03T19:20:47.025824] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-03T19:20:47.190680] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-03T19:20:47.990691] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-03T19:20:48.138301] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:20:48.790677] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-03T19:20:48.983263] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T19:20:49.047224] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T19:20:49.590688] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-03T19:20:50.390722] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-03T19:20:50.511737] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:20:50.558121] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T19:20:51.190742] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-03T19:20:51.990690] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-03T19:20:52.146053] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:20:52.169250] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:20:52.790699] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-03T19:20:53.590697] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-03T19:20:54.186848] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T19:20:54.261578] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T19:20:54.367122] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:20:54.368388] [INFO ] [REMOTE ] HCI: Full fetch complete (19458 records). [2025-10-03T19:20:54.368470] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-03T19:20:54.395835] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-03T19:20:54.808399] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-03T19:20:54.808490] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-03T19:20:54.808993] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-03T19:20:54.809092] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-03T19:20:54.810034] [DEBUG] [LOCAL ] HCI: Trimmed 19458 records to 14103 (keeping 200 days of data) [2025-10-03T19:20:54.915680] [DEBUG] [LOCAL ] HCI: Primary data saved (14103 records). [2025-10-03T19:20:54.915880] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-03T19:20:54.915979] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HCI took 33.4s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-03T19:20:55.115853] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:55.116021] [DEBUG] [LOCAL ] HEI: No existing data file found in primary storage. [2025-10-03T19:20:55.116059] [WARN ] [MAIN ] HEI: No existing data found, performing full refresh instead. [2025-10-03T19:20:55.116176] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-03T19:20:55.116219] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-03T19:20:55.116262] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-03T19:20:55.116297] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-03T19:20:55.199028] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-03T19:20:55.510869] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:55.990681] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-03T19:20:56.140712] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:20:56.790686] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-03T19:20:57.135511] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:20:57.590704] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-03T19:20:57.647976] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:20:58.334182] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:20:58.390681] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-03T19:20:59.049380] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:20:59.190715] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-03T19:20:59.982389] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:20:59.985048] [INFO ] [REMOTE ] HDB: Full fetch complete (75309 records). [2025-10-03T19:20:59.985200] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-03T19:20:59.998454] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-03T19:21:00.437172] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-03T19:21:00.437289] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-03T19:21:00.438354] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-03T19:21:00.438514] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-03T19:21:00.440399] [DEBUG] [LOCAL ] HDB: Trimmed 75309 records to 52716 (keeping 200 days of data) [2025-10-03T19:21:00.573695] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:21:00.795636] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-03T19:21:00.824197] [DEBUG] [LOCAL ] HDB: Primary data saved (52716 records). [2025-10-03T19:21:00.824360] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-03T19:21:00.824458] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HDB took 39.3s. Estimated remaining: 3h 12m 5s. Rate: 7.1 symbols/min [2025-10-03T19:21:01.010947] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:01.011116] [DEBUG] [LOCAL ] HEQ: No existing data file found in primary storage. [2025-10-03T19:21:01.011155] [WARN ] [MAIN ] HEQ: No existing data found, performing full refresh instead. [2025-10-03T19:21:01.011394] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-03T19:21:01.011448] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-03T19:21:01.011493] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-03T19:21:01.011528] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-03T19:21:01.421200] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:01.590736] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-03T19:21:01.879061] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:21:01.952028] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T19:21:02.390724] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-03T19:21:03.190743] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-03T19:21:03.866422] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T19:21:03.934030] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T19:21:03.939740] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T19:21:03.990685] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-03T19:21:04.790683] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-03T19:21:05.454541] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:21:05.590728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-03T19:21:06.390639] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-03T19:21:06.691287] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:21:06.695322] [INFO ] [REMOTE ] HD: Full fetch complete (77442 records). [2025-10-03T19:21:06.695550] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-03T19:21:07.059739] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:21:07.117870] [INFO ] [REMOTE ] HE: Full fetch complete (72314 records). [2025-10-03T19:21:07.109068] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T19:21:07.140040] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-03T19:21:07.163218] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-03T19:21:07.163390] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-03T19:21:07.164425] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-03T19:21:07.164549] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-03T19:21:07.201753] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-03T19:21:07.281754] [DEBUG] [LOCAL ] HD: Trimmed 77442 records to 54268 (keeping 200 days of data) [2025-10-03T19:21:07.731060] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-03T19:21:07.731517] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-03T19:21:07.733022] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-03T19:21:07.733669] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-03T19:21:07.742237] [DEBUG] [LOCAL ] HE: Trimmed 72314 records to 49729 (keeping 200 days of data) [2025-10-03T19:21:07.992389] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-03T19:21:08.296621] [DEBUG] [LOCAL ] HD: Primary data saved (54268 records). [2025-10-03T19:21:08.297607] [INFO ] [MAIN ] HD: Full history saved. [2025-10-03T19:21:08.298107] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 46.8s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-03T19:21:08.470134] [DEBUG] [LOCAL ] HE: Primary data saved (49729 records). [2025-10-03T19:21:08.481534] [INFO ] [MAIN ] HE: Full history saved. [2025-10-03T19:21:08.504047] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:08.504457] [DEBUG] [LOCAL ] HESM: No existing data file found in primary storage. [2025-10-03T19:21:08.504321] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 30.4s. Estimated remaining: 3h 11m 36s. Rate: 7.1 symbols/min [2025-10-03T19:21:08.504610] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-10-03T19:21:08.527377] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-03T19:21:08.554257] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-03T19:21:08.590496] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-03T19:21:08.601291] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-03T19:21:08.658635] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T19:21:08.798722] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:08.795132] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-03T19:21:08.815275] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-03T19:21:08.829127] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-03T19:21:08.829681] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-03T19:21:08.829833] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-03T19:21:08.840479] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-03T19:21:08.845801] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-03T19:21:09.365287] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:09.470230] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T19:21:09.471926] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-03T19:21:09.567920] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:09.590618] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-03T19:21:09.916138] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-03T19:21:10.390695] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-03T19:21:11.190689] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-03T19:21:11.536468] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T19:21:11.938522] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T19:21:11.990728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-03T19:21:12.790721] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-03T19:21:13.590691] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-03T19:21:13.630754] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:21:13.631224] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T19:21:13.928663] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T19:21:14.390682] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-03T19:21:15.190682] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-03T19:21:15.465473] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-03T19:21:15.951042] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:21:15.990619] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-03T19:21:16.790741] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-03T19:21:17.595787] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-03T19:21:17.620752] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:21:18.268606] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T19:21:18.295267] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:21:18.390712] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-03T19:21:19.190691] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-03T19:21:19.506440] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-03T19:21:19.922428] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:21:19.990634] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-03T19:21:20.790715] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-03T19:21:21.025478] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-03T19:21:21.396634] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:21:21.590705] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-03T19:21:21.836005] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-03T19:21:22.390720] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-03T19:21:23.190699] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-03T19:21:23.993195] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-03T19:21:23.996699] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:21:24.232053] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-03T19:21:24.586821] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:21:24.790732] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-03T19:21:25.015102] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-03T19:21:25.590737] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-03T19:21:26.153482] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:21:26.390682] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-03T19:21:26.646963] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-03T19:21:27.190736] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-03T19:21:27.990705] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-03T19:21:28.701115] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T19:21:28.702721] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:21:28.790726] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-03T19:21:29.590701] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-03T19:21:30.188895] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:21:30.399202] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-03T19:21:30.405048] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:21:30.750876] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T19:21:30.751543] [INFO ] [REMOTE ] HF: Full fetch complete (474 records). [2025-10-03T19:21:30.751617] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-03T19:21:30.939905] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-03T19:21:30.940076] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:21:30.940148] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:21:30.940248] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-03T19:21:30.940339] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-03T19:21:30.940399] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-03T19:21:30.940464] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-03T19:21:30.940568] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HF took 22.4s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-03T19:21:31.128778] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:31.129008] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-03T19:21:31.129062] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-03T19:21:31.129213] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-03T19:21:31.129263] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-03T19:21:31.129316] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-03T19:21:31.129356] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-03T19:21:31.200805] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-03T19:21:31.509866] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:31.990723] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-03T19:21:32.790741] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-03T19:21:33.060217] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-03T19:21:33.064756] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:21:33.366282] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:21:33.590724] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-03T19:21:34.390725] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-03T19:21:35.190722] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-03T19:21:35.286313] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:21:35.312333] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T19:21:35.990728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-03T19:21:36.436454] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T19:21:36.790698] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-03T19:21:37.590684] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-03T19:21:37.761735] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:21:37.823113] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:21:37.825509] [INFO ] [REMOTE ] HEI: Full fetch complete (48689 records). [2025-10-03T19:21:37.825731] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-03T19:21:38.359387] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-03T19:21:38.354883] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T19:21:38.359628] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-03T19:21:38.361173] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-03T19:21:38.363064] [INFO ] [REMOTE ] HEQ: Full fetch complete (9332 records). [2025-10-03T19:21:38.363195] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-03T19:21:38.362976] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-03T19:21:38.394913] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-03T19:21:38.471112] [DEBUG] [LOCAL ] HEI: Trimmed 48689 records to 32420 (keeping 200 days of data) [2025-10-03T19:21:38.835511] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:21:38.981232] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-03T19:21:38.984479] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-03T19:21:38.985862] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-03T19:21:38.985944] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-03T19:21:38.987691] [DEBUG] [LOCAL ] HEQ: Trimmed 9332 records to 6450 (keeping 200 days of data) [2025-10-03T19:21:39.095025] [DEBUG] [LOCAL ] HEQ: Primary data saved (6450 records). [2025-10-03T19:21:39.095772] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-03T19:21:39.096429] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEQ took 38.3s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-03T19:21:39.195763] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-03T19:21:39.298115] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:39.299220] [DEBUG] [LOCAL ] HFRO: No existing data file found in primary storage. [2025-10-03T19:21:39.299910] [WARN ] [MAIN ] HFRO: No existing data found, performing full refresh instead. [2025-10-03T19:21:39.300319] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-03T19:21:39.300762] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-03T19:21:39.301116] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-03T19:21:39.301502] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-03T19:21:39.375296] [DEBUG] [LOCAL ] HEI: Primary data saved (32420 records). [2025-10-03T19:21:39.388946] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-03T19:21:39.389056] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HEI took 44.5s. Estimated remaining: 3h 11m 18s. Rate: 7.1 symbols/min [2025-10-03T19:21:39.781604] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:39.810983] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-03T19:21:39.814164] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-03T19:21:39.814306] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-03T19:21:39.814367] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-03T19:21:39.814453] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-03T19:21:39.814523] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-03T19:21:40.012910] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-03T19:21:40.008620] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:40.290699] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:40.470815] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:21:40.624155] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:21:40.629345] [INFO ] [REMOTE ] HESM: Full fetch complete (69356 records). [2025-10-03T19:21:40.629576] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-03T19:21:40.798205] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-03T19:21:41.070771] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-03T19:21:41.070855] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-03T19:21:41.071794] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-03T19:21:41.071884] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-03T19:21:41.073347] [DEBUG] [LOCAL ] HESM: Trimmed 69356 records to 48942 (keeping 200 days of data) [2025-10-03T19:21:41.276868] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T19:21:41.400822] [DEBUG] [LOCAL ] HESM: Primary data saved (48942 records). [2025-10-03T19:21:41.400979] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-03T19:21:41.401102] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 33.1s. Estimated remaining: 3h 11m 1s. Rate: 7.1 symbols/min [2025-10-03T19:21:41.591492] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:41.591571] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-03T19:21:41.592825] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-10-03T19:21:41.592901] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-10-03T19:21:41.593066] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-03T19:21:41.593121] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-03T19:21:41.593230] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-03T19:21:41.593279] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-03T19:21:41.995893] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:42.134941] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T19:21:42.390731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-03T19:21:43.190679] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-03T19:21:43.475960] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:21:43.515935] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-03T19:21:43.990730] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-03T19:21:44.306559] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:21:44.790713] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-03T19:21:45.216883] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T19:21:45.590729] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-03T19:21:46.368166] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:21:46.390739] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-03T19:21:47.170392] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:21:47.190675] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-03T19:21:47.948640] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:21:47.990704] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-03T19:21:48.790685] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-03T19:21:49.122331] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:21:49.375470] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T19:21:49.590712] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-03T19:21:50.331075] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:21:50.390686] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-03T19:21:51.190699] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-03T19:21:51.206054] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:21:51.935935] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:21:51.990687] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-03T19:21:52.757921] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:21:52.790722] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-03T19:21:53.590685] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-03T19:21:53.854041] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:21:54.366216] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:21:54.390610] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-03T19:21:55.190626] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-03T19:21:55.284213] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T19:21:55.598528] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T19:21:55.990727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-03T19:21:56.790269] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:21:56.791486] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-03T19:21:57.237048] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T19:21:57.590703] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-03T19:21:58.390696] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-03T19:21:58.529807] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:21:59.190751] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-03T19:21:59.280293] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:21:59.990664] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-03T19:22:00.292488] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:22:00.790626] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-03T19:22:00.864135] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:22:01.267087] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T19:22:01.267803] [INFO ] [REMOTE ] HFND: Full fetch complete (1782 records). [2025-10-03T19:22:01.267879] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-03T19:22:01.461438] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T19:22:01.461682] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:22:01.461782] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:22:01.461860] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-03T19:22:01.461931] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-03T19:22:01.461970] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-03T19:22:01.462013] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-03T19:22:01.462103] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 30.5s. Estimated remaining: 3h 11m 8s. Rate: 7.1 symbols/min [2025-10-03T19:22:01.595844] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-03T19:22:01.669871] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:01.670299] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-10-03T19:22:01.670359] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-10-03T19:22:01.670508] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-03T19:22:01.670615] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-03T19:22:01.670741] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-03T19:22:01.670786] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-03T19:22:02.092804] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:02.390695] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-03T19:22:02.591887] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T19:22:03.190731] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-03T19:22:03.481905] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:22:03.967356] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:22:03.990698] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-03T19:22:04.705422] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T19:22:04.790731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-03T19:22:05.590639] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-03T19:22:05.659128] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:22:06.390676] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-03T19:22:06.542121] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:22:07.156194] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:22:07.190633] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-03T19:22:07.990729] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-03T19:22:08.006803] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T19:22:08.790719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-03T19:22:08.960181] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:22:09.510471] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T19:22:09.590727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-03T19:22:10.389154] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T19:22:10.391684] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-03T19:22:11.163869] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T19:22:11.190677] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-03T19:22:11.946635] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:22:11.990660] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-03T19:22:12.725274] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T19:22:12.726786] [INFO ] [REMOTE ] HGLB: Full fetch complete (14818 records). [2025-10-03T19:22:12.726869] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-03T19:22:12.795783] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-03T19:22:13.134368] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-03T19:22:13.134450] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-03T19:22:13.134867] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-03T19:22:13.134930] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-03T19:22:13.135511] [DEBUG] [LOCAL ] HGLB: Trimmed 14818 records to 9821 (keeping 200 days of data) [2025-10-03T19:22:13.197221] [DEBUG] [LOCAL ] HGLB: Primary data saved (9821 records). [2025-10-03T19:22:13.197369] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-03T19:22:13.197447] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HGLB took 31.8s. Estimated remaining: 3h 11m 4s. Rate: 7.1 symbols/min [2025-10-03T19:22:13.384507] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:13.384746] [DEBUG] [LOCAL ] HGV: No existing data file found in primary storage. [2025-10-03T19:22:13.384804] [WARN ] [MAIN ] HGV: No existing data found, performing full refresh instead. [2025-10-03T19:22:13.384915] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-03T19:22:13.384958] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-03T19:22:13.385000] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-03T19:22:13.385032] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-03T19:22:13.593465] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-03T19:22:13.626994] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:22:13.792561] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:14.390734] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-03T19:22:14.633048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:22:15.153171] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:22:15.190619] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-03T19:22:15.990664] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-03T19:22:16.043421] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:22:16.790704] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-03T19:22:16.975919] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T19:22:17.590744] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-03T19:22:17.751965] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:22:17.753726] [INFO ] [REMOTE ] HGER: Full fetch complete (17187 records). [2025-10-03T19:22:17.753810] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-03T19:22:18.170667] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-03T19:22:18.170789] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-03T19:22:18.171226] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-03T19:22:18.171269] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-03T19:22:18.172018] [DEBUG] [LOCAL ] HGER: Trimmed 17187 records to 13988 (keeping 200 days of data) [2025-10-03T19:22:18.261201] [DEBUG] [LOCAL ] HGER: Primary data saved (13988 records). [2025-10-03T19:22:18.261382] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-03T19:22:18.261475] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGER took 38.9s. Estimated remaining: 3h 10m 51s. Rate: 7.1 symbols/min [2025-10-03T19:22:18.395822] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-03T19:22:18.458507] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:18.458714] [DEBUG] [LOCAL ] HHH: No existing data file found in primary storage. [2025-10-03T19:22:18.458765] [WARN ] [MAIN ] HHH: No existing data found, performing full refresh instead. [2025-10-03T19:22:18.458879] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-03T19:22:18.458923] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-03T19:22:18.458966] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-03T19:22:18.459000] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-03T19:22:18.860423] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:19.001176] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:22:19.190623] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-03T19:22:19.558458] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:22:19.990689] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-03T19:22:20.721911] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:22:20.790700] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-03T19:22:21.063051] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:22:21.507004] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T19:22:21.590693] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-03T19:22:22.390701] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-03T19:22:22.959631] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:22:23.190668] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-03T19:22:23.468026] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:22:23.990722] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-03T19:22:24.095691] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T19:22:24.096860] [INFO ] [REMOTE ] HGTY: Full fetch complete (17270 records). [2025-10-03T19:22:24.096941] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-03T19:22:24.493217] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-03T19:22:24.493305] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-03T19:22:24.493740] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-03T19:22:24.493809] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-03T19:22:24.494437] [DEBUG] [LOCAL ] HGTY: Trimmed 17270 records to 13362 (keeping 200 days of data) [2025-10-03T19:22:24.574183] [DEBUG] [LOCAL ] HGTY: Primary data saved (13362 records). [2025-10-03T19:22:24.574329] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-03T19:22:24.574417] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGTY took 23.1s. Estimated remaining: 3h 10m 40s. Rate: 7.1 symbols/min [2025-10-03T19:22:24.750184] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:24.750374] [DEBUG] [LOCAL ] HI: No existing data file found in primary storage. [2025-10-03T19:22:24.750416] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-10-03T19:22:24.750530] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-03T19:22:24.750573] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-03T19:22:24.750615] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-03T19:22:24.750677] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-03T19:22:24.795809] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-03T19:22:25.148988] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:25.343061] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:22:25.590693] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-03T19:22:25.821865] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:22:26.390699] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-03T19:22:26.896606] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:22:27.190984] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-03T19:22:27.774232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:22:27.990629] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-03T19:22:28.418786] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T19:22:28.790733] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-03T19:22:29.305507] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T19:22:29.442115] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:22:29.443805] [INFO ] [REMOTE ] HFRO: Full fetch complete (28962 records). [2025-10-03T19:22:29.443896] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-03T19:22:29.595733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-03T19:22:29.842835] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-03T19:22:29.842938] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-03T19:22:29.843616] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-03T19:22:29.843722] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-03T19:22:29.844593] [DEBUG] [LOCAL ] HFRO: Trimmed 28962 records to 17887 (keeping 200 days of data) [2025-10-03T19:22:29.956822] [DEBUG] [LOCAL ] HFRO: Primary data saved (17887 records). [2025-10-03T19:22:29.956993] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-03T19:22:29.957111] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HFRO took 50.9s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-03T19:22:30.211839] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:30.212129] [DEBUG] [LOCAL ] HIG: No existing data file found in primary storage. [2025-10-03T19:22:30.212384] [WARN ] [MAIN ] HIG: No existing data found, performing full refresh instead. [2025-10-03T19:22:30.212550] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-03T19:22:30.212610] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-03T19:22:30.212725] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-03T19:22:30.212795] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-03T19:22:30.404543] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-03T19:22:30.724472] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:31.190716] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-03T19:22:31.259338] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:22:31.852827] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:22:31.990702] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-03T19:22:32.392818] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T19:22:32.790707] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-03T19:22:33.590709] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-03T19:22:33.630308] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:22:34.379241] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:22:34.390603] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-03T19:22:34.950024] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:22:35.190695] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-03T19:22:35.935131] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:22:35.990639] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-03T19:22:36.730099] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:22:36.790741] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-03T19:22:37.341938] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T19:22:37.590746] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-03T19:22:38.318919] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:22:38.390732] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-03T19:22:39.157058] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:22:39.190631] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-03T19:22:39.995501] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-03T19:22:40.001352] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:22:40.134554] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:22:40.790743] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-03T19:22:41.580014] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:22:41.590605] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-03T19:22:42.390686] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-03T19:22:42.526219] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:22:43.066158] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:22:43.190694] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-03T19:22:43.515778] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:22:43.517978] [INFO ] [REMOTE ] HHH: Full fetch complete (45664 records). [2025-10-03T19:22:43.518076] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-03T19:22:43.916979] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-03T19:22:43.917073] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-03T19:22:43.917780] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-03T19:22:43.917844] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-03T19:22:43.918861] [DEBUG] [LOCAL ] HHH: Trimmed 45664 records to 33147 (keeping 200 days of data) [2025-10-03T19:22:44.004023] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-03T19:22:44.128113] [DEBUG] [LOCAL ] HHH: Primary data saved (33147 records). [2025-10-03T19:22:44.128293] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-03T19:22:44.128403] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HHH took 25.9s. Estimated remaining: 3h 10m 27s. Rate: 7.1 symbols/min [2025-10-03T19:22:44.311851] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:44.312212] [DEBUG] [LOCAL ] HII: No existing data file found in primary storage. [2025-10-03T19:22:44.312310] [WARN ] [MAIN ] HII: No existing data found, performing full refresh instead. [2025-10-03T19:22:44.312547] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-03T19:22:44.312763] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-03T19:22:44.312839] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-03T19:22:44.312878] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-03T19:22:44.752503] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:44.754521] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T19:22:44.790634] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-03T19:22:45.308879] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:22:45.590691] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-03T19:22:46.215545] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T19:22:46.390683] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-03T19:22:47.159992] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:22:47.190625] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-03T19:22:47.835021] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:22:47.990699] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-03T19:22:48.677118] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:22:48.790707] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-03T19:22:49.548032] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:22:49.590624] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-03T19:22:50.149946] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:22:50.390694] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-03T19:22:51.065421] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:22:51.067830] [INFO ] [REMOTE ] HGV: Full fetch complete (65949 records). [2025-10-03T19:22:51.067957] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-03T19:22:51.193460] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-03T19:22:51.513618] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-03T19:22:51.513737] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-03T19:22:51.514753] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-03T19:22:51.514821] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-03T19:22:51.516286] [DEBUG] [LOCAL ] HGV: Trimmed 65949 records to 47226 (keeping 200 days of data) [2025-10-03T19:22:51.728043] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T19:22:51.737068] [INFO ] [REMOTE ] HI: Full fetch complete (50054 records). [2025-10-03T19:22:51.738224] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-03T19:22:52.002216] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-03T19:22:52.257844] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-03T19:22:52.258951] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-03T19:22:52.260430] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-03T19:22:52.260896] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-03T19:22:52.264234] [DEBUG] [LOCAL ] HI: Trimmed 50054 records to 35823 (keeping 200 days of data) [2025-10-03T19:22:52.429401] [DEBUG] [LOCAL ] HGV: Primary data saved (47226 records). [2025-10-03T19:22:52.430698] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-03T19:22:52.430813] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HGV took 39.2s. Estimated remaining: 3h 10m 18s. Rate: 7.1 symbols/min [2025-10-03T19:22:52.646757] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:52.648009] [DEBUG] [LOCAL ] HIMS: No existing data file found in primary storage. [2025-10-03T19:22:52.648664] [WARN ] [MAIN ] HIMS: No existing data found, performing full refresh instead. [2025-10-03T19:22:52.649556] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-03T19:22:52.650198] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-03T19:22:52.650589] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-03T19:22:52.650915] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-03T19:22:53.132903] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:53.135831] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-03T19:22:53.159821] [DEBUG] [LOCAL ] HI: Primary data saved (35823 records). [2025-10-03T19:22:53.159988] [INFO ] [MAIN ] HI: Full history saved. [2025-10-03T19:22:53.160072] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 28.6s. Estimated remaining: 3h 9m 60s. Rate: 7.1 symbols/min [2025-10-03T19:22:53.344543] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:53.344740] [DEBUG] [LOCAL ] HIO: No existing data file found in primary storage. [2025-10-03T19:22:53.344789] [WARN ] [MAIN ] HIO: No existing data found, performing full refresh instead. [2025-10-03T19:22:53.344905] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-03T19:22:53.344949] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-03T19:22:53.344993] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-03T19:22:53.345028] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-03T19:22:53.730726] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:53.731348] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-03T19:23:06.387339] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (15.19 seconds). [2025-10-03T19:23:06.397859] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-03T19:23:07.322990] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (14.19 seconds). [2025-10-03T19:23:07.334902] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-03T19:23:08.692354] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (14.96 seconds). [2025-10-03T19:23:08.702345] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-03T19:23:09.010709] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-03T19:23:09.023268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-03T19:23:09.160056] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (17.16 seconds). [2025-10-03T19:23:09.168680] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-03T19:23:09.301287] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T19:23:09.315164] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-03T19:23:09.860794] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:23:09.870471] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-03T19:23:10.479106] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:23:10.494188] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-03T19:23:11.007525] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:23:11.022106] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-03T19:23:11.056321] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:23:11.066229] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-03T19:23:12.067575] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-03T19:23:12.080239] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-03T19:23:12.144361] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:23:12.156083] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-03T19:23:12.181328] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T19:23:12.189946] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-03T19:23:12.440627] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T19:23:12.453447] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-03T19:23:13.322568] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:23:13.329376] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-03T19:23:13.593292] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:23:13.604014] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-03T19:23:13.981277] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T19:23:13.986833] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-03T19:23:14.164661] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:23:14.177057] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-03T19:23:14.756978] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-03T19:23:14.788692] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:23:14.794994] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-03T19:23:14.795578] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-03T19:23:14.824092] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T19:23:14.832207] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-03T19:23:15.901806] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T19:23:15.907962] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-03T19:23:16.204254] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:23:16.217018] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-03T19:23:16.295268] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:23:16.304077] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-03T19:23:17.299629] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:23:17.306159] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-03T19:23:17.741282] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-03T19:23:17.780703] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-03T19:23:17.782849] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:23:17.793306] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-03T19:23:17.835444] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:23:17.848033] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-03T19:23:18.173799] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:23:18.182167] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-03T19:23:18.949944] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:23:18.958363] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-03T19:23:19.351489] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:23:19.354156] [INFO ] [REMOTE ] HIO: Full fetch complete (37649 records). [2025-10-03T19:23:19.354262] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-03T19:23:19.840057] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:23:19.868855] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-03T19:23:19.869145] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-03T19:23:19.870023] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-03T19:23:19.870109] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-03T19:23:19.870767] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-03T19:23:19.874711] [DEBUG] [LOCAL ] HIO: Trimmed 37649 records to 24380 (keeping 200 days of data) [2025-10-03T19:23:20.045207] [DEBUG] [LOCAL ] HIO: Primary data saved (24380 records). [2025-10-03T19:23:20.045400] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-03T19:23:20.045752] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIO took 26.9s. Estimated remaining: 3h 10m 16s. Rate: 7.1 symbols/min [2025-10-03T19:23:20.269019] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:20.269822] [DEBUG] [LOCAL ] HIPO: No existing data file found in primary storage. [2025-10-03T19:23:20.269997] [WARN ] [MAIN ] HIPO: No existing data found, performing full refresh instead. [2025-10-03T19:23:20.270350] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-03T19:23:20.271069] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-03T19:23:20.280754] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-03T19:23:20.295880] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-03T19:23:20.350609] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:23:20.433117] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-03T19:23:20.751477] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:20.751880] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-03T19:23:20.793431] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-03T19:23:20.807290] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-03T19:23:21.536912] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:23:21.539677] [INFO ] [REMOTE ] HIG: Full fetch complete (73205 records). [2025-10-03T19:23:21.539821] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-03T19:23:21.751929] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:23:21.820951] [INFO ] [REMOTE ] HII: Full fetch complete (52950 records). [2025-10-03T19:23:21.848135] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-03T19:23:22.137211] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-03T19:23:22.160961] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-03T19:23:22.162267] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-03T19:23:22.162378] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-03T19:23:22.198300] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T19:23:22.245749] [DEBUG] [LOCAL ] HIG: Trimmed 73205 records to 51948 (keeping 200 days of data) [2025-10-03T19:23:22.251729] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-03T19:23:22.617861] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-03T19:23:22.618451] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-03T19:23:22.622512] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-03T19:23:22.623139] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-03T19:23:22.629907] [DEBUG] [LOCAL ] HII: Trimmed 52950 records to 35064 (keeping 200 days of data) [2025-10-03T19:23:23.263696] [DEBUG] [LOCAL ] HII: Primary data saved (35064 records). [2025-10-03T19:23:23.264940] [INFO ] [MAIN ] HII: Full history saved. [2025-10-03T19:23:23.265537] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HII took 39.1s. Estimated remaining: 3h 10m 0s. Rate: 7.1 symbols/min [2025-10-03T19:23:23.419716] [DEBUG] [LOCAL ] HIG: Primary data saved (51948 records). [2025-10-03T19:23:23.425813] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-03T19:23:23.501726] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:23.477304] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HIG took 53.5s. Estimated remaining: 3h 9m 41s. Rate: 7.1 symbols/min [2025-10-03T19:23:23.507594] [DEBUG] [LOCAL ] HIW: No existing data file found in primary storage. [2025-10-03T19:23:23.600913] [WARN ] [MAIN ] HIW: No existing data found, performing full refresh instead. [2025-10-03T19:23:23.659573] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-03T19:23:23.659450] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-03T19:23:23.677332] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-03T19:23:23.677562] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-03T19:23:23.677244] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:23:23.694991] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-03T19:23:23.749413] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-03T19:23:23.810498] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-03T19:23:23.873209] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:23.884183] [DEBUG] [LOCAL ] HIX: No existing data file found in primary storage. [2025-10-03T19:23:23.894574] [WARN ] [MAIN ] HIX: No existing data found, performing full refresh instead. [2025-10-03T19:23:23.903555] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-03T19:23:23.903720] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-03T19:23:23.911962] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-03T19:23:23.916195] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-03T19:23:24.521582] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:24.535031] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-03T19:23:24.627170] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:24.790751] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-03T19:23:24.822104] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:23:25.590730] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-03T19:23:25.972874] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:23:26.064005] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:23:26.296440] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-03T19:23:26.390680] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-03T19:23:26.689515] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:23:27.190718] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-03T19:23:27.792466] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T19:23:27.990703] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-03T19:23:28.306373] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:23:28.790745] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-03T19:23:29.119461] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:23:29.590727] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-03T19:23:30.036820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T19:23:30.390735] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-03T19:23:31.190637] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-03T19:23:31.507926] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T19:23:31.990672] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-03T19:23:32.299965] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-03T19:23:32.790708] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-03T19:23:32.880507] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:23:33.077864] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T19:23:33.524363] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T19:23:33.590714] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-03T19:23:34.390695] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-03T19:23:35.190736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-03T19:23:35.255345] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:23:35.705820] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:23:35.990723] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-03T19:23:36.333344] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:23:36.790733] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-03T19:23:37.044575] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:23:37.590717] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-03T19:23:38.384094] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:23:38.393891] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-03T19:23:38.592415] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:23:39.190728] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-03T19:23:39.589291] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:23:39.990692] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-03T19:23:40.768374] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:23:40.790615] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-03T19:23:41.056718] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:23:41.590695] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-03T19:23:42.393790] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-03T19:23:42.400159] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:23:42.565588] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:23:43.190698] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-03T19:23:43.990706] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-03T19:23:44.671810] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:23:44.673498] [INFO ] [REMOTE ] HIPO: Full fetch complete (31538 records). [2025-10-03T19:23:44.673605] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-03T19:23:44.792498] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-03T19:23:44.915071] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:23:45.191396] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-03T19:23:45.191681] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-03T19:23:45.192444] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-03T19:23:45.192675] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-03T19:23:45.194162] [DEBUG] [LOCAL ] HIPO: Trimmed 31538 records to 22331 (keeping 200 days of data) [2025-10-03T19:23:45.352527] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-03T19:23:45.412001] [DEBUG] [LOCAL ] HIPO: Primary data saved (22331 records). [2025-10-03T19:23:45.412166] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-03T19:23:45.412288] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIPO took 25.4s. Estimated remaining: 3h 9m 50s. Rate: 7.1 symbols/min [2025-10-03T19:23:45.592919] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-03T19:23:45.618213] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:45.620100] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-10-03T19:23:45.620213] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-10-03T19:23:45.620331] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-03T19:23:45.620384] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-03T19:23:45.620444] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-03T19:23:45.620493] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-03T19:23:46.062006] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:46.077638] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:23:46.390694] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-03T19:23:47.028420] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:23:47.190689] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-03T19:23:47.626424] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T19:23:47.990716] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-03T19:23:48.790664] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-03T19:23:48.986856] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:23:49.339380] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-03T19:23:49.342353] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-03T19:23:49.342493] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-03T19:23:49.600478] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-03T19:23:49.783387] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-03T19:23:49.783545] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-03T19:23:49.784767] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-03T19:23:49.784922] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-03T19:23:49.792373] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T19:23:49.796027] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-10-03T19:23:49.796877] [INFO ] [REMOTE ] HIW: Full fetch complete (64807 records). [2025-10-03T19:23:49.797383] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-03T19:23:50.364304] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-03T19:23:50.365298] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-03T19:23:50.366605] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-03T19:23:50.367276] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-03T19:23:50.375012] [DEBUG] [LOCAL ] HIW: Trimmed 64807 records to 45164 (keeping 200 days of data) [2025-10-03T19:23:50.432589] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-03T19:23:50.930222] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:23:50.945323] [DEBUG] [LOCAL ] HIW: Primary data saved (45164 records). [2025-10-03T19:23:50.946315] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-03T19:23:50.946507] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIW took 27.7s. Estimated remaining: 3h 9m 38s. Rate: 7.1 symbols/min [2025-10-03T19:23:51.126000] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-03T19:23:51.134984] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-03T19:23:51.153542] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIMS took 58.7s. Estimated remaining: 3h 9m 19s. Rate: 7.1 symbols/min [2025-10-03T19:23:51.155427] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:51.206431] [DEBUG] [LOCAL ] HL: No existing data file found in primary storage. [2025-10-03T19:23:51.198595] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-03T19:23:51.206605] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-10-03T19:23:51.230746] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-03T19:23:51.230988] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-03T19:23:51.249804] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-03T19:23:51.272608] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-03T19:23:51.470171] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:51.470432] [DEBUG] [LOCAL ] HLF: No existing data file found in primary storage. [2025-10-03T19:23:51.470509] [WARN ] [MAIN ] HLF: No existing data found, performing full refresh instead. [2025-10-03T19:23:51.481700] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-03T19:23:51.492090] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-03T19:23:51.492221] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-03T19:23:51.497427] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-03T19:23:52.127907] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:52.196225] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:23:52.189028] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-03T19:23:52.246561] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:52.306841] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:23:52.790702] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-03T19:23:53.590705] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-03T19:23:53.739696] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:23:53.896063] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:23:54.390732] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-03T19:23:54.669606] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T19:23:55.190626] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-03T19:23:55.409229] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T19:23:55.411744] [INFO ] [REMOTE ] HIX: Full fetch complete (30771 records). [2025-10-03T19:23:55.411847] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-03T19:23:55.876814] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-03T19:23:55.876908] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-03T19:23:55.877549] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-03T19:23:55.877710] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-03T19:23:55.878614] [DEBUG] [LOCAL ] HIX: Trimmed 30771 records to 20931 (keeping 200 days of data) [2025-10-03T19:23:55.991519] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-03T19:23:56.006150] [DEBUG] [LOCAL ] HIX: Primary data saved (20931 records). [2025-10-03T19:23:56.006288] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-03T19:23:56.006374] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HIX took 32.5s. Estimated remaining: 3h 9m 6s. Rate: 7.1 symbols/min [2025-10-03T19:23:56.199062] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:56.199481] [DEBUG] [LOCAL ] HLI: No existing data file found in primary storage. [2025-10-03T19:23:56.199548] [WARN ] [MAIN ] HLI: No existing data found, performing full refresh instead. [2025-10-03T19:23:56.199810] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-03T19:23:56.199896] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-03T19:23:56.199967] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-03T19:23:56.200012] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-03T19:23:56.601718] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:56.635108] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T19:23:56.790679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-03T19:23:57.485985] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:23:57.590716] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-03T19:23:58.370040] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:23:58.390616] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-03T19:23:58.779527] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:23:59.190750] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-03T19:23:59.990635] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-03T19:24:00.107073] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:24:00.488409] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:24:00.790714] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-03T19:24:01.352392] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:24:01.565022] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:24:01.590624] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-03T19:24:02.390689] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-03T19:24:03.190724] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-03T19:24:03.492569] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T19:24:03.835692] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:24:03.990718] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-03T19:24:04.790689] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-03T19:24:04.908469] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:24:05.590678] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-03T19:24:06.054891] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T19:24:06.225285] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:24:06.390679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-03T19:24:06.620816] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T19:24:07.190735] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-03T19:24:07.990720] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-03T19:24:08.078186] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:24:08.528431] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:24:08.790694] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-03T19:24:09.590723] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-03T19:24:09.780064] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:24:09.782826] [INFO ] [REMOTE ] HKD: Full fetch complete (28415 records). [2025-10-03T19:24:09.783025] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-03T19:24:09.996859] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:24:10.248121] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-03T19:24:10.248203] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-03T19:24:10.248843] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-03T19:24:10.248909] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-03T19:24:10.249619] [DEBUG] [LOCAL ] HKD: Trimmed 28415 records to 18629 (keeping 200 days of data) [2025-10-03T19:24:10.373846] [DEBUG] [LOCAL ] HKD: Primary data saved (18629 records). [2025-10-03T19:24:10.373993] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-03T19:24:10.374084] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HKD took 25.0s. Estimated remaining: 3h 9m 5s. Rate: 7.1 symbols/min [2025-10-03T19:24:10.390855] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-03T19:24:10.563043] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:10.563216] [DEBUG] [LOCAL ] HLIO: No existing data file found in primary storage. [2025-10-03T19:24:10.563255] [WARN ] [MAIN ] HLIO: No existing data found, performing full refresh instead. [2025-10-03T19:24:10.563406] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-03T19:24:10.563450] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-03T19:24:10.563492] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-03T19:24:10.563568] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-03T19:24:10.958896] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:11.190632] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-03T19:24:11.231824] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:24:11.990718] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-03T19:24:12.653413] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T19:24:12.696621] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:24:12.790708] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-03T19:24:13.590719] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-03T19:24:13.639028] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:24:13.804582] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T19:24:14.390743] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-03T19:24:15.190699] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-03T19:24:15.405042] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T19:24:15.577753] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T19:24:15.990676] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-03T19:24:16.310286] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:24:16.622544] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:24:16.790696] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-03T19:24:17.590715] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-03T19:24:18.180472] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T19:24:18.390692] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-03T19:24:19.195835] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-03T19:24:19.216153] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T19:24:19.533610] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:24:19.990719] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-03T19:24:20.790679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-03T19:24:21.215117] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:24:21.334955] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T19:24:21.590717] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-03T19:24:22.390713] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-03T19:24:22.476830] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:24:23.174082] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:24:23.190614] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-03T19:24:23.664716] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T19:24:23.990694] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-03T19:24:24.790686] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-03T19:24:25.495072] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-03T19:24:25.509323] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:24:25.590676] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-03T19:24:26.390739] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-03T19:24:26.446808] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:24:27.190734] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-03T19:24:27.571265] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-03T19:24:27.574770] [INFO ] [REMOTE ] HL: Full fetch complete (77661 records). [2025-10-03T19:24:27.574949] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-03T19:24:27.901621] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:24:27.993535] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-03T19:24:28.046490] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-03T19:24:28.046637] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-03T19:24:28.047743] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-03T19:24:28.047812] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-03T19:24:28.049554] [DEBUG] [LOCAL ] HL: Trimmed 77661 records to 54451 (keeping 200 days of data) [2025-10-03T19:24:28.401120] [DEBUG] [LOCAL ] HL: Primary data saved (54451 records). [2025-10-03T19:24:28.401308] [INFO ] [MAIN ] HL: Full history saved. [2025-10-03T19:24:28.401440] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HL took 37.5s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-03T19:24:28.620274] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:28.620713] [DEBUG] [LOCAL ] HLLY: No existing data file found in primary storage. [2025-10-03T19:24:28.620804] [WARN ] [MAIN ] HLLY: No existing data found, performing full refresh instead. [2025-10-03T19:24:28.621493] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-03T19:24:28.622814] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-03T19:24:28.622723] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:24:28.623012] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-03T19:24:28.623216] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-03T19:24:28.793690] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-03T19:24:29.026227] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:29.482027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T19:24:29.485146] [INFO ] [REMOTE ] HLF: Full fetch complete (71161 records). [2025-10-03T19:24:29.485265] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-03T19:24:29.594394] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-03T19:24:29.952305] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-03T19:24:29.952410] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-03T19:24:29.953436] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-03T19:24:29.953509] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-03T19:24:29.955061] [DEBUG] [LOCAL ] HLF: Trimmed 71161 records to 49195 (keeping 200 days of data) [2025-10-03T19:24:30.189044] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:24:30.285233] [DEBUG] [LOCAL ] HLF: Primary data saved (49195 records). [2025-10-03T19:24:30.285398] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-03T19:24:30.285517] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLF took 39.1s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-03T19:24:30.398379] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-03T19:24:30.481936] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:30.482133] [DEBUG] [LOCAL ] HLN: No existing data file found in primary storage. [2025-10-03T19:24:30.482190] [WARN ] [MAIN ] HLN: No existing data found, performing full refresh instead. [2025-10-03T19:24:30.482306] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-03T19:24:30.482350] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-03T19:24:30.482393] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-03T19:24:30.482427] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-03T19:24:30.918292] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:30.974021] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T19:24:31.190698] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-03T19:24:31.443805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T19:24:31.990631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-03T19:24:32.069424] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T19:24:32.790737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-03T19:24:33.247937] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:24:33.590742] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-03T19:24:34.390707] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-03T19:24:34.560232] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:24:34.828238] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T19:24:35.190716] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-03T19:24:35.393439] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:24:35.990696] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-03T19:24:36.285805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T19:24:36.790698] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-03T19:24:37.115106] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T19:24:37.116787] [INFO ] [REMOTE ] HLI: Full fetch complete (45302 records). [2025-10-03T19:24:37.116877] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-03T19:24:37.535052] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-03T19:24:37.535145] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-03T19:24:37.535980] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-03T19:24:37.536046] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-03T19:24:37.537036] [DEBUG] [LOCAL ] HLI: Trimmed 45302 records to 31274 (keeping 200 days of data) [2025-10-03T19:24:37.598109] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-03T19:24:37.752784] [DEBUG] [LOCAL ] HLI: Primary data saved (31274 records). [2025-10-03T19:24:37.752936] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-03T19:24:37.753017] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HLI took 41.7s. Estimated remaining: 3h 8m 42s. Rate: 7.1 symbols/min [2025-10-03T19:24:37.935512] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:37.935708] [DEBUG] [LOCAL ] HLT: No existing data file found in primary storage. [2025-10-03T19:24:37.935761] [WARN ] [MAIN ] HLT: No existing data found, performing full refresh instead. [2025-10-03T19:24:37.935875] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-03T19:24:37.935919] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-03T19:24:37.935963] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-03T19:24:37.935997] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-03T19:24:38.339555] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:38.390691] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-03T19:24:38.590639] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:24:38.610813] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:24:38.612374] [INFO ] [REMOTE ] HLIO: Full fetch complete (36242 records). [2025-10-03T19:24:38.612459] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-03T19:24:39.020760] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-03T19:24:39.020856] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-03T19:24:39.021555] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-03T19:24:39.021621] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-03T19:24:39.022616] [DEBUG] [LOCAL ] HLIO: Trimmed 36242 records to 28237 (keeping 200 days of data) [2025-10-03T19:24:39.190924] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-03T19:24:39.210094] [DEBUG] [LOCAL ] HLIO: Primary data saved (28237 records). [2025-10-03T19:24:39.210243] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-03T19:24:39.210409] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLIO took 28.8s. Estimated remaining: 3h 8m 25s. Rate: 7.1 symbols/min [2025-10-03T19:24:39.405353] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:39.405667] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-03T19:24:39.405784] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-03T19:24:39.406001] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-03T19:24:39.413162] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-03T19:24:39.425287] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-03T19:24:39.425384] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-03T19:24:39.472548] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:24:39.822210] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:39.990681] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-03T19:24:40.782200] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:24:40.792310] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-03T19:24:40.981173] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T19:24:41.590680] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-03T19:24:42.382742] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:24:42.392456] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-03T19:24:43.182569] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:24:43.190630] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-03T19:24:43.990610] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-03T19:24:44.192170] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:24:44.450345] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:24:44.790696] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-03T19:24:45.580697] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T19:24:45.594935] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-03T19:24:46.346015] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:24:46.390704] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-03T19:24:46.679343] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:24:47.190713] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-03T19:24:47.990670] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-03T19:24:48.186030] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:24:48.751532] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:24:48.790671] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-03T19:24:49.305833] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:24:49.590692] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-03T19:24:50.390633] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-03T19:24:50.657223] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T19:24:51.190723] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-03T19:24:51.226806] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:24:51.791816] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T19:24:51.990685] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-03T19:24:52.790674] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-03T19:24:53.114507] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T19:24:53.590698] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-03T19:24:53.687757] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:24:54.390737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-03T19:24:54.461563] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:24:55.093450] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:24:55.190730] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-03T19:24:55.990680] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-03T19:24:56.060412] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:24:56.655723] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:24:56.790723] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-03T19:24:57.590718] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-03T19:24:57.664823] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T19:24:57.979019] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:24:57.981196] [INFO ] [REMOTE ] HLLY: Full fetch complete (46270 records). [2025-10-03T19:24:57.981305] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-03T19:24:58.390772] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-03T19:24:58.404440] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-03T19:24:58.404530] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-03T19:24:58.405281] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-03T19:24:58.405346] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-03T19:24:58.406595] [DEBUG] [LOCAL ] HLLY: Trimmed 46270 records to 33661 (keeping 200 days of data) [2025-10-03T19:24:58.605164] [DEBUG] [LOCAL ] HLLY: Primary data saved (33661 records). [2025-10-03T19:24:58.605318] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-03T19:24:58.605415] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLLY took 30.2s. Estimated remaining: 3h 8m 31s. Rate: 7.1 symbols/min [2025-10-03T19:24:58.784142] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:58.784312] [DEBUG] [LOCAL ] HMC: No existing data file found in primary storage. [2025-10-03T19:24:58.784351] [WARN ] [MAIN ] HMC: No existing data found, performing full refresh instead. [2025-10-03T19:24:58.784469] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-03T19:24:58.784513] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-03T19:24:58.784556] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-03T19:24:58.784621] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-03T19:24:59.189426] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:59.190617] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-03T19:24:59.556828] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T19:24:59.990719] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-03T19:25:00.160378] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:25:00.790774] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-03T19:25:01.304727] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T19:25:01.590729] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-03T19:25:01.874503] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:25:02.328114] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:25:02.390716] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-03T19:25:03.153661] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:25:03.159738] [INFO ] [REMOTE ] HLN: Full fetch complete (76799 records). [2025-10-03T19:25:03.159883] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-03T19:25:03.195857] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-03T19:25:03.628560] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-03T19:25:03.628683] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-03T19:25:03.629613] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-03T19:25:03.629700] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-03T19:25:03.631309] [DEBUG] [LOCAL ] HLN: Trimmed 76799 records to 53863 (keeping 200 days of data) [2025-10-03T19:25:03.965380] [DEBUG] [LOCAL ] HLN: Primary data saved (53863 records). [2025-10-03T19:25:03.965531] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-03T19:25:03.965608] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLN took 33.7s. Estimated remaining: 3h 8m 18s. Rate: 7.1 symbols/min [2025-10-03T19:25:03.998069] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-03T19:25:04.160222] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:04.160690] [DEBUG] [LOCAL ] HMN: No existing data file found in primary storage. [2025-10-03T19:25:04.160755] [WARN ] [MAIN ] HMN: No existing data found, performing full refresh instead. [2025-10-03T19:25:04.160880] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-03T19:25:04.160929] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-03T19:25:04.160977] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-03T19:25:04.161011] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-03T19:25:04.549686] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T19:25:04.605779] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:04.790733] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-03T19:25:04.881239] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:25:05.590705] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-03T19:25:06.050147] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T19:25:06.390739] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-03T19:25:06.591911] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T19:25:06.615022] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:25:07.190713] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-03T19:25:07.990720] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-03T19:25:08.319679] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T19:25:08.790629] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-03T19:25:08.827911] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:25:08.876501] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T19:25:09.590731] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-03T19:25:10.390732] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-03T19:25:10.933216] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T19:25:11.190721] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-03T19:25:11.245845] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:25:11.626567] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:25:11.990705] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-03T19:25:12.790680] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-03T19:25:12.895370] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:25:13.458090] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:25:13.461005] [INFO ] [REMOTE ] HLX: Full fetch complete (69238 records). [2025-10-03T19:25:13.461117] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-03T19:25:13.595762] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-03T19:25:13.887055] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-03T19:25:13.887153] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-03T19:25:13.888125] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-03T19:25:13.888201] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-03T19:25:13.891949] [DEBUG] [LOCAL ] HLX: Trimmed 69238 records to 48451 (keeping 200 days of data) [2025-10-03T19:25:14.168436] [DEBUG] [LOCAL ] HLX: Primary data saved (48451 records). [2025-10-03T19:25:14.168581] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-03T19:25:14.168700] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLX took 35.0s. Estimated remaining: 3h 8m 12s. Rate: 7.1 symbols/min [2025-10-03T19:25:14.371168] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:14.371349] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-03T19:25:14.371574] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-03T19:25:14.371946] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-03T19:25:14.371997] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-03T19:25:14.372043] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-03T19:25:14.372078] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-03T19:25:14.396000] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-03T19:25:14.790047] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:14.823757] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:25:15.190743] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-03T19:25:15.429457] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:25:15.540887] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:25:15.990690] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-03T19:25:16.790671] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-03T19:25:17.105132] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T19:25:17.132991] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:25:17.590730] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-03T19:25:18.314622] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:25:18.390690] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-03T19:25:18.424158] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:25:19.190710] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-03T19:25:19.925790] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:25:19.928691] [INFO ] [REMOTE ] HLT: Full fetch complete (73441 records). [2025-10-03T19:25:19.928821] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-03T19:25:20.002914] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-03T19:25:20.379591] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-03T19:25:20.379742] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-03T19:25:20.380746] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-03T19:25:20.380812] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-03T19:25:20.382351] [DEBUG] [LOCAL ] HLT: Trimmed 73441 records to 51359 (keeping 200 days of data) [2025-10-03T19:25:20.736725] [DEBUG] [LOCAL ] HLT: Primary data saved (51359 records). [2025-10-03T19:25:20.736864] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-03T19:25:20.736990] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HLT took 43.0s. Estimated remaining: 3h 8m 1s. Rate: 7.1 symbols/min [2025-10-03T19:25:20.800571] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-03T19:25:20.960964] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:20.963029] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:25:20.963259] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-03T19:25:20.963462] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-03T19:25:20.974633] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-03T19:25:20.974928] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-03T19:25:20.975026] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-03T19:25:20.975112] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-03T19:25:21.409752] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:21.590714] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-03T19:25:21.797463] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:25:21.797935] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-03T19:25:21.798023] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:25:21.798086] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-03T19:25:21.798123] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:25:21.798192] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-03T19:25:21.798300] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-03T19:25:21.798370] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-03T19:25:21.798435] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-03T19:25:21.798508] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 7m 43s. Rate: 7.1 symbols/min [2025-10-03T19:25:22.000053] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:22.000797] [DEBUG] [LOCAL ] HNI: No existing data file found in primary storage. [2025-10-03T19:25:22.000883] [WARN ] [MAIN ] HNI: No existing data found, performing full refresh instead. [2025-10-03T19:25:22.001204] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-03T19:25:22.001350] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-03T19:25:22.001451] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-03T19:25:22.001598] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-03T19:25:22.095214] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:25:22.179101] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-03T19:25:22.395815] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-03T19:25:22.465495] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:23.190696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-03T19:25:23.990687] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-03T19:25:24.081846] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T19:25:24.313039] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T19:25:24.790689] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-03T19:25:25.153774] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T19:25:25.590718] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-03T19:25:25.726187] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:25:26.390746] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-03T19:25:26.912431] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:25:27.190695] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-03T19:25:27.990696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-03T19:25:28.228796] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:25:28.339097] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:25:28.790687] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-03T19:25:29.042191] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:25:29.590731] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-03T19:25:30.390705] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-03T19:25:30.801850] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:25:31.190694] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-03T19:25:31.462790] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-03T19:25:31.990712] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-03T19:25:32.388478] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:25:32.417937] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:25:32.790715] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-03T19:25:32.876301] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T19:25:32.877780] [INFO ] [REMOTE ] HMN: Full fetch complete (31542 records). [2025-10-03T19:25:32.877881] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-03T19:25:33.280544] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-03T19:25:33.280631] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-03T19:25:33.281242] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-03T19:25:33.281292] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-03T19:25:33.282130] [DEBUG] [LOCAL ] HMN: Trimmed 31542 records to 23661 (keeping 200 days of data) [2025-10-03T19:25:33.431128] [DEBUG] [LOCAL ] HMN: Primary data saved (23661 records). [2025-10-03T19:25:33.431288] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-03T19:25:33.431376] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMN took 29.5s. Estimated remaining: 3h 7m 39s. Rate: 7.1 symbols/min [2025-10-03T19:25:33.594187] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-03T19:25:33.615587] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:33.616520] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-03T19:25:33.616577] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-03T19:25:33.616746] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-03T19:25:33.616803] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-03T19:25:33.616850] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-03T19:25:33.616883] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-03T19:25:34.015825] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:34.384986] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:25:34.395442] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-03T19:25:35.190636] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-03T19:25:35.428325] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:25:35.990663] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-03T19:25:36.153586] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T19:25:36.790711] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-03T19:25:36.845467] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T19:25:37.105410] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:25:37.590725] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-03T19:25:38.216127] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:25:38.390685] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-03T19:25:38.657860] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T19:25:39.190706] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-03T19:25:39.990638] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-03T19:25:40.044332] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:25:40.646090] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:25:40.790673] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-03T19:25:41.590703] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-03T19:25:41.646354] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:25:42.227191] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:25:42.390608] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-03T19:25:42.894918] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:25:42.897471] [INFO ] [REMOTE ] HMC: Full fetch complete (69381 records). [2025-10-03T19:25:42.897599] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-03T19:25:43.195894] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-03T19:25:43.342103] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-03T19:25:43.342193] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-03T19:25:43.343120] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-03T19:25:43.343243] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-03T19:25:43.344793] [DEBUG] [LOCAL ] HMC: Trimmed 69381 records to 47350 (keeping 200 days of data) [2025-10-03T19:25:43.646112] [DEBUG] [LOCAL ] HMC: Primary data saved (47350 records). [2025-10-03T19:25:43.646265] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-03T19:25:43.646396] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMC took 45.0s. Estimated remaining: 3h 7m 33s. Rate: 7.1 symbols/min [2025-10-03T19:25:43.832025] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:43.832199] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-03T19:25:43.832236] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-03T19:25:43.832351] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-03T19:25:43.832392] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-03T19:25:43.832463] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-03T19:25:43.832509] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-03T19:25:43.962207] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T19:25:43.991190] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-03T19:25:43.985918] [INFO ] [REMOTE ] HNI: Full fetch complete (42013 records). [2025-10-03T19:25:44.023111] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-03T19:25:44.442084] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:44.689720] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-03T19:25:44.689814] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-03T19:25:44.690475] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-03T19:25:44.690516] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-03T19:25:44.691513] [DEBUG] [LOCAL ] HNI: Trimmed 42013 records to 29796 (keeping 200 days of data) [2025-10-03T19:25:44.790975] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-03T19:25:44.879981] [DEBUG] [LOCAL ] HNI: Primary data saved (29796 records). [2025-10-03T19:25:44.880117] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-03T19:25:44.880197] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNI took 23.1s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-03T19:25:45.140084] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:25:45.590722] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-03T19:25:46.072014] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T19:25:46.336146] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-03T19:25:46.390681] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-03T19:25:47.190738] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-03T19:25:47.367773] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:25:47.990711] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-03T19:25:48.428460] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T19:25:48.790737] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-03T19:25:48.821908] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:25:49.590751] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-03T19:25:49.749579] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:25:50.390747] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-03T19:25:50.914943] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:25:51.018534] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:25:51.190711] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-03T19:25:51.997465] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-03T19:25:52.017154] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:25:52.790754] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-03T19:25:53.177132] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-03T19:25:53.590665] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-03T19:25:53.659515] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:25:54.124920] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T19:25:54.390688] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-03T19:25:55.190676] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-03T19:25:55.762453] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-03T19:25:55.809981] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T19:25:55.990713] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-03T19:25:56.796671] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-03T19:25:56.817524] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:25:57.590683] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-03T19:25:57.658892] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T19:25:58.390738] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-03T19:25:58.754585] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:25:58.801734] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T19:25:58.804787] [INFO ] [REMOTE ] HMY: Full fetch complete (76735 records). [2025-10-03T19:25:58.804911] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-03T19:25:59.195385] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-03T19:25:59.252844] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-03T19:25:59.252935] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-03T19:25:59.254022] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-03T19:25:59.254095] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-03T19:25:59.256554] [DEBUG] [LOCAL ] HMY: Trimmed 76735 records to 53914 (keeping 200 days of data) [2025-10-03T19:25:59.594087] [DEBUG] [LOCAL ] HMY: Primary data saved (53914 records). [2025-10-03T19:25:59.594230] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-03T19:25:59.594326] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HMY took 45.4s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-03T19:25:59.948277] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:25:59.952013] [INFO ] [REMOTE ] HOG: Full fetch complete (74170 records). [2025-10-03T19:25:59.952148] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-03T19:26:00.411911] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-03T19:26:00.412015] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-03T19:26:00.412952] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-03T19:26:00.413016] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-03T19:26:00.414468] [DEBUG] [LOCAL ] HOG: Trimmed 74170 records to 51853 (keeping 200 days of data) [2025-10-03T19:26:00.754216] [DEBUG] [LOCAL ] HOG: Primary data saved (51853 records). [2025-10-03T19:26:00.754392] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-03T19:26:00.754510] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 27.3s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-03T19:26:01.033058] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:26:01.042410] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-03T19:26:02.697113] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:26:02.707996] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-03T19:26:04.491486] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:26:04.504036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-03T19:26:06.091382] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:26:06.102320] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-03T19:26:07.475363] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:26:07.477801] [INFO ] [REMOTE ] HOMB: Full fetch complete (64004 records). [2025-10-03T19:26:07.477921] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-03T19:26:07.907365] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-03T19:26:07.907467] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-03T19:26:07.908410] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-03T19:26:07.908477] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-03T19:26:07.910069] [DEBUG] [LOCAL ] HOMB: Trimmed 64004 records to 44129 (keeping 200 days of data) [2025-10-03T19:26:08.202599] [DEBUG] [LOCAL ] HOMB: Primary data saved (44129 records). [2025-10-03T19:26:08.202780] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-03T19:26:08.202868] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 24.6s. Estimated remaining: 3h 6m 47s. Rate: 7.1 symbols/min [2025-10-03T19:26:08.921592] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.894259] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.977098] [DEBUG] [LOCAL ] HPE: No existing data file found in primary storage. [2025-10-03T19:26:08.976767] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.976959] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-03T19:26:09.012920] [DEBUG] [LOCAL ] HP: No existing data file found in primary storage. [2025-10-03T19:26:09.003388] [WARN ] [MAIN ] HPE: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.035492] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:09.035618] [WARN ] [MAIN ] HP: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.010240] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.036483] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.036372] [DEBUG] [LOCAL ] HOV: No existing data file found in primary storage. [2025-10-03T19:26:09.036730] [WARN ] [MAIN ] HOV: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.036971] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.037174] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.036622] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.037379] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-03T19:26:09.037456] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-03T19:26:09.037315] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-03T19:26:09.037864] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-03T19:26:09.038091] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-03T19:26:09.037742] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-03T19:26:09.038214] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-03T19:26:09.038443] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-03T19:26:09.038523] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-03T19:26:09.043962] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-03T19:26:09.119335] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-03T19:26:09.218375] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-03T19:26:10.444308] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.501066] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-03T19:26:10.490341] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.529342] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-03T19:26:10.639330] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.661574] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.660872] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-03T19:26:10.661986] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-03T19:26:11.589285] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:26:11.593347] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-03T19:26:11.950128] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:26:11.961041] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-03T19:26:12.167561] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:26:12.178588] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-03T19:26:12.399112] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T19:26:12.403725] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-03T19:26:12.648614] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T19:26:12.660501] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-03T19:26:13.052024] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T19:26:13.055049] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-03T19:26:13.568479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:26:13.578859] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-03T19:26:13.624493] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:26:13.634715] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-03T19:26:14.073181] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:26:14.076775] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-03T19:26:14.535944] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:26:14.547561] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-03T19:26:14.679116] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:26:14.688026] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-03T19:26:14.737270] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T19:26:15.191487] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-03T19:26:15.197960] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:26:15.990743] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-03T19:26:16.026634] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:26:16.355664] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:26:16.607180] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:26:16.790736] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-03T19:26:17.590678] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-03T19:26:17.655492] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:26:18.395895] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-03T19:26:18.419479] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:26:18.762794] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:26:19.190740] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-03T19:26:19.990715] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-03T19:26:20.188703] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T19:26:20.207478] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T19:26:20.790686] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-03T19:26:21.590721] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-03T19:26:21.774869] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:26:22.044939] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T19:26:22.390712] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-03T19:26:23.190772] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-03T19:26:23.416128] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:26:23.990709] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-03T19:26:24.116789] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:26:24.555373] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T19:26:24.790694] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-03T19:26:25.598455] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-03T19:26:25.620336] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:26:26.390744] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-03T19:26:26.764444] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T19:26:27.064366] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:26:27.190707] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-03T19:26:27.898799] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:26:27.900013] [INFO ] [REMOTE ] HOV: Full fetch complete (19209 records). [2025-10-03T19:26:27.900088] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-03T19:26:27.996218] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-03T19:26:28.347165] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-03T19:26:28.347338] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-03T19:26:28.347965] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-03T19:26:28.348128] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-03T19:26:28.349286] [DEBUG] [LOCAL ] HOV: Trimmed 19209 records to 13893 (keeping 200 days of data) [2025-10-03T19:26:28.445824] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T19:26:28.483813] [DEBUG] [LOCAL ] HOV: Primary data saved (13893 records). [2025-10-03T19:26:28.483961] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-03T19:26:28.484041] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 20.3s. Estimated remaining: 3h 6m 54s. Rate: 7.1 symbols/min [2025-10-03T19:26:28.666627] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:28.666830] [DEBUG] [LOCAL ] HPF: No existing data file found in primary storage. [2025-10-03T19:26:28.666873] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-10-03T19:26:28.667084] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-03T19:26:28.667164] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-03T19:26:28.667268] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-03T19:26:28.667347] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-03T19:26:28.795775] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-03T19:26:29.063502] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:29.543790] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T19:26:29.590741] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-03T19:26:30.390630] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-03T19:26:30.805125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:26:31.156330] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T19:26:31.161924] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T19:26:31.190622] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-03T19:26:31.990686] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-03T19:26:32.790677] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-03T19:26:33.222147] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:26:33.264471] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:26:33.590697] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-03T19:26:34.390681] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-03T19:26:34.526701] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:26:35.155568] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:26:35.190665] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-03T19:26:35.531826] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:26:35.776158] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T19:26:35.990689] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-03T19:26:36.602452] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T19:26:36.790682] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-03T19:26:37.511699] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T19:26:37.590694] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-03T19:26:38.285429] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T19:26:38.390685] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-03T19:26:39.190699] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-03T19:26:39.672883] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T19:26:39.898516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-03T19:26:39.990746] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-03T19:26:40.790696] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-03T19:26:40.811609] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T19:26:41.590695] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-03T19:26:42.289326] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-03T19:26:42.390666] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-03T19:26:42.443552] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:26:43.190717] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-03T19:26:43.940113] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:26:43.990674] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-03T19:26:44.477951] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T19:26:44.790711] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-03T19:26:45.254751] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:26:45.257428] [INFO ] [REMOTE ] HOUS: Full fetch complete (63694 records). [2025-10-03T19:26:45.257593] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-03T19:26:45.420516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:26:45.437238] [INFO ] [REMOTE ] HPF: Full fetch complete (10818 records). [2025-10-03T19:26:45.461774] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-03T19:26:45.605190] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-03T19:26:45.977426] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-03T19:26:45.990996] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-03T19:26:46.010305] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-03T19:26:46.022741] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-03T19:26:46.078939] [DEBUG] [LOCAL ] HOUS: Trimmed 63694 records to 45288 (keeping 200 days of data) [2025-10-03T19:26:46.113922] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-03T19:26:46.114016] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-03T19:26:46.114174] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-03T19:26:46.114251] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-03T19:26:46.115373] [DEBUG] [LOCAL ] HPF: Trimmed 10818 records to 7503 (keeping 200 days of data) [2025-10-03T19:26:46.266775] [DEBUG] [LOCAL ] HPF: Primary data saved (7503 records). [2025-10-03T19:26:46.268061] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-03T19:26:46.268567] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HPF took 17.8s. Estimated remaining: 3h 6m 58s. Rate: 7.1 symbols/min [2025-10-03T19:26:46.390959] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-03T19:26:46.474163] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:46.475683] [DEBUG] [LOCAL ] HPI: No existing data file found in primary storage. [2025-10-03T19:26:46.476166] [WARN ] [MAIN ] HPI: No existing data found, performing full refresh instead. [2025-10-03T19:26:46.476827] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-03T19:26:46.476970] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-03T19:26:46.477411] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-03T19:26:46.477968] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-03T19:26:46.993768] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:47.053388] [DEBUG] [LOCAL ] HOUS: Primary data saved (45288 records). [2025-10-03T19:26:47.053533] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-03T19:26:47.053626] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HOUS took 38.8s. Estimated remaining: 3h 6m 39s. Rate: 7.1 symbols/min [2025-10-03T19:26:47.203094] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-03T19:26:47.238897] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:47.239130] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-10-03T19:26:47.239180] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-10-03T19:26:47.239295] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-03T19:26:47.239378] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-03T19:26:47.239435] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-03T19:26:47.239470] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-03T19:26:47.630749] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:47.715190] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T19:26:47.718103] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-03T19:26:47.718290] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-03T19:26:47.995725] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-03T19:26:48.051121] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T19:26:48.052701] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T19:26:48.097249] [INFO ] [REMOTE ] HP: Full fetch complete (74025 records). [2025-10-03T19:26:48.112923] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-03T19:26:48.359744] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-03T19:26:48.363334] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-03T19:26:48.364502] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-03T19:26:48.370356] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-03T19:26:48.435092] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-10-03T19:26:48.786212] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-03T19:26:48.786903] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-03T19:26:48.787949] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-03T19:26:48.788631] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-03T19:26:48.791246] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-03T19:26:48.795280] [DEBUG] [LOCAL ] HP: Trimmed 74025 records to 52346 (keeping 200 days of data) [2025-10-03T19:26:49.376938] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-03T19:26:49.378410] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-03T19:26:49.379066] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 41.2s. Estimated remaining: 3h 6m 23s. Rate: 7.1 symbols/min [2025-10-03T19:26:49.453383] [DEBUG] [LOCAL ] HP: Primary data saved (52346 records). [2025-10-03T19:26:49.490605] [INFO ] [MAIN ] HP: Full history saved. [2025-10-03T19:26:49.494770] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HP took 41.3s. Estimated remaining: 3h 6m 4s. Rate: 7.1 symbols/min [2025-10-03T19:26:49.594560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:26:49.658120] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:49.660754] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-03T19:26:49.676966] [DEBUG] [LOCAL ] HPQ: No existing data file found in primary storage. [2025-10-03T19:26:49.677951] [WARN ] [MAIN ] HPQ: No existing data found, performing full refresh instead. [2025-10-03T19:26:49.678427] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-03T19:26:49.683935] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-03T19:26:49.708421] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-03T19:26:49.708968] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-03T19:26:49.832501] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:49.843122] [DEBUG] [LOCAL ] HPS: No existing data file found in primary storage. [2025-10-03T19:26:49.858180] [WARN ] [MAIN ] HPS: No existing data found, performing full refresh instead. [2025-10-03T19:26:49.886717] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-03T19:26:49.892033] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-03T19:26:49.914891] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-03T19:26:49.935460] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-03T19:26:50.178608] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T19:26:50.396024] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-03T19:26:50.573725] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:26:50.765758] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:50.789079] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:51.190736] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-03T19:26:51.995809] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-03T19:26:52.017739] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T19:26:52.646225] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:26:52.736143] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:26:52.790722] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-03T19:26:53.590823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-03T19:26:54.352516] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:26:54.390700] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-03T19:26:54.738587] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:26:55.190759] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-03T19:26:55.992816] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-03T19:26:55.996008] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:26:56.046010] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:26:56.600603] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T19:26:56.790735] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-03T19:26:57.590713] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-03T19:26:57.614250] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:26:58.390705] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-03T19:26:59.194715] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-03T19:26:59.217630] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:26:59.228331] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T19:26:59.990692] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-03T19:27:00.790736] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-03T19:27:00.806708] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T19:27:00.904884] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:27:01.590756] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-03T19:27:02.221524] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:27:02.380533] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:27:02.390626] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-03T19:27:03.190688] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-03T19:27:03.209297] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:27:03.990727] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-03T19:27:04.792639] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-03T19:27:04.792498] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:27:05.590685] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-03T19:27:05.614707] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:27:06.022723] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:27:06.390691] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-03T19:27:06.983968] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:27:06.985133] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:27:07.190723] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-03T19:27:07.990731] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-03T19:27:08.790747] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-03T19:27:08.936798] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:27:08.970537] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:27:09.590702] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-03T19:27:10.390737] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-03T19:27:10.426862] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:27:10.800024] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:27:11.190724] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-03T19:27:11.990697] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-03T19:27:12.113302] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:27:12.767345] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:27:12.790686] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-03T19:27:13.123615] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T19:27:13.590746] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-03T19:27:14.390619] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-03T19:27:14.459162] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T19:27:14.497286] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:27:15.190695] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-03T19:27:15.990718] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-03T19:27:16.176963] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T19:27:16.231687] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:27:16.790723] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-03T19:27:17.346608] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:27:17.353340] [INFO ] [REMOTE ] HPP: Full fetch complete (73344 records). [2025-10-03T19:27:17.353519] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-03T19:27:17.595736] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-03T19:27:17.789421] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-03T19:27:17.789544] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-03T19:27:17.790522] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-03T19:27:17.790588] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-03T19:27:17.792144] [DEBUG] [LOCAL ] HPP: Trimmed 73344 records to 51658 (keeping 200 days of data) [2025-10-03T19:27:18.095040] [DEBUG] [LOCAL ] HPP: Primary data saved (51658 records). [2025-10-03T19:27:18.095187] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-03T19:27:18.095278] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPP took 31.0s. Estimated remaining: 3h 6m 21s. Rate: 7.1 symbols/min [2025-10-03T19:27:18.276545] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:18.276751] [DEBUG] [LOCAL ] HQH: No existing data file found in primary storage. [2025-10-03T19:27:18.276824] [WARN ] [MAIN ] HQH: No existing data found, performing full refresh instead. [2025-10-03T19:27:18.276988] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-03T19:27:18.277159] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-03T19:27:18.277309] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-03T19:27:18.277404] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-03T19:27:18.397599] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-03T19:27:18.680969] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:18.682088] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:27:18.724129] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:27:19.190714] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-03T19:27:19.281633] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:27:19.282862] [INFO ] [REMOTE ] HPI: Full fetch complete (13905 records). [2025-10-03T19:27:19.282939] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-03T19:27:19.692933] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-03T19:27:19.693060] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-03T19:27:19.693449] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-03T19:27:19.693514] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-03T19:27:19.694156] [DEBUG] [LOCAL ] HPI: Trimmed 13905 records to 10537 (keeping 200 days of data) [2025-10-03T19:27:19.765527] [DEBUG] [LOCAL ] HPI: Primary data saved (10537 records). [2025-10-03T19:27:19.765726] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-03T19:27:19.765833] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPI took 33.5s. Estimated remaining: 3h 6m 4s. Rate: 7.1 symbols/min [2025-10-03T19:27:19.897730] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:27:19.915066] [INFO ] [REMOTE ] HPS: Full fetch complete (15267 records). [2025-10-03T19:27:19.946392] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-03T19:27:19.967689] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:20.009138] [DEBUG] [LOCAL ] HQL: No existing data file found in primary storage. [2025-10-03T19:27:19.995784] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-03T19:27:20.032529] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-10-03T19:27:20.067456] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-03T19:27:20.088688] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-03T19:27:20.094674] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-03T19:27:20.105090] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-03T19:27:20.684222] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-03T19:27:20.695846] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-03T19:27:20.704695] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-03T19:27:20.707314] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-03T19:27:20.723949] [DEBUG] [LOCAL ] HPS: Trimmed 15267 records to 10340 (keeping 200 days of data) [2025-10-03T19:27:20.792865] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-03T19:27:20.846987] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:20.869744] [DEBUG] [LOCAL ] HPS: Primary data saved (10340 records). [2025-10-03T19:27:20.869863] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-03T19:27:20.869960] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HPS took 31.4s. Estimated remaining: 3h 5m 47s. Rate: 7.1 symbols/min [2025-10-03T19:27:21.052285] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:21.052479] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-10-03T19:27:21.052540] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-10-03T19:27:21.052692] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-03T19:27:21.052749] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-03T19:27:21.052802] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-03T19:27:21.052841] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-03T19:27:21.433394] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:21.590638] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-03T19:27:21.972389] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T19:27:22.117405] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-03T19:27:22.305886] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:27:22.390688] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-03T19:27:23.190696] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-03T19:27:23.552688] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:27:23.990637] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-03T19:27:24.290471] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T19:27:24.790700] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-03T19:27:25.160526] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:27:25.590719] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-03T19:27:25.786339] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:27:26.390685] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-03T19:27:27.195834] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-03T19:27:27.214424] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T19:27:27.267849] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T19:27:27.990683] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-03T19:27:28.790617] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-03T19:27:29.108739] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T19:27:29.417677] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T19:27:29.590689] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-03T19:27:29.660460] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:27:30.390727] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-03T19:27:30.511454] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T19:27:31.190707] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-03T19:27:31.981546] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:27:31.991709] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-03T19:27:32.048108] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T19:27:32.790709] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-03T19:27:32.957592] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:27:33.590718] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-03T19:27:33.889115] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:27:34.390683] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-03T19:27:35.190702] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-03T19:27:35.506621] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-03T19:27:35.509412] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-03T19:27:35.509532] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-03T19:27:35.998146] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-03T19:27:35.997860] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-03T19:27:35.998491] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-03T19:27:36.001006] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-03T19:27:36.014171] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:27:36.012590] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-03T19:27:36.022914] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:27:36.030616] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 54447 (keeping 200 days of data) [2025-10-03T19:27:36.384812] [DEBUG] [LOCAL ] HPQ: Primary data saved (54447 records). [2025-10-03T19:27:36.385008] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-03T19:27:36.385146] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HPQ took 47.0s. Estimated remaining: 3h 5m 47s. Rate: 7.1 symbols/min [2025-10-03T19:27:36.570153] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:36.570334] [DEBUG] [LOCAL ] HRB: No existing data file found in primary storage. [2025-10-03T19:27:36.570396] [WARN ] [MAIN ] HRB: No existing data found, performing full refresh instead. [2025-10-03T19:27:36.570522] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-03T19:27:36.570598] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-03T19:27:36.570742] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-03T19:27:36.570806] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-03T19:27:36.797953] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-03T19:27:36.992336] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:37.590768] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-03T19:27:37.706116] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:27:38.213457] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T19:27:38.230867] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T19:27:38.390757] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-03T19:27:39.190699] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-03T19:27:39.990673] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-03T19:27:40.138044] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:27:40.173470] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:27:40.706409] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T19:27:40.790690] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-03T19:27:41.590686] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-03T19:27:41.889142] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:27:41.890861] [INFO ] [REMOTE ] HQH: Full fetch complete (37479 records). [2025-10-03T19:27:41.890969] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-03T19:27:42.295489] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-03T19:27:42.295567] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-03T19:27:42.296229] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-03T19:27:42.296293] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-03T19:27:42.297280] [DEBUG] [LOCAL ] HQH: Trimmed 37479 records to 25615 (keeping 200 days of data) [2025-10-03T19:27:42.392937] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-03T19:27:42.467821] [DEBUG] [LOCAL ] HQH: Primary data saved (25615 records). [2025-10-03T19:27:42.467988] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-03T19:27:42.468137] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQH took 24.4s. Estimated remaining: 3h 5m 36s. Rate: 7.1 symbols/min [2025-10-03T19:27:42.654091] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:42.654257] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-10-03T19:27:42.654296] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-10-03T19:27:42.654442] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-03T19:27:42.654498] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-03T19:27:42.654542] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-03T19:27:42.654575] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-03T19:27:43.038183] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:43.099184] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:27:43.190698] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-03T19:27:43.373017] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:27:43.990627] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-03T19:27:44.159154] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:27:44.790693] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-03T19:27:45.590634] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-03T19:27:45.954446] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T19:27:46.390681] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-03T19:27:46.590263] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:27:46.660040] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:27:47.190684] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-03T19:27:47.981755] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:27:47.991181] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-03T19:27:48.061054] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T19:27:48.790672] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-03T19:27:48.889564] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:27:48.891514] [INFO ] [REMOTE ] HQL: Full fetch complete (24974 records). [2025-10-03T19:27:48.891595] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-03T19:27:49.305498] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-03T19:27:49.305592] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-03T19:27:49.306260] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-03T19:27:49.306371] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-03T19:27:49.308101] [DEBUG] [LOCAL ] HQL: Trimmed 24974 records to 16628 (keeping 200 days of data) [2025-10-03T19:27:49.419975] [DEBUG] [LOCAL ] HQL: Primary data saved (16628 records). [2025-10-03T19:27:49.420123] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-03T19:27:49.420228] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HQL took 29.7s. Estimated remaining: 3h 5m 25s. Rate: 7.1 symbols/min [2025-10-03T19:27:49.608104] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:49.604477] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-03T19:27:49.608352] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-10-03T19:27:49.608419] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-10-03T19:27:49.608783] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-03T19:27:49.609426] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-03T19:27:49.609497] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-03T19:27:49.609535] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-03T19:27:50.013579] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:50.399102] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-03T19:27:50.422696] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:27:50.667518] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:27:51.190698] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-03T19:27:51.990702] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-03T19:27:52.341565] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T19:27:52.790731] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-03T19:27:52.995492] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:27:53.590632] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-03T19:27:53.702884] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:27:54.390706] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-03T19:27:54.465963] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:27:55.190669] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-03T19:27:55.241355] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:27:55.990728] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-03T19:27:56.107535] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:27:56.703016] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:27:56.790692] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-03T19:27:57.429398] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T19:27:57.590726] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-03T19:27:57.940339] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:27:58.390737] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-03T19:27:59.190670] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-03T19:27:59.271539] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:27:59.858971] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:27:59.990689] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-03T19:28:00.790688] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-03T19:28:01.064810] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:28:01.590634] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-03T19:28:01.938480] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:28:02.261793] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:28:02.390733] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-03T19:28:03.055033] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:28:03.057684] [INFO ] [REMOTE ] HR: Full fetch complete (74837 records). [2025-10-03T19:28:03.057796] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-03T19:28:03.205716] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-03T19:28:03.481573] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-03T19:28:03.481701] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-03T19:28:03.482677] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-03T19:28:03.482745] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-03T19:28:03.484322] [DEBUG] [LOCAL ] HR: Trimmed 74837 records to 52706 (keeping 200 days of data) [2025-10-03T19:28:03.821056] [DEBUG] [LOCAL ] HR: Primary data saved (52706 records). [2025-10-03T19:28:03.821237] [INFO ] [MAIN ] HR: Full history saved. [2025-10-03T19:28:03.821340] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HR took 43.0s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-03T19:28:03.998225] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-03T19:28:04.002030] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:04.003736] [DEBUG] [LOCAL ] HRTG: No existing data file found in primary storage. [2025-10-03T19:28:04.003794] [WARN ] [MAIN ] HRTG: No existing data found, performing full refresh instead. [2025-10-03T19:28:04.003949] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-03T19:28:04.004003] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-03T19:28:04.004069] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-03T19:28:04.004140] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-03T19:28:04.438014] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:04.442706] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T19:28:04.790618] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-03T19:28:04.824978] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:28:04.959814] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:28:05.590735] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-03T19:28:06.390633] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-03T19:28:06.590334] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:28:06.757586] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:28:07.190717] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-03T19:28:07.822585] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:28:07.990671] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-03T19:28:08.286354] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T19:28:08.790745] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-03T19:28:09.590684] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-03T19:28:09.770634] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T19:28:10.390704] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-03T19:28:10.600666] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:28:10.966220] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:28:11.190690] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-03T19:28:11.444827] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:28:11.990630] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-03T19:28:12.790667] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-03T19:28:12.952532] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:28:13.086539] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T19:28:13.590707] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-03T19:28:13.898966] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:28:14.390730] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-03T19:28:15.190700] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-03T19:28:15.282126] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:28:15.990721] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-03T19:28:16.348044] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T19:28:16.436190] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T19:28:16.790699] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-03T19:28:17.087868] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:28:17.089807] [INFO ] [REMOTE ] HRI: Full fetch complete (46353 records). [2025-10-03T19:28:17.089896] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-03T19:28:17.520401] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-03T19:28:17.520550] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-03T19:28:17.521419] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-03T19:28:17.521487] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-03T19:28:17.522794] [DEBUG] [LOCAL ] HRI: Trimmed 46353 records to 33230 (keeping 200 days of data) [2025-10-03T19:28:17.597097] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-03T19:28:17.756893] [DEBUG] [LOCAL ] HRI: Primary data saved (33230 records). [2025-10-03T19:28:17.757057] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-03T19:28:17.757162] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRI took 35.3s. Estimated remaining: 3h 5m 23s. Rate: 7.1 symbols/min [2025-10-03T19:28:17.941571] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:17.941787] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-03T19:28:17.941833] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-03T19:28:17.941953] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-03T19:28:17.941997] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-03T19:28:17.942040] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-03T19:28:17.942074] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-03T19:28:18.367179] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:18.390617] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-03T19:28:18.561285] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T19:28:18.565271] [INFO ] [REMOTE ] HRL: Full fetch complete (76681 records). [2025-10-03T19:28:18.565432] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-03T19:28:19.012314] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:28:19.048850] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-03T19:28:19.049348] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-03T19:28:19.050515] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-03T19:28:19.050609] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-03T19:28:19.053791] [DEBUG] [LOCAL ] HRL: Trimmed 76681 records to 53847 (keeping 200 days of data) [2025-10-03T19:28:19.190732] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-03T19:28:19.421688] [DEBUG] [LOCAL ] HRL: Primary data saved (53847 records). [2025-10-03T19:28:19.421856] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-03T19:28:19.421976] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HRL took 30.0s. Estimated remaining: 3h 5m 6s. Rate: 7.1 symbols/min [2025-10-03T19:28:19.608232] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:19.608516] [DEBUG] [LOCAL ] HSHP: No existing data file found in primary storage. [2025-10-03T19:28:19.608561] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-10-03T19:28:19.608714] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-03T19:28:19.608771] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-03T19:28:19.608818] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-03T19:28:19.608855] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-03T19:28:19.997551] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-03T19:28:20.056736] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:20.100259] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:28:20.739763] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:28:20.746813] [INFO ] [REMOTE ] HRB: Full fetch complete (69891 records). [2025-10-03T19:28:20.747049] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-03T19:28:20.804077] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-03T19:28:21.276408] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-03T19:28:21.276526] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-03T19:28:21.277691] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-03T19:28:21.277847] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-03T19:28:21.279873] [DEBUG] [LOCAL ] HRB: Trimmed 69891 records to 49183 (keeping 200 days of data) [2025-10-03T19:28:21.539393] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:28:21.611599] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-03T19:28:21.647985] [DEBUG] [LOCAL ] HRB: Primary data saved (49183 records). [2025-10-03T19:28:21.648131] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-03T19:28:21.648210] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRB took 45.3s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-03T19:28:21.829319] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:21.829557] [DEBUG] [LOCAL ] HSY: No existing data file found in primary storage. [2025-10-03T19:28:21.829619] [WARN ] [MAIN ] HSY: No existing data found, performing full refresh instead. [2025-10-03T19:28:21.829760] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-03T19:28:21.829805] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-03T19:28:21.829849] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-03T19:28:21.829883] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-03T19:28:22.233540] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:22.390717] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-03T19:28:22.687758] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:28:22.703894] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:28:23.190699] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-03T19:28:23.498431] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:28:23.990634] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-03T19:28:24.138946] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:28:24.790696] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-03T19:28:25.590631] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-03T19:28:25.903455] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T19:28:26.390696] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-03T19:28:26.577484] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:28:26.644258] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:28:27.190708] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-03T19:28:27.528020] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:28:27.990683] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-03T19:28:28.790631] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-03T19:28:28.954427] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:28:29.044372] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:28:29.590694] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-03T19:28:29.822205] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T19:28:30.390639] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-03T19:28:30.684714] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:28:31.190697] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-03T19:28:31.990684] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-03T19:28:32.705846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-03T19:28:32.755315] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:28:32.790623] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-03T19:28:32.849946] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:28:33.590684] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-03T19:28:33.758816] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:28:34.390683] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-03T19:28:35.190710] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-03T19:28:35.559296] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T19:28:35.898964] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T19:28:35.990698] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-03T19:28:36.319682] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T19:28:36.790733] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-03T19:28:37.478680] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:28:37.572168] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:28:37.590673] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-03T19:28:38.390705] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-03T19:28:38.641035] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:28:39.190711] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-03T19:28:39.596515] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:28:39.598809] [INFO ] [REMOTE ] HRTG: Full fetch complete (43109 records). [2025-10-03T19:28:39.598930] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-03T19:28:40.003095] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-03T19:28:40.022747] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-03T19:28:40.022824] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-03T19:28:40.023544] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-03T19:28:40.023609] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-03T19:28:40.025529] [DEBUG] [LOCAL ] HRTG: Trimmed 43109 records to 33921 (keeping 200 days of data) [2025-10-03T19:28:40.230878] [DEBUG] [LOCAL ] HRTG: Primary data saved (33921 records). [2025-10-03T19:28:40.231017] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-03T19:28:40.231095] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 36.4s. Estimated remaining: 3h 4m 54s. Rate: 7.1 symbols/min [2025-10-03T19:28:40.423033] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:40.423262] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-03T19:28:40.423318] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-03T19:28:40.423477] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-03T19:28:40.423527] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-03T19:28:40.423574] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-03T19:28:40.423607] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-03T19:28:40.793451] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-03T19:28:40.819782] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:40.939406] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:28:41.590683] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-03T19:28:41.650836] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:28:41.651983] [INFO ] [REMOTE ] HSHP: Full fetch complete (23354 records). [2025-10-03T19:28:41.652056] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-03T19:28:41.785276] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:28:41.853923] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-03T19:28:41.859373] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:28:41.890236] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-03T19:28:41.904300] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:28:41.909701] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-03T19:28:41.945559] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-03T19:28:41.950897] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-03T19:28:41.970940] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-03T19:28:41.981465] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HTB took 1.8s. Estimated remaining: 3h 4m 37s. Rate: 7.1 symbols/min [2025-10-03T19:28:42.180163] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-03T19:28:42.185931] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-03T19:28:42.207260] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-03T19:28:42.222179] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-03T19:28:42.236210] [DEBUG] [LOCAL ] HSHP: Trimmed 23354 records to 15437 (keeping 200 days of data) [2025-10-03T19:28:42.317377] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:42.358906] [DEBUG] [LOCAL ] HTD: No existing data file found in primary storage. [2025-10-03T19:28:42.360633] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-10-03T19:28:42.361539] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-03T19:28:42.362692] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-03T19:28:42.374135] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-03T19:28:42.376158] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-03T19:28:42.376816] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-03T19:28:42.396167] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-03T19:28:42.808228] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:42.812906] [DEBUG] [LOCAL ] HSHP: Primary data saved (15437 records). [2025-10-03T19:28:42.813053] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-03T19:28:42.813162] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HSHP took 23.4s. Estimated remaining: 3h 4m 19s. Rate: 7.1 symbols/min [2025-10-03T19:28:43.008870] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:43.009053] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-03T19:28:43.009110] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-03T19:28:43.009222] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-03T19:28:43.009265] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-03T19:28:43.009309] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-03T19:28:43.009344] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-03T19:28:43.195842] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-03T19:28:43.396697] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:43.990629] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-03T19:28:44.202676] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:28:44.240281] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-10-03T19:28:44.790733] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-03T19:28:45.324996] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T19:28:45.590701] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-03T19:28:45.927333] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:28:46.390679] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-03T19:28:46.673094] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T19:28:47.190684] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-03T19:28:47.993374] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-03T19:28:47.996495] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T19:28:48.179954] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:28:48.790708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-03T19:28:49.115709] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T19:28:49.590637] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-03T19:28:49.913284] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T19:28:49.926967] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T19:28:50.390726] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-03T19:28:50.816615] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T19:28:51.190728] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-03T19:28:51.990731] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-03T19:28:52.315388] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T19:28:52.790632] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-03T19:28:53.172105] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T19:28:53.175096] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T19:28:53.590708] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-03T19:28:54.390728] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-03T19:28:55.190638] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-03T19:28:55.335868] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:28:55.370354] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:28:55.455519] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-03T19:28:55.990686] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-03T19:28:56.790700] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-03T19:28:57.590702] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-03T19:28:57.675709] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:28:58.045924] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:28:58.390694] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-03T19:28:58.649808] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-03T19:28:58.654007] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:28:59.190736] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-03T19:28:59.990711] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-03T19:29:00.254136] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T19:29:00.790722] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-03T19:29:01.135105] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T19:29:01.574863] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:29:01.577617] [INFO ] [REMOTE ] HSY: Full fetch complete (73605 records). [2025-10-03T19:29:01.577818] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-03T19:29:01.601480] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-03T19:29:02.002177] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-03T19:29:02.002270] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-03T19:29:02.003258] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-03T19:29:02.003326] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-03T19:29:02.004991] [DEBUG] [LOCAL ] HSY: Trimmed 73605 records to 51044 (keeping 200 days of data) [2025-10-03T19:29:02.192451] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:29:02.202616] [INFO ] [REMOTE ] HTFC: Full fetch complete (845 records). [2025-10-03T19:29:02.227992] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-03T19:29:02.395880] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-03T19:29:02.431486] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-03T19:29:02.432007] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:29:02.432341] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:29:02.432975] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-03T19:29:02.433878] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-03T19:29:02.434103] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-03T19:29:02.435050] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-03T19:29:02.435430] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HTFC took 19.6s. Estimated remaining: 3h 4m 25s. Rate: 7.1 symbols/min [2025-10-03T19:29:02.629346] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:02.630288] [DEBUG] [LOCAL ] HTGC: No existing data file found in primary storage. [2025-10-03T19:29:02.630681] [WARN ] [MAIN ] HTGC: No existing data found, performing full refresh instead. [2025-10-03T19:29:02.632407] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-03T19:29:02.633266] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-03T19:29:02.633919] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-03T19:29:02.634245] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-03T19:29:03.102523] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:03.138164] [DEBUG] [LOCAL ] HSY: Primary data saved (51044 records). [2025-10-03T19:29:03.138335] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-03T19:29:03.138420] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HSY took 41.5s. Estimated remaining: 3h 4m 7s. Rate: 7.1 symbols/min [2025-10-03T19:29:03.196946] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-03T19:29:03.321097] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:03.321265] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-03T19:29:03.321303] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-03T19:29:03.321442] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-03T19:29:03.321518] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-03T19:29:03.321579] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-03T19:29:03.321612] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-03T19:29:03.701476] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:03.990625] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-03T19:29:04.063913] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:29:04.066619] [INFO ] [REMOTE ] HSBC: Full fetch complete (73753 records). [2025-10-03T19:29:04.066780] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-03T19:29:04.491146] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-03T19:29:04.491230] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-03T19:29:04.492209] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-03T19:29:04.492276] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-03T19:29:04.493755] [DEBUG] [LOCAL ] HSBC: Trimmed 73753 records to 51774 (keeping 200 days of data) [2025-10-03T19:29:04.803529] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-03T19:29:04.828270] [DEBUG] [LOCAL ] HSBC: Primary data saved (51774 records). [2025-10-03T19:29:04.828442] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-03T19:29:04.828525] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HSBC took 47.1s. Estimated remaining: 3h 3m 50s. Rate: 7.1 symbols/min [2025-10-03T19:29:05.010807] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:05.011364] [DEBUG] [LOCAL ] HUBB: No existing data file found in primary storage. [2025-10-03T19:29:05.011708] [WARN ] [MAIN ] HUBB: No existing data found, performing full refresh instead. [2025-10-03T19:29:05.026895] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-03T19:29:05.027372] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-03T19:29:05.028441] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:29:05.034988] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-03T19:29:05.035056] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-03T19:29:05.195282] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:29:05.475332] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:05.590714] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-03T19:29:05.776126] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:29:06.390705] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-03T19:29:06.991072] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:29:07.190679] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-03T19:29:07.191542] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T19:29:07.990704] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-03T19:29:08.790723] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-03T19:29:08.879236] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:29:08.941544] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:29:09.585990] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:29:09.590605] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-03T19:29:10.390703] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-03T19:29:10.538509] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:29:11.190733] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-03T19:29:11.704380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:29:11.990689] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-03T19:29:12.790745] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-03T19:29:12.899990] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:29:13.232169] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:29:13.590726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-03T19:29:14.390715] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-03T19:29:14.476925] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:29:15.130997] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T19:29:15.190630] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-03T19:29:15.914572] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:29:15.990678] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-03T19:29:16.789100] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T19:29:16.792727] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-03T19:29:17.134639] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:29:17.590691] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-03T19:29:18.242281] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:29:18.390743] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-03T19:29:19.190738] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-03T19:29:19.319401] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:29:19.990735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-03T19:29:20.060617] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T19:29:20.136778] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:29:20.576795] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:29:20.790726] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-03T19:29:21.590694] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-03T19:29:22.399791] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-03T19:29:22.403102] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:29:23.007738] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T19:29:23.190691] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-03T19:29:23.990692] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-03T19:29:24.117752] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:29:24.206442] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T19:29:24.790688] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-03T19:29:24.795901] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:29:24.797383] [INFO ] [REMOTE ] HTD: Full fetch complete (19089 records). [2025-10-03T19:29:24.797460] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-03T19:29:25.206020] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-03T19:29:25.206101] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-03T19:29:25.206553] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-03T19:29:25.206623] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-03T19:29:25.207296] [DEBUG] [LOCAL ] HTD: Trimmed 19089 records to 14020 (keeping 200 days of data) [2025-10-03T19:29:25.303078] [DEBUG] [LOCAL ] HTD: Primary data saved (14020 records). [2025-10-03T19:29:25.303338] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-03T19:29:25.303451] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTD took 43.3s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-03T19:29:25.482783] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:25.482959] [DEBUG] [LOCAL ] HUBS: No existing data file found in primary storage. [2025-10-03T19:29:25.483009] [WARN ] [MAIN ] HUBS: No existing data found, performing full refresh instead. [2025-10-03T19:29:25.483217] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-03T19:29:25.483263] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-03T19:29:25.483307] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-03T19:29:25.483340] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-03T19:29:25.594870] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-03T19:29:25.867128] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:26.390637] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-03T19:29:26.426626] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:29:26.952114] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:29:27.190713] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-03T19:29:27.796094] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:29:27.990677] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-03T19:29:28.456373] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:29:28.790691] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-03T19:29:29.569346] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:29:29.590606] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-03T19:29:29.797109] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:29:29.798847] [INFO ] [REMOTE ] HTH: Full fetch complete (46752 records). [2025-10-03T19:29:29.799002] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-03T19:29:30.202098] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-03T19:29:30.202182] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-03T19:29:30.202917] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-03T19:29:30.202983] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-03T19:29:30.204069] [DEBUG] [LOCAL ] HTH: Trimmed 46752 records to 32613 (keeping 200 days of data) [2025-10-03T19:29:30.390761] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-03T19:29:30.410675] [DEBUG] [LOCAL ] HTH: Primary data saved (32613 records). [2025-10-03T19:29:30.410861] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-03T19:29:30.410957] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTH took 27.3s. Estimated remaining: 3h 3m 44s. Rate: 7.1 symbols/min [2025-10-03T19:29:30.612848] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:30.613078] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-03T19:29:30.613137] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-03T19:29:30.613256] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-03T19:29:30.613301] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-03T19:29:30.613344] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-03T19:29:30.613378] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-03T19:29:30.983760] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:31.190692] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-03T19:29:31.445350] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:29:31.507998] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:29:31.990691] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-03T19:29:32.790722] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-03T19:29:32.895197] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T19:29:33.593850] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-03T19:29:33.650137] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:29:34.222592] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:29:34.390733] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-03T19:29:35.190693] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-03T19:29:35.393689] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:29:35.718764] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:29:35.990717] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-03T19:29:36.620617] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:29:36.624110] [INFO ] [REMOTE ] HTGC: Full fetch complete (68238 records). [2025-10-03T19:29:36.624283] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-03T19:29:36.795895] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-03T19:29:37.059890] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-03T19:29:37.059984] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-03T19:29:37.061061] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-03T19:29:37.061135] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-03T19:29:37.062972] [DEBUG] [LOCAL ] HTGC: Trimmed 68238 records to 48078 (keeping 200 days of data) [2025-10-03T19:29:37.377765] [DEBUG] [LOCAL ] HTGC: Primary data saved (48078 records). [2025-10-03T19:29:37.377934] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-03T19:29:37.378062] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HTGC took 34.9s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-03T19:29:37.598589] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-03T19:29:37.601352] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:37.602878] [DEBUG] [LOCAL ] HUN: No existing data file found in primary storage. [2025-10-03T19:29:37.603062] [WARN ] [MAIN ] HUN: No existing data found, performing full refresh instead. [2025-10-03T19:29:37.603256] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-03T19:29:37.603325] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-03T19:29:37.603522] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-03T19:29:37.603787] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-03T19:29:37.701917] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:29:38.036325] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:38.390742] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-03T19:29:38.945947] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T19:29:39.030196] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:29:39.190715] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-03T19:29:40.000352] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-03T19:29:40.021844] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:29:40.790695] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-03T19:29:40.893154] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:29:41.399842] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:29:41.590716] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-03T19:29:41.988353] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:29:42.390722] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-03T19:29:43.190632] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-03T19:29:43.544613] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:29:43.914387] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T19:29:43.990731] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-03T19:29:44.663478] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T19:29:44.790742] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-03T19:29:45.590736] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-03T19:29:45.653958] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:29:46.390706] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-03T19:29:46.465260] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:29:47.190713] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-03T19:29:47.571844] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T19:29:47.990618] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-03T19:29:48.109284] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:29:48.261979] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T19:29:48.790706] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-03T19:29:49.430842] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T19:29:49.590702] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-03T19:29:50.307138] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:29:50.390630] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-03T19:29:51.190680] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-03T19:29:51.432795] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T19:29:51.777758] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:29:51.990685] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-03T19:29:52.344841] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T19:29:52.348575] [INFO ] [REMOTE ] HUBB: Full fetch complete (53784 records). [2025-10-03T19:29:52.348892] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-03T19:29:52.777063] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-03T19:29:52.777165] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-03T19:29:52.778069] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-03T19:29:52.778191] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-03T19:29:52.779550] [DEBUG] [LOCAL ] HUBB: Trimmed 53784 records to 37114 (keeping 200 days of data) [2025-10-03T19:29:52.841671] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-03T19:29:53.031373] [DEBUG] [LOCAL ] HUBB: Primary data saved (37114 records). [2025-10-03T19:29:53.031542] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-03T19:29:53.031627] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBB took 48.2s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-03T19:29:53.215509] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:53.215709] [DEBUG] [LOCAL ] HUYA: No existing data file found in primary storage. [2025-10-03T19:29:53.215763] [WARN ] [MAIN ] HUYA: No existing data found, performing full refresh instead. [2025-10-03T19:29:53.215882] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-03T19:29:53.215928] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-03T19:29:53.215974] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-03T19:29:53.216010] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-03T19:29:53.603154] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-03T19:29:53.608934] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:53.643524] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:29:54.390739] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-03T19:29:54.591141] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:29:55.190676] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-03T19:29:55.231880] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:29:55.689035] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:29:55.990760] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-03T19:29:56.790714] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-03T19:29:56.954217] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T19:29:57.570568] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:29:57.590664] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-03T19:29:58.390712] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-03T19:29:58.430343] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:29:59.094317] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:29:59.190638] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-03T19:29:59.990707] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-03T19:30:00.357946] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T19:30:00.654485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:30:00.790637] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-03T19:30:01.590743] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-03T19:30:02.209511] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T19:30:02.390712] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-03T19:30:02.522484] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:30:03.190695] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-03T19:30:03.460071] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:30:03.634943] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:30:03.638394] [INFO ] [REMOTE ] HUBS: Full fetch complete (55736 records). [2025-10-03T19:30:03.638489] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-03T19:30:03.995910] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-03T19:30:04.088944] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-03T19:30:04.089040] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-03T19:30:04.089951] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-03T19:30:04.090024] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-03T19:30:04.091720] [DEBUG] [LOCAL ] HUBS: Trimmed 55736 records to 39955 (keeping 200 days of data) [2025-10-03T19:30:04.365346] [DEBUG] [LOCAL ] HUBS: Primary data saved (39955 records). [2025-10-03T19:30:04.365526] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-03T19:30:04.365627] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HUBS took 39.1s. Estimated remaining: 3h 3m 29s. Rate: 7.1 symbols/min [2025-10-03T19:30:04.556003] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:04.556170] [DEBUG] [LOCAL ] HVT: No existing data file found in primary storage. [2025-10-03T19:30:04.556209] [WARN ] [MAIN ] HVT: No existing data found, performing full refresh instead. [2025-10-03T19:30:04.556325] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-03T19:30:04.556369] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-03T19:30:04.556413] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-03T19:30:04.556446] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-03T19:30:04.798085] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-03T19:30:04.820760] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T19:30:04.858912] [INFO ] [REMOTE ] HUN: Full fetch complete (76715 records). [2025-10-03T19:30:04.880889] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-03T19:30:05.115138] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:05.576366] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-03T19:30:05.576545] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-03T19:30:05.578918] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-03T19:30:05.579030] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-03T19:30:05.581102] [DEBUG] [LOCAL ] HUN: Trimmed 76715 records to 53977 (keeping 200 days of data) [2025-10-03T19:30:05.654706] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-03T19:30:05.760444] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:30:06.150815] [DEBUG] [LOCAL ] HUN: Primary data saved (53977 records). [2025-10-03T19:30:06.151003] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-03T19:30:06.151119] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUN took 28.8s. Estimated remaining: 3h 3m 13s. Rate: 7.1 symbols/min [2025-10-03T19:30:06.362499] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:06.362809] [DEBUG] [LOCAL ] HWM: No existing data file found in primary storage. [2025-10-03T19:30:06.362910] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-10-03T19:30:06.363043] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-03T19:30:06.363118] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-03T19:30:06.363204] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-03T19:30:06.363271] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-03T19:30:06.397890] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-03T19:30:06.681099] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T19:30:06.726298] [INFO ] [REMOTE ] HUM: Full fetch complete (71037 records). [2025-10-03T19:30:06.736850] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-03T19:30:06.824979] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:06.911525] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T19:30:07.195745] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-03T19:30:07.281634] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-03T19:30:07.281755] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-03T19:30:07.282809] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-03T19:30:07.282882] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-03T19:30:07.284667] [DEBUG] [LOCAL ] HUM: Trimmed 71037 records to 49601 (keeping 200 days of data) [2025-10-03T19:30:07.644967] [DEBUG] [LOCAL ] HUM: Primary data saved (49601 records). [2025-10-03T19:30:07.645114] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-03T19:30:07.645217] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUM took 37.2s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-03T19:30:07.831632] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:07.831867] [DEBUG] [LOCAL ] HXL: No existing data file found in primary storage. [2025-10-03T19:30:07.831956] [WARN ] [MAIN ] HXL: No existing data found, performing full refresh instead. [2025-10-03T19:30:07.832076] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-03T19:30:07.832118] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-03T19:30:07.832160] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-03T19:30:07.832193] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-03T19:30:07.995405] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-03T19:30:08.223719] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:08.251003] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:30:08.412743] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:30:08.790693] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-03T19:30:09.590727] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-03T19:30:10.030200] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T19:30:10.053219] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:30:10.390717] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-03T19:30:11.076120] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:30:11.190702] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-03T19:30:11.990668] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-03T19:30:12.028917] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:30:12.790718] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-03T19:30:13.136414] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:30:13.590691] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-03T19:30:13.740202] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:30:13.872396] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:30:14.390701] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-03T19:30:15.190732] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-03T19:30:15.507320] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T19:30:15.990685] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-03T19:30:16.050274] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:30:16.790701] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-03T19:30:16.941214] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:30:17.590742] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-03T19:30:17.934372] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:30:17.964478] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T19:30:18.390724] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-03T19:30:19.122095] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:30:19.190689] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-03T19:30:19.440982] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:30:19.990716] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-03T19:30:20.790634] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-03T19:30:20.978726] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:30:21.520020] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:30:21.590734] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-03T19:30:22.390695] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-03T19:30:22.746634] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:30:23.190700] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-03T19:30:23.234124] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T19:30:23.236732] [INFO ] [REMOTE ] HUYA: Full fetch complete (63630 records). [2025-10-03T19:30:23.236874] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-03T19:30:23.374813] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T19:30:23.679726] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-03T19:30:23.679852] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-03T19:30:23.680831] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-03T19:30:23.680898] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-03T19:30:23.682896] [DEBUG] [LOCAL ] HUYA: Trimmed 63630 records to 44793 (keeping 200 days of data) [2025-10-03T19:30:23.951619] [DEBUG] [LOCAL ] HUYA: Primary data saved (44793 records). [2025-10-03T19:30:23.951824] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-03T19:30:23.951912] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HUYA took 30.9s. Estimated remaining: 3h 2m 57s. Rate: 7.1 symbols/min [2025-10-03T19:30:23.998208] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-03T19:30:24.144523] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:24.144718] [DEBUG] [LOCAL ] HY: No existing data file found in primary storage. [2025-10-03T19:30:24.144770] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-10-03T19:30:24.144886] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-03T19:30:24.144931] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-03T19:30:24.144975] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-03T19:30:24.145010] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-03T19:30:24.540093] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:24.790630] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-03T19:30:24.905929] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:30:25.006765] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:30:25.590683] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-03T19:30:26.390640] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-03T19:30:26.795910] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:30:27.187750] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:30:27.197742] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-03T19:30:27.288589] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:30:27.990699] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-03T19:30:28.790633] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-03T19:30:29.060862] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:30:29.561527] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:30:29.590680] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-03T19:30:29.606225] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:30:30.390693] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-03T19:30:31.190620] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-03T19:30:31.294365] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:30:31.580105] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:30:31.581458] [INFO ] [REMOTE ] HVT: Full fetch complete (23368 records). [2025-10-03T19:30:31.581593] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-03T19:30:31.984195] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-03T19:30:31.984275] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-03T19:30:31.984777] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-03T19:30:31.984880] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-03T19:30:31.985554] [DEBUG] [LOCAL ] HVT: Trimmed 23368 records to 15649 (keeping 200 days of data) [2025-10-03T19:30:32.026095] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-03T19:30:32.085406] [DEBUG] [LOCAL ] HVT: Primary data saved (15649 records). [2025-10-03T19:30:32.085559] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-03T19:30:32.085636] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HVT took 27.7s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-03T19:30:32.258321] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:32.258518] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-03T19:30:32.258557] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-03T19:30:32.258696] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-03T19:30:32.258751] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-03T19:30:32.258797] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-03T19:30:32.258831] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-03T19:30:32.637331] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:32.790699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-03T19:30:33.140878] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-03T19:30:33.290962] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T19:30:33.562637] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:30:33.590711] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-03T19:30:34.390718] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-03T19:30:35.190744] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-03T19:30:35.243310] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:30:35.254197] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:30:35.515756] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T19:30:35.990706] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-03T19:30:36.790690] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-03T19:30:37.590874] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-03T19:30:37.592628] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:30:37.900460] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T19:30:38.041937] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-03T19:30:38.044608] [INFO ] [REMOTE ] HXL: Full fetch complete (66246 records). [2025-10-03T19:30:38.044818] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-03T19:30:38.395822] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-03T19:30:38.469167] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-03T19:30:38.469332] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-03T19:30:38.470336] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-03T19:30:38.470404] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-03T19:30:38.472120] [DEBUG] [LOCAL ] HXL: Trimmed 66246 records to 46561 (keeping 200 days of data) [2025-10-03T19:30:38.747605] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T19:30:38.816575] [DEBUG] [LOCAL ] HXL: Primary data saved (46561 records). [2025-10-03T19:30:38.816880] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-03T19:30:38.817043] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HXL took 31.2s. Estimated remaining: 3h 2m 38s. Rate: 7.1 symbols/min [2025-10-03T19:30:38.997246] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:38.997461] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-03T19:30:38.997511] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-03T19:30:38.997622] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-03T19:30:38.997696] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-03T19:30:38.997753] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-03T19:30:38.997800] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-03T19:30:39.192239] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-03T19:30:39.414993] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:39.574138] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T19:30:39.990699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-03T19:30:40.345673] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T19:30:40.790724] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-03T19:30:41.207915] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T19:30:41.590725] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-03T19:30:41.911777] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-03T19:30:42.390682] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-03T19:30:43.190706] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-03T19:30:43.508453] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:30:43.990673] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-03T19:30:44.292606] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T19:30:44.427283] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:30:44.790721] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-03T19:30:45.024194] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-03T19:30:45.590673] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-03T19:30:45.836201] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-03T19:30:46.390760] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-03T19:30:46.620808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-03T19:30:47.190708] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-03T19:30:47.440369] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-03T19:30:47.990696] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-03T19:30:48.790726] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-03T19:30:49.136356] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T19:30:49.590722] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-03T19:30:50.390679] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-03T19:30:50.538107] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-03T19:30:50.538894] [INFO ] [REMOTE ] HYAC: Full fetch complete (899 records). [2025-10-03T19:30:50.538989] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-03T19:30:50.737078] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-10-03T19:30:50.737377] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:30:50.737456] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:30:50.737533] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-03T19:30:50.737609] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-03T19:30:50.737679] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-03T19:30:50.737780] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-03T19:30:50.737877] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HYAC took 18.7s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-03T19:30:50.924572] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:50.924802] [DEBUG] [LOCAL ] HYI: No existing data file found in primary storage. [2025-10-03T19:30:50.924866] [WARN ] [MAIN ] HYI: No existing data found, performing full refresh instead. [2025-10-03T19:30:50.925007] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-03T19:30:50.925062] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-03T19:30:50.925109] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-03T19:30:50.925143] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-03T19:30:51.192476] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-03T19:30:51.246472] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T19:30:51.334823] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:51.373862] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:30:51.477171] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-03T19:30:51.990711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-03T19:30:52.790717] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-03T19:30:53.114031] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:30:53.590678] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-03T19:30:54.323113] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:30:54.390726] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-03T19:30:54.589684] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-03T19:30:54.592469] [INFO ] [REMOTE ] HWM: Full fetch complete (76602 records). [2025-10-03T19:30:54.592639] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-03T19:30:54.688811] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-03T19:30:55.021247] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-03T19:30:55.021368] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-03T19:30:55.022363] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-03T19:30:55.022430] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-03T19:30:55.024119] [DEBUG] [LOCAL ] HWM: Trimmed 76602 records to 53700 (keeping 200 days of data) [2025-10-03T19:30:55.211863] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-03T19:30:55.379227] [DEBUG] [LOCAL ] HWM: Primary data saved (53700 records). [2025-10-03T19:30:55.379378] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-03T19:30:55.379481] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HWM took 49.2s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-03T19:30:55.573736] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:55.573971] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-03T19:30:55.574062] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-03T19:30:55.574150] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-03T19:30:55.574199] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-03T19:30:55.574287] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-03T19:30:55.574337] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-03T19:30:55.968066] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:55.990619] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-03T19:30:56.072629] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T19:30:56.790725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-03T19:30:57.282871] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:30:57.379099] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T19:30:57.590713] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-03T19:30:58.382412] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:30:58.390702] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-03T19:30:59.191177] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-03T19:30:59.197167] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:30:59.521593] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T19:30:59.990707] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-03T19:31:00.790694] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-03T19:31:00.831488] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:31:01.272922] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:31:01.590717] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-03T19:31:02.390727] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-03T19:31:02.897171] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:31:02.898011] [INFO ] [REMOTE ] HYBX: Full fetch complete (737 records). [2025-10-03T19:31:02.898084] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-03T19:31:03.025716] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:31:03.139121] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-03T19:31:03.139345] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:31:03.139433] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:31:03.139521] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-03T19:31:03.139605] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-03T19:31:03.139690] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-03T19:31:03.139786] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-03T19:31:03.139954] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HYBX took 24.3s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-03T19:31:03.197627] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-03T19:31:03.332103] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:03.332271] [DEBUG] [LOCAL ] HYTR: No existing data file found in primary storage. [2025-10-03T19:31:03.332359] [WARN ] [MAIN ] HYTR: No existing data found, performing full refresh instead. [2025-10-03T19:31:03.332480] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-03T19:31:03.332538] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-03T19:31:03.332619] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-03T19:31:03.332707] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-03T19:31:03.762861] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:03.990692] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-03T19:31:04.605060] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T19:31:04.623853] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:31:04.790639] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-03T19:31:05.590703] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-03T19:31:06.236893] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T19:31:06.260226] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:31:06.390721] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-03T19:31:07.129854] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:31:07.190664] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-03T19:31:07.952460] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T19:31:07.990617] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-03T19:31:08.758966] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T19:31:08.790690] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-03T19:31:09.523557] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:31:09.590712] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-03T19:31:10.390730] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-03T19:31:10.526888] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T19:31:11.188985] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:31:11.191993] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-03T19:31:11.765000] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:31:11.990706] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-03T19:31:12.794264] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-03T19:31:12.797629] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:31:13.538729] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:31:13.590714] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-03T19:31:14.166468] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T19:31:14.390695] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-03T19:31:15.190707] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-03T19:31:15.783463] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:31:15.931335] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:31:15.990716] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-03T19:31:16.712890] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:31:16.790699] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-03T19:31:17.590722] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-03T19:31:18.082181] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T19:31:18.083166] [INFO ] [REMOTE ] HY: Full fetch complete (15135 records). [2025-10-03T19:31:18.083239] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-03T19:31:18.395844] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-03T19:31:18.476857] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-03T19:31:18.476949] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-03T19:31:18.477286] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-03T19:31:18.477328] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-03T19:31:18.477948] [DEBUG] [LOCAL ] HY: Trimmed 15135 records to 10055 (keeping 200 days of data) [2025-10-03T19:31:18.544720] [DEBUG] [LOCAL ] HY: Primary data saved (10055 records). [2025-10-03T19:31:18.544910] [INFO ] [MAIN ] HY: Full history saved. [2025-10-03T19:31:18.545010] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HY took 54.6s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-03T19:31:18.742263] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:18.742605] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-03T19:31:18.742752] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-03T19:31:18.742913] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-03T19:31:18.742962] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-03T19:31:18.743009] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-03T19:31:18.743044] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-03T19:31:19.046144] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T19:31:19.154140] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:31:19.210256] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:19.196376] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-03T19:31:19.678622] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T19:31:19.990691] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-03T19:31:20.790669] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-03T19:31:21.067838] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:31:21.317169] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T19:31:21.590692] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-03T19:31:22.390637] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-03T19:31:22.703791] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T19:31:23.190686] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-03T19:31:23.781162] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:31:23.954533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T19:31:23.990678] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-03T19:31:24.790694] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-03T19:31:25.349816] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T19:31:25.590631] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-03T19:31:25.897447] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:31:26.090757] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T19:31:26.390711] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-03T19:31:26.951465] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T19:31:27.190723] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-03T19:31:27.930944] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T19:31:27.990684] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-03T19:31:28.790683] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-03T19:31:28.834073] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:31:28.835601] [INFO ] [REMOTE ] HYI: Full fetch complete (13863 records). [2025-10-03T19:31:28.835701] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-03T19:31:29.254499] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-03T19:31:29.254579] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-03T19:31:29.254944] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-03T19:31:29.255008] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-03T19:31:29.255593] [DEBUG] [LOCAL ] HYI: Trimmed 13863 records to 9955 (keeping 200 days of data) [2025-10-03T19:31:29.334824] [DEBUG] [LOCAL ] HYI: Primary data saved (9955 records). [2025-10-03T19:31:29.335105] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-03T19:31:29.335287] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYI took 38.6s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-03T19:31:29.526577] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:29.526822] [DEBUG] [LOCAL ] IAE: No existing data file found in primary storage. [2025-10-03T19:31:29.526881] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-10-03T19:31:29.526995] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-03T19:31:29.527065] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-03T19:31:29.527126] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-03T19:31:29.527162] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-03T19:31:29.603826] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:31:29.603663] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-03T19:31:29.614845] [INFO ] [REMOTE ] HYTR: Full fetch complete (4556 records). [2025-10-03T19:31:29.620315] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-03T19:31:30.279370] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:30.348377] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-03T19:31:30.348455] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-03T19:31:30.348622] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-03T19:31:30.348730] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-03T19:31:30.349171] [DEBUG] [LOCAL ] HYTR: Trimmed 4556 records to 3216 (keeping 200 days of data) [2025-10-03T19:31:30.370770] [DEBUG] [LOCAL ] HYTR: Primary data saved (3216 records). [2025-10-03T19:31:30.370853] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-03T19:31:30.370936] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYTR took 27.2s. Estimated remaining: 3h 1m 48s. Rate: 7.1 symbols/min [2025-10-03T19:31:30.390679] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-03T19:31:30.983144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:31:31.190725] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-03T19:31:31.952540] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:31:31.990707] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-03T19:31:32.579305] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:31:32.683341] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:31:32.790741] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-03T19:31:33.590705] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-03T19:31:34.130131] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:31:34.154864] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:31:34.390713] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-03T19:31:35.190726] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-03T19:31:35.800598] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:31:35.803488] [INFO ] [REMOTE ] HYT: Full fetch complete (47669 records). [2025-10-03T19:31:35.803629] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-03T19:31:35.937718] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:31:35.993516] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-03T19:31:36.242140] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-03T19:31:36.242225] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-03T19:31:36.243009] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-03T19:31:36.243098] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-03T19:31:36.244182] [DEBUG] [LOCAL ] HYT: Trimmed 47669 records to 34152 (keeping 200 days of data) [2025-10-03T19:31:36.460619] [DEBUG] [LOCAL ] HYT: Primary data saved (34152 records). [2025-10-03T19:31:36.460809] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-03T19:31:36.460900] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 41.1s. Estimated remaining: 3h 1m 37s. Rate: 7.1 symbols/min [2025-10-03T19:31:36.779792] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:31:36.790626] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-03T19:31:37.392119] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T19:31:37.590716] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-03T19:31:38.390673] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-03T19:31:38.421503] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:31:39.053703] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T19:31:39.190719] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-03T19:31:39.856387] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:31:39.990715] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-03T19:31:40.639116] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T19:31:40.790714] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-03T19:31:41.590744] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-03T19:31:42.066382] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:31:42.167985] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T19:31:42.390749] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-03T19:31:43.126549] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T19:31:43.190724] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-03T19:31:43.990737] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-03T19:31:45.244944] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T19:31:45.255797] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-03T19:31:46.410896] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:31:46.417185] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-03T19:31:46.639754] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-03T19:31:46.640775] [INFO ] [REMOTE ] IAE: Full fetch complete (8653 records). [2025-10-03T19:31:46.640851] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-03T19:31:47.048988] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-03T19:31:47.049118] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-03T19:31:47.049419] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-03T19:31:47.049505] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-03T19:31:47.050100] [DEBUG] [LOCAL ] IAE: Trimmed 8653 records to 6116 (keeping 200 days of data) [2025-10-03T19:31:47.102586] [DEBUG] [LOCAL ] IAE: Primary data saved (6116 records). [2025-10-03T19:31:47.102785] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-03T19:31:47.102927] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. IAE took 17.8s. Estimated remaining: 3h 1m 31s. Rate: 7.1 symbols/min [2025-10-03T19:31:47.400042] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:31:47.407418] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-03T19:31:50.961705] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (3.55 seconds). [2025-10-03T19:31:50.964019] [INFO ] [REMOTE ] HZO: Full fetch complete (41069 records). [2025-10-03T19:31:50.964139] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-03T19:31:51.376695] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-03T19:31:51.376862] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-03T19:31:51.377701] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-03T19:31:51.377777] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-03T19:31:51.378993] [DEBUG] [LOCAL ] HZO: Trimmed 41069 records to 29526 (keeping 200 days of data) [2025-10-03T19:31:51.561199] [DEBUG] [LOCAL ] HZO: Primary data saved (29526 records). [2025-10-03T19:31:51.561360] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-03T19:31:51.561497] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. HZO took 33.0s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-03T19:31:52.297713] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.350496] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.364399] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.384778] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.423721] [DEBUG] [LOCAL ] IBP: Loaded 29050 existing records from primary storage. [2025-10-03T19:31:52.424493] [INFO ] [MAIN ] IBP: Loaded 29050 existing records. [2025-10-03T19:31:52.643870] [DEBUG] [LOCAL ] IAG: Loaded 53844 existing records from primary storage. [2025-10-03T19:31:52.660969] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-03T19:31:52.661576] [INFO ] [MAIN ] IAG: Loaded 53844 existing records. [2025-10-03T19:31:52.662194] [INFO ] [MAIN ] IBM: Loaded 54023 existing records. [2025-10-03T19:31:52.902703] [DEBUG] [LOCAL ] IBN: Loaded 53259 existing records from primary storage. [2025-10-03T19:31:52.984453] [INFO ] [MAIN ] IBN: Loaded 53259 existing records. [2025-10-03T19:31:52.984180] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.109871] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.164404] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-03T19:31:53.275664] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.305499] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.315100] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-03T19:31:53.291261] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-03T19:31:53.317516] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-03T19:31:53.334717] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-03T19:31:53.362382] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-03T19:31:53.379258] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.468535] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.476638] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-03T19:31:53.553013] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.562889] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-03T19:31:53.609268] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.642469] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-03T19:31:53.677677] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-03T19:31:53.726315] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-03T19:31:53.778589] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-03T19:31:54.845878] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:54.900718] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-03T19:31:54.955133] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.002194] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.053399] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-03T19:31:55.053134] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-03T19:31:55.080580] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.081933] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-03T19:31:56.302043] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:31:56.311137] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-03T19:31:56.743497] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:31:56.755434] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-03T19:31:56.939397] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T19:31:56.951258] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-03T19:31:57.421058] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-03T19:31:57.433493] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-03T19:31:57.449498] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T19:31:57.455435] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-03T19:31:58.220070] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T19:31:58.232005] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-03T19:31:58.621301] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:31:58.628064] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-03T19:31:58.676304] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:31:58.692630] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-03T19:31:59.644426] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-03T19:31:59.657124] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-03T19:31:59.879482] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:31:59.886726] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-03T19:31:59.960667] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T19:31:59.972673] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-03T19:32:00.086253] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:32:00.097610] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-03T19:32:01.275772] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:32:01.283815] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-03T19:32:01.385280] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T19:32:01.396464] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-03T19:32:01.711455] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:32:01.723389] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-03T19:32:01.986428] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T19:32:02.166774] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T19:32:02.390696] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-03T19:32:03.190720] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-03T19:32:03.605248] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:32:03.651449] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-03T19:32:03.990691] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-03T19:32:04.143414] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T19:32:04.432085] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:32:04.790738] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-03T19:32:05.590743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-03T19:32:06.241379] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T19:32:06.390639] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-03T19:32:06.668069] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T19:32:07.190741] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-03T19:32:07.437704] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:32:07.990745] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-03T19:32:08.381431] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T19:32:08.790720] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-03T19:32:08.950616] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:32:09.440827] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:32:09.590718] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-03T19:32:10.390693] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-03T19:32:10.961240] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T19:32:11.190638] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-03T19:32:11.481704] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:32:11.635719] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T19:32:11.990722] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-03T19:32:12.790704] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-03T19:32:13.590738] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-03T19:32:13.673104] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-03T19:32:13.807552] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T19:32:14.154015] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:32:14.390761] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-03T19:32:15.190701] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-03T19:32:15.439412] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:32:15.990689] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-03T19:32:16.146283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:32:16.790708] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-03T19:32:17.548050] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T19:32:17.590757] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-03T19:32:17.823453] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:32:18.390679] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-03T19:32:18.622664] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:32:18.801789] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:32:19.190691] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-03T19:32:19.990696] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-03T19:32:20.566752] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T19:32:20.569417] [INFO ] [REMOTE ] IAG: Full fetch complete (77261 records). [2025-10-03T19:32:20.569569] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-03T19:32:20.798610] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-03T19:32:20.932940] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T19:32:20.957492] [INFO ] [REMOTE ] IBN: Full fetch complete (76321 records). [2025-10-03T19:32:20.983043] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-03T19:32:21.116745] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-03T19:32:21.135341] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-03T19:32:21.143563] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-03T19:32:21.143682] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-03T19:32:21.199745] [DEBUG] [LOCAL ] IAG: Trimmed 77261 records to 54232 (keeping 200 days of data) [2025-10-03T19:32:21.668532] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-03T19:32:21.669332] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-03T19:32:21.671075] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-03T19:32:21.671867] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-03T19:32:21.677540] [DEBUG] [LOCAL ] IBN: Trimmed 76321 records to 53644 (keeping 200 days of data) [2025-10-03T19:32:22.166161] [DEBUG] [LOCAL ] IAG: Primary data saved (54232 records). [2025-10-03T19:32:22.166579] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-03T19:32:22.167801] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IAG took 30.6s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-03T19:32:22.451105] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:22.464258] [DEBUG] [LOCAL ] IBN: Primary data saved (53644 records). [2025-10-03T19:32:22.464563] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-03T19:32:22.464813] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IBN took 30.9s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-03T19:32:22.665680] [DEBUG] [LOCAL ] IBTA: Loaded 37847 existing records from primary storage. [2025-10-03T19:32:22.684523] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:22.685450] [INFO ] [MAIN ] IBTA: Loaded 37847 existing records. [2025-10-03T19:32:22.818811] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-03T19:32:22.879059] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-03T19:32:22.948791] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:22.950394] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-03T19:32:22.950458] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-03T19:32:22.965466] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-03T19:32:22.965790] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-03T19:32:23.109988] [DEBUG] [LOCAL ] ICE: Loaded 53392 existing records from primary storage. [2025-10-03T19:32:23.121634] [INFO ] [MAIN ] ICE: Loaded 53392 existing records. [2025-10-03T19:32:23.563882] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:23.583961] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-03T19:32:23.584052] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-03T19:32:23.618576] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-03T19:32:23.618701] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-03T19:32:23.631098] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:23.672505] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-03T19:32:24.022265] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:24.022612] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-03T19:32:25.059976] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-03T19:32:25.061457] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:32:25.069934] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-03T19:32:25.072053] [INFO ] [REMOTE ] IBP: Full fetch complete (40991 records). [2025-10-03T19:32:25.072157] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-03T19:32:25.073587] [FATAL] [VALIDATOR ] IBP: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T19:32:25.073711] [FATAL] [MAIN ] IBP: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:32:25.073791] [WARN ] [MAIN ] IBP: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:32:25.073909] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-03T19:32:25.074012] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-03T19:32:25.074073] [INFO ] [LOCAL ] IBP: Starting deletion of derivative data. [2025-10-03T19:32:25.074442] [DEBUG] [LOCAL ] IBP: Deleted derivative data file. [2025-10-03T19:32:25.077434] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IBP took 33.5s. Estimated remaining: 3h 1m 2s. Rate: 7.1 symbols/min [2025-10-03T19:32:25.268996] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:25.322417] [DEBUG] [LOCAL ] ICL: Loaded 38682 existing records from primary storage. [2025-10-03T19:32:25.322792] [INFO ] [MAIN ] ICL: Loaded 38682 existing records. [2025-10-03T19:32:25.527605] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:25.527862] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-03T19:32:25.527914] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-03T19:32:25.529056] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-03T19:32:25.529120] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-03T19:32:25.948714] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:25.955454] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-03T19:32:25.956671] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (3.08 seconds). [2025-10-03T19:32:25.992555] [INFO ] [REMOTE ] IBM: Full fetch complete (77621 records). [2025-10-03T19:32:25.994933] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-03T19:32:25.994785] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T19:32:26.043876] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-03T19:32:26.426181] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:32:26.493977] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-03T19:32:26.493745] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-03T19:32:26.494195] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-03T19:32:26.496266] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-03T19:32:26.496475] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-03T19:32:26.498945] [DEBUG] [LOCAL ] IBM: Trimmed 77621 records to 54412 (keeping 200 days of data) [2025-10-03T19:32:26.869409] [DEBUG] [LOCAL ] IBM: Primary data saved (54412 records). [2025-10-03T19:32:26.869569] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-03T19:32:26.869697] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 35.3s. Estimated remaining: 3h 0m 46s. Rate: 7.1 symbols/min [2025-10-03T19:32:27.059132] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:27.100539] [DEBUG] [LOCAL ] IDA: Loaded 32394 existing records from primary storage. [2025-10-03T19:32:27.100888] [INFO ] [MAIN ] IDA: Loaded 32394 existing records. [2025-10-03T19:32:27.332393] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:27.333850] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-03T19:32:27.334557] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-03T19:32:27.336305] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:32:27.344791] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-03T19:32:27.345580] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-03T19:32:27.345828] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-03T19:32:27.761984] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:27.778408] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:32:27.814065] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T19:32:27.990741] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-03T19:32:28.790637] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-03T19:32:28.897073] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:32:29.590691] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-03T19:32:29.748729] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:32:30.023460] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:32:30.390734] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-03T19:32:30.942096] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:32:31.190702] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-03T19:32:31.872589] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:32:31.990710] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-03T19:32:32.598440] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:32:32.790739] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-03T19:32:33.604154] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-03T19:32:33.629664] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:32:34.390633] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-03T19:32:34.709091] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T19:32:34.789768] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:32:35.190737] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-03T19:32:35.561795] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T19:32:35.990742] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-03T19:32:36.039243] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-03T19:32:36.790748] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-03T19:32:37.379142] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:32:37.590693] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-03T19:32:37.909691] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:32:38.390710] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-03T19:32:38.893059] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:32:39.190704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-03T19:32:39.990636] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-03T19:32:40.255085] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:32:40.702322] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:32:40.790728] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-03T19:32:41.438296] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:32:41.590716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-03T19:32:42.390706] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-03T19:32:42.535857] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:32:42.608935] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T19:32:43.190664] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-03T19:32:43.609834] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T19:32:43.990709] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-03T19:32:44.790639] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-03T19:32:45.134394] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T19:32:45.595749] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-03T19:32:45.614093] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:32:46.245065] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:32:46.390664] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-03T19:32:47.155981] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T19:32:47.190718] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-03T19:32:47.528120] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:32:47.990712] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-03T19:32:48.480541] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T19:32:48.790720] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-03T19:32:49.370896] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:32:49.590729] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-03T19:32:50.390702] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-03T19:32:50.661289] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:32:50.691637] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T19:32:51.190742] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-03T19:32:51.554953] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:32:51.990734] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-03T19:32:52.110498] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T19:32:52.112561] [INFO ] [REMOTE ] IDA: Full fetch complete (44872 records). [2025-10-03T19:32:52.112771] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-03T19:32:52.529063] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-03T19:32:52.529153] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-03T19:32:52.529963] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-03T19:32:52.530030] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-03T19:32:52.531210] [DEBUG] [LOCAL ] IDA: Trimmed 44872 records to 32618 (keeping 200 days of data) [2025-10-03T19:32:52.748857] [DEBUG] [LOCAL ] IDA: Primary data saved (32618 records). [2025-10-03T19:32:52.748999] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-03T19:32:52.749097] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IDA took 25.9s. Estimated remaining: 3h 0m 58s. Rate: 7.1 symbols/min [2025-10-03T19:32:52.795791] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-03T19:32:52.939268] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:52.951100] [DEBUG] [LOCAL ] IDE: Loaded 8807 existing records from primary storage. [2025-10-03T19:32:52.951332] [INFO ] [MAIN ] IDE: Loaded 8807 existing records. [2025-10-03T19:32:53.148890] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:53.149134] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-03T19:32:53.149187] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-03T19:32:53.149448] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-03T19:32:53.149511] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-03T19:32:53.621701] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:53.591564] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-03T19:32:53.625442] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T19:32:54.390677] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-03T19:32:54.782946] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:32:55.110284] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:32:55.190696] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-03T19:32:55.661911] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T19:32:55.663955] [INFO ] [REMOTE ] IBTA: Full fetch complete (50883 records). [2025-10-03T19:32:55.664062] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-03T19:32:55.995875] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-03T19:32:56.089895] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-03T19:32:56.089998] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-03T19:32:56.090871] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-03T19:32:56.090941] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-03T19:32:56.092147] [DEBUG] [LOCAL ] IBTA: Trimmed 50883 records to 38108 (keeping 200 days of data) [2025-10-03T19:32:56.324793] [DEBUG] [LOCAL ] IBTA: Primary data saved (38108 records). [2025-10-03T19:32:56.324972] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-03T19:32:56.325099] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. IBTA took 34.2s. Estimated remaining: 3h 0m 44s. Rate: 7.1 symbols/min [2025-10-03T19:32:56.521786] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:56.544960] [DEBUG] [LOCAL ] IDT: Loaded 18168 existing records from primary storage. [2025-10-03T19:32:56.545258] [INFO ] [MAIN ] IDT: Loaded 18168 existing records. [2025-10-03T19:32:56.760975] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:56.761269] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-03T19:32:56.761416] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-03T19:32:56.766741] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-03T19:32:56.767366] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-03T19:32:56.767606] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:32:56.796710] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-03T19:32:56.864968] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-03T19:32:56.891295] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-03T19:32:57.579838] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:57.612174] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-03T19:32:57.710058] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-03T19:32:57.723616] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:32:57.721484] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-03T19:32:57.735275] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-03T19:32:57.725121] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:32:57.736782] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-03T19:32:57.742779] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53782 (keeping 200 days of data) [2025-10-03T19:32:58.113331] [DEBUG] [LOCAL ] ICE: Primary data saved (53782 records). [2025-10-03T19:32:58.113486] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-03T19:32:58.113573] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICE took 35.6s. Estimated remaining: 3h 0m 28s. Rate: 7.1 symbols/min [2025-10-03T19:32:58.298016] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:58.343058] [DEBUG] [LOCAL ] IEX: Loaded 38652 existing records from primary storage. [2025-10-03T19:32:58.343389] [INFO ] [MAIN ] IEX: Loaded 38652 existing records. [2025-10-03T19:32:58.395841] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-03T19:32:58.565934] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:58.571687] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-03T19:32:58.571838] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-03T19:32:58.578759] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-03T19:32:58.579465] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-03T19:32:58.579392] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:32:58.984552] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:59.190700] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-03T19:32:59.222198] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:32:59.990735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-03T19:33:00.079294] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T19:33:00.790736] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-03T19:33:01.294403] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:33:01.296717] [INFO ] [REMOTE ] ICL: Full fetch complete (55966 records). [2025-10-03T19:33:01.296893] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-03T19:33:01.602107] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-03T19:33:01.623584] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T19:33:01.748295] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-03T19:33:01.748394] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-03T19:33:01.749317] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-03T19:33:01.749406] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-03T19:33:01.750745] [DEBUG] [LOCAL ] ICL: Trimmed 55966 records to 38938 (keeping 200 days of data) [2025-10-03T19:33:01.981742] [DEBUG] [LOCAL ] ICL: Primary data saved (38938 records). [2025-10-03T19:33:01.981900] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-03T19:33:01.982504] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. ICL took 36.9s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-03T19:33:02.199037] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:02.257084] [DEBUG] [LOCAL ] IFF: Loaded 51357 existing records from primary storage. [2025-10-03T19:33:02.257438] [INFO ] [MAIN ] IFF: Loaded 51357 existing records. [2025-10-03T19:33:02.395794] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-03T19:33:02.452981] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:02.460133] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-03T19:33:02.460230] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-03T19:33:02.461156] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T19:33:02.461214] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-03T19:33:02.463509] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-03T19:33:02.855251] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:03.190702] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-03T19:33:03.879921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T19:33:03.990734] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-03T19:33:04.691109] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T19:33:04.766578] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:33:04.790621] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-03T19:33:05.590702] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-03T19:33:06.390715] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-03T19:33:06.870538] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T19:33:07.006918] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:33:07.190639] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-03T19:33:07.418908] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:33:07.990705] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-03T19:33:08.704097] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:33:08.715067] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T19:33:08.790691] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-03T19:33:09.590693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-03T19:33:10.239986] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:33:10.352377] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:33:10.390691] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-03T19:33:11.190686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-03T19:33:11.889971] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T19:33:11.990686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-03T19:33:12.129908] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:33:12.722004] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:33:12.790678] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-03T19:33:13.590687] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-03T19:33:13.632082] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T19:33:14.390669] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-03T19:33:14.615091] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T19:33:15.190684] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-03T19:33:15.218565] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T19:33:15.990705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-03T19:33:16.790700] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-03T19:33:17.085257] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:33:17.590719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-03T19:33:17.694516] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:33:17.695691] [INFO ] [REMOTE ] IDE: Full fetch complete (12579 records). [2025-10-03T19:33:17.695775] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-03T19:33:17.886268] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:33:18.143694] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-03T19:33:18.143782] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-03T19:33:18.144123] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-03T19:33:18.144187] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-03T19:33:18.144750] [DEBUG] [LOCAL ] IDE: Trimmed 12579 records to 8867 (keeping 200 days of data) [2025-10-03T19:33:18.202456] [DEBUG] [LOCAL ] IDE: Primary data saved (8867 records). [2025-10-03T19:33:18.202594] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-03T19:33:18.202727] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDE took 25.5s. Estimated remaining: 3h 0m 15s. Rate: 7.1 symbols/min [2025-10-03T19:33:18.384297] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:18.390672] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-03T19:33:18.406469] [DEBUG] [LOCAL ] IFN: Loaded 18372 existing records from primary storage. [2025-10-03T19:33:18.406801] [INFO ] [MAIN ] IFN: Loaded 18372 existing records. [2025-10-03T19:33:18.634916] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:18.636799] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:33:18.635937] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-03T19:33:18.642046] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-03T19:33:18.642776] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-03T19:33:18.642871] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-03T19:33:19.052165] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:19.190694] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-03T19:33:19.823300] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:33:19.923530] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:33:19.990688] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-03T19:33:20.790709] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-03T19:33:21.167272] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T19:33:21.590721] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-03T19:33:22.321205] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:33:22.390726] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-03T19:33:22.967392] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:33:23.190701] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-03T19:33:23.784963] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:33:23.990640] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-03T19:33:24.229098] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:33:24.790635] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-03T19:33:25.176218] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:33:25.590751] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-03T19:33:26.084079] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:33:26.390704] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-03T19:33:26.690019] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:33:27.190693] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-03T19:33:27.891861] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:33:27.990628] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-03T19:33:28.337972] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:33:28.790718] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-03T19:33:29.478052] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:33:29.590881] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-03T19:33:29.836883] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:33:30.390728] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-03T19:33:31.190625] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-03T19:33:31.284196] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T19:33:31.316779] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:33:31.990686] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-03T19:33:32.500558] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T19:33:32.502723] [INFO ] [REMOTE ] IEX: Full fetch complete (53536 records). [2025-10-03T19:33:32.502879] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-03T19:33:32.796015] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-03T19:33:32.962490] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-03T19:33:32.962667] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-03T19:33:32.963679] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-03T19:33:32.963751] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-03T19:33:32.964989] [DEBUG] [LOCAL ] IEX: Trimmed 53536 records to 38871 (keeping 200 days of data) [2025-10-03T19:33:33.093349] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T19:33:33.254562] [DEBUG] [LOCAL ] IEX: Primary data saved (38871 records). [2025-10-03T19:33:33.254752] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-03T19:33:33.254865] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IEX took 35.1s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-03T19:33:33.435219] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:33.457779] [DEBUG] [LOCAL ] IFS: Loaded 23264 existing records from primary storage. [2025-10-03T19:33:33.458056] [INFO ] [MAIN ] IFS: Loaded 23264 existing records. [2025-10-03T19:33:33.604905] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-03T19:33:33.650796] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:33.651098] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-03T19:33:33.651153] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-03T19:33:33.651431] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-03T19:33:33.651491] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-03T19:33:34.056367] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:34.320566] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:33:34.390700] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-03T19:33:34.818153] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:33:35.190679] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-03T19:33:35.344029] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T19:33:35.990698] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-03T19:33:36.292901] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:33:36.790630] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-03T19:33:36.933850] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:33:37.590637] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-03T19:33:37.738144] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:33:38.390723] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-03T19:33:38.737043] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:33:39.190707] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-03T19:33:39.990684] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-03T19:33:40.097850] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T19:33:40.268144] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:33:40.790721] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-03T19:33:40.833663] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:33:40.835134] [INFO ] [REMOTE ] IFN: Full fetch complete (29183 records). [2025-10-03T19:33:40.835209] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-03T19:33:41.256336] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-03T19:33:41.256420] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-03T19:33:41.257089] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-03T19:33:41.257156] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-03T19:33:41.258019] [DEBUG] [LOCAL ] IFN: Trimmed 29183 records to 18598 (keeping 200 days of data) [2025-10-03T19:33:41.375549] [DEBUG] [LOCAL ] IFN: Primary data saved (18598 records). [2025-10-03T19:33:41.375743] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-03T19:33:41.375844] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IFN took 23.2s. Estimated remaining: 3h 0m 5s. Rate: 7.1 symbols/min [2025-10-03T19:33:41.572277] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:41.584078] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:33:41.590610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-03T19:33:41.599899] [DEBUG] [LOCAL ] IGA: Loaded 9918 existing records from primary storage. [2025-10-03T19:33:41.600444] [INFO ] [MAIN ] IGA: Loaded 9918 existing records. [2025-10-03T19:33:41.814262] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:41.814547] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-03T19:33:41.814608] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-03T19:33:41.814857] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-03T19:33:41.814915] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-03T19:33:42.229108] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:42.390731] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-03T19:33:42.644720] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:33:42.868464] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:33:43.190710] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-03T19:33:43.990727] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-03T19:33:44.784522] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:33:44.790690] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-03T19:33:44.878731] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:33:45.590751] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-03T19:33:46.064521] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T19:33:46.390729] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-03T19:33:46.869004] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:33:46.871201] [INFO ] [REMOTE ] IDT: Full fetch complete (23101 records). [2025-10-03T19:33:46.871370] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-03T19:33:47.197450] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-03T19:33:47.303441] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-03T19:33:47.303528] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-03T19:33:47.304123] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-03T19:33:47.304190] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-03T19:33:47.305154] [DEBUG] [LOCAL ] IDT: Trimmed 23101 records to 18332 (keeping 200 days of data) [2025-10-03T19:33:47.426465] [DEBUG] [LOCAL ] IDT: Primary data saved (18332 records). [2025-10-03T19:33:47.426668] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-03T19:33:47.426814] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IDT took 51.1s. Estimated remaining: 2h 59m 54s. Rate: 7.1 symbols/min [2025-10-03T19:33:47.631477] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:47.653985] [DEBUG] [LOCAL ] IGD: Loaded 19256 existing records from primary storage. [2025-10-03T19:33:47.654260] [INFO ] [MAIN ] IGD: Loaded 19256 existing records. [2025-10-03T19:33:47.866353] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:47.866611] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-03T19:33:47.866701] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-03T19:33:47.867361] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-03T19:33:47.867453] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-03T19:33:47.995742] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-03T19:33:48.197150] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:33:48.305342] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:48.311903] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-03T19:33:48.314840] [INFO ] [REMOTE ] IFF: Full fetch complete (73067 records). [2025-10-03T19:33:48.315022] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-03T19:33:48.748796] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-03T19:33:48.748915] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-03T19:33:48.749897] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-03T19:33:48.749966] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-03T19:33:48.751539] [DEBUG] [LOCAL ] IFF: Trimmed 73067 records to 51736 (keeping 200 days of data) [2025-10-03T19:33:48.813195] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-03T19:33:49.113121] [DEBUG] [LOCAL ] IFF: Primary data saved (51736 records). [2025-10-03T19:33:49.113325] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-03T19:33:49.115242] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFF took 47.1s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-03T19:33:49.303096] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:33:49.347160] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:49.355826] [DEBUG] [LOCAL ] IGI: Loaded 3658 existing records from primary storage. [2025-10-03T19:33:49.356115] [INFO ] [MAIN ] IGI: Loaded 3658 existing records. [2025-10-03T19:33:49.563000] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:49.563211] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-03T19:33:49.563260] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-03T19:33:49.563477] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-03T19:33:49.563554] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-03T19:33:49.600068] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-03T19:33:50.005402] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:50.232942] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:33:50.381219] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:33:50.390664] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-03T19:33:51.048827] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T19:33:51.190695] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-03T19:33:51.990711] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-03T19:33:52.411498] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:33:52.782603] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:33:52.790672] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-03T19:33:53.558497] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T19:33:53.590729] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-03T19:33:54.390677] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-03T19:33:54.682425] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T19:33:55.110498] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:33:55.190676] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-03T19:33:55.990732] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-03T19:33:56.026264] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:33:56.790699] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-03T19:33:57.040409] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:33:57.527837] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T19:33:57.590632] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-03T19:33:58.355950] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:33:58.390621] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-03T19:33:58.852379] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T19:33:59.190703] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-03T19:33:59.721887] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T19:33:59.990667] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-03T19:34:00.790688] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-03T19:34:01.374608] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:34:01.590718] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-03T19:34:01.786004] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:34:02.390698] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-03T19:34:02.705253] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:34:03.190667] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-03T19:34:03.497507] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:34:03.938736] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:34:03.939875] [INFO ] [REMOTE ] IGA: Full fetch complete (13785 records). [2025-10-03T19:34:03.939988] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-03T19:34:03.998178] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-03T19:34:04.344094] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-03T19:34:04.344220] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-03T19:34:04.345349] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-03T19:34:04.345462] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-03T19:34:04.347905] [DEBUG] [LOCAL ] IGA: Trimmed 13785 records to 10018 (keeping 200 days of data) [2025-10-03T19:34:04.430592] [DEBUG] [LOCAL ] IGA: Primary data saved (10018 records). [2025-10-03T19:34:04.430848] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-03T19:34:04.431044] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IGA took 23.1s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-03T19:34:04.629570] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:04.671493] [DEBUG] [LOCAL ] IGR: Loaded 30686 existing records from primary storage. [2025-10-03T19:34:04.671932] [INFO ] [MAIN ] IGR: Loaded 30686 existing records. [2025-10-03T19:34:04.795873] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-03T19:34:04.858255] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:04.858817] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-03T19:34:04.858877] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-03T19:34:04.859187] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-03T19:34:04.859248] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-03T19:34:05.216045] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:05.285952] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T19:34:05.590699] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-03T19:34:05.778069] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:34:05.780982] [INFO ] [REMOTE ] IFS: Full fetch complete (31759 records). [2025-10-03T19:34:05.781081] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-03T19:34:06.195718] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-03T19:34:06.195816] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-03T19:34:06.196461] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-03T19:34:06.196504] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-03T19:34:06.198172] [DEBUG] [LOCAL ] IFS: Trimmed 31759 records to 23414 (keeping 200 days of data) [2025-10-03T19:34:06.344274] [DEBUG] [LOCAL ] IFS: Primary data saved (23414 records). [2025-10-03T19:34:06.344423] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-03T19:34:06.344525] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IFS took 33.1s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-03T19:34:06.402268] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-03T19:34:06.530480] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:06.537254] [DEBUG] [LOCAL ] IH: Loaded 3128 existing records from primary storage. [2025-10-03T19:34:06.537426] [INFO ] [MAIN ] IH: Loaded 3128 existing records. [2025-10-03T19:34:06.685748] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T19:34:06.753873] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:06.754210] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-03T19:34:06.754271] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-03T19:34:06.754475] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-03T19:34:06.754543] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-03T19:34:07.140291] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:07.190751] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-03T19:34:07.931103] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:34:07.990610] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-03T19:34:08.121961] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:34:08.790714] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-03T19:34:08.830756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:34:09.480150] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T19:34:09.590691] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-03T19:34:10.390749] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-03T19:34:10.952301] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T19:34:11.022315] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:34:11.190708] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-03T19:34:11.679029] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T19:34:11.990621] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-03T19:34:12.473637] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T19:34:12.790718] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-03T19:34:13.234112] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:34:13.590721] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-03T19:34:14.116693] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T19:34:14.390682] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-03T19:34:15.190715] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-03T19:34:15.726635] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-03T19:34:15.846636] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:34:15.990720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-03T19:34:16.790786] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-03T19:34:17.287860] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T19:34:17.416048] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:34:17.590696] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-03T19:34:18.322086] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:34:18.390676] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-03T19:34:18.848967] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:34:19.190737] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-03T19:34:19.634666] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T19:34:19.990738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-03T19:34:20.410781] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T19:34:20.790787] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-03T19:34:21.590638] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-03T19:34:21.645183] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:34:22.390716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-03T19:34:22.438268] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:34:22.989415] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:34:23.190736] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-03T19:34:23.990695] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-03T19:34:24.188339] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:34:24.559768] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:34:24.790714] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-03T19:34:25.590778] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-03T19:34:25.802692] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:34:26.390779] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-03T19:34:26.868970] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T19:34:27.190682] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-03T19:34:27.272898] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:34:27.276257] [INFO ] [REMOTE ] IGD: Full fetch complete (29773 records). [2025-10-03T19:34:27.276419] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-03T19:34:27.691686] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-03T19:34:27.691791] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-03T19:34:27.692526] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-03T19:34:27.692595] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-03T19:34:27.693523] [DEBUG] [LOCAL ] IGD: Trimmed 29773 records to 19385 (keeping 200 days of data) [2025-10-03T19:34:27.790462] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T19:34:27.792940] [INFO ] [REMOTE ] IGI: Full fetch complete (5269 records). [2025-10-03T19:34:27.793407] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-03T19:34:27.992727] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-03T19:34:28.242105] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-03T19:34:28.243305] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-03T19:34:28.243686] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-03T19:34:28.244030] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-03T19:34:28.245914] [DEBUG] [LOCAL ] IGI: Trimmed 5269 records to 3706 (keeping 200 days of data) [2025-10-03T19:34:28.273087] [DEBUG] [LOCAL ] IGI: Primary data saved (3706 records). [2025-10-03T19:34:28.274130] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-03T19:34:28.274858] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IGI took 39.2s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-03T19:34:28.369296] [DEBUG] [LOCAL ] IGD: Primary data saved (19385 records). [2025-10-03T19:34:28.385988] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-03T19:34:28.386204] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGD took 41.0s. Estimated remaining: 2h 59m 10s. Rate: 7.1 symbols/min [2025-10-03T19:34:28.531905] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:28.559489] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:34:28.659413] [DEBUG] [LOCAL ] IHD: Loaded 6998 existing records from primary storage. [2025-10-03T19:34:28.658969] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:28.659729] [INFO ] [MAIN ] IHD: Loaded 6998 existing records. [2025-10-03T19:34:28.794253] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-03T19:34:28.853601] [DEBUG] [LOCAL ] IHG: Loaded 24606 existing records from primary storage. [2025-10-03T19:34:28.882835] [INFO ] [MAIN ] IHG: Loaded 24606 existing records. [2025-10-03T19:34:29.007956] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:29.040010] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-03T19:34:29.049505] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-03T19:34:29.072079] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-03T19:34:29.083122] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-03T19:34:29.282443] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:29.307236] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-03T19:34:29.307405] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:34:29.307801] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-03T19:34:29.309921] [INFO ] [REMOTE ] IH: Full fetch complete (4977 records). [2025-10-03T19:34:29.315633] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-03T19:34:29.316005] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-03T19:34:29.315882] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-03T19:34:29.599246] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-03T19:34:30.259359] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:30.425275] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-03T19:34:30.497157] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:30.503026] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-03T19:34:30.503341] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-03T19:34:30.503587] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-03T19:34:30.503635] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-03T19:34:30.504256] [DEBUG] [LOCAL ] IH: Trimmed 4977 records to 3145 (keeping 200 days of data) [2025-10-03T19:34:30.524388] [DEBUG] [LOCAL ] IH: Primary data saved (3145 records). [2025-10-03T19:34:30.524480] [INFO ] [MAIN ] IH: Full history saved. [2025-10-03T19:34:30.524590] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IH took 24.2s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-03T19:34:30.715727] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:30.762490] [DEBUG] [LOCAL ] IHS: Loaded 39304 existing records from primary storage. [2025-10-03T19:34:30.763011] [INFO ] [MAIN ] IHS: Loaded 39304 existing records. [2025-10-03T19:34:30.958775] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:30.959120] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-03T19:34:30.959189] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-03T19:34:30.960687] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-03T19:34:30.960753] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-03T19:34:31.119484] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T19:34:31.194333] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-03T19:34:31.238342] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:34:31.390070] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:31.990683] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-03T19:34:32.669285] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T19:34:32.790738] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-03T19:34:33.146924] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:34:33.590739] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-03T19:34:33.941733] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:34:34.191871] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T19:34:34.390723] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-03T19:34:35.190673] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-03T19:34:35.425517] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:34:35.624206] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T19:34:35.990731] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-03T19:34:36.790726] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-03T19:34:37.279294] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:34:37.590737] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-03T19:34:38.302163] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:34:38.362573] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:34:38.390632] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-03T19:34:39.190742] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-03T19:34:39.697878] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:34:39.844713] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T19:34:39.990701] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-03T19:34:40.790765] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-03T19:34:41.081500] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T19:34:41.590798] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-03T19:34:41.834998] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:34:42.390639] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-03T19:34:42.716139] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:34:43.190770] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-03T19:34:43.909346] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:34:43.990695] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-03T19:34:44.266996] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:34:44.269567] [INFO ] [REMOTE ] IGR: Full fetch complete (45703 records). [2025-10-03T19:34:44.269837] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-03T19:34:44.608575] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T19:34:44.766585] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-03T19:34:44.766744] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-03T19:34:44.767828] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-03T19:34:44.767897] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-03T19:34:44.769445] [DEBUG] [LOCAL ] IGR: Trimmed 45703 records to 30882 (keeping 200 days of data) [2025-10-03T19:34:44.824216] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-03T19:34:45.001949] [DEBUG] [LOCAL ] IGR: Primary data saved (30882 records). [2025-10-03T19:34:45.002183] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-03T19:34:45.002302] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IGR took 40.6s. Estimated remaining: 2h 58m 53s. Rate: 7.1 symbols/min [2025-10-03T19:34:45.223150] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:45.235405] [DEBUG] [LOCAL ] IIF: Loaded 5734 existing records from primary storage. [2025-10-03T19:34:45.235888] [INFO ] [MAIN ] IIF: Loaded 5734 existing records. [2025-10-03T19:34:45.554239] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:45.554629] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-03T19:34:45.554740] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-03T19:34:45.555409] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-03T19:34:45.555491] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-03T19:34:45.592453] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-03T19:34:46.092555] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:46.114486] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T19:34:46.390711] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-03T19:34:46.413756] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T19:34:47.190721] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-03T19:34:47.820533] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:34:47.990723] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-03T19:34:48.235385] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:34:48.770050] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:34:48.790637] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-03T19:34:49.473979] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:34:49.590752] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-03T19:34:50.317686] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T19:34:50.390673] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-03T19:34:51.071306] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:34:51.072356] [INFO ] [REMOTE ] IHD: Full fetch complete (11764 records). [2025-10-03T19:34:51.072432] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-03T19:34:51.195731] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-03T19:34:51.458557] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-03T19:34:51.458675] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-03T19:34:51.459040] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-03T19:34:51.459089] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-03T19:34:51.459710] [DEBUG] [LOCAL ] IHD: Trimmed 11764 records to 7057 (keeping 200 days of data) [2025-10-03T19:34:51.504998] [DEBUG] [LOCAL ] IHD: Primary data saved (7057 records). [2025-10-03T19:34:51.505167] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-03T19:34:51.505280] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IHD took 23.2s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-03T19:34:51.686403] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:51.703546] [DEBUG] [LOCAL ] IIIN: Loaded 16475 existing records from primary storage. [2025-10-03T19:34:51.703863] [INFO ] [MAIN ] IIIN: Loaded 16475 existing records. [2025-10-03T19:34:51.896596] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:51.897152] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-03T19:34:51.897213] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-03T19:34:51.898158] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-03T19:34:51.898221] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-03T19:34:51.995864] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-03T19:34:52.279475] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:52.790691] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-03T19:34:52.927465] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:34:53.495563] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:34:53.590747] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-03T19:34:53.679186] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:34:54.390745] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-03T19:34:54.932435] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T19:34:55.190754] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-03T19:34:55.990776] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-03T19:34:56.009156] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:34:56.107690] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T19:34:56.790739] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-03T19:34:57.055549] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:34:57.590674] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-03T19:34:57.924814] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:34:58.390730] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-03T19:34:59.121382] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:34:59.190881] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-03T19:34:59.414351] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:34:59.684856] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T19:34:59.990683] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-03T19:35:00.790697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-03T19:35:01.041926] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:35:01.590687] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-03T19:35:02.057082] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T19:35:02.390697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-03T19:35:02.624684] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:35:03.190681] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-03T19:35:03.640316] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T19:35:03.990622] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-03T19:35:03.999832] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:35:04.790735] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-03T19:35:05.117837] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:35:05.498501] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T19:35:05.590694] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-03T19:35:06.390621] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-03T19:35:06.780243] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T19:35:06.829894] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:35:07.190679] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-03T19:35:07.963804] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:35:07.990628] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-03T19:35:08.619409] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:35:08.790685] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-03T19:35:09.381536] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:35:09.590703] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-03T19:35:10.298203] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:35:10.299064] [INFO ] [REMOTE ] IIF: Full fetch complete (9334 records). [2025-10-03T19:35:10.299171] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-03T19:35:10.395756] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-03T19:35:10.707855] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-03T19:35:10.708228] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-03T19:35:10.708594] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-03T19:35:10.708683] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-03T19:35:10.709298] [DEBUG] [LOCAL ] IIF: Trimmed 9334 records to 5751 (keeping 200 days of data) [2025-10-03T19:35:10.748281] [DEBUG] [LOCAL ] IIF: Primary data saved (5751 records). [2025-10-03T19:35:10.748449] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-03T19:35:10.748589] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IIF took 25.7s. Estimated remaining: 2h 58m 46s. Rate: 7.1 symbols/min [2025-10-03T19:35:10.946519] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:10.966971] [DEBUG] [LOCAL ] IIM: Loaded 16251 existing records from primary storage. [2025-10-03T19:35:10.967249] [INFO ] [MAIN ] IIM: Loaded 16251 existing records. [2025-10-03T19:35:11.190815] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-03T19:35:11.195536] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:11.196899] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-03T19:35:11.196986] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-03T19:35:11.198355] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-03T19:35:11.198443] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-03T19:35:11.587084] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:35:11.638341] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:11.990735] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-03T19:35:12.790631] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-03T19:35:12.859676] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:35:12.861488] [INFO ] [REMOTE ] IHG: Full fetch complete (33871 records). [2025-10-03T19:35:12.861590] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-03T19:35:13.274211] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-03T19:35:13.274412] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-03T19:35:13.275223] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-03T19:35:13.275303] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-03T19:35:13.288459] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:35:13.293702] [DEBUG] [LOCAL ] IHG: Trimmed 33871 records to 24747 (keeping 200 days of data) [2025-10-03T19:35:13.467893] [DEBUG] [LOCAL ] IHG: Primary data saved (24747 records). [2025-10-03T19:35:13.468029] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-03T19:35:13.468127] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IHG took 45.1s. Estimated remaining: 2h 58m 31s. Rate: 7.1 symbols/min [2025-10-03T19:35:13.595822] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-03T19:35:13.657170] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:13.690967] [DEBUG] [LOCAL ] IIPR: Loaded 30075 existing records from primary storage. [2025-10-03T19:35:13.691269] [INFO ] [MAIN ] IIPR: Loaded 30075 existing records. [2025-10-03T19:35:13.883837] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:13.884101] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-03T19:35:13.884152] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-03T19:35:13.885951] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-03T19:35:13.886014] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-03T19:35:14.268606] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:14.361755] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:35:14.390718] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-03T19:35:14.842127] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T19:35:14.979046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:35:15.190717] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-03T19:35:15.990672] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-03T19:35:16.625620] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:35:16.790725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-03T19:35:17.074946] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T19:35:17.590726] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-03T19:35:18.226343] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:35:18.390703] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-03T19:35:18.522160] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T19:35:19.190725] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-03T19:35:19.692323] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:35:19.990685] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-03T19:35:20.421277] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:35:20.790738] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-03T19:35:21.590698] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-03T19:35:21.735753] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T19:35:22.363901] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:35:22.390713] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-03T19:35:23.190734] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-03T19:35:23.729064] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (3.74 seconds). [2025-10-03T19:35:23.731130] [INFO ] [REMOTE ] IHS: Full fetch complete (51455 records). [2025-10-03T19:35:23.731269] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-03T19:35:23.732528] [FATAL] [VALIDATOR ] IHS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T19:35:23.732624] [FATAL] [MAIN ] IHS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:35:23.732709] [WARN ] [MAIN ] IHS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:35:23.732759] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-03T19:35:23.732824] [DEBUG] [LOCAL ] IHS: No primary data file found to delete. [2025-10-03T19:35:23.732861] [INFO ] [LOCAL ] IHS: Starting deletion of derivative data. [2025-10-03T19:35:23.733436] [DEBUG] [LOCAL ] IHS: Deleted derivative data file. [2025-10-03T19:35:23.733567] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IHS took 53.2s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-03T19:35:23.920762] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:23.944040] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:35:23.994758] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-03T19:35:23.996949] [DEBUG] [LOCAL ] IMAX: Loaded 43087 existing records from primary storage. [2025-10-03T19:35:23.997429] [INFO ] [MAIN ] IMAX: Loaded 43087 existing records. [2025-10-03T19:35:24.075867] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T19:35:24.109416] [INFO ] [REMOTE ] IIIN: Full fetch complete (24871 records). [2025-10-03T19:35:24.120868] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-03T19:35:24.345915] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:24.356458] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-03T19:35:24.377883] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-03T19:35:24.412832] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-03T19:35:24.430937] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-03T19:35:24.793528] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-03T19:35:24.924257] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-03T19:35:24.954394] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-03T19:35:24.966966] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-03T19:35:24.973972] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-03T19:35:25.008466] [DEBUG] [LOCAL ] IIIN: Trimmed 24871 records to 16544 (keeping 200 days of data) [2025-10-03T19:35:25.124747] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:25.189795] [DEBUG] [LOCAL ] IIIN: Primary data saved (16544 records). [2025-10-03T19:35:25.189944] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-03T19:35:25.190054] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 33.7s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-03T19:35:25.377966] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:25.397627] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:35:25.455472] [DEBUG] [LOCAL ] INFA: Loaded 49887 existing records from primary storage. [2025-10-03T19:35:25.455853] [INFO ] [MAIN ] INFA: Loaded 49887 existing records. [2025-10-03T19:35:25.606276] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-03T19:35:25.656243] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:25.656672] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-03T19:35:25.656810] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-03T19:35:25.659131] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-03T19:35:25.659290] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-03T19:35:25.797469] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:35:26.054991] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:26.390694] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-03T19:35:27.190689] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-03T19:35:27.261409] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:35:27.709061] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T19:35:27.990754] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-03T19:35:28.647946] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:35:28.790717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-03T19:35:29.437139] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:35:29.590713] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-03T19:35:30.296320] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:35:30.390631] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-03T19:35:30.511495] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:35:31.190738] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-03T19:35:31.902389] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:35:31.990720] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-03T19:35:32.678310] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:35:32.790737] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-03T19:35:33.461953] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:35:33.590752] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-03T19:35:34.338205] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:35:34.390676] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-03T19:35:35.120225] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:35:35.190705] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-03T19:35:35.310040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:35:35.990717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-03T19:35:36.790704] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-03T19:35:36.842549] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T19:35:37.315794] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:35:37.590742] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-03T19:35:37.773442] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:35:38.390730] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-03T19:35:39.029607] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T19:35:39.190703] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-03T19:35:39.229957] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:35:39.990711] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-03T19:35:40.209873] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:35:40.790699] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-03T19:35:41.024011] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:35:41.590700] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-03T19:35:42.390734] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-03T19:35:42.687887] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:35:42.689787] [INFO ] [REMOTE ] IIM: Full fetch complete (25619 records). [2025-10-03T19:35:42.689882] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-03T19:35:43.108379] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-03T19:35:43.108466] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-03T19:35:43.109043] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-03T19:35:43.109119] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-03T19:35:43.110045] [DEBUG] [LOCAL ] IIM: Trimmed 25619 records to 16408 (keeping 200 days of data) [2025-10-03T19:35:43.190820] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-03T19:35:43.224916] [DEBUG] [LOCAL ] IIM: Primary data saved (16408 records). [2025-10-03T19:35:43.225107] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-03T19:35:43.225224] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IIM took 32.5s. Estimated remaining: 2h 58m 11s. Rate: 7.1 symbols/min [2025-10-03T19:35:43.421162] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:43.453432] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:35:43.521042] [DEBUG] [LOCAL ] INFY: Loaded 53985 existing records from primary storage. [2025-10-03T19:35:43.521388] [INFO ] [MAIN ] INFY: Loaded 53985 existing records. [2025-10-03T19:35:43.721306] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:43.721671] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-03T19:35:43.721884] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-03T19:35:43.723468] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-03T19:35:43.723531] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-03T19:35:43.862822] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T19:35:44.002484] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-03T19:35:44.139839] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:44.353544] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:35:44.790722] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-03T19:35:45.519605] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:35:45.590708] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-03T19:35:46.390748] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-03T19:35:46.462006] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T19:35:47.169782] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:35:47.190623] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-03T19:35:47.788469] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T19:35:47.990726] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-03T19:35:48.658082] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T19:35:48.790731] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-03T19:35:49.590690] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-03T19:35:49.730891] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:35:50.396802] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-03T19:35:50.402408] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T19:35:51.190696] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-03T19:35:51.226113] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:35:51.990620] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-03T19:35:52.099900] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:35:52.794367] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-03T19:35:52.799824] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T19:35:53.590708] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-03T19:35:53.728530] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:35:54.390711] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-03T19:35:54.547866] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:35:54.798662] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:35:54.801119] [INFO ] [REMOTE ] IMAX: Full fetch complete (59957 records). [2025-10-03T19:35:54.801259] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-03T19:35:55.198862] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-03T19:35:55.244024] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-03T19:35:55.244117] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-03T19:35:55.245069] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-03T19:35:55.245137] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-03T19:35:55.246966] [DEBUG] [LOCAL ] IMAX: Trimmed 59957 records to 43420 (keeping 200 days of data) [2025-10-03T19:35:55.519053] [DEBUG] [LOCAL ] IMAX: Primary data saved (43420 records). [2025-10-03T19:35:55.519209] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-03T19:35:55.519343] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IMAX took 31.8s. Estimated remaining: 2h 58m 7s. Rate: 7.1 symbols/min [2025-10-03T19:35:55.717619] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:55.715803] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:35:55.720517] [INFO ] [REMOTE ] IIPR: Full fetch complete (44849 records). [2025-10-03T19:35:55.720612] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-03T19:35:56.015817] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-03T19:35:56.109510] [DEBUG] [LOCAL ] ING: Loaded 51091 existing records from primary storage. [2025-10-03T19:35:56.110507] [INFO ] [MAIN ] ING: Loaded 51091 existing records. [2025-10-03T19:35:56.500968] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-03T19:35:56.516714] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-03T19:35:56.518953] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-03T19:35:56.519145] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-03T19:35:56.548953] [DEBUG] [LOCAL ] IIPR: Trimmed 44849 records to 30310 (keeping 200 days of data) [2025-10-03T19:35:56.575602] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:35:56.703696] [INFO ] [REMOTE ] INFA: Full fetch complete (71329 records). [2025-10-03T19:35:56.767327] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:56.768491] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-03T19:35:56.769094] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-03T19:35:56.771515] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-03T19:35:56.774085] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-03T19:35:56.789255] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-03T19:35:57.710581] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-03T19:35:57.737508] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-03T19:35:57.738962] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-03T19:35:57.739355] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-03T19:35:57.786754] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:57.788053] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-03T19:35:57.791638] [DEBUG] [LOCAL ] INFA: Trimmed 71329 records to 50218 (keeping 200 days of data) [2025-10-03T19:35:57.987475] [DEBUG] [LOCAL ] IIPR: Primary data saved (30310 records). [2025-10-03T19:35:57.994258] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-03T19:35:57.996312] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. IIPR took 44.5s. Estimated remaining: 2h 57m 52s. Rate: 7.1 symbols/min [2025-10-03T19:35:58.314438] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:58.369545] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-03T19:35:58.392518] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-03T19:35:58.424755] [DEBUG] [LOCAL ] INGM: Loaded 28854 existing records from primary storage. [2025-10-03T19:35:58.430791] [INFO ] [MAIN ] INGM: Loaded 28854 existing records. [2025-10-03T19:35:58.661068] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:58.662906] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-03T19:35:58.663631] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-03T19:35:58.665754] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-03T19:35:58.666709] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-03T19:35:58.807466] [DEBUG] [LOCAL ] INFA: Primary data saved (50218 records). [2025-10-03T19:35:58.817952] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-03T19:35:58.838434] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. INFA took 33.6s. Estimated remaining: 2h 57m 34s. Rate: 7.1 symbols/min [2025-10-03T19:35:59.251218] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:59.283737] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:59.284144] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-03T19:35:59.317056] [DEBUG] [LOCAL ] INGR: Loaded 33646 existing records from primary storage. [2025-10-03T19:35:59.317372] [INFO ] [MAIN ] INGR: Loaded 33646 existing records. [2025-10-03T19:35:59.505756] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:59.506027] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-03T19:35:59.506079] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-03T19:35:59.507290] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-03T19:35:59.507352] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-03T19:35:59.887133] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:59.887555] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-03T19:35:59.922935] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T19:35:59.990688] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-03T19:36:00.344982] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:36:00.375137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:36:00.790718] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-03T19:36:01.095518] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:36:01.590685] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-03T19:36:01.781405] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T19:36:02.390754] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-03T19:36:02.636398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:36:02.667482] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:36:03.190699] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-03T19:36:03.990690] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-03T19:36:04.040958] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:36:04.790627] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-03T19:36:04.992105] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:36:05.145037] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:36:05.590682] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-03T19:36:06.390679] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-03T19:36:06.672767] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:36:07.190695] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-03T19:36:07.713041] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:36:07.769042] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:36:07.990690] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-03T19:36:08.790730] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-03T19:36:09.045222] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T19:36:09.590733] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-03T19:36:09.812925] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T19:36:10.191247] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:36:10.390674] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-03T19:36:11.117582] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:36:11.190676] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-03T19:36:11.990729] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-03T19:36:12.255116] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:36:12.617693] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:36:12.790718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-03T19:36:13.279754] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:36:13.590708] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-03T19:36:14.390635] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-03T19:36:14.585309] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T19:36:15.141552] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:36:15.190714] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-03T19:36:15.784206] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T19:36:15.786998] [INFO ] [REMOTE ] INFY: Full fetch complete (77542 records). [2025-10-03T19:36:15.787141] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-03T19:36:15.996855] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-03T19:36:16.239065] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-03T19:36:16.239152] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-03T19:36:16.240349] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-03T19:36:16.240417] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-03T19:36:16.242019] [DEBUG] [LOCAL ] INFY: Trimmed 77542 records to 54375 (keeping 200 days of data) [2025-10-03T19:36:16.592040] [DEBUG] [LOCAL ] INFY: Primary data saved (54375 records). [2025-10-03T19:36:16.592296] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-03T19:36:16.592451] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. INFY took 33.4s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-10-03T19:36:16.780228] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:16.790683] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-03T19:36:16.821697] [DEBUG] [LOCAL ] INN: Loaded 41983 existing records from primary storage. [2025-10-03T19:36:16.821996] [INFO ] [MAIN ] INN: Loaded 41983 existing records. [2025-10-03T19:36:17.033449] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:17.034128] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-03T19:36:17.034357] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-03T19:36:17.035556] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-03T19:36:17.035732] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-03T19:36:17.203783] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:36:17.487969] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:36:17.569101] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:17.590717] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-03T19:36:18.319121] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:36:18.390673] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-03T19:36:19.082187] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:36:19.190717] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-03T19:36:19.990664] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-03T19:36:20.168926] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:36:20.549368] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:36:20.790726] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-03T19:36:21.153339] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:36:21.590688] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-03T19:36:22.142457] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:36:22.390734] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-03T19:36:22.990543] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:36:23.190720] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-03T19:36:23.614221] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:36:23.990742] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-03T19:36:24.635314] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:36:24.638915] [INFO ] [REMOTE ] ING: Full fetch complete (73626 records). [2025-10-03T19:36:24.639040] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-03T19:36:24.794678] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-03T19:36:25.060941] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-03T19:36:25.061061] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-03T19:36:25.062177] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-03T19:36:25.062255] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-03T19:36:25.063853] [DEBUG] [LOCAL ] ING: Trimmed 73626 records to 51453 (keeping 200 days of data) [2025-10-03T19:36:25.302776] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:36:25.417220] [DEBUG] [LOCAL ] ING: Primary data saved (51453 records). [2025-10-03T19:36:25.417364] [INFO ] [MAIN ] ING: Full history saved. [2025-10-03T19:36:25.417461] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. ING took 29.9s. Estimated remaining: 2h 57m 29s. Rate: 7.1 symbols/min [2025-10-03T19:36:25.595242] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:25.595348] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-03T19:36:25.596631] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-03T19:36:25.596724] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-03T19:36:25.596852] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-03T19:36:25.596896] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-03T19:36:25.596941] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-03T19:36:25.596974] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-03T19:36:25.988922] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:26.297677] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:36:26.390679] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-03T19:36:26.596899] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:36:26.597226] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-03T19:36:26.597350] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:36:26.597428] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-03T19:36:26.597497] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:36:26.597573] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-03T19:36:26.597665] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-03T19:36:26.597726] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-03T19:36:26.597813] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-03T19:36:26.597871] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INR took 1.2s. Estimated remaining: 2h 57m 12s. Rate: 7.1 symbols/min [2025-10-03T19:36:26.805326] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:26.829454] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T19:36:26.871196] [DEBUG] [LOCAL ] INSP: Loaded 37471 existing records from primary storage. [2025-10-03T19:36:26.871538] [INFO ] [MAIN ] INSP: Loaded 37471 existing records. [2025-10-03T19:36:27.071884] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:27.072176] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-03T19:36:27.072258] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-03T19:36:27.072842] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-03T19:36:27.072905] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-03T19:36:27.191082] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-03T19:36:27.482211] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:27.990638] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-03T19:36:28.452873] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:36:28.790701] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-03T19:36:29.107760] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:36:29.590729] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-03T19:36:30.223071] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:36:30.390719] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-03T19:36:30.576932] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:36:30.580316] [INFO ] [REMOTE ] INGR: Full fetch complete (50318 records). [2025-10-03T19:36:30.580495] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-03T19:36:31.024243] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-03T19:36:31.024328] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-03T19:36:31.025215] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-03T19:36:31.025281] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-03T19:36:31.026454] [DEBUG] [LOCAL ] INGR: Trimmed 50318 records to 33949 (keeping 200 days of data) [2025-10-03T19:36:31.201259] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-03T19:36:31.255354] [DEBUG] [LOCAL ] INGR: Primary data saved (33949 records). [2025-10-03T19:36:31.255508] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-03T19:36:31.255596] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGR took 32.4s. Estimated remaining: 2h 56m 59s. Rate: 7.1 symbols/min [2025-10-03T19:36:31.455344] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:31.498943] [DEBUG] [LOCAL ] INSW: Loaded 40240 existing records from primary storage. [2025-10-03T19:36:31.499259] [INFO ] [MAIN ] INSW: Loaded 40240 existing records. [2025-10-03T19:36:31.699033] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:31.699460] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-03T19:36:31.699604] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-03T19:36:31.701037] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-03T19:36:31.701104] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-03T19:36:31.907333] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:36:31.996494] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-03T19:36:32.136591] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:32.565252] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:36:32.790720] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-03T19:36:33.539066] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:36:33.590730] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-03T19:36:34.364767] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:36:34.390636] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-03T19:36:35.014975] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:36:35.190673] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-03T19:36:35.620595] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T19:36:35.990712] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-03T19:36:36.723315] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:36:36.790639] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-03T19:36:36.980968] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:36:36.982770] [INFO ] [REMOTE ] INGM: Full fetch complete (42543 records). [2025-10-03T19:36:36.982868] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-03T19:36:37.386662] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-03T19:36:37.386756] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-03T19:36:37.387489] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-03T19:36:37.387554] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-03T19:36:37.388597] [DEBUG] [LOCAL ] INGM: Trimmed 42543 records to 29093 (keeping 200 days of data) [2025-10-03T19:36:37.585511] [DEBUG] [LOCAL ] INGM: Primary data saved (29093 records). [2025-10-03T19:36:37.585719] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-03T19:36:37.585867] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INGM took 39.6s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-03T19:36:37.598541] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-03T19:36:37.792797] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:37.851160] [DEBUG] [LOCAL ] INVH: Loaded 53521 existing records from primary storage. [2025-10-03T19:36:37.851585] [INFO ] [MAIN ] INVH: Loaded 53521 existing records. [2025-10-03T19:36:38.047993] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:38.048214] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-03T19:36:38.048292] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-03T19:36:38.050997] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-03T19:36:38.051062] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-03T19:36:38.395165] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-03T19:36:38.454885] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:38.483877] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:36:39.130542] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:36:39.190734] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-03T19:36:39.990670] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-03T19:36:40.101402] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:36:40.551919] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:36:40.790735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-03T19:36:41.595792] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-03T19:36:41.620032] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:36:42.225227] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:36:42.390722] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-03T19:36:43.190743] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-03T19:36:43.252627] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:36:43.846927] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:36:43.990737] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-03T19:36:44.790714] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-03T19:36:44.990093] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:36:45.348940] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:36:45.590701] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-03T19:36:46.077370] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:36:46.390704] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-03T19:36:47.190732] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-03T19:36:47.337982] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:36:47.990727] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-03T19:36:48.030273] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:36:48.537942] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:36:48.540729] [INFO ] [REMOTE ] INN: Full fetch complete (57866 records). [2025-10-03T19:36:48.540883] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-03T19:36:48.804227] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-03T19:36:49.144850] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-03T19:36:49.144974] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-03T19:36:49.146814] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-03T19:36:49.146903] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-03T19:36:49.148788] [DEBUG] [LOCAL ] INN: Trimmed 57866 records to 42281 (keeping 200 days of data) [2025-10-03T19:36:49.499776] [DEBUG] [LOCAL ] INN: Primary data saved (42281 records). [2025-10-03T19:36:49.499932] [INFO ] [MAIN ] INN: Full history saved. [2025-10-03T19:36:49.500054] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INN took 32.9s. Estimated remaining: 2h 56m 44s. Rate: 7.1 symbols/min [2025-10-03T19:36:49.593335] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-03T19:36:49.711667] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:49.747225] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:36:49.784798] [DEBUG] [LOCAL ] INVX: Loaded 29238 existing records from primary storage. [2025-10-03T19:36:49.785099] [INFO ] [MAIN ] INVX: Loaded 29238 existing records. [2025-10-03T19:36:49.977977] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:49.978363] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-03T19:36:49.978470] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-03T19:36:49.979739] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-03T19:36:49.979802] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-03T19:36:50.207266] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T19:36:50.398605] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-03T19:36:50.430806] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:50.938195] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:36:51.190709] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-03T19:36:51.990635] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-03T19:36:52.182100] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:36:52.707823] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:36:52.790614] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-03T19:36:53.262890] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T19:36:53.590730] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-03T19:36:54.390708] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-03T19:36:54.505102] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:36:55.017978] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:36:55.190700] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-03T19:36:55.931967] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:36:55.990719] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-03T19:36:56.552804] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:36:56.790725] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-03T19:36:57.596099] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-03T19:36:57.607849] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:36:58.175128] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:36:58.390711] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-03T19:36:59.190729] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-03T19:36:59.348992] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:36:59.418594] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:36:59.990699] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-03T19:37:00.674822] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:37:00.790694] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-03T19:37:01.279612] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T19:37:01.590681] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-03T19:37:02.306114] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:37:02.390689] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-03T19:37:03.130717] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:37:03.133108] [INFO ] [REMOTE ] INSP: Full fetch complete (53143 records). [2025-10-03T19:37:03.133252] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-03T19:37:03.195788] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-03T19:37:03.555794] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-03T19:37:03.555907] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-03T19:37:03.556842] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-03T19:37:03.556909] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-03T19:37:03.558385] [DEBUG] [LOCAL ] INSP: Trimmed 53143 records to 37804 (keeping 200 days of data) [2025-10-03T19:37:03.804908] [DEBUG] [LOCAL ] INSP: Primary data saved (37804 records). [2025-10-03T19:37:03.805064] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-03T19:37:03.805166] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INSP took 37.2s. Estimated remaining: 2h 56m 42s. Rate: 7.1 symbols/min [2025-10-03T19:37:03.984608] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:03.990672] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-03T19:37:04.042920] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-03T19:37:04.043268] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-03T19:37:04.239073] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:04.239401] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-03T19:37:04.239468] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-03T19:37:04.240171] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-03T19:37:04.240296] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-03T19:37:04.395466] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:37:04.657688] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:37:04.706737] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:04.790668] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-03T19:37:05.520027] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:37:05.590731] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-03T19:37:06.390718] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-03T19:37:06.536927] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:37:06.807769] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:37:06.809795] [INFO ] [REMOTE ] INSW: Full fetch complete (60390 records). [2025-10-03T19:37:06.809901] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-03T19:37:07.195967] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-03T19:37:07.243588] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-03T19:37:07.243698] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-03T19:37:07.244609] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-03T19:37:07.244702] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-03T19:37:07.246063] [DEBUG] [LOCAL ] INSW: Trimmed 60390 records to 40456 (keeping 200 days of data) [2025-10-03T19:37:07.502422] [DEBUG] [LOCAL ] INSW: Primary data saved (40456 records). [2025-10-03T19:37:07.502554] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-03T19:37:07.504920] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INSW took 36.2s. Estimated remaining: 2h 56m 28s. Rate: 7.1 symbols/min [2025-10-03T19:37:07.696750] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:07.757306] [DEBUG] [LOCAL ] IOT: Loaded 53861 existing records from primary storage. [2025-10-03T19:37:07.757664] [INFO ] [MAIN ] IOT: Loaded 53861 existing records. [2025-10-03T19:37:07.938313] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:37:07.990258] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:07.990700] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-03T19:37:07.991049] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-03T19:37:07.991950] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-03T19:37:07.992622] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-03T19:37:07.992725] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-03T19:37:08.381973] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:08.790731] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-03T19:37:09.071156] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T19:37:09.140779] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T19:37:09.590701] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-03T19:37:10.390724] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-03T19:37:10.879583] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:37:11.190695] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-03T19:37:11.548676] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-03T19:37:11.990634] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-03T19:37:12.309735] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:37:12.576783] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T19:37:12.790714] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-03T19:37:13.590708] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-03T19:37:14.390626] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-03T19:37:14.472475] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-03T19:37:14.527863] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:37:14.903261] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:37:15.190708] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-03T19:37:15.706542] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:37:15.709436] [INFO ] [REMOTE ] INVH: Full fetch complete (76722 records). [2025-10-03T19:37:15.709575] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-03T19:37:15.996938] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-03T19:37:16.150492] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-03T19:37:16.150599] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-03T19:37:16.151865] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-03T19:37:16.151936] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-03T19:37:16.153570] [DEBUG] [LOCAL ] INVH: Trimmed 76722 records to 53907 (keeping 200 days of data) [2025-10-03T19:37:16.403368] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:37:16.532533] [DEBUG] [LOCAL ] INVH: Primary data saved (53907 records). [2025-10-03T19:37:16.532709] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-03T19:37:16.532808] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVH took 38.9s. Estimated remaining: 2h 56m 20s. Rate: 7.1 symbols/min [2025-10-03T19:37:16.790675] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-03T19:37:17.590684] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-03T19:37:17.792159] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T19:37:17.793969] [INFO ] [REMOTE ] INVX: Full fetch complete (43981 records). [2025-10-03T19:37:17.794070] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-03T19:37:18.193530] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-03T19:37:18.193865] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-03T19:37:18.194919] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-03T19:37:18.194997] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-03T19:37:18.198100] [DEBUG] [LOCAL ] INVX: Trimmed 43981 records to 29430 (keeping 200 days of data) [2025-10-03T19:37:18.380699] [DEBUG] [LOCAL ] INVX: Primary data saved (29430 records). [2025-10-03T19:37:18.380843] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-03T19:37:18.380993] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INVX took 28.9s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-03T19:37:18.450374] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-03T19:37:18.461822] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-03T19:37:19.263181] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:37:19.273869] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-03T19:37:21.227282] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-03T19:37:21.240587] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-03T19:37:21.309273] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T19:37:21.321439] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-03T19:37:23.197134] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:37:23.209766] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-03T19:37:24.010152] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-03T19:37:24.022109] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-03T19:37:25.113991] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:37:25.126875] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-03T19:37:26.794596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-03T19:37:26.806841] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-03T19:37:26.939568] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T19:37:26.952098] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-03T19:37:28.939835] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:37:28.952935] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-03T19:37:29.412695] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-03T19:37:29.425592] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-03T19:37:30.624205] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:37:30.637940] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-03T19:37:32.399493] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-03T19:37:32.412944] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-03T19:37:32.601485] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T19:37:32.614339] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-03T19:37:34.330318] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T19:37:34.333265] [INFO ] [REMOTE ] IOT: Full fetch complete (77385 records). [2025-10-03T19:37:34.333390] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-03T19:37:34.745071] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-03T19:37:34.745215] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-03T19:37:34.746830] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-03T19:37:34.746971] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-03T19:37:34.749436] [DEBUG] [LOCAL ] IOT: Trimmed 77385 records to 54251 (keeping 200 days of data) [2025-10-03T19:37:34.876366] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-03T19:37:34.901863] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-03T19:37:35.143027] [DEBUG] [LOCAL ] IOT: Primary data saved (54251 records). [2025-10-03T19:37:35.143261] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-03T19:37:35.144107] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IOT took 27.6s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-03T19:37:37.701095] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-03T19:37:37.714718] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-03T19:37:40.271369] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-03T19:37:40.274538] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-03T19:37:40.274930] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-03T19:37:40.706551] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-03T19:37:40.706702] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-03T19:37:40.708006] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-03T19:37:40.708076] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-03T19:37:40.710176] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-03T19:37:41.149398] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-03T19:37:41.149570] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-03T19:37:41.149686] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IONQ took 37.3s. Estimated remaining: 2h 55m 54s. Rate: 7.1 symbols/min [2025-10-03T19:37:42.107775] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.130987] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.134975] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.129887] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.160950] [DEBUG] [LOCAL ] IQI: Loaded 18227 existing records from primary storage. [2025-10-03T19:37:42.166268] [INFO ] [MAIN ] IQI: Loaded 18227 existing records. [2025-10-03T19:37:42.312163] [DEBUG] [LOCAL ] IPI: Loaded 21605 existing records from primary storage. [2025-10-03T19:37:42.339238] [INFO ] [MAIN ] IPI: Loaded 21605 existing records. [2025-10-03T19:37:42.437090] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:42.519472] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-03T19:37:42.533863] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-03T19:37:42.519092] [DEBUG] [LOCAL ] IPG: Loaded 53719 existing records from primary storage. [2025-10-03T19:37:42.535367] [INFO ] [MAIN ] IPG: Loaded 53719 existing records. [2025-10-03T19:37:42.540557] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-03T19:37:42.590977] [DEBUG] [LOCAL ] IP: Loaded 53702 existing records from primary storage. [2025-10-03T19:37:42.607482] [INFO ] [MAIN ] IP: Loaded 53702 existing records. [2025-10-03T19:37:42.607370] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-03T19:37:42.881538] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:42.959531] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-03T19:37:42.992998] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-03T19:37:43.077692] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-03T19:37:43.175160] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:43.170951] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-03T19:37:43.228360] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-03T19:37:43.213750] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:43.252148] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-03T19:37:43.279044] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-03T19:37:43.340694] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-03T19:37:43.397436] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-03T19:37:43.377502] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-03T19:37:43.428716] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-03T19:37:43.434022] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-03T19:37:43.930838] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.038342] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-03T19:37:44.341760] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.374289] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-03T19:37:44.644746] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.646818] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-03T19:37:44.671118] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.671767] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-03T19:37:45.373836] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:37:45.379168] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-03T19:37:45.447510] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:37:45.451443] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-03T19:37:46.370734] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:37:46.375925] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-03T19:37:46.447528] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:37:46.480504] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-03T19:37:46.484777] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:37:46.496685] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-03T19:37:46.568879] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:37:46.580019] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-03T19:37:47.158432] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T19:37:47.163718] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-03T19:37:47.441923] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:37:47.446207] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-03T19:37:47.870948] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:37:47.882296] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-03T19:37:47.995629] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:37:48.007066] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-03T19:37:48.179806] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:37:48.183908] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-03T19:37:48.701987] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T19:37:48.707561] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-03T19:37:49.006076] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:37:49.011703] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-03T19:37:49.363631] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:37:49.375249] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-03T19:37:49.587945] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T19:37:49.592952] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-03T19:37:49.916925] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T19:37:49.929005] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-03T19:37:49.953270] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T19:37:49.960326] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-03T19:37:50.558437] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:37:50.562714] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-03T19:37:50.786703] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:37:50.817120] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-03T19:37:50.819856] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T19:37:50.826480] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-03T19:37:51.629495] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T19:37:51.634631] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-03T19:37:51.727692] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T19:37:51.740539] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-03T19:37:51.831874] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T19:37:51.990694] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-03T19:37:52.413219] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:37:52.508483] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:37:52.790711] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-03T19:37:53.037344] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:37:53.367196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:37:53.590726] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-03T19:37:54.390719] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-03T19:37:54.737141] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:37:54.946532] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:37:55.190724] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-03T19:37:55.963196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:37:55.990628] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-03T19:37:56.790711] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-03T19:37:56.962685] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:37:57.590716] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-03T19:37:57.875846] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:37:57.949839] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:37:58.390709] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-03T19:37:58.730753] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T19:37:59.190723] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-03T19:37:59.990741] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-03T19:38:00.295888] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:38:00.297486] [INFO ] [REMOTE ] IQI: Full fetch complete (27020 records). [2025-10-03T19:38:00.297594] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-03T19:38:00.657748] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T19:38:00.765939] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-03T19:38:00.766026] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-03T19:38:00.766673] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-03T19:38:00.766740] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-03T19:38:00.767504] [DEBUG] [LOCAL ] IQI: Trimmed 27020 records to 18347 (keeping 200 days of data) [2025-10-03T19:38:00.825004] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-03T19:38:00.898139] [DEBUG] [LOCAL ] IQI: Primary data saved (18347 records). [2025-10-03T19:38:00.898350] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-03T19:38:00.898454] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IQI took 19.7s. Estimated remaining: 2h 55m 58s. Rate: 7.1 symbols/min [2025-10-03T19:38:01.093756] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:01.130093] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:38:01.132807] [INFO ] [REMOTE ] IPI: Full fetch complete (29429 records). [2025-10-03T19:38:01.132928] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-03T19:38:01.265798] [DEBUG] [LOCAL ] IQV: Loaded 50465 existing records from primary storage. [2025-10-03T19:38:01.281619] [INFO ] [MAIN ] IQV: Loaded 50465 existing records. [2025-10-03T19:38:01.599768] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-03T19:38:01.697492] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:01.739813] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-03T19:38:01.768732] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-03T19:38:01.783683] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-03T19:38:01.783798] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-03T19:38:01.784535] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-03T19:38:01.784588] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-03T19:38:01.785198] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-03T19:38:01.785448] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-03T19:38:01.852572] [DEBUG] [LOCAL ] IPI: Trimmed 29429 records to 21849 (keeping 200 days of data) [2025-10-03T19:38:02.297041] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:02.340874] [DEBUG] [LOCAL ] IPI: Primary data saved (21849 records). [2025-10-03T19:38:02.341040] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-03T19:38:02.341142] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IPI took 21.2s. Estimated remaining: 2h 55m 42s. Rate: 7.1 symbols/min [2025-10-03T19:38:02.414593] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-03T19:38:02.544260] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:02.581537] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:38:02.645515] [DEBUG] [LOCAL ] IR: Loaded 53077 existing records from primary storage. [2025-10-03T19:38:02.645977] [INFO ] [MAIN ] IR: Loaded 53077 existing records. [2025-10-03T19:38:02.826113] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:02.826397] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-03T19:38:02.826451] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-03T19:38:02.828118] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-03T19:38:02.828183] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-03T19:38:03.202297] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-03T19:38:03.226772] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:03.531702] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:38:03.750757] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:38:03.990733] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-03T19:38:04.790693] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-03T19:38:05.014513] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:38:05.525870] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:38:05.590630] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-03T19:38:06.396403] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-03T19:38:06.402685] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:38:07.190637] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-03T19:38:07.405019] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T19:38:07.407921] [INFO ] [REMOTE ] IP: Full fetch complete (77111 records). [2025-10-03T19:38:07.408043] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-03T19:38:07.868392] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-03T19:38:07.868599] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-03T19:38:07.870041] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-03T19:38:07.870200] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-03T19:38:07.874501] [DEBUG] [LOCAL ] IP: Trimmed 77111 records to 54091 (keeping 200 days of data) [2025-10-03T19:38:07.990687] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-03T19:38:08.145419] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:38:08.278620] [DEBUG] [LOCAL ] IP: Primary data saved (54091 records). [2025-10-03T19:38:08.278835] [INFO ] [MAIN ] IP: Full history saved. [2025-10-03T19:38:08.278993] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IP took 27.1s. Estimated remaining: 2h 55m 31s. Rate: 7.1 symbols/min [2025-10-03T19:38:08.478625] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:08.534299] [DEBUG] [LOCAL ] IRM: Loaded 49653 existing records from primary storage. [2025-10-03T19:38:08.534830] [INFO ] [MAIN ] IRM: Loaded 49653 existing records. [2025-10-03T19:38:08.763900] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:08.764153] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-03T19:38:08.764455] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-03T19:38:08.764999] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-03T19:38:08.765066] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-03T19:38:08.802724] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-03T19:38:08.974188] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:38:09.216087] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:09.590707] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-03T19:38:09.816446] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T19:38:10.390659] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-03T19:38:10.589378] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:38:11.190719] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-03T19:38:11.471510] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:38:11.990709] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-03T19:38:12.075162] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:38:12.596508] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:38:12.790685] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-03T19:38:13.590634] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-03T19:38:13.839713] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:38:14.390686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-03T19:38:14.507738] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T19:38:15.135704] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:38:15.190670] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-03T19:38:15.990745] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-03T19:38:16.597309] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T19:38:16.790741] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-03T19:38:17.053748] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:38:17.391005] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:38:17.590693] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-03T19:38:18.390709] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-03T19:38:18.568169] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T19:38:19.190734] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-03T19:38:19.599493] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:38:19.923982] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T19:38:19.927283] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-03T19:38:19.927528] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-03T19:38:20.002582] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-03T19:38:20.395719] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-03T19:38:20.395828] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-03T19:38:20.397080] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-03T19:38:20.397174] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-03T19:38:20.399470] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 54109 (keeping 200 days of data) [2025-10-03T19:38:20.780103] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:38:20.795409] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-03T19:38:20.822267] [DEBUG] [LOCAL ] IPG: Primary data saved (54109 records). [2025-10-03T19:38:20.822795] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-03T19:38:20.822938] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IPG took 39.7s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-03T19:38:21.014887] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:21.036504] [DEBUG] [LOCAL ] IRS: Loaded 22194 existing records from primary storage. [2025-10-03T19:38:21.036793] [INFO ] [MAIN ] IRS: Loaded 22194 existing records. [2025-10-03T19:38:21.241894] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:21.242211] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-03T19:38:21.242268] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-03T19:38:21.242906] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-03T19:38:21.242979] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-03T19:38:21.595770] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-03T19:38:21.656343] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:21.810866] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:38:22.390630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-03T19:38:22.745742] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:38:23.190630] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-03T19:38:23.266758] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T19:38:23.295099] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T19:38:23.990716] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-03T19:38:24.790688] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-03T19:38:25.036343] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T19:38:25.590724] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-03T19:38:25.708297] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:38:26.071086] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T19:38:26.390673] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-03T19:38:27.000019] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:38:27.190750] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-03T19:38:27.404768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:38:27.990725] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-03T19:38:28.798968] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-03T19:38:28.805324] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T19:38:29.590733] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-03T19:38:29.648892] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T19:38:30.299506] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:38:30.390715] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-03T19:38:31.154983] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:38:31.158296] [INFO ] [REMOTE ] IQV: Full fetch complete (72215 records). [2025-10-03T19:38:31.158492] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-03T19:38:31.195826] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-03T19:38:31.596413] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-03T19:38:31.596500] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-03T19:38:31.597678] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-03T19:38:31.597789] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-03T19:38:31.599374] [DEBUG] [LOCAL ] IQV: Trimmed 72215 records to 50838 (keeping 200 days of data) [2025-10-03T19:38:31.925220] [DEBUG] [LOCAL ] IQV: Primary data saved (50838 records). [2025-10-03T19:38:31.925391] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-03T19:38:31.925499] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IQV took 31.0s. Estimated remaining: 2h 55m 21s. Rate: 7.1 symbols/min [2025-10-03T19:38:31.998194] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-03T19:38:32.138525] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:32.198160] [DEBUG] [LOCAL ] IRT: Loaded 50773 existing records from primary storage. [2025-10-03T19:38:32.198572] [INFO ] [MAIN ] IRT: Loaded 50773 existing records. [2025-10-03T19:38:32.370896] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T19:38:32.455401] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:32.455734] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-03T19:38:32.455801] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-03T19:38:32.456728] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-03T19:38:32.456810] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-03T19:38:32.794016] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-03T19:38:32.862288] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:32.966850] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:38:33.050238] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:38:33.590740] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-03T19:38:34.345603] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:38:34.348421] [INFO ] [REMOTE ] IR: Full fetch complete (76215 records). [2025-10-03T19:38:34.348563] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-03T19:38:34.396058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-03T19:38:34.839530] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-03T19:38:34.839740] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-03T19:38:34.840854] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-03T19:38:34.841045] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-03T19:38:34.842759] [DEBUG] [LOCAL ] IR: Trimmed 76215 records to 53466 (keeping 200 days of data) [2025-10-03T19:38:34.988028] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:38:35.206018] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-03T19:38:35.233795] [DEBUG] [LOCAL ] IR: Primary data saved (53466 records). [2025-10-03T19:38:35.233947] [INFO ] [MAIN ] IR: Full history saved. [2025-10-03T19:38:35.234529] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IR took 32.9s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-03T19:38:35.424479] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:35.446528] [DEBUG] [LOCAL ] ISD: Loaded 15710 existing records from primary storage. [2025-10-03T19:38:35.446823] [INFO ] [MAIN ] ISD: Loaded 15710 existing records. [2025-10-03T19:38:35.635176] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:35.635412] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-03T19:38:35.635493] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-03T19:38:35.635841] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-03T19:38:35.635901] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-03T19:38:35.995676] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-03T19:38:36.026639] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:36.245275] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:38:36.741031] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T19:38:36.796951] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-03T19:38:36.819310] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:38:37.590692] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-03T19:38:38.390668] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-03T19:38:38.738639] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:38:39.197192] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-03T19:38:39.229450] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:38:39.516959] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T19:38:39.990690] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-03T19:38:40.647734] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:38:40.650355] [INFO ] [REMOTE ] IRM: Full fetch complete (72294 records). [2025-10-03T19:38:40.650476] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-03T19:38:40.793325] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-03T19:38:40.896212] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:38:41.106881] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-03T19:38:41.106995] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-03T19:38:41.108029] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-03T19:38:41.108097] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-03T19:38:41.109709] [DEBUG] [LOCAL ] IRM: Trimmed 72294 records to 50029 (keeping 200 days of data) [2025-10-03T19:38:41.435904] [DEBUG] [LOCAL ] IRM: Primary data saved (50029 records). [2025-10-03T19:38:41.436056] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-03T19:38:41.436161] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRM took 33.2s. Estimated remaining: 2h 54m 56s. Rate: 7.1 symbols/min [2025-10-03T19:38:41.595685] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-03T19:38:41.621897] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:41.665897] [DEBUG] [LOCAL ] IT: Loaded 42328 existing records from primary storage. [2025-10-03T19:38:41.666215] [INFO ] [MAIN ] IT: Loaded 42328 existing records. [2025-10-03T19:38:41.861240] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:41.861749] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-03T19:38:41.861895] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-03T19:38:41.862454] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-03T19:38:41.862522] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-03T19:38:41.986947] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:38:42.302666] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:42.390706] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-03T19:38:42.656022] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T19:38:43.190711] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-03T19:38:43.990669] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-03T19:38:44.220121] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:38:44.549350] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:38:44.717467] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T19:38:44.790713] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-03T19:38:45.590701] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-03T19:38:46.133680] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T19:38:46.390681] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-03T19:38:46.628768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:38:47.190684] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-03T19:38:47.990708] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-03T19:38:48.269863] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:38:48.626226] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:38:48.627963] [INFO ] [REMOTE ] IRS: Full fetch complete (32268 records). [2025-10-03T19:38:48.628045] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-03T19:38:48.791539] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-03T19:38:49.029700] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-03T19:38:49.029919] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-03T19:38:49.030785] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-03T19:38:49.031017] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-03T19:38:49.032195] [DEBUG] [LOCAL ] IRS: Trimmed 32268 records to 22375 (keeping 200 days of data) [2025-10-03T19:38:49.140024] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:38:49.195513] [DEBUG] [LOCAL ] IRS: Primary data saved (22375 records). [2025-10-03T19:38:49.195664] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-03T19:38:49.195766] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IRS took 28.4s. Estimated remaining: 2h 54m 47s. Rate: 7.1 symbols/min [2025-10-03T19:38:49.381435] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:49.413246] [DEBUG] [LOCAL ] ITGR: Loaded 31551 existing records from primary storage. [2025-10-03T19:38:49.413543] [INFO ] [MAIN ] ITGR: Loaded 31551 existing records. [2025-10-03T19:38:49.591684] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-03T19:38:49.618782] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:49.619041] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-03T19:38:49.619117] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-03T19:38:49.621104] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-03T19:38:49.621187] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-03T19:38:50.048556] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:50.390690] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-03T19:38:50.494303] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:38:50.712976] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:38:51.190733] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-03T19:38:51.720352] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T19:38:51.990688] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-03T19:38:52.758775] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:38:52.790701] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-03T19:38:53.463966] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:38:53.590722] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-03T19:38:53.851007] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:38:54.390674] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-03T19:38:54.778620] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T19:38:55.190682] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-03T19:38:55.990639] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-03T19:38:56.046457] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T19:38:56.122115] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:38:56.790685] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-03T19:38:57.587923] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:38:57.595693] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-03T19:38:57.733497] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T19:38:58.390688] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-03T19:38:59.177319] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:38:59.190613] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-03T19:38:59.332714] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T19:38:59.990626] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-03T19:39:00.520932] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T19:39:00.790727] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-03T19:39:01.412212] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:39:01.590705] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-03T19:39:01.954175] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T19:39:01.957819] [INFO ] [REMOTE ] IRT: Full fetch complete (72652 records). [2025-10-03T19:39:01.958028] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-03T19:39:02.386037] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-03T19:39:02.386128] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-03T19:39:02.387116] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-03T19:39:02.387183] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-03T19:39:02.388715] [DEBUG] [LOCAL ] IRT: Trimmed 72652 records to 51140 (keeping 200 days of data) [2025-10-03T19:39:02.442545] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-03T19:39:02.721359] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:39:02.746445] [DEBUG] [LOCAL ] IRT: Primary data saved (51140 records). [2025-10-03T19:39:02.746605] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-03T19:39:02.746783] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IRT took 30.8s. Estimated remaining: 2h 54m 44s. Rate: 7.1 symbols/min [2025-10-03T19:39:02.945466] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:02.987299] [DEBUG] [LOCAL ] ITT: Loaded 32995 existing records from primary storage. [2025-10-03T19:39:02.987605] [INFO ] [MAIN ] ITT: Loaded 32995 existing records. [2025-10-03T19:39:03.191173] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:03.191343] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-03T19:39:03.193113] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-03T19:39:03.193199] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-03T19:39:03.193934] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-03T19:39:03.194002] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-03T19:39:03.574230] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:03.990738] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-03T19:39:04.347177] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T19:39:04.387486] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:39:04.790685] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-03T19:39:05.479736] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:39:05.590695] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-03T19:39:06.390628] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-03T19:39:06.584329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:39:06.627672] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:39:07.190818] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-03T19:39:07.684369] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:39:07.990740] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-03T19:39:08.790684] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-03T19:39:08.919498] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:39:09.352068] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:39:09.590682] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-03T19:39:09.830746] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T19:39:10.390682] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-03T19:39:11.156940] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:39:11.190705] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-03T19:39:11.246576] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:39:11.990726] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-03T19:39:12.614084] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T19:39:12.790693] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-03T19:39:13.590725] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-03T19:39:13.768538] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:39:13.771483] [INFO ] [REMOTE ] IT: Full fetch complete (56368 records). [2025-10-03T19:39:13.771625] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-03T19:39:14.212349] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-03T19:39:14.212603] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-03T19:39:14.213826] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-03T19:39:14.213915] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-03T19:39:14.215818] [DEBUG] [LOCAL ] IT: Trimmed 56368 records to 42648 (keeping 200 days of data) [2025-10-03T19:39:14.249993] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:39:14.442354] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-03T19:39:14.546717] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T19:39:14.554732] [DEBUG] [LOCAL ] IT: Primary data saved (42648 records). [2025-10-03T19:39:14.554907] [INFO ] [MAIN ] IT: Full history saved. [2025-10-03T19:39:14.555024] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. IT took 33.1s. Estimated remaining: 2h 54m 40s. Rate: 7.1 symbols/min [2025-10-03T19:39:14.752486] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:14.810096] [DEBUG] [LOCAL ] ITUB: Loaded 53711 existing records from primary storage. [2025-10-03T19:39:14.810474] [INFO ] [MAIN ] ITUB: Loaded 53711 existing records. [2025-10-03T19:39:15.011104] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:15.011366] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-03T19:39:15.011455] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-03T19:39:15.012007] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-03T19:39:15.012068] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-03T19:39:15.197166] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-03T19:39:15.435865] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:15.990735] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-03T19:39:16.174963] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:39:16.179682] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:39:16.187758] [INFO ] [REMOTE ] ISD: Full fetch complete (24078 records). [2025-10-03T19:39:16.188529] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-03T19:39:16.586211] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-03T19:39:16.586318] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-03T19:39:16.587180] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-03T19:39:16.587247] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-03T19:39:16.588038] [DEBUG] [LOCAL ] ISD: Trimmed 24078 records to 15880 (keeping 200 days of data) [2025-10-03T19:39:16.693054] [DEBUG] [LOCAL ] ISD: Primary data saved (15880 records). [2025-10-03T19:39:16.693257] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-03T19:39:16.693379] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. ISD took 41.5s. Estimated remaining: 2h 54m 24s. Rate: 7.1 symbols/min [2025-10-03T19:39:16.797516] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-03T19:39:16.879244] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:16.937168] [DEBUG] [LOCAL ] ITW: Loaded 46101 existing records from primary storage. [2025-10-03T19:39:16.937594] [INFO ] [MAIN ] ITW: Loaded 46101 existing records. [2025-10-03T19:39:17.122785] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:17.123126] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-03T19:39:17.123186] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-03T19:39:17.123754] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-03T19:39:17.123814] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-03T19:39:17.503142] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:17.590682] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-03T19:39:17.816360] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:39:18.390687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-03T19:39:18.534696] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:39:18.917298] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:39:19.190694] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-03T19:39:19.990692] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-03T19:39:20.203462] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T19:39:20.426272] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T19:39:20.790738] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-03T19:39:21.590721] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-03T19:39:21.638216] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:39:22.390688] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-03T19:39:22.678959] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T19:39:23.032825] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T19:39:23.190709] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-03T19:39:23.730674] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:39:23.990711] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-03T19:39:24.585760] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:39:24.790678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-03T19:39:25.245094] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T19:39:25.590622] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-03T19:39:25.750430] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T19:39:26.390688] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-03T19:39:26.889965] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:39:27.190717] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-03T19:39:27.301852] [DEBUG] [REMOTE ] ITUB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-03T19:39:27.302204] [WARN ] [REMOTE ] ITUB: No data returned for month 2025-04 [2025-10-03T19:39:27.302300] [FATAL] [REMOTE ] ITUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:39:27.302386] [FATAL] [MAIN ] ITUB: Failed to fetch primary data. [2025-10-03T19:39:27.302454] [WARN ] [MAIN ] ITUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:39:27.302530] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-03T19:39:27.302597] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-10-03T19:39:27.302665] [INFO ] [LOCAL ] ITUB: Starting deletion of derivative data. [2025-10-03T19:39:27.303310] [DEBUG] [LOCAL ] ITUB: Deleted derivative data file. [2025-10-03T19:39:27.303400] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. ITUB took 12.7s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-10-03T19:39:27.425673] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:39:27.448733] [INFO ] [REMOTE ] ITGR: Full fetch complete (41893 records). [2025-10-03T19:39:27.478092] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-03T19:39:27.504585] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:27.885851] [DEBUG] [LOCAL ] IVR: Loaded 48258 existing records from primary storage. [2025-10-03T19:39:27.917485] [INFO ] [MAIN ] IVR: Loaded 48258 existing records. [2025-10-03T19:39:27.995739] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-03T19:39:28.003343] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-03T19:39:28.003473] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-03T19:39:28.023559] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-03T19:39:28.030537] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-03T19:39:28.089049] [DEBUG] [LOCAL ] ITGR: Trimmed 41893 records to 31755 (keeping 200 days of data) [2025-10-03T19:39:28.243146] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:28.249362] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-03T19:39:28.253788] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-03T19:39:28.256364] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-03T19:39:28.256434] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-03T19:39:28.738450] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:28.752466] [DEBUG] [LOCAL ] ITGR: Primary data saved (31755 records). [2025-10-03T19:39:28.752634] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-03T19:39:28.752788] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITGR took 39.6s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-10-03T19:39:28.798787] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-03T19:39:28.940936] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:28.974591] [DEBUG] [LOCAL ] IVT: Loaded 30940 existing records from primary storage. [2025-10-03T19:39:28.974913] [INFO ] [MAIN ] IVT: Loaded 30940 existing records. [2025-10-03T19:39:29.166033] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:29.166256] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-03T19:39:29.166306] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-03T19:39:29.166519] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-03T19:39:29.166579] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-03T19:39:29.569521] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:39:29.587431] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:29.590611] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-03T19:39:30.390690] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-03T19:39:30.443535] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:39:30.505323] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T19:39:31.190732] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-03T19:39:31.791740] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:39:31.990706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-03T19:39:32.319410] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:39:32.321259] [INFO ] [REMOTE ] ITT: Full fetch complete (47010 records). [2025-10-03T19:39:32.321372] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-03T19:39:32.721555] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-03T19:39:32.721638] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-03T19:39:32.722438] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-03T19:39:32.722484] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-03T19:39:32.723546] [DEBUG] [LOCAL ] ITT: Trimmed 47010 records to 33181 (keeping 200 days of data) [2025-10-03T19:39:32.812522] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-03T19:39:32.938364] [DEBUG] [LOCAL ] ITT: Primary data saved (33181 records). [2025-10-03T19:39:32.938537] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-03T19:39:32.938662] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. ITT took 30.2s. Estimated remaining: 2h 53m 49s. Rate: 7.1 symbols/min [2025-10-03T19:39:33.115056] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:33.167994] [DEBUG] [LOCAL ] IVZ: Loaded 53517 existing records from primary storage. [2025-10-03T19:39:33.168391] [INFO ] [MAIN ] IVZ: Loaded 53517 existing records. [2025-10-03T19:39:33.356220] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:33.356499] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-03T19:39:33.356551] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-03T19:39:33.356911] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-03T19:39:33.356975] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-03T19:39:33.599366] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-03T19:39:33.743772] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:33.775439] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T19:39:34.070507] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:39:34.390691] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-03T19:39:34.567833] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T19:39:35.190724] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-03T19:39:35.929275] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:39:35.990706] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-03T19:39:36.790636] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-03T19:39:36.879873] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:39:37.590732] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-03T19:39:37.648526] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:39:38.066080] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:39:38.390696] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-03T19:39:38.927258] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T19:39:39.190714] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-03T19:39:39.990690] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-03T19:39:40.030911] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:39:40.790682] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-03T19:39:41.142861] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:39:41.590668] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-03T19:39:41.687935] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:39:42.390691] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-03T19:39:42.845711] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:39:43.147345] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:39:43.190735] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-03T19:39:43.990679] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-03T19:39:44.277080] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:39:44.790634] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-03T19:39:44.917610] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:39:45.590698] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-03T19:39:45.714578] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:39:46.390629] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-03T19:39:46.470606] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:39:47.190709] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-03T19:39:47.693748] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T19:39:47.970707] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:39:47.990683] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-03T19:39:48.790685] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-03T19:39:49.097883] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T19:39:49.590722] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-03T19:39:49.733690] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:39:50.390633] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-03T19:39:50.512694] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:39:51.072358] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T19:39:51.190746] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-03T19:39:51.990673] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-03T19:39:52.057057] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:39:52.568384] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:39:52.790697] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-03T19:39:53.516511] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:39:53.590689] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-03T19:39:54.085195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:39:54.390727] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-03T19:39:55.190700] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-03T19:39:55.235941] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:39:55.294738] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T19:39:55.990697] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-03T19:39:56.790706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-03T19:39:57.157186] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T19:39:57.535235] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:39:57.590681] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-03T19:39:58.400862] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-03T19:39:58.409629] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:39:58.961149] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T19:39:59.190699] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-03T19:39:59.635851] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T19:39:59.990735] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-03T19:40:00.790677] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-03T19:40:01.020775] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:40:01.590470] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:40:01.592421] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-03T19:40:01.594402] [INFO ] [REMOTE ] ITW: Full fetch complete (66426 records). [2025-10-03T19:40:01.594569] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-03T19:40:02.033907] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-03T19:40:02.034029] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-03T19:40:02.035280] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-03T19:40:02.035404] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-03T19:40:02.037246] [DEBUG] [LOCAL ] ITW: Trimmed 66426 records to 46423 (keeping 200 days of data) [2025-10-03T19:40:02.210965] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:40:02.404107] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-03T19:40:02.432638] [DEBUG] [LOCAL ] ITW: Primary data saved (46423 records). [2025-10-03T19:40:02.432846] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-03T19:40:02.433903] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 45.7s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-03T19:40:02.623136] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:02.651075] [DEBUG] [LOCAL ] IX: Loaded 22607 existing records from primary storage. [2025-10-03T19:40:02.651349] [INFO ] [MAIN ] IX: Loaded 22607 existing records. [2025-10-03T19:40:02.854516] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:02.854799] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-03T19:40:02.854864] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-03T19:40:02.855193] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-03T19:40:02.855253] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-03T19:40:03.200979] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-03T19:40:03.245716] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:03.376875] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:40:03.382796] [INFO ] [REMOTE ] IVZ: Full fetch complete (76804 records). [2025-10-03T19:40:03.383009] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-03T19:40:03.834586] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-03T19:40:03.834713] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-03T19:40:03.835851] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-03T19:40:03.835923] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-03T19:40:03.837888] [DEBUG] [LOCAL ] IVZ: Trimmed 76804 records to 53906 (keeping 200 days of data) [2025-10-03T19:40:04.038540] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-03T19:40:04.202854] [DEBUG] [LOCAL ] IVZ: Primary data saved (53906 records). [2025-10-03T19:40:04.203012] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-03T19:40:04.203120] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. IVZ took 31.3s. Estimated remaining: 2h 53m 48s. Rate: 7.1 symbols/min [2025-10-03T19:40:04.418755] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:40:04.423172] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:04.427255] [INFO ] [REMOTE ] IVT: Full fetch complete (45492 records). [2025-10-03T19:40:04.427773] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-03T19:40:04.585297] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T19:40:04.796742] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-03T19:40:04.823568] [DEBUG] [LOCAL ] J: Loaded 40454 existing records from primary storage. [2025-10-03T19:40:04.867370] [INFO ] [MAIN ] J: Loaded 40454 existing records. [2025-10-03T19:40:04.999938] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T19:40:05.263964] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-03T19:40:05.264064] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-03T19:40:05.265039] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-03T19:40:05.265130] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-03T19:40:05.263756] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:05.265502] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-03T19:40:05.265558] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-03T19:40:05.266167] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-03T19:40:05.266244] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-03T19:40:05.345813] [DEBUG] [LOCAL ] IVT: Trimmed 45492 records to 31154 (keeping 200 days of data) [2025-10-03T19:40:05.595219] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-03T19:40:05.774333] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:05.876822] [DEBUG] [LOCAL ] IVT: Primary data saved (31154 records). [2025-10-03T19:40:05.876976] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-03T19:40:05.877078] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 37.1s. Estimated remaining: 2h 53m 32s. Rate: 7.1 symbols/min [2025-10-03T19:40:06.058006] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:06.107745] [DEBUG] [LOCAL ] JBGS: Loaded 42686 existing records from primary storage. [2025-10-03T19:40:06.108058] [INFO ] [MAIN ] JBGS: Loaded 42686 existing records. [2025-10-03T19:40:06.300873] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:06.301105] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-03T19:40:06.301161] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-03T19:40:06.301492] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-03T19:40:06.301564] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-03T19:40:06.393132] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-03T19:40:06.426928] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:40:06.704963] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:06.803331] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T19:40:06.806233] [INFO ] [REMOTE ] IVR: Full fetch complete (69238 records). [2025-10-03T19:40:06.806365] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-03T19:40:07.205509] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-03T19:40:07.267810] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-03T19:40:07.267966] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-03T19:40:07.269122] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-03T19:40:07.269191] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-03T19:40:07.271075] [DEBUG] [LOCAL ] IVR: Trimmed 69238 records to 48643 (keeping 200 days of data) [2025-10-03T19:40:07.581820] [DEBUG] [LOCAL ] IVR: Primary data saved (48643 records). [2025-10-03T19:40:07.581975] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-03T19:40:07.582101] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. IVR took 40.3s. Estimated remaining: 2h 53m 16s. Rate: 7.1 symbols/min [2025-10-03T19:40:07.777408] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:07.822073] [DEBUG] [LOCAL ] JBI: Loaded 43831 existing records from primary storage. [2025-10-03T19:40:07.822416] [INFO ] [MAIN ] JBI: Loaded 43831 existing records. [2025-10-03T19:40:07.993511] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-03T19:40:08.017427] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:08.017926] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-03T19:40:08.018006] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-03T19:40:08.018619] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-03T19:40:08.018768] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-03T19:40:08.223830] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:40:08.449204] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:08.713419] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:40:08.790708] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-03T19:40:08.874627] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:40:09.590702] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-03T19:40:10.366708] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:40:10.390620] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-03T19:40:10.659221] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:40:11.190701] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-03T19:40:11.990638] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-03T19:40:12.099091] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:40:12.585513] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T19:40:12.790715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-03T19:40:13.312388] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T19:40:13.590712] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-03T19:40:14.379477] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:40:14.390616] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-03T19:40:14.892604] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:40:15.190677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-03T19:40:15.990701] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-03T19:40:16.055810] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:40:16.335511] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:40:16.790726] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-03T19:40:17.590745] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-03T19:40:17.705903] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:40:18.390682] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-03T19:40:18.426175] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:40:19.190625] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-03T19:40:19.230478] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:40:19.990747] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-03T19:40:20.269362] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:40:20.790723] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-03T19:40:20.996586] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T19:40:21.445791] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:40:21.590719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-03T19:40:21.924054] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:40:22.390717] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-03T19:40:22.993867] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:40:23.190713] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-03T19:40:23.226858] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:40:23.990707] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-03T19:40:24.693768] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:40:24.746857] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T19:40:24.790637] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-03T19:40:25.590731] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-03T19:40:25.911543] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:40:26.390721] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-03T19:40:27.033384] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:40:27.190743] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-03T19:40:27.900029] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:40:27.990708] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-03T19:40:28.790723] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-03T19:40:28.839367] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T19:40:28.840804] [INFO ] [REMOTE ] IX: Full fetch complete (27378 records). [2025-10-03T19:40:28.840906] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-03T19:40:29.061247] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:40:29.308297] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-03T19:40:29.308411] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-03T19:40:29.309091] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-03T19:40:29.309200] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-03T19:40:29.310033] [DEBUG] [LOCAL ] IX: Trimmed 27378 records to 22726 (keeping 200 days of data) [2025-10-03T19:40:29.448426] [DEBUG] [LOCAL ] IX: Primary data saved (22726 records). [2025-10-03T19:40:29.448572] [INFO ] [MAIN ] IX: Full history saved. [2025-10-03T19:40:29.448713] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IX took 27.0s. Estimated remaining: 2h 53m 22s. Rate: 7.1 symbols/min [2025-10-03T19:40:29.600938] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-03T19:40:29.637410] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:29.690451] [DEBUG] [LOCAL ] JBL: Loaded 48752 existing records from primary storage. [2025-10-03T19:40:29.690872] [INFO ] [MAIN ] JBL: Loaded 48752 existing records. [2025-10-03T19:40:29.898587] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:29.899001] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-03T19:40:29.899221] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-03T19:40:29.899543] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-03T19:40:29.899736] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-03T19:40:30.094101] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:40:30.330617] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:30.390683] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-03T19:40:31.190694] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-03T19:40:31.308316] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:40:31.889840] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:40:31.990719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-03T19:40:32.790708] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-03T19:40:32.994042] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:40:33.594684] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-03T19:40:33.600426] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:40:33.929193] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:40:33.931847] [INFO ] [REMOTE ] J: Full fetch complete (59133 records). [2025-10-03T19:40:33.931983] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-03T19:40:34.373751] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-03T19:40:34.373848] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-03T19:40:34.374946] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-03T19:40:34.375017] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-03T19:40:34.376494] [DEBUG] [LOCAL ] J: Trimmed 59133 records to 40756 (keeping 200 days of data) [2025-10-03T19:40:34.434963] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-03T19:40:34.649103] [DEBUG] [LOCAL ] J: Primary data saved (40756 records). [2025-10-03T19:40:34.649237] [INFO ] [MAIN ] J: Full history saved. [2025-10-03T19:40:34.649326] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. J took 30.4s. Estimated remaining: 2h 53m 10s. Rate: 7.1 symbols/min [2025-10-03T19:40:34.843851] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:34.873597] [DEBUG] [LOCAL ] JBND: Loaded 26305 existing records from primary storage. [2025-10-03T19:40:34.874007] [INFO ] [MAIN ] JBND: Loaded 26305 existing records. [2025-10-03T19:40:35.094746] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:35.095043] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-03T19:40:35.095108] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-03T19:40:35.095384] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-03T19:40:35.095485] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-03T19:40:35.196964] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-03T19:40:35.535578] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:40:35.727507] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:35.990754] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-03T19:40:36.043924] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:40:36.790689] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-03T19:40:37.055132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:40:37.482207] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:40:37.590700] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-03T19:40:37.977015] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:40:38.390728] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-03T19:40:39.190635] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-03T19:40:39.220872] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:40:39.599867] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:40:39.990702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-03T19:40:40.416432] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:40:40.418975] [INFO ] [REMOTE ] JBGS: Full fetch complete (59404 records). [2025-10-03T19:40:40.419081] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-03T19:40:40.795783] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-03T19:40:40.848027] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-03T19:40:40.848120] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-03T19:40:40.849161] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-03T19:40:40.849232] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-03T19:40:40.851121] [DEBUG] [LOCAL ] JBGS: Trimmed 59404 records to 42986 (keeping 200 days of data) [2025-10-03T19:40:41.130788] [DEBUG] [LOCAL ] JBGS: Primary data saved (42986 records). [2025-10-03T19:40:41.130943] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-03T19:40:41.131087] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBGS took 35.3s. Estimated remaining: 2h 52m 60s. Rate: 7.1 symbols/min [2025-10-03T19:40:41.332918] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:41.333294] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-03T19:40:41.333482] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-03T19:40:41.333705] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-03T19:40:41.333831] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-03T19:40:41.333970] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-03T19:40:41.334071] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-03T19:40:41.509928] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:40:41.594216] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-03T19:40:41.815635] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:42.390754] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-03T19:40:42.794204] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T19:40:43.190703] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-03T19:40:43.246866] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:40:43.312047] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T19:40:43.990738] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-03T19:40:44.181998] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:40:44.182316] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-03T19:40:44.182410] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:40:44.182458] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-03T19:40:44.182492] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:40:44.182530] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-03T19:40:44.182587] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-03T19:40:44.182624] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-03T19:40:44.182712] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-03T19:40:44.182792] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBS took 3.1s. Estimated remaining: 2h 52m 46s. Rate: 7.1 symbols/min [2025-10-03T19:40:44.383047] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:44.383294] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-03T19:40:44.383353] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-03T19:40:44.383484] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-03T19:40:44.383534] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-03T19:40:44.383580] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-03T19:40:44.383614] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-03T19:40:44.802333] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-03T19:40:44.808992] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:44.859948] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:40:45.590742] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-03T19:40:45.793725] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:40:45.794066] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-03T19:40:45.794160] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:40:45.794209] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-03T19:40:45.794283] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:40:45.794357] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-03T19:40:45.794423] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-03T19:40:45.794481] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-03T19:40:45.794523] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-03T19:40:45.794601] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 52m 30s. Rate: 7.1 symbols/min [2025-10-03T19:40:45.937356] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:40:46.014074] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:46.024671] [DEBUG] [LOCAL ] JCE: Loaded 6893 existing records from primary storage. [2025-10-03T19:40:46.024942] [INFO ] [MAIN ] JCE: Loaded 6893 existing records. [2025-10-03T19:40:46.223204] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:46.223452] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-03T19:40:46.223503] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-03T19:40:46.223784] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-03T19:40:46.223845] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-03T19:40:46.395808] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-03T19:40:46.633694] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:47.190708] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-03T19:40:47.990687] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-03T19:40:48.132584] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:40:48.193450] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:40:48.790686] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-03T19:40:48.935801] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T19:40:49.590692] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-03T19:40:50.129539] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T19:40:50.390692] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-03T19:40:51.190679] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-03T19:40:51.486127] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:40:51.765717] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:40:51.774812] [INFO ] [REMOTE ] JBI: Full fetch complete (64394 records). [2025-10-03T19:40:51.776320] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:40:51.776467] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-03T19:40:51.995869] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-03T19:40:52.207919] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-03T19:40:52.208026] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-03T19:40:52.209207] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-03T19:40:52.209279] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-03T19:40:52.211017] [DEBUG] [LOCAL ] JBI: Trimmed 64394 records to 44153 (keeping 200 days of data) [2025-10-03T19:40:52.466047] [DEBUG] [LOCAL ] JBI: Primary data saved (44153 records). [2025-10-03T19:40:52.466190] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-03T19:40:52.466291] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBI took 44.9s. Estimated remaining: 2h 52m 19s. Rate: 7.1 symbols/min [2025-10-03T19:40:52.669041] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:52.725385] [DEBUG] [LOCAL ] JCI: Loaded 53933 existing records from primary storage. [2025-10-03T19:40:52.725760] [INFO ] [MAIN ] JCI: Loaded 53933 existing records. [2025-10-03T19:40:52.795835] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-03T19:40:52.929609] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:52.929867] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-03T19:40:52.929919] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-03T19:40:52.930374] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-03T19:40:52.930435] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-03T19:40:53.338014] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:53.421997] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:40:53.590713] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-03T19:40:53.910719] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T19:40:54.161403] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T19:40:54.390695] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-03T19:40:55.190703] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-03T19:40:55.990684] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-03T19:40:56.006584] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:40:56.040415] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:40:56.790712] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-03T19:40:57.590696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-03T19:40:57.679225] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:40:58.390716] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-03T19:40:58.675951] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T19:40:58.731250] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:40:58.975913] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:40:59.190700] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-03T19:40:59.990704] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-03T19:41:00.251379] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:41:00.790723] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-03T19:41:01.401047] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:41:01.403731] [INFO ] [REMOTE ] JBL: Full fetch complete (70448 records). [2025-10-03T19:41:01.403902] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-03T19:41:01.602581] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-03T19:41:01.861780] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-03T19:41:01.861911] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-03T19:41:01.862911] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-03T19:41:01.862981] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-03T19:41:01.864529] [DEBUG] [LOCAL ] JBL: Trimmed 70448 records to 49138 (keeping 200 days of data) [2025-10-03T19:41:02.023610] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:41:02.238416] [DEBUG] [LOCAL ] JBL: Primary data saved (49138 records). [2025-10-03T19:41:02.238581] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-03T19:41:02.239434] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JBL took 32.8s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-10-03T19:41:02.402294] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-03T19:41:02.438285] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:02.490669] [DEBUG] [LOCAL ] JEF: Loaded 50415 existing records from primary storage. [2025-10-03T19:41:02.491019] [INFO ] [MAIN ] JEF: Loaded 50415 existing records. [2025-10-03T19:41:02.692502] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:02.692829] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-03T19:41:02.692883] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-03T19:41:02.694678] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-03T19:41:02.694751] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-03T19:41:03.076789] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:03.183507] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:41:03.190604] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-03T19:41:03.433376] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T19:41:03.853711] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T19:41:03.990699] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-03T19:41:04.790699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-03T19:41:05.285143] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:41:05.500200] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T19:41:05.590697] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-03T19:41:06.390710] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-03T19:41:07.177969] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T19:41:07.190610] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-03T19:41:07.238199] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:41:07.910986] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T19:41:07.912206] [INFO ] [REMOTE ] JCE: Full fetch complete (9516 records). [2025-10-03T19:41:07.912281] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-03T19:41:07.995817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-03T19:41:08.301750] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-03T19:41:08.301865] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-03T19:41:08.302111] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-03T19:41:08.302152] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-03T19:41:08.302605] [DEBUG] [LOCAL ] JCE: Trimmed 9516 records to 6994 (keeping 200 days of data) [2025-10-03T19:41:08.349260] [DEBUG] [LOCAL ] JCE: Primary data saved (6994 records). [2025-10-03T19:41:08.349410] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-03T19:41:08.349497] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JCE took 22.6s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-03T19:41:08.535816] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:08.584419] [DEBUG] [LOCAL ] JELD: Loaded 46427 existing records from primary storage. [2025-10-03T19:41:08.584874] [INFO ] [MAIN ] JELD: Loaded 46427 existing records. [2025-10-03T19:41:08.797179] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:08.797314] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-03T19:41:08.797720] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-03T19:41:08.797792] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-03T19:41:08.799109] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-03T19:41:08.799218] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-03T19:41:09.171464] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:09.487573] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:41:09.590696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-03T19:41:10.247732] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:41:10.390752] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-03T19:41:10.954015] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:41:11.190748] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-03T19:41:11.755951] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:41:11.990707] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-03T19:41:12.296359] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:41:12.790716] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-03T19:41:13.572688] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T19:41:13.590631] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-03T19:41:14.127574] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T19:41:14.390720] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-03T19:41:14.790595] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T19:41:14.792510] [INFO ] [REMOTE ] JBND: Full fetch complete (34416 records). [2025-10-03T19:41:14.792595] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-03T19:41:15.191090] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-03T19:41:15.190825] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-03T19:41:15.192053] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-03T19:41:15.192875] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-03T19:41:15.192992] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-03T19:41:15.194123] [DEBUG] [LOCAL ] JBND: Trimmed 34416 records to 26559 (keeping 200 days of data) [2025-10-03T19:41:15.366094] [DEBUG] [LOCAL ] JBND: Primary data saved (26559 records). [2025-10-03T19:41:15.366238] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-03T19:41:15.366382] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBND took 40.7s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-03T19:41:15.550313] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:15.562535] [DEBUG] [LOCAL ] JEQ: Loaded 8924 existing records from primary storage. [2025-10-03T19:41:15.562809] [INFO ] [MAIN ] JEQ: Loaded 8924 existing records. [2025-10-03T19:41:15.772370] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:15.772752] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-03T19:41:15.772867] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-03T19:41:15.773520] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-03T19:41:15.773684] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-03T19:41:15.930574] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:41:15.991970] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-03T19:41:16.199886] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:16.696378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:41:16.790717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-03T19:41:17.173755] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T19:41:17.557508] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:41:17.590757] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-03T19:41:17.995691] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-03T19:41:18.390711] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-03T19:41:19.190736] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-03T19:41:19.990639] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-03T19:41:20.279566] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:41:20.790724] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-03T19:41:20.919443] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:41:21.201810] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:41:21.590727] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-03T19:41:22.390694] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-03T19:41:22.613808] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:41:23.190728] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-03T19:41:23.355806] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T19:41:23.961726] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:41:23.990625] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-03T19:41:24.790694] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-03T19:41:25.161896] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T19:41:25.590696] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-03T19:41:25.769582] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T19:41:25.958366] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-03T19:41:26.376084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:41:26.390631] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-03T19:41:27.190723] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-03T19:41:27.693100] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:41:27.990731] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-03T19:41:28.096414] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T19:41:28.790756] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-03T19:41:29.590689] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-03T19:41:29.631005] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:41:29.649998] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:41:30.390677] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-03T19:41:31.134961] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:41:31.190728] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-03T19:41:31.911785] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:41:31.990704] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-03T19:41:32.146020] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:41:32.790717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-03T19:41:33.593901] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-03T19:41:33.594839] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:41:33.629761] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:41:34.390697] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-03T19:41:34.995864] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:41:35.190697] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-03T19:41:35.330065] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:41:35.990725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-03T19:41:36.790685] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-03T19:41:36.830894] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:41:37.590694] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-03T19:41:37.799093] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:41:38.314154] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:41:38.317230] [INFO ] [REMOTE ] JEF: Full fetch complete (72970 records). [2025-10-03T19:41:38.317424] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-03T19:41:38.395893] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-03T19:41:38.637352] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T19:41:38.863871] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-03T19:41:38.864018] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-03T19:41:38.865258] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-03T19:41:38.865343] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-03T19:41:38.867238] [DEBUG] [LOCAL ] JEF: Trimmed 72970 records to 50784 (keeping 200 days of data) [2025-10-03T19:41:39.212861] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-03T19:41:39.253721] [DEBUG] [LOCAL ] JEF: Primary data saved (50784 records). [2025-10-03T19:41:39.253855] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-03T19:41:39.254467] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEF took 37.0s. Estimated remaining: 2h 51m 60s. Rate: 7.1 symbols/min [2025-10-03T19:41:39.446043] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:39.481949] [DEBUG] [LOCAL ] JFR: Loaded 30936 existing records from primary storage. [2025-10-03T19:41:39.482227] [INFO ] [MAIN ] JFR: Loaded 30936 existing records. [2025-10-03T19:41:39.710257] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:39.710560] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-03T19:41:39.710614] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-03T19:41:39.710875] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-03T19:41:39.710933] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-03T19:41:39.996008] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-03T19:41:40.118588] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:40.137975] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:41:40.790635] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-03T19:41:40.812537] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:41:41.111839] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T19:41:41.590706] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-03T19:41:42.170089] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:41:42.172787] [INFO ] [REMOTE ] JELD: Full fetch complete (64129 records). [2025-10-03T19:41:42.172941] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-03T19:41:42.250488] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T19:41:42.274203] [INFO ] [REMOTE ] JEQ: Full fetch complete (11819 records). [2025-10-03T19:41:42.300533] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-03T19:41:42.393662] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-03T19:41:43.043090] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-03T19:41:43.048698] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-03T19:41:43.052975] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-03T19:41:43.060234] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-03T19:41:43.089560] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-03T19:41:43.089689] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-03T19:41:43.089943] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-03T19:41:43.090171] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-03T19:41:43.090685] [DEBUG] [LOCAL ] JELD: Trimmed 64129 records to 46721 (keeping 200 days of data) [2025-10-03T19:41:43.091056] [DEBUG] [LOCAL ] JEQ: Trimmed 11819 records to 8975 (keeping 200 days of data) [2025-10-03T19:41:43.210700] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-03T19:41:43.233982] [DEBUG] [LOCAL ] JEQ: Primary data saved (8975 records). [2025-10-03T19:41:43.234870] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-03T19:41:43.235326] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JEQ took 27.9s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-03T19:41:43.445580] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:43.551632] [DEBUG] [LOCAL ] JGH: Loaded 11163 existing records from primary storage. [2025-10-03T19:41:43.552724] [INFO ] [MAIN ] JGH: Loaded 11163 existing records. [2025-10-03T19:41:43.776228] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:43.779811] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-03T19:41:43.780487] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-03T19:41:43.781712] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-03T19:41:43.782293] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-03T19:41:44.209679] [DEBUG] [LOCAL ] JELD: Primary data saved (46721 records). [2025-10-03T19:41:44.232006] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-03T19:41:44.231393] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-03T19:41:44.262189] [INFO ] [REMOTE ] JCI: Full fetch complete (77409 records). [2025-10-03T19:41:44.278313] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-03T19:41:44.245186] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JELD took 35.9s. Estimated remaining: 2h 51m 30s. Rate: 7.1 symbols/min [2025-10-03T19:41:44.319833] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:44.407310] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-03T19:41:44.680131] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:44.969481] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-03T19:41:44.969767] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-03T19:41:44.971117] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-03T19:41:44.979164] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-03T19:41:45.017796] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:41:45.015507] [DEBUG] [LOCAL ] JHG: Loaded 47986 existing records from primary storage. [2025-10-03T19:41:45.027553] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-03T19:41:45.027934] [INFO ] [MAIN ] JHG: Loaded 47986 existing records. [2025-10-03T19:41:45.028261] [DEBUG] [LOCAL ] JCI: Trimmed 77409 records to 54318 (keeping 200 days of data) [2025-10-03T19:41:45.356499] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:45.367311] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-03T19:41:45.368326] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-03T19:41:45.370717] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-03T19:41:45.372754] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-03T19:41:45.609789] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:41:45.624818] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-03T19:41:45.937621] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:46.042130] [DEBUG] [LOCAL ] JCI: Primary data saved (54318 records). [2025-10-03T19:41:46.042289] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-03T19:41:46.042379] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JCI took 53.6s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-03T19:41:46.227772] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:46.234942] [DEBUG] [LOCAL ] JHI: Loaded 3612 existing records from primary storage. [2025-10-03T19:41:46.235170] [INFO ] [MAIN ] JHI: Loaded 3612 existing records. [2025-10-03T19:41:46.406245] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-03T19:41:46.456427] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:46.457242] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-03T19:41:46.457329] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-03T19:41:46.457998] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-03T19:41:46.458062] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-03T19:41:46.609130] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:41:46.621902] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:41:46.908850] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:47.190696] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-03T19:41:47.942150] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:41:47.990711] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-03T19:41:48.291558] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T19:41:48.593551] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T19:41:48.790707] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-03T19:41:49.590719] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-03T19:41:49.633671] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:41:50.327276] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:41:50.390691] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-03T19:41:51.190703] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-03T19:41:51.811388] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T19:41:51.870056] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:41:51.990681] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-03T19:41:52.445213] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T19:41:52.790701] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-03T19:41:53.590735] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-03T19:41:54.359295] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T19:41:54.390634] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-03T19:41:54.408727] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:41:55.190709] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-03T19:41:55.846579] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:41:55.990712] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-03T19:41:56.589980] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T19:41:56.590530] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T19:41:56.790738] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-03T19:41:57.590684] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-03T19:41:58.388216] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T19:41:58.391299] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-03T19:41:58.467492] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:41:59.042010] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T19:41:59.190695] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-03T19:41:59.990715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-03T19:42:00.718859] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:42:00.790705] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-03T19:42:01.163857] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T19:42:01.374985] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T19:42:01.590810] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-03T19:42:02.372285] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:42:02.390609] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-03T19:42:03.175505] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:42:03.190599] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-03T19:42:03.990666] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-03T19:42:04.000685] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T19:42:04.625042] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T19:42:04.790751] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-03T19:42:05.590635] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-03T19:42:06.026614] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T19:42:06.390680] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-03T19:42:06.400856] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:42:07.190711] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-03T19:42:07.681071] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T19:42:07.990630] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-03T19:42:08.087160] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:42:08.745096] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:42:08.746363] [INFO ] [REMOTE ] JGH: Full fetch complete (15058 records). [2025-10-03T19:42:08.746439] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-03T19:42:08.795829] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-03T19:42:09.135321] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-03T19:42:09.135421] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-03T19:42:09.135818] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-03T19:42:09.135883] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-03T19:42:09.136523] [DEBUG] [LOCAL ] JGH: Trimmed 15058 records to 11242 (keeping 200 days of data) [2025-10-03T19:42:09.210955] [DEBUG] [LOCAL ] JGH: Primary data saved (11242 records). [2025-10-03T19:42:09.211120] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-03T19:42:09.211215] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JGH took 26.0s. Estimated remaining: 2h 51m 22s. Rate: 7.1 symbols/min [2025-10-03T19:42:09.392852] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:09.398785] [DEBUG] [LOCAL ] JHS: Loaded 2834 existing records from primary storage. [2025-10-03T19:42:09.398967] [INFO ] [MAIN ] JHS: Loaded 2834 existing records. [2025-10-03T19:42:09.591707] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-03T19:42:09.591591] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:09.593080] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-03T19:42:09.593138] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-03T19:42:09.593364] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-03T19:42:09.593425] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-03T19:42:10.012571] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:10.298473] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:42:10.390701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-03T19:42:10.930046] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T19:42:11.199056] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-03T19:42:11.206938] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:42:11.990681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-03T19:42:12.528833] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-03T19:42:12.530726] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T19:42:12.790719] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-03T19:42:13.379364] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:42:13.590692] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-03T19:42:14.176260] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:42:14.390721] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-03T19:42:15.190729] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-03T19:42:15.915968] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T19:42:15.939835] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:42:15.990637] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-03T19:42:16.438230] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T19:42:16.790695] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-03T19:42:17.590686] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-03T19:42:18.121824] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:42:18.395819] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-03T19:42:18.409588] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:42:18.963527] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T19:42:18.964332] [INFO ] [REMOTE ] JHI: Full fetch complete (5251 records). [2025-10-03T19:42:18.964438] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-03T19:42:19.199015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-03T19:42:19.362181] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-03T19:42:19.362272] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-03T19:42:19.362471] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-03T19:42:19.362537] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-03T19:42:19.363135] [DEBUG] [LOCAL ] JHI: Trimmed 5251 records to 3638 (keeping 200 days of data) [2025-10-03T19:42:19.387620] [DEBUG] [LOCAL ] JHI: Primary data saved (3638 records). [2025-10-03T19:42:19.387806] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-03T19:42:19.387935] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JHI took 33.3s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-03T19:42:19.585139] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:19.641267] [DEBUG] [LOCAL ] JHX: Loaded 52271 existing records from primary storage. [2025-10-03T19:42:19.641604] [INFO ] [MAIN ] JHX: Loaded 52271 existing records. [2025-10-03T19:42:19.842344] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:19.843836] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-03T19:42:19.843911] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-03T19:42:19.844793] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-03T19:42:19.844853] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-03T19:42:20.001019] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-03T19:42:20.255274] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:20.790745] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-03T19:42:20.870015] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:42:21.230703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:42:21.237038] [INFO ] [REMOTE ] JFR: Full fetch complete (48396 records). [2025-10-03T19:42:21.237268] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-03T19:42:21.595919] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-03T19:42:21.821136] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T19:42:21.867497] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-03T19:42:21.867591] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-03T19:42:21.868705] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-03T19:42:21.868789] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-03T19:42:21.870237] [DEBUG] [LOCAL ] JFR: Trimmed 48396 records to 31302 (keeping 200 days of data) [2025-10-03T19:42:22.082266] [DEBUG] [LOCAL ] JFR: Primary data saved (31302 records). [2025-10-03T19:42:22.082434] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-03T19:42:22.083154] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JFR took 42.8s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-03T19:42:22.182906] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:42:22.291077] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:22.324208] [DEBUG] [LOCAL ] JILL: Loaded 16768 existing records from primary storage. [2025-10-03T19:42:22.324514] [INFO ] [MAIN ] JILL: Loaded 16768 existing records. [2025-10-03T19:42:22.392234] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-03T19:42:22.539052] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:22.539297] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-03T19:42:22.539383] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-03T19:42:22.539696] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-03T19:42:22.539756] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-03T19:42:22.964334] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:23.190721] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-03T19:42:23.977808] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:42:23.990610] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-03T19:42:24.026610] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:42:24.790735] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-03T19:42:25.353826] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:42:25.507165] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:42:25.511157] [INFO ] [REMOTE ] JHG: Full fetch complete (68281 records). [2025-10-03T19:42:25.511280] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-03T19:42:25.595906] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-03T19:42:25.935415] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-03T19:42:25.935502] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-03T19:42:25.936684] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-03T19:42:25.936763] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-03T19:42:25.938263] [DEBUG] [LOCAL ] JHG: Trimmed 68281 records to 48335 (keeping 200 days of data) [2025-10-03T19:42:26.236985] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T19:42:26.254698] [DEBUG] [LOCAL ] JHG: Primary data saved (48335 records). [2025-10-03T19:42:26.254877] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-03T19:42:26.255022] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 42.0s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-03T19:42:26.402775] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-03T19:42:26.438343] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:26.481550] [DEBUG] [LOCAL ] JKS: Loaded 40360 existing records from primary storage. [2025-10-03T19:42:26.481891] [INFO ] [MAIN ] JKS: Loaded 40360 existing records. [2025-10-03T19:42:26.675897] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:26.676139] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-03T19:42:26.676190] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-03T19:42:26.676449] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-03T19:42:26.676510] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-03T19:42:27.060557] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:27.190711] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-03T19:42:27.385625] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:42:27.990730] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-03T19:42:28.010786] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:42:28.790718] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-03T19:42:28.957572] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T19:42:29.472132] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:42:29.590715] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-03T19:42:30.390712] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-03T19:42:30.850067] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T19:42:31.158686] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:42:31.190699] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-03T19:42:31.721044] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:42:31.721831] [INFO ] [REMOTE ] JHS: Full fetch complete (4478 records). [2025-10-03T19:42:31.721901] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-03T19:42:31.995915] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-03T19:42:32.121974] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-03T19:42:32.122095] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-03T19:42:32.122335] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-03T19:42:32.122400] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-03T19:42:32.122840] [DEBUG] [LOCAL ] JHS: Trimmed 4478 records to 2882 (keeping 200 days of data) [2025-10-03T19:42:32.141072] [DEBUG] [LOCAL ] JHS: Primary data saved (2882 records). [2025-10-03T19:42:32.141174] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-03T19:42:32.141255] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 22.9s. Estimated remaining: 2h 50m 37s. Rate: 7.1 symbols/min [2025-10-03T19:42:32.319103] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:32.319292] [DEBUG] [LOCAL ] JLL: No existing data file found in primary storage. [2025-10-03T19:42:32.319349] [WARN ] [MAIN ] JLL: No existing data found, performing full refresh instead. [2025-10-03T19:42:32.319486] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-03T19:42:32.319530] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-03T19:42:32.319575] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-10-03T19:42:32.319609] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-03T19:42:32.703953] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:32.790688] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-03T19:42:33.590630] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-03T19:42:33.629635] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:42:34.026694] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T19:42:34.390689] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-03T19:42:34.404937] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:42:35.190684] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-03T19:42:35.970843] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:42:35.990609] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-03T19:42:36.207675] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:42:36.790705] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-03T19:42:37.248748] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:42:37.590723] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-03T19:42:37.800816] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:42:38.390726] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-03T19:42:39.190710] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-03T19:42:39.300151] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:42:39.330403] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:42:39.990715] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-03T19:42:40.167700] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:42:40.790710] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-03T19:42:41.590709] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-03T19:42:41.697105] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:42:42.243030] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:42:42.390698] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-03T19:42:43.060322] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:42:43.190689] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-03T19:42:43.827179] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:42:43.990702] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-03T19:42:44.790631] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-03T19:42:44.897608] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T19:42:44.963882] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:42:45.590710] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-03T19:42:46.326681] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T19:42:46.390680] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-03T19:42:47.190688] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-03T19:42:47.481191] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:42:47.831730] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:42:47.990706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-03T19:42:48.795822] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-03T19:42:48.811216] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T19:42:49.104860] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:42:49.590671] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-03T19:42:49.742819] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:42:50.390872] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-03T19:42:51.190679] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-03T19:42:51.390259] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:42:51.422295] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:42:51.990718] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-03T19:42:52.790626] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-03T19:42:52.851615] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:42:52.853089] [INFO ] [REMOTE ] JILL: Full fetch complete (22749 records). [2025-10-03T19:42:52.853164] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-03T19:42:53.207304] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:42:53.301886] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-03T19:42:53.301967] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-03T19:42:53.302488] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-03T19:42:53.302554] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-03T19:42:53.303337] [DEBUG] [LOCAL ] JILL: Trimmed 22749 records to 16861 (keeping 200 days of data) [2025-10-03T19:42:53.414956] [DEBUG] [LOCAL ] JILL: Primary data saved (16861 records). [2025-10-03T19:42:53.415114] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-03T19:42:53.415234] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JILL took 31.3s. Estimated remaining: 2h 50m 42s. Rate: 7.1 symbols/min [2025-10-03T19:42:53.590697] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-03T19:42:54.214323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T19:42:54.390718] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-03T19:42:54.879281] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T19:42:54.882164] [INFO ] [REMOTE ] JHX: Full fetch complete (59134 records). [2025-10-03T19:42:54.882312] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-03T19:42:55.200227] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-03T19:42:55.358855] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-03T19:42:55.359056] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-03T19:42:55.360104] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-03T19:42:55.360178] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-03T19:42:55.361739] [DEBUG] [LOCAL ] JHX: Trimmed 59134 records to 52661 (keeping 200 days of data) [2025-10-03T19:42:55.703766] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T19:42:55.736084] [DEBUG] [LOCAL ] JHX: Primary data saved (52661 records). [2025-10-03T19:42:55.736246] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-03T19:42:55.736366] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JHX took 36.3s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-03T19:42:55.990695] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-03T19:42:56.713261] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:42:56.790720] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-03T19:42:57.359305] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:42:57.590733] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-03T19:42:58.323312] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:42:58.390621] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-03T19:42:59.021365] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T19:42:59.190741] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-03T19:42:59.728607] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:42:59.990744] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-03T19:43:00.608506] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:43:00.790706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-03T19:43:01.536592] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:43:01.590694] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-03T19:43:01.724219] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T19:43:01.725937] [INFO ] [REMOTE ] JLL: Full fetch complete (44754 records). [2025-10-03T19:43:01.726050] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-03T19:43:02.195238] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-03T19:43:02.195318] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-03T19:43:02.196141] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-03T19:43:02.196215] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-03T19:43:02.198128] [DEBUG] [LOCAL ] JLL: Trimmed 44754 records to 31853 (keeping 200 days of data) [2025-10-03T19:43:02.404499] [DEBUG] [LOCAL ] JLL: Primary data saved (31853 records). [2025-10-03T19:43:02.404668] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-03T19:43:02.404764] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JLL took 30.3s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-03T19:43:02.951606] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:43:02.954803] [INFO ] [REMOTE ] JKS: Full fetch complete (58921 records). [2025-10-03T19:43:02.954943] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-03T19:43:03.360026] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-03T19:43:03.360122] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-03T19:43:03.361320] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-03T19:43:03.361409] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-03T19:43:03.362861] [DEBUG] [LOCAL ] JKS: Trimmed 58921 records to 40657 (keeping 200 days of data) [2025-10-03T19:43:03.621209] [DEBUG] [LOCAL ] JKS: Primary data saved (40657 records). [2025-10-03T19:43:03.621368] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-03T19:43:03.621486] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JKS took 37.4s. Estimated remaining: 2h 50m 1s. Rate: 7.1 symbols/min [2025-10-03T19:43:04.313358] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.307421] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.371011] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.385130] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-03T19:43:04.406104] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.406421] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-03T19:43:04.406791] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-03T19:43:04.406962] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-03T19:43:04.407032] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-03T19:43:04.407069] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-03T19:43:04.509460] [DEBUG] [LOCAL ] JLS: Loaded 4162 existing records from primary storage. [2025-10-03T19:43:04.540503] [INFO ] [MAIN ] JLS: Loaded 4162 existing records. [2025-10-03T19:43:04.838557] [DEBUG] [LOCAL ] JMIA: Loaded 51046 existing records from primary storage. [2025-10-03T19:43:04.899458] [INFO ] [MAIN ] JMIA: Loaded 51046 existing records. [2025-10-03T19:43:05.018668] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.024607] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.052696] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-03T19:43:04.988026] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-03T19:43:05.112525] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-03T19:43:05.125439] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-03T19:43:05.136344] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-03T19:43:05.131013] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:05.204878] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-03T19:43:05.597308] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.634287] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.649670] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-03T19:43:05.700085] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.736878] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.742313] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-03T19:43:05.736629] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-03T19:43:05.762398] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-03T19:43:05.783587] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-03T19:43:05.783530] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-03T19:43:06.069175] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:43:06.140695] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-03T19:43:06.184106] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.259483] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-03T19:43:06.636087] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.664358] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T19:43:06.649677] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-03T19:43:06.680293] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-03T19:43:06.714076] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.714581] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-03T19:43:07.060183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:43:07.175441] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T19:43:07.190681] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-03T19:43:07.520819] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T19:43:07.990740] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-03T19:43:08.548015] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:43:08.567092] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T19:43:08.790714] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-03T19:43:09.210566] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-03T19:43:09.225941] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T19:43:09.590715] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-03T19:43:10.390718] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-03T19:43:10.963829] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T19:43:11.190675] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-03T19:43:11.920460] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T19:43:11.947878] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T19:43:11.990700] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-03T19:43:12.445875] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T19:43:12.790714] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-03T19:43:13.590707] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-03T19:43:14.222393] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T19:43:14.390707] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-03T19:43:14.544576] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:43:15.052772] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T19:43:15.190726] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-03T19:43:15.990717] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-03T19:43:16.790681] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-03T19:43:17.277725] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T19:43:17.309886] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T19:43:17.590635] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-03T19:43:17.656526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:43:18.065342] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T19:43:18.390722] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-03T19:43:19.190728] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-03T19:43:19.990682] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-03T19:43:20.262011] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:43:20.429172] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:43:20.790698] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-03T19:43:21.434096] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-03T19:43:21.590730] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-03T19:43:21.884592] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-03T19:43:22.187637] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T19:43:22.390692] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-03T19:43:23.190687] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-03T19:43:23.839417] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:43:23.840200] [INFO ] [REMOTE ] JMM: Full fetch complete (2323 records). [2025-10-03T19:43:23.840270] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-03T19:43:23.990987] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-03T19:43:24.037158] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-03T19:43:24.037437] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:43:24.037584] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:43:24.037754] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-03T19:43:24.037905] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-03T19:43:24.037983] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-03T19:43:24.038182] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-03T19:43:24.038290] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 20.4s. Estimated remaining: 2h 50m 5s. Rate: 7.1 symbols/min [2025-10-03T19:43:24.227346] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:24.259542] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:43:24.326768] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-10-03T19:43:24.327253] [INFO ] [MAIN ] JOBY: Loaded 54189 existing records. [2025-10-03T19:43:24.525281] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:24.525569] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-03T19:43:24.525670] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-03T19:43:24.526034] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-03T19:43:24.526107] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-03T19:43:24.756018] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:43:24.795829] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-03T19:43:24.983416] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:25.590691] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-03T19:43:26.227745] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T19:43:26.390689] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-03T19:43:26.696062] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:43:26.941462] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T19:43:27.190687] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-03T19:43:27.990722] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-03T19:43:28.790690] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-03T19:43:29.132628] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T19:43:29.590772] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-03T19:43:30.200780] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T19:43:30.390749] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-03T19:43:30.546162] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-03T19:43:30.621342] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:43:30.979791] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:43:30.980702] [INFO ] [REMOTE ] JLS: Full fetch complete (5841 records). [2025-10-03T19:43:30.980788] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-03T19:43:31.195845] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-03T19:43:31.390253] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-03T19:43:31.390372] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-03T19:43:31.390562] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-03T19:43:31.390605] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-03T19:43:31.391065] [DEBUG] [LOCAL ] JLS: Trimmed 5841 records to 4193 (keeping 200 days of data) [2025-10-03T19:43:31.418536] [DEBUG] [LOCAL ] JLS: Primary data saved (4193 records). [2025-10-03T19:43:31.418700] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-03T19:43:31.418817] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JLS took 27.8s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-03T19:43:31.605350] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:31.629951] [DEBUG] [LOCAL ] JOE: Loaded 24297 existing records from primary storage. [2025-10-03T19:43:31.630232] [INFO ] [MAIN ] JOE: Loaded 24297 existing records. [2025-10-03T19:43:31.836184] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:31.836424] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-03T19:43:31.836472] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-03T19:43:31.836800] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-03T19:43:31.836862] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-03T19:43:31.992178] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-03T19:43:32.217301] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:32.790718] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-03T19:43:33.590683] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-03T19:43:33.871871] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-03T19:43:34.080409] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:43:34.390635] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-03T19:43:34.714085] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T19:43:34.908976] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T19:43:35.190688] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-03T19:43:35.990697] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-03T19:43:36.790709] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-03T19:43:36.829236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-03T19:43:37.590718] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-03T19:43:37.832982] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-03T19:43:37.984508] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:43:38.110625] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:43:38.390688] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-03T19:43:39.190699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-03T19:43:39.535548] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:43:39.820390] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T19:43:39.990692] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-03T19:43:40.790686] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-03T19:43:41.590634] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-03T19:43:41.763623] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-03T19:43:41.884702] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T19:43:41.887456] [INFO ] [REMOTE ] JMIA: Full fetch complete (73273 records). [2025-10-03T19:43:41.887570] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-03T19:43:42.313250] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:43:42.345397] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-03T19:43:42.345499] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-03T19:43:42.346724] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-03T19:43:42.346801] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-03T19:43:42.348473] [DEBUG] [LOCAL ] JMIA: Trimmed 73273 records to 51428 (keeping 200 days of data) [2025-10-03T19:43:42.394245] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-03T19:43:42.665881] [DEBUG] [LOCAL ] JMIA: Primary data saved (51428 records). [2025-10-03T19:43:42.666046] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-03T19:43:42.666157] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JMIA took 39.0s. Estimated remaining: 2h 49m 50s. Rate: 7.1 symbols/min [2025-10-03T19:43:42.851066] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:42.860464] [DEBUG] [LOCAL ] JOF: Loaded 7036 existing records from primary storage. [2025-10-03T19:43:42.860699] [INFO ] [MAIN ] JOF: Loaded 7036 existing records. [2025-10-03T19:43:43.062733] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:43.062971] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-03T19:43:43.063024] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-03T19:43:43.063223] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-03T19:43:43.063283] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-03T19:43:43.194307] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-03T19:43:43.486119] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:43.770569] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:43:43.791378] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T19:43:43.990676] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-03T19:43:44.790639] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-03T19:43:44.965363] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:43:45.590776] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-03T19:43:45.794216] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T19:43:46.390713] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-03T19:43:46.732369] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:43:46.988537] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:43:46.994862] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-03T19:43:47.190728] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-03T19:43:47.990714] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-03T19:43:48.790731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-03T19:43:49.101714] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:43:49.410759] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-03T19:43:49.590726] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-03T19:43:50.390706] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-03T19:43:50.811357] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-03T19:43:50.820369] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-03T19:43:50.831339] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-03T19:43:50.832113] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T19:43:51.195835] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-03T19:43:51.295486] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-03T19:43:51.295617] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-03T19:43:51.296917] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-03T19:43:51.296989] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-03T19:43:51.298757] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-10-03T19:43:51.673891] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-03T19:43:51.674047] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-03T19:43:51.674153] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JNJ took 48.0s. Estimated remaining: 2h 49m 42s. Rate: 7.1 symbols/min [2025-10-03T19:43:51.871949] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:51.908398] [DEBUG] [LOCAL ] JPC: Loaded 37383 existing records from primary storage. [2025-10-03T19:43:51.908733] [INFO ] [MAIN ] JPC: Loaded 37383 existing records. [2025-10-03T19:43:51.995861] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-03T19:43:52.106054] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:52.106293] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-03T19:43:52.106346] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-03T19:43:52.106710] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-03T19:43:52.106773] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-03T19:43:52.499482] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T19:43:52.570115] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:52.608375] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T19:43:52.790630] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-03T19:43:52.867670] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T19:43:53.590639] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-03T19:43:53.919405] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T19:43:54.390759] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-03T19:43:55.190665] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-03T19:43:55.334066] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T19:43:55.335564] [INFO ] [REMOTE ] JOE: Full fetch complete (36027 records). [2025-10-03T19:43:55.335673] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-03T19:43:55.750771] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-03T19:43:55.750864] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-03T19:43:55.751680] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-03T19:43:55.751764] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-03T19:43:55.752809] [DEBUG] [LOCAL ] JOE: Trimmed 36027 records to 24485 (keeping 200 days of data) [2025-10-03T19:43:55.922672] [DEBUG] [LOCAL ] JOE: Primary data saved (24485 records). [2025-10-03T19:43:55.923831] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:43:55.925974] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-03T19:43:55.926838] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOE took 24.5s. Estimated remaining: 2h 49m 29s. Rate: 7.1 symbols/min [2025-10-03T19:43:55.991081] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-03T19:43:56.126011] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:56.186714] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-03T19:43:56.187052] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-03T19:43:56.381203] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:56.381490] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-03T19:43:56.381593] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-03T19:43:56.382080] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-03T19:43:56.382179] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-03T19:43:56.537819] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-03T19:43:56.793046] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-03T19:43:56.832713] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:56.851358] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:43:57.590741] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-03T19:43:58.390696] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-03T19:43:59.190721] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-03T19:43:59.580415] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-03T19:43:59.643674] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T19:43:59.801717] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T19:43:59.997186] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-03T19:44:00.005014] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:44:00.500949] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T19:44:00.790720] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-03T19:44:01.583520] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T19:44:01.590631] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-03T19:44:02.390703] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-03T19:44:02.407678] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:44:03.190715] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-03T19:44:03.802605] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:44:03.990691] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-03T19:44:04.790690] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-03T19:44:05.503918] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:44:05.590769] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-03T19:44:05.891989] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-03T19:44:06.390694] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-03T19:44:06.900372] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T19:44:06.938134] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T19:44:07.039888] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:44:07.190711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-03T19:44:07.990774] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-03T19:44:08.524056] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:44:08.525004] [INFO ] [REMOTE ] JOF: Full fetch complete (9464 records). [2025-10-03T19:44:08.525079] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-03T19:44:08.811608] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-03T19:44:08.936204] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:44:08.989329] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-03T19:44:08.989413] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-03T19:44:08.989696] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-03T19:44:08.989761] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-03T19:44:08.990307] [DEBUG] [LOCAL ] JOF: Trimmed 9464 records to 7072 (keeping 200 days of data) [2025-10-03T19:44:09.040482] [DEBUG] [LOCAL ] JOF: Primary data saved (7072 records). [2025-10-03T19:44:09.040883] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-03T19:44:09.041015] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOF took 26.4s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-03T19:44:09.233679] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:09.280982] [DEBUG] [LOCAL ] JQC: Loaded 34592 existing records from primary storage. [2025-10-03T19:44:09.281381] [INFO ] [MAIN ] JQC: Loaded 34592 existing records. [2025-10-03T19:44:09.492778] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:09.493033] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-03T19:44:09.493084] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-03T19:44:09.493311] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-03T19:44:09.493370] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-03T19:44:09.599525] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-03T19:44:09.880306] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:10.390710] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-03T19:44:11.190632] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-03T19:44:11.448067] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-03T19:44:11.451413] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-03T19:44:11.451595] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-03T19:44:11.912378] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-03T19:44:11.913068] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-03T19:44:11.914412] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-03T19:44:11.914610] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-03T19:44:11.949940] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:44:11.955355] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54579 (keeping 200 days of data) [2025-10-03T19:44:11.979287] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T19:44:12.037872] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-03T19:44:12.332748] [DEBUG] [LOCAL ] JOBY: Primary data saved (54579 records). [2025-10-03T19:44:12.332905] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-03T19:44:12.333006] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 48.3s. Estimated remaining: 2h 49m 12s. Rate: 7.1 symbols/min [2025-10-03T19:44:12.530612] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:12.557308] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:44:12.580129] [DEBUG] [LOCAL ] JRI: Loaded 14997 existing records from primary storage. [2025-10-03T19:44:12.580437] [INFO ] [MAIN ] JRI: Loaded 14997 existing records. [2025-10-03T19:44:12.781582] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:12.781851] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-03T19:44:12.781905] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-03T19:44:12.782144] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-03T19:44:12.782205] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-03T19:44:12.795799] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-03T19:44:13.191838] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:13.401177] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:44:13.590738] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-03T19:44:14.390711] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-03T19:44:15.102988] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:44:15.190701] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-03T19:44:15.370145] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:44:15.501214] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-03T19:44:15.990730] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-03T19:44:16.611718] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:44:16.790690] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-03T19:44:17.431904] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:44:17.590690] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-03T19:44:18.073288] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:44:18.390713] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-03T19:44:18.660072] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T19:44:19.190704] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-03T19:44:19.990679] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-03T19:44:20.124985] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:44:20.790681] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-03T19:44:21.043061] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-03T19:44:21.293289] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T19:44:21.590748] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-03T19:44:21.784903] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:44:22.390728] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-03T19:44:22.764489] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:44:22.767979] [INFO ] [REMOTE ] JPC: Full fetch complete (55633 records). [2025-10-03T19:44:22.768381] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-03T19:44:23.197679] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-03T19:44:23.378296] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-03T19:44:23.378419] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-03T19:44:23.380387] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-03T19:44:23.380478] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-03T19:44:23.382408] [DEBUG] [LOCAL ] JPC: Trimmed 55633 records to 37668 (keeping 200 days of data) [2025-10-03T19:44:23.650762] [DEBUG] [LOCAL ] JPC: Primary data saved (37668 records). [2025-10-03T19:44:23.650918] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-03T19:44:23.651029] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 32.0s. Estimated remaining: 2h 49m 6s. Rate: 7.1 symbols/min [2025-10-03T19:44:23.841663] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:23.855067] [DEBUG] [LOCAL ] JRS: Loaded 11452 existing records from primary storage. [2025-10-03T19:44:23.855313] [INFO ] [MAIN ] JRS: Loaded 11452 existing records. [2025-10-03T19:44:24.004248] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-03T19:44:24.054834] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:24.055181] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-03T19:44:24.055294] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-03T19:44:24.055501] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-03T19:44:24.055562] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-03T19:44:24.476159] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:24.651454] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:44:24.790717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-03T19:44:24.835405] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-03T19:44:25.076134] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:44:25.590805] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-03T19:44:26.216664] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T19:44:26.376883] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T19:44:26.390631] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-03T19:44:26.997988] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T19:44:27.190706] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-03T19:44:27.990722] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-03T19:44:28.790728] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-03T19:44:29.187256] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T19:44:29.375850] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:44:29.557265] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-03T19:44:29.590733] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-03T19:44:30.390683] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-03T19:44:30.618121] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T19:44:31.190738] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-03T19:44:31.837438] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:44:31.990703] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-03T19:44:32.323347] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:44:32.790711] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-03T19:44:33.292740] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T19:44:33.536836] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:44:33.590680] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-03T19:44:34.390718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-03T19:44:34.519450] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:44:35.190720] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-03T19:44:35.776832] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:44:35.990704] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-03T19:44:36.005959] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T19:44:36.790676] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-03T19:44:36.812736] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:44:37.590690] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-03T19:44:38.062699] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T19:44:38.065177] [INFO ] [REMOTE ] JQC: Full fetch complete (49420 records). [2025-10-03T19:44:38.065285] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-03T19:44:38.395772] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-03T19:44:38.487683] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-03T19:44:38.487822] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-03T19:44:38.488747] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-03T19:44:38.488814] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-03T19:44:38.490057] [DEBUG] [LOCAL ] JQC: Trimmed 49420 records to 34960 (keeping 200 days of data) [2025-10-03T19:44:38.706922] [DEBUG] [LOCAL ] JQC: Primary data saved (34960 records). [2025-10-03T19:44:38.707090] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-03T19:44:38.707181] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JQC took 29.7s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-03T19:44:38.904685] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:38.955028] [DEBUG] [LOCAL ] JXN: Loaded 45845 existing records from primary storage. [2025-10-03T19:44:38.955399] [INFO ] [MAIN ] JXN: Loaded 45845 existing records. [2025-10-03T19:44:39.145204] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:39.145476] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-03T19:44:39.145526] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-03T19:44:39.145797] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-03T19:44:39.145866] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-03T19:44:39.203553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-03T19:44:39.541920] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:39.543188] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T19:44:39.990676] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-03T19:44:40.047899] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T19:44:40.110770] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-03T19:44:40.790629] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-03T19:44:40.861621] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T19:44:40.863122] [INFO ] [REMOTE ] JRI: Full fetch complete (23330 records). [2025-10-03T19:44:40.863212] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-03T19:44:41.279761] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-03T19:44:41.279851] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-03T19:44:41.280332] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-03T19:44:41.280424] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-03T19:44:41.281329] [DEBUG] [LOCAL ] JRI: Trimmed 23330 records to 15135 (keeping 200 days of data) [2025-10-03T19:44:41.378395] [DEBUG] [LOCAL ] JRI: Primary data saved (15135 records). [2025-10-03T19:44:41.378553] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-03T19:44:41.378680] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRI took 29.0s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-03T19:44:41.563245] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:41.591808] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-03T19:44:41.615687] [DEBUG] [LOCAL ] K: Loaded 50366 existing records from primary storage. [2025-10-03T19:44:41.616065] [INFO ] [MAIN ] K: Loaded 50366 existing records. [2025-10-03T19:44:41.808932] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:41.809241] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-03T19:44:41.809320] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-03T19:44:41.809632] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-03T19:44:41.809732] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-03T19:44:42.204177] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:42.390721] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-03T19:44:43.114318] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T19:44:43.157043] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:44:43.190632] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-03T19:44:43.983355] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:44:43.993638] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-03T19:44:44.723405] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T19:44:44.790696] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-03T19:44:44.847937] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:44:45.590734] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-03T19:44:46.390739] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-03T19:44:47.188891] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T19:44:47.189478] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:44:47.209200] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-03T19:44:47.264481] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T19:44:47.990725] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-03T19:44:48.596040] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T19:44:48.790741] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-03T19:44:48.906589] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:44:49.590766] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-03T19:44:50.390675] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-03T19:44:50.511489] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:44:50.728111] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:44:51.176442] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:44:51.190622] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-03T19:44:51.970367] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T19:44:51.990691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-03T19:44:52.790715] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-03T19:44:53.590731] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-03T19:44:53.623712] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:44:54.390716] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-03T19:44:55.051894] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T19:44:55.054893] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-03T19:44:55.055065] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-03T19:44:55.195787] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-03T19:44:55.266436] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:44:55.309327] [INFO ] [REMOTE ] JRS: Full fetch complete (16367 records). [2025-10-03T19:44:55.334390] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-03T19:44:55.741190] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-03T19:44:55.763370] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-03T19:44:55.781725] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-03T19:44:55.792726] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-03T19:44:55.884945] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-10-03T19:44:55.980923] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-03T19:44:55.984200] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-03T19:44:55.985093] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-03T19:44:55.985233] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-03T19:44:55.989183] [DEBUG] [LOCAL ] JRS: Trimmed 16367 records to 11561 (keeping 200 days of data) [2025-10-03T19:44:55.988632] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-03T19:44:56.100831] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-03T19:44:56.195708] [DEBUG] [LOCAL ] JRS: Primary data saved (11561 records). [2025-10-03T19:44:56.196444] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-03T19:44:56.196929] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JRS took 32.5s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-03T19:44:56.396360] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:56.506319] [DEBUG] [LOCAL ] KAI: Loaded 13381 existing records from primary storage. [2025-10-03T19:44:56.507196] [INFO ] [MAIN ] KAI: Loaded 13381 existing records. [2025-10-03T19:44:56.725290] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:56.728943] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-03T19:44:56.729446] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-03T19:44:56.730404] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-03T19:44:56.731720] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-03T19:44:57.164849] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:57.166021] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-03T19:44:57.267906] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T19:44:57.307548] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-03T19:44:57.307755] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-03T19:44:57.308614] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JPM took 1m 1s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-03T19:44:57.495760] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:57.551953] [DEBUG] [LOCAL ] KAR: Loaded 40252 existing records from primary storage. [2025-10-03T19:44:57.552377] [INFO ] [MAIN ] KAR: Loaded 40252 existing records. [2025-10-03T19:44:57.600687] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-03T19:44:57.754737] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:57.755556] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-03T19:44:57.755618] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-03T19:44:57.755974] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-03T19:44:57.756035] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-03T19:44:58.159001] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:58.191598] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T19:44:58.211926] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T19:44:58.390694] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-03T19:44:59.187458] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:44:59.190601] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-03T19:44:59.431556] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:44:59.990703] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-03T19:45:00.184835] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T19:45:00.790700] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-03T19:45:01.590746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-03T19:45:01.876056] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:45:02.209853] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:45:02.390728] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-03T19:45:03.190630] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-03T19:45:03.287981] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:45:03.990723] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-03T19:45:04.121696] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:45:04.239510] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:45:04.790716] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-03T19:45:05.590719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-03T19:45:05.651741] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:45:06.390708] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-03T19:45:06.683470] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:45:07.060764] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:45:07.190743] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-03T19:45:07.935893] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:45:07.990689] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-03T19:45:08.584273] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:45:08.790705] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-03T19:45:09.391555] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:45:09.393901] [INFO ] [REMOTE ] JXN: Full fetch complete (65212 records). [2025-10-03T19:45:09.394033] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-03T19:45:09.597372] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-03T19:45:09.836541] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-03T19:45:09.836677] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-03T19:45:09.837842] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-03T19:45:09.837910] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-03T19:45:09.839367] [DEBUG] [LOCAL ] JXN: Trimmed 65212 records to 46137 (keeping 200 days of data) [2025-10-03T19:45:10.153360] [DEBUG] [LOCAL ] JXN: Primary data saved (46137 records). [2025-10-03T19:45:10.153514] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-03T19:45:10.153638] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. JXN took 31.4s. Estimated remaining: 2h 48m 28s. Rate: 7.1 symbols/min [2025-10-03T19:45:10.356881] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:10.381088] [DEBUG] [LOCAL ] KB: Loaded 24074 existing records from primary storage. [2025-10-03T19:45:10.381485] [INFO ] [MAIN ] KB: Loaded 24074 existing records. [2025-10-03T19:45:10.399498] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-03T19:45:10.620024] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:10.622761] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T19:45:10.622929] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-03T19:45:10.623078] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-03T19:45:10.635530] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-03T19:45:10.635631] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-03T19:45:11.030455] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:11.130770] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T19:45:11.190700] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-03T19:45:11.618035] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:45:11.990731] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-03T19:45:12.587357] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:45:12.790714] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-03T19:45:13.590638] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-03T19:45:13.786887] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:45:13.897063] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:45:14.390715] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-03T19:45:15.128236] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:45:15.190742] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-03T19:45:15.902562] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T19:45:15.911502] [INFO ] [REMOTE ] K: Full fetch complete (72103 records). [2025-10-03T19:45:15.911825] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-03T19:45:16.003900] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-03T19:45:16.467039] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-03T19:45:16.467214] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-03T19:45:16.468671] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-03T19:45:16.468767] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-03T19:45:16.470501] [DEBUG] [LOCAL ] K: Trimmed 72103 records to 50735 (keeping 200 days of data) [2025-10-03T19:45:16.795887] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-03T19:45:16.803578] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:45:16.832547] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:45:16.933206] [DEBUG] [LOCAL ] K: Primary data saved (50735 records). [2025-10-03T19:45:16.933359] [INFO ] [MAIN ] K: Full history saved. [2025-10-03T19:45:16.933477] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. K took 35.6s. Estimated remaining: 2h 48m 18s. Rate: 7.1 symbols/min [2025-10-03T19:45:17.115472] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:17.138249] [DEBUG] [LOCAL ] KBDC: Loaded 21392 existing records from primary storage. [2025-10-03T19:45:17.138525] [INFO ] [MAIN ] KBDC: Loaded 21392 existing records. [2025-10-03T19:45:17.334384] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:17.334680] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-03T19:45:17.334743] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-03T19:45:17.334961] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-03T19:45:17.335022] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-03T19:45:17.594623] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-03T19:45:17.753890] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:17.764832] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:45:18.390711] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-03T19:45:19.075498] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:45:19.190685] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-03T19:45:19.253540] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:45:19.990697] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-03T19:45:20.126463] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:45:20.790667] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-03T19:45:21.123914] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:45:21.590689] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-03T19:45:21.646547] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:45:22.390711] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-03T19:45:23.082226] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T19:45:23.103116] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T19:45:23.190676] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-03T19:45:23.990748] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-03T19:45:24.626200] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:45:24.678983] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T19:45:24.790705] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-03T19:45:25.590723] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-03T19:45:26.371590] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:45:26.390616] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-03T19:45:26.417477] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:45:26.418870] [INFO ] [REMOTE ] KAI: Full fetch complete (18852 records). [2025-10-03T19:45:26.418969] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-03T19:45:26.836003] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-03T19:45:26.836099] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-03T19:45:26.836555] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-03T19:45:26.836602] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-03T19:45:26.837381] [DEBUG] [LOCAL ] KAI: Trimmed 18852 records to 13475 (keeping 200 days of data) [2025-10-03T19:45:26.926231] [DEBUG] [LOCAL ] KAI: Primary data saved (13475 records). [2025-10-03T19:45:26.926388] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-03T19:45:26.926500] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. KAI took 30.7s. Estimated remaining: 2h 48m 11s. Rate: 7.1 symbols/min [2025-10-03T19:45:27.120975] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:27.171580] [DEBUG] [LOCAL ] KBH: Loaded 49218 existing records from primary storage. [2025-10-03T19:45:27.172001] [INFO ] [MAIN ] KBH: Loaded 49218 existing records. [2025-10-03T19:45:27.195817] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-03T19:45:27.370091] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:27.370330] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-03T19:45:27.370380] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-03T19:45:27.370688] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-03T19:45:27.370747] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-03T19:45:27.763315] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:27.769046] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:45:27.771356] [INFO ] [REMOTE ] KAR: Full fetch complete (56882 records). [2025-10-03T19:45:27.771445] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-03T19:45:27.999319] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-03T19:45:28.133717] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:45:28.234190] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-03T19:45:28.234284] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-03T19:45:28.235372] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-03T19:45:28.235442] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-03T19:45:28.236875] [DEBUG] [LOCAL ] KAR: Trimmed 56882 records to 40570 (keeping 200 days of data) [2025-10-03T19:45:28.481240] [DEBUG] [LOCAL ] KAR: Primary data saved (40570 records). [2025-10-03T19:45:28.481371] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-03T19:45:28.482068] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 31.2s. Estimated remaining: 2h 47m 56s. Rate: 7.1 symbols/min [2025-10-03T19:45:28.665205] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:28.722174] [DEBUG] [LOCAL ] KBR: Loaded 48339 existing records from primary storage. [2025-10-03T19:45:28.722773] [INFO ] [MAIN ] KBR: Loaded 48339 existing records. [2025-10-03T19:45:28.795831] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-03T19:45:28.927500] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:28.927778] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-03T19:45:28.927833] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-03T19:45:28.928238] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-03T19:45:28.928300] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-03T19:45:29.324075] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:29.590631] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-03T19:45:29.790908] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:45:30.086107] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T19:45:30.343682] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:45:30.390705] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-03T19:45:31.190699] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-03T19:45:31.262260] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T19:45:31.990741] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-03T19:45:32.790637] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-03T19:45:32.885261] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:45:33.084775] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T19:45:33.590711] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-03T19:45:33.938234] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:45:34.337563] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T19:45:34.390690] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-03T19:45:35.190697] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-03T19:45:35.999543] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-03T19:45:36.019494] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:45:36.553988] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:45:36.790729] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-03T19:45:37.592166] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-03T19:45:37.595531] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:45:38.390695] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-03T19:45:38.555348] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:45:38.721088] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:45:39.190686] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-03T19:45:39.468298] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T19:45:39.990696] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-03T19:45:40.790697] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-03T19:45:40.949267] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:45:41.567691] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:45:41.590629] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-03T19:45:41.619263] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T19:45:42.390697] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-03T19:45:42.946894] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T19:45:43.190699] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-03T19:45:43.991366] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-03T19:45:43.997062] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:45:44.535963] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T19:45:44.790739] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-03T19:45:44.888339] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T19:45:45.590724] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-03T19:45:46.374529] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T19:45:46.390620] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-03T19:45:46.791052] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T19:45:47.190716] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-03T19:45:47.990735] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-03T19:45:48.149381] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:45:48.151755] [INFO ] [REMOTE ] KBDC: Full fetch complete (29024 records). [2025-10-03T19:45:48.151848] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-03T19:45:48.394124] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T19:45:48.622155] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-03T19:45:48.622256] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-03T19:45:48.622952] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-03T19:45:48.623029] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-03T19:45:48.623884] [DEBUG] [LOCAL ] KBDC: Trimmed 29024 records to 21640 (keeping 200 days of data) [2025-10-03T19:45:48.763746] [DEBUG] [LOCAL ] KBDC: Primary data saved (21640 records). [2025-10-03T19:45:48.763886] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-03T19:45:48.763994] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KBDC took 31.8s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-03T19:45:48.795845] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-03T19:45:48.955093] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:49.009548] [DEBUG] [LOCAL ] KD: Loaded 52682 existing records from primary storage. [2025-10-03T19:45:49.009969] [INFO ] [MAIN ] KD: Loaded 52682 existing records. [2025-10-03T19:45:49.208264] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:49.208510] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-03T19:45:49.208560] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-03T19:45:49.208862] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-03T19:45:49.208930] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-03T19:45:49.592902] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-03T19:45:49.592760] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:49.637081] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:45:50.390635] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-03T19:45:50.561087] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:45:50.653626] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:45:51.190685] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-03T19:45:51.990669] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-03T19:45:52.032188] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:45:52.033493] [INFO ] [REMOTE ] KB: Full fetch complete (33957 records). [2025-10-03T19:45:52.033585] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-03T19:45:52.492987] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-03T19:45:52.493826] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-03T19:45:52.495857] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T19:45:52.496786] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-03T19:45:52.496874] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-03T19:45:52.514108] [DEBUG] [LOCAL ] KB: Trimmed 33957 records to 24181 (keeping 200 days of data) [2025-10-03T19:45:52.690170] [DEBUG] [LOCAL ] KB: Primary data saved (24181 records). [2025-10-03T19:45:52.690315] [INFO ] [MAIN ] KB: Full history saved. [2025-10-03T19:45:52.690435] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KB took 42.5s. Estimated remaining: 2h 47m 46s. Rate: 7.1 symbols/min [2025-10-03T19:45:52.798985] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-03T19:45:52.884839] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:52.893124] [DEBUG] [LOCAL ] KEN: Loaded 4749 existing records from primary storage. [2025-10-03T19:45:52.893386] [INFO ] [MAIN ] KEN: Loaded 4749 existing records. [2025-10-03T19:45:53.081973] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:53.082216] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-03T19:45:53.082269] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-03T19:45:53.082498] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-03T19:45:53.082600] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-03T19:45:53.469122] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:53.590721] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-03T19:45:53.689964] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T19:45:54.061161] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T19:45:54.390720] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-03T19:45:55.190606] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:45:55.190741] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-03T19:45:55.781874] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:45:55.990725] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-03T19:45:56.123808] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:45:56.554725] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T19:45:56.790730] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-03T19:45:57.176370] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T19:45:57.590722] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-03T19:45:58.390737] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-03T19:45:59.190677] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-03T19:45:59.311376] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:45:59.968216] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:45:59.970706] [INFO ] [REMOTE ] KBH: Full fetch complete (70719 records). [2025-10-03T19:45:59.970807] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-03T19:45:59.995871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-03T19:46:00.402408] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-03T19:46:00.402493] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-03T19:46:00.403484] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-03T19:46:00.403550] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-03T19:46:00.405250] [DEBUG] [LOCAL ] KBH: Trimmed 70719 records to 49576 (keeping 200 days of data) [2025-10-03T19:46:00.733628] [DEBUG] [LOCAL ] KBH: Primary data saved (49576 records). [2025-10-03T19:46:00.733864] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-03T19:46:00.734010] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KBH took 33.8s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-03T19:46:00.795787] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-03T19:46:00.796044] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:46:00.947565] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:00.979449] [DEBUG] [LOCAL ] KEP: Loaded 31283 existing records from primary storage. [2025-10-03T19:46:00.979765] [INFO ] [MAIN ] KEP: Loaded 31283 existing records. [2025-10-03T19:46:01.180158] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:01.180561] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-03T19:46:01.180715] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-03T19:46:01.181151] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-03T19:46:01.181325] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-03T19:46:01.394086] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T19:46:01.597155] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-03T19:46:01.643817] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:02.332688] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:46:02.390725] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-03T19:46:02.517760] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T19:46:03.190708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-03T19:46:03.990716] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-03T19:46:04.034175] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:46:04.496696] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:46:04.790712] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-03T19:46:05.590714] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-03T19:46:05.682728] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:46:06.249672] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:46:06.252353] [INFO ] [REMOTE ] KBR: Full fetch complete (69851 records). [2025-10-03T19:46:06.252500] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-03T19:46:06.395826] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-03T19:46:06.700667] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-03T19:46:06.700910] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-03T19:46:06.702158] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-03T19:46:06.702228] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-03T19:46:06.703939] [DEBUG] [LOCAL ] KBR: Trimmed 69851 records to 48697 (keeping 200 days of data) [2025-10-03T19:46:06.789806] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:46:07.070403] [DEBUG] [LOCAL ] KBR: Primary data saved (48697 records). [2025-10-03T19:46:07.071310] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-03T19:46:07.072754] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KBR took 38.6s. Estimated remaining: 2h 47m 27s. Rate: 7.1 symbols/min [2025-10-03T19:46:07.195913] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-03T19:46:07.292445] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:07.337583] [DEBUG] [LOCAL ] KEX: Loaded 38410 existing records from primary storage. [2025-10-03T19:46:07.337945] [INFO ] [MAIN ] KEX: Loaded 38410 existing records. [2025-10-03T19:46:07.534963] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:07.535172] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-03T19:46:07.535281] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-03T19:46:07.535779] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-03T19:46:07.535838] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-03T19:46:07.902731] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T19:46:07.993758] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-03T19:46:08.030794] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:08.427206] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:46:08.790747] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-03T19:46:09.016925] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:46:09.590707] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-03T19:46:10.341302] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T19:46:10.390681] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-03T19:46:10.673153] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:46:11.190695] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-03T19:46:11.897418] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:46:11.990703] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-03T19:46:12.790637] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-03T19:46:13.058671] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T19:46:13.390790] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T19:46:13.420109] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:46:13.590700] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-03T19:46:14.390735] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-03T19:46:14.946504] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:46:15.190708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-03T19:46:15.458771] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:46:15.990701] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-03T19:46:16.524535] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T19:46:16.525903] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:46:16.790727] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-03T19:46:17.590732] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-03T19:46:18.390694] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-03T19:46:18.479891] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T19:46:19.051983] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:46:19.190688] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-03T19:46:19.701129] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:46:19.759083] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:46:19.990694] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-03T19:46:20.790701] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-03T19:46:21.590672] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-03T19:46:21.876756] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:46:22.049749] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T19:46:22.050569] [INFO ] [REMOTE ] KEN: Full fetch complete (5932 records). [2025-10-03T19:46:22.050668] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-03T19:46:22.393999] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-03T19:46:22.463711] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-03T19:46:22.463883] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-03T19:46:22.464205] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-03T19:46:22.464325] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-03T19:46:22.465239] [DEBUG] [LOCAL ] KEN: Trimmed 5932 records to 4758 (keeping 200 days of data) [2025-10-03T19:46:22.515789] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:46:22.533964] [DEBUG] [LOCAL ] KEN: Primary data saved (4758 records). [2025-10-03T19:46:22.534499] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-03T19:46:22.534621] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KEN took 29.8s. Estimated remaining: 2h 47m 26s. Rate: 7.1 symbols/min [2025-10-03T19:46:22.757842] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:22.758052] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-03T19:46:22.758096] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-03T19:46:22.758266] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-03T19:46:22.758309] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-03T19:46:22.758358] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-03T19:46:22.758396] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-03T19:46:23.196054] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-03T19:46:23.203826] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:23.990679] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-03T19:46:24.400045] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:46:24.775850] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:46:24.790615] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-03T19:46:25.509955] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:46:25.590712] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-03T19:46:26.152317] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:46:26.390714] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-03T19:46:27.150249] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:46:27.190668] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-03T19:46:27.719800] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T19:46:27.990686] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-03T19:46:28.543876] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T19:46:28.790735] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-03T19:46:28.828449] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:46:28.830448] [INFO ] [REMOTE ] KEP: Full fetch complete (41824 records). [2025-10-03T19:46:28.830581] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-03T19:46:29.244050] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-03T19:46:29.244136] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-03T19:46:29.244995] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-03T19:46:29.245065] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-03T19:46:29.246084] [DEBUG] [LOCAL ] KEP: Trimmed 41824 records to 31512 (keeping 200 days of data) [2025-10-03T19:46:29.440719] [DEBUG] [LOCAL ] KEP: Primary data saved (31512 records). [2025-10-03T19:46:29.440867] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-03T19:46:29.440997] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KEP took 28.7s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-03T19:46:29.595903] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-03T19:46:29.632897] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:29.686816] [DEBUG] [LOCAL ] KEYS: Loaded 43450 existing records from primary storage. [2025-10-03T19:46:29.687169] [INFO ] [MAIN ] KEYS: Loaded 43450 existing records. [2025-10-03T19:46:29.884761] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:29.885014] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-03T19:46:29.885065] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-03T19:46:29.885672] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-03T19:46:29.885735] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-03T19:46:30.282270] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:30.390669] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-03T19:46:30.477404] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:46:31.146193] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:46:31.190697] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-03T19:46:31.990719] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-03T19:46:32.127631] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:46:32.790675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-03T19:46:32.826980] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T19:46:32.830067] [INFO ] [REMOTE ] KD: Full fetch complete (75656 records). [2025-10-03T19:46:32.830243] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-03T19:46:33.267181] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-03T19:46:33.267272] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-03T19:46:33.268477] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-03T19:46:33.268548] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-03T19:46:33.270178] [DEBUG] [LOCAL ] KD: Trimmed 75656 records to 53067 (keeping 200 days of data) [2025-10-03T19:46:33.591688] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-03T19:46:33.597591] [DEBUG] [LOCAL ] KD: Primary data saved (53067 records). [2025-10-03T19:46:33.597831] [INFO ] [MAIN ] KD: Full history saved. [2025-10-03T19:46:33.597957] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KD took 44.8s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-03T19:46:33.818543] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:46:33.823090] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:33.836595] [DEBUG] [LOCAL ] KF: Loaded 2452 existing records from primary storage. [2025-10-03T19:46:33.836804] [INFO ] [MAIN ] KF: Loaded 2452 existing records. [2025-10-03T19:46:34.031048] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:34.031630] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-03T19:46:34.031741] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-03T19:46:34.032014] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-03T19:46:34.032076] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-03T19:46:34.393576] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-03T19:46:34.435485] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:34.534834] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:46:35.116422] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:46:35.190708] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-03T19:46:35.666105] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T19:46:35.990683] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-03T19:46:36.057139] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T19:46:36.790700] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-03T19:46:37.282391] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T19:46:37.595881] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-03T19:46:37.611787] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:46:38.390736] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-03T19:46:39.190678] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-03T19:46:39.300318] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:46:39.576488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:46:39.649981] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:46:39.990740] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-03T19:46:40.790728] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-03T19:46:41.590740] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-03T19:46:41.724078] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:46:42.197334] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T19:46:42.390675] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-03T19:46:42.428058] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:46:42.977774] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T19:46:43.190722] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-03T19:46:43.990711] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-03T19:46:44.358779] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T19:46:44.712326] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:46:44.790735] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-03T19:46:45.590689] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-03T19:46:46.390638] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-03T19:46:46.713447] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T19:46:47.062769] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:46:47.065095] [INFO ] [REMOTE ] KEX: Full fetch complete (55881 records). [2025-10-03T19:46:47.065228] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-03T19:46:47.153727] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:46:47.195756] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-03T19:46:47.483765] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-03T19:46:47.483854] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-03T19:46:47.484799] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-03T19:46:47.484869] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-03T19:46:47.488773] [DEBUG] [LOCAL ] KEX: Trimmed 55881 records to 38713 (keeping 200 days of data) [2025-10-03T19:46:47.740421] [DEBUG] [LOCAL ] KEX: Primary data saved (38713 records). [2025-10-03T19:46:47.740576] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-03T19:46:47.742571] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KEX took 40.7s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-03T19:46:47.930528] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:47.961798] [DEBUG] [LOCAL ] KFRC: Loaded 19732 existing records from primary storage. [2025-10-03T19:46:47.962074] [INFO ] [MAIN ] KFRC: Loaded 19732 existing records. [2025-10-03T19:46:47.995988] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-03T19:46:48.184511] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:48.184807] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-03T19:46:48.184863] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-03T19:46:48.185416] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-03T19:46:48.185477] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-03T19:46:48.620557] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:48.790679] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-03T19:46:49.025199] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:46:49.233899] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:46:49.385308] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:46:49.590714] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-03T19:46:50.015326] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T19:46:50.390732] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-03T19:46:51.190738] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-03T19:46:51.400474] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T19:46:51.990713] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-03T19:46:52.790720] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-03T19:46:53.198860] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T19:46:53.274696] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:46:53.590706] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-03T19:46:53.667585] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:46:54.390697] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-03T19:46:54.441497] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T19:46:55.190726] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-03T19:46:55.839467] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:46:55.840317] [INFO ] [REMOTE ] KF: Full fetch complete (3601 records). [2025-10-03T19:46:55.840390] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-03T19:46:55.991040] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-03T19:46:56.256870] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-03T19:46:56.256964] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-03T19:46:56.257232] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-03T19:46:56.257434] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-03T19:46:56.258179] [DEBUG] [LOCAL ] KF: Trimmed 3601 records to 2509 (keeping 200 days of data) [2025-10-03T19:46:56.275396] [DEBUG] [LOCAL ] KF: Primary data saved (2509 records). [2025-10-03T19:46:56.275519] [INFO ] [MAIN ] KF: Full history saved. [2025-10-03T19:46:56.275677] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KF took 22.7s. Estimated remaining: 2h 46m 52s. Rate: 7.1 symbols/min [2025-10-03T19:46:56.428438] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T19:46:56.518693] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:56.528942] [DEBUG] [LOCAL ] KFS: Loaded 8523 existing records from primary storage. [2025-10-03T19:46:56.529186] [INFO ] [MAIN ] KFS: Loaded 8523 existing records. [2025-10-03T19:46:56.726938] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:56.727219] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-03T19:46:56.727274] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-03T19:46:56.727630] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-03T19:46:56.727734] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-03T19:46:56.801224] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-03T19:46:57.127863] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:57.592373] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:46:57.590805] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-03T19:46:58.390626] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-03T19:46:58.604258] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:46:58.603747] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:46:59.190732] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-03T19:46:59.671678] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T19:46:59.778497] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:46:59.990718] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-03T19:47:00.790697] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-03T19:47:01.576847] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:47:01.579676] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-03T19:47:01.579814] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-03T19:47:01.595798] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-03T19:47:01.820731] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T19:47:01.822609] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:47:01.823842] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:47:01.828885] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:47:01.829056] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-03T19:47:01.829132] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-03T19:47:01.829173] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-03T19:47:01.829248] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-03T19:47:01.829343] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEY took 39.3s. Estimated remaining: 2h 46m 40s. Rate: 7.1 symbols/min [2025-10-03T19:47:02.009252] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:02.049748] [DEBUG] [LOCAL ] KFY: Loaded 30268 existing records from primary storage. [2025-10-03T19:47:02.050100] [INFO ] [MAIN ] KFY: Loaded 30268 existing records. [2025-10-03T19:47:02.257215] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:02.257567] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-03T19:47:02.257671] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-03T19:47:02.259043] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-03T19:47:02.259127] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-03T19:47:02.392927] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-03T19:47:02.415844] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:47:02.731115] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:03.190683] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-03T19:47:03.572583] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T19:47:03.990695] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-03T19:47:04.502895] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:47:04.660741] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T19:47:04.790728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-03T19:47:05.590738] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-03T19:47:06.395774] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-03T19:47:06.413268] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:47:06.600563] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:47:07.190735] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-03T19:47:07.851399] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T19:47:07.884774] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:47:07.990696] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-03T19:47:08.790719] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-03T19:47:09.312409] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:47:09.314884] [INFO ] [REMOTE ] KEYS: Full fetch complete (62865 records). [2025-10-03T19:47:09.314985] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-03T19:47:09.595759] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-03T19:47:09.747192] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-03T19:47:09.747459] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-03T19:47:09.748551] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-03T19:47:09.748619] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-03T19:47:09.750219] [DEBUG] [LOCAL ] KEYS: Trimmed 62865 records to 43769 (keeping 200 days of data) [2025-10-03T19:47:09.986827] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:47:10.048350] [DEBUG] [LOCAL ] KEYS: Primary data saved (43769 records). [2025-10-03T19:47:10.048514] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-03T19:47:10.048605] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KEYS took 40.6s. Estimated remaining: 2h 46m 32s. Rate: 7.1 symbols/min [2025-10-03T19:47:10.229129] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:10.284499] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-03T19:47:10.284959] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-10-03T19:47:10.395186] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-03T19:47:10.406369] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:47:10.494817] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:10.495064] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-03T19:47:10.495131] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-03T19:47:10.496371] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-03T19:47:10.496436] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-03T19:47:10.882636] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:11.190707] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-03T19:47:11.674791] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:47:11.990782] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-03T19:47:12.544396] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:47:12.790704] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-03T19:47:13.567754] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:47:13.590717] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-03T19:47:13.914247] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:47:14.390661] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-03T19:47:14.555705] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:47:15.190711] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-03T19:47:15.991493] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-03T19:47:15.993526] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:47:16.086816] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:47:16.790680] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-03T19:47:16.846340] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:47:17.590738] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-03T19:47:18.366281] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:47:18.390720] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-03T19:47:18.554152] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T19:47:19.190673] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-03T19:47:19.331531] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:47:19.990732] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-03T19:47:20.790684] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-03T19:47:21.056913] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:47:21.537945] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:47:21.590694] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-03T19:47:21.867792] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:47:21.869283] [INFO ] [REMOTE ] KFRC: Full fetch complete (25756 records). [2025-10-03T19:47:21.869367] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-03T19:47:22.258754] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-03T19:47:22.258841] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-03T19:47:22.259365] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-03T19:47:22.259413] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-03T19:47:22.260196] [DEBUG] [LOCAL ] KFRC: Trimmed 25756 records to 19888 (keeping 200 days of data) [2025-10-03T19:47:22.386557] [DEBUG] [LOCAL ] KFRC: Primary data saved (19888 records). [2025-10-03T19:47:22.386737] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-03T19:47:22.386836] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KFRC took 34.6s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-03T19:47:22.398353] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-03T19:47:22.572946] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:22.624310] [DEBUG] [LOCAL ] KGS: Loaded 46001 existing records from primary storage. [2025-10-03T19:47:22.624692] [INFO ] [MAIN ] KGS: Loaded 46001 existing records. [2025-10-03T19:47:22.813793] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:22.820043] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-03T19:47:22.829615] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-03T19:47:22.831263] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-03T19:47:22.831180] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T19:47:22.833950] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-03T19:47:23.040532] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T19:47:23.195817] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-03T19:47:23.255623] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:23.990689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-03T19:47:24.790735] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-03T19:47:25.202014] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T19:47:25.512426] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:47:25.562592] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:47:25.590668] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-03T19:47:26.214477] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T19:47:26.215415] [INFO ] [REMOTE ] KFS: Full fetch complete (10605 records). [2025-10-03T19:47:26.215503] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-03T19:47:26.393971] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-03T19:47:26.621333] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-03T19:47:26.621420] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-03T19:47:26.621709] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-03T19:47:26.621773] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-03T19:47:26.622338] [DEBUG] [LOCAL ] KFS: Trimmed 10605 records to 8567 (keeping 200 days of data) [2025-10-03T19:47:26.675742] [DEBUG] [LOCAL ] KFS: Primary data saved (8567 records). [2025-10-03T19:47:26.675922] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-03T19:47:26.676108] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 30.4s. Estimated remaining: 2h 46m 15s. Rate: 7.1 symbols/min [2025-10-03T19:47:26.863117] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:26.919585] [DEBUG] [LOCAL ] KIM: Loaded 53419 existing records from primary storage. [2025-10-03T19:47:26.920011] [INFO ] [MAIN ] KIM: Loaded 53419 existing records. [2025-10-03T19:47:27.124896] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:27.125188] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-03T19:47:27.125243] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-03T19:47:27.126730] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-03T19:47:27.126831] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-03T19:47:27.195781] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-03T19:47:27.505916] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:27.990637] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-03T19:47:28.072120] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:47:28.790717] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-03T19:47:29.479102] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T19:47:29.586964] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:47:29.597612] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-03T19:47:30.364775] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:47:30.390692] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-03T19:47:31.003130] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:47:31.190714] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-03T19:47:31.990713] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-03T19:47:32.123043] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:47:32.790692] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-03T19:47:32.846820] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:47:33.389758] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:47:33.590695] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-03T19:47:34.390684] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-03T19:47:35.019381] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T19:47:35.190742] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-03T19:47:35.342730] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:47:35.506571] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:47:35.990719] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-03T19:47:36.790711] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-03T19:47:37.006851] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:47:37.423482] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:47:37.590733] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-03T19:47:38.168791] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:47:38.390723] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-03T19:47:39.180955] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:47:39.190624] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-03T19:47:39.990729] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-03T19:47:40.378937] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:47:40.381075] [INFO ] [REMOTE ] KFY: Full fetch complete (43425 records). [2025-10-03T19:47:40.381193] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-03T19:47:40.809508] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-03T19:47:40.860575] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-03T19:47:40.833914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-03T19:47:40.872005] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-03T19:47:40.873728] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-03T19:47:40.874159] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-03T19:47:40.875612] [DEBUG] [LOCAL ] KFY: Trimmed 43425 records to 30424 (keeping 200 days of data) [2025-10-03T19:47:41.078979] [DEBUG] [LOCAL ] KFY: Primary data saved (30424 records). [2025-10-03T19:47:41.079448] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-03T19:47:41.079724] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 39.3s. Estimated remaining: 2h 46m 12s. Rate: 7.1 symbols/min [2025-10-03T19:47:41.272803] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:41.297714] [DEBUG] [LOCAL ] KIO: Loaded 21442 existing records from primary storage. [2025-10-03T19:47:41.298004] [INFO ] [MAIN ] KIO: Loaded 21442 existing records. [2025-10-03T19:47:41.506416] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:41.506839] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-03T19:47:41.506935] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-03T19:47:41.516304] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-03T19:47:41.531463] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-03T19:47:41.609467] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-03T19:47:41.604240] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:47:41.948228] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:42.390720] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-03T19:47:42.573124] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:47:43.190732] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-03T19:47:43.774821] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T19:47:43.941982] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:47:43.990721] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-03T19:47:44.682048] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:47:44.790704] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-03T19:47:45.590689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-03T19:47:45.607138] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T19:47:46.243887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T19:47:46.390690] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-03T19:47:47.203715] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-03T19:47:47.213475] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:47:47.437621] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:47:47.990727] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-03T19:47:48.790740] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-03T19:47:48.933840] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:47:49.584927] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:47:49.595902] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-03T19:47:50.390723] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-03T19:47:50.537103] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T19:47:50.540760] [INFO ] [REMOTE ] KGC: Full fetch complete (77698 records). [2025-10-03T19:47:50.541179] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-03T19:47:50.979855] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-03T19:47:50.980004] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-03T19:47:50.981274] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-03T19:47:50.981360] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-03T19:47:50.983036] [DEBUG] [LOCAL ] KGC: Trimmed 77698 records to 54479 (keeping 200 days of data) [2025-10-03T19:47:51.106604] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:47:51.210283] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-03T19:47:51.383864] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-10-03T19:47:51.384017] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-03T19:47:51.384131] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KGC took 41.3s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-03T19:47:51.576824] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:51.634456] [DEBUG] [LOCAL ] KKR: Loaded 53890 existing records from primary storage. [2025-10-03T19:47:51.634832] [INFO ] [MAIN ] KKR: Loaded 53890 existing records. [2025-10-03T19:47:51.831552] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:51.831843] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-03T19:47:51.831894] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-03T19:47:51.833322] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-03T19:47:51.833389] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-03T19:47:51.949689] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:47:51.973321] [INFO ] [REMOTE ] KGS: Full fetch complete (66384 records). [2025-10-03T19:47:51.983817] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-03T19:47:51.998973] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-03T19:47:52.602017] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:52.702238] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-03T19:47:52.702325] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-03T19:47:52.703250] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-03T19:47:52.703316] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-03T19:47:52.704690] [DEBUG] [LOCAL ] KGS: Trimmed 66384 records to 46368 (keeping 200 days of data) [2025-10-03T19:47:52.806689] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-03T19:47:53.008766] [DEBUG] [LOCAL ] KGS: Primary data saved (46368 records). [2025-10-03T19:47:53.008925] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-03T19:47:53.009975] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGS took 30.6s. Estimated remaining: 2h 45m 50s. Rate: 7.1 symbols/min [2025-10-03T19:47:53.208943] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:47:53.240149] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:53.260977] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:47:53.275590] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-03T19:47:53.275951] [INFO ] [MAIN ] KKRS: Loaded 5729 existing records. [2025-10-03T19:47:53.500131] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:53.500386] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-03T19:47:53.500441] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-03T19:47:53.500794] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-03T19:47:53.500855] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-03T19:47:53.595851] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-03T19:47:53.925602] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:54.390676] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-03T19:47:54.706164] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:47:54.849905] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T19:47:55.190709] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-03T19:47:55.507392] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T19:47:55.771474] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T19:47:55.990715] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-03T19:47:56.579264] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T19:47:56.790712] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-03T19:47:57.590747] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-03T19:47:58.390629] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-03T19:47:58.505033] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:47:59.190631] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-03T19:47:59.447400] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T19:47:59.990694] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-03T19:48:00.781325] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:48:00.786954] [INFO ] [REMOTE ] KIM: Full fetch complete (76830 records). [2025-10-03T19:48:00.787074] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-03T19:48:00.822097] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-03T19:48:01.212792] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:48:01.241201] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-03T19:48:01.241729] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-03T19:48:01.243033] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-03T19:48:01.243110] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-03T19:48:01.244725] [DEBUG] [LOCAL ] KIM: Trimmed 76830 records to 53806 (keeping 200 days of data) [2025-10-03T19:48:01.586801] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (4.00 seconds). [2025-10-03T19:48:01.590766] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-03T19:48:01.618433] [DEBUG] [LOCAL ] KIM: Primary data saved (53806 records). [2025-10-03T19:48:01.618636] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-03T19:48:01.618822] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KIM took 34.9s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-03T19:48:01.804377] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:01.804579] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-03T19:48:01.804695] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-03T19:48:01.804825] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-03T19:48:01.804869] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-03T19:48:01.804912] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-03T19:48:01.804946] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-03T19:48:02.189062] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:02.390727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-03T19:48:02.422432] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T19:48:02.679304] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:48:03.190708] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-03T19:48:03.440922] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:48:03.442528] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-03T19:48:03.442439] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:48:03.447717] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:03.448288] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-03T19:48:03.448812] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:03.448888] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-03T19:48:03.448961] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-03T19:48:03.449001] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-03T19:48:03.449060] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-03T19:48:03.449170] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KKRT took 1.8s. Estimated remaining: 2h 45m 27s. Rate: 7.1 symbols/min [2025-10-03T19:48:03.639533] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:03.639768] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-03T19:48:03.639830] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-03T19:48:03.639951] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-03T19:48:03.639998] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-03T19:48:03.640045] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-03T19:48:03.640081] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-03T19:48:03.995742] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-03T19:48:04.025967] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:04.790673] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-03T19:48:05.010506] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T19:48:05.590702] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-03T19:48:05.798306] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:48:05.798671] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-03T19:48:05.798764] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:05.798882] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-03T19:48:05.798952] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:05.799024] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-03T19:48:05.799089] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-03T19:48:05.799173] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-03T19:48:05.799247] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-03T19:48:05.799317] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KLAR took 2.4s. Estimated remaining: 2h 45m 13s. Rate: 7.1 symbols/min [2025-10-03T19:48:05.982778] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:06.018749] [DEBUG] [LOCAL ] KLC: Loaded 36984 existing records from primary storage. [2025-10-03T19:48:06.019081] [INFO ] [MAIN ] KLC: Loaded 36984 existing records. [2025-10-03T19:48:06.214741] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:06.215211] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-03T19:48:06.215345] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-03T19:48:06.216192] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-03T19:48:06.216257] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-03T19:48:06.393710] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-03T19:48:06.581513] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:48:06.670759] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:07.190705] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-03T19:48:07.211585] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:48:07.990677] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-03T19:48:08.141716] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:48:08.790731] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-03T19:48:09.409945] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T19:48:09.590746] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-03T19:48:10.071235] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T19:48:10.390764] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-03T19:48:10.671033] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:48:11.019507] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:48:11.190708] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-03T19:48:11.990706] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-03T19:48:12.213270] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:48:12.790703] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-03T19:48:13.590739] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-03T19:48:13.702916] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T19:48:13.704673] [INFO ] [REMOTE ] KIO: Full fetch complete (31358 records). [2025-10-03T19:48:13.704758] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-03T19:48:14.115220] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-03T19:48:14.115380] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-03T19:48:14.116235] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-03T19:48:14.116515] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-03T19:48:14.118727] [DEBUG] [LOCAL ] KIO: Trimmed 31358 records to 21612 (keeping 200 days of data) [2025-10-03T19:48:14.149902] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T19:48:14.256560] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T19:48:14.310693] [DEBUG] [LOCAL ] KIO: Primary data saved (21612 records). [2025-10-03T19:48:14.310851] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-03T19:48:14.310948] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KIO took 33.2s. Estimated remaining: 2h 45m 4s. Rate: 7.1 symbols/min [2025-10-03T19:48:14.395845] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-03T19:48:14.512464] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:14.569294] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-03T19:48:14.569673] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-03T19:48:14.768500] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:14.769201] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-03T19:48:14.769266] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-03T19:48:14.770524] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-03T19:48:14.770593] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-03T19:48:15.157163] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:15.190703] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-03T19:48:15.930488] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:48:15.990703] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-03T19:48:16.790715] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-03T19:48:17.309500] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T19:48:17.357597] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:48:17.525367] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:48:17.590734] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-03T19:48:18.390684] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-03T19:48:18.957478] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T19:48:18.958515] [INFO ] [REMOTE ] KKRS: Full fetch complete (7863 records). [2025-10-03T19:48:18.958606] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-03T19:48:19.196216] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-03T19:48:19.389451] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-03T19:48:19.389731] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-03T19:48:19.390079] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-03T19:48:19.390194] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-03T19:48:19.391153] [DEBUG] [LOCAL ] KKRS: Trimmed 7863 records to 5753 (keeping 200 days of data) [2025-10-03T19:48:19.432419] [DEBUG] [LOCAL ] KKRS: Primary data saved (5753 records). [2025-10-03T19:48:19.432788] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-03T19:48:19.433029] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRS took 26.4s. Estimated remaining: 2h 44m 52s. Rate: 7.1 symbols/min [2025-10-03T19:48:19.466005] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T19:48:19.990687] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-03T19:48:20.519064] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:48:20.790707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-03T19:48:21.590636] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-03T19:48:21.952427] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T19:48:22.070691] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T19:48:22.390634] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-03T19:48:23.190685] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-03T19:48:23.813801] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T19:48:23.990802] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-03T19:48:24.229981] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T19:48:24.699994] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:48:24.790705] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-03T19:48:25.557480] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:48:25.590631] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-03T19:48:26.220317] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:48:26.390717] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-03T19:48:27.190760] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-03T19:48:27.545743] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T19:48:27.864453] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:48:27.990689] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-03T19:48:28.790716] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-03T19:48:29.007117] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T19:48:29.590692] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-03T19:48:29.960926] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:48:30.071853] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T19:48:30.390684] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-03T19:48:31.190696] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-03T19:48:31.253003] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T19:48:31.255838] [INFO ] [REMOTE ] KKR: Full fetch complete (77447 records). [2025-10-03T19:48:31.255966] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-03T19:48:31.327238] [DEBUG] [REMOTE ] KMI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T19:48:31.345527] [WARN ] [REMOTE ] KMI: No data returned for month 2025-05 [2025-10-03T19:48:31.370080] [FATAL] [REMOTE ] KMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:31.417682] [FATAL] [MAIN ] KMI: Failed to fetch primary data. [2025-10-03T19:48:31.453354] [WARN ] [MAIN ] KMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:31.464610] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-03T19:48:31.522513] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-10-03T19:48:31.558605] [INFO ] [LOCAL ] KMI: Starting deletion of derivative data. [2025-10-03T19:48:31.613453] [DEBUG] [LOCAL ] KMI: Deleted derivative data file. [2025-10-03T19:48:31.634759] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KMI took 17.3s. Estimated remaining: 2h 44m 48s. Rate: 7.1 symbols/min [2025-10-03T19:48:31.734751] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-03T19:48:31.735468] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-03T19:48:31.738100] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T19:48:31.736640] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-03T19:48:31.746001] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-03T19:48:31.748343] [DEBUG] [LOCAL ] KKR: Trimmed 77447 records to 54280 (keeping 200 days of data) [2025-10-03T19:48:31.992228] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-03T19:48:32.106291] [DEBUG] [LOCAL ] KKR: Primary data saved (54280 records). [2025-10-03T19:48:32.106449] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-03T19:48:32.106538] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KKR took 40.7s. Estimated remaining: 2h 44m 32s. Rate: 7.1 symbols/min [2025-10-03T19:48:33.454743] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:48:33.463799] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-03T19:48:34.788494] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T19:48:34.797678] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-03T19:48:36.059501] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:48:36.061639] [INFO ] [REMOTE ] KLC: Full fetch complete (50743 records). [2025-10-03T19:48:36.061889] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-03T19:48:36.518336] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-03T19:48:36.518477] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-03T19:48:36.519567] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-03T19:48:36.519673] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-03T19:48:36.521552] [DEBUG] [LOCAL ] KLC: Trimmed 50743 records to 37278 (keeping 200 days of data) [2025-10-03T19:48:36.743793] [DEBUG] [LOCAL ] KLC: Primary data saved (37278 records). [2025-10-03T19:48:36.743944] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-03T19:48:36.744043] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KLC took 30.9s. Estimated remaining: 2h 44m 19s. Rate: 7.1 symbols/min [2025-10-03T19:48:37.454403] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.487314] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.477182] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.510255] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.524359] [DEBUG] [LOCAL ] KMPB: Loaded 3795 existing records from primary storage. [2025-10-03T19:48:37.524848] [INFO ] [MAIN ] KMPB: Loaded 3795 existing records. [2025-10-03T19:48:37.810342] [DEBUG] [LOCAL ] KMPR: Loaded 39204 existing records from primary storage. [2025-10-03T19:48:37.811214] [DEBUG] [LOCAL ] KMT: Loaded 43222 existing records from primary storage. [2025-10-03T19:48:37.808913] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:37.811669] [INFO ] [MAIN ] KMPR: Loaded 39204 existing records. [2025-10-03T19:48:37.817213] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-03T19:48:37.817308] [INFO ] [MAIN ] KMT: Loaded 43222 existing records. [2025-10-03T19:48:37.860962] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-03T19:48:37.964449] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-03T19:48:37.974672] [DEBUG] [LOCAL ] KMX: Loaded 53551 existing records from primary storage. [2025-10-03T19:48:38.000800] [INFO ] [MAIN ] KMX: Loaded 53551 existing records. [2025-10-03T19:48:37.995429] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-03T19:48:38.395935] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.523105] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.523275] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.592044] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-03T19:48:38.650473] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.650760] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-03T19:48:38.650322] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.650946] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.650996] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-03T19:48:38.651118] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-03T19:48:38.651201] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-03T19:48:38.670112] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-03T19:48:38.663999] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-03T19:48:38.741535] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-03T19:48:38.767368] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-03T19:48:39.336852] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:39.418927] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-03T19:48:40.030975] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:39.995161] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:40.042053] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-03T19:48:40.042371] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-03T19:48:40.118445] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:40.118920] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-03T19:48:40.316900] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T19:48:40.318442] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-03T19:48:40.762549] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:48:40.763840] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-03T19:48:41.314765] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T19:48:41.316460] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-03T19:48:41.577059] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:48:41.583572] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-03T19:48:41.745271] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:48:41.756793] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-03T19:48:41.782379] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:48:41.792034] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-03T19:48:41.984736] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:48:42.390740] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-03T19:48:42.609748] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:48:42.844373] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T19:48:43.190666] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-03T19:48:43.289274] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:48:43.499402] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:48:43.695603] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T19:48:43.990734] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-03T19:48:44.556870] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T19:48:44.790694] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-03T19:48:45.590706] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-03T19:48:46.402047] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-03T19:48:46.407493] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:48:46.763972] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:48:47.190686] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-03T19:48:47.708283] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:48:47.990729] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-03T19:48:48.592841] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:48:48.790742] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-03T19:48:49.218242] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:48:49.590637] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-03T19:48:50.390688] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-03T19:48:50.797785] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:48:50.865901] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T19:48:51.190732] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-03T19:48:51.499174] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:48:51.990725] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-03T19:48:52.184038] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:48:52.790734] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-03T19:48:53.590632] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-03T19:48:53.681926] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:48:54.066053] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:48:54.390735] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-03T19:48:54.908533] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T19:48:55.190705] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-03T19:48:55.377993] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:48:55.750923] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T19:48:55.990717] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-03T19:48:56.790724] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-03T19:48:57.547367] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:48:57.590627] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-03T19:48:58.332115] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T19:48:58.390698] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-03T19:48:59.039414] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:48:59.190698] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-03T19:48:59.990681] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-03T19:49:00.077686] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:49:00.790718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-03T19:49:01.081370] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T19:49:01.586805] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T19:49:01.599164] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-03T19:49:02.139824] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:49:02.390726] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-03T19:49:02.723957] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T19:49:03.192250] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:49:03.192335] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-03T19:49:03.748789] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:49:03.749560] [INFO ] [REMOTE ] KMPB: Full fetch complete (5132 records). [2025-10-03T19:49:03.749633] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-03T19:49:03.996230] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-03T19:49:04.142613] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-03T19:49:04.142726] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-03T19:49:04.142904] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-03T19:49:04.142984] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-03T19:49:04.143415] [DEBUG] [LOCAL ] KMPB: Trimmed 5132 records to 3810 (keeping 200 days of data) [2025-10-03T19:49:04.166825] [DEBUG] [LOCAL ] KMPB: Primary data saved (3810 records). [2025-10-03T19:49:04.166936] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-03T19:49:04.167045] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPB took 27.4s. Estimated remaining: 2h 44m 29s. Rate: 7.1 symbols/min [2025-10-03T19:49:04.341134] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:04.383288] [DEBUG] [LOCAL ] KN: Loaded 38880 existing records from primary storage. [2025-10-03T19:49:04.383608] [INFO ] [MAIN ] KN: Loaded 38880 existing records. [2025-10-03T19:49:04.580677] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:04.580979] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-03T19:49:04.581036] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-03T19:49:04.581467] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-03T19:49:04.581526] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-03T19:49:04.795879] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-03T19:49:04.979763] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:05.590697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-03T19:49:05.693025] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:49:06.258930] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:49:06.261193] [INFO ] [REMOTE ] KMPR: Full fetch complete (51629 records). [2025-10-03T19:49:06.261283] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-03T19:49:06.395877] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-03T19:49:06.700288] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-03T19:49:06.700383] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-03T19:49:06.701353] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-03T19:49:06.701420] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-03T19:49:06.703030] [DEBUG] [LOCAL ] KMPR: Trimmed 51629 records to 39497 (keeping 200 days of data) [2025-10-03T19:49:06.962047] [DEBUG] [LOCAL ] KMPR: Primary data saved (39497 records). [2025-10-03T19:49:06.962618] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-03T19:49:06.962847] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPR took 30.2s. Estimated remaining: 2h 44m 16s. Rate: 7.1 symbols/min [2025-10-03T19:49:07.154460] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:49:07.193128] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-03T19:49:07.193038] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:07.236721] [DEBUG] [LOCAL ] KNF: Loaded 36189 existing records from primary storage. [2025-10-03T19:49:07.237076] [INFO ] [MAIN ] KNF: Loaded 36189 existing records. [2025-10-03T19:49:07.436742] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:07.437004] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-03T19:49:07.437059] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-03T19:49:07.437493] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-03T19:49:07.437551] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-03T19:49:07.838173] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:07.990668] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-03T19:49:08.307684] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T19:49:08.750670] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:49:08.790708] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-03T19:49:09.506304] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:49:09.590694] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-03T19:49:10.292350] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:49:10.390694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-03T19:49:11.190632] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-03T19:49:11.322216] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T19:49:11.615202] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:49:11.990682] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-03T19:49:12.587225] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:49:12.589577] [INFO ] [REMOTE ] KMT: Full fetch complete (62141 records). [2025-10-03T19:49:12.589718] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-03T19:49:12.803016] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-03T19:49:13.017885] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-03T19:49:13.018024] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-03T19:49:13.019151] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-03T19:49:13.019222] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-03T19:49:13.020677] [DEBUG] [LOCAL ] KMT: Trimmed 62141 records to 43553 (keeping 200 days of data) [2025-10-03T19:49:13.294108] [DEBUG] [LOCAL ] KMT: Primary data saved (43553 records). [2025-10-03T19:49:13.294239] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-03T19:49:13.294327] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KMT took 36.5s. Estimated remaining: 2h 44m 5s. Rate: 7.1 symbols/min [2025-10-03T19:49:13.429827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T19:49:13.510389] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:13.521808] [DEBUG] [LOCAL ] KNOP: Loaded 10514 existing records from primary storage. [2025-10-03T19:49:13.522029] [INFO ] [MAIN ] KNOP: Loaded 10514 existing records. [2025-10-03T19:49:13.599758] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-03T19:49:13.723872] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:13.724151] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-03T19:49:13.724224] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-03T19:49:13.724468] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-03T19:49:13.724527] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-03T19:49:14.120039] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:14.360874] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:49:14.390630] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-03T19:49:14.837275] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:49:15.190708] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-03T19:49:15.913024] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:49:15.990629] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-03T19:49:16.790673] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-03T19:49:16.970056] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:49:16.974756] [INFO ] [REMOTE ] KMX: Full fetch complete (76095 records). [2025-10-03T19:49:16.974896] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-03T19:49:17.392293] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-03T19:49:17.392378] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-03T19:49:17.393513] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-03T19:49:17.393583] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-03T19:49:17.396617] [DEBUG] [LOCAL ] KMX: Trimmed 76095 records to 53938 (keeping 200 days of data) [2025-10-03T19:49:17.609838] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-03T19:49:17.674488] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:49:17.777089] [DEBUG] [LOCAL ] KMX: Primary data saved (53938 records). [2025-10-03T19:49:17.777243] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-03T19:49:17.777355] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMX took 41.0s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-03T19:49:17.962878] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:17.984635] [DEBUG] [LOCAL ] KNSL: Loaded 18336 existing records from primary storage. [2025-10-03T19:49:17.985097] [INFO ] [MAIN ] KNSL: Loaded 18336 existing records. [2025-10-03T19:49:18.180328] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:18.180739] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-03T19:49:18.180812] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-03T19:49:18.181224] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-03T19:49:18.181308] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-03T19:49:18.300477] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:49:18.392788] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-03T19:49:18.625337] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:18.626885] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:49:19.190695] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-03T19:49:19.984709] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:49:19.992712] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-03T19:49:20.061843] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:49:20.784377] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:49:20.790597] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-03T19:49:21.508801] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:49:21.590735] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-03T19:49:22.390688] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-03T19:49:23.050255] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:49:23.190687] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-03T19:49:23.386759] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T19:49:23.990695] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-03T19:49:24.724126] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:49:24.790624] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-03T19:49:24.952598] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:49:25.590712] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-03T19:49:26.390695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-03T19:49:27.190683] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-03T19:49:27.268583] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T19:49:27.729120] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-03T19:49:27.990691] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-03T19:49:28.310860] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-03T19:49:28.682357] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T19:49:28.790693] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-03T19:49:29.455615] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:49:29.590752] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-03T19:49:29.897457] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:49:30.390705] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-03T19:49:31.033022] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:49:31.035135] [INFO ] [REMOTE ] KNF: Full fetch complete (50830 records). [2025-10-03T19:49:31.035229] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-03T19:49:31.195741] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-03T19:49:31.395370] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T19:49:31.494283] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-03T19:49:31.494374] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-03T19:49:31.495243] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-03T19:49:31.495309] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-03T19:49:31.496798] [DEBUG] [LOCAL ] KNF: Trimmed 50830 records to 36421 (keeping 200 days of data) [2025-10-03T19:49:31.722728] [DEBUG] [LOCAL ] KNF: Primary data saved (36421 records). [2025-10-03T19:49:31.722873] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-03T19:49:31.722977] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KNF took 24.8s. Estimated remaining: 2h 43m 50s. Rate: 7.1 symbols/min [2025-10-03T19:49:31.899310] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:31.946019] [DEBUG] [LOCAL ] KNTK: Loaded 46533 existing records from primary storage. [2025-10-03T19:49:31.946332] [INFO ] [MAIN ] KNTK: Loaded 46533 existing records. [2025-10-03T19:49:31.995923] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-03T19:49:32.140250] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:32.140505] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-03T19:49:32.140559] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-03T19:49:32.141000] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-03T19:49:32.141061] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-03T19:49:32.567527] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:32.720143] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:49:32.790628] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-03T19:49:33.148722] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T19:49:33.590689] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-03T19:49:33.806004] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:49:34.390699] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-03T19:49:34.609131] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:49:35.190632] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-03T19:49:35.280210] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:49:35.990709] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-03T19:49:36.557440] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:49:36.790619] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-03T19:49:37.025026] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T19:49:37.590738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-03T19:49:38.216145] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:49:38.361153] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T19:49:38.390689] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-03T19:49:39.106391] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:49:39.190679] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-03T19:49:39.974074] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:49:39.990606] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-03T19:49:40.720224] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T19:49:40.790664] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-03T19:49:41.590708] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-03T19:49:41.603762] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:49:42.390725] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-03T19:49:42.701308] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:49:42.703702] [INFO ] [REMOTE ] KN: Full fetch complete (56623 records). [2025-10-03T19:49:42.703834] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-03T19:49:43.128834] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-03T19:49:43.128930] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-03T19:49:43.129878] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-03T19:49:43.129945] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-03T19:49:43.131294] [DEBUG] [LOCAL ] KN: Trimmed 56623 records to 39160 (keeping 200 days of data) [2025-10-03T19:49:43.215768] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-03T19:49:43.364612] [DEBUG] [LOCAL ] KN: Primary data saved (39160 records). [2025-10-03T19:49:43.364789] [INFO ] [MAIN ] KN: Full history saved. [2025-10-03T19:49:43.365713] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 39.2s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-03T19:49:43.544834] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:43.606103] [DEBUG] [LOCAL ] KNX: Loaded 52978 existing records from primary storage. [2025-10-03T19:49:43.606468] [INFO ] [MAIN ] KNX: Loaded 52978 existing records. [2025-10-03T19:49:43.801912] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:43.802223] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-03T19:49:43.802277] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-03T19:49:43.802823] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-03T19:49:43.802889] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-03T19:49:43.992254] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-03T19:49:44.020940] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:49:44.106074] [INFO ] [REMOTE ] KNOP: Full fetch complete (14733 records). [2025-10-03T19:49:44.144717] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-03T19:49:44.188607] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T19:49:44.369904] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:44.659904] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-03T19:49:44.659980] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-03T19:49:44.660296] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-03T19:49:44.660339] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-03T19:49:44.660882] [DEBUG] [LOCAL ] KNOP: Trimmed 14733 records to 10576 (keeping 200 days of data) [2025-10-03T19:49:44.722558] [DEBUG] [LOCAL ] KNOP: Primary data saved (10576 records). [2025-10-03T19:49:44.722742] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-03T19:49:44.722838] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KNOP took 31.4s. Estimated remaining: 2h 43m 29s. Rate: 7.1 symbols/min [2025-10-03T19:49:44.797779] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-03T19:49:44.925474] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:44.925692] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-03T19:49:44.925747] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-03T19:49:44.925859] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-03T19:49:44.925901] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-03T19:49:44.925942] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-03T19:49:44.925974] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-03T19:49:45.244834] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T19:49:45.362017] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:45.590744] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-03T19:49:46.390684] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-03T19:49:46.494734] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T19:49:47.190726] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-03T19:49:47.990708] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-03T19:49:48.129621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:49:48.790682] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-03T19:49:48.904749] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:49:49.151616] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:49:49.590695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-03T19:49:50.074234] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (4.48 seconds). [2025-10-03T19:49:50.390732] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-03T19:49:50.455670] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:49:50.507571] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T19:49:51.190760] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-03T19:49:51.965085] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:49:51.990627] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-03T19:49:52.801635] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-03T19:49:52.809375] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:49:53.590741] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-03T19:49:53.799010] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T19:49:54.390792] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-03T19:49:55.196703] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-03T19:49:55.223861] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T19:49:55.280301] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:49:55.990735] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-03T19:49:56.092772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T19:49:56.268736] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:49:56.790734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-03T19:49:57.541751] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T19:49:57.590688] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-03T19:49:58.390689] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-03T19:49:58.625756] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:49:59.190679] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-03T19:49:59.358438] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T19:49:59.360179] [INFO ] [REMOTE ] KNSL: Full fetch complete (26774 records). [2025-10-03T19:49:59.360435] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-03T19:49:59.741039] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-03T19:49:59.741152] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-03T19:49:59.742560] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-03T19:49:59.742630] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-03T19:49:59.743609] [DEBUG] [LOCAL ] KNSL: Trimmed 26774 records to 18503 (keeping 200 days of data) [2025-10-03T19:49:59.873337] [DEBUG] [LOCAL ] KNSL: Primary data saved (18503 records). [2025-10-03T19:49:59.873558] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-03T19:49:59.873696] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNSL took 42.1s. Estimated remaining: 2h 43m 27s. Rate: 7.1 symbols/min [2025-10-03T19:49:59.996376] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-03T19:50:00.068967] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-03T19:50:00.118831] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:00.171320] [DEBUG] [LOCAL ] KODK: Loaded 43779 existing records from primary storage. [2025-10-03T19:50:00.171794] [INFO ] [MAIN ] KODK: Loaded 43779 existing records. [2025-10-03T19:50:00.370043] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:00.370312] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-03T19:50:00.370364] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-03T19:50:00.370967] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-03T19:50:00.371030] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-03T19:50:00.795948] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-03T19:50:00.802852] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:01.590767] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-03T19:50:02.039187] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:50:02.043739] [INFO ] [REMOTE ] KNTK: Full fetch complete (64774 records). [2025-10-03T19:50:02.044223] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-03T19:50:02.491188] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-03T19:50:02.491410] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-03T19:50:02.493195] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-03T19:50:02.493276] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-03T19:50:02.495957] [DEBUG] [LOCAL ] KNTK: Trimmed 64774 records to 46914 (keeping 200 days of data) [2025-10-03T19:50:02.820090] [DEBUG] [LOCAL ] KNTK: Primary data saved (46914 records). [2025-10-03T19:50:02.820323] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-03T19:50:02.820561] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNTK took 31.1s. Estimated remaining: 2h 43m 13s. Rate: 7.1 symbols/min [2025-10-03T19:50:03.005628] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:03.036630] [DEBUG] [LOCAL ] KOF: Loaded 26353 existing records from primary storage. [2025-10-03T19:50:03.037002] [INFO ] [MAIN ] KOF: Loaded 26353 existing records. [2025-10-03T19:50:03.235756] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:03.269791] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-03T19:50:03.273665] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-03T19:50:03.276380] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (4.09 seconds). [2025-10-03T19:50:03.287511] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-03T19:50:03.288321] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-03T19:50:03.288815] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-03T19:50:03.716110] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:03.716946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-03T19:50:03.974854] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-03T19:50:03.990612] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-03T19:50:05.809225] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T19:50:05.819180] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-03T19:50:05.957251] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-03T19:50:05.969456] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-03T19:50:07.133830] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (7.14 seconds). [2025-10-03T19:50:07.159327] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-03T19:50:07.175813] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:50:07.190607] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-03T19:50:08.679397] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-03T19:50:08.691477] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-03T19:50:08.820014] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:50:08.831253] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-03T19:50:08.969691] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:50:09.590700] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-03T19:50:10.075262] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (6.36 seconds). [2025-10-03T19:50:10.390679] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-03T19:50:10.518094] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:50:11.190678] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-03T19:50:11.332748] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-03T19:50:11.463566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:50:11.608099] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:50:11.990683] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-03T19:50:12.790631] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-03T19:50:12.989131] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:50:13.193294] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T19:50:13.590705] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-03T19:50:14.225180] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:50:14.390722] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-03T19:50:15.190734] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-03T19:50:15.475284] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:50:15.990695] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-03T19:50:16.157103] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-03T19:50:16.790737] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-03T19:50:17.550727] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:50:17.554046] [INFO ] [REMOTE ] KNX: Full fetch complete (75853 records). [2025-10-03T19:50:17.554189] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-03T19:50:17.595856] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-03T19:50:18.009166] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-03T19:50:18.009332] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-03T19:50:18.010550] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-03T19:50:18.010684] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-03T19:50:18.042493] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-03T19:50:18.053784] [DEBUG] [LOCAL ] KNX: Trimmed 75853 records to 53368 (keeping 200 days of data) [2025-10-03T19:50:18.390633] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-03T19:50:18.411461] [DEBUG] [LOCAL ] KNX: Primary data saved (53368 records). [2025-10-03T19:50:18.411583] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-03T19:50:18.412303] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNX took 35.0s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-03T19:50:18.599772] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:18.636244] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T19:50:18.662449] [DEBUG] [LOCAL ] KOP: Loaded 17741 existing records from primary storage. [2025-10-03T19:50:18.662726] [INFO ] [MAIN ] KOP: Loaded 17741 existing records. [2025-10-03T19:50:18.861546] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:18.861865] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-03T19:50:18.861915] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-03T19:50:18.862246] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-03T19:50:18.862307] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-03T19:50:19.195761] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-03T19:50:19.267445] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:19.279884] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:50:19.990688] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-03T19:50:20.790632] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-03T19:50:20.976867] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:50:21.127016] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-03T19:50:21.411315] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:50:21.590761] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-03T19:50:22.017139] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T19:50:22.390685] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-03T19:50:22.581860] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:50:23.190669] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-03T19:50:23.990689] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-03T19:50:24.108585] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T19:50:24.790684] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-03T19:50:25.409283] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:50:25.590632] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-03T19:50:25.859483] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-03T19:50:25.907803] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T19:50:26.390629] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-03T19:50:26.920295] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:50:26.923504] [INFO ] [REMOTE ] KODK: Full fetch complete (63410 records). [2025-10-03T19:50:26.923670] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-03T19:50:27.197749] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-03T19:50:27.383038] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-03T19:50:27.383126] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-03T19:50:27.384139] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-03T19:50:27.384207] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-03T19:50:27.386279] [DEBUG] [LOCAL ] KODK: Trimmed 63410 records to 44096 (keeping 200 days of data) [2025-10-03T19:50:27.646355] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:50:27.670214] [DEBUG] [LOCAL ] KODK: Primary data saved (44096 records). [2025-10-03T19:50:27.670542] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-03T19:50:27.670629] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KODK took 27.8s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-03T19:50:27.872592] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:27.877256] [DEBUG] [LOCAL ] KORE: Loaded 2034 existing records from primary storage. [2025-10-03T19:50:27.877438] [INFO ] [MAIN ] KORE: Loaded 2034 existing records. [2025-10-03T19:50:27.994608] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-03T19:50:28.086814] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:28.087113] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-03T19:50:28.087182] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-03T19:50:28.087385] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-03T19:50:28.087447] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-03T19:50:28.517199] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:28.790700] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-03T19:50:29.131460] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:50:29.590739] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-03T19:50:29.752853] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T19:50:29.793770] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T19:50:30.390670] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-03T19:50:30.684295] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T19:50:31.190708] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-03T19:50:31.865389] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:50:31.990713] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-03T19:50:32.756750] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T19:50:32.790636] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-03T19:50:33.046915] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:50:33.590699] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-03T19:50:33.890540] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:50:33.894967] [INFO ] [REMOTE ] KOF: Full fetch complete (37405 records). [2025-10-03T19:50:33.895107] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-03T19:50:34.327470] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-03T19:50:34.327567] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-03T19:50:34.328539] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-03T19:50:34.328610] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-03T19:50:34.329883] [DEBUG] [LOCAL ] KOF: Trimmed 37405 records to 26587 (keeping 200 days of data) [2025-10-03T19:50:34.398715] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-03T19:50:34.510372] [DEBUG] [LOCAL ] KOF: Primary data saved (26587 records). [2025-10-03T19:50:34.510527] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-03T19:50:34.510626] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KOF took 31.7s. Estimated remaining: 2h 42m 54s. Rate: 7.1 symbols/min [2025-10-03T19:50:34.709010] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:34.767583] [DEBUG] [LOCAL ] KOS: Loaded 53441 existing records from primary storage. [2025-10-03T19:50:34.768019] [INFO ] [MAIN ] KOS: Loaded 53441 existing records. [2025-10-03T19:50:34.970390] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:34.970670] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-03T19:50:34.970736] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-03T19:50:34.972042] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-03T19:50:34.972106] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-03T19:50:35.199383] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-03T19:50:35.361883] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:35.407600] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:50:35.832401] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:50:35.847681] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T19:50:35.850469] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-03T19:50:35.850617] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-03T19:50:35.995867] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-03T19:50:36.078658] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T19:50:36.079628] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:50:36.079776] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:50:36.079853] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-03T19:50:36.079927] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-03T19:50:36.079966] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-03T19:50:36.080021] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-03T19:50:36.080137] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KO took 51.4s. Estimated remaining: 2h 42m 39s. Rate: 7.1 symbols/min [2025-10-03T19:50:36.267276] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:36.330227] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-03T19:50:36.330617] [INFO ] [MAIN ] KR: Loaded 54071 existing records. [2025-10-03T19:50:36.524567] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:36.524880] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-03T19:50:36.524934] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-03T19:50:36.527122] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-03T19:50:36.527190] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-03T19:50:36.795843] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-03T19:50:36.907876] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:37.340192] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T19:50:37.590683] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-03T19:50:37.824070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:50:38.390694] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-03T19:50:38.852957] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:50:39.190710] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-03T19:50:39.285089] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:50:39.675801] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T19:50:39.990725] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-03T19:50:40.433936] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:50:40.790680] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-03T19:50:41.590708] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-03T19:50:42.390638] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-03T19:50:42.589822] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:50:42.921088] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-03T19:50:43.034198] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:50:43.190729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-03T19:50:43.990739] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-03T19:50:44.790740] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-03T19:50:44.837473] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:50:45.243329] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:50:45.590639] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-03T19:50:45.772122] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:50:46.037707] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T19:50:46.390708] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-03T19:50:47.190732] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-03T19:50:47.659222] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T19:50:47.660156] [INFO ] [REMOTE ] KORE: Full fetch complete (5859 records). [2025-10-03T19:50:47.660231] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-03T19:50:47.990946] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-03T19:50:48.072484] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-03T19:50:48.072680] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-03T19:50:48.073049] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-03T19:50:48.073116] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-03T19:50:48.073630] [DEBUG] [LOCAL ] KORE: Trimmed 5859 records to 2043 (keeping 200 days of data) [2025-10-03T19:50:48.086509] [DEBUG] [LOCAL ] KORE: Primary data saved (2043 records). [2025-10-03T19:50:48.086612] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-03T19:50:48.086754] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KORE took 20.4s. Estimated remaining: 2h 42m 34s. Rate: 7.1 symbols/min [2025-10-03T19:50:48.278536] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:48.325285] [DEBUG] [LOCAL ] KRC: Loaded 48621 existing records from primary storage. [2025-10-03T19:50:48.325607] [INFO ] [MAIN ] KRC: Loaded 48621 existing records. [2025-10-03T19:50:48.521746] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:48.522272] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-03T19:50:48.522331] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-03T19:50:48.522831] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-03T19:50:48.522894] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-03T19:50:48.799567] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-03T19:50:48.933007] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:49.083494] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-03T19:50:49.590703] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-03T19:50:49.763599] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:50:50.122111] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T19:50:50.390735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-03T19:50:51.190632] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-03T19:50:51.351003] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:50:51.904012] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-03T19:50:51.990723] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-03T19:50:52.790732] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-03T19:50:53.003785] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:50:53.092368] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:50:53.590671] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-03T19:50:54.286158] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T19:50:54.390722] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-03T19:50:55.190699] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-03T19:50:55.455707] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:50:55.538306] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:50:55.990711] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-03T19:50:56.790632] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-03T19:50:57.196273] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:50:57.574128] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:50:57.590633] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-03T19:50:58.390751] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-03T19:50:58.816175] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T19:50:59.197931] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-03T19:50:59.221235] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:50:59.250360] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:50:59.252264] [INFO ] [REMOTE ] KOP: Full fetch complete (25547 records). [2025-10-03T19:50:59.252352] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-03T19:50:59.667587] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-03T19:50:59.667718] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-03T19:50:59.668472] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-03T19:50:59.668538] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-03T19:50:59.669345] [DEBUG] [LOCAL ] KOP: Trimmed 25547 records to 17879 (keeping 200 days of data) [2025-10-03T19:50:59.789289] [DEBUG] [LOCAL ] KOP: Primary data saved (17879 records). [2025-10-03T19:50:59.789693] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-03T19:50:59.789908] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KOP took 41.4s. Estimated remaining: 2h 42m 29s. Rate: 7.1 symbols/min [2025-10-03T19:50:59.979517] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:59.990704] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-03T19:51:00.026099] [DEBUG] [LOCAL ] KREF: Loaded 37907 existing records from primary storage. [2025-10-03T19:51:00.026450] [INFO ] [MAIN ] KREF: Loaded 37907 existing records. [2025-10-03T19:51:00.216110] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:00.216369] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-03T19:51:00.216420] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-03T19:51:00.216882] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-03T19:51:00.216955] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-03T19:51:00.607601] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:00.790636] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-03T19:51:01.262412] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T19:51:01.590639] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-03T19:51:01.762359] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:51:02.390695] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-03T19:51:02.750969] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:51:03.030455] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T19:51:03.190735] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-03T19:51:03.990741] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-03T19:51:04.128316] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:51:04.220247] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T19:51:04.790740] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-03T19:51:05.590687] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-03T19:51:05.932055] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:51:06.390732] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-03T19:51:06.614313] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:51:07.074414] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:51:07.190686] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-03T19:51:07.990677] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-03T19:51:08.254999] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:51:08.760684] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:51:08.790633] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-03T19:51:09.197997] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T19:51:09.590724] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-03T19:51:10.390630] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-03T19:51:10.474146] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:51:11.190731] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-03T19:51:11.376739] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:51:11.936702] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:51:11.939853] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-03T19:51:11.940043] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-03T19:51:12.002999] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-03T19:51:12.420303] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-03T19:51:12.420411] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-03T19:51:12.421785] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-03T19:51:12.421860] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-03T19:51:12.423771] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54461 (keeping 200 days of data) [2025-10-03T19:51:12.790784] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-03T19:51:12.810162] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-10-03T19:51:12.810384] [INFO ] [MAIN ] KR: Full history saved. [2025-10-03T19:51:12.810490] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KR took 36.7s. Estimated remaining: 2h 42m 25s. Rate: 7.1 symbols/min [2025-10-03T19:51:12.981513] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:51:13.058148] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:13.105573] [DEBUG] [LOCAL ] KRG: Loaded 49512 existing records from primary storage. [2025-10-03T19:51:13.105948] [INFO ] [MAIN ] KRG: Loaded 49512 existing records. [2025-10-03T19:51:13.295870] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:13.296089] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-03T19:51:13.296203] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-03T19:51:13.297544] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-03T19:51:13.297606] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-03T19:51:13.595854] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-03T19:51:13.747581] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:13.891262] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T19:51:14.141232] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T19:51:14.390694] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-03T19:51:15.190684] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-03T19:51:15.347494] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:51:15.989384] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:51:15.991883] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-03T19:51:15.992965] [INFO ] [REMOTE ] KOS: Full fetch complete (76883 records). [2025-10-03T19:51:15.993065] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-03T19:51:16.452122] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-03T19:51:16.452333] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-03T19:51:16.453485] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-03T19:51:16.453683] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-03T19:51:16.455623] [DEBUG] [LOCAL ] KOS: Trimmed 76883 records to 53828 (keeping 200 days of data) [2025-10-03T19:51:16.697808] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:51:16.794315] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-03T19:51:16.823389] [DEBUG] [LOCAL ] KOS: Primary data saved (53828 records). [2025-10-03T19:51:16.823552] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-03T19:51:16.823680] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KOS took 42.3s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-03T19:51:17.045448] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:17.046018] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-03T19:51:17.046080] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-03T19:51:17.046242] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-03T19:51:17.046300] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-03T19:51:17.046349] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-03T19:51:17.046385] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-03T19:51:17.447021] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:17.472072] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T19:51:17.474597] [INFO ] [REMOTE ] KRC: Full fetch complete (69856 records). [2025-10-03T19:51:17.474757] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-03T19:51:17.592625] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-03T19:51:17.915483] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-03T19:51:17.915583] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-03T19:51:17.916769] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-03T19:51:17.916848] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-03T19:51:17.918402] [DEBUG] [LOCAL ] KRC: Trimmed 69856 records to 48988 (keeping 200 days of data) [2025-10-03T19:51:18.250730] [DEBUG] [LOCAL ] KRC: Primary data saved (48988 records). [2025-10-03T19:51:18.250893] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-03T19:51:18.251058] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KRC took 30.2s. Estimated remaining: 2h 41m 57s. Rate: 7.1 symbols/min [2025-10-03T19:51:18.395611] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-03T19:51:18.452481] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:18.480751] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:51:18.517594] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-10-03T19:51:18.517958] [INFO ] [MAIN ] KRO: Loaded 26251 existing records. [2025-10-03T19:51:18.678911] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:51:18.709179] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-03T19:51:18.716026] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:51:18.716247] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-03T19:51:18.715864] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:18.716730] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-03T19:51:18.716384] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:51:18.716908] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-03T19:51:18.717030] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-03T19:51:18.717550] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-03T19:51:18.717768] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-03T19:51:18.717858] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-03T19:51:18.718078] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-03T19:51:18.718120] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-03T19:51:18.718294] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KRMN took 1.9s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-03T19:51:18.952938] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:51:19.196476] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-03T19:51:19.191125] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:19.356715] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:19.384421] [DEBUG] [LOCAL ] KRP: Loaded 37273 existing records from primary storage. [2025-10-03T19:51:19.384748] [INFO ] [MAIN ] KRP: Loaded 37273 existing records. [2025-10-03T19:51:19.579431] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:19.579737] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-03T19:51:19.579794] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-03T19:51:19.580244] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-03T19:51:19.580303] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-03T19:51:19.958178] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:19.990698] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-03T19:51:20.795191] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-03T19:51:20.800608] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:51:21.331546] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:51:21.590698] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-03T19:51:21.981144] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:51:22.390701] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-03T19:51:22.975375] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:51:23.190677] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-03T19:51:23.401882] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T19:51:23.990737] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-03T19:51:24.495040] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T19:51:24.790718] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-03T19:51:25.590673] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-03T19:51:26.052126] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:51:26.271547] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:51:26.390719] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-03T19:51:27.071779] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:51:27.190724] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-03T19:51:27.910026] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:51:27.990687] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-03T19:51:28.546242] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:51:28.790702] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-03T19:51:29.476249] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:51:29.590633] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-03T19:51:29.737421] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:51:30.390705] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-03T19:51:30.956710] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T19:51:31.190728] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-03T19:51:31.707864] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T19:51:31.990703] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-03T19:51:32.792560] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-03T19:51:32.795561] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:51:33.502507] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:51:33.590708] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-03T19:51:34.308925] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:51:34.390737] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-03T19:51:35.195778] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-03T19:51:35.209185] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:51:35.378905] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:51:35.381438] [INFO ] [REMOTE ] KREF: Full fetch complete (52660 records). [2025-10-03T19:51:35.381558] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-03T19:51:35.822679] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-03T19:51:35.822841] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-03T19:51:35.823788] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-03T19:51:35.823856] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-03T19:51:35.825180] [DEBUG] [LOCAL ] KREF: Trimmed 52660 records to 38174 (keeping 200 days of data) [2025-10-03T19:51:36.005948] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-03T19:51:36.082377] [DEBUG] [LOCAL ] KREF: Primary data saved (38174 records). [2025-10-03T19:51:36.082546] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-03T19:51:36.084865] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 36.3s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-03T19:51:36.312684] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:36.371154] [DEBUG] [LOCAL ] KSS: Loaded 53992 existing records from primary storage. [2025-10-03T19:51:36.371527] [INFO ] [MAIN ] KSS: Loaded 53992 existing records. [2025-10-03T19:51:36.568585] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:36.568962] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-03T19:51:36.569080] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-03T19:51:36.569627] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-03T19:51:36.569779] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-03T19:51:36.801294] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:51:36.801430] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-03T19:51:37.013713] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:37.590690] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-03T19:51:38.141152] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:51:38.363285] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T19:51:38.390624] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-03T19:51:39.190714] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-03T19:51:39.575211] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T19:51:39.990635] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-03T19:51:40.226431] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-03T19:51:40.797197] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-03T19:51:40.817744] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:51:41.345827] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:51:41.590698] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-03T19:51:42.385262] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:51:42.395940] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-03T19:51:43.190692] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-03T19:51:43.244174] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:51:43.530813] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:51:43.990700] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-03T19:51:44.506716] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:51:44.790736] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-03T19:51:45.330294] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T19:51:45.333126] [INFO ] [REMOTE ] KRG: Full fetch complete (71148 records). [2025-10-03T19:51:45.333246] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-03T19:51:45.597336] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-03T19:51:45.769152] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-03T19:51:45.769240] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-03T19:51:45.770263] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-03T19:51:45.770331] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-03T19:51:45.771774] [DEBUG] [LOCAL ] KRG: Trimmed 71148 records to 49885 (keeping 200 days of data) [2025-10-03T19:51:46.018707] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T19:51:46.120364] [DEBUG] [LOCAL ] KRG: Primary data saved (49885 records). [2025-10-03T19:51:46.120513] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-03T19:51:46.120617] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRG took 33.3s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-03T19:51:46.300938] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:46.346061] [DEBUG] [LOCAL ] KT: Loaded 46056 existing records from primary storage. [2025-10-03T19:51:46.346391] [INFO ] [MAIN ] KT: Loaded 46056 existing records. [2025-10-03T19:51:46.395906] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-03T19:51:46.539585] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:46.539885] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-03T19:51:46.539948] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-03T19:51:46.543007] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-03T19:51:46.543074] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-03T19:51:46.925575] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:47.190635] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-03T19:51:47.301388] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:51:47.334876] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:51:47.990700] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-03T19:51:48.708849] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:51:48.790690] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-03T19:51:49.188477] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:51:49.590724] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-03T19:51:50.390692] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-03T19:51:50.758682] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T19:51:50.947580] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:51:51.190694] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-03T19:51:51.294827] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:51:51.296364] [INFO ] [REMOTE ] KRO: Full fetch complete (34986 records). [2025-10-03T19:51:51.296439] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-03T19:51:51.701278] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-03T19:51:51.701375] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-03T19:51:51.702194] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-03T19:51:51.702279] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-03T19:51:51.703184] [DEBUG] [LOCAL ] KRO: Trimmed 34986 records to 26399 (keeping 200 days of data) [2025-10-03T19:51:51.857780] [DEBUG] [LOCAL ] KRO: Primary data saved (26399 records). [2025-10-03T19:51:51.857917] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-03T19:51:51.858035] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRO took 33.6s. Estimated remaining: 2h 41m 23s. Rate: 7.1 symbols/min [2025-10-03T19:51:51.995886] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-03T19:51:52.050891] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:52.094103] [DEBUG] [LOCAL ] KTB: Loaded 41321 existing records from primary storage. [2025-10-03T19:51:52.094437] [INFO ] [MAIN ] KTB: Loaded 41321 existing records. [2025-10-03T19:51:52.287240] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:52.287453] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-03T19:51:52.287503] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-03T19:51:52.288002] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-03T19:51:52.288080] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-03T19:51:52.406466] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:51:52.422606] [INFO ] [REMOTE ] KRP: Full fetch complete (54902 records). [2025-10-03T19:51:52.438159] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-03T19:51:52.809935] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-03T19:51:52.921139] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:53.126181] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-03T19:51:53.126278] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-03T19:51:53.127227] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-03T19:51:53.127301] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-03T19:51:53.128582] [DEBUG] [LOCAL ] KRP: Trimmed 54902 records to 37479 (keeping 200 days of data) [2025-10-03T19:51:53.377882] [DEBUG] [LOCAL ] KRP: Primary data saved (37479 records). [2025-10-03T19:51:53.378075] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-03T19:51:53.378213] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRP took 34.7s. Estimated remaining: 2h 41m 8s. Rate: 7.1 symbols/min [2025-10-03T19:51:53.567505] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:53.582284] [DEBUG] [LOCAL ] KTF: Loaded 12632 existing records from primary storage. [2025-10-03T19:51:53.582547] [INFO ] [MAIN ] KTF: Loaded 12632 existing records. [2025-10-03T19:51:53.618548] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-03T19:51:53.799864] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:53.800221] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-03T19:51:53.800329] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-03T19:51:53.801303] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-03T19:51:53.801367] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-03T19:51:54.211940] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:54.244599] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T19:51:54.390689] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-03T19:51:54.609061] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:51:54.695918] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:51:55.190681] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-03T19:51:55.323099] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:51:55.990741] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-03T19:51:56.790741] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-03T19:51:57.200282] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:51:57.363347] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:51:57.376964] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:51:57.590720] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-03T19:51:58.390710] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-03T19:51:59.043536] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:51:59.190628] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-03T19:51:59.345789] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:51:59.990727] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-03T19:52:00.656305] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:52:00.790740] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-03T19:52:01.590690] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-03T19:52:01.948067] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:52:02.171978] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:52:02.390687] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-03T19:52:02.605033] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T19:52:03.190714] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-03T19:52:03.990703] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-03T19:52:04.059619] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:52:04.790695] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-03T19:52:05.070365] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:52:05.590735] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-03T19:52:05.770597] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T19:52:05.950062] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:52:06.390696] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-03T19:52:07.167685] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:52:07.190632] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-03T19:52:07.231089] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:52:07.990696] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-03T19:52:08.790704] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-03T19:52:08.906240] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:52:09.413012] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-03T19:52:09.590710] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-03T19:52:10.174911] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:52:10.390689] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-03T19:52:10.904326] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:52:11.190688] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-03T19:52:11.921279] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:52:11.990731] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-03T19:52:12.790667] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-03T19:52:12.823711] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:52:12.843420] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:52:13.590700] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-03T19:52:14.147279] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:52:14.373008] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:52:14.390752] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-03T19:52:15.190673] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-03T19:52:15.983020] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:52:15.992485] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-03T19:52:16.756917] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:52:16.790621] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-03T19:52:16.913487] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:52:17.417665] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:52:17.418763] [INFO ] [REMOTE ] KTF: Full fetch complete (17769 records). [2025-10-03T19:52:17.418842] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-03T19:52:17.602627] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-03T19:52:17.848155] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-03T19:52:17.848239] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-03T19:52:17.848746] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-03T19:52:17.848828] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-03T19:52:17.849629] [DEBUG] [LOCAL ] KTF: Trimmed 17769 records to 12698 (keeping 200 days of data) [2025-10-03T19:52:17.933568] [DEBUG] [LOCAL ] KTF: Primary data saved (12698 records). [2025-10-03T19:52:17.933744] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-03T19:52:17.933841] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KTF took 24.6s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-03T19:52:18.158437] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:18.158862] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-03T19:52:18.158926] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-03T19:52:18.159221] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-03T19:52:18.159289] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-03T19:52:18.159358] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-03T19:52:18.159398] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-03T19:52:18.395820] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-03T19:52:18.564779] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:19.190634] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-03T19:52:19.540964] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:52:19.995803] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-03T19:52:20.017118] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:52:20.777486] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:52:20.790611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-03T19:52:21.410131] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:52:21.415988] [INFO ] [REMOTE ] KSS: Full fetch complete (77633 records). [2025-10-03T19:52:21.416288] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-03T19:52:21.591983] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-03T19:52:21.850976] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-03T19:52:21.851108] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-03T19:52:21.852396] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-03T19:52:21.852485] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-03T19:52:21.854462] [DEBUG] [LOCAL ] KSS: Trimmed 77633 records to 54381 (keeping 200 days of data) [2025-10-03T19:52:21.993870] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:52:22.237350] [DEBUG] [LOCAL ] KSS: Primary data saved (54381 records). [2025-10-03T19:52:22.237551] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-03T19:52:22.238396] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KSS took 46.2s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-10-03T19:52:22.395788] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-03T19:52:22.443319] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:22.512934] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-03T19:52:22.513382] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-03T19:52:22.724688] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:22.725008] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-03T19:52:22.725070] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-03T19:52:22.725681] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-03T19:52:22.725748] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-03T19:52:23.130908] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:23.190702] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-03T19:52:23.386909] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T19:52:23.660383] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:52:23.662526] [INFO ] [REMOTE ] KTB: Full fetch complete (57964 records). [2025-10-03T19:52:23.662787] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-03T19:52:23.995909] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-03T19:52:24.075639] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-03T19:52:24.075759] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-03T19:52:24.076779] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-03T19:52:24.076847] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-03T19:52:24.078175] [DEBUG] [LOCAL ] KTB: Trimmed 57964 records to 41546 (keeping 200 days of data) [2025-10-03T19:52:24.354823] [DEBUG] [LOCAL ] KTB: Primary data saved (41546 records). [2025-10-03T19:52:24.354961] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-03T19:52:24.355086] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KTB took 32.5s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-03T19:52:24.535961] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:24.589228] [DEBUG] [LOCAL ] KVYO: Loaded 50458 existing records from primary storage. [2025-10-03T19:52:24.589560] [INFO ] [MAIN ] KVYO: Loaded 50458 existing records. [2025-10-03T19:52:24.786924] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:24.787266] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-03T19:52:24.787348] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-03T19:52:24.787905] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-03T19:52:24.787983] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-03T19:52:24.799559] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-03T19:52:25.205952] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:25.238196] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T19:52:25.238914] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:52:25.254505] [INFO ] [REMOTE ] KT: Full fetch complete (66637 records). [2025-10-03T19:52:25.254696] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-03T19:52:25.584680] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:52:25.598145] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-03T19:52:25.703265] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-03T19:52:25.703347] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-03T19:52:25.704348] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-03T19:52:25.704424] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-03T19:52:25.705892] [DEBUG] [LOCAL ] KT: Trimmed 66637 records to 46344 (keeping 200 days of data) [2025-10-03T19:52:26.000006] [DEBUG] [LOCAL ] KT: Primary data saved (46344 records). [2025-10-03T19:52:26.000147] [INFO ] [MAIN ] KT: Full history saved. [2025-10-03T19:52:26.000270] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KT took 39.9s. Estimated remaining: 2h 40m 33s. Rate: 7.1 symbols/min [2025-10-03T19:52:26.192959] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:26.234118] [DEBUG] [LOCAL ] KW: Loaded 40831 existing records from primary storage. [2025-10-03T19:52:26.234519] [INFO ] [MAIN ] KW: Loaded 40831 existing records. [2025-10-03T19:52:26.398351] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-03T19:52:26.444420] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:26.444735] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-03T19:52:26.444801] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-03T19:52:26.445277] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-03T19:52:26.445338] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-03T19:52:26.869976] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:27.190733] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-03T19:52:27.328408] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T19:52:27.387959] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:52:27.990701] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-03T19:52:28.539983] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:52:28.717942] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T19:52:28.790706] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-03T19:52:29.590737] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-03T19:52:30.390633] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-03T19:52:30.517078] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:52:31.190737] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-03T19:52:31.257504] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:52:31.377365] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:52:31.990632] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-03T19:52:32.071549] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T19:52:32.790702] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-03T19:52:33.340302] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T19:52:33.590720] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-03T19:52:33.695832] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:52:34.390681] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-03T19:52:34.831782] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T19:52:34.855356] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:52:35.190722] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-03T19:52:35.990694] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-03T19:52:36.790677] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-03T19:52:36.875079] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:52:37.365667] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T19:52:37.392328] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:52:37.590720] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-03T19:52:38.390675] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-03T19:52:39.158545] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:52:39.190634] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-03T19:52:39.990744] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-03T19:52:40.237699] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T19:52:40.790631] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-03T19:52:40.915787] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:52:41.548230] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:52:41.590636] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-03T19:52:42.390668] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-03T19:52:42.543996] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:52:43.118112] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:52:43.190668] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-03T19:52:43.990717] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-03T19:52:44.075552] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:52:44.602013] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:52:44.632463] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T19:52:44.790712] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-03T19:52:45.387614] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:52:45.590694] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-03T19:52:46.390680] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-03T19:52:47.190725] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-03T19:52:47.341174] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:52:47.798029] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:52:47.990760] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-03T19:52:48.780456] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T19:52:48.790676] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-03T19:52:49.132364] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T19:52:49.590728] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-03T19:52:49.600234] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:52:49.602041] [INFO ] [REMOTE ] KUKE: Full fetch complete (8552 records). [2025-10-03T19:52:49.602162] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-03T19:52:49.890449] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T19:52:49.890770] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:52:49.890833] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:52:49.890902] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-03T19:52:49.890970] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-03T19:52:49.891008] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-03T19:52:49.891052] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-03T19:52:49.891114] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KUKE took 32.0s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-03T19:52:50.076183] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:50.098985] [DEBUG] [LOCAL ] KWR: Loaded 16654 existing records from primary storage. [2025-10-03T19:52:50.099232] [INFO ] [MAIN ] KWR: Loaded 16654 existing records. [2025-10-03T19:52:50.289041] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:50.289281] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-03T19:52:50.289332] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-03T19:52:50.289701] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-03T19:52:50.289762] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-03T19:52:50.395637] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-03T19:52:50.686118] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:51.019385] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:52:51.190711] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-03T19:52:51.990749] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-03T19:52:52.021289] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:52:52.790715] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-03T19:52:52.950164] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:52:52.973527] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:52:53.590709] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-03T19:52:54.390637] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-03T19:52:54.445398] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:52:54.551498] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:52:55.190700] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-03T19:52:55.990703] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-03T19:52:56.354463] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:52:56.790679] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-03T19:52:56.890323] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:52:57.215117] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:52:57.217512] [INFO ] [REMOTE ] KW: Full fetch complete (57110 records). [2025-10-03T19:52:57.217702] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-03T19:52:57.550611] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:52:57.595757] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-03T19:52:57.671789] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-03T19:52:57.671961] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-03T19:52:57.673086] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-03T19:52:57.673158] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-03T19:52:57.674992] [DEBUG] [LOCAL ] KW: Trimmed 57110 records to 41133 (keeping 200 days of data) [2025-10-03T19:52:57.932006] [DEBUG] [LOCAL ] KW: Primary data saved (41133 records). [2025-10-03T19:52:57.932136] [INFO ] [MAIN ] KW: Full history saved. [2025-10-03T19:52:57.932219] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KW took 31.9s. Estimated remaining: 2h 40m 31s. Rate: 7.1 symbols/min [2025-10-03T19:52:58.138790] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:58.172877] [DEBUG] [LOCAL ] KYN: Loaded 30181 existing records from primary storage. [2025-10-03T19:52:58.173224] [INFO ] [MAIN ] KYN: Loaded 30181 existing records. [2025-10-03T19:52:58.382124] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:58.382360] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-03T19:52:58.382410] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-03T19:52:58.382778] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-03T19:52:58.382852] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-03T19:52:58.395782] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-03T19:52:58.780774] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:59.190699] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-03T19:52:59.371737] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:52:59.905168] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T19:52:59.990720] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-03T19:53:00.083185] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:53:00.790716] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-03T19:53:01.015800] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:53:01.590680] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-03T19:53:02.055176] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:53:02.390687] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-03T19:53:02.851730] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:53:02.854273] [INFO ] [REMOTE ] KVYO: Full fetch complete (71720 records). [2025-10-03T19:53:02.854449] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-03T19:53:03.195739] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-03T19:53:03.307177] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-03T19:53:03.307276] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-03T19:53:03.308437] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-03T19:53:03.308522] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-03T19:53:03.310111] [DEBUG] [LOCAL ] KVYO: Trimmed 71720 records to 50847 (keeping 200 days of data) [2025-10-03T19:53:03.625223] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:53:03.644620] [DEBUG] [LOCAL ] KVYO: Primary data saved (50847 records). [2025-10-03T19:53:03.644808] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-03T19:53:03.644922] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KVYO took 39.3s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-03T19:53:03.832016] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:03.877143] [DEBUG] [LOCAL ] L: Loaded 41305 existing records from primary storage. [2025-10-03T19:53:03.877570] [INFO ] [MAIN ] L: Loaded 41305 existing records. [2025-10-03T19:53:03.995857] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-03T19:53:04.070875] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:04.071114] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-03T19:53:04.071166] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-03T19:53:04.071504] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-03T19:53:04.071578] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-03T19:53:04.457483] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:04.475089] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:53:04.790695] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-03T19:53:05.100129] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T19:53:05.590684] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-03T19:53:06.390701] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-03T19:53:07.116059] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T19:53:07.155703] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:53:07.190615] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-03T19:53:07.770583] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:53:07.990712] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-03T19:53:08.790718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-03T19:53:09.417837] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:53:09.457434] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T19:53:09.460847] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-03T19:53:09.460988] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-03T19:53:09.596703] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-03T19:53:09.913020] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T19:53:09.912586] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-03T19:53:09.917097] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-03T19:53:09.918764] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-03T19:53:09.919196] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-03T19:53:09.920631] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 54447 (keeping 200 days of data) [2025-10-03T19:53:10.271798] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-03T19:53:10.271955] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-03T19:53:10.272633] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KVUE took 48.0s. Estimated remaining: 2h 40m 10s. Rate: 7.1 symbols/min [2025-10-03T19:53:10.395723] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-03T19:53:10.466275] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:10.521140] [DEBUG] [LOCAL ] LAC: Loaded 52752 existing records from primary storage. [2025-10-03T19:53:10.521474] [INFO ] [MAIN ] LAC: Loaded 52752 existing records. [2025-10-03T19:53:10.712707] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:10.712960] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-03T19:53:10.713147] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-03T19:53:10.713679] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-03T19:53:10.713753] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-03T19:53:11.083932] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:53:11.148700] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:11.190610] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-03T19:53:11.521520] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T19:53:11.990707] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-03T19:53:12.790699] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-03T19:53:13.246476] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:53:13.281147] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T19:53:13.590696] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-03T19:53:14.235853] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:53:14.390707] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-03T19:53:15.190638] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-03T19:53:15.286808] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:53:15.659760] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T19:53:15.990724] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-03T19:53:16.256469] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T19:53:16.790700] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-03T19:53:17.590680] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-03T19:53:17.833357] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:53:18.348415] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:53:18.390739] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-03T19:53:18.408513] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:53:19.190717] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-03T19:53:19.905070] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:53:19.907582] [INFO ] [REMOTE ] KWR: Full fetch complete (23960 records). [2025-10-03T19:53:19.908070] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-03T19:53:19.999387] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-03T19:53:20.428246] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-03T19:53:20.428516] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-03T19:53:20.429638] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-03T19:53:20.429782] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-03T19:53:20.431164] [DEBUG] [LOCAL ] KWR: Trimmed 23960 records to 16741 (keeping 200 days of data) [2025-10-03T19:53:20.548265] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T19:53:20.591604] [DEBUG] [LOCAL ] KWR: Primary data saved (16741 records). [2025-10-03T19:53:20.591850] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-03T19:53:20.591985] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KWR took 30.7s. Estimated remaining: 2h 40m 3s. Rate: 7.1 symbols/min [2025-10-03T19:53:20.778433] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:20.796391] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-03T19:53:20.810102] [DEBUG] [LOCAL ] LAD: Loaded 23644 existing records from primary storage. [2025-10-03T19:53:20.810554] [INFO ] [MAIN ] LAD: Loaded 23644 existing records. [2025-10-03T19:53:21.007949] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:21.008313] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-03T19:53:21.008367] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-03T19:53:21.008768] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-03T19:53:21.008836] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-03T19:53:21.391458] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:21.590765] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-03T19:53:21.620572] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:53:22.199576] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:53:22.390766] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-03T19:53:23.190744] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-03T19:53:23.502838] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:53:23.656397] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T19:53:23.990635] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-03T19:53:24.457620] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:53:24.790757] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-03T19:53:24.977546] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:53:25.590726] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-03T19:53:26.152929] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:53:26.350136] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:53:26.390767] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-03T19:53:27.190737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-03T19:53:27.615122] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T19:53:27.990766] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-03T19:53:28.220819] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:53:28.222567] [INFO ] [REMOTE ] KYN: Full fetch complete (44551 records). [2025-10-03T19:53:28.222690] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-03T19:53:28.635895] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-03T19:53:28.636084] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-03T19:53:28.637059] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-03T19:53:28.637127] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-03T19:53:28.638365] [DEBUG] [LOCAL ] KYN: Trimmed 44551 records to 30355 (keeping 200 days of data) [2025-10-03T19:53:28.791421] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-03T19:53:28.834904] [DEBUG] [LOCAL ] KYN: Primary data saved (30355 records). [2025-10-03T19:53:28.835112] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-03T19:53:28.835279] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KYN took 30.9s. Estimated remaining: 2h 39m 54s. Rate: 7.1 symbols/min [2025-10-03T19:53:29.033236] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:29.074282] [DEBUG] [LOCAL ] LADR: Loaded 39182 existing records from primary storage. [2025-10-03T19:53:29.074598] [INFO ] [MAIN ] LADR: Loaded 39182 existing records. [2025-10-03T19:53:29.276777] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:29.277126] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-03T19:53:29.277189] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-03T19:53:29.277736] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-03T19:53:29.277799] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-03T19:53:29.595749] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-03T19:53:29.662883] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:29.691768] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T19:53:30.390741] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-03T19:53:30.526232] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:53:31.090348] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:53:31.190692] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-03T19:53:31.892320] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T19:53:31.990681] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-03T19:53:32.647576] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:53:32.790740] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-03T19:53:33.158489] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:53:33.590725] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-03T19:53:34.390631] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-03T19:53:34.650461] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:53:34.708678] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T19:53:35.190726] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-03T19:53:35.751852] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:53:35.990688] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-03T19:53:36.790673] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-03T19:53:36.984419] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:53:37.336543] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T19:53:37.590741] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-03T19:53:38.162779] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:53:38.390689] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-03T19:53:39.118203] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T19:53:39.190703] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-03T19:53:39.822893] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:53:39.990749] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-03T19:53:40.688226] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:53:40.790688] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-03T19:53:41.590983] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-03T19:53:41.595425] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T19:53:42.017582] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:53:42.020142] [INFO ] [REMOTE ] L: Full fetch complete (59503 records). [2025-10-03T19:53:42.020296] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-03T19:53:42.395828] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-03T19:53:42.536286] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-03T19:53:42.536424] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-03T19:53:42.538216] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-03T19:53:42.538301] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-03T19:53:42.540230] [DEBUG] [LOCAL ] L: Trimmed 59503 records to 41625 (keeping 200 days of data) [2025-10-03T19:53:42.861105] [DEBUG] [LOCAL ] L: Primary data saved (41625 records). [2025-10-03T19:53:42.861278] [INFO ] [MAIN ] L: Full history saved. [2025-10-03T19:53:42.861556] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. L took 39.2s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-03T19:53:43.056430] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:43.063024] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-03T19:53:43.063215] [INFO ] [MAIN ] LANV: Loaded 2845 existing records. [2025-10-03T19:53:43.195815] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-03T19:53:43.263141] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:43.263476] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-03T19:53:43.263532] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-03T19:53:43.264083] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-03T19:53:43.264175] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-03T19:53:43.679944] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:43.697613] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:53:43.906795] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T19:53:43.990633] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-03T19:53:44.721308] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:53:44.790685] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-03T19:53:45.590704] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-03T19:53:46.207116] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:53:46.252376] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T19:53:46.390694] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-03T19:53:46.629296] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:53:46.798804] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-03T19:53:47.190727] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-03T19:53:47.990725] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-03T19:53:48.415320] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T19:53:48.790699] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-03T19:53:49.590718] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-03T19:53:50.084973] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-03T19:53:50.087887] [INFO ] [REMOTE ] LAC: Full fetch complete (75992 records). [2025-10-03T19:53:50.088133] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-03T19:53:50.401084] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-03T19:53:50.558445] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:53:50.589533] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:53:50.589784] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-03T19:53:50.600142] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-03T19:53:50.601578] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-03T19:53:50.601702] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-03T19:53:50.603555] [DEBUG] [LOCAL ] LAC: Trimmed 75992 records to 53142 (keeping 200 days of data) [2025-10-03T19:53:50.917395] [DEBUG] [LOCAL ] LAC: Primary data saved (53142 records). [2025-10-03T19:53:50.917543] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-03T19:53:50.918910] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. LAC took 40.6s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-10-03T19:53:51.013154] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T19:53:51.135806] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:51.136028] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-03T19:53:51.136085] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-03T19:53:51.136204] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-03T19:53:51.136248] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-03T19:53:51.136290] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-03T19:53:51.136327] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-03T19:53:51.195873] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-03T19:53:51.517714] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:51.710609] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T19:53:51.990711] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-03T19:53:52.466774] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T19:53:52.790724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-03T19:53:53.590762] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-03T19:53:54.175120] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:53:54.355114] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T19:53:54.357152] [INFO ] [REMOTE ] LAD: Full fetch complete (35397 records). [2025-10-03T19:53:54.357276] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-03T19:53:54.395771] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-03T19:53:54.680567] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:53:54.680981] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-03T19:53:54.686736] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:53:54.697060] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-03T19:53:54.702305] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:53:54.733387] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-03T19:53:54.765270] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-03T19:53:54.774927] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-03T19:53:54.775032] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-03T19:53:54.775179] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-03T19:53:54.775129] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-03T19:53:54.776010] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-03T19:53:54.776091] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-03T19:53:54.776470] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LAR took 3.9s. Estimated remaining: 2h 39m 29s. Rate: 7.1 symbols/min [2025-10-03T19:53:54.867089] [DEBUG] [LOCAL ] LAD: Trimmed 35397 records to 23804 (keeping 200 days of data) [2025-10-03T19:53:55.062427] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:55.120948] [DEBUG] [LOCAL ] LAW: Loaded 14185 existing records from primary storage. [2025-10-03T19:53:55.129083] [INFO ] [MAIN ] LAW: Loaded 14185 existing records. [2025-10-03T19:53:55.190740] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-03T19:53:55.263702] [DEBUG] [LOCAL ] LAD: Primary data saved (23804 records). [2025-10-03T19:53:55.279262] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-03T19:53:55.279424] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. LAD took 34.7s. Estimated remaining: 2h 39m 14s. Rate: 7.1 symbols/min [2025-10-03T19:53:55.335572] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:55.335810] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-03T19:53:55.335861] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-03T19:53:55.336091] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-03T19:53:55.336150] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-03T19:53:55.669711] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T19:53:55.794122] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:55.990717] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-03T19:53:56.790690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-03T19:53:56.978898] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T19:53:57.268755] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T19:53:57.590691] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-03T19:53:58.058794] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T19:53:58.390685] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-03T19:53:59.190693] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-03T19:53:59.270053] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T19:53:59.990683] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-03T19:54:00.581619] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:54:00.618466] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:54:00.790685] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-03T19:54:01.366272] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T19:54:01.590722] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-03T19:54:02.390722] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-03T19:54:02.990168] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:54:02.992475] [INFO ] [REMOTE ] LADR: Full fetch complete (55473 records). [2025-10-03T19:54:02.992574] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-03T19:54:03.058127] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:54:03.092212] [INFO ] [REMOTE ] LANV: Full fetch complete (4463 records). [2025-10-03T19:54:03.106737] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-03T19:54:03.196907] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-03T19:54:03.797103] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-03T19:54:03.818163] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-03T19:54:03.834536] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-03T19:54:03.860175] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-03T19:54:03.892427] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-03T19:54:03.892829] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-03T19:54:03.892995] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-03T19:54:03.893101] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-03T19:54:03.893773] [DEBUG] [LOCAL ] LANV: Trimmed 4463 records to 2868 (keeping 200 days of data) [2025-10-03T19:54:03.894608] [DEBUG] [LOCAL ] LADR: Trimmed 55473 records to 39456 (keeping 200 days of data) [2025-10-03T19:54:03.911034] [DEBUG] [LOCAL ] LANV: Primary data saved (2868 records). [2025-10-03T19:54:03.911146] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-03T19:54:03.911234] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. LANV took 21.0s. Estimated remaining: 2h 39m 6s. Rate: 7.1 symbols/min [2025-10-03T19:54:04.158545] [DEBUG] [LOCAL ] LADR: Primary data saved (39456 records). [2025-10-03T19:54:04.158729] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-03T19:54:04.158848] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LADR took 35.3s. Estimated remaining: 2h 38m 50s. Rate: 7.1 symbols/min [2025-10-03T19:54:04.192446] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:54:04.196203] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-03T19:54:04.757708] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T19:54:04.790743] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-03T19:54:05.584666] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T19:54:05.590601] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-03T19:54:06.595154] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:54:06.601010] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-03T19:54:07.516415] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:54:07.520394] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-03T19:54:08.438806] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:54:08.442714] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-03T19:54:09.406288] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:54:09.413074] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-03T19:54:10.345486] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:54:10.349886] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-03T19:54:11.252984] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:54:11.254579] [INFO ] [REMOTE ] LAW: Full fetch complete (20674 records). [2025-10-03T19:54:11.254721] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-03T19:54:11.662381] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-03T19:54:11.662461] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-03T19:54:11.662954] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-03T19:54:11.663017] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-03T19:54:11.663601] [DEBUG] [LOCAL ] LAW: Trimmed 20674 records to 14355 (keeping 200 days of data) [2025-10-03T19:54:11.748730] [DEBUG] [LOCAL ] LAW: Primary data saved (14355 records). [2025-10-03T19:54:11.748886] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-03T19:54:11.748975] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LAW took 17.0s. Estimated remaining: 2h 38m 40s. Rate: 7.1 symbols/min [2025-10-03T19:54:12.460181] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.499453] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.521561] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.554006] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.664634] [DEBUG] [LOCAL ] LC: Loaded 48187 existing records from primary storage. [2025-10-03T19:54:12.667021] [DEBUG] [LOCAL ] LB: Loaded 37995 existing records from primary storage. [2025-10-03T19:54:12.667424] [INFO ] [MAIN ] LC: Loaded 48187 existing records. [2025-10-03T19:54:12.668350] [DEBUG] [LOCAL ] LBRT: Loaded 53299 existing records from primary storage. [2025-10-03T19:54:12.668568] [INFO ] [MAIN ] LB: Loaded 37995 existing records. [2025-10-03T19:54:12.743155] [DEBUG] [LOCAL ] LAZ: Loaded 45182 existing records from primary storage. [2025-10-03T19:54:12.719960] [INFO ] [MAIN ] LBRT: Loaded 53299 existing records. [2025-10-03T19:54:12.824419] [INFO ] [MAIN ] LAZ: Loaded 45182 existing records. [2025-10-03T19:54:13.338049] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.430756] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.395802] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.472629] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.468884] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-03T19:54:13.472797] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-03T19:54:13.502811] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.506314] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.506664] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.506902] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-03T19:54:13.507057] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-03T19:54:13.507184] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-03T19:54:13.506860] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-03T19:54:13.507538] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-03T19:54:13.507394] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.524528] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-03T19:54:13.536707] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-03T19:54:13.631299] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-03T19:54:13.564611] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-03T19:54:13.647037] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-03T19:54:14.991069] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.047379] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.076219] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.076845] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-03T19:54:15.077406] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-03T19:54:15.077147] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-03T19:54:15.168124] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.168445] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-03T19:54:16.660464] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:54:16.670512] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-03T19:54:16.773800] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:54:16.786030] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-03T19:54:16.816127] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:54:16.828274] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-03T19:54:16.864316] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:54:16.873679] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-03T19:54:18.292697] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:54:18.305825] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-03T19:54:18.340486] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:54:18.353493] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-03T19:54:18.385036] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:54:18.398003] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-03T19:54:18.468369] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:54:19.190745] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-03T19:54:19.652420] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:54:19.990632] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-03T19:54:20.068708] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:54:20.094210] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:54:20.697916] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:54:20.790754] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-03T19:54:21.505878] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:54:21.590619] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-03T19:54:22.391157] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-03T19:54:22.398377] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T19:54:23.167746] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:54:23.190615] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-03T19:54:23.990682] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-03T19:54:24.027962] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:54:24.779270] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:54:24.790611] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-03T19:54:25.590684] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-03T19:54:25.756092] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T19:54:26.236804] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:54:26.390710] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-03T19:54:27.190728] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-03T19:54:27.261945] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:54:27.862592] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:54:27.990723] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-03T19:54:28.707055] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:54:28.790721] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-03T19:54:29.590671] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-03T19:54:29.885978] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:54:29.981551] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:54:30.390694] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-03T19:54:30.723174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T19:54:31.190699] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-03T19:54:31.990633] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-03T19:54:32.230476] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:54:32.563769] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T19:54:32.790693] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-03T19:54:33.393509] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T19:54:33.590691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-03T19:54:34.393683] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-03T19:54:34.403151] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:54:35.190753] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-03T19:54:35.335923] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:54:35.693113] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:54:35.695604] [INFO ] [REMOTE ] LAZ: Full fetch complete (65877 records). [2025-10-03T19:54:35.695824] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-03T19:54:35.995965] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-03T19:54:36.143814] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-03T19:54:36.143913] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-03T19:54:36.145059] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-03T19:54:36.145133] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-03T19:54:36.146778] [DEBUG] [LOCAL ] LAZ: Trimmed 65877 records to 45487 (keeping 200 days of data) [2025-10-03T19:54:36.438467] [DEBUG] [LOCAL ] LAZ: Primary data saved (45487 records). [2025-10-03T19:54:36.438639] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-03T19:54:36.438806] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LAZ took 24.7s. Estimated remaining: 2h 38m 47s. Rate: 7.1 symbols/min [2025-10-03T19:54:36.627309] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:36.658007] [DEBUG] [LOCAL ] LCII: Loaded 28181 existing records from primary storage. [2025-10-03T19:54:36.658634] [INFO ] [MAIN ] LCII: Loaded 28181 existing records. [2025-10-03T19:54:36.784916] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:54:36.793552] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-03T19:54:36.889742] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:36.890028] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-03T19:54:36.890077] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-03T19:54:36.890353] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-03T19:54:36.890412] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-03T19:54:37.274746] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:37.590719] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-03T19:54:37.822798] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:54:38.298981] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:54:38.390666] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-03T19:54:38.632250] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:54:39.190722] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-03T19:54:39.837105] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T19:54:39.990718] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-03T19:54:40.790635] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-03T19:54:40.996315] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:54:41.541685] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:54:41.590726] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-03T19:54:41.893383] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T19:54:42.390721] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-03T19:54:43.093858] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:54:43.152274] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:54:43.190627] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-03T19:54:43.990702] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-03T19:54:44.660512] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:54:44.790713] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-03T19:54:45.440265] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T19:54:45.590704] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-03T19:54:46.362723] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:54:46.390706] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-03T19:54:46.836514] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T19:54:46.838874] [INFO ] [REMOTE ] LB: Full fetch complete (55934 records). [2025-10-03T19:54:46.839036] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-03T19:54:47.196676] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-03T19:54:47.256412] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-03T19:54:47.256511] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-03T19:54:47.257452] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-03T19:54:47.257533] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-03T19:54:47.258821] [DEBUG] [LOCAL ] LB: Trimmed 55934 records to 38337 (keeping 200 days of data) [2025-10-03T19:54:47.500321] [DEBUG] [LOCAL ] LB: Primary data saved (38337 records). [2025-10-03T19:54:47.500476] [INFO ] [MAIN ] LB: Full history saved. [2025-10-03T19:54:47.500609] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LB took 35.7s. Estimated remaining: 2h 38m 41s. Rate: 7.1 symbols/min [2025-10-03T19:54:47.683457] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:47.725224] [DEBUG] [LOCAL ] LDI: Loaded 44523 existing records from primary storage. [2025-10-03T19:54:47.725546] [INFO ] [MAIN ] LDI: Loaded 44523 existing records. [2025-10-03T19:54:47.914019] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:47.914274] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-03T19:54:47.914334] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-03T19:54:47.914699] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-03T19:54:47.914758] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-03T19:54:47.992973] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-03T19:54:48.299559] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:48.335778] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T19:54:48.498575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T19:54:48.790691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-03T19:54:49.311700] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:54:49.316395] [INFO ] [REMOTE ] LC: Full fetch complete (70566 records). [2025-10-03T19:54:49.316516] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-03T19:54:49.596424] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-03T19:54:49.744596] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-03T19:54:49.744713] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-03T19:54:49.745805] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-03T19:54:49.745879] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-03T19:54:49.747439] [DEBUG] [LOCAL ] LC: Trimmed 70566 records to 48516 (keeping 200 days of data) [2025-10-03T19:54:50.047165] [DEBUG] [LOCAL ] LC: Primary data saved (48516 records). [2025-10-03T19:54:50.047335] [INFO ] [MAIN ] LC: Full history saved. [2025-10-03T19:54:50.048200] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LC took 38.3s. Estimated remaining: 2h 38m 27s. Rate: 7.1 symbols/min [2025-10-03T19:54:50.237509] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:50.286689] [DEBUG] [LOCAL ] LDOS: Loaded 45923 existing records from primary storage. [2025-10-03T19:54:50.287017] [INFO ] [MAIN ] LDOS: Loaded 45923 existing records. [2025-10-03T19:54:50.397284] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-03T19:54:50.485398] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:50.485677] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-03T19:54:50.485740] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-03T19:54:50.485992] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-03T19:54:50.486052] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-03T19:54:50.935023] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:50.970159] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T19:54:51.130605] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:54:51.190689] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-03T19:54:51.560837] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:54:51.990790] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-03T19:54:52.460858] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T19:54:52.790773] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-03T19:54:53.403747] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:54:53.590697] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-03T19:54:54.144301] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:54:54.147170] [INFO ] [REMOTE ] LBRT: Full fetch complete (76543 records). [2025-10-03T19:54:54.147288] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-03T19:54:54.395756] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-03T19:54:54.579277] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-03T19:54:54.579370] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-03T19:54:54.580602] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-03T19:54:54.580693] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-03T19:54:54.582254] [DEBUG] [LOCAL ] LBRT: Trimmed 76543 records to 53687 (keeping 200 days of data) [2025-10-03T19:54:54.928131] [DEBUG] [LOCAL ] LBRT: Primary data saved (53687 records). [2025-10-03T19:54:54.928280] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-03T19:54:54.928394] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LBRT took 43.2s. Estimated remaining: 2h 38m 15s. Rate: 7.1 symbols/min [2025-10-03T19:54:55.113904] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:55.130693] [DEBUG] [LOCAL ] LDP: Loaded 13028 existing records from primary storage. [2025-10-03T19:54:55.130949] [INFO ] [MAIN ] LDP: Loaded 13028 existing records. [2025-10-03T19:54:55.192460] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-03T19:54:55.333226] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:55.333478] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-03T19:54:55.333617] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-03T19:54:55.334009] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-03T19:54:55.334081] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-03T19:54:55.446930] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:54:55.828589] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:55.830613] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:54:55.990678] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-03T19:54:56.574584] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:54:56.790709] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-03T19:54:57.176301] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:54:57.590690] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-03T19:54:58.083046] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T19:54:58.390689] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-03T19:54:59.190676] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-03T19:54:59.238602] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:54:59.329618] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:54:59.990702] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-03T19:55:00.665961] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:55:00.790671] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-03T19:55:01.177732] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T19:55:01.590741] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-03T19:55:02.390707] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-03T19:55:02.432426] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:55:02.633088] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:55:02.634660] [INFO ] [REMOTE ] LCII: Full fetch complete (39170 records). [2025-10-03T19:55:02.634748] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-03T19:55:03.061428] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-03T19:55:03.061537] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-03T19:55:03.062373] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-03T19:55:03.062440] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-03T19:55:03.064025] [DEBUG] [LOCAL ] LCII: Trimmed 39170 records to 28309 (keeping 200 days of data) [2025-10-03T19:55:03.192045] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-03T19:55:03.252852] [DEBUG] [LOCAL ] LCII: Primary data saved (28309 records). [2025-10-03T19:55:03.253006] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-03T19:55:03.253126] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LCII took 26.8s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-03T19:55:03.438475] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:03.483562] [DEBUG] [LOCAL ] LEA: Loaded 42058 existing records from primary storage. [2025-10-03T19:55:03.483915] [INFO ] [MAIN ] LEA: Loaded 42058 existing records. [2025-10-03T19:55:03.677930] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:03.678227] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-03T19:55:03.678292] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-03T19:55:03.678741] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-03T19:55:03.678802] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-03T19:55:03.998034] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-03T19:55:04.119399] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:04.123376] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:55:04.128604] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:55:04.790688] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-03T19:55:05.590732] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-03T19:55:05.864300] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T19:55:06.236303] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:55:06.390735] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-03T19:55:07.192314] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-03T19:55:07.195770] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:55:07.779799] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T19:55:07.990639] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-03T19:55:08.131924] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T19:55:08.790688] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-03T19:55:09.589974] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:55:09.598838] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-03T19:55:09.739731] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T19:55:10.390699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-03T19:55:11.023028] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:55:11.190674] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-03T19:55:11.443923] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:55:11.990672] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-03T19:55:12.790692] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-03T19:55:12.874242] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:55:12.900143] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:55:13.590691] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-03T19:55:14.390674] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-03T19:55:14.483693] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:55:15.115843] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T19:55:15.151171] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:55:15.190675] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-03T19:55:15.990699] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-03T19:55:16.790678] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-03T19:55:16.941684] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:55:17.126498] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:55:17.590722] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-03T19:55:18.390735] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-03T19:55:18.534154] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:55:18.569275] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:55:19.190731] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-03T19:55:19.990710] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-03T19:55:20.456800] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-03T19:55:20.460725] [INFO ] [REMOTE ] LDI: Full fetch complete (60709 records). [2025-10-03T19:55:20.460931] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-03T19:55:20.795509] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-03T19:55:20.923927] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-03T19:55:20.924075] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-03T19:55:20.925194] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-03T19:55:20.925283] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-03T19:55:20.947630] [DEBUG] [LOCAL ] LDI: Trimmed 60709 records to 44902 (keeping 200 days of data) [2025-10-03T19:55:20.952904] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:55:21.227707] [DEBUG] [LOCAL ] LDI: Primary data saved (44902 records). [2025-10-03T19:55:21.227852] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-03T19:55:21.227943] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LDI took 33.7s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-03T19:55:21.434873] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:21.489304] [DEBUG] [LOCAL ] LEG: Loaded 50600 existing records from primary storage. [2025-10-03T19:55:21.489739] [INFO ] [MAIN ] LEG: Loaded 50600 existing records. [2025-10-03T19:55:21.601667] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-03T19:55:21.694434] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:21.694763] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-03T19:55:21.694877] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-03T19:55:21.703600] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-03T19:55:21.716112] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-03T19:55:21.752690] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T19:55:21.799057] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:55:22.169865] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:22.390692] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-03T19:55:23.074394] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:55:23.180151] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T19:55:23.181364] [INFO ] [REMOTE ] LDP: Full fetch complete (19390 records). [2025-10-03T19:55:23.181500] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-03T19:55:23.195798] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-03T19:55:23.589091] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-03T19:55:23.589178] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-03T19:55:23.589795] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-03T19:55:23.589864] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-03T19:55:23.590685] [DEBUG] [LOCAL ] LDP: Trimmed 19390 records to 13110 (keeping 200 days of data) [2025-10-03T19:55:23.678514] [DEBUG] [LOCAL ] LDP: Primary data saved (13110 records). [2025-10-03T19:55:23.678704] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-03T19:55:23.678825] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDP took 28.8s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-03T19:55:23.854129] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:23.911689] [DEBUG] [LOCAL ] LEN: Loaded 53562 existing records from primary storage. [2025-10-03T19:55:23.912076] [INFO ] [MAIN ] LEN: Loaded 53562 existing records. [2025-10-03T19:55:23.995879] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-03T19:55:24.132420] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:24.132691] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-03T19:55:24.132760] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-03T19:55:24.133325] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-03T19:55:24.133389] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-03T19:55:24.575591] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:24.792397] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-03T19:55:24.805873] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:55:25.165162] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:55:25.590737] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-03T19:55:26.390717] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-03T19:55:26.753919] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T19:55:27.190699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-03T19:55:27.241204] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T19:55:27.990682] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-03T19:55:28.090007] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:55:28.697046] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:55:28.790615] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-03T19:55:29.595813] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-03T19:55:29.610838] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:55:29.788555] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:55:30.390712] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-03T19:55:31.190727] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-03T19:55:31.233901] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:55:31.548829] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T19:55:31.990716] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-03T19:55:32.790721] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-03T19:55:33.077553] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T19:55:33.452885] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:55:33.455338] [INFO ] [REMOTE ] LDOS: Full fetch complete (67588 records). [2025-10-03T19:55:33.455472] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-03T19:55:33.595853] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-03T19:55:33.911886] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-03T19:55:33.912049] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-03T19:55:33.913321] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-03T19:55:33.913394] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-03T19:55:33.915281] [DEBUG] [LOCAL ] LDOS: Trimmed 67588 records to 46250 (keeping 200 days of data) [2025-10-03T19:55:34.163223] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:55:34.167388] [INFO ] [REMOTE ] LEA: Full fetch complete (60901 records). [2025-10-03T19:55:34.168530] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-03T19:55:34.395567] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-03T19:55:34.722100] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-03T19:55:34.722799] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-03T19:55:34.724924] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-03T19:55:34.725042] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-03T19:55:34.728954] [DEBUG] [LOCAL ] LEA: Trimmed 60901 records to 42367 (keeping 200 days of data) [2025-10-03T19:55:34.913891] [DEBUG] [LOCAL ] LDOS: Primary data saved (46250 records). [2025-10-03T19:55:34.914827] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-03T19:55:34.915862] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LDOS took 44.9s. Estimated remaining: 2h 37m 47s. Rate: 7.1 symbols/min [2025-10-03T19:55:35.131665] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:35.255063] [DEBUG] [LOCAL ] LEO: Loaded 17395 existing records from primary storage. [2025-10-03T19:55:35.256463] [INFO ] [MAIN ] LEO: Loaded 17395 existing records. [2025-10-03T19:55:35.432512] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T19:55:35.520426] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:35.521064] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-03T19:55:35.524381] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-03T19:55:35.524795] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-03T19:55:35.525635] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-03T19:55:35.526514] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-03T19:55:35.900908] [DEBUG] [LOCAL ] LEA: Primary data saved (42367 records). [2025-10-03T19:55:35.916541] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-03T19:55:35.945230] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LEA took 32.7s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-03T19:55:35.992795] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:36.035501] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-03T19:55:36.183184] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:36.248031] [DEBUG] [LOCAL ] LEVI: Loaded 51949 existing records from primary storage. [2025-10-03T19:55:36.264972] [INFO ] [MAIN ] LEVI: Loaded 51949 existing records. [2025-10-03T19:55:36.328922] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T19:55:36.473259] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:36.473543] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-03T19:55:36.473593] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-03T19:55:36.474250] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-03T19:55:36.474313] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-03T19:55:36.795770] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-03T19:55:36.866421] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:37.105578] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:55:37.280350] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:55:37.590716] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-03T19:55:38.390707] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-03T19:55:38.840345] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T19:55:39.190732] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-03T19:55:39.277214] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:55:39.990717] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-03T19:55:40.051753] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:55:40.790748] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-03T19:55:40.918304] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T19:55:41.007602] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:55:41.590736] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-03T19:55:42.014054] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:55:42.390732] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-03T19:55:43.190725] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-03T19:55:43.328696] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:55:43.990700] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-03T19:55:44.093982] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:55:44.263546] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:55:44.790722] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-03T19:55:45.590738] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-03T19:55:45.804290] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T19:55:45.884205] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:55:46.390703] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-03T19:55:47.190689] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-03T19:55:47.242911] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:55:47.484994] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:55:47.990716] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-03T19:55:48.790709] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-03T19:55:49.258574] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T19:55:49.331735] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:55:49.590639] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-03T19:55:49.687579] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T19:55:50.390685] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-03T19:55:51.190722] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-03T19:55:51.491867] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T19:55:51.562162] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:55:51.564798] [INFO ] [REMOTE ] LEG: Full fetch complete (73055 records). [2025-10-03T19:55:51.564926] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-03T19:55:52.001518] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-03T19:55:52.005325] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-03T19:55:52.006624] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-03T19:55:52.007751] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-03T19:55:52.007924] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-03T19:55:52.009607] [DEBUG] [LOCAL ] LEG: Trimmed 73055 records to 50956 (keeping 200 days of data) [2025-10-03T19:55:52.158882] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:55:52.377771] [DEBUG] [LOCAL ] LEG: Primary data saved (50956 records). [2025-10-03T19:55:52.377978] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-03T19:55:52.378117] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LEG took 31.2s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-03T19:55:52.571561] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:52.591434] [DEBUG] [LOCAL ] LFT: Loaded 18394 existing records from primary storage. [2025-10-03T19:55:52.591792] [INFO ] [MAIN ] LFT: Loaded 18394 existing records. [2025-10-03T19:55:52.789451] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:52.789722] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-03T19:55:52.789794] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-03T19:55:52.790155] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-03T19:55:52.790215] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-03T19:55:52.795794] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-03T19:55:53.225284] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:53.502942] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:55:53.590669] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-03T19:55:54.390736] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-03T19:55:55.072162] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-03T19:55:55.148286] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:55:55.190690] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-03T19:55:55.357761] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:55:55.990634] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-03T19:55:56.054550] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T19:55:56.790694] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-03T19:55:57.590700] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-03T19:55:57.794313] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:55:58.390694] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-03T19:55:58.531628] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:55:59.041380] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T19:55:59.190723] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-03T19:55:59.990677] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-03T19:56:00.106223] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T19:56:00.154401] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:56:00.790695] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-03T19:56:01.541682] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:56:01.590671] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-03T19:56:01.808710] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T19:56:01.811943] [INFO ] [REMOTE ] LEN: Full fetch complete (77044 records). [2025-10-03T19:56:01.812072] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-03T19:56:02.250178] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-03T19:56:02.250273] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-03T19:56:02.251697] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-03T19:56:02.251789] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-03T19:56:02.253631] [DEBUG] [LOCAL ] LEN: Trimmed 77044 records to 53950 (keeping 200 days of data) [2025-10-03T19:56:02.445886] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:56:02.442265] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-03T19:56:02.457380] [INFO ] [REMOTE ] LEO: Full fetch complete (26897 records). [2025-10-03T19:56:02.466709] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-03T19:56:03.072563] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-03T19:56:03.073857] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-03T19:56:03.075283] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-03T19:56:03.075671] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-03T19:56:03.085225] [DEBUG] [LOCAL ] LEO: Trimmed 26897 records to 17457 (keeping 200 days of data) [2025-10-03T19:56:03.089787] [DEBUG] [LOCAL ] LEN: Primary data saved (53950 records). [2025-10-03T19:56:03.090209] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-03T19:56:03.090343] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEN took 39.4s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-03T19:56:03.200427] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-03T19:56:03.369553] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:03.396621] [DEBUG] [LOCAL ] LGI: Loaded 9893 existing records from primary storage. [2025-10-03T19:56:03.397734] [INFO ] [MAIN ] LGI: Loaded 9893 existing records. [2025-10-03T19:56:03.511052] [DEBUG] [LOCAL ] LEO: Primary data saved (17457 records). [2025-10-03T19:56:03.511608] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-03T19:56:03.527687] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEO took 28.6s. Estimated remaining: 2h 37m 9s. Rate: 7.1 symbols/min [2025-10-03T19:56:03.689355] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:03.717677] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-03T19:56:03.721394] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-03T19:56:03.727255] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-03T19:56:03.732588] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-03T19:56:03.895834] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:04.163784] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:56:04.223322] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:04.224110] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-03T19:56:04.237700] [DEBUG] [LOCAL ] LH: Loaded 38094 existing records from primary storage. [2025-10-03T19:56:04.238067] [INFO ] [MAIN ] LH: Loaded 38094 existing records. [2025-10-03T19:56:04.412259] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-03T19:56:04.490579] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:04.490971] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-03T19:56:04.491056] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-03T19:56:04.491873] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-03T19:56:04.491935] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-03T19:56:04.796439] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-03T19:56:04.885105] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:05.067746] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T19:56:05.590669] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-03T19:56:05.659596] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:56:06.390679] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-03T19:56:07.064360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T19:56:07.190702] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-03T19:56:07.947431] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:56:07.990677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-03T19:56:08.266477] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:56:08.505136] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:56:08.790727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-03T19:56:09.590686] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-03T19:56:10.390696] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-03T19:56:10.464484] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:56:10.676978] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:56:11.190680] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-03T19:56:11.888379] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:56:11.990682] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-03T19:56:12.192281] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:56:12.790707] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-03T19:56:13.461624] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:56:13.488637] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:56:13.590673] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-03T19:56:14.390676] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-03T19:56:15.138019] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:56:15.190712] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-03T19:56:15.464578] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T19:56:15.990744] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-03T19:56:16.790677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-03T19:56:16.986255] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:56:17.571863] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T19:56:17.590634] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-03T19:56:17.738076] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:56:18.390735] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-03T19:56:18.413576] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:56:19.190698] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-03T19:56:19.945727] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:56:19.948417] [INFO ] [REMOTE ] LEVI: Full fetch complete (74495 records). [2025-10-03T19:56:19.948566] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-03T19:56:19.995771] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-03T19:56:20.395925] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-03T19:56:20.396124] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-03T19:56:20.397537] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-03T19:56:20.397751] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-03T19:56:20.399464] [DEBUG] [LOCAL ] LEVI: Trimmed 74495 records to 52330 (keeping 200 days of data) [2025-10-03T19:56:20.666203] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:56:20.794303] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-03T19:56:20.800451] [DEBUG] [LOCAL ] LEVI: Primary data saved (52330 records). [2025-10-03T19:56:20.801158] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:56:20.802559] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-03T19:56:20.806105] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LEVI took 44.8s. Estimated remaining: 2h 37m 8s. Rate: 7.1 symbols/min [2025-10-03T19:56:21.004867] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:21.069975] [DEBUG] [LOCAL ] LHX: Loaded 49032 existing records from primary storage. [2025-10-03T19:56:21.070330] [INFO ] [MAIN ] LHX: Loaded 49032 existing records. [2025-10-03T19:56:21.272969] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:21.273212] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-03T19:56:21.273263] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-03T19:56:21.273751] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-03T19:56:21.273811] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-03T19:56:21.595870] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-03T19:56:21.670932] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:22.199566] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T19:56:22.390670] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-03T19:56:22.426707] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:56:23.190716] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-03T19:56:23.288177] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:56:23.990729] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-03T19:56:24.725747] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T19:56:24.790674] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-03T19:56:25.150510] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:56:25.331984] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T19:56:25.590678] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-03T19:56:26.390688] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-03T19:56:26.979040] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:56:27.190711] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-03T19:56:27.510363] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:56:27.990733] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-03T19:56:28.586622] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:56:28.790826] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-03T19:56:29.042455] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:56:29.380550] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:56:29.381494] [INFO ] [REMOTE ] LGI: Full fetch complete (14269 records). [2025-10-03T19:56:29.381567] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-03T19:56:29.601023] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-03T19:56:29.781170] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-03T19:56:29.781255] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-03T19:56:29.781638] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-03T19:56:29.781721] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-03T19:56:29.782264] [DEBUG] [LOCAL ] LGI: Trimmed 14269 records to 9934 (keeping 200 days of data) [2025-10-03T19:56:29.845636] [DEBUG] [LOCAL ] LGI: Primary data saved (9934 records). [2025-10-03T19:56:29.845821] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-03T19:56:29.845960] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LGI took 26.8s. Estimated remaining: 2h 37m 0s. Rate: 7.1 symbols/min [2025-10-03T19:56:30.030431] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:30.059429] [DEBUG] [LOCAL ] LII: Loaded 28170 existing records from primary storage. [2025-10-03T19:56:30.059740] [INFO ] [MAIN ] LII: Loaded 28170 existing records. [2025-10-03T19:56:30.255281] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:30.255536] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-03T19:56:30.255591] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-03T19:56:30.255900] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-03T19:56:30.255961] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-03T19:56:30.395926] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-03T19:56:30.661678] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:31.190721] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-03T19:56:31.346123] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:56:31.793018] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T19:56:31.990749] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-03T19:56:32.499143] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:56:32.790746] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-03T19:56:33.590704] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-03T19:56:33.642186] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:56:33.828939] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T19:56:34.367015] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:56:34.368310] [INFO ] [REMOTE ] LFT: Full fetch complete (24056 records). [2025-10-03T19:56:34.368399] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-03T19:56:34.398937] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-03T19:56:34.779285] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-03T19:56:34.779377] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-03T19:56:34.779953] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-03T19:56:34.780024] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-03T19:56:34.780862] [DEBUG] [LOCAL ] LFT: Trimmed 24056 records to 18523 (keeping 200 days of data) [2025-10-03T19:56:34.893269] [DEBUG] [LOCAL ] LFT: Primary data saved (18523 records). [2025-10-03T19:56:34.893424] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-03T19:56:34.893544] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LFT took 42.5s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-03T19:56:35.089509] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:35.089759] [DEBUG] [LOCAL ] LION: No existing data file found in primary storage. [2025-10-03T19:56:35.089836] [WARN ] [MAIN ] LION: No existing data found, performing full refresh instead. [2025-10-03T19:56:35.089989] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-03T19:56:35.090053] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-03T19:56:35.090123] [DEBUG] [LOCAL ] LION: No primary data file found to delete. [2025-10-03T19:56:35.090179] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-03T19:56:35.195740] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-03T19:56:35.512012] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:35.990692] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-03T19:56:36.178121] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:56:36.228985] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:56:36.790685] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-03T19:56:37.124793] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:56:37.590730] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-03T19:56:38.113068] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T19:56:38.390740] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-03T19:56:38.729684] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:56:38.732204] [INFO ] [REMOTE ] LH: Full fetch complete (55026 records). [2025-10-03T19:56:38.732357] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-03T19:56:39.157589] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-03T19:56:39.157775] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-03T19:56:39.158882] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-03T19:56:39.158950] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-03T19:56:39.160281] [DEBUG] [LOCAL ] LH: Trimmed 55026 records to 38370 (keeping 200 days of data) [2025-10-03T19:56:39.217461] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-03T19:56:39.409786] [DEBUG] [LOCAL ] LH: Primary data saved (38370 records). [2025-10-03T19:56:39.409975] [INFO ] [MAIN ] LH: Full history saved. [2025-10-03T19:56:39.410089] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LH took 35.9s. Estimated remaining: 2h 36m 37s. Rate: 7.1 symbols/min [2025-10-03T19:56:39.606561] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:39.613402] [DEBUG] [LOCAL ] LITB: Loaded 4368 existing records from primary storage. [2025-10-03T19:56:39.613611] [INFO ] [MAIN ] LITB: Loaded 4368 existing records. [2025-10-03T19:56:39.815413] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:39.815704] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-03T19:56:39.815858] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-03T19:56:39.816119] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-03T19:56:39.816180] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-03T19:56:39.991981] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-03T19:56:40.166432] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:56:40.267620] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:40.790716] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-03T19:56:41.107565] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:56:41.139137] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:56:41.236296] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T19:56:41.590675] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-03T19:56:42.390719] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-03T19:56:42.643975] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:56:43.190697] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-03T19:56:43.722131] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-03T19:56:43.990705] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-03T19:56:44.292941] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:56:44.790713] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-03T19:56:45.008887] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:56:45.590671] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-03T19:56:46.022202] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T19:56:46.390708] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-03T19:56:46.752947] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:56:47.190693] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-03T19:56:47.360601] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T19:56:47.827484] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:56:47.990716] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-03T19:56:48.790679] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-03T19:56:48.809141] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:56:49.590636] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-03T19:56:50.013261] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:56:50.390697] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-03T19:56:50.893776] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T19:56:51.190667] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-03T19:56:51.458630] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T19:56:51.990707] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-03T19:56:52.798994] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-03T19:56:52.804764] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:56:53.147118] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:56:53.590677] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-03T19:56:54.390727] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-03T19:56:54.604090] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:56:54.785244] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-03T19:56:54.956705] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:56:55.190737] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-03T19:56:55.990687] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-03T19:56:56.468596] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:56:56.790691] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-03T19:56:57.573257] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:56:57.590626] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-03T19:56:58.071767] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T19:56:58.390719] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-03T19:56:59.190636] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-03T19:56:59.277605] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:56:59.504877] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:56:59.507138] [INFO ] [REMOTE ] LII: Full fetch complete (41476 records). [2025-10-03T19:56:59.507283] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-03T19:56:59.640934] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:56:59.940400] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-03T19:56:59.940482] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-03T19:56:59.941304] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-03T19:56:59.941368] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-03T19:56:59.942297] [DEBUG] [LOCAL ] LII: Trimmed 41476 records to 28404 (keeping 200 days of data) [2025-10-03T19:57:00.006632] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-03T19:57:00.141535] [DEBUG] [LOCAL ] LII: Primary data saved (28404 records). [2025-10-03T19:57:00.141761] [INFO ] [MAIN ] LII: Full history saved. [2025-10-03T19:57:00.141887] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LII took 30.3s. Estimated remaining: 2h 36m 39s. Rate: 7.1 symbols/min [2025-10-03T19:57:00.333247] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:00.389781] [DEBUG] [LOCAL ] LLY: Loaded 53674 existing records from primary storage. [2025-10-03T19:57:00.390151] [INFO ] [MAIN ] LLY: Loaded 53674 existing records. [2025-10-03T19:57:00.581071] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:00.581310] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-03T19:57:00.581359] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-03T19:57:00.581623] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-03T19:57:00.581717] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-03T19:57:00.797099] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-03T19:57:00.962580] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:01.276927] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T19:57:01.588797] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:57:01.590710] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-03T19:57:01.592772] [INFO ] [REMOTE ] LHX: Full fetch complete (70767 records). [2025-10-03T19:57:01.592870] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-03T19:57:02.046727] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-03T19:57:02.046914] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-03T19:57:02.048509] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-03T19:57:02.048592] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-03T19:57:02.050724] [DEBUG] [LOCAL ] LHX: Trimmed 70767 records to 49316 (keeping 200 days of data) [2025-10-03T19:57:02.295200] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T19:57:02.390743] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-03T19:57:02.397692] [DEBUG] [LOCAL ] LHX: Primary data saved (49316 records). [2025-10-03T19:57:02.397874] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-03T19:57:02.398051] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LHX took 41.6s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-03T19:57:02.580317] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:02.645796] [DEBUG] [LOCAL ] LMND: Loaded 52254 existing records from primary storage. [2025-10-03T19:57:02.646148] [INFO ] [MAIN ] LMND: Loaded 52254 existing records. [2025-10-03T19:57:02.846365] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:02.846694] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-03T19:57:02.846778] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-03T19:57:02.847104] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-03T19:57:02.847181] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-03T19:57:03.056911] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:57:03.124499] [INFO ] [REMOTE ] LITB: Full fetch complete (5642 records). [2025-10-03T19:57:03.153431] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-03T19:57:03.218498] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-03T19:57:03.352445] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:03.631885] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-03T19:57:03.631973] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-03T19:57:03.632228] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-03T19:57:03.632286] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-03T19:57:03.632818] [DEBUG] [LOCAL ] LITB: Trimmed 5642 records to 4388 (keeping 200 days of data) [2025-10-03T19:57:03.660733] [DEBUG] [LOCAL ] LITB: Primary data saved (4388 records). [2025-10-03T19:57:03.660883] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-03T19:57:03.661014] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LITB took 24.3s. Estimated remaining: 2h 36m 11s. Rate: 7.1 symbols/min [2025-10-03T19:57:03.849040] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:03.912046] [DEBUG] [LOCAL ] LMT: Loaded 50172 existing records from primary storage. [2025-10-03T19:57:03.912419] [INFO ] [MAIN ] LMT: Loaded 50172 existing records. [2025-10-03T19:57:03.995847] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-03T19:57:04.104002] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:04.104333] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-03T19:57:04.104396] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-03T19:57:04.105076] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-03T19:57:04.105139] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-03T19:57:04.493410] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:04.790694] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-03T19:57:05.094169] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:57:05.590719] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-03T19:57:06.052095] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T19:57:06.390690] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-03T19:57:07.041435] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T19:57:07.190699] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-03T19:57:07.245278] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:57:07.990693] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-03T19:57:08.217458] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T19:57:08.790679] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-03T19:57:09.329978] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T19:57:09.547684] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:57:09.590630] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-03T19:57:10.398457] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-03T19:57:10.408340] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:57:11.190714] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-03T19:57:11.726563] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T19:57:11.990738] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-03T19:57:12.781024] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T19:57:12.791409] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-03T19:57:12.883182] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:57:13.590631] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-03T19:57:13.895287] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:57:14.257024] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:57:14.261376] [INFO ] [REMOTE ] LION: Full fetch complete (55435 records). [2025-10-03T19:57:14.261502] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-03T19:57:14.395782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-03T19:57:14.681190] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-03T19:57:14.681280] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-03T19:57:14.682207] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-03T19:57:14.682279] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-03T19:57:14.683739] [DEBUG] [LOCAL ] LION: Trimmed 55435 records to 45007 (keeping 200 days of data) [2025-10-03T19:57:14.966464] [DEBUG] [LOCAL ] LION: Primary data saved (45007 records). [2025-10-03T19:57:14.966622] [INFO ] [MAIN ] LION: Full history saved. [2025-10-03T19:57:14.966769] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LION took 40.1s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-03T19:57:15.163917] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:15.193572] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-03T19:57:15.216417] [DEBUG] [LOCAL ] LNC: Loaded 51991 existing records from primary storage. [2025-10-03T19:57:15.216787] [INFO ] [MAIN ] LNC: Loaded 51991 existing records. [2025-10-03T19:57:15.414111] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:15.414482] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-03T19:57:15.414670] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-03T19:57:15.415166] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-03T19:57:15.415288] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-03T19:57:15.589021] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T19:57:15.871805] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:15.990706] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-03T19:57:16.597408] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-03T19:57:16.790706] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-03T19:57:17.590732] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-03T19:57:17.630350] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:57:17.698773] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T19:57:18.390633] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-03T19:57:18.740747] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:57:18.876036] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:57:19.190722] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-03T19:57:19.990628] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-03T19:57:20.417325] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T19:57:20.790684] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-03T19:57:21.590721] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-03T19:57:21.819900] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-03T19:57:22.112834] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T19:57:22.390634] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-03T19:57:22.917882] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T19:57:23.054428] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T19:57:23.190746] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-03T19:57:23.990689] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-03T19:57:24.454875] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T19:57:24.790692] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-03T19:57:24.915275] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:57:25.592950] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-03T19:57:25.596419] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:57:26.390689] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-03T19:57:27.047054] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-03T19:57:27.190695] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-03T19:57:27.926121] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T19:57:27.990679] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-03T19:57:28.511780] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T19:57:28.790673] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-03T19:57:28.922080] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:57:29.590734] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-03T19:57:30.390743] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-03T19:57:30.471118] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T19:57:31.154630] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T19:57:31.190619] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-03T19:57:31.566581] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-03T19:57:31.573188] [INFO ] [REMOTE ] LMND: Full fetch complete (75322 records). [2025-10-03T19:57:31.573395] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-03T19:57:31.993944] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-03T19:57:32.021888] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-03T19:57:32.022980] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-03T19:57:32.024244] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-03T19:57:32.024581] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-03T19:57:32.026695] [DEBUG] [LOCAL ] LMND: Trimmed 75322 records to 52640 (keeping 200 days of data) [2025-10-03T19:57:32.150397] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:57:32.398849] [DEBUG] [LOCAL ] LMND: Primary data saved (52640 records). [2025-10-03T19:57:32.398998] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-03T19:57:32.399097] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LMND took 30.0s. Estimated remaining: 2h 36m 4s. Rate: 7.1 symbols/min [2025-10-03T19:57:32.603184] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:32.610988] [DEBUG] [LOCAL ] LND: Loaded 4941 existing records from primary storage. [2025-10-03T19:57:32.611245] [INFO ] [MAIN ] LND: Loaded 4941 existing records. [2025-10-03T19:57:32.795773] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-03T19:57:32.801727] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:32.802752] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-03T19:57:32.802822] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-03T19:57:32.803007] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-03T19:57:32.803066] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-03T19:57:33.238303] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:33.490601] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T19:57:33.590730] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-03T19:57:34.390742] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-03T19:57:34.619669] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:57:34.653536] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T19:57:35.190706] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-03T19:57:35.214862] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T19:57:35.625001] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T19:57:35.990695] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-03T19:57:36.790742] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-03T19:57:37.590688] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-03T19:57:37.762785] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:57:37.929010] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-03T19:57:38.187742] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:57:38.390689] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-03T19:57:38.473809] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T19:57:38.477042] [INFO ] [REMOTE ] LMT: Full fetch complete (72440 records). [2025-10-03T19:57:38.477234] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-03T19:57:38.920095] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-03T19:57:38.920223] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-03T19:57:38.921561] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-03T19:57:38.921637] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-03T19:57:38.923305] [DEBUG] [LOCAL ] LMT: Trimmed 72440 records to 50509 (keeping 200 days of data) [2025-10-03T19:57:39.157766] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:57:39.190849] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-03T19:57:39.272775] [DEBUG] [LOCAL ] LMT: Primary data saved (50509 records). [2025-10-03T19:57:39.272935] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-03T19:57:39.273786] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LMT took 35.6s. Estimated remaining: 2h 35m 55s. Rate: 7.1 symbols/min [2025-10-03T19:57:39.465156] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:39.523994] [DEBUG] [LOCAL ] LNG: Loaded 51737 existing records from primary storage. [2025-10-03T19:57:39.524399] [INFO ] [MAIN ] LNG: Loaded 51737 existing records. [2025-10-03T19:57:39.742767] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:39.743010] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-03T19:57:39.743068] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-03T19:57:39.743732] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-03T19:57:39.743833] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-03T19:57:40.002034] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-03T19:57:40.137486] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:40.790715] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-03T19:57:41.590698] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-03T19:57:41.712743] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:57:41.844367] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-03T19:57:41.981858] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-03T19:57:42.390678] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-03T19:57:42.701615] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T19:57:42.952706] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:57:42.955781] [INFO ] [REMOTE ] LLY: Full fetch complete (77277 records). [2025-10-03T19:57:42.955923] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-03T19:57:43.198409] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-03T19:57:43.390757] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-03T19:57:43.390865] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-03T19:57:43.392226] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-03T19:57:43.392292] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-03T19:57:43.393878] [DEBUG] [LOCAL ] LLY: Trimmed 77277 records to 54064 (keeping 200 days of data) [2025-10-03T19:57:43.753707] [DEBUG] [LOCAL ] LLY: Primary data saved (54064 records). [2025-10-03T19:57:43.753858] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-03T19:57:43.753966] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LLY took 43.6s. Estimated remaining: 2h 35m 43s. Rate: 7.1 symbols/min [2025-10-03T19:57:43.935408] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:43.942306] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T19:57:43.956446] [DEBUG] [LOCAL ] LNN: Loaded 11250 existing records from primary storage. [2025-10-03T19:57:43.956699] [INFO ] [MAIN ] LNN: Loaded 11250 existing records. [2025-10-03T19:57:43.996168] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-03T19:57:44.151496] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:44.151990] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-03T19:57:44.152064] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-03T19:57:44.152295] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-03T19:57:44.152383] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-03T19:57:44.543706] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:44.790683] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-03T19:57:45.362482] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T19:57:45.590624] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-03T19:57:45.695052] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:57:46.390672] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-03T19:57:46.399112] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T19:57:47.190697] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-03T19:57:47.990705] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-03T19:57:48.287891] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:57:48.657319] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:57:48.790663] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-03T19:57:48.955935] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:57:49.590677] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-03T19:57:49.614152] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:57:50.390725] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-03T19:57:51.120992] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T19:57:51.124620] [INFO ] [REMOTE ] LNC: Full fetch complete (74290 records). [2025-10-03T19:57:51.124882] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-03T19:57:51.195881] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-03T19:57:51.591193] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-03T19:57:51.591295] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-03T19:57:51.592457] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-03T19:57:51.592525] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-03T19:57:51.594214] [DEBUG] [LOCAL ] LNC: Trimmed 74290 records to 52378 (keeping 200 days of data) [2025-10-03T19:57:51.870561] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T19:57:51.953397] [DEBUG] [LOCAL ] LNC: Primary data saved (52378 records). [2025-10-03T19:57:51.953663] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-03T19:57:51.953827] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LNC took 37.0s. Estimated remaining: 2h 35m 34s. Rate: 7.1 symbols/min [2025-10-03T19:57:51.992249] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-03T19:57:52.151021] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:52.193847] [DEBUG] [LOCAL ] LOAR: Loaded 41885 existing records from primary storage. [2025-10-03T19:57:52.194255] [INFO ] [MAIN ] LOAR: Loaded 41885 existing records. [2025-10-03T19:57:52.385503] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:52.385853] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-03T19:57:52.401584] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-03T19:57:52.412857] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-03T19:57:52.413956] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T19:57:52.414066] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-03T19:57:52.793528] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-03T19:57:52.821366] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:52.846739] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T19:57:53.590731] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-03T19:57:54.202680] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T19:57:54.390687] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-03T19:57:54.691930] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:57:55.190700] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-03T19:57:55.818677] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:57:55.833703] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:57:55.990698] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-03T19:57:56.790688] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-03T19:57:57.590700] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-03T19:57:57.705187] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T19:57:57.735145] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:57:58.390714] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-03T19:57:58.599699] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:57:59.190715] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-03T19:57:59.751275] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:57:59.934937] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T19:57:59.990685] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-03T19:58:00.790727] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-03T19:58:00.872822] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T19:58:01.374922] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T19:58:01.590742] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-03T19:58:02.390635] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-03T19:58:02.552478] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:58:03.029855] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T19:58:03.031002] [INFO ] [REMOTE ] LND: Full fetch complete (8331 records). [2025-10-03T19:58:03.031075] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-03T19:58:03.214244] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-03T19:58:03.419621] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-03T19:58:03.419737] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-03T19:58:03.420145] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-03T19:58:03.420233] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-03T19:58:03.421064] [DEBUG] [LOCAL ] LND: Trimmed 8331 records to 4994 (keeping 200 days of data) [2025-10-03T19:58:03.451488] [DEBUG] [LOCAL ] LND: Primary data saved (4994 records). [2025-10-03T19:58:03.451633] [INFO ] [MAIN ] LND: Full history saved. [2025-10-03T19:58:03.451766] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LND took 31.1s. Estimated remaining: 2h 35m 28s. Rate: 7.1 symbols/min [2025-10-03T19:58:03.644783] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:03.674123] [DEBUG] [LOCAL ] LOB: Loaded 27571 existing records from primary storage. [2025-10-03T19:58:03.674442] [INFO ] [MAIN ] LOB: Loaded 27571 existing records. [2025-10-03T19:58:03.867242] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:03.867478] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-03T19:58:03.867527] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-03T19:58:03.867837] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-03T19:58:03.867897] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-03T19:58:03.995877] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-03T19:58:04.260763] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:04.790688] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-03T19:58:05.071096] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:58:05.423142] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:58:05.577300] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:58:05.590607] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-03T19:58:06.343532] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:58:06.390637] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-03T19:58:07.190682] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-03T19:58:07.219824] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:58:07.220921] [INFO ] [REMOTE ] LNN: Full fetch complete (15651 records). [2025-10-03T19:58:07.220996] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-03T19:58:07.639535] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-03T19:58:07.639616] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-03T19:58:07.640065] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-03T19:58:07.640128] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-03T19:58:07.640742] [DEBUG] [LOCAL ] LNN: Trimmed 15651 records to 11340 (keeping 200 days of data) [2025-10-03T19:58:07.720400] [DEBUG] [LOCAL ] LNN: Primary data saved (11340 records). [2025-10-03T19:58:07.720562] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-03T19:58:07.720693] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNN took 24.0s. Estimated remaining: 2h 35m 16s. Rate: 7.1 symbols/min [2025-10-03T19:58:07.914162] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:07.921218] [DEBUG] [LOCAL ] LOCL: Loaded 3642 existing records from primary storage. [2025-10-03T19:58:07.921400] [INFO ] [MAIN ] LOCL: Loaded 3642 existing records. [2025-10-03T19:58:07.995874] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-03T19:58:08.124567] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:08.124807] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-03T19:58:08.124857] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-03T19:58:08.125116] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-03T19:58:08.125177] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-03T19:58:08.549301] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:08.790730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-03T19:58:09.227991] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T19:58:09.408295] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:58:09.590721] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-03T19:58:09.774403] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:58:10.390703] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-03T19:58:11.190723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-03T19:58:11.345763] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:58:11.971543] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:58:11.990701] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-03T19:58:12.274410] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:58:12.790698] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-03T19:58:13.590730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-03T19:58:13.764578] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:58:14.390620] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-03T19:58:14.501235] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:58:14.638766] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:58:15.190685] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-03T19:58:15.930907] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:58:15.933734] [INFO ] [REMOTE ] LNG: Full fetch complete (74681 records). [2025-10-03T19:58:15.933871] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-03T19:58:15.995894] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-03T19:58:16.377116] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-03T19:58:16.377216] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-03T19:58:16.378473] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-03T19:58:16.378546] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-03T19:58:16.380037] [DEBUG] [LOCAL ] LNG: Trimmed 74681 records to 52089 (keeping 200 days of data) [2025-10-03T19:58:16.769158] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:58:16.773901] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:58:16.788975] [DEBUG] [LOCAL ] LNG: Primary data saved (52089 records). [2025-10-03T19:58:16.790182] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-03T19:58:16.791744] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LNG took 37.5s. Estimated remaining: 2h 35m 8s. Rate: 7.1 symbols/min [2025-10-03T19:58:16.791933] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-03T19:58:16.986890] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:17.026707] [DEBUG] [LOCAL ] LOMA: Loaded 32305 existing records from primary storage. [2025-10-03T19:58:17.026993] [INFO ] [MAIN ] LOMA: Loaded 32305 existing records. [2025-10-03T19:58:17.219958] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:17.220216] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-03T19:58:17.220268] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-03T19:58:17.220683] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-03T19:58:17.220744] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-03T19:58:17.330475] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:58:17.595203] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-03T19:58:17.600614] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:17.941300] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T19:58:18.390715] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-03T19:58:19.190692] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-03T19:58:19.668122] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T19:58:19.855573] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:58:19.990734] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-03T19:58:20.790708] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-03T19:58:21.485967] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:58:21.534748] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T19:58:21.590730] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-03T19:58:22.390695] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-03T19:58:22.677789] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-03T19:58:23.195845] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-03T19:58:23.220374] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:58:23.990719] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-03T19:58:24.555141] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:58:24.790728] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-03T19:58:25.255774] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:58:25.590714] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-03T19:58:26.037528] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T19:58:26.195914] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T19:58:26.390708] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-03T19:58:27.190722] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-03T19:58:27.747208] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:58:27.816110] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:58:27.990717] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-03T19:58:28.507863] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T19:58:28.790699] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-03T19:58:29.413717] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T19:58:29.590685] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-03T19:58:30.142108] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:58:30.142893] [INFO ] [REMOTE ] LOCL: Full fetch complete (4680 records). [2025-10-03T19:58:30.142965] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-03T19:58:30.395851] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-03T19:58:30.552707] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-03T19:58:30.552797] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-03T19:58:30.552978] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-03T19:58:30.553056] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-03T19:58:30.553535] [DEBUG] [LOCAL ] LOCL: Trimmed 4680 records to 3659 (keeping 200 days of data) [2025-10-03T19:58:30.576537] [DEBUG] [LOCAL ] LOCL: Primary data saved (3659 records). [2025-10-03T19:58:30.576713] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-03T19:58:30.576832] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LOCL took 22.9s. Estimated remaining: 2h 35m 4s. Rate: 7.1 symbols/min [2025-10-03T19:58:30.760085] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:30.824163] [DEBUG] [LOCAL ] LOW: Loaded 53319 existing records from primary storage. [2025-10-03T19:58:30.824509] [INFO ] [MAIN ] LOW: Loaded 53319 existing records. [2025-10-03T19:58:31.042762] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:31.043039] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-03T19:58:31.043099] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-03T19:58:31.043840] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-03T19:58:31.043904] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-03T19:58:31.197944] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-03T19:58:31.440401] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:31.744735] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:58:31.750016] [INFO ] [REMOTE ] LOAR: Full fetch complete (56166 records). [2025-10-03T19:58:31.750160] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-03T19:58:31.996249] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-03T19:58:32.240922] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-03T19:58:32.241293] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-03T19:58:32.244029] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:58:32.242922] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-03T19:58:32.251239] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-03T19:58:32.253217] [DEBUG] [LOCAL ] LOAR: Trimmed 56166 records to 42186 (keeping 200 days of data) [2025-10-03T19:58:32.512157] [DEBUG] [LOCAL ] LOAR: Primary data saved (42186 records). [2025-10-03T19:58:32.512300] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-03T19:58:32.512409] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOAR took 40.6s. Estimated remaining: 2h 34m 50s. Rate: 7.1 symbols/min [2025-10-03T19:58:32.706227] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:32.748861] [DEBUG] [LOCAL ] LPG: Loaded 40198 existing records from primary storage. [2025-10-03T19:58:32.749254] [INFO ] [MAIN ] LPG: Loaded 40198 existing records. [2025-10-03T19:58:32.795790] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-03T19:58:32.997256] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:32.997521] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-03T19:58:32.997586] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-03T19:58:32.998094] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-03T19:58:32.998170] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-03T19:58:33.389303] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:33.590729] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-03T19:58:33.826140] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:58:33.871946] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T19:58:34.390677] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-03T19:58:34.674762] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:58:35.190711] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-03T19:58:35.990785] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-03T19:58:35.998126] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:58:36.366672] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:58:36.790627] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-03T19:58:37.256586] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:58:37.590722] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-03T19:58:38.390743] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-03T19:58:38.630201] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:58:38.820194] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:58:39.190728] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-03T19:58:39.991472] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-03T19:58:40.092056] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:58:40.659855] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:58:40.790692] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-03T19:58:41.590635] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-03T19:58:41.903044] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T19:58:41.983761] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:58:42.390632] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-03T19:58:43.200757] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-03T19:58:43.206372] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:58:43.990693] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-03T19:58:44.410450] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:58:44.569389] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T19:58:44.790702] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-03T19:58:45.432425] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:58:45.590702] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-03T19:58:45.973348] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T19:58:46.390712] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-03T19:58:47.193835] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-03T19:58:47.198140] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:58:47.990729] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-03T19:58:48.343185] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:58:48.408526] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:58:48.790680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-03T19:58:49.190491] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:58:49.590699] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-03T19:58:50.397066] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-03T19:58:50.420965] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:58:50.708470] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:58:51.190715] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-03T19:58:51.941437] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:58:51.990711] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-03T19:58:52.790626] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-03T19:58:53.125321] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:58:53.216890] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T19:58:53.590735] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-03T19:58:53.961143] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:58:54.390706] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-03T19:58:55.190638] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-03T19:58:55.516872] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T19:58:55.617538] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:58:55.619687] [INFO ] [REMOTE ] LOMA: Full fetch complete (47827 records). [2025-10-03T19:58:55.619785] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-03T19:58:55.991462] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-03T19:58:56.037448] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-03T19:58:56.037539] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-03T19:58:56.038498] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-03T19:58:56.038570] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-03T19:58:56.039830] [DEBUG] [LOCAL ] LOMA: Trimmed 47827 records to 32578 (keeping 200 days of data) [2025-10-03T19:58:56.249134] [DEBUG] [LOCAL ] LOMA: Primary data saved (32578 records). [2025-10-03T19:58:56.249313] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-03T19:58:56.250007] [INFO ] [MAIN ] Update Progress: 1270/2370 symbols completed. LOMA took 39.5s. Estimated remaining: 2h 34m 55s. Rate: 7.1 symbols/min [2025-10-03T19:58:56.449266] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:56.480450] [DEBUG] [LOCAL ] LPL: Loaded 26772 existing records from primary storage. [2025-10-03T19:58:56.480812] [INFO ] [MAIN ] LPL: Loaded 26772 existing records. [2025-10-03T19:58:56.643605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:58:56.705078] [INFO ] [REMOTE ] LOB: Full fetch complete (37957 records). [2025-10-03T19:58:56.712159] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-03T19:58:56.736898] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:56.737279] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-03T19:58:56.737343] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-03T19:58:56.799286] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-03T19:58:56.814423] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-03T19:58:56.829280] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-03T19:58:57.560686] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-03T19:58:57.588201] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-03T19:58:57.612921] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-03T19:58:57.613754] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-03T19:58:57.637741] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:57.638368] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-03T19:58:57.639861] [DEBUG] [LOCAL ] LOB: Trimmed 37957 records to 27738 (keeping 200 days of data) [2025-10-03T19:58:57.832532] [DEBUG] [LOCAL ] LOB: Primary data saved (27738 records). [2025-10-03T19:58:57.832702] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-03T19:58:57.832820] [INFO ] [MAIN ] Update Progress: 1271/2370 symbols completed. LOB took 54.4s. Estimated remaining: 2h 34m 41s. Rate: 7.1 symbols/min [2025-10-03T19:58:58.052540] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:58.077735] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T19:58:58.126941] [DEBUG] [LOCAL ] LPX: Loaded 39976 existing records from primary storage. [2025-10-03T19:58:58.127241] [INFO ] [MAIN ] LPX: Loaded 39976 existing records. [2025-10-03T19:58:58.320846] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:58.321075] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-03T19:58:58.321123] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-03T19:58:58.321422] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-03T19:58:58.321481] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-03T19:58:58.399961] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-03T19:58:58.727809] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:58.775899] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T19:58:58.905618] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T19:58:59.190707] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-03T19:58:59.990680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-03T19:59:00.031205] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:59:00.215330] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:59:00.790701] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-03T19:59:01.590712] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-03T19:59:01.748529] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T19:59:01.751133] [INFO ] [REMOTE ] LOW: Full fetch complete (76504 records). [2025-10-03T19:59:01.751245] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-03T19:59:02.187762] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-03T19:59:02.187856] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-03T19:59:02.189143] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-03T19:59:02.189212] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-03T19:59:02.191276] [DEBUG] [LOCAL ] LOW: Trimmed 76504 records to 53704 (keeping 200 days of data) [2025-10-03T19:59:02.392698] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-03T19:59:02.489195] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:59:02.605436] [DEBUG] [LOCAL ] LOW: Primary data saved (53704 records). [2025-10-03T19:59:02.605619] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-03T19:59:02.605762] [INFO ] [MAIN ] Update Progress: 1272/2370 symbols completed. LOW took 32.0s. Estimated remaining: 2h 34m 29s. Rate: 7.1 symbols/min [2025-10-03T19:59:02.804799] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:02.849116] [DEBUG] [LOCAL ] LRN: Loaded 40020 existing records from primary storage. [2025-10-03T19:59:02.849451] [INFO ] [MAIN ] LRN: Loaded 40020 existing records. [2025-10-03T19:59:03.070574] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:03.070998] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-03T19:59:03.071082] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-03T19:59:03.071427] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-03T19:59:03.071546] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-03T19:59:03.199298] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-03T19:59:03.272825] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:59:03.508815] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:03.561639] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:59:03.990701] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-03T19:59:04.627338] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:59:04.629925] [INFO ] [REMOTE ] LPG: Full fetch complete (59571 records). [2025-10-03T19:59:04.630044] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-03T19:59:04.795831] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-03T19:59:05.071134] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-03T19:59:05.071228] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-03T19:59:05.072187] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-03T19:59:05.072251] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-03T19:59:05.073595] [DEBUG] [LOCAL ] LPG: Trimmed 59571 records to 40441 (keeping 200 days of data) [2025-10-03T19:59:05.320953] [DEBUG] [LOCAL ] LPG: Primary data saved (40441 records). [2025-10-03T19:59:05.321225] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-03T19:59:05.321337] [INFO ] [MAIN ] Update Progress: 1273/2370 symbols completed. LPG took 32.8s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-03T19:59:05.503112] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:05.530398] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:59:05.577782] [DEBUG] [LOCAL ] LSPD: Loaded 43183 existing records from primary storage. [2025-10-03T19:59:05.578153] [INFO ] [MAIN ] LSPD: Loaded 43183 existing records. [2025-10-03T19:59:05.601132] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-03T19:59:05.772981] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:05.773197] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-03T19:59:05.773247] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-03T19:59:05.773554] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-03T19:59:05.773615] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-03T19:59:06.161041] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:06.373317] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:59:06.390609] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-03T19:59:06.814338] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:59:07.190726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-03T19:59:07.990709] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-03T19:59:08.095370] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:59:08.383267] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T19:59:08.790717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-03T19:59:09.149910] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T19:59:09.590677] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-03T19:59:10.057618] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T19:59:10.390630] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-03T19:59:10.710264] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T19:59:11.190684] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-03T19:59:11.752750] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:59:11.863224] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:59:11.990708] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-03T19:59:12.790733] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-03T19:59:13.465518] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:59:13.590844] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-03T19:59:14.275055] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:59:14.390711] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-03T19:59:15.077516] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:59:15.190716] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-03T19:59:15.990632] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-03T19:59:16.022520] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:59:16.704442] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:59:16.790701] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-03T19:59:17.250700] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:59:17.590697] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-03T19:59:18.390680] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-03T19:59:18.435584] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:59:18.997959] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:59:19.190704] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-03T19:59:19.971465] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:59:19.990629] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-03T19:59:20.762007] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:59:20.790697] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-03T19:59:21.455113] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:59:21.590720] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-03T19:59:21.799873] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:59:22.390735] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-03T19:59:22.825424] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:59:23.190717] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-03T19:59:23.720121] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:59:23.722448] [INFO ] [REMOTE ] LPL: Full fetch complete (35682 records). [2025-10-03T19:59:23.722636] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-03T19:59:23.998798] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-03T19:59:24.130105] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-03T19:59:24.130194] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-03T19:59:24.130959] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-03T19:59:24.131039] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-03T19:59:24.132057] [DEBUG] [LOCAL ] LPL: Trimmed 35682 records to 27029 (keeping 200 days of data) [2025-10-03T19:59:24.295772] [DEBUG] [LOCAL ] LPL: Primary data saved (27029 records). [2025-10-03T19:59:24.295989] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-03T19:59:24.296119] [INFO ] [MAIN ] Update Progress: 1274/2370 symbols completed. LPL took 28.0s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-03T19:59:24.482424] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:24.515860] [DEBUG] [LOCAL ] LTC: Loaded 30459 existing records from primary storage. [2025-10-03T19:59:24.516211] [INFO ] [MAIN ] LTC: Loaded 30459 existing records. [2025-10-03T19:59:24.720707] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:24.721373] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-03T19:59:24.721489] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-03T19:59:24.722290] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-03T19:59:24.722354] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-03T19:59:24.795763] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-03T19:59:25.079085] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:59:25.176414] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:25.590637] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-03T19:59:25.679761] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:59:26.390692] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-03T19:59:26.478712] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T19:59:26.791487] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:59:27.190715] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-03T19:59:27.575847] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:59:27.990693] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-03T19:59:28.793058] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-03T19:59:28.799289] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:59:29.303393] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T19:59:29.590720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-03T19:59:30.289968] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:59:30.390710] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-03T19:59:30.568525] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:59:31.190704] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-03T19:59:31.973091] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:59:31.990671] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-03T19:59:32.355354] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:59:32.790732] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-03T19:59:33.528202] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:59:33.590675] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-03T19:59:34.039154] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:59:34.390712] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-03T19:59:35.055500] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:59:35.190732] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-03T19:59:35.887377] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:59:35.990629] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-03T19:59:36.638075] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:59:36.641019] [INFO ] [REMOTE ] LRN: Full fetch complete (58493 records). [2025-10-03T19:59:36.641170] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-03T19:59:36.804817] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-03T19:59:37.085836] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-03T19:59:37.086048] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-03T19:59:37.087111] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-03T19:59:37.087177] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-03T19:59:37.089459] [DEBUG] [LOCAL ] LRN: Trimmed 58493 records to 40253 (keeping 200 days of data) [2025-10-03T19:59:37.341576] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T19:59:37.389639] [DEBUG] [LOCAL ] LRN: Primary data saved (40253 records). [2025-10-03T19:59:37.389817] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-03T19:59:37.389921] [INFO ] [MAIN ] Update Progress: 1275/2370 symbols completed. LRN took 34.8s. Estimated remaining: 2h 34m 12s. Rate: 7.1 symbols/min [2025-10-03T19:59:37.619578] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-03T19:59:37.622445] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:37.690236] [DEBUG] [LOCAL ] LTH: Loaded 52100 existing records from primary storage. [2025-10-03T19:59:37.690638] [INFO ] [MAIN ] LTH: Loaded 52100 existing records. [2025-10-03T19:59:37.891101] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:37.891523] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-03T19:59:37.891702] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-03T19:59:37.892121] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-03T19:59:37.892182] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-03T19:59:38.270821] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:59:38.323314] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:38.390636] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-03T19:59:38.640744] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T19:59:38.643249] [INFO ] [REMOTE ] LPX: Full fetch complete (58838 records). [2025-10-03T19:59:38.643347] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-03T19:59:39.077469] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-03T19:59:39.077600] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-03T19:59:39.078744] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-03T19:59:39.078839] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-03T19:59:39.080208] [DEBUG] [LOCAL ] LPX: Trimmed 58838 records to 40238 (keeping 200 days of data) [2025-10-03T19:59:39.193354] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-03T19:59:39.346218] [DEBUG] [LOCAL ] LPX: Primary data saved (40238 records). [2025-10-03T19:59:39.346353] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-03T19:59:39.346439] [INFO ] [MAIN ] Update Progress: 1276/2370 symbols completed. LPX took 41.5s. Estimated remaining: 2h 33m 58s. Rate: 7.1 symbols/min [2025-10-03T19:59:39.533745] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:39.571379] [DEBUG] [LOCAL ] LTM: Loaded 37342 existing records from primary storage. [2025-10-03T19:59:39.571784] [INFO ] [MAIN ] LTM: Loaded 37342 existing records. [2025-10-03T19:59:39.765740] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:39.766067] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-03T19:59:39.766202] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-03T19:59:39.766607] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-03T19:59:39.766726] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-03T19:59:39.992382] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-03T19:59:40.120397] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T19:59:40.198529] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:40.552033] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:59:40.790735] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-03T19:59:41.429375] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:59:41.590749] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-03T19:59:41.656299] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T19:59:42.390692] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-03T19:59:42.764314] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:59:42.766535] [INFO ] [REMOTE ] LSPD: Full fetch complete (61688 records). [2025-10-03T19:59:42.766636] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-03T19:59:43.181701] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-03T19:59:43.181792] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-03T19:59:43.182745] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-03T19:59:43.182809] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-03T19:59:43.184740] [DEBUG] [LOCAL ] LSPD: Trimmed 61688 records to 43487 (keeping 200 days of data) [2025-10-03T19:59:43.190683] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-03T19:59:43.457670] [DEBUG] [LOCAL ] LSPD: Primary data saved (43487 records). [2025-10-03T19:59:43.457827] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-03T19:59:43.457973] [INFO ] [MAIN ] Update Progress: 1277/2370 symbols completed. LSPD took 38.1s. Estimated remaining: 2h 33m 46s. Rate: 7.1 symbols/min [2025-10-03T19:59:43.934787] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:59:43.990679] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-03T19:59:44.392924] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:59:44.790719] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-03T19:59:45.457987] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T19:59:45.590714] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-03T19:59:45.855594] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:59:46.390701] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-03T19:59:46.971710] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:59:47.190727] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-03T19:59:47.487249] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T19:59:47.990729] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-03T19:59:48.785848] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T19:59:48.795710] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-03T19:59:49.139960] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T19:59:49.590700] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-03T19:59:50.103465] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T19:59:50.390702] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-03T19:59:50.858267] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T19:59:51.190708] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-03T19:59:51.990637] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-03T19:59:52.111195] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:59:52.501259] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:59:52.790691] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-03T19:59:53.145754] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T19:59:53.147803] [INFO ] [REMOTE ] LTC: Full fetch complete (43520 records). [2025-10-03T19:59:53.147912] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-03T19:59:53.556590] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-03T19:59:53.556707] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-03T19:59:53.557520] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-03T19:59:53.557565] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-03T19:59:53.558761] [DEBUG] [LOCAL ] LTC: Trimmed 43520 records to 30653 (keeping 200 days of data) [2025-10-03T19:59:53.616631] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-03T19:59:53.766545] [DEBUG] [LOCAL ] LTC: Primary data saved (30653 records). [2025-10-03T19:59:53.766742] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-03T19:59:53.767347] [INFO ] [MAIN ] Update Progress: 1278/2370 symbols completed. LTC took 29.5s. Estimated remaining: 2h 33m 39s. Rate: 7.1 symbols/min [2025-10-03T19:59:54.357549] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:59:54.390731] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-03T19:59:55.170120] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T19:59:55.190613] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-03T19:59:56.155862] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:59:56.167784] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-03T19:59:56.627264] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T19:59:56.790720] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-03T19:59:57.626438] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:59:57.638048] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-03T19:59:58.379122] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:59:58.390626] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-03T19:59:59.349561] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:59:59.362493] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-03T20:00:00.096922] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:00:00.109791] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-03T20:00:01.083258] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T20:00:01.095188] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-03T20:00:01.624410] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T20:00:01.628586] [INFO ] [REMOTE ] LTM: Full fetch complete (48324 records). [2025-10-03T20:00:01.628805] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-03T20:00:02.075978] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-03T20:00:02.076076] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-03T20:00:02.077079] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-03T20:00:02.077155] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-03T20:00:02.078511] [DEBUG] [LOCAL ] LTM: Trimmed 48324 records to 37673 (keeping 200 days of data) [2025-10-03T20:00:02.317468] [DEBUG] [LOCAL ] LTM: Primary data saved (37673 records). [2025-10-03T20:00:02.317632] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-03T20:00:02.317815] [INFO ] [MAIN ] Update Progress: 1279/2370 symbols completed. LTM took 23.0s. Estimated remaining: 2h 33m 31s. Rate: 7.1 symbols/min [2025-10-03T20:00:02.804844] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:00:02.816582] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-03T20:00:04.622446] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T20:00:04.625251] [INFO ] [REMOTE ] LTH: Full fetch complete (74256 records). [2025-10-03T20:00:04.625421] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-03T20:00:05.107042] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-03T20:00:05.107138] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-03T20:00:05.108869] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-03T20:00:05.108992] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-03T20:00:05.111180] [DEBUG] [LOCAL ] LTH: Trimmed 74256 records to 52466 (keeping 200 days of data) [2025-10-03T20:00:05.469133] [DEBUG] [LOCAL ] LTH: Primary data saved (52466 records). [2025-10-03T20:00:05.469292] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-03T20:00:05.469426] [INFO ] [MAIN ] Update Progress: 1280/2370 symbols completed. LTH took 28.1s. Estimated remaining: 2h 33m 18s. Rate: 7.1 symbols/min [2025-10-03T20:00:06.180956] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:06.241415] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:06.244526] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:06.266609] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:06.326299] [DEBUG] [LOCAL ] LUCK: Loaded 24825 existing records from primary storage. [2025-10-03T20:00:06.339150] [INFO ] [MAIN ] LUCK: Loaded 24825 existing records. [2025-10-03T20:00:06.494396] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-10-03T20:00:06.484783] [DEBUG] [LOCAL ] LU: Loaded 49348 existing records from primary storage. [2025-10-03T20:00:06.514778] [INFO ] [MAIN ] LU: Loaded 49348 existing records. [2025-10-03T20:00:06.514569] [INFO ] [MAIN ] LUMN: Loaded 54024 existing records. [2025-10-03T20:00:06.822245] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-03T20:00:06.856452] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:06.867369] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-03T20:00:06.867625] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-10-03T20:00:06.878119] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-03T20:00:06.932726] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-03T20:00:06.992386] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-03T20:00:07.214973] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:07.276804] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-03T20:00:07.271408] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:07.282485] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-03T20:00:07.287841] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-03T20:00:07.305682] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-03T20:00:07.326747] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-03T20:00:07.326270] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-03T20:00:07.369474] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-03T20:00:07.388626] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-03T20:00:07.552896] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:07.600994] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-03T20:00:07.679742] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-03T20:00:07.843875] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-03T20:00:07.901167] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-03T20:00:08.310349] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:08.366789] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-03T20:00:08.807201] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:08.870455] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:08.876531] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-03T20:00:08.837491] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-03T20:00:09.004021] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:09.004391] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-03T20:00:10.221015] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T20:00:10.229180] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-03T20:00:10.391424] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T20:00:10.402531] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-03T20:00:11.018570] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T20:00:11.032925] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-03T20:00:11.070834] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-03T20:00:11.082814] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-03T20:00:11.820057] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T20:00:11.829703] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-03T20:00:11.914575] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T20:00:11.925089] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-03T20:00:12.965369] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T20:00:12.981400] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-03T20:00:13.021122] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T20:00:13.036080] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-03T20:00:13.061095] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T20:00:13.069190] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-03T20:00:13.544450] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T20:00:13.555134] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-03T20:00:13.954528] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T20:00:13.966576] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-03T20:00:14.635967] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T20:00:14.652991] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-03T20:00:15.083815] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T20:00:15.190700] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-03T20:00:15.229268] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:00:15.294888] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T20:00:15.990734] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-03T20:00:16.520828] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T20:00:16.790677] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-03T20:00:17.205878] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T20:00:17.237302] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T20:00:17.590737] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-03T20:00:18.390699] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-03T20:00:18.691982] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T20:00:18.878448] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T20:00:19.190734] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-03T20:00:19.990720] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-03T20:00:20.309341] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T20:00:20.790746] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-03T20:00:21.134486] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T20:00:21.173880] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T20:00:21.590739] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-03T20:00:22.390720] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-03T20:00:22.482598] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T20:00:23.104991] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T20:00:23.190706] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-03T20:00:23.625295] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T20:00:23.990736] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-03T20:00:24.790742] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-03T20:00:25.093062] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T20:00:25.138703] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T20:00:25.590731] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-03T20:00:26.364550] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T20:00:26.390620] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-03T20:00:26.573089] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T20:00:26.574724] [INFO ] [REMOTE ] LUCK: Full fetch complete (41107 records). [2025-10-03T20:00:26.574847] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-03T20:00:27.017304] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-03T20:00:27.017483] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-03T20:00:27.018408] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-03T20:00:27.018473] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-03T20:00:27.019565] [DEBUG] [LOCAL ] LUCK: Trimmed 41107 records to 24969 (keeping 200 days of data) [2025-10-03T20:00:27.181603] [DEBUG] [LOCAL ] LUCK: Primary data saved (24969 records). [2025-10-03T20:00:27.181772] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-03T20:00:27.181925] [INFO ] [MAIN ] Update Progress: 1281/2370 symbols completed. LUCK took 21.7s. Estimated remaining: 2h 33m 21s. Rate: 7.1 symbols/min [2025-10-03T20:00:27.195800] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-03T20:00:27.381294] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:27.381524] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-03T20:00:27.381587] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-03T20:00:27.381743] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-03T20:00:27.381788] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-03T20:00:27.381832] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-03T20:00:27.381877] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-03T20:00:27.816951] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:27.990719] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-03T20:00:28.185993] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:00:28.186375] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-03T20:00:28.186486] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:00:28.186545] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-03T20:00:28.186588] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:00:28.186636] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-03T20:00:28.186757] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-03T20:00:28.186809] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-03T20:00:28.186881] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-03T20:00:28.186965] [INFO ] [MAIN ] Update Progress: 1282/2370 symbols completed. LUXE took 1.0s. Estimated remaining: 2h 33m 6s. Rate: 7.1 symbols/min [2025-10-03T20:00:28.397773] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:28.439709] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T20:00:28.507168] [DEBUG] [LOCAL ] LVS: Loaded 53953 existing records from primary storage. [2025-10-03T20:00:28.507611] [INFO ] [MAIN ] LVS: Loaded 53953 existing records. [2025-10-03T20:00:28.717001] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:28.717311] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-03T20:00:28.717367] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-03T20:00:28.717685] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-03T20:00:28.717746] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-03T20:00:28.795928] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-03T20:00:29.130414] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:29.217951] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T20:00:29.590744] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-03T20:00:30.131626] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T20:00:30.390727] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-03T20:00:31.190677] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-03T20:00:31.462846] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T20:00:31.990698] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-03T20:00:32.204298] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T20:00:32.790686] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-03T20:00:32.823908] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T20:00:33.582123] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T20:00:33.593724] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-03T20:00:34.390701] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-03T20:00:34.531736] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T20:00:34.916719] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T20:00:35.190722] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-03T20:00:35.990689] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-03T20:00:36.110241] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T20:00:36.793518] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-03T20:00:36.799383] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T20:00:37.590883] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-03T20:00:38.022861] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T20:00:38.390725] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-03T20:00:38.529811] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T20:00:39.190707] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-03T20:00:39.254524] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T20:00:39.990705] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-03T20:00:40.145661] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T20:00:40.148730] [INFO ] [REMOTE ] LUMN: Full fetch complete (77636 records). [2025-10-03T20:00:40.148915] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-03T20:00:40.596947] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-03T20:00:40.597042] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-03T20:00:40.598213] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-03T20:00:40.598295] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-03T20:00:40.600136] [DEBUG] [LOCAL ] LUMN: Trimmed 77636 records to 54414 (keeping 200 days of data) [2025-10-03T20:00:40.805217] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-03T20:00:40.926543] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T20:00:40.933047] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-03T20:00:40.934462] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-03T20:00:41.243721] [DEBUG] [LOCAL ] LUMN: Primary data saved (54414 records). [2025-10-03T20:00:41.259396] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-03T20:00:41.265863] [INFO ] [MAIN ] Update Progress: 1283/2370 symbols completed. LUMN took 35.8s. Estimated remaining: 2h 33m 1s. Rate: 7.1 symbols/min [2025-10-03T20:00:41.569480] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-03T20:00:41.595999] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-03T20:00:41.627538] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:41.629368] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-03T20:00:41.631430] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T20:00:41.635366] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-03T20:00:41.636006] [INFO ] [REMOTE ] LU: Full fetch complete (70364 records). [2025-10-03T20:00:41.636426] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-03T20:00:41.703035] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 54469 (keeping 200 days of data) [2025-10-03T20:00:41.887365] [DEBUG] [LOCAL ] LVWR: Loaded 17935 existing records from primary storage. [2025-10-03T20:00:41.893882] [INFO ] [MAIN ] LVWR: Loaded 17935 existing records. [2025-10-03T20:00:42.419847] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:42.446180] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-03T20:00:42.446685] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-03T20:00:42.442058] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-03T20:00:42.449563] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-03T20:00:42.452281] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-03T20:00:42.452891] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-03T20:00:42.454393] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-03T20:00:42.455172] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-03T20:00:42.515197] [DEBUG] [LOCAL ] LU: Trimmed 70364 records to 49698 (keeping 200 days of data) [2025-10-03T20:00:43.137616] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-03T20:00:43.272135] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-03T20:00:43.279974] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:43.297680] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-03T20:00:43.304400] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-10-03T20:00:43.304679] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-03T20:00:43.307148] [INFO ] [MAIN ] Update Progress: 1284/2370 symbols completed. LUV took 37.8s. Estimated remaining: 2h 32m 47s. Rate: 7.1 symbols/min [2025-10-03T20:00:43.619605] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:43.738378] [DEBUG] [LOCAL ] LW: Loaded 51548 existing records from primary storage. [2025-10-03T20:00:43.740416] [DEBUG] [LOCAL ] LU: Primary data saved (49698 records). [2025-10-03T20:00:43.741680] [INFO ] [MAIN ] LU: Full history saved. [2025-10-03T20:00:43.741549] [INFO ] [MAIN ] LW: Loaded 51548 existing records. [2025-10-03T20:00:43.741813] [INFO ] [MAIN ] Update Progress: 1285/2370 symbols completed. LU took 38.3s. Estimated remaining: 2h 32m 32s. Rate: 7.1 symbols/min [2025-10-03T20:00:44.060797] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T20:00:44.092858] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-03T20:00:44.178274] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:00:44.185736] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:44.186534] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-03T20:00:44.186603] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-03T20:00:44.187094] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-03T20:00:44.187156] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-03T20:00:44.371412] [DEBUG] [LOCAL ] LXFR: Loaded 16949 existing records from primary storage. [2025-10-03T20:00:44.398237] [INFO ] [MAIN ] LXFR: Loaded 16949 existing records. [2025-10-03T20:00:44.801477] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:00:44.832015] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-03T20:00:44.836355] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-03T20:00:44.836183] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:44.836807] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-03T20:00:44.841903] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-03T20:00:44.842033] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-03T20:00:44.844040] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:00:44.859408] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-03T20:00:45.269516] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:00:45.308286] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T20:00:45.521260] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T20:00:45.590703] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-03T20:00:46.390686] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-03T20:00:46.590272] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T20:00:47.190670] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-03T20:00:47.235304] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T20:00:47.371905] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:00:47.990723] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-03T20:00:48.790695] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-03T20:00:48.918031] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T20:00:48.941472] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:00:49.590682] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-03T20:00:50.390632] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-03T20:00:50.521144] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T20:00:50.546376] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T20:00:50.968690] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T20:00:51.190689] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-03T20:00:51.990731] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-03T20:00:52.177931] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T20:00:52.790676] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-03T20:00:53.590676] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-03T20:00:53.656680] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T20:00:53.717363] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:00:54.178567] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T20:00:54.390709] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-03T20:00:55.190695] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-03T20:00:55.990715] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-03T20:00:56.281884] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T20:00:56.790701] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-03T20:00:57.083785] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T20:00:57.108468] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T20:00:57.590683] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-03T20:00:57.854612] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T20:00:58.390688] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-03T20:00:59.190686] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-03T20:00:59.313785] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T20:00:59.818488] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T20:00:59.990673] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-03T20:01:00.146181] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T20:01:00.790702] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-03T20:01:01.127160] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T20:01:01.590737] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-03T20:01:02.390739] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-03T20:01:03.192697] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-03T20:01:03.213419] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-03T20:01:03.512808] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T20:01:03.541053] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T20:01:03.990683] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-03T20:01:04.243039] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T20:01:04.790723] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-03T20:01:04.815171] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T20:01:05.590680] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-03T20:01:06.390732] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-03T20:01:06.586731] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T20:01:07.190689] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-03T20:01:07.288166] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T20:01:07.291142] [INFO ] [REMOTE ] LVS: Full fetch complete (77517 records). [2025-10-03T20:01:07.291357] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-03T20:01:07.658327] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T20:01:07.774705] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-03T20:01:07.774811] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-03T20:01:07.776097] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-03T20:01:07.776176] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-03T20:01:07.777984] [DEBUG] [LOCAL ] LVS: Trimmed 77517 records to 54343 (keeping 200 days of data) [2025-10-03T20:01:08.005876] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-03T20:01:08.123326] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T20:01:08.157223] [DEBUG] [LOCAL ] LVS: Primary data saved (54343 records). [2025-10-03T20:01:08.157415] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-03T20:01:08.160064] [INFO ] [MAIN ] Update Progress: 1286/2370 symbols completed. LVS took 40.0s. Estimated remaining: 2h 32m 37s. Rate: 7.1 symbols/min [2025-10-03T20:01:08.354828] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:08.408127] [DEBUG] [LOCAL ] LXP: Loaded 51071 existing records from primary storage. [2025-10-03T20:01:08.408580] [INFO ] [MAIN ] LXP: Loaded 51071 existing records. [2025-10-03T20:01:08.603256] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:08.603541] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-03T20:01:08.603622] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-03T20:01:08.604075] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-03T20:01:08.604139] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-03T20:01:08.805289] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-03T20:01:09.041712] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:09.590752] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-03T20:01:09.596280] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T20:01:09.598133] [INFO ] [REMOTE ] LVWR: Full fetch complete (20153 records). [2025-10-03T20:01:09.598460] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-03T20:01:09.763304] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:01:10.077801] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-03T20:01:10.077923] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-03T20:01:10.078546] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-03T20:01:10.078624] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-03T20:01:10.079515] [DEBUG] [LOCAL ] LVWR: Trimmed 20153 records to 18043 (keeping 200 days of data) [2025-10-03T20:01:10.186847] [DEBUG] [LOCAL ] LVWR: Primary data saved (18043 records). [2025-10-03T20:01:10.186996] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-03T20:01:10.187083] [INFO ] [MAIN ] Update Progress: 1287/2370 symbols completed. LVWR took 28.9s. Estimated remaining: 2h 32m 23s. Rate: 7.1 symbols/min [2025-10-03T20:01:10.403870] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:10.399241] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-03T20:01:10.415689] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T20:01:10.417565] [INFO ] [REMOTE ] LXFR: Full fetch complete (25055 records). [2025-10-03T20:01:10.417751] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-03T20:01:10.605964] [DEBUG] [LOCAL ] LXU: Loaded 31890 existing records from primary storage. [2025-10-03T20:01:10.625706] [INFO ] [MAIN ] LXU: Loaded 31890 existing records. [2025-10-03T20:01:11.054432] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-03T20:01:11.062959] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-03T20:01:11.086634] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-03T20:01:11.092364] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:11.092637] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-03T20:01:11.092756] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-03T20:01:11.093061] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-03T20:01:11.093339] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-03T20:01:11.093406] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-03T20:01:11.154461] [DEBUG] [LOCAL ] LXFR: Trimmed 25055 records to 17050 (keeping 200 days of data) [2025-10-03T20:01:11.194879] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-03T20:01:11.593465] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:11.615784] [DEBUG] [LOCAL ] LXFR: Primary data saved (17050 records). [2025-10-03T20:01:11.615962] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-03T20:01:11.616056] [INFO ] [MAIN ] Update Progress: 1288/2370 symbols completed. LXFR took 27.9s. Estimated remaining: 2h 32m 9s. Rate: 7.1 symbols/min [2025-10-03T20:01:11.808701] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:11.862027] [DEBUG] [LOCAL ] LYB: Loaded 53992 existing records from primary storage. [2025-10-03T20:01:11.862388] [INFO ] [MAIN ] LYB: Loaded 53992 existing records. [2025-10-03T20:01:11.995088] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-03T20:01:12.061991] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:12.062220] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-03T20:01:12.062272] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-03T20:01:12.062769] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-03T20:01:12.062832] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-03T20:01:12.470441] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:12.506592] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T20:01:12.790571] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-03T20:01:12.979079] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T20:01:13.189043] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:01:13.590685] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-03T20:01:14.390718] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-03T20:01:14.461632] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T20:01:14.523180] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T20:01:15.190712] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-03T20:01:15.995743] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-03T20:01:16.012930] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T20:01:16.790746] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-03T20:01:17.591072] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-03T20:01:17.769612] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-03T20:01:18.390748] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-03T20:01:18.432097] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-03T20:01:18.495045] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T20:01:18.799105] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T20:01:19.190735] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-03T20:01:19.990726] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-03T20:01:20.163626] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T20:01:20.480012] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T20:01:20.790703] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-03T20:01:21.568662] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T20:01:21.571430] [INFO ] [REMOTE ] LW: Full fetch complete (74700 records). [2025-10-03T20:01:21.571614] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-03T20:01:21.596632] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-03T20:01:22.037008] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-03T20:01:22.037102] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-03T20:01:22.038324] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-03T20:01:22.038398] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-03T20:01:22.040027] [DEBUG] [LOCAL ] LW: Trimmed 74700 records to 51931 (keeping 200 days of data) [2025-10-03T20:01:22.356961] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T20:01:22.400735] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-03T20:01:22.457462] [DEBUG] [LOCAL ] LW: Primary data saved (51931 records). [2025-10-03T20:01:22.457677] [INFO ] [MAIN ] LW: Full history saved. [2025-10-03T20:01:22.458027] [INFO ] [MAIN ] Update Progress: 1289/2370 symbols completed. LW took 39.1s. Estimated remaining: 2h 32m 3s. Rate: 7.1 symbols/min [2025-10-03T20:01:22.653588] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:22.711154] [DEBUG] [LOCAL ] LYG: Loaded 53179 existing records from primary storage. [2025-10-03T20:01:22.711486] [INFO ] [MAIN ] LYG: Loaded 53179 existing records. [2025-10-03T20:01:22.902397] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:22.903025] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-03T20:01:22.903084] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-03T20:01:22.903582] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-03T20:01:22.903669] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-03T20:01:23.191419] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-03T20:01:23.348036] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:23.350032] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:01:23.990697] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-03T20:01:24.313298] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T20:01:24.790705] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-03T20:01:24.875290] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T20:01:25.590711] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-03T20:01:25.772324] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T20:01:26.390742] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-03T20:01:26.738045] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T20:01:26.905271] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T20:01:27.190733] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-03T20:01:27.924424] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T20:01:27.990707] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-03T20:01:28.576014] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T20:01:28.790745] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-03T20:01:29.590639] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-03T20:01:29.702279] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T20:01:30.138501] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T20:01:30.390752] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-03T20:01:31.190708] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-03T20:01:31.444377] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T20:01:31.840851] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T20:01:31.990732] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-03T20:01:32.790720] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-03T20:01:33.046749] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T20:01:33.314171] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T20:01:33.590741] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-03T20:01:34.023107] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T20:01:34.390691] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-03T20:01:35.190640] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-03T20:01:35.440955] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T20:01:35.548142] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T20:01:35.990713] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-03T20:01:36.705847] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T20:01:36.790686] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-03T20:01:37.590719] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-03T20:01:37.920395] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T20:01:38.390701] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-03T20:01:39.190695] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-03T20:01:39.276639] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-03T20:01:39.322006] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T20:01:39.990691] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-03T20:01:40.148805] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T20:01:40.150553] [INFO ] [REMOTE ] LXU: Full fetch complete (45041 records). [2025-10-03T20:01:40.150636] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-03T20:01:40.574260] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-03T20:01:40.574463] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-03T20:01:40.575618] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-03T20:01:40.603548] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-03T20:01:40.609870] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-03T20:01:40.622631] [DEBUG] [LOCAL ] LXU: Trimmed 45041 records to 32152 (keeping 200 days of data) [2025-10-03T20:01:40.798827] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-03T20:01:40.824026] [DEBUG] [LOCAL ] LXU: Primary data saved (32152 records). [2025-10-03T20:01:40.824186] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-03T20:01:40.824303] [INFO ] [MAIN ] Update Progress: 1290/2370 symbols completed. LXU took 30.6s. Estimated remaining: 2h 32m 2s. Rate: 7.1 symbols/min [2025-10-03T20:01:41.013603] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:41.077263] [DEBUG] [LOCAL ] LYV: Loaded 51500 existing records from primary storage. [2025-10-03T20:01:41.077619] [INFO ] [MAIN ] LYV: Loaded 51500 existing records. [2025-10-03T20:01:41.280577] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:41.280919] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-03T20:01:41.280971] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-03T20:01:41.281529] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-03T20:01:41.281589] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-03T20:01:41.596827] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-03T20:01:41.723588] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:41.726618] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T20:01:42.390717] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-03T20:01:42.478928] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:01:43.190709] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-03T20:01:43.578075] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T20:01:43.990670] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-03T20:01:44.090202] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T20:01:44.591601] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T20:01:44.790693] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-03T20:01:45.590728] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-03T20:01:45.855137] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T20:01:45.858346] [INFO ] [REMOTE ] LYB: Full fetch complete (77460 records). [2025-10-03T20:01:45.858523] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-03T20:01:46.354537] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-03T20:01:46.354708] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-03T20:01:46.356087] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-03T20:01:46.356166] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-03T20:01:46.358080] [DEBUG] [LOCAL ] LYB: Trimmed 77460 records to 54382 (keeping 200 days of data) [2025-10-03T20:01:46.413599] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-03T20:01:46.617875] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T20:01:46.768886] [DEBUG] [LOCAL ] LYB: Primary data saved (54382 records). [2025-10-03T20:01:46.769036] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-03T20:01:46.769139] [INFO ] [MAIN ] Update Progress: 1291/2370 symbols completed. LYB took 35.2s. Estimated remaining: 2h 31m 52s. Rate: 7.1 symbols/min [2025-10-03T20:01:46.951197] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:46.989112] [DEBUG] [LOCAL ] LZB: Loaded 35687 existing records from primary storage. [2025-10-03T20:01:46.989432] [INFO ] [MAIN ] LZB: Loaded 35687 existing records. [2025-10-03T20:01:47.182156] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:47.182348] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-03T20:01:47.182397] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-03T20:01:47.182776] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-03T20:01:47.182836] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-03T20:01:47.191040] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-03T20:01:47.608861] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:47.614514] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T20:01:47.990745] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-03T20:01:48.122835] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T20:01:48.707291] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T20:01:48.710008] [INFO ] [REMOTE ] LXP: Full fetch complete (72627 records). [2025-10-03T20:01:48.710126] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-03T20:01:48.795728] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-03T20:01:49.142353] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-03T20:01:49.142450] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-03T20:01:49.143508] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-03T20:01:49.143573] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-03T20:01:49.145241] [DEBUG] [LOCAL ] LXP: Trimmed 72627 records to 51444 (keeping 200 days of data) [2025-10-03T20:01:49.470109] [DEBUG] [LOCAL ] LXP: Primary data saved (51444 records). [2025-10-03T20:01:49.470349] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-03T20:01:49.471195] [INFO ] [MAIN ] Update Progress: 1292/2370 symbols completed. LXP took 41.3s. Estimated remaining: 2h 31m 39s. Rate: 7.1 symbols/min [2025-10-03T20:01:49.592152] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-03T20:01:49.665365] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:49.702154] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T20:01:49.724947] [DEBUG] [LOCAL ] LZM: Loaded 14138 existing records from primary storage. [2025-10-03T20:01:49.725209] [INFO ] [MAIN ] LZM: Loaded 14138 existing records. [2025-10-03T20:01:49.918773] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:49.919021] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-03T20:01:49.919104] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-03T20:01:49.919343] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-03T20:01:49.919416] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-03T20:01:50.332895] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:01:50.390631] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-03T20:01:50.498151] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:01:50.860310] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T20:01:51.190717] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-03T20:01:51.990663] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-03T20:01:52.169606] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:01:52.482451] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T20:01:52.790695] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-03T20:01:53.590694] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-03T20:01:53.775487] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T20:01:54.218867] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T20:01:54.350829] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T20:01:54.390676] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-03T20:01:55.190708] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-03T20:01:55.923606] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T20:01:55.990731] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-03T20:01:56.790737] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-03T20:01:57.368438] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T20:01:57.403984] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T20:01:57.590684] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-03T20:01:58.321537] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T20:01:58.324531] [INFO ] [REMOTE ] LYG: Full fetch complete (76053 records). [2025-10-03T20:01:58.324708] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-03T20:01:58.410494] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-03T20:01:58.420976] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T20:01:58.773373] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-03T20:01:58.773462] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-03T20:01:58.774563] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-03T20:01:58.774634] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-03T20:01:58.776277] [DEBUG] [LOCAL ] LYG: Trimmed 76053 records to 53556 (keeping 200 days of data) [2025-10-03T20:01:59.114785] [DEBUG] [LOCAL ] LYG: Primary data saved (53556 records). [2025-10-03T20:01:59.114941] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-03T20:01:59.115072] [INFO ] [MAIN ] Update Progress: 1293/2370 symbols completed. LYG took 36.7s. Estimated remaining: 2h 31m 31s. Rate: 7.1 symbols/min [2025-10-03T20:01:59.196455] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-03T20:01:59.308137] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:01:59.362267] [DEBUG] [LOCAL ] M: Loaded 53924 existing records from primary storage. [2025-10-03T20:01:59.362622] [INFO ] [MAIN ] M: Loaded 53924 existing records. [2025-10-03T20:01:59.572941] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:01:59.573302] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-03T20:01:59.573357] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-03T20:01:59.573582] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-03T20:01:59.573680] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-03T20:01:59.973547] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T20:02:00.010481] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-03T20:02:00.026317] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:00.027689] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T20:02:00.790708] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-03T20:02:01.590738] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-03T20:02:01.870620] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T20:02:01.913156] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:02:02.390706] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-03T20:02:03.104507] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T20:02:03.190723] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-03T20:02:03.990676] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-03T20:02:04.091453] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T20:02:04.698755] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T20:02:04.790717] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-03T20:02:05.590630] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-03T20:02:05.937340] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T20:02:06.269444] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T20:02:06.390738] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-03T20:02:06.962348] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T20:02:07.190725] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-03T20:02:07.990632] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-03T20:02:08.296158] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T20:02:08.790667] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-03T20:02:08.908428] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T20:02:09.400578] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T20:02:09.590672] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-03T20:02:09.776746] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T20:02:10.390697] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-03T20:02:11.190740] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-03T20:02:11.342580] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T20:02:11.990676] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-03T20:02:12.632408] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-03T20:02:12.674211] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T20:02:12.676686] [INFO ] [REMOTE ] LZB: Full fetch complete (50690 records). [2025-10-03T20:02:12.676837] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-03T20:02:12.793474] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-03T20:02:13.115227] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-03T20:02:13.115325] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-03T20:02:13.116328] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-03T20:02:13.116400] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-03T20:02:13.117734] [DEBUG] [LOCAL ] LZB: Trimmed 50690 records to 35982 (keeping 200 days of data) [2025-10-03T20:02:13.352711] [DEBUG] [LOCAL ] LZB: Primary data saved (35982 records). [2025-10-03T20:02:13.352881] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-03T20:02:13.352977] [INFO ] [MAIN ] Update Progress: 1294/2370 symbols completed. LZB took 26.6s. Estimated remaining: 2h 31m 28s. Rate: 7.1 symbols/min [2025-10-03T20:02:13.561139] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:13.606286] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-03T20:02:13.620892] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T20:02:13.643459] [DEBUG] [LOCAL ] MA: Loaded 52903 existing records from primary storage. [2025-10-03T20:02:13.643853] [INFO ] [MAIN ] MA: Loaded 52903 existing records. [2025-10-03T20:02:13.712575] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T20:02:13.758254] [INFO ] [REMOTE ] LYV: Full fetch complete (73757 records). [2025-10-03T20:02:13.786213] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-03T20:02:14.020738] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:14.026200] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-03T20:02:14.064185] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-03T20:02:14.082763] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-03T20:02:14.143169] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-03T20:02:14.399131] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-03T20:02:14.515051] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-03T20:02:14.583364] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-03T20:02:14.602960] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-03T20:02:14.628892] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-03T20:02:14.690691] [DEBUG] [LOCAL ] LYV: Trimmed 73757 records to 51873 (keeping 200 days of data) [2025-10-03T20:02:14.812905] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:15.086975] [DEBUG] [LOCAL ] LYV: Primary data saved (51873 records). [2025-10-03T20:02:15.087207] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-03T20:02:15.087353] [INFO ] [MAIN ] Update Progress: 1295/2370 symbols completed. LYV took 34.3s. Estimated remaining: 2h 31m 14s. Rate: 7.1 symbols/min [2025-10-03T20:02:15.192544] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-03T20:02:15.287021] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:15.336506] [DEBUG] [LOCAL ] MAA: Loaded 42948 existing records from primary storage. [2025-10-03T20:02:15.336968] [INFO ] [MAIN ] MAA: Loaded 42948 existing records. [2025-10-03T20:02:15.568713] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:15.576941] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-03T20:02:15.577366] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T20:02:15.580671] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-03T20:02:15.581403] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-03T20:02:15.581600] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-03T20:02:15.740101] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T20:02:15.995882] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-03T20:02:16.095204] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:16.790693] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-03T20:02:17.171304] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T20:02:17.590943] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-03T20:02:18.236273] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T20:02:18.323584] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T20:02:18.390922] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-03T20:02:19.190689] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-03T20:02:19.294067] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T20:02:19.990728] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-03T20:02:20.242120] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T20:02:20.697168] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T20:02:20.769764] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T20:02:20.790615] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-03T20:02:21.590752] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-03T20:02:21.775013] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T20:02:22.390761] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-03T20:02:23.191245] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-03T20:02:23.418736] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T20:02:23.420323] [INFO ] [REMOTE ] LZM: Full fetch complete (18648 records). [2025-10-03T20:02:23.420399] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-03T20:02:23.797591] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-03T20:02:23.881233] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-03T20:02:23.881309] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-03T20:02:23.881731] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-03T20:02:23.881796] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-03T20:02:23.882385] [DEBUG] [LOCAL ] LZM: Trimmed 18648 records to 14413 (keeping 200 days of data) [2025-10-03T20:02:23.970674] [DEBUG] [LOCAL ] LZM: Primary data saved (14413 records). [2025-10-03T20:02:23.970841] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-03T20:02:23.970981] [INFO ] [MAIN ] Update Progress: 1296/2370 symbols completed. LZM took 34.5s. Estimated remaining: 2h 31m 6s. Rate: 7.1 symbols/min [2025-10-03T20:02:23.995976] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-03T20:02:24.197721] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:24.259406] [DEBUG] [LOCAL ] MAC: Loaded 50021 existing records from primary storage. [2025-10-03T20:02:24.259797] [INFO ] [MAIN ] MAC: Loaded 50021 existing records. [2025-10-03T20:02:24.497671] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:24.498135] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-03T20:02:24.498263] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-03T20:02:24.498587] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-03T20:02:24.498687] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-03T20:02:24.797402] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-03T20:02:24.985069] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:24.987059] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T20:02:25.590625] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-03T20:02:25.936134] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T20:02:26.390746] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-03T20:02:26.918071] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-03T20:02:26.998199] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T20:02:27.190761] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-03T20:02:28.000695] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-03T20:02:28.008249] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T20:02:28.790621] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-03T20:02:28.983276] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T20:02:29.597691] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-03T20:02:29.618610] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T20:02:30.398492] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-03T20:02:30.425614] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T20:02:31.190697] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-03T20:02:31.647045] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T20:02:31.990726] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-03T20:02:32.405830] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T20:02:32.453456] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T20:02:32.790720] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-03T20:02:33.590698] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-03T20:02:33.690806] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T20:02:34.390720] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-03T20:02:34.665973] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T20:02:35.194955] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-03T20:02:35.202695] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T20:02:35.572286] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T20:02:35.990736] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-03T20:02:36.790725] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-03T20:02:37.196526] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T20:02:37.595730] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-03T20:02:37.615668] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T20:02:38.390747] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-03T20:02:38.554705] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T20:02:39.190695] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-03T20:02:39.252734] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T20:02:39.978322] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T20:02:39.990629] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-03T20:02:40.790632] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-03T20:02:40.882830] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T20:02:41.149638] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T20:02:41.590667] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-03T20:02:42.390746] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-03T20:02:42.475280] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T20:02:42.478412] [INFO ] [REMOTE ] M: Full fetch complete (77519 records). [2025-10-03T20:02:42.478564] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-03T20:02:42.941811] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-03T20:02:42.942103] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-03T20:02:42.943521] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-03T20:02:42.943628] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-03T20:02:42.981667] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T20:02:42.981962] [DEBUG] [LOCAL ] M: Trimmed 77519 records to 54314 (keeping 200 days of data) [2025-10-03T20:02:43.196064] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-03T20:02:43.378160] [DEBUG] [LOCAL ] M: Primary data saved (54314 records). [2025-10-03T20:02:43.378353] [INFO ] [MAIN ] M: Full history saved. [2025-10-03T20:02:43.378530] [INFO ] [MAIN ] Update Progress: 1297/2370 symbols completed. M took 44.3s. Estimated remaining: 2h 31m 6s. Rate: 7.1 symbols/min [2025-10-03T20:02:43.584891] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:43.624039] [DEBUG] [LOCAL ] MAGN: Loaded 35225 existing records from primary storage. [2025-10-03T20:02:43.624341] [INFO ] [MAIN ] MAGN: Loaded 35225 existing records. [2025-10-03T20:02:43.840591] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:43.841132] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-03T20:02:43.841377] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-03T20:02:43.841794] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-03T20:02:43.841858] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-03T20:02:43.998374] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-03T20:02:44.292910] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T20:02:44.297612] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:44.645666] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T20:02:44.790722] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-03T20:02:45.590699] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-03T20:02:46.169143] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T20:02:46.283158] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T20:02:46.390695] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-03T20:02:46.687548] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T20:02:46.694230] [INFO ] [REMOTE ] MAA: Full fetch complete (61191 records). [2025-10-03T20:02:46.694621] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-03T20:02:47.120254] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-03T20:02:47.120346] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-03T20:02:47.121792] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-03T20:02:47.121864] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-03T20:02:47.123801] [DEBUG] [LOCAL ] MAA: Trimmed 61191 records to 43243 (keeping 200 days of data) [2025-10-03T20:02:47.193972] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-03T20:02:47.414639] [DEBUG] [LOCAL ] MAA: Primary data saved (43243 records). [2025-10-03T20:02:47.414837] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-03T20:02:47.414935] [INFO ] [MAIN ] Update Progress: 1298/2370 symbols completed. MAA took 32.3s. Estimated remaining: 2h 30m 54s. Rate: 7.1 symbols/min [2025-10-03T20:02:47.613306] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:47.661724] [DEBUG] [LOCAL ] MAIN: Loaded 41439 existing records from primary storage. [2025-10-03T20:02:47.662095] [INFO ] [MAIN ] MAIN: Loaded 41439 existing records. [2025-10-03T20:02:47.878479] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:47.878793] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-03T20:02:47.878850] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-03T20:02:47.879304] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-03T20:02:47.879364] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-03T20:02:47.993121] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-03T20:02:48.303051] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:48.327233] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T20:02:48.363545] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T20:02:48.790701] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-03T20:02:49.590687] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-03T20:02:49.910148] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T20:02:49.978333] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:02:50.390770] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-03T20:02:50.998959] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T20:02:51.001875] [INFO ] [REMOTE ] MAC: Full fetch complete (71487 records). [2025-10-03T20:02:51.002030] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-03T20:02:51.201731] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-03T20:02:51.470617] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-03T20:02:51.470804] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-03T20:02:51.472059] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-03T20:02:51.472137] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-03T20:02:51.473915] [DEBUG] [LOCAL ] MAC: Trimmed 71487 records to 50400 (keeping 200 days of data) [2025-10-03T20:02:51.738251] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T20:02:51.859929] [DEBUG] [LOCAL ] MAC: Primary data saved (50400 records). [2025-10-03T20:02:51.860077] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-03T20:02:51.861015] [INFO ] [MAIN ] Update Progress: 1299/2370 symbols completed. MAC took 27.9s. Estimated remaining: 2h 30m 42s. Rate: 7.1 symbols/min [2025-10-03T20:02:51.995896] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-03T20:02:52.056413] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:52.106086] [DEBUG] [LOCAL ] MAN: Loaded 43848 existing records from primary storage. [2025-10-03T20:02:52.106679] [INFO ] [MAIN ] MAN: Loaded 43848 existing records. [2025-10-03T20:02:52.303787] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:52.304204] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-03T20:02:52.304262] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-03T20:02:52.304918] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-03T20:02:52.304982] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-03T20:02:52.698241] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:52.790717] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-03T20:02:52.997292] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T20:02:53.590719] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-03T20:02:53.757873] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T20:02:54.267191] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:02:54.390724] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-03T20:02:55.035353] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T20:02:55.190737] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-03T20:02:55.625852] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T20:02:55.990736] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-03T20:02:56.790722] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-03T20:02:56.986811] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T20:02:56.992497] [INFO ] [REMOTE ] MA: Full fetch complete (76264 records). [2025-10-03T20:02:56.992685] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-03T20:02:57.507044] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-03T20:02:57.507143] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-03T20:02:57.509017] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-03T20:02:57.509097] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-03T20:02:57.511037] [DEBUG] [LOCAL ] MA: Trimmed 76264 records to 53281 (keeping 200 days of data) [2025-10-03T20:02:57.593022] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-03T20:02:57.928263] [DEBUG] [LOCAL ] MA: Primary data saved (53281 records). [2025-10-03T20:02:57.928616] [INFO ] [MAIN ] MA: Full history saved. [2025-10-03T20:02:57.928915] [INFO ] [MAIN ] Update Progress: 1300/2370 symbols completed. MA took 44.6s. Estimated remaining: 2h 30m 32s. Rate: 7.1 symbols/min [2025-10-03T20:02:58.121749] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T20:02:58.172019] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:02:58.202001] [DEBUG] [LOCAL ] MANU: Loaded 26976 existing records from primary storage. [2025-10-03T20:02:58.202306] [INFO ] [MAIN ] MANU: Loaded 26976 existing records. [2025-10-03T20:02:58.430115] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:02:58.408557] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-03T20:02:58.430921] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-03T20:02:58.432154] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-03T20:02:58.435960] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:02:58.449030] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-03T20:02:58.451581] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-03T20:02:58.879025] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:02:59.040457] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T20:02:59.190734] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-03T20:02:59.975853] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T20:02:59.990836] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-03T20:03:00.045504] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T20:03:00.790733] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-03T20:03:01.590916] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-03T20:03:01.871324] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T20:03:02.390718] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-03T20:03:03.190907] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-03T20:03:04.092437] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T20:03:04.099547] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-03T20:03:04.242179] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-03T20:03:04.790746] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-03T20:03:05.150285] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T20:03:05.590743] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-03T20:03:06.220786] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T20:03:06.384093] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (5.59 seconds). [2025-10-03T20:03:06.392029] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-03T20:03:06.467207] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-03T20:03:07.190689] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-03T20:03:07.330221] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T20:03:07.990685] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-03T20:03:08.022150] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T20:03:08.666265] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T20:03:08.790674] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-03T20:03:09.106177] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:03:09.590776] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-03T20:03:10.390700] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-03T20:03:11.190719] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-03T20:03:11.582065] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T20:03:11.990755] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-03T20:03:12.870749] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (4.08 seconds). [2025-10-03T20:03:12.881742] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-03T20:03:13.766849] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:03:13.773280] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-03T20:03:14.345020] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T20:03:14.390753] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-03T20:03:15.805727] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:03:15.815849] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-03T20:03:15.892604] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (4.70 seconds). [2025-10-03T20:03:15.990725] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-03T20:03:17.405011] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T20:03:17.414089] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-03T20:03:17.448537] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T20:03:17.505127] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (7.91 seconds). [2025-10-03T20:03:17.590725] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-03T20:03:18.390678] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-03T20:03:18.689209] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (4.92 seconds). [2025-10-03T20:03:18.841613] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T20:03:19.190727] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-03T20:03:19.305374] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:03:19.646189] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T20:03:19.990755] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-03T20:03:20.115189] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T20:03:20.790723] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-03T20:03:21.602329] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-03T20:03:21.611561] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T20:03:21.655478] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T20:03:22.390730] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-03T20:03:23.136866] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T20:03:23.139503] [INFO ] [REMOTE ] MAIN: Full fetch complete (59854 records). [2025-10-03T20:03:23.139610] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-03T20:03:23.201006] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-03T20:03:23.605358] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-03T20:03:23.605474] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-03T20:03:23.606824] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-03T20:03:23.606937] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-03T20:03:23.610269] [DEBUG] [LOCAL ] MAIN: Trimmed 59854 records to 41732 (keeping 200 days of data) [2025-10-03T20:03:23.749294] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T20:03:23.945829] [DEBUG] [LOCAL ] MAIN: Primary data saved (41732 records). [2025-10-03T20:03:23.946017] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-03T20:03:23.946133] [INFO ] [MAIN ] Update Progress: 1301/2370 symbols completed. MAIN took 36.5s. Estimated remaining: 2h 30m 38s. Rate: 7.1 symbols/min [2025-10-03T20:03:23.995842] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-03T20:03:24.139142] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:24.198507] [DEBUG] [LOCAL ] MAS: Loaded 52702 existing records from primary storage. [2025-10-03T20:03:24.198937] [INFO ] [MAIN ] MAS: Loaded 52702 existing records. [2025-10-03T20:03:24.401283] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:24.401496] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-03T20:03:24.401606] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-03T20:03:24.402965] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-03T20:03:24.403027] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-03T20:03:24.749801] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T20:03:24.774326] [INFO ] [REMOTE ] MAN: Full fetch complete (62128 records). [2025-10-03T20:03:24.803061] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-03T20:03:24.803175] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-03T20:03:24.860014] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:03:25.183069] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T20:03:25.207619] [INFO ] [REMOTE ] MAGN: Full fetch complete (51188 records). [2025-10-03T20:03:25.232978] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-03T20:03:25.386540] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-03T20:03:25.386705] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-03T20:03:25.400949] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-03T20:03:25.407407] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-03T20:03:25.442547] [DEBUG] [LOCAL ] MAN: Trimmed 62128 records to 44133 (keeping 200 days of data) [2025-10-03T20:03:25.598148] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-03T20:03:25.893095] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-03T20:03:25.896819] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-03T20:03:25.905350] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-03T20:03:25.911761] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-03T20:03:25.915701] [DEBUG] [LOCAL ] MAGN: Trimmed 51188 records to 35600 (keeping 200 days of data) [2025-10-03T20:03:26.015075] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T20:03:26.034017] [INFO ] [REMOTE ] MANU: Full fetch complete (38260 records). [2025-10-03T20:03:26.035995] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-03T20:03:26.667251] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-03T20:03:26.667867] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-03T20:03:26.669594] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-03T20:03:26.671235] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-03T20:03:26.679080] [DEBUG] [LOCAL ] MANU: Trimmed 38260 records to 27150 (keeping 200 days of data) [2025-10-03T20:03:26.859129] [DEBUG] [LOCAL ] MAGN: Primary data saved (35600 records). [2025-10-03T20:03:26.860444] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-03T20:03:26.861779] [DEBUG] [LOCAL ] MAN: Primary data saved (44133 records). [2025-10-03T20:03:26.861901] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-03T20:03:26.861710] [INFO ] [MAIN ] Update Progress: 1302/2370 symbols completed. MAGN took 43.5s. Estimated remaining: 2h 30m 25s. Rate: 7.1 symbols/min [2025-10-03T20:03:26.869426] [INFO ] [MAIN ] Update Progress: 1303/2370 symbols completed. MAN took 35.0s. Estimated remaining: 2h 30m 10s. Rate: 7.1 symbols/min [2025-10-03T20:03:27.290680] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:27.366598] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:27.370567] [DEBUG] [LOCAL ] MANU: Primary data saved (27150 records). [2025-10-03T20:03:27.370892] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-03T20:03:27.371068] [INFO ] [MAIN ] Update Progress: 1304/2370 symbols completed. MANU took 29.4s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-03T20:03:27.614572] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:27.612356] [DEBUG] [LOCAL ] MATV: Loaded 36941 existing records from primary storage. [2025-10-03T20:03:27.627350] [DEBUG] [LOCAL ] MATX: Loaded 31728 existing records from primary storage. [2025-10-03T20:03:27.626605] [INFO ] [MAIN ] MATV: Loaded 36941 existing records. [2025-10-03T20:03:27.656103] [INFO ] [MAIN ] MATX: Loaded 31728 existing records. [2025-10-03T20:03:27.707823] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T20:03:27.837794] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-03T20:03:27.983519] [DEBUG] [LOCAL ] MAX: Loaded 30922 existing records from primary storage. [2025-10-03T20:03:28.072998] [INFO ] [MAIN ] MAX: Loaded 30922 existing records. [2025-10-03T20:03:28.080427] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:28.182087] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-03T20:03:28.176835] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:28.199920] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-03T20:03:28.224176] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-03T20:03:28.232578] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-03T20:03:28.232712] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-03T20:03:28.249919] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-03T20:03:28.315103] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-03T20:03:28.378158] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-03T20:03:28.439166] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:28.457904] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-03T20:03:28.483500] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-03T20:03:28.547756] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-03T20:03:28.576175] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-03T20:03:29.444332] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:03:29.523229] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-03T20:03:29.551878] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:03:29.558359] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-03T20:03:29.647061] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:03:29.648950] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-03T20:03:29.686189] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T20:03:29.697280] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-03T20:03:30.829182] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T20:03:30.835622] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-03T20:03:30.922248] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T20:03:31.063319] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T20:03:31.190729] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-03T20:03:31.392449] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:03:31.712830] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T20:03:31.990740] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-03T20:03:32.464375] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T20:03:32.790723] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-03T20:03:33.590702] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-03T20:03:33.668381] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T20:03:33.717370] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T20:03:34.390706] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-03T20:03:34.994372] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T20:03:35.190735] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-03T20:03:35.804370] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T20:03:35.990664] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-03T20:03:36.135798] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T20:03:36.790725] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-03T20:03:37.590701] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-03T20:03:37.633242] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T20:03:37.811391] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T20:03:38.390738] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-03T20:03:38.908053] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T20:03:39.190712] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-03T20:03:39.817458] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T20:03:39.990706] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-03T20:03:40.379145] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T20:03:40.790681] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-03T20:03:41.239184] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T20:03:41.590716] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-03T20:03:42.272975] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:03:42.390740] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-03T20:03:43.027343] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T20:03:43.190694] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-03T20:03:43.537451] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:03:43.990687] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-03T20:03:44.790751] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-03T20:03:45.240013] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T20:03:45.590724] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-03T20:03:46.390924] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-03T20:03:47.340476] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T20:03:47.353461] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-03T20:03:47.771039] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T20:03:47.990712] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-03T20:03:49.022916] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T20:03:49.035465] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-03T20:03:50.769713] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T20:03:50.782451] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-03T20:03:54.250027] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (3.47 seconds). [2025-10-03T20:03:54.263015] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-03T20:03:54.361215] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (11.17 seconds). [2025-10-03T20:03:54.373638] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-03T20:03:55.160672] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (10.37 seconds). [2025-10-03T20:03:55.169891] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-03T20:03:55.383810] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T20:03:55.392414] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-03T20:03:55.789138] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (7.80 seconds). [2025-10-03T20:03:55.797898] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-03T20:03:55.979820] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T20:03:55.992160] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-03T20:03:56.941980] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T20:03:56.944153] [INFO ] [REMOTE ] MAX: Full fetch complete (45256 records). [2025-10-03T20:03:56.944275] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-03T20:03:57.373968] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-03T20:03:57.374050] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-03T20:03:57.374989] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-03T20:03:57.375056] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-03T20:03:57.376092] [DEBUG] [LOCAL ] MAX: Trimmed 45256 records to 31182 (keeping 200 days of data) [2025-10-03T20:03:57.571377] [DEBUG] [LOCAL ] MAX: Primary data saved (31182 records). [2025-10-03T20:03:57.571538] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-03T20:03:57.571635] [INFO ] [MAIN ] Update Progress: 1305/2370 symbols completed. MAX took 30.2s. Estimated remaining: 2h 30m 4s. Rate: 7.1 symbols/min [2025-10-03T20:03:57.768988] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:57.807228] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-03T20:03:57.820304] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-03T20:03:57.865863] [DEBUG] [LOCAL ] MBC: Loaded 43591 existing records from primary storage. [2025-10-03T20:03:57.866250] [INFO ] [MAIN ] MBC: Loaded 43591 existing records. [2025-10-03T20:03:58.073948] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:58.074199] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-03T20:03:58.074249] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-03T20:03:58.075364] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-03T20:03:58.075428] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-03T20:03:58.157930] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-03T20:03:58.204237] [INFO ] [REMOTE ] MAS: Full fetch complete (74876 records). [2025-10-03T20:03:58.220624] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-03T20:03:58.689079] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:03:58.712435] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-03T20:03:58.842756] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (3.45 seconds). [2025-10-03T20:03:58.905346] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-03T20:03:59.062741] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-03T20:03:59.062929] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-03T20:03:59.064135] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-03T20:03:59.064222] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-03T20:03:59.066201] [DEBUG] [LOCAL ] MAS: Trimmed 74876 records to 53080 (keeping 200 days of data) [2025-10-03T20:03:59.182406] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T20:03:59.190878] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-03T20:03:59.475204] [DEBUG] [LOCAL ] MAS: Primary data saved (53080 records). [2025-10-03T20:03:59.475411] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-03T20:03:59.475543] [INFO ] [MAIN ] Update Progress: 1306/2370 symbols completed. MAS took 35.5s. Estimated remaining: 2h 29m 50s. Rate: 7.1 symbols/min [2025-10-03T20:03:59.684093] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:03:59.710755] [DEBUG] [LOCAL ] MBI: Loaded 24438 existing records from primary storage. [2025-10-03T20:03:59.711021] [INFO ] [MAIN ] MBI: Loaded 24438 existing records. [2025-10-03T20:03:59.910029] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:03:59.910316] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-03T20:03:59.910379] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-03T20:03:59.911025] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-03T20:03:59.911090] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-03T20:04:00.330669] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:00.331588] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-03T20:04:00.361142] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:04:00.371481] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-03T20:04:00.534500] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T20:04:00.560369] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T20:04:00.560912] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-03T20:04:00.790744] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-03T20:04:01.728837] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T20:04:01.739234] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-03T20:04:01.813245] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T20:04:01.843562] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T20:04:02.125911] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:04:02.128391] [INFO ] [REMOTE ] MATV: Full fetch complete (52384 records). [2025-10-03T20:04:02.128582] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-03T20:04:02.395908] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-03T20:04:02.619794] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-03T20:04:02.619915] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-03T20:04:02.621347] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-03T20:04:02.621474] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-03T20:04:02.622937] [DEBUG] [LOCAL ] MATV: Trimmed 52384 records to 37127 (keeping 200 days of data) [2025-10-03T20:04:02.867595] [DEBUG] [LOCAL ] MATV: Primary data saved (37127 records). [2025-10-03T20:04:02.867789] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-03T20:04:02.867953] [INFO ] [MAIN ] Update Progress: 1307/2370 symbols completed. MATV took 36.0s. Estimated remaining: 2h 29m 38s. Rate: 7.1 symbols/min [2025-10-03T20:04:03.060240] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:03.118015] [DEBUG] [LOCAL ] MC: Loaded 44384 existing records from primary storage. [2025-10-03T20:04:03.118573] [INFO ] [MAIN ] MC: Loaded 44384 existing records. [2025-10-03T20:04:03.193447] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-03T20:04:03.327366] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:04:03.327806] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-03T20:04:03.328156] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-03T20:04:03.329366] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-03T20:04:03.329431] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-03T20:04:03.559234] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T20:04:03.802191] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:03.820977] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T20:04:03.990696] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-03T20:04:04.348001] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:04:04.790734] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-03T20:04:05.126508] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T20:04:05.590725] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-03T20:04:05.958880] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T20:04:05.960701] [INFO ] [REMOTE ] MATX: Full fetch complete (42693 records). [2025-10-03T20:04:05.960869] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-03T20:04:06.392288] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-03T20:04:06.392056] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-03T20:04:06.393315] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-03T20:04:06.394339] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-03T20:04:06.394513] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-03T20:04:06.395831] [DEBUG] [LOCAL ] MATX: Trimmed 42693 records to 31889 (keeping 200 days of data) [2025-10-03T20:04:06.615947] [DEBUG] [LOCAL ] MATX: Primary data saved (31889 records). [2025-10-03T20:04:06.616095] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-03T20:04:06.616198] [INFO ] [MAIN ] Update Progress: 1308/2370 symbols completed. MATX took 39.7s. Estimated remaining: 2h 29m 25s. Rate: 7.1 symbols/min [2025-10-03T20:04:06.816318] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:06.830520] [DEBUG] [LOCAL ] MCB: Loaded 11457 existing records from primary storage. [2025-10-03T20:04:06.830899] [INFO ] [MAIN ] MCB: Loaded 11457 existing records. [2025-10-03T20:04:07.051771] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:04:07.052062] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-03T20:04:07.052213] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-03T20:04:07.052765] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-03T20:04:07.052865] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-03T20:04:07.191505] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-03T20:04:07.201049] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T20:04:07.514734] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:07.532536] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T20:04:07.990736] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-03T20:04:08.790721] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-03T20:04:08.860211] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:04:09.590627] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-03T20:04:09.692367] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T20:04:09.757584] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T20:04:10.390729] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-03T20:04:10.419994] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T20:04:11.190715] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-03T20:04:11.990693] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-03T20:04:12.677412] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:04:12.790716] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-03T20:04:12.871775] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T20:04:13.590713] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-03T20:04:13.873892] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:04:14.343804] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T20:04:14.390704] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-03T20:04:15.190704] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-03T20:04:15.942475] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T20:04:15.980443] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (5.59 seconds). [2025-10-03T20:04:15.990755] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-03T20:04:16.790731] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-03T20:04:17.590689] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-03T20:04:17.786411] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-03T20:04:18.390630] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-03T20:04:18.495187] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:04:19.190779] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-03T20:04:20.182894] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T20:04:20.187032] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-03T20:04:20.440739] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (4.45 seconds). [2025-10-03T20:04:20.790764] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-03T20:04:22.132719] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T20:04:22.145099] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-03T20:04:22.187110] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (5.40 seconds). [2025-10-03T20:04:22.390695] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-03T20:04:22.453985] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (4.06 seconds). [2025-10-03T20:04:22.526354] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-03T20:04:23.190712] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-03T20:04:23.759523] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T20:04:23.933963] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T20:04:23.990685] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-03T20:04:24.790692] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-03T20:04:24.887996] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T20:04:25.590724] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-03T20:04:26.054462] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (3.91 seconds). [2025-10-03T20:04:26.390709] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-03T20:04:26.967080] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T20:04:27.190716] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-03T20:04:27.795967] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T20:04:27.990665] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-03T20:04:28.259700] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T20:04:28.790744] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-03T20:04:28.914243] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (4.12 seconds). [2025-10-03T20:04:29.518114] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T20:04:29.590735] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-03T20:04:30.212742] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:04:30.214373] [INFO ] [REMOTE ] MBI: Full fetch complete (36569 records). [2025-10-03T20:04:30.214527] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-03T20:04:30.347908] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T20:04:30.395833] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-03T20:04:30.647621] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-03T20:04:30.647733] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-03T20:04:30.648496] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-03T20:04:30.648561] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-03T20:04:30.649858] [DEBUG] [LOCAL ] MBI: Trimmed 36569 records to 24622 (keeping 200 days of data) [2025-10-03T20:04:30.789549] [DEBUG] [LOCAL ] MBI: Primary data saved (24622 records). [2025-10-03T20:04:30.789723] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-03T20:04:30.789846] [INFO ] [MAIN ] Update Progress: 1309/2370 symbols completed. MBI took 31.3s. Estimated remaining: 2h 29m 30s. Rate: 7.1 symbols/min [2025-10-03T20:04:30.971014] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:30.971219] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-03T20:04:30.971277] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-03T20:04:30.971388] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-03T20:04:30.971439] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-03T20:04:30.971488] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-03T20:04:30.971521] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-03T20:04:31.193681] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-03T20:04:31.291722] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:04:31.381156] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:31.990738] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-03T20:04:32.790683] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-03T20:04:32.954934] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T20:04:33.336451] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T20:04:33.337550] [INFO ] [REMOTE ] MCB: Full fetch complete (16336 records). [2025-10-03T20:04:33.337636] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-03T20:04:33.592965] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-03T20:04:33.777227] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-03T20:04:33.777923] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-03T20:04:33.778949] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T20:04:33.779482] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-03T20:04:33.788942] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-03T20:04:33.790504] [DEBUG] [LOCAL ] MCB: Trimmed 16336 records to 11506 (keeping 200 days of data) [2025-10-03T20:04:33.862848] [DEBUG] [LOCAL ] MCB: Primary data saved (11506 records). [2025-10-03T20:04:33.862987] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-03T20:04:33.863074] [INFO ] [MAIN ] Update Progress: 1310/2370 symbols completed. MCB took 27.2s. Estimated remaining: 2h 29m 17s. Rate: 7.1 symbols/min [2025-10-03T20:04:34.047453] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:34.056475] [DEBUG] [LOCAL ] MCI: Loaded 6458 existing records from primary storage. [2025-10-03T20:04:34.056720] [INFO ] [MAIN ] MCI: Loaded 6458 existing records. [2025-10-03T20:04:34.252314] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:04:34.252544] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-03T20:04:34.252593] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-03T20:04:34.252952] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-03T20:04:34.253014] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-03T20:04:34.398633] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-03T20:04:34.640807] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:35.190714] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-03T20:04:35.550975] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T20:04:35.553354] [INFO ] [REMOTE ] MC: Full fetch complete (62650 records). [2025-10-03T20:04:35.553460] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-03T20:04:35.992008] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-03T20:04:36.015159] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-03T20:04:36.015274] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-03T20:04:36.016480] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-03T20:04:36.016815] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-03T20:04:36.020500] [DEBUG] [LOCAL ] MC: Trimmed 62650 records to 44681 (keeping 200 days of data) [2025-10-03T20:04:36.308260] [DEBUG] [LOCAL ] MC: Primary data saved (44681 records). [2025-10-03T20:04:36.308431] [INFO ] [MAIN ] MC: Full history saved. [2025-10-03T20:04:36.308556] [INFO ] [MAIN ] Update Progress: 1311/2370 symbols completed. MC took 33.4s. Estimated remaining: 2h 29m 4s. Rate: 7.1 symbols/min [2025-10-03T20:04:36.492389] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:36.522311] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T20:04:36.569476] [DEBUG] [LOCAL ] MCK: Loaded 39384 existing records from primary storage. [2025-10-03T20:04:36.574473] [INFO ] [MAIN ] MCK: Loaded 39384 existing records. [2025-10-03T20:04:36.621409] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T20:04:36.764292] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:04:36.764524] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-03T20:04:36.764572] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-03T20:04:36.765045] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-03T20:04:36.765104] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-03T20:04:36.795784] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-03T20:04:37.165901] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:37.265086] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-03T20:04:37.590679] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-03T20:04:38.213541] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:04:38.216039] [INFO ] [REMOTE ] MBC: Full fetch complete (63147 records). [2025-10-03T20:04:38.216219] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-03T20:04:38.402804] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-03T20:04:38.645499] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-03T20:04:38.645585] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-03T20:04:38.646668] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-03T20:04:38.646734] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-03T20:04:38.648133] [DEBUG] [LOCAL ] MBC: Trimmed 63147 records to 43945 (keeping 200 days of data) [2025-10-03T20:04:38.906530] [DEBUG] [LOCAL ] MBC: Primary data saved (43945 records). [2025-10-03T20:04:38.906713] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-03T20:04:38.906814] [INFO ] [MAIN ] Update Progress: 1312/2370 symbols completed. MBC took 41.3s. Estimated remaining: 2h 28m 50s. Rate: 7.1 symbols/min [2025-10-03T20:04:39.092604] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:04:39.104458] [DEBUG] [LOCAL ] MCN: Loaded 8254 existing records from primary storage. [2025-10-03T20:04:39.104765] [INFO ] [MAIN ] MCN: Loaded 8254 existing records. [2025-10-03T20:04:39.200273] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-03T20:04:39.251278] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T20:04:39.319307] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:04:39.319824] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-03T20:04:39.319931] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-03T20:04:39.320376] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-03T20:04:39.320438] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-03T20:04:39.718911] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:04:39.753457] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-03T20:04:39.990685] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-03T20:04:40.719026] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T20:04:40.792521] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-03T20:04:40.795355] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T20:04:41.590707] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-03T20:04:42.390718] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-03T20:04:42.839010] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T20:04:43.097220] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T20:04:43.190703] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-03T20:04:43.602487] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T20:04:43.990690] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-03T20:04:44.656669] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (3.07 seconds). [2025-10-03T20:04:44.783979] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T20:04:44.790610] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-03T20:04:45.506274] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T20:04:45.590717] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-03T20:04:46.390751] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-03T20:04:47.190736] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-03T20:04:47.864623] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T20:04:47.990706] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-03T20:04:48.220385] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T20:04:48.790737] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-03T20:04:49.034832] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T20:04:49.590727] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-03T20:04:50.390673] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-03T20:04:50.432044] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T20:04:50.845826] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T20:04:51.190710] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-03T20:04:51.224221] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T20:04:51.915638] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T20:04:51.990698] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-03T20:04:52.790751] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-03T20:04:53.590729] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-03T20:04:54.926858] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T20:04:54.942234] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-03T20:04:54.987689] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T20:04:55.190705] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-03T20:04:55.209686] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (3.22 seconds). [2025-10-03T20:04:55.990694] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-03T20:04:56.026112] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (10.44 seconds). [2025-10-03T20:04:56.423758] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T20:04:56.790659] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-03T20:04:56.825544] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T20:04:57.130380] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-03T20:04:57.590696] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-03T20:04:57.936165] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T20:04:58.390690] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-03T20:04:59.190699] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-03T20:04:59.883628] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T20:04:59.984463] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T20:04:59.990600] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-03T20:05:00.216585] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-03T20:05:00.467616] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T20:05:00.790722] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-03T20:05:01.590715] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-03T20:05:02.390726] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-03T20:05:03.149340] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T20:05:03.162629] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-03T20:05:03.189955] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T20:05:03.192700] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-03T20:05:03.990720] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-03T20:05:04.659179] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T20:05:04.790790] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-03T20:05:05.446355] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T20:05:05.590733] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-03T20:05:06.370059] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T20:05:06.390622] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-03T20:05:07.190796] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-03T20:05:07.579483] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T20:05:07.582218] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-10-03T20:05:07.582354] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-03T20:05:07.814610] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:05:07.815503] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:05:07.815614] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:05:07.815850] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-03T20:05:07.816061] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-03T20:05:07.816216] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-03T20:05:07.823823] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-03T20:05:07.838842] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T20:05:07.837941] [INFO ] [MAIN ] Update Progress: 1313/2370 symbols completed. MCD took 37.0s. Estimated remaining: 2h 28m 58s. Rate: 7.1 symbols/min [2025-10-03T20:05:07.901531] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T20:05:07.944436] [INFO ] [REMOTE ] MCI: Full fetch complete (10003 records). [2025-10-03T20:05:07.966538] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-03T20:05:07.995726] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-03T20:05:08.136058] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:08.482730] [DEBUG] [LOCAL ] MCO: Loaded 39604 existing records from primary storage. [2025-10-03T20:05:08.514811] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-03T20:05:08.515073] [INFO ] [MAIN ] MCO: Loaded 39604 existing records. [2025-10-03T20:05:08.514928] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-03T20:05:08.544477] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-03T20:05:08.572249] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-03T20:05:08.620492] [DEBUG] [LOCAL ] MCI: Trimmed 10003 records to 6499 (keeping 200 days of data) [2025-10-03T20:05:08.817921] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-03T20:05:08.829471] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:08.830414] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-03T20:05:08.832010] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-03T20:05:08.833328] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-03T20:05:08.834615] [DEBUG] [LOCAL ] MCI: Primary data saved (6499 records). [2025-10-03T20:05:08.834761] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-03T20:05:08.834902] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-03T20:05:08.840198] [INFO ] [MAIN ] Update Progress: 1314/2370 symbols completed. MCI took 35.0s. Estimated remaining: 2h 28m 44s. Rate: 7.1 symbols/min [2025-10-03T20:05:09.280121] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:09.421888] [DEBUG] [LOCAL ] MCR: Loaded 8814 existing records from primary storage. [2025-10-03T20:05:09.424524] [INFO ] [MAIN ] MCR: Loaded 8814 existing records. [2025-10-03T20:05:09.465150] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:09.531711] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T20:05:09.602607] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-03T20:05:09.604506] [INFO ] [REMOTE ] MCK: Full fetch complete (57299 records). [2025-10-03T20:05:09.605412] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T20:05:09.606276] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-03T20:05:09.668742] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:09.671295] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-03T20:05:09.671606] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-03T20:05:09.689805] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-03T20:05:09.690081] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-03T20:05:10.423029] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:10.394975] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-03T20:05:10.499970] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-03T20:05:10.500065] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-03T20:05:10.501040] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-03T20:05:10.501107] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-03T20:05:10.502760] [DEBUG] [LOCAL ] MCK: Trimmed 57299 records to 39685 (keeping 200 days of data) [2025-10-03T20:05:10.773539] [DEBUG] [LOCAL ] MCK: Primary data saved (39685 records). [2025-10-03T20:05:10.773713] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-03T20:05:10.773837] [INFO ] [MAIN ] Update Progress: 1315/2370 symbols completed. MCK took 34.5s. Estimated remaining: 2h 28m 30s. Rate: 7.1 symbols/min [2025-10-03T20:05:10.989567] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:11.016217] [DEBUG] [LOCAL ] MCS: Loaded 21177 existing records from primary storage. [2025-10-03T20:05:11.016509] [INFO ] [MAIN ] MCS: Loaded 21177 existing records. [2025-10-03T20:05:11.218335] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-03T20:05:11.218090] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:11.219855] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-03T20:05:11.219941] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-03T20:05:11.220433] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-03T20:05:11.220702] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-03T20:05:11.296583] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:05:11.331306] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T20:05:11.669337] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:11.990701] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-03T20:05:12.093840] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:05:12.570255] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:05:12.571454] [INFO ] [REMOTE ] MCN: Full fetch complete (11682 records). [2025-10-03T20:05:12.571528] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-03T20:05:12.795730] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-03T20:05:13.004730] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-03T20:05:13.004827] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-03T20:05:13.005175] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-03T20:05:13.005233] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-03T20:05:13.006130] [DEBUG] [LOCAL ] MCN: Trimmed 11682 records to 8300 (keeping 200 days of data) [2025-10-03T20:05:13.059867] [DEBUG] [LOCAL ] MCN: Primary data saved (8300 records). [2025-10-03T20:05:13.060013] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-03T20:05:13.060140] [INFO ] [MAIN ] Update Progress: 1316/2370 symbols completed. MCN took 34.2s. Estimated remaining: 2h 28m 17s. Rate: 7.1 symbols/min [2025-10-03T20:05:13.247916] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:13.278356] [DEBUG] [LOCAL ] MCY: Loaded 24525 existing records from primary storage. [2025-10-03T20:05:13.278625] [INFO ] [MAIN ] MCY: Loaded 24525 existing records. [2025-10-03T20:05:13.480610] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:13.480881] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-03T20:05:13.480933] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-03T20:05:13.481362] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-03T20:05:13.481437] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-03T20:05:13.598533] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-03T20:05:13.880968] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:14.276586] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T20:05:14.390678] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-03T20:05:14.548412] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:05:15.190707] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-03T20:05:15.970856] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T20:05:15.990638] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-03T20:05:16.136325] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T20:05:16.790718] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-03T20:05:17.046095] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T20:05:17.590713] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-03T20:05:18.106137] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T20:05:18.374806] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T20:05:18.390685] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-03T20:05:19.172371] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T20:05:19.190665] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-03T20:05:19.990741] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-03T20:05:20.093694] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T20:05:20.790727] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-03T20:05:21.448815] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T20:05:21.510562] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T20:05:21.590681] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-03T20:05:22.369589] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T20:05:22.390632] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-03T20:05:23.042688] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T20:05:23.190721] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-03T20:05:23.990728] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-03T20:05:24.790691] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-03T20:05:24.951969] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T20:05:24.979103] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T20:05:25.395036] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T20:05:25.590704] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-03T20:05:26.123437] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:05:26.124489] [INFO ] [REMOTE ] MCR: Full fetch complete (14031 records). [2025-10-03T20:05:26.124564] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-03T20:05:26.395820] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-03T20:05:26.557612] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-03T20:05:26.557731] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-03T20:05:26.558117] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-03T20:05:26.558201] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-03T20:05:26.558958] [DEBUG] [LOCAL ] MCR: Trimmed 14031 records to 8848 (keeping 200 days of data) [2025-10-03T20:05:26.613463] [DEBUG] [LOCAL ] MCR: Primary data saved (8848 records). [2025-10-03T20:05:26.613615] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-03T20:05:26.613758] [INFO ] [MAIN ] Update Progress: 1317/2370 symbols completed. MCR took 17.7s. Estimated remaining: 2h 28m 13s. Rate: 7.1 symbols/min [2025-10-03T20:05:27.190670] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-03T20:05:27.542663] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:05:27.990686] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-03T20:05:28.791807] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-03T20:05:28.791702] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T20:05:29.104564] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T20:05:29.590678] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-03T20:05:30.335059] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T20:05:30.390694] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-03T20:05:30.638590] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:05:31.190713] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-03T20:05:31.869766] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:05:31.990710] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-03T20:05:32.241092] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T20:05:32.790709] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-03T20:05:33.349370] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:05:33.425749] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T20:05:33.590684] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-03T20:05:34.390686] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-03T20:05:34.678558] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T20:05:35.190678] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-03T20:05:35.585083] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T20:05:35.990682] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-03T20:05:36.431148] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T20:05:36.790686] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-03T20:05:37.190456] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T20:05:37.590720] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-03T20:05:38.075246] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T20:05:38.390713] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-03T20:05:38.661487] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T20:05:39.190724] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-03T20:05:39.839482] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T20:05:39.990718] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-03T20:05:40.764051] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T20:05:40.790622] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-03T20:05:41.100579] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T20:05:41.590753] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-03T20:05:42.389152] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T20:05:42.398125] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-03T20:05:42.653533] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T20:05:43.190719] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-03T20:05:43.416831] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T20:05:43.990722] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-03T20:05:44.582577] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T20:05:44.585282] [INFO ] [REMOTE ] MCO: Full fetch complete (57095 records). [2025-10-03T20:05:44.585416] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-03T20:05:44.792709] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-03T20:05:44.935987] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T20:05:44.975285] [INFO ] [REMOTE ] MCS: Full fetch complete (30455 records). [2025-10-03T20:05:44.998338] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-03T20:05:45.114572] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-03T20:05:45.147430] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-03T20:05:45.165383] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-03T20:05:45.171507] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-03T20:05:45.252383] [DEBUG] [LOCAL ] MCO: Trimmed 57095 records to 39892 (keeping 200 days of data) [2025-10-03T20:05:45.591626] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-03T20:05:45.592118] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-03T20:05:45.593158] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-03T20:05:45.593820] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-03T20:05:45.599839] [DEBUG] [LOCAL ] MCS: Trimmed 30455 records to 21303 (keeping 200 days of data) [2025-10-03T20:05:45.759465] [DEBUG] [LOCAL ] MCS: Primary data saved (21303 records). [2025-10-03T20:05:45.760321] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-03T20:05:45.768539] [INFO ] [MAIN ] Update Progress: 1318/2370 symbols completed. MCS took 35.0s. Estimated remaining: 2h 28m 13s. Rate: 7.1 symbols/min [2025-10-03T20:05:45.775795] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T20:05:45.784603] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-03T20:05:45.922022] [DEBUG] [LOCAL ] MCO: Primary data saved (39892 records). [2025-10-03T20:05:45.922204] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-03T20:05:45.922308] [INFO ] [MAIN ] Update Progress: 1319/2370 symbols completed. MCO took 38.1s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-03T20:05:46.641588] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:05:46.643287] [INFO ] [REMOTE ] MCY: Full fetch complete (41499 records). [2025-10-03T20:05:46.643383] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-03T20:05:47.049721] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-03T20:05:47.049826] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-03T20:05:47.050838] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-03T20:05:47.050926] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-03T20:05:47.052316] [DEBUG] [LOCAL ] MCY: Trimmed 41499 records to 24734 (keeping 200 days of data) [2025-10-03T20:05:47.209708] [DEBUG] [LOCAL ] MCY: Primary data saved (24734 records). [2025-10-03T20:05:47.209865] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-03T20:05:47.209988] [INFO ] [MAIN ] Update Progress: 1320/2370 symbols completed. MCY took 34.1s. Estimated remaining: 2h 27m 43s. Rate: 7.1 symbols/min [2025-10-03T20:05:47.924853] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:47.930872] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:47.967504] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:47.994446] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:05:48.003436] [DEBUG] [LOCAL ] MDST: Loaded 5730 existing records from primary storage. [2025-10-03T20:05:48.003877] [INFO ] [MAIN ] MDST: Loaded 5730 existing records. [2025-10-03T20:05:48.247019] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:48.289918] [DEBUG] [LOCAL ] MD: Loaded 38594 existing records from primary storage. [2025-10-03T20:05:48.261370] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-03T20:05:48.290444] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-03T20:05:48.290390] [INFO ] [MAIN ] MD: Loaded 38594 existing records. [2025-10-03T20:05:48.301798] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-03T20:05:48.302687] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-03T20:05:48.303721] [DEBUG] [LOCAL ] MDU: Loaded 48324 existing records from primary storage. [2025-10-03T20:05:48.302763] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-03T20:05:48.324314] [INFO ] [MAIN ] MDU: Loaded 48324 existing records. [2025-10-03T20:05:48.314393] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-10-03T20:05:49.029069] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:49.113450] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:49.132801] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-03T20:05:49.166669] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:05:49.162524] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-03T20:05:49.162363] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-03T20:05:49.185494] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-03T20:05:49.200753] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-03T20:05:49.206783] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-03T20:05:49.211981] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-03T20:05:49.222079] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-03T20:05:49.212121] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-03T20:05:49.247542] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-03T20:05:49.269826] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-03T20:05:49.259279] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-03T20:05:49.961477] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:50.051919] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-03T20:05:50.497386] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:50.514490] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:50.511253] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-03T20:05:50.525125] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-03T20:05:50.593313] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:05:50.593791] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-03T20:05:50.810355] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T20:05:50.812541] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-03T20:05:51.521662] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T20:05:51.523802] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-03T20:05:51.739381] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T20:05:51.748381] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-03T20:05:52.134862] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T20:05:52.146715] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-03T20:05:52.161059] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T20:05:52.500501] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T20:05:52.643631] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:05:52.790719] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-03T20:05:53.590709] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-03T20:05:53.900430] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T20:05:54.390711] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-03T20:05:54.408715] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T20:05:54.505733] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T20:05:55.190741] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-03T20:05:55.596722] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T20:05:55.990726] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-03T20:05:56.724087] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T20:05:56.790679] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-03T20:05:57.590705] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-03T20:05:57.905090] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T20:05:58.165796] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T20:05:58.390699] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-03T20:05:58.454416] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T20:05:59.190710] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-03T20:05:59.990733] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-03T20:06:00.414014] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T20:06:00.686283] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T20:06:00.790766] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-03T20:06:01.590673] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-03T20:06:01.844573] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T20:06:02.390720] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-03T20:06:03.012308] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T20:06:03.045391] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T20:06:03.190708] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-03T20:06:03.923575] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T20:06:03.990716] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-03T20:06:04.790668] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-03T20:06:05.257582] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T20:06:05.591486] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-03T20:06:05.596757] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T20:06:06.170833] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T20:06:06.390801] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T20:06:06.390895] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-03T20:06:07.190716] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-03T20:06:07.685130] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T20:06:07.990728] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-03T20:06:08.613205] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T20:06:08.778327] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T20:06:08.790608] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-03T20:06:09.590686] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-03T20:06:10.390750] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-03T20:06:10.575906] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T20:06:11.057886] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T20:06:11.153787] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T20:06:11.190691] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-03T20:06:11.857458] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T20:06:11.990721] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-03T20:06:12.790733] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-03T20:06:13.593280] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-03T20:06:13.599155] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T20:06:14.334493] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T20:06:14.390719] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-03T20:06:14.608560] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T20:06:15.190735] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-03T20:06:15.990717] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-03T20:06:16.136000] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T20:06:16.790699] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-03T20:06:17.286146] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T20:06:17.461110] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T20:06:17.462068] [INFO ] [REMOTE ] MDST: Full fetch complete (8566 records). [2025-10-03T20:06:17.462143] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-03T20:06:17.598427] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-03T20:06:17.712918] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T20:06:17.902289] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-03T20:06:17.902414] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-03T20:06:17.902768] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-03T20:06:17.902853] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-03T20:06:17.903815] [DEBUG] [LOCAL ] MDST: Trimmed 8566 records to 5772 (keeping 200 days of data) [2025-10-03T20:06:17.947240] [DEBUG] [LOCAL ] MDST: Primary data saved (5772 records). [2025-10-03T20:06:17.947392] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-03T20:06:17.947488] [INFO ] [MAIN ] Update Progress: 1321/2370 symbols completed. MDST took 30.7s. Estimated remaining: 2h 27m 53s. Rate: 7.1 symbols/min [2025-10-03T20:06:18.139465] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:18.150584] [DEBUG] [LOCAL ] MDV: Loaded 8576 existing records from primary storage. [2025-10-03T20:06:18.150833] [INFO ] [MAIN ] MDV: Loaded 8576 existing records. [2025-10-03T20:06:18.348751] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:18.349020] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-03T20:06:18.349079] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-03T20:06:18.349305] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-03T20:06:18.349362] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-03T20:06:18.396724] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-03T20:06:18.754783] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:19.190627] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-03T20:06:19.742704] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T20:06:19.799735] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T20:06:19.990117] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T20:06:19.992273] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-03T20:06:19.994584] [INFO ] [REMOTE ] MDU: Full fetch complete (70482 records). [2025-10-03T20:06:19.994749] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-03T20:06:20.428346] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-03T20:06:20.428433] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-03T20:06:20.429513] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-03T20:06:20.429581] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-03T20:06:20.431144] [DEBUG] [LOCAL ] MDU: Trimmed 70482 records to 48708 (keeping 200 days of data) [2025-10-03T20:06:20.734184] [DEBUG] [LOCAL ] MDU: Primary data saved (48708 records). [2025-10-03T20:06:20.734322] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-03T20:06:20.734410] [INFO ] [MAIN ] Update Progress: 1322/2370 symbols completed. MDU took 33.5s. Estimated remaining: 2h 27m 40s. Rate: 7.1 symbols/min [2025-10-03T20:06:20.801141] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-03T20:06:20.920741] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:20.939819] [DEBUG] [LOCAL ] MEC: Loaded 16383 existing records from primary storage. [2025-10-03T20:06:20.940082] [INFO ] [MAIN ] MEC: Loaded 16383 existing records. [2025-10-03T20:06:21.137014] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:21.137721] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-03T20:06:21.137884] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-03T20:06:21.138315] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-03T20:06:21.138377] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-03T20:06:21.542708] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:21.549079] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:06:21.590722] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-03T20:06:22.026055] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T20:06:22.390736] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-03T20:06:22.845467] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T20:06:22.847772] [INFO ] [REMOTE ] MD: Full fetch complete (55224 records). [2025-10-03T20:06:22.848268] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-03T20:06:23.047908] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T20:06:23.195761] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-03T20:06:23.273667] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-03T20:06:23.273758] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-03T20:06:23.274766] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-03T20:06:23.274832] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-03T20:06:23.276034] [DEBUG] [LOCAL ] MD: Trimmed 55224 records to 38895 (keeping 200 days of data) [2025-10-03T20:06:23.528930] [DEBUG] [LOCAL ] MD: Primary data saved (38895 records). [2025-10-03T20:06:23.529088] [INFO ] [MAIN ] MD: Full history saved. [2025-10-03T20:06:23.529749] [INFO ] [MAIN ] Update Progress: 1323/2370 symbols completed. MD took 36.3s. Estimated remaining: 2h 27m 27s. Rate: 7.1 symbols/min [2025-10-03T20:06:23.724449] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:23.749405] [DEBUG] [LOCAL ] MED: Loaded 21638 existing records from primary storage. [2025-10-03T20:06:23.749699] [INFO ] [MAIN ] MED: Loaded 21638 existing records. [2025-10-03T20:06:23.962851] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:23.963325] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-03T20:06:23.963412] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-03T20:06:23.963813] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-03T20:06:23.963874] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-03T20:06:24.003021] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-03T20:06:24.352420] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T20:06:24.422391] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:24.790697] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-03T20:06:25.593894] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T20:06:25.593557] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-03T20:06:25.746085] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T20:06:25.749225] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-03T20:06:25.749388] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-03T20:06:26.172362] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-03T20:06:26.172454] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-03T20:06:26.173638] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-03T20:06:26.173735] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-03T20:06:26.175369] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54458 (keeping 200 days of data) [2025-10-03T20:06:26.391362] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-03T20:06:26.529864] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-10-03T20:06:26.530016] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-03T20:06:26.530116] [INFO ] [MAIN ] Update Progress: 1324/2370 symbols completed. MDT took 39.3s. Estimated remaining: 2h 27m 14s. Rate: 7.1 symbols/min [2025-10-03T20:06:26.752334] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T20:06:26.756311] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:26.795809] [DEBUG] [LOCAL ] MEG: Loaded 32074 existing records from primary storage. [2025-10-03T20:06:26.796132] [INFO ] [MAIN ] MEG: Loaded 32074 existing records. [2025-10-03T20:06:26.994461] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:26.994951] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-03T20:06:26.995072] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-03T20:06:26.995490] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-03T20:06:26.995550] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-03T20:06:27.195773] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-03T20:06:27.301808] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T20:06:27.406801] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:27.990687] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-03T20:06:28.446586] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T20:06:28.752741] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T20:06:28.790676] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-03T20:06:29.590716] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-03T20:06:29.629398] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T20:06:30.390705] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-03T20:06:30.694851] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T20:06:31.190692] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-03T20:06:31.316681] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:06:31.716452] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T20:06:31.990707] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-03T20:06:32.790689] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-03T20:06:32.924566] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T20:06:33.590686] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-03T20:06:33.700249] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T20:06:34.261179] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T20:06:34.390712] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-03T20:06:35.190635] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-03T20:06:35.348794] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T20:06:35.990721] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-03T20:06:36.674942] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T20:06:36.732965] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T20:06:36.790806] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-03T20:06:37.590716] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-03T20:06:38.095491] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T20:06:38.390768] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-03T20:06:38.528422] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T20:06:39.190624] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-03T20:06:39.289847] [DEBUG] [REMOTE ] MDV: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T20:06:39.290154] [WARN ] [REMOTE ] MDV: No data returned for month 2025-07 [2025-10-03T20:06:39.290263] [FATAL] [REMOTE ] MDV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:06:39.290395] [FATAL] [MAIN ] MDV: Failed to fetch primary data. [2025-10-03T20:06:39.290548] [WARN ] [MAIN ] MDV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:06:39.290638] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-03T20:06:39.290769] [DEBUG] [LOCAL ] MDV: No primary data file found to delete. [2025-10-03T20:06:39.290826] [INFO ] [LOCAL ] MDV: Starting deletion of derivative data. [2025-10-03T20:06:39.291179] [DEBUG] [LOCAL ] MDV: Deleted derivative data file. [2025-10-03T20:06:39.291293] [INFO ] [MAIN ] Update Progress: 1325/2370 symbols completed. MDV took 21.3s. Estimated remaining: 2h 27m 9s. Rate: 7.1 symbols/min [2025-10-03T20:06:39.490287] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:39.515676] [DEBUG] [LOCAL ] MEGI: Loaded 20228 existing records from primary storage. [2025-10-03T20:06:39.515952] [INFO ] [MAIN ] MEGI: Loaded 20228 existing records. [2025-10-03T20:06:39.734464] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:39.736225] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T20:06:39.736393] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-03T20:06:39.742821] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-03T20:06:39.743639] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-03T20:06:39.743736] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-03T20:06:40.000597] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-03T20:06:40.127095] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:40.790685] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-03T20:06:41.271736] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T20:06:41.590731] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-03T20:06:41.993276] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T20:06:42.390715] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-03T20:06:42.754789] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T20:06:43.190718] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-03T20:06:43.853446] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T20:06:43.990674] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-03T20:06:44.308492] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T20:06:44.790750] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-03T20:06:44.810708] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T20:06:45.592306] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-03T20:06:45.596663] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T20:06:46.390692] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-03T20:06:46.588927] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T20:06:47.190712] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-03T20:06:47.576837] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T20:06:47.990667] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-03T20:06:48.149324] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T20:06:48.788227] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T20:06:48.789524] [INFO ] [REMOTE ] MEC: Full fetch complete (22852 records). [2025-10-03T20:06:48.789626] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-03T20:06:48.795824] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-03T20:06:49.203297] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-03T20:06:49.203380] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-03T20:06:49.203930] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-03T20:06:49.203993] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-03T20:06:49.204773] [DEBUG] [LOCAL ] MEC: Trimmed 22852 records to 16493 (keeping 200 days of data) [2025-10-03T20:06:49.305609] [DEBUG] [LOCAL ] MEC: Primary data saved (16493 records). [2025-10-03T20:06:49.305781] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-03T20:06:49.305899] [INFO ] [MAIN ] Update Progress: 1326/2370 symbols completed. MEC took 28.6s. Estimated remaining: 2h 27m 2s. Rate: 7.1 symbols/min [2025-10-03T20:06:49.498562] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:49.534195] [DEBUG] [LOCAL ] MEI: Loaded 32265 existing records from primary storage. [2025-10-03T20:06:49.534527] [INFO ] [MAIN ] MEI: Loaded 32265 existing records. [2025-10-03T20:06:49.595749] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-03T20:06:49.732056] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:49.732453] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-03T20:06:49.732582] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-03T20:06:49.732995] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-03T20:06:49.733055] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-03T20:06:50.161053] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T20:06:50.172967] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:50.390697] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-03T20:06:50.963918] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T20:06:51.190669] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-03T20:06:51.414183] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T20:06:51.990695] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-03T20:06:52.429374] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T20:06:52.790754] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-03T20:06:53.081951] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T20:06:53.490353] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T20:06:53.590713] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-03T20:06:54.390699] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-03T20:06:54.523708] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:06:55.190702] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-03T20:06:55.244449] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T20:06:55.246561] [INFO ] [REMOTE ] MED: Full fetch complete (32597 records). [2025-10-03T20:06:55.246720] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-03T20:06:55.651244] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-03T20:06:55.651326] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-03T20:06:55.652008] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-03T20:06:55.652076] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-03T20:06:55.652996] [DEBUG] [LOCAL ] MED: Trimmed 32597 records to 21777 (keeping 200 days of data) [2025-10-03T20:06:55.794036] [DEBUG] [LOCAL ] MED: Primary data saved (21777 records). [2025-10-03T20:06:55.794183] [INFO ] [MAIN ] MED: Full history saved. [2025-10-03T20:06:55.794316] [INFO ] [MAIN ] Update Progress: 1327/2370 symbols completed. MED took 32.3s. Estimated remaining: 2h 26m 52s. Rate: 7.1 symbols/min [2025-10-03T20:06:55.970282] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:06:55.990688] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-03T20:06:56.036171] [DEBUG] [LOCAL ] MET: Loaded 53701 existing records from primary storage. [2025-10-03T20:06:56.036587] [INFO ] [MAIN ] MET: Loaded 53701 existing records. [2025-10-03T20:06:56.233632] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:06:56.233876] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-03T20:06:56.233924] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-03T20:06:56.234471] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-03T20:06:56.234531] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-03T20:06:56.638415] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:06:56.658161] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T20:06:56.790676] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-03T20:06:56.931735] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T20:06:57.590686] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-03T20:06:58.390708] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-03T20:06:58.475945] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T20:06:58.898305] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T20:06:59.190622] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-03T20:06:59.347122] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T20:06:59.990635] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-03T20:07:00.350171] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T20:07:00.790733] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-03T20:07:01.287558] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T20:07:01.590691] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-03T20:07:02.390637] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-03T20:07:02.458748] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:07:02.712214] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T20:07:03.190734] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-03T20:07:03.990667] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-03T20:07:04.238192] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T20:07:04.460712] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T20:07:04.790744] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-03T20:07:04.986053] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T20:07:05.590713] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-03T20:07:06.238409] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T20:07:06.390728] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-03T20:07:06.453674] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:07:06.456003] [INFO ] [REMOTE ] MEGI: Full fetch complete (30332 records). [2025-10-03T20:07:06.456100] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-03T20:07:07.024143] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-03T20:07:07.024274] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-03T20:07:07.025759] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-03T20:07:07.025850] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-03T20:07:07.027175] [DEBUG] [LOCAL ] MEGI: Trimmed 30332 records to 20332 (keeping 200 days of data) [2025-10-03T20:07:07.191494] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-03T20:07:07.230275] [DEBUG] [LOCAL ] MEGI: Primary data saved (20332 records). [2025-10-03T20:07:07.230456] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-03T20:07:07.230639] [INFO ] [MAIN ] Update Progress: 1328/2370 symbols completed. MEGI took 27.9s. Estimated remaining: 2h 26m 46s. Rate: 7.1 symbols/min [2025-10-03T20:07:07.499510] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:07.554834] [DEBUG] [LOCAL ] MFA: Loaded 45805 existing records from primary storage. [2025-10-03T20:07:07.555293] [INFO ] [MAIN ] MFA: Loaded 45805 existing records. [2025-10-03T20:07:07.779546] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:07:07.779855] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-03T20:07:07.779929] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-03T20:07:07.780318] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-03T20:07:07.780377] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-03T20:07:07.992422] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-03T20:07:08.219149] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T20:07:08.241032] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:08.790675] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-03T20:07:09.130492] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T20:07:09.336774] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T20:07:09.590701] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-03T20:07:09.902768] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T20:07:10.390723] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-03T20:07:11.140408] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T20:07:11.190716] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-03T20:07:11.990713] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-03T20:07:12.267495] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T20:07:12.795740] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-03T20:07:12.810043] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T20:07:13.144959] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:07:13.590699] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-03T20:07:14.390628] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-03T20:07:14.720897] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T20:07:15.190738] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-03T20:07:15.227708] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T20:07:15.516821] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:07:15.990722] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-03T20:07:16.790715] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-03T20:07:17.042328] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T20:07:17.433365] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T20:07:17.590691] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-03T20:07:18.332366] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T20:07:18.390680] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-03T20:07:19.190717] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-03T20:07:19.506926] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T20:07:19.713412] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T20:07:19.715767] [INFO ] [REMOTE ] MEG: Full fetch complete (47830 records). [2025-10-03T20:07:19.715933] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-03T20:07:19.995825] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-03T20:07:20.129343] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-03T20:07:20.129427] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-03T20:07:20.130291] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-03T20:07:20.130357] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-03T20:07:20.131537] [DEBUG] [LOCAL ] MEG: Trimmed 47830 records to 32328 (keeping 200 days of data) [2025-10-03T20:07:20.322072] [DEBUG] [LOCAL ] MEG: Primary data saved (32328 records). [2025-10-03T20:07:20.322216] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-03T20:07:20.322324] [INFO ] [MAIN ] Update Progress: 1329/2370 symbols completed. MEG took 53.8s. Estimated remaining: 2h 26m 41s. Rate: 7.1 symbols/min [2025-10-03T20:07:20.529606] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:20.536725] [DEBUG] [LOCAL ] MFAN: Loaded 4277 existing records from primary storage. [2025-10-03T20:07:20.536941] [INFO ] [MAIN ] MFAN: Loaded 4277 existing records. [2025-10-03T20:07:20.724129] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:07:20.724577] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-03T20:07:20.724633] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-03T20:07:20.724842] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-03T20:07:20.724902] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-03T20:07:20.792900] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-03T20:07:21.159382] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:21.162102] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T20:07:21.466281] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T20:07:21.590696] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-03T20:07:22.390728] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-03T20:07:22.609846] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:07:23.190710] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-03T20:07:23.326147] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T20:07:23.821992] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T20:07:23.990720] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-03T20:07:24.697016] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T20:07:24.790694] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-03T20:07:25.229888] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T20:07:25.231899] [INFO ] [REMOTE ] MEI: Full fetch complete (45517 records). [2025-10-03T20:07:25.232012] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-03T20:07:25.595739] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-03T20:07:25.656528] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-03T20:07:25.656601] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-03T20:07:25.657668] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-03T20:07:25.657736] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-03T20:07:25.659131] [DEBUG] [LOCAL ] MEI: Trimmed 45517 records to 32495 (keeping 200 days of data) [2025-10-03T20:07:25.857179] [DEBUG] [LOCAL ] MEI: Primary data saved (32495 records). [2025-10-03T20:07:25.857329] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-03T20:07:25.857419] [INFO ] [MAIN ] Update Progress: 1330/2370 symbols completed. MEI took 36.6s. Estimated remaining: 2h 26m 30s. Rate: 7.1 symbols/min [2025-10-03T20:07:26.046998] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:26.053492] [DEBUG] [LOCAL ] MFAO: Loaded 3857 existing records from primary storage. [2025-10-03T20:07:26.053706] [INFO ] [MAIN ] MFAO: Loaded 3857 existing records. [2025-10-03T20:07:26.241671] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:07:26.247159] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-03T20:07:26.247788] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-03T20:07:26.248090] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T20:07:26.250516] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-03T20:07:26.250583] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-03T20:07:26.283463] [INFO ] [REMOTE ] MET: Full fetch complete (77121 records). [2025-10-03T20:07:26.316875] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-03T20:07:26.407732] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-03T20:07:26.995983] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:26.999570] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T20:07:27.110964] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-03T20:07:27.111134] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-03T20:07:27.112395] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-03T20:07:27.112464] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-03T20:07:27.114249] [DEBUG] [LOCAL ] MET: Trimmed 77121 records to 54091 (keeping 200 days of data) [2025-10-03T20:07:27.209582] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-03T20:07:27.368784] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T20:07:27.504810] [DEBUG] [LOCAL ] MET: Primary data saved (54091 records). [2025-10-03T20:07:27.504967] [INFO ] [MAIN ] MET: Full history saved. [2025-10-03T20:07:27.505803] [INFO ] [MAIN ] Update Progress: 1331/2370 symbols completed. MET took 31.7s. Estimated remaining: 2h 26m 16s. Rate: 7.1 symbols/min [2025-10-03T20:07:27.698277] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:27.702201] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T20:07:27.758188] [DEBUG] [LOCAL ] MFC: Loaded 51524 existing records from primary storage. [2025-10-03T20:07:27.758527] [INFO ] [MAIN ] MFC: Loaded 51524 existing records. [2025-10-03T20:07:27.949512] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:07:27.949763] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-03T20:07:27.949815] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-03T20:07:27.950301] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-03T20:07:27.950360] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-03T20:07:27.995764] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-03T20:07:28.350876] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:28.615258] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T20:07:28.790680] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-03T20:07:29.590685] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-03T20:07:30.390679] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-03T20:07:30.530009] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T20:07:30.860093] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T20:07:30.997209] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T20:07:31.190678] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-03T20:07:31.823475] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T20:07:31.990704] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-03T20:07:32.582760] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T20:07:32.790707] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-03T20:07:33.332280] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:07:33.590686] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-03T20:07:34.221665] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T20:07:34.390725] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-03T20:07:35.190702] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-03T20:07:35.990703] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-03T20:07:36.064684] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T20:07:36.525682] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T20:07:36.790696] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-03T20:07:36.868130] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T20:07:37.243628] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T20:07:37.590727] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-03T20:07:38.390725] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-03T20:07:38.948194] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T20:07:39.190673] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-03T20:07:39.428684] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T20:07:39.777594] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T20:07:39.990717] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-03T20:07:40.563608] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T20:07:40.790686] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-03T20:07:41.351218] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T20:07:41.590709] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-03T20:07:42.390709] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-03T20:07:42.940380] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T20:07:43.038527] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T20:07:43.040956] [INFO ] [REMOTE ] MFA: Full fetch complete (65219 records). [2025-10-03T20:07:43.041056] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-03T20:07:43.195798] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-03T20:07:43.510708] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-03T20:07:43.510802] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-03T20:07:43.511913] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-03T20:07:43.511982] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-03T20:07:43.513424] [DEBUG] [LOCAL ] MFA: Trimmed 65219 records to 46145 (keeping 200 days of data) [2025-10-03T20:07:43.802355] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T20:07:43.807189] [DEBUG] [LOCAL ] MFA: Primary data saved (46145 records). [2025-10-03T20:07:43.807270] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-03T20:07:43.807366] [INFO ] [MAIN ] Update Progress: 1332/2370 symbols completed. MFA took 36.6s. Estimated remaining: 2h 26m 14s. Rate: 7.1 symbols/min [2025-10-03T20:07:43.991329] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-03T20:07:43.991179] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:44.041539] [DEBUG] [LOCAL ] MFG: Loaded 49581 existing records from primary storage. [2025-10-03T20:07:44.041894] [INFO ] [MAIN ] MFG: Loaded 49581 existing records. [2025-10-03T20:07:44.240738] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:07:44.240981] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-03T20:07:44.241086] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-03T20:07:44.241464] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-03T20:07:44.241533] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-03T20:07:44.546586] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T20:07:44.631100] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:44.790700] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-03T20:07:45.327308] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T20:07:45.590715] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-03T20:07:46.390703] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-03T20:07:46.858990] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T20:07:47.069965] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:07:47.190719] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-03T20:07:47.990708] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-03T20:07:48.382984] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T20:07:48.383829] [INFO ] [REMOTE ] MFAO: Full fetch complete (5339 records). [2025-10-03T20:07:48.383903] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-03T20:07:48.799409] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-03T20:07:48.792851] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-03T20:07:48.801002] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-03T20:07:48.801230] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-03T20:07:48.801311] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-03T20:07:48.802170] [DEBUG] [LOCAL ] MFAO: Trimmed 5339 records to 3886 (keeping 200 days of data) [2025-10-03T20:07:48.855371] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T20:07:48.866465] [DEBUG] [LOCAL ] MFAO: Primary data saved (3886 records). [2025-10-03T20:07:48.867043] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-03T20:07:48.867173] [INFO ] [MAIN ] Update Progress: 1333/2370 symbols completed. MFAO took 23.0s. Estimated remaining: 2h 26m 3s. Rate: 7.1 symbols/min [2025-10-03T20:07:49.054602] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:49.054859] [DEBUG] [LOCAL ] MFM: No existing data file found in primary storage. [2025-10-03T20:07:49.054925] [WARN ] [MAIN ] MFM: No existing data found, performing full refresh instead. [2025-10-03T20:07:49.055079] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-03T20:07:49.055145] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-03T20:07:49.055199] [DEBUG] [LOCAL ] MFM: No primary data file found to delete. [2025-10-03T20:07:49.055236] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-03T20:07:49.449994] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:49.590741] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-03T20:07:50.390684] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-03T20:07:50.402297] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T20:07:50.554813] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T20:07:51.190692] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-03T20:07:51.782102] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T20:07:51.959024] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T20:07:51.990698] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-03T20:07:52.790703] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-03T20:07:53.430375] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T20:07:53.590632] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-03T20:07:53.680169] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:07:54.390750] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-03T20:07:54.965365] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T20:07:55.190703] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-03T20:07:55.266866] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T20:07:55.672348] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T20:07:55.673292] [INFO ] [REMOTE ] MFAN: Full fetch complete (5750 records). [2025-10-03T20:07:55.673402] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-03T20:07:55.994396] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-03T20:07:56.085982] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-03T20:07:56.086081] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-03T20:07:56.086292] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-03T20:07:56.086354] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-03T20:07:56.086823] [DEBUG] [LOCAL ] MFAN: Trimmed 5750 records to 4303 (keeping 200 days of data) [2025-10-03T20:07:56.113623] [DEBUG] [LOCAL ] MFAN: Primary data saved (4303 records). [2025-10-03T20:07:56.113770] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-03T20:07:56.113885] [INFO ] [MAIN ] Update Progress: 1334/2370 symbols completed. MFAN took 35.8s. Estimated remaining: 2h 25m 54s. Rate: 7.1 symbols/min [2025-10-03T20:07:56.293415] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:07:56.293619] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-03T20:07:56.293702] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-03T20:07:56.293825] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-03T20:07:56.293870] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-03T20:07:56.293913] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-03T20:07:56.293947] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-03T20:07:56.696981] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:07:56.790705] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-03T20:07:56.828287] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T20:07:57.196145] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-03T20:07:57.590715] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-03T20:07:58.390702] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-03T20:07:59.190718] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-03T20:07:59.396382] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T20:07:59.464711] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T20:07:59.990746] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-03T20:08:00.790707] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-03T20:08:00.852311] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:08:01.085746] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-03T20:08:01.258904] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T20:08:01.590697] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-03T20:08:02.390709] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-03T20:08:03.190711] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-03T20:08:03.426843] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T20:08:03.589112] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T20:08:03.794730] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T20:08:03.990747] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-03T20:08:04.790743] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-03T20:08:05.590682] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-03T20:08:05.713834] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T20:08:06.182443] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T20:08:06.388007] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T20:08:06.398562] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-03T20:08:07.193183] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-03T20:08:07.196854] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T20:08:07.439741] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-03T20:08:07.990697] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-03T20:08:08.790713] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-03T20:08:09.590720] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-03T20:08:09.683852] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T20:08:09.838750] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-03T20:08:10.390718] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-03T20:08:10.561921] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T20:08:11.190733] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-03T20:08:11.508202] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-03T20:08:11.990682] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-03T20:08:12.054446] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T20:08:12.790733] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-03T20:08:13.590683] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-03T20:08:13.731759] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T20:08:13.860625] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-03T20:08:13.865252] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T20:08:14.390690] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-03T20:08:15.190731] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-03T20:08:15.555818] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T20:08:15.970300] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T20:08:15.975439] [INFO ] [REMOTE ] MFG: Full fetch complete (68990 records). [2025-10-03T20:08:15.975604] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-03T20:08:15.999374] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-03T20:08:16.429574] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-03T20:08:16.429718] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-03T20:08:16.430832] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-03T20:08:16.430901] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-03T20:08:16.434370] [DEBUG] [LOCAL ] MFG: Trimmed 68990 records to 49937 (keeping 200 days of data) [2025-10-03T20:08:16.739927] [DEBUG] [LOCAL ] MFG: Primary data saved (49937 records). [2025-10-03T20:08:16.740087] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-03T20:08:16.740210] [INFO ] [MAIN ] Update Progress: 1335/2370 symbols completed. MFG took 32.9s. Estimated remaining: 2h 25m 55s. Rate: 7.1 symbols/min [2025-10-03T20:08:16.800127] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-03T20:08:16.936869] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:16.946534] [DEBUG] [LOCAL ] MFSG: Loaded 5433 existing records from primary storage. [2025-10-03T20:08:16.946853] [INFO ] [MAIN ] MFSG: Loaded 5433 existing records. [2025-10-03T20:08:17.150184] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:17.150484] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-03T20:08:17.150556] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-03T20:08:17.150870] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-03T20:08:17.150942] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-03T20:08:17.555571] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:17.590676] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-03T20:08:17.663805] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T20:08:17.745464] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T20:08:17.747465] [INFO ] [REMOTE ] MFM: Full fetch complete (19772 records). [2025-10-03T20:08:17.747549] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-03T20:08:17.856431] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-03T20:08:18.151580] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-03T20:08:18.151831] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-03T20:08:18.152521] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-03T20:08:18.152588] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-03T20:08:18.153485] [DEBUG] [LOCAL ] MFM: Trimmed 19772 records to 14967 (keeping 200 days of data) [2025-10-03T20:08:18.246979] [DEBUG] [LOCAL ] MFM: Primary data saved (14967 records). [2025-10-03T20:08:18.247165] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-03T20:08:18.247309] [INFO ] [MAIN ] Update Progress: 1336/2370 symbols completed. MFM took 29.4s. Estimated remaining: 2h 25m 41s. Rate: 7.1 symbols/min [2025-10-03T20:08:18.402196] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-03T20:08:18.440226] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:18.456012] [DEBUG] [LOCAL ] MFSI: Loaded 11578 existing records from primary storage. [2025-10-03T20:08:18.456283] [INFO ] [MAIN ] MFSI: Loaded 11578 existing records. [2025-10-03T20:08:18.656040] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:18.656328] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-03T20:08:18.656381] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-03T20:08:18.656758] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-03T20:08:18.656819] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-03T20:08:18.941959] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:08:19.079389] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:19.190718] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-03T20:08:19.525447] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T20:08:19.990679] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-03T20:08:20.790697] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-03T20:08:21.172964] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T20:08:21.590702] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-03T20:08:21.740707] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T20:08:22.173794] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T20:08:22.390717] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-03T20:08:22.693732] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-03T20:08:23.190697] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-03T20:08:23.602458] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T20:08:23.990692] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-03T20:08:24.539582] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T20:08:24.790680] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-03T20:08:25.333090] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T20:08:25.590694] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-03T20:08:26.180720] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T20:08:26.390678] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-03T20:08:27.108359] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T20:08:27.190680] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-03T20:08:27.919997] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T20:08:27.990723] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-03T20:08:28.412866] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-03T20:08:28.790725] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-03T20:08:29.272204] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T20:08:29.273221] [INFO ] [REMOTE ] MFSB: Full fetch complete (1732 records). [2025-10-03T20:08:29.273296] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-03T20:08:29.479577] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-03T20:08:29.479840] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:08:29.479927] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:08:29.480021] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-03T20:08:29.480127] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-03T20:08:29.480203] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-03T20:08:29.480293] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-03T20:08:29.480405] [INFO ] [MAIN ] Update Progress: 1337/2370 symbols completed. MFSB took 33.4s. Estimated remaining: 2h 25m 34s. Rate: 7.1 symbols/min [2025-10-03T20:08:29.595817] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-03T20:08:29.678805] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:29.684295] [DEBUG] [LOCAL ] MFSV: Loaded 2596 existing records from primary storage. [2025-10-03T20:08:29.684541] [INFO ] [MAIN ] MFSV: Loaded 2596 existing records. [2025-10-03T20:08:29.874020] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:29.874245] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-03T20:08:29.874295] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-03T20:08:29.874549] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-03T20:08:29.874617] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-03T20:08:30.281558] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:30.292057] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T20:08:30.390697] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-03T20:08:30.744944] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-03T20:08:31.190729] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-03T20:08:31.951535] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T20:08:31.990692] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-03T20:08:32.334514] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T20:08:32.790681] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-03T20:08:33.590678] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-03T20:08:33.736898] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:08:33.948516] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T20:08:34.390698] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-03T20:08:34.947004] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T20:08:35.190699] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-03T20:08:35.842759] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T20:08:35.990719] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-03T20:08:36.649773] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T20:08:36.790710] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-03T20:08:37.590701] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-03T20:08:37.612395] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T20:08:37.613976] [INFO ] [REMOTE ] MFSI: Full fetch complete (13865 records). [2025-10-03T20:08:37.614075] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-03T20:08:37.924958] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T20:08:38.005940] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-03T20:08:38.006024] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-03T20:08:38.006395] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-03T20:08:38.006442] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-03T20:08:38.007144] [DEBUG] [LOCAL ] MFSI: Trimmed 13865 records to 11669 (keeping 200 days of data) [2025-10-03T20:08:38.080255] [DEBUG] [LOCAL ] MFSI: Primary data saved (11669 records). [2025-10-03T20:08:38.080428] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-03T20:08:38.080528] [INFO ] [MAIN ] Update Progress: 1338/2370 symbols completed. MFSI took 19.8s. Estimated remaining: 2h 25m 26s. Rate: 7.1 symbols/min [2025-10-03T20:08:38.263100] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:38.286464] [DEBUG] [LOCAL ] MG: Loaded 16524 existing records from primary storage. [2025-10-03T20:08:38.286763] [INFO ] [MAIN ] MG: Loaded 16524 existing records. [2025-10-03T20:08:38.395758] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-03T20:08:38.474049] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:38.474318] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-03T20:08:38.474374] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-03T20:08:38.474707] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-03T20:08:38.474767] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-03T20:08:38.847090] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:39.190701] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-03T20:08:39.626224] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T20:08:39.895174] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T20:08:39.897938] [INFO ] [REMOTE ] MFC: Full fetch complete (74155 records). [2025-10-03T20:08:39.898120] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-03T20:08:39.995834] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-03T20:08:40.329043] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-03T20:08:40.329131] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-03T20:08:40.330277] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-03T20:08:40.330354] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-03T20:08:40.331897] [DEBUG] [LOCAL ] MFC: Trimmed 74155 records to 51889 (keeping 200 days of data) [2025-10-03T20:08:40.597586] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T20:08:40.678079] [DEBUG] [LOCAL ] MFC: Primary data saved (51889 records). [2025-10-03T20:08:40.678230] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-03T20:08:40.682436] [INFO ] [MAIN ] Update Progress: 1339/2370 symbols completed. MFC took 1m 13s. Estimated remaining: 2h 25m 13s. Rate: 7.1 symbols/min [2025-10-03T20:08:40.793607] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-03T20:08:40.872523] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:40.933612] [DEBUG] [LOCAL ] MGA: Loaded 51045 existing records from primary storage. [2025-10-03T20:08:40.934051] [INFO ] [MAIN ] MGA: Loaded 51045 existing records. [2025-10-03T20:08:41.129072] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:41.129316] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-03T20:08:41.129368] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-03T20:08:41.130022] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-03T20:08:41.130085] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-03T20:08:41.518433] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:41.590713] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-03T20:08:41.868201] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T20:08:42.200255] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T20:08:42.390707] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-03T20:08:43.190675] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-03T20:08:43.258578] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T20:08:43.924153] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T20:08:43.990719] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-03T20:08:44.790733] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-03T20:08:45.216077] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T20:08:45.590711] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-03T20:08:45.800771] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T20:08:46.188827] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T20:08:46.189788] [INFO ] [REMOTE ] MFSG: Full fetch complete (6175 records). [2025-10-03T20:08:46.189863] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-03T20:08:46.391276] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-03T20:08:46.593261] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-03T20:08:46.593349] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-03T20:08:46.593620] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-03T20:08:46.593715] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-03T20:08:46.594310] [DEBUG] [LOCAL ] MFSG: Trimmed 6175 records to 5487 (keeping 200 days of data) [2025-10-03T20:08:46.629240] [DEBUG] [LOCAL ] MFSG: Primary data saved (5487 records). [2025-10-03T20:08:46.629386] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-03T20:08:46.629501] [INFO ] [MAIN ] Update Progress: 1340/2370 symbols completed. MFSG took 29.9s. Estimated remaining: 2h 25m 3s. Rate: 7.1 symbols/min [2025-10-03T20:08:46.830589] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:08:46.838340] [DEBUG] [LOCAL ] MGF: Loaded 4296 existing records from primary storage. [2025-10-03T20:08:46.838600] [INFO ] [MAIN ] MGF: Loaded 4296 existing records. [2025-10-03T20:08:47.033616] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:08:47.033882] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-03T20:08:47.033938] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-03T20:08:47.034143] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-03T20:08:47.034203] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-03T20:08:47.195856] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-03T20:08:47.447814] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:08:47.702784] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-03T20:08:47.990615] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-03T20:08:48.265277] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T20:08:48.397483] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T20:08:48.790732] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-03T20:08:49.590666] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-03T20:08:49.642316] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T20:08:50.025445] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T20:08:50.390716] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-03T20:08:51.040694] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T20:08:51.190701] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-03T20:08:51.742817] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-03T20:08:51.990737] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-03T20:08:52.790741] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-03T20:08:53.044412] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T20:08:53.590694] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-03T20:08:54.150025] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T20:08:54.390635] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-03T20:08:54.422261] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T20:08:55.166227] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T20:08:55.190693] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-03T20:08:55.990713] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-03T20:08:56.572196] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T20:08:56.790678] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-03T20:08:56.844200] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T20:08:57.389447] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T20:08:57.590750] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-03T20:08:58.158365] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-03T20:08:58.390703] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-03T20:08:58.966736] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T20:08:59.190725] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-03T20:08:59.608677] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-03T20:08:59.990701] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-03T20:09:00.527295] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T20:09:00.790715] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-03T20:09:01.432830] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T20:09:01.590717] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-03T20:09:02.204309] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T20:09:02.390724] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-03T20:09:03.190736] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-03T20:09:03.456184] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T20:09:03.990716] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-03T20:09:04.546080] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T20:09:04.546993] [INFO ] [REMOTE ] MGF: Full fetch complete (5919 records). [2025-10-03T20:09:04.547064] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-03T20:09:04.795856] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-03T20:09:04.954658] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-03T20:09:04.954864] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-03T20:09:04.955111] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-03T20:09:04.955291] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-03T20:09:04.956003] [DEBUG] [LOCAL ] MGF: Trimmed 5919 records to 4313 (keeping 200 days of data) [2025-10-03T20:09:05.019697] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T20:09:05.022217] [DEBUG] [LOCAL ] MGF: Primary data saved (4313 records). [2025-10-03T20:09:05.036190] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-03T20:09:05.036856] [INFO ] [MAIN ] Update Progress: 1341/2370 symbols completed. MGF took 18.4s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-03T20:09:05.226857] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:05.290528] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-03T20:09:05.290893] [INFO ] [MAIN ] MGM: Loaded 53997 existing records. [2025-10-03T20:09:05.494114] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:05.494422] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-03T20:09:05.494481] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-03T20:09:05.495077] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-03T20:09:05.495138] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-03T20:09:05.600751] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-03T20:09:05.923494] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:05.930495] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T20:09:06.390682] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-03T20:09:07.190676] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-03T20:09:07.276443] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T20:09:07.305131] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:09:07.990706] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-03T20:09:08.790744] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-03T20:09:09.102940] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T20:09:09.551250] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T20:09:09.590694] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-03T20:09:09.703918] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T20:09:10.390706] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-03T20:09:10.921381] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:09:10.922368] [INFO ] [REMOTE ] MFSV: Full fetch complete (3261 records). [2025-10-03T20:09:10.922450] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-03T20:09:11.195286] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-03T20:09:11.322293] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-03T20:09:11.322427] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-03T20:09:11.322684] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-03T20:09:11.322763] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-03T20:09:11.323299] [DEBUG] [LOCAL ] MFSV: Trimmed 3261 records to 2639 (keeping 200 days of data) [2025-10-03T20:09:11.340598] [DEBUG] [LOCAL ] MFSV: Primary data saved (2639 records). [2025-10-03T20:09:11.340729] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-03T20:09:11.340819] [INFO ] [MAIN ] Update Progress: 1342/2370 symbols completed. MFSV took 41.9s. Estimated remaining: 2h 24m 52s. Rate: 7.1 symbols/min [2025-10-03T20:09:11.536484] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:11.572852] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T20:09:11.589536] [DEBUG] [LOCAL ] MGR: Loaded 5639 existing records from primary storage. [2025-10-03T20:09:11.589815] [INFO ] [MAIN ] MGR: Loaded 5639 existing records. [2025-10-03T20:09:11.787055] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:11.787284] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-03T20:09:11.787333] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-03T20:09:11.787547] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-03T20:09:11.787622] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-03T20:09:11.995870] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-03T20:09:12.198945] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:12.790707] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-03T20:09:13.092980] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:09:13.131436] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T20:09:13.590744] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-03T20:09:14.306621] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T20:09:14.399017] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-03T20:09:14.406138] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T20:09:15.190750] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-03T20:09:15.677621] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T20:09:15.990712] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-03T20:09:16.064085] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T20:09:16.790697] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-03T20:09:17.558855] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T20:09:17.560202] [INFO ] [REMOTE ] MG: Full fetch complete (23943 records). [2025-10-03T20:09:17.560292] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-03T20:09:17.595816] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-03T20:09:17.983148] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-03T20:09:17.983258] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-03T20:09:17.983990] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-03T20:09:17.984113] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-03T20:09:17.985352] [DEBUG] [LOCAL ] MG: Trimmed 23943 records to 16608 (keeping 200 days of data) [2025-10-03T20:09:18.103961] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T20:09:18.131383] [DEBUG] [LOCAL ] MG: Primary data saved (16608 records). [2025-10-03T20:09:18.132265] [INFO ] [MAIN ] MG: Full history saved. [2025-10-03T20:09:18.132779] [INFO ] [MAIN ] Update Progress: 1343/2370 symbols completed. MG took 40.1s. Estimated remaining: 2h 24m 42s. Rate: 7.1 symbols/min [2025-10-03T20:09:18.308804] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:18.318281] [DEBUG] [LOCAL ] MGRB: Loaded 4079 existing records from primary storage. [2025-10-03T20:09:18.318495] [INFO ] [MAIN ] MGRB: Loaded 4079 existing records. [2025-10-03T20:09:18.396257] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-03T20:09:18.508206] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:18.508412] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-03T20:09:18.508460] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-03T20:09:18.508634] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-03T20:09:18.508721] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-03T20:09:18.888719] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:19.190684] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-03T20:09:19.354251] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T20:09:19.571899] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T20:09:19.861337] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T20:09:19.990684] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-03T20:09:20.790682] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-03T20:09:21.590634] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-03T20:09:21.935625] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T20:09:22.224000] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T20:09:22.293800] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T20:09:22.296595] [INFO ] [REMOTE ] MGA: Full fetch complete (73718 records). [2025-10-03T20:09:22.296769] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-03T20:09:22.395857] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-03T20:09:22.766406] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-03T20:09:22.766515] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-03T20:09:22.767720] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-03T20:09:22.767786] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-03T20:09:22.769373] [DEBUG] [LOCAL ] MGA: Trimmed 73718 records to 51428 (keeping 200 days of data) [2025-10-03T20:09:23.080414] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T20:09:23.105084] [DEBUG] [LOCAL ] MGA: Primary data saved (51428 records). [2025-10-03T20:09:23.105325] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-03T20:09:23.106302] [INFO ] [MAIN ] Update Progress: 1344/2370 symbols completed. MGA took 42.4s. Estimated remaining: 2h 24m 31s. Rate: 7.1 symbols/min [2025-10-03T20:09:23.195866] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-03T20:09:23.290224] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:23.296465] [DEBUG] [LOCAL ] MGRD: Loaded 2248 existing records from primary storage. [2025-10-03T20:09:23.296711] [INFO ] [MAIN ] MGRD: Loaded 2248 existing records. [2025-10-03T20:09:23.516363] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:23.516974] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-03T20:09:23.517056] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-03T20:09:23.517344] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-03T20:09:23.517416] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-03T20:09:23.844111] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T20:09:23.925752] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:23.990639] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-03T20:09:24.472892] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T20:09:24.790691] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-03T20:09:25.334535] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T20:09:25.590686] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-03T20:09:26.217495] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T20:09:26.390688] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-03T20:09:27.190712] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-03T20:09:27.812444] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T20:09:27.996379] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-03T20:09:28.011205] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T20:09:28.494996] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-03T20:09:28.790712] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-03T20:09:29.397877] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T20:09:29.590668] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-03T20:09:30.217733] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T20:09:30.390703] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-03T20:09:31.190733] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-03T20:09:31.792420] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T20:09:31.990678] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-03T20:09:32.242432] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T20:09:32.604405] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T20:09:32.790700] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-03T20:09:33.508301] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T20:09:33.590717] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-03T20:09:34.035850] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T20:09:34.390713] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-03T20:09:34.950731] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T20:09:35.190694] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-03T20:09:35.614982] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-03T20:09:35.990730] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-03T20:09:36.511636] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T20:09:36.790692] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-03T20:09:37.332828] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-03T20:09:37.590710] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-03T20:09:38.390724] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-03T20:09:38.965926] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T20:09:39.190712] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-03T20:09:39.477202] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T20:09:39.846003] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T20:09:39.990746] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-03T20:09:40.462783] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T20:09:40.790727] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-03T20:09:41.272878] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T20:09:41.590689] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-03T20:09:42.021763] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T20:09:42.390689] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-03T20:09:42.984559] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T20:09:43.190693] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-03T20:09:43.657953] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T20:09:43.990723] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-03T20:09:44.421899] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T20:09:44.790726] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-03T20:09:45.250926] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T20:09:45.251789] [INFO ] [REMOTE ] MGRB: Full fetch complete (6047 records). [2025-10-03T20:09:45.251883] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-03T20:09:45.595745] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-03T20:09:45.660147] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-03T20:09:45.660262] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-03T20:09:45.660493] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-03T20:09:45.660556] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-03T20:09:45.660988] [DEBUG] [LOCAL ] MGRB: Trimmed 6047 records to 4092 (keeping 200 days of data) [2025-10-03T20:09:45.688335] [DEBUG] [LOCAL ] MGRB: Primary data saved (4092 records). [2025-10-03T20:09:45.688534] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-03T20:09:45.688799] [INFO ] [MAIN ] Update Progress: 1345/2370 symbols completed. MGRB took 27.6s. Estimated remaining: 2h 24m 33s. Rate: 7.1 symbols/min [2025-10-03T20:09:45.875143] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:45.887277] [DEBUG] [LOCAL ] MGRE: Loaded 6725 existing records from primary storage. [2025-10-03T20:09:45.887516] [INFO ] [MAIN ] MGRE: Loaded 6725 existing records. [2025-10-03T20:09:46.085465] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:46.085702] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-03T20:09:46.085760] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-03T20:09:46.086063] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-03T20:09:46.086123] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-03T20:09:46.178421] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T20:09:46.397820] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-03T20:09:46.503612] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:46.895462] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T20:09:47.190732] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-03T20:09:47.562178] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T20:09:47.563184] [INFO ] [REMOTE ] MGRD: Full fetch complete (3503 records). [2025-10-03T20:09:47.563292] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-03T20:09:47.972208] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-03T20:09:47.972292] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-03T20:09:47.972419] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-03T20:09:47.972460] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-03T20:09:47.972925] [DEBUG] [LOCAL ] MGRD: Trimmed 3503 records to 2257 (keeping 200 days of data) [2025-10-03T20:09:47.988590] [DEBUG] [LOCAL ] MGRD: Primary data saved (2257 records). [2025-10-03T20:09:47.988760] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-03T20:09:47.988892] [INFO ] [MAIN ] Update Progress: 1346/2370 symbols completed. MGRD took 24.9s. Estimated remaining: 2h 24m 20s. Rate: 7.1 symbols/min [2025-10-03T20:09:47.995788] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-03T20:09:48.180323] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:48.252153] [DEBUG] [LOCAL ] MGY: Loaded 52801 existing records from primary storage. [2025-10-03T20:09:48.252582] [INFO ] [MAIN ] MGY: Loaded 52801 existing records. [2025-10-03T20:09:48.443761] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:48.443990] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-03T20:09:48.444038] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-03T20:09:48.444493] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-03T20:09:48.444553] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-03T20:09:48.705566] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T20:09:48.737162] [INFO ] [REMOTE ] MGR: Full fetch complete (8148 records). [2025-10-03T20:09:48.749090] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-03T20:09:48.791513] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-03T20:09:48.935205] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:49.238004] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-03T20:09:49.238085] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-03T20:09:49.238285] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-03T20:09:49.238324] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-03T20:09:49.238811] [DEBUG] [LOCAL ] MGR: Trimmed 8148 records to 5687 (keeping 200 days of data) [2025-10-03T20:09:49.274727] [DEBUG] [LOCAL ] MGR: Primary data saved (5687 records). [2025-10-03T20:09:49.274855] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-03T20:09:49.274969] [INFO ] [MAIN ] Update Progress: 1347/2370 symbols completed. MGR took 37.9s. Estimated remaining: 2h 24m 6s. Rate: 7.1 symbols/min [2025-10-03T20:09:49.463472] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:49.463794] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-03T20:09:49.463864] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-03T20:09:49.464020] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-03T20:09:49.464074] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-03T20:09:49.464119] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-03T20:09:49.464153] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-03T20:09:49.585000] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T20:09:49.595794] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-03T20:09:49.865661] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:50.390700] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-03T20:09:51.190709] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-03T20:09:51.307881] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T20:09:51.392382] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:09:51.392758] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-03T20:09:51.392861] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:09:51.392910] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-03T20:09:51.392972] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:09:51.393047] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-03T20:09:51.393112] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-03T20:09:51.393150] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-03T20:09:51.393194] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-03T20:09:51.393254] [INFO ] [MAIN ] Update Progress: 1348/2370 symbols completed. MH took 2.1s. Estimated remaining: 2h 23m 53s. Rate: 7.1 symbols/min [2025-10-03T20:09:51.572446] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:51.590177] [DEBUG] [LOCAL ] MHD: Loaded 12563 existing records from primary storage. [2025-10-03T20:09:51.590427] [INFO ] [MAIN ] MHD: Loaded 12563 existing records. [2025-10-03T20:09:51.792451] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:51.792743] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-03T20:09:51.792820] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-03T20:09:51.793058] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-03T20:09:51.793130] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-03T20:09:52.001408] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-03T20:09:52.188301] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:52.225865] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T20:09:52.638106] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T20:09:52.790672] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-03T20:09:53.590787] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-03T20:09:53.780325] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T20:09:54.390748] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-03T20:09:54.907015] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T20:09:54.949489] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T20:09:54.952235] [INFO ] [REMOTE ] MGM: Full fetch complete (77603 records). [2025-10-03T20:09:54.952393] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-03T20:09:55.195777] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-03T20:09:55.378354] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-03T20:09:55.378451] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-03T20:09:55.379922] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-03T20:09:55.379995] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-03T20:09:55.381717] [DEBUG] [LOCAL ] MGM: Trimmed 77603 records to 54387 (keeping 200 days of data) [2025-10-03T20:09:55.729460] [DEBUG] [LOCAL ] MGM: Primary data saved (54387 records). [2025-10-03T20:09:55.729665] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-03T20:09:55.729774] [INFO ] [MAIN ] Update Progress: 1349/2370 symbols completed. MGM took 50.7s. Estimated remaining: 2h 23m 41s. Rate: 7.1 symbols/min [2025-10-03T20:09:55.922710] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:09:55.934349] [DEBUG] [LOCAL ] MHF: Loaded 8733 existing records from primary storage. [2025-10-03T20:09:55.934580] [INFO ] [MAIN ] MHF: Loaded 8733 existing records. [2025-10-03T20:09:56.003897] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-03T20:09:56.129826] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:09:56.130231] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-03T20:09:56.130352] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-03T20:09:56.130620] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-03T20:09:56.130719] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-03T20:09:56.256144] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:09:56.532503] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:09:56.706678] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T20:09:56.790683] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-03T20:09:57.556045] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T20:09:57.590623] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-03T20:09:58.167454] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T20:09:58.390694] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-03T20:09:59.190722] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-03T20:09:59.306300] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T20:09:59.931343] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T20:09:59.990730] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-03T20:10:00.790689] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-03T20:10:00.806282] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T20:10:01.590742] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-03T20:10:02.327263] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T20:10:02.369478] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T20:10:02.390686] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-03T20:10:03.190731] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-03T20:10:03.995353] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-03T20:10:03.996294] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T20:10:04.095751] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T20:10:04.790708] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-03T20:10:04.917315] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T20:10:05.535721] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T20:10:05.590702] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-03T20:10:06.304445] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T20:10:06.390692] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-03T20:10:07.190705] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-03T20:10:07.202327] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T20:10:07.994821] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-03T20:10:07.998586] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T20:10:08.744099] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T20:10:08.790689] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-03T20:10:09.527070] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T20:10:09.590688] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-03T20:10:10.331852] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T20:10:10.390691] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-03T20:10:10.987132] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T20:10:10.988110] [INFO ] [REMOTE ] MGRE: Full fetch complete (9429 records). [2025-10-03T20:10:10.988207] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-03T20:10:11.196288] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-03T20:10:11.389329] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-03T20:10:11.389409] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-03T20:10:11.389683] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-03T20:10:11.389747] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-03T20:10:11.390208] [DEBUG] [LOCAL ] MGRE: Trimmed 9429 records to 6744 (keeping 200 days of data) [2025-10-03T20:10:11.433199] [DEBUG] [LOCAL ] MGRE: Primary data saved (6744 records). [2025-10-03T20:10:11.433325] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-03T20:10:11.433498] [INFO ] [MAIN ] Update Progress: 1350/2370 symbols completed. MGRE took 25.7s. Estimated remaining: 2h 23m 39s. Rate: 7.1 symbols/min [2025-10-03T20:10:11.620598] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:11.672282] [DEBUG] [LOCAL ] MHK: Loaded 42458 existing records from primary storage. [2025-10-03T20:10:11.672596] [INFO ] [MAIN ] MHK: Loaded 42458 existing records. [2025-10-03T20:10:11.866940] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:10:11.867099] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-03T20:10:11.867169] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-03T20:10:11.867689] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-03T20:10:11.867751] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-03T20:10:11.995735] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-03T20:10:12.254880] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:12.790690] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-03T20:10:12.923759] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T20:10:13.108830] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T20:10:13.590690] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-03T20:10:13.915155] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:10:14.354169] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T20:10:14.390705] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-03T20:10:15.190695] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-03T20:10:15.990632] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-03T20:10:16.042743] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:10:16.087638] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T20:10:16.790673] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-03T20:10:17.590624] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-03T20:10:17.675421] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T20:10:17.710691] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T20:10:18.390701] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-03T20:10:19.190675] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-03T20:10:19.196042] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T20:10:19.197512] [INFO ] [REMOTE ] MHD: Full fetch complete (18925 records). [2025-10-03T20:10:19.197593] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-03T20:10:19.413962] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T20:10:19.666756] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-03T20:10:19.666889] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-03T20:10:19.667365] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-03T20:10:19.667432] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-03T20:10:19.668356] [DEBUG] [LOCAL ] MHD: Trimmed 18925 records to 12685 (keeping 200 days of data) [2025-10-03T20:10:19.756468] [DEBUG] [LOCAL ] MHD: Primary data saved (12685 records). [2025-10-03T20:10:19.756615] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-03T20:10:19.756763] [INFO ] [MAIN ] Update Progress: 1351/2370 symbols completed. MHD took 28.4s. Estimated remaining: 2h 23m 30s. Rate: 7.1 symbols/min [2025-10-03T20:10:19.947119] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:19.947314] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-03T20:10:19.947354] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-03T20:10:19.947497] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-03T20:10:19.947540] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-03T20:10:19.947584] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-03T20:10:19.947630] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-03T20:10:19.996604] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-03T20:10:20.347093] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:20.681973] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T20:10:20.728878] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T20:10:20.790687] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-03T20:10:21.590737] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-03T20:10:22.398614] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-03T20:10:22.405301] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T20:10:22.449749] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T20:10:22.764183] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-03T20:10:23.190710] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-03T20:10:23.990708] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-03T20:10:24.331336] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T20:10:24.681871] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:10:24.790690] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-03T20:10:25.590712] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-03T20:10:25.935724] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T20:10:26.390735] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-03T20:10:26.436880] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T20:10:27.122498] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T20:10:27.190706] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-03T20:10:27.990731] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-03T20:10:28.781089] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T20:10:28.793354] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-03T20:10:29.131112] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T20:10:29.542961] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T20:10:29.590626] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-03T20:10:30.390721] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-03T20:10:30.812713] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T20:10:31.063474] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:10:31.190699] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-03T20:10:31.990719] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-03T20:10:32.790730] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-03T20:10:32.912548] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T20:10:33.299176] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T20:10:33.551098] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T20:10:33.590715] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-03T20:10:34.125221] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T20:10:34.390745] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-03T20:10:35.190708] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-03T20:10:35.248727] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T20:10:35.990730] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-03T20:10:36.790729] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-03T20:10:36.929914] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T20:10:37.551205] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T20:10:37.552293] [INFO ] [REMOTE ] MHF: Full fetch complete (12606 records). [2025-10-03T20:10:37.552366] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-03T20:10:37.595728] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-03T20:10:37.761251] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:10:38.033529] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-03T20:10:38.033629] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-03T20:10:38.033989] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-03T20:10:38.034103] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-03T20:10:38.034736] [DEBUG] [LOCAL ] MHF: Trimmed 12606 records to 8774 (keeping 200 days of data) [2025-10-03T20:10:38.087519] [DEBUG] [LOCAL ] MHF: Primary data saved (8774 records). [2025-10-03T20:10:38.087693] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-03T20:10:38.087800] [INFO ] [MAIN ] Update Progress: 1352/2370 symbols completed. MHF took 42.4s. Estimated remaining: 2h 23m 29s. Rate: 7.1 symbols/min [2025-10-03T20:10:38.264415] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:38.275333] [DEBUG] [LOCAL ] MHN: Loaded 7634 existing records from primary storage. [2025-10-03T20:10:38.275589] [INFO ] [MAIN ] MHN: Loaded 7634 existing records. [2025-10-03T20:10:38.395877] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-03T20:10:38.475587] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:10:38.475831] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-03T20:10:38.475883] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-03T20:10:38.476113] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-03T20:10:38.476172] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-03T20:10:38.812632] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T20:10:38.899257] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:39.141156] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T20:10:39.143850] [INFO ] [REMOTE ] MGY: Full fetch complete (75699 records). [2025-10-03T20:10:39.143986] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-03T20:10:39.195847] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-03T20:10:39.566303] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-03T20:10:39.566386] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-03T20:10:39.567446] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-03T20:10:39.567513] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-03T20:10:39.569123] [DEBUG] [LOCAL ] MGY: Trimmed 75699 records to 53185 (keeping 200 days of data) [2025-10-03T20:10:39.896717] [DEBUG] [LOCAL ] MGY: Primary data saved (53185 records). [2025-10-03T20:10:39.896864] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-03T20:10:39.897391] [INFO ] [MAIN ] Update Progress: 1353/2370 symbols completed. MGY took 51.9s. Estimated remaining: 2h 23m 16s. Rate: 7.1 symbols/min [2025-10-03T20:10:39.995888] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-03T20:10:40.095826] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:40.122847] [DEBUG] [LOCAL ] MHO: Loaded 24076 existing records from primary storage. [2025-10-03T20:10:40.123116] [INFO ] [MAIN ] MHO: Loaded 24076 existing records. [2025-10-03T20:10:40.305793] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:10:40.306038] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-03T20:10:40.306097] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-03T20:10:40.306343] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-03T20:10:40.306401] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-03T20:10:40.696796] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:40.777832] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T20:10:40.795790] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-03T20:10:40.807756] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T20:10:41.592473] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-03T20:10:41.593609] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T20:10:41.836819] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-03T20:10:42.390697] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-03T20:10:43.190757] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-03T20:10:43.657077] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T20:10:43.963373] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T20:10:43.990624] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-03T20:10:44.790677] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-03T20:10:45.360997] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T20:10:45.590747] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-03T20:10:46.116721] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T20:10:46.118911] [INFO ] [REMOTE ] MHK: Full fetch complete (60815 records). [2025-10-03T20:10:46.119010] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-03T20:10:46.400661] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-03T20:10:46.551056] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-03T20:10:46.551175] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-03T20:10:46.552195] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-03T20:10:46.552362] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-03T20:10:46.554675] [DEBUG] [LOCAL ] MHK: Trimmed 60815 records to 42739 (keeping 200 days of data) [2025-10-03T20:10:46.768968] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T20:10:46.809423] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T20:10:46.861026] [DEBUG] [LOCAL ] MHK: Primary data saved (42739 records). [2025-10-03T20:10:46.861180] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-03T20:10:46.861284] [INFO ] [MAIN ] Update Progress: 1354/2370 symbols completed. MHK took 35.4s. Estimated remaining: 2h 23m 6s. Rate: 7.1 symbols/min [2025-10-03T20:10:47.046265] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:47.046815] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-03T20:10:47.046888] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-03T20:10:47.047054] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-03T20:10:47.047113] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-03T20:10:47.047162] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-03T20:10:47.047198] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-03T20:10:47.203087] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-03T20:10:47.467330] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:47.625012] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T20:10:47.990685] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-03T20:10:48.332566] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-03T20:10:48.333268] [INFO ] [REMOTE ] MHLA: Full fetch complete (1528 records). [2025-10-03T20:10:48.333400] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-03T20:10:48.544478] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-03T20:10:48.544899] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:10:48.545010] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:10:48.545109] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-03T20:10:48.545215] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-03T20:10:48.545291] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-03T20:10:48.545402] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-03T20:10:48.545533] [INFO ] [MAIN ] Update Progress: 1355/2370 symbols completed. MHLA took 28.8s. Estimated remaining: 2h 22m 52s. Rate: 7.1 symbols/min [2025-10-03T20:10:48.727401] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:48.745382] [DEBUG] [LOCAL ] MIN: Loaded 13399 existing records from primary storage. [2025-10-03T20:10:48.745627] [INFO ] [MAIN ] MIN: Loaded 13399 existing records. [2025-10-03T20:10:48.795858] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-03T20:10:48.945010] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:10:48.945315] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-03T20:10:48.945377] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-03T20:10:48.945732] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-03T20:10:48.945791] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-03T20:10:49.327879] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:49.590740] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-03T20:10:50.166587] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T20:10:50.312753] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T20:10:50.390696] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-03T20:10:50.909397] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T20:10:51.190628] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-03T20:10:51.914539] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T20:10:51.990726] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-03T20:10:52.790672] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-03T20:10:53.006433] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:10:53.006863] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-03T20:10:53.007000] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:10:53.007075] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-03T20:10:53.007189] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:10:53.007275] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-03T20:10:53.007395] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-03T20:10:53.007451] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-03T20:10:53.007504] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-03T20:10:53.007602] [INFO ] [MAIN ] Update Progress: 1356/2370 symbols completed. MIAX took 6.1s. Estimated remaining: 2h 22m 41s. Rate: 7.1 symbols/min [2025-10-03T20:10:53.215689] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:10:53.232633] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T20:10:53.292006] [DEBUG] [LOCAL ] MIR: Loaded 51410 existing records from primary storage. [2025-10-03T20:10:53.292458] [INFO ] [MAIN ] MIR: Loaded 51410 existing records. [2025-10-03T20:10:53.521860] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:10:53.522151] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-03T20:10:53.522202] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-03T20:10:53.522599] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-03T20:10:53.522698] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-03T20:10:53.597522] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-03T20:10:54.052458] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:10:54.116519] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T20:10:54.390875] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-03T20:10:55.190736] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-03T20:10:55.368128] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T20:10:55.990741] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-03T20:10:56.266462] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:10:56.722523] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T20:10:56.790705] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-03T20:10:57.490320] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T20:10:57.590747] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-03T20:10:58.390712] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-03T20:10:59.191078] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-03T20:10:59.214980] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T20:10:59.434764] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T20:10:59.967636] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T20:10:59.990633] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-03T20:11:00.777038] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T20:11:00.790665] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-03T20:11:01.590701] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-03T20:11:01.636685] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:11:02.391571] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-03T20:11:02.392834] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T20:11:03.190705] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-03T20:11:03.656049] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T20:11:03.674906] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T20:11:03.990693] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-03T20:11:04.790669] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-03T20:11:04.836525] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T20:11:05.590737] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-03T20:11:06.390740] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-03T20:11:06.434862] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T20:11:06.793987] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T20:11:07.092838] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T20:11:07.094541] [INFO ] [REMOTE ] MHN: Full fetch complete (11805 records). [2025-10-03T20:11:07.094627] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-03T20:11:07.195807] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-03T20:11:07.505504] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-03T20:11:07.505599] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-03T20:11:07.505891] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-03T20:11:07.505954] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-03T20:11:07.506496] [DEBUG] [LOCAL ] MHN: Trimmed 11805 records to 7680 (keeping 200 days of data) [2025-10-03T20:11:07.557382] [DEBUG] [LOCAL ] MHN: Primary data saved (7680 records). [2025-10-03T20:11:07.557533] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-03T20:11:07.557717] [INFO ] [MAIN ] Update Progress: 1357/2370 symbols completed. MHN took 29.5s. Estimated remaining: 2h 22m 37s. Rate: 7.1 symbols/min [2025-10-03T20:11:07.990698] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-03T20:11:08.397165] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T20:11:08.790715] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-03T20:11:09.097474] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T20:11:09.590711] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-03T20:11:10.390731] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-03T20:11:10.433491] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T20:11:10.612475] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T20:11:10.614226] [INFO ] [REMOTE ] MHO: Full fetch complete (37074 records). [2025-10-03T20:11:10.614339] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-03T20:11:11.038917] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-03T20:11:11.039006] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-03T20:11:11.039899] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-03T20:11:11.039967] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-03T20:11:11.041075] [DEBUG] [LOCAL ] MHO: Trimmed 37074 records to 24193 (keeping 200 days of data) [2025-10-03T20:11:11.190794] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-03T20:11:11.196846] [DEBUG] [LOCAL ] MHO: Primary data saved (24193 records). [2025-10-03T20:11:11.197116] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-03T20:11:11.197260] [INFO ] [MAIN ] Update Progress: 1358/2370 symbols completed. MHO took 31.3s. Estimated remaining: 2h 22m 25s. Rate: 7.1 symbols/min [2025-10-03T20:11:11.362402] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T20:11:11.990698] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-03T20:11:12.794406] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T20:11:12.806247] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-03T20:11:12.985237] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T20:11:13.590678] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-03T20:11:14.343133] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T20:11:14.401429] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-03T20:11:14.406966] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T20:11:15.190682] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-03T20:11:15.224773] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T20:11:15.226281] [INFO ] [REMOTE ] MIN: Full fetch complete (17863 records). [2025-10-03T20:11:15.226357] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-03T20:11:15.619892] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-03T20:11:15.619981] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-03T20:11:15.620448] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-03T20:11:15.620511] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-03T20:11:15.621118] [DEBUG] [LOCAL ] MIN: Trimmed 17863 records to 13511 (keeping 200 days of data) [2025-10-03T20:11:15.713597] [DEBUG] [LOCAL ] MIN: Primary data saved (13511 records). [2025-10-03T20:11:15.713771] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-03T20:11:15.713943] [INFO ] [MAIN ] Update Progress: 1359/2370 symbols completed. MIN took 27.2s. Estimated remaining: 2h 22m 14s. Rate: 7.1 symbols/min [2025-10-03T20:11:16.880920] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T20:11:16.892957] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-03T20:11:18.603365] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T20:11:18.621791] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-03T20:11:20.388274] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T20:11:20.400535] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-03T20:11:21.992029] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T20:11:22.003720] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-03T20:11:23.842354] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T20:11:23.854889] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-03T20:11:25.437475] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T20:11:25.440363] [INFO ] [REMOTE ] MIR: Full fetch complete (73502 records). [2025-10-03T20:11:25.440521] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-03T20:11:25.863109] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-03T20:11:25.863204] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-03T20:11:25.864316] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-03T20:11:25.864386] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-03T20:11:25.865903] [DEBUG] [LOCAL ] MIR: Trimmed 73502 records to 51798 (keeping 200 days of data) [2025-10-03T20:11:26.183883] [DEBUG] [LOCAL ] MIR: Primary data saved (51798 records). [2025-10-03T20:11:26.184066] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-03T20:11:26.184184] [INFO ] [MAIN ] Update Progress: 1360/2370 symbols completed. MIR took 33.2s. Estimated remaining: 2h 22m 7s. Rate: 7.1 symbols/min [2025-10-03T20:11:26.853966] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:26.869915] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:26.912177] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:26.912287] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-03T20:11:26.943908] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-03T20:11:26.972182] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-03T20:11:26.978260] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:26.978607] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-03T20:11:26.979069] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-03T20:11:26.979248] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-03T20:11:27.085753] [DEBUG] [LOCAL ] MITP: Loaded 2411 existing records from primary storage. [2025-10-03T20:11:27.083808] [DEBUG] [LOCAL ] MIY: Loaded 6023 existing records from primary storage. [2025-10-03T20:11:27.097088] [INFO ] [MAIN ] MIY: Loaded 6023 existing records. [2025-10-03T20:11:27.096893] [INFO ] [MAIN ] MITP: Loaded 2411 existing records. [2025-10-03T20:11:27.190226] [DEBUG] [LOCAL ] MITT: Loaded 23090 existing records from primary storage. [2025-10-03T20:11:27.318995] [INFO ] [MAIN ] MITT: Loaded 23090 existing records. [2025-10-03T20:11:27.865587] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:27.911178] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:27.948122] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-03T20:11:28.010224] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-03T20:11:28.010396] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-03T20:11:28.010724] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-03T20:11:28.015542] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:28.021070] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-03T20:11:28.029034] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-03T20:11:28.071013] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:28.046794] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-03T20:11:28.046721] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-03T20:11:28.076700] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-03T20:11:28.094114] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-03T20:11:28.132148] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-03T20:11:28.196830] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-03T20:11:28.212433] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-03T20:11:28.475154] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T20:11:28.578452] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-03T20:11:29.212447] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:29.233497] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-03T20:11:29.283289] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T20:11:29.328127] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-03T20:11:29.333995] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:29.339620] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:29.340067] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-03T20:11:29.340366] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-03T20:11:29.774116] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T20:11:29.775551] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-03T20:11:29.850711] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T20:11:29.852300] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-03T20:11:30.006115] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T20:11:30.009203] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-03T20:11:30.278257] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T20:11:30.280198] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-03T20:11:30.339935] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T20:11:30.341545] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-03T20:11:30.511248] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T20:11:30.513241] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-03T20:11:30.563720] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-03T20:11:30.565438] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-03T20:11:30.587077] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T20:11:30.594557] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-03T20:11:30.666671] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-03T20:11:30.959183] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-03T20:11:31.036067] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T20:11:31.190720] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-03T20:11:31.448070] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-03T20:11:31.760915] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T20:11:31.990714] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-03T20:11:32.577962] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T20:11:32.790730] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-03T20:11:33.568942] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T20:11:33.590635] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-03T20:11:34.037898] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T20:11:34.390737] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-03T20:11:35.190683] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-03T20:11:35.328205] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T20:11:35.737467] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T20:11:35.990733] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-03T20:11:36.704106] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-03T20:11:36.790716] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-03T20:11:37.535153] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T20:11:37.590701] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-03T20:11:38.196185] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T20:11:38.390733] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-03T20:11:38.717238] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-03T20:11:39.190727] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-03T20:11:39.527586] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T20:11:39.990705] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-03T20:11:40.790712] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-03T20:11:41.137945] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T20:11:41.208536] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T20:11:41.590679] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-03T20:11:42.147286] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T20:11:42.390692] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-03T20:11:43.054462] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T20:11:43.190758] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-03T20:11:43.521623] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T20:11:43.990747] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-03T20:11:44.630072] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T20:11:44.631054] [INFO ] [REMOTE ] MIY: Full fetch complete (8983 records). [2025-10-03T20:11:44.631128] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-03T20:11:44.796312] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-03T20:11:45.065858] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-03T20:11:45.065938] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-03T20:11:45.066157] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-03T20:11:45.066198] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-03T20:11:45.066617] [DEBUG] [LOCAL ] MIY: Trimmed 8983 records to 6099 (keeping 200 days of data) [2025-10-03T20:11:45.105483] [DEBUG] [LOCAL ] MIY: Primary data saved (6099 records). [2025-10-03T20:11:45.105684] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-03T20:11:45.105790] [INFO ] [MAIN ] Update Progress: 1361/2370 symbols completed. MIY took 18.9s. Estimated remaining: 2h 22m 6s. Rate: 7.1 symbols/min [2025-10-03T20:11:45.290925] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:45.343364] [DEBUG] [LOCAL ] MKC: Loaded 52828 existing records from primary storage. [2025-10-03T20:11:45.343715] [INFO ] [MAIN ] MKC: Loaded 52828 existing records. [2025-10-03T20:11:45.545499] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:45.545804] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-03T20:11:45.545859] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-03T20:11:45.546322] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-03T20:11:45.546382] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-03T20:11:45.595736] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-03T20:11:45.936750] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:46.085473] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-03T20:11:46.258124] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T20:11:46.390775] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-03T20:11:46.866035] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T20:11:46.867165] [INFO ] [REMOTE ] MITN: Full fetch complete (2333 records). [2025-10-03T20:11:46.867265] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-03T20:11:47.141065] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T20:11:47.141320] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:11:47.141428] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:11:47.141525] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-03T20:11:47.141627] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-03T20:11:47.141724] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-03T20:11:47.141797] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-03T20:11:47.141903] [INFO ] [MAIN ] Update Progress: 1362/2370 symbols completed. MITN took 21.0s. Estimated remaining: 2h 21m 53s. Rate: 7.1 symbols/min [2025-10-03T20:11:47.198679] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-03T20:11:47.395156] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:47.448892] [DEBUG] [LOCAL ] MKL: Loaded 34273 existing records from primary storage. [2025-10-03T20:11:47.449253] [INFO ] [MAIN ] MKL: Loaded 34273 existing records. [2025-10-03T20:11:47.642302] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:47.642588] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-03T20:11:47.642685] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-03T20:11:47.643077] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-03T20:11:47.643137] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-03T20:11:47.995777] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-03T20:11:48.034458] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:48.512433] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T20:11:48.790688] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-03T20:11:49.020979] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T20:11:49.590712] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-03T20:11:49.893167] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T20:11:50.390695] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-03T20:11:50.964090] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-03T20:11:50.987387] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T20:11:51.190692] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-03T20:11:51.990765] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-03T20:11:52.407948] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T20:11:52.757897] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T20:11:52.790634] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-03T20:11:53.209504] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T20:11:53.210319] [INFO ] [REMOTE ] MITP: Full fetch complete (3338 records). [2025-10-03T20:11:53.210409] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-03T20:11:53.600758] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-03T20:11:53.612195] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-03T20:11:53.612320] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-03T20:11:53.612467] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-03T20:11:53.612515] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-03T20:11:53.612984] [DEBUG] [LOCAL ] MITP: Trimmed 3338 records to 2419 (keeping 200 days of data) [2025-10-03T20:11:53.629588] [DEBUG] [LOCAL ] MITP: Primary data saved (2419 records). [2025-10-03T20:11:53.629751] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-03T20:11:53.629900] [INFO ] [MAIN ] Update Progress: 1363/2370 symbols completed. MITP took 27.4s. Estimated remaining: 2h 21m 43s. Rate: 7.1 symbols/min [2025-10-03T20:11:53.813289] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:11:53.878947] [DEBUG] [LOCAL ] MLI: Loaded 43830 existing records from primary storage. [2025-10-03T20:11:53.879315] [INFO ] [MAIN ] MLI: Loaded 43830 existing records. [2025-10-03T20:11:54.089330] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:11:54.089695] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-03T20:11:54.089771] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-03T20:11:54.090182] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-03T20:11:54.090242] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-03T20:11:54.399681] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-03T20:11:54.529214] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:11:55.051346] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T20:11:55.190699] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-03T20:11:55.541105] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T20:11:55.990697] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-03T20:11:56.624596] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T20:11:56.790732] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-03T20:11:57.229381] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T20:11:57.590691] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-03T20:11:58.257581] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T20:11:58.390731] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-03T20:11:59.126836] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T20:11:59.190710] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-03T20:11:59.844935] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T20:11:59.990725] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-03T20:12:00.280243] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T20:12:00.790672] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-03T20:12:01.318559] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T20:12:01.590753] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-03T20:12:02.390621] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-03T20:12:02.678167] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T20:12:03.190633] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-03T20:12:03.323298] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T20:12:03.520943] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:12:03.990714] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-03T20:12:04.454250] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T20:12:04.790688] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-03T20:12:05.590696] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-03T20:12:05.738022] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:12:06.350750] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T20:12:06.390706] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-03T20:12:06.442253] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T20:12:06.443803] [INFO ] [REMOTE ] MITT: Full fetch complete (34695 records). [2025-10-03T20:12:06.443946] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-03T20:12:06.851074] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-03T20:12:06.851158] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-03T20:12:06.851982] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-03T20:12:06.852057] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-03T20:12:06.853070] [DEBUG] [LOCAL ] MITT: Trimmed 34695 records to 23184 (keeping 200 days of data) [2025-10-03T20:12:07.014949] [DEBUG] [LOCAL ] MITT: Primary data saved (23184 records). [2025-10-03T20:12:07.015134] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-03T20:12:07.015299] [INFO ] [MAIN ] Update Progress: 1364/2370 symbols completed. MITT took 40.8s. Estimated remaining: 2h 21m 38s. Rate: 7.1 symbols/min [2025-10-03T20:12:07.190715] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-03T20:12:07.218517] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:07.260950] [DEBUG] [LOCAL ] MLM: Loaded 30160 existing records from primary storage. [2025-10-03T20:12:07.261247] [INFO ] [MAIN ] MLM: Loaded 30160 existing records. [2025-10-03T20:12:07.458961] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:07.459221] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-03T20:12:07.459294] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-03T20:12:07.459575] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-03T20:12:07.459672] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-03T20:12:07.854806] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:07.879806] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:12:07.990693] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-03T20:12:08.790683] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-03T20:12:08.945675] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T20:12:09.005238] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T20:12:09.590695] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-03T20:12:10.390694] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-03T20:12:10.496100] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T20:12:11.030709] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T20:12:11.190682] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-03T20:12:11.459036] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T20:12:11.990726] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-03T20:12:12.790724] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-03T20:12:13.032735] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T20:12:13.333987] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T20:12:13.590688] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-03T20:12:14.130578] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T20:12:14.390701] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-03T20:12:15.190699] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-03T20:12:15.270117] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:12:15.990736] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-03T20:12:16.043389] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T20:12:16.788737] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T20:12:16.791677] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-03T20:12:17.326070] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T20:12:17.590754] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-03T20:12:18.289031] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T20:12:18.390698] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-03T20:12:19.116601] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T20:12:19.190724] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-03T20:12:19.612982] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T20:12:19.615050] [INFO ] [REMOTE ] MKL: Full fetch complete (49660 records). [2025-10-03T20:12:19.615159] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-03T20:12:19.995899] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-03T20:12:20.053875] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-03T20:12:20.053962] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-03T20:12:20.054972] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-03T20:12:20.055043] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-03T20:12:20.056358] [DEBUG] [LOCAL ] MKL: Trimmed 49660 records to 34507 (keeping 200 days of data) [2025-10-03T20:12:20.286238] [DEBUG] [LOCAL ] MKL: Primary data saved (34507 records). [2025-10-03T20:12:20.286384] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-03T20:12:20.286499] [INFO ] [MAIN ] Update Progress: 1365/2370 symbols completed. MKL took 33.1s. Estimated remaining: 2h 21m 33s. Rate: 7.1 symbols/min [2025-10-03T20:12:20.476776] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:20.504487] [DEBUG] [LOCAL ] MLNK: Loaded 25666 existing records from primary storage. [2025-10-03T20:12:20.504844] [INFO ] [MAIN ] MLNK: Loaded 25666 existing records. [2025-10-03T20:12:20.702808] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:20.703206] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-03T20:12:20.703395] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-03T20:12:20.703971] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-03T20:12:20.704035] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-03T20:12:20.795180] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-03T20:12:21.150720] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T20:12:21.157303] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:21.590696] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-03T20:12:21.733898] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T20:12:22.390692] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-03T20:12:22.545531] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T20:12:22.662115] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T20:12:23.190693] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-03T20:12:23.991544] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-03T20:12:23.994474] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T20:12:24.722461] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T20:12:24.728121] [INFO ] [REMOTE ] MKC: Full fetch complete (75592 records). [2025-10-03T20:12:24.728278] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-03T20:12:24.795734] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-03T20:12:25.069231] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T20:12:25.172074] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-03T20:12:25.172153] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-03T20:12:25.173323] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-03T20:12:25.173389] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-03T20:12:25.174870] [DEBUG] [LOCAL ] MKC: Trimmed 75592 records to 53215 (keeping 200 days of data) [2025-10-03T20:12:25.520086] [DEBUG] [LOCAL ] MKC: Primary data saved (53215 records). [2025-10-03T20:12:25.520240] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-03T20:12:25.520416] [INFO ] [MAIN ] Update Progress: 1366/2370 symbols completed. MKC took 40.4s. Estimated remaining: 2h 21m 23s. Rate: 7.1 symbols/min [2025-10-03T20:12:25.595747] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-03T20:12:25.703738] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:25.709012] [DEBUG] [LOCAL ] MLP: Loaded 3007 existing records from primary storage. [2025-10-03T20:12:25.709162] [INFO ] [MAIN ] MLP: Loaded 3007 existing records. [2025-10-03T20:12:25.896170] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:25.896403] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-03T20:12:25.896451] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-03T20:12:25.896688] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-03T20:12:25.896748] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-03T20:12:26.280564] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:26.390711] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-03T20:12:26.476420] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T20:12:26.968508] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T20:12:27.103309] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T20:12:27.190697] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-03T20:12:27.990702] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-03T20:12:28.378633] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T20:12:28.790630] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-03T20:12:29.018754] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T20:12:29.590720] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-03T20:12:30.390719] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-03T20:12:30.481475] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T20:12:30.706117] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:12:31.190708] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-03T20:12:31.410303] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T20:12:31.990666] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-03T20:12:32.364723] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T20:12:32.790672] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-03T20:12:33.252822] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T20:12:33.255211] [INFO ] [REMOTE ] MLI: Full fetch complete (63329 records). [2025-10-03T20:12:33.255354] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-03T20:12:33.593121] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-03T20:12:33.702452] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-03T20:12:33.702564] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-03T20:12:33.703739] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-03T20:12:33.703817] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-03T20:12:33.706082] [DEBUG] [LOCAL ] MLI: Trimmed 63329 records to 44149 (keeping 200 days of data) [2025-10-03T20:12:33.960635] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T20:12:34.027035] [DEBUG] [LOCAL ] MLI: Primary data saved (44149 records). [2025-10-03T20:12:34.027184] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-03T20:12:34.028604] [INFO ] [MAIN ] Update Progress: 1367/2370 symbols completed. MLI took 40.4s. Estimated remaining: 2h 21m 14s. Rate: 7.1 symbols/min [2025-10-03T20:12:34.206995] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:34.223385] [DEBUG] [LOCAL ] MLR: Loaded 12560 existing records from primary storage. [2025-10-03T20:12:34.223639] [INFO ] [MAIN ] MLR: Loaded 12560 existing records. [2025-10-03T20:12:34.330488] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T20:12:34.398887] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-03T20:12:34.432565] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:34.433538] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-03T20:12:34.433594] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-03T20:12:34.433834] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-03T20:12:34.433896] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-03T20:12:34.822545] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:35.190737] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-03T20:12:35.668863] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T20:12:35.990681] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-03T20:12:36.448372] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T20:12:36.748725] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T20:12:36.790676] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-03T20:12:37.559500] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T20:12:37.590665] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-03T20:12:38.390700] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-03T20:12:38.429906] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T20:12:39.190734] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-03T20:12:39.555161] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T20:12:39.649754] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T20:12:39.990669] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-03T20:12:40.474937] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T20:12:40.790698] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-03T20:12:41.352136] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T20:12:41.590688] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-03T20:12:42.180848] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T20:12:42.390709] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-03T20:12:43.190699] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-03T20:12:43.496523] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T20:12:43.803632] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T20:12:43.990684] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-03T20:12:44.790684] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-03T20:12:45.254402] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T20:12:45.328349] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T20:12:45.590675] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-03T20:12:46.390684] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-03T20:12:46.750765] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T20:12:46.949871] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T20:12:47.190705] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-03T20:12:47.990734] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-03T20:12:48.428854] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T20:12:48.578463] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T20:12:48.790699] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-03T20:12:49.590699] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-03T20:12:49.735204] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T20:12:49.736965] [INFO ] [REMOTE ] MLNK: Full fetch complete (36151 records). [2025-10-03T20:12:49.737054] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-03T20:12:50.168584] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-03T20:12:50.168831] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-03T20:12:50.169569] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-03T20:12:50.169613] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-03T20:12:50.170586] [DEBUG] [LOCAL ] MLNK: Trimmed 36151 records to 25866 (keeping 200 days of data) [2025-10-03T20:12:50.327629] [DEBUG] [LOCAL ] MLNK: Primary data saved (25866 records). [2025-10-03T20:12:50.327815] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-03T20:12:50.328050] [INFO ] [MAIN ] Update Progress: 1368/2370 symbols completed. MLNK took 30.0s. Estimated remaining: 2h 21m 11s. Rate: 7.1 symbols/min [2025-10-03T20:12:50.402459] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-03T20:12:50.527802] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:50.581546] [DEBUG] [LOCAL ] MMC: Loaded 52173 existing records from primary storage. [2025-10-03T20:12:50.581938] [INFO ] [MAIN ] MMC: Loaded 52173 existing records. [2025-10-03T20:12:50.782418] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:50.782630] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-03T20:12:50.782712] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-03T20:12:50.782994] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-03T20:12:50.783064] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-03T20:12:50.902559] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T20:12:50.926443] [INFO ] [REMOTE ] MLM: Full fetch complete (45552 records). [2025-10-03T20:12:50.962359] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-03T20:12:50.962278] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T20:12:51.021124] [INFO ] [REMOTE ] MLP: Full fetch complete (4564 records). [2025-10-03T20:12:51.100190] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-03T20:12:51.212667] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-03T20:12:51.445559] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:52.026115] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-03T20:12:52.077203] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-03T20:12:52.077323] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-03T20:12:52.077557] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-03T20:12:52.081535] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-03T20:12:52.081712] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-03T20:12:52.081790] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-03T20:12:52.083018] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-03T20:12:52.083974] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-03T20:12:52.084879] [DEBUG] [LOCAL ] MLP: Trimmed 4564 records to 3014 (keeping 200 days of data) [2025-10-03T20:12:52.101770] [DEBUG] [LOCAL ] MLM: Trimmed 45552 records to 30361 (keeping 200 days of data) [2025-10-03T20:12:52.118130] [DEBUG] [LOCAL ] MLP: Primary data saved (3014 records). [2025-10-03T20:12:52.118222] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-03T20:12:52.118329] [INFO ] [MAIN ] Update Progress: 1369/2370 symbols completed. MLP took 26.6s. Estimated remaining: 2h 20m 58s. Rate: 7.1 symbols/min [2025-10-03T20:12:52.429689] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T20:12:52.429086] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:52.453095] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-10-03T20:12:52.453869] [INFO ] [MAIN ] MMD: Loaded 11435 existing records. [2025-10-03T20:12:52.656556] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:52.661297] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-03T20:12:52.661892] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-03T20:12:52.663269] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-03T20:12:52.663559] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-03T20:12:52.821405] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-03T20:12:53.120287] [DEBUG] [LOCAL ] MLM: Primary data saved (30361 records). [2025-10-03T20:12:53.136546] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-03T20:12:53.142371] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:53.142573] [INFO ] [MAIN ] Update Progress: 1370/2370 symbols completed. MLM took 46.1s. Estimated remaining: 2h 20m 44s. Rate: 7.1 symbols/min [2025-10-03T20:12:53.322789] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:12:53.343091] [DEBUG] [LOCAL ] MMI: Loaded 15236 existing records from primary storage. [2025-10-03T20:12:53.343384] [INFO ] [MAIN ] MMI: Loaded 15236 existing records. [2025-10-03T20:12:53.544309] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:12:53.544719] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-03T20:12:53.544832] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-03T20:12:53.545029] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-03T20:12:53.545087] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-03T20:12:53.591161] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-03T20:12:53.814076] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T20:12:53.964677] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:12:54.000469] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T20:12:54.390696] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-03T20:12:54.708139] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:12:55.187125] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T20:12:55.190621] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-03T20:12:55.990675] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-03T20:12:56.053111] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T20:12:56.790689] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-03T20:12:56.827709] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T20:12:57.590714] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-03T20:12:58.390725] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-03T20:12:58.620027] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T20:12:58.653801] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T20:12:59.190638] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-03T20:12:59.329969] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T20:12:59.990692] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-03T20:13:00.035966] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T20:13:00.790677] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-03T20:13:00.860799] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T20:13:01.590710] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-03T20:13:01.809724] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T20:13:02.390715] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-03T20:13:02.508462] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:13:03.190684] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-03T20:13:03.284241] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T20:13:03.990714] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-03T20:13:04.033447] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T20:13:04.034876] [INFO ] [REMOTE ] MLR: Full fetch complete (18676 records). [2025-10-03T20:13:04.034973] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-03T20:13:04.443073] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-03T20:13:04.443171] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-03T20:13:04.443626] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-03T20:13:04.443714] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-03T20:13:04.444570] [DEBUG] [LOCAL ] MLR: Trimmed 18676 records to 12615 (keeping 200 days of data) [2025-10-03T20:13:04.527291] [DEBUG] [LOCAL ] MLR: Primary data saved (12615 records). [2025-10-03T20:13:04.527442] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-03T20:13:04.527542] [INFO ] [MAIN ] Update Progress: 1371/2370 symbols completed. MLR took 30.5s. Estimated remaining: 2h 20m 38s. Rate: 7.1 symbols/min [2025-10-03T20:13:04.706781] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:04.707005] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-03T20:13:04.707063] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-03T20:13:04.707212] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-03T20:13:04.707285] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-03T20:13:04.707345] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-03T20:13:04.707383] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-03T20:13:04.795791] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-03T20:13:05.094246] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:05.590690] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-03T20:13:05.675218] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T20:13:05.856201] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T20:13:06.189843] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T20:13:06.390691] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-03T20:13:07.148095] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T20:13:07.190689] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-03T20:13:07.990680] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-03T20:13:08.308625] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T20:13:08.460075] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T20:13:08.790684] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-03T20:13:09.590699] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-03T20:13:09.616246] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T20:13:09.798428] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:13:09.798810] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-03T20:13:09.799007] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:13:09.799099] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-03T20:13:09.799180] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:13:09.799262] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-03T20:13:09.799349] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-03T20:13:09.799389] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-03T20:13:09.799429] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-03T20:13:09.799494] [INFO ] [MAIN ] Update Progress: 1372/2370 symbols completed. MMID took 5.3s. Estimated remaining: 2h 20m 27s. Rate: 7.1 symbols/min [2025-10-03T20:13:09.989764] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:09.989968] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-03T20:13:09.990025] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-03T20:13:09.990259] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-03T20:13:09.990341] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-03T20:13:09.990404] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-03T20:13:09.990441] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-03T20:13:10.363066] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:10.390629] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-03T20:13:10.846474] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T20:13:11.190691] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-03T20:13:11.990672] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-03T20:13:12.179903] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T20:13:12.425053] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T20:13:12.790674] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-03T20:13:13.590690] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-03T20:13:14.013727] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T20:13:14.390735] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-03T20:13:14.713396] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T20:13:15.190672] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-03T20:13:15.361850] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T20:13:15.990693] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-03T20:13:16.356525] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-03T20:13:16.790634] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-03T20:13:17.115010] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T20:13:17.214104] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T20:13:17.590708] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-03T20:13:18.390700] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-03T20:13:19.149270] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T20:13:19.190622] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-03T20:13:19.292704] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T20:13:19.871717] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T20:13:19.990722] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-03T20:13:20.349218] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-03T20:13:20.790675] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-03T20:13:21.138841] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T20:13:21.590714] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-03T20:13:22.392022] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-03T20:13:22.395639] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T20:13:23.190721] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-03T20:13:23.244545] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:13:23.539570] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-03T20:13:23.990688] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-03T20:13:24.781765] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T20:13:24.790605] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-03T20:13:25.460428] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T20:13:25.461417] [INFO ] [REMOTE ] MMD: Full fetch complete (17842 records). [2025-10-03T20:13:25.461494] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-03T20:13:25.595802] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-03T20:13:25.881712] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-03T20:13:25.881810] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-03T20:13:25.882349] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-03T20:13:25.882415] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-03T20:13:25.883233] [DEBUG] [LOCAL ] MMD: Trimmed 17842 records to 11497 (keeping 200 days of data) [2025-10-03T20:13:25.958044] [DEBUG] [LOCAL ] MMD: Primary data saved (11497 records). [2025-10-03T20:13:25.958913] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-03T20:13:25.959062] [INFO ] [MAIN ] Update Progress: 1373/2370 symbols completed. MMD took 33.8s. Estimated remaining: 2h 20m 24s. Rate: 7.1 symbols/min [2025-10-03T20:13:26.140811] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T20:13:26.160549] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:26.218419] [DEBUG] [LOCAL ] MMM: Loaded 53550 existing records from primary storage. [2025-10-03T20:13:26.218842] [INFO ] [MAIN ] MMM: Loaded 53550 existing records. [2025-10-03T20:13:26.390689] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-03T20:13:26.413194] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:13:26.414348] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-03T20:13:26.414411] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-03T20:13:26.414962] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-03T20:13:26.415023] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-03T20:13:26.818104] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:27.190676] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-03T20:13:27.300098] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T20:13:27.302062] [INFO ] [REMOTE ] MMI: Full fetch complete (21245 records). [2025-10-03T20:13:27.302184] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-03T20:13:27.695289] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-03T20:13:27.695420] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-03T20:13:27.695983] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-03T20:13:27.696047] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-03T20:13:27.696885] [DEBUG] [LOCAL ] MMI: Trimmed 21245 records to 15364 (keeping 200 days of data) [2025-10-03T20:13:27.793774] [DEBUG] [LOCAL ] MMI: Primary data saved (15364 records). [2025-10-03T20:13:27.793920] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-03T20:13:27.794023] [INFO ] [MAIN ] Update Progress: 1374/2370 symbols completed. MMI took 34.7s. Estimated remaining: 2h 20m 11s. Rate: 7.1 symbols/min [2025-10-03T20:13:27.978768] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:27.998798] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-03T20:13:28.014688] [DEBUG] [LOCAL ] MMS: Loaded 34135 existing records from primary storage. [2025-10-03T20:13:28.014979] [INFO ] [MAIN ] MMS: Loaded 34135 existing records. [2025-10-03T20:13:28.203948] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:13:28.204276] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-03T20:13:28.204329] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-03T20:13:28.204739] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-03T20:13:28.204800] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-03T20:13:28.586725] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:28.790697] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-03T20:13:29.108389] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T20:13:29.180546] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-03T20:13:29.590631] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-03T20:13:29.779306] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T20:13:30.390724] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-03T20:13:31.075630] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T20:13:31.076424] [INFO ] [REMOTE ] MMKT: Full fetch complete (2110 records). [2025-10-03T20:13:31.076499] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-03T20:13:31.190937] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-03T20:13:31.288510] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T20:13:31.288813] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:13:31.289055] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:13:31.289151] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-03T20:13:31.289343] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-03T20:13:31.289445] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-03T20:13:31.289623] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-03T20:13:31.289809] [INFO ] [MAIN ] Update Progress: 1375/2370 symbols completed. MMKT took 21.5s. Estimated remaining: 2h 19m 59s. Rate: 7.1 symbols/min [2025-10-03T20:13:31.474859] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:31.506348] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T20:13:31.526846] [DEBUG] [LOCAL ] MMT: Loaded 10865 existing records from primary storage. [2025-10-03T20:13:31.527110] [INFO ] [MAIN ] MMT: Loaded 10865 existing records. [2025-10-03T20:13:31.712970] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:13:31.713247] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-03T20:13:31.713298] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-03T20:13:31.713471] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-03T20:13:31.713528] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-03T20:13:31.995834] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-03T20:13:32.087257] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:32.790680] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-03T20:13:32.950586] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T20:13:33.590701] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-03T20:13:33.622830] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T20:13:34.326380] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T20:13:34.390702] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-03T20:13:34.490359] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T20:13:35.190699] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-03T20:13:35.987066] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T20:13:35.990603] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-03T20:13:36.349345] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T20:13:36.768575] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T20:13:36.790677] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-03T20:13:37.590723] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-03T20:13:38.390718] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-03T20:13:38.528733] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T20:13:38.721286] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T20:13:39.190703] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-03T20:13:39.473270] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T20:13:39.993721] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-03T20:13:39.997264] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T20:13:40.790694] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-03T20:13:41.590714] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-03T20:13:42.288230] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-03T20:13:42.390694] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-03T20:13:42.764782] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:13:42.931814] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T20:13:43.030465] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T20:13:43.190714] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-03T20:13:43.990696] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-03T20:13:44.498544] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T20:13:44.790695] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-03T20:13:45.590920] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-03T20:13:45.938827] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T20:13:46.327184] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T20:13:46.390633] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-03T20:13:47.190689] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-03T20:13:47.369834] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:13:47.990720] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-03T20:13:48.498985] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T20:13:48.522963] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T20:13:48.698690] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-03T20:13:48.790697] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-03T20:13:49.590737] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-03T20:13:50.390720] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-03T20:13:50.627968] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T20:13:50.657030] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T20:13:51.190684] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-03T20:13:51.355501] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T20:13:51.990696] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-03T20:13:52.790743] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-03T20:13:53.182219] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T20:13:53.590720] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-03T20:13:53.615471] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T20:13:53.620920] [INFO ] [REMOTE ] MMC: Full fetch complete (74752 records). [2025-10-03T20:13:53.621106] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-03T20:13:54.070615] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-03T20:13:54.070814] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-03T20:13:54.072359] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-03T20:13:54.072506] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-03T20:13:54.075064] [DEBUG] [LOCAL ] MMC: Trimmed 74752 records to 52557 (keeping 200 days of data) [2025-10-03T20:13:54.183225] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T20:13:54.217026] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T20:13:54.390851] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-03T20:13:54.538157] [DEBUG] [LOCAL ] MMC: Primary data saved (52557 records). [2025-10-03T20:13:54.538338] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-03T20:13:54.538518] [INFO ] [MAIN ] Update Progress: 1376/2370 symbols completed. MMC took 1m 4s. Estimated remaining: 2h 20m 1s. Rate: 7.1 symbols/min [2025-10-03T20:13:54.726430] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:54.744294] [DEBUG] [LOCAL ] MMU: Loaded 16945 existing records from primary storage. [2025-10-03T20:13:54.744543] [INFO ] [MAIN ] MMU: Loaded 16945 existing records. [2025-10-03T20:13:54.922263] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T20:13:54.952951] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:13:54.953192] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-03T20:13:54.953242] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-03T20:13:54.953442] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-03T20:13:54.953502] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-03T20:13:55.195869] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-03T20:13:55.353033] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:55.990747] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-03T20:13:56.736968] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T20:13:56.790663] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-03T20:13:57.013402] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T20:13:57.590691] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-03T20:13:58.266854] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T20:13:58.270765] [INFO ] [REMOTE ] MMM: Full fetch complete (77086 records). [2025-10-03T20:13:58.270910] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-03T20:13:58.395740] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-03T20:13:58.641335] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T20:13:58.748400] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-03T20:13:58.748482] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-03T20:13:58.749571] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-03T20:13:58.749703] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-03T20:13:58.751514] [DEBUG] [LOCAL ] MMM: Trimmed 77086 records to 53938 (keeping 200 days of data) [2025-10-03T20:13:59.107750] [DEBUG] [LOCAL ] MMM: Primary data saved (53938 records). [2025-10-03T20:13:59.111117] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-03T20:13:59.111245] [INFO ] [MAIN ] Update Progress: 1377/2370 symbols completed. MMM took 33.2s. Estimated remaining: 2h 19m 50s. Rate: 7.1 symbols/min [2025-10-03T20:13:59.196688] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-03T20:13:59.308121] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:13:59.335608] [DEBUG] [LOCAL ] MNR: Loaded 24586 existing records from primary storage. [2025-10-03T20:13:59.335900] [INFO ] [MAIN ] MNR: Loaded 24586 existing records. [2025-10-03T20:13:59.526773] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:13:59.527095] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-03T20:13:59.527195] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-03T20:13:59.528098] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-03T20:13:59.528162] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-03T20:13:59.970869] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:13:59.986786] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T20:13:59.995454] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-03T20:14:00.305606] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T20:14:00.668957] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T20:14:00.670030] [INFO ] [REMOTE ] MMT: Full fetch complete (16035 records). [2025-10-03T20:14:00.670149] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-03T20:14:00.795754] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-03T20:14:01.076000] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-03T20:14:01.076081] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-03T20:14:01.076528] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-03T20:14:01.076580] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-03T20:14:01.077212] [DEBUG] [LOCAL ] MMT: Trimmed 16035 records to 10895 (keeping 200 days of data) [2025-10-03T20:14:01.145761] [DEBUG] [LOCAL ] MMT: Primary data saved (10895 records). [2025-10-03T20:14:01.145917] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-03T20:14:01.146017] [INFO ] [MAIN ] Update Progress: 1378/2370 symbols completed. MMT took 29.9s. Estimated remaining: 2h 19m 37s. Rate: 7.1 symbols/min [2025-10-03T20:14:01.335880] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:01.389919] [DEBUG] [LOCAL ] MNSO: Loaded 44754 existing records from primary storage. [2025-10-03T20:14:01.390232] [INFO ] [MAIN ] MNSO: Loaded 44754 existing records. [2025-10-03T20:14:01.595866] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-03T20:14:01.619359] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:01.619869] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-03T20:14:01.619945] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-03T20:14:01.621209] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-03T20:14:01.621288] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-03T20:14:02.112850] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T20:14:02.117873] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:02.390632] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-03T20:14:02.475591] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:14:03.190716] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-03T20:14:03.990633] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-03T20:14:04.087403] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T20:14:04.474154] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T20:14:04.476369] [INFO ] [REMOTE ] MMS: Full fetch complete (52044 records). [2025-10-03T20:14:04.476460] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-03T20:14:04.792144] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-03T20:14:04.911587] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-03T20:14:04.911711] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-03T20:14:04.912742] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-03T20:14:04.912809] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-03T20:14:04.914159] [DEBUG] [LOCAL ] MMS: Trimmed 52044 records to 34400 (keeping 200 days of data) [2025-10-03T20:14:05.028273] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T20:14:05.162804] [DEBUG] [LOCAL ] MMS: Primary data saved (34400 records). [2025-10-03T20:14:05.162962] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-03T20:14:05.163052] [INFO ] [MAIN ] Update Progress: 1379/2370 symbols completed. MMS took 37.4s. Estimated remaining: 2h 19m 25s. Rate: 7.1 symbols/min [2025-10-03T20:14:05.355542] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:05.355825] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-03T20:14:05.355885] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-03T20:14:05.356000] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-03T20:14:05.356045] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-03T20:14:05.356092] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-03T20:14:05.356125] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-03T20:14:05.596491] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-03T20:14:05.787334] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:05.935715] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:14:06.390689] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-03T20:14:07.195720] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-03T20:14:07.213779] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T20:14:07.288722] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T20:14:07.426846] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:14:07.427188] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-03T20:14:07.427285] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:14:07.427339] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-03T20:14:07.427428] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:14:07.427503] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-03T20:14:07.427570] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-03T20:14:07.427633] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-03T20:14:07.427744] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-03T20:14:07.427814] [INFO ] [MAIN ] Update Progress: 1380/2370 symbols completed. MNTN took 2.3s. Estimated remaining: 2h 19m 13s. Rate: 7.1 symbols/min [2025-10-03T20:14:07.654763] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:07.654929] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-03T20:14:07.654997] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-03T20:14:07.655148] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-03T20:14:07.655218] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-03T20:14:07.655288] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-03T20:14:07.655351] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-03T20:14:08.003324] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-03T20:14:08.046772] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:08.790720] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-03T20:14:09.333483] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T20:14:09.590717] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-03T20:14:10.390626] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-03T20:14:10.718478] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T20:14:11.170725] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-03T20:14:11.190616] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-03T20:14:11.354314] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T20:14:11.990728] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-03T20:14:12.790725] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-03T20:14:13.524975] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T20:14:13.587985] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-03T20:14:13.592625] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-03T20:14:13.619718] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T20:14:14.390728] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-03T20:14:14.535873] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T20:14:15.190732] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-03T20:14:15.990716] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-03T20:14:16.491804] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T20:14:16.541146] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T20:14:16.790726] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-03T20:14:17.590628] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-03T20:14:17.795840] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T20:14:18.038747] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T20:14:18.390683] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-03T20:14:18.683522] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T20:14:19.190730] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-03T20:14:19.903239] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T20:14:19.990706] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-03T20:14:20.790735] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-03T20:14:21.411422] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T20:14:21.590739] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-03T20:14:21.776751] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T20:14:21.833066] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T20:14:22.390638] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-03T20:14:22.764950] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T20:14:23.190628] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-03T20:14:23.255478] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:14:23.256749] [INFO ] [REMOTE ] MMU: Full fetch complete (25562 records). [2025-10-03T20:14:23.256823] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-03T20:14:23.693584] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-03T20:14:23.693728] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-03T20:14:23.694339] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-03T20:14:23.694404] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-03T20:14:23.695323] [DEBUG] [LOCAL ] MMU: Trimmed 25562 records to 17040 (keeping 200 days of data) [2025-10-03T20:14:23.817542] [DEBUG] [LOCAL ] MMU: Primary data saved (17040 records). [2025-10-03T20:14:23.817999] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-03T20:14:23.818276] [INFO ] [MAIN ] Update Progress: 1381/2370 symbols completed. MMU took 29.3s. Estimated remaining: 2h 19m 10s. Rate: 7.1 symbols/min [2025-10-03T20:14:24.000444] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-03T20:14:24.019793] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:24.067568] [DEBUG] [LOCAL ] MOD: Loaded 45531 existing records from primary storage. [2025-10-03T20:14:24.067931] [INFO ] [MAIN ] MOD: Loaded 45531 existing records. [2025-10-03T20:14:24.260266] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:24.260551] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-03T20:14:24.260610] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-03T20:14:24.262005] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-03T20:14:24.262066] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-03T20:14:24.671733] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:24.755012] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T20:14:24.790639] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-03T20:14:24.813194] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T20:14:25.590744] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-03T20:14:26.390631] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-03T20:14:26.644079] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T20:14:27.190724] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-03T20:14:27.938864] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-03T20:14:27.987830] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T20:14:27.993690] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-03T20:14:28.265221] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T20:14:28.790741] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-03T20:14:29.588236] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T20:14:29.596878] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-03T20:14:30.390689] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-03T20:14:30.510625] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T20:14:30.512543] [INFO ] [REMOTE ] MNR: Full fetch complete (36801 records). [2025-10-03T20:14:30.512679] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-03T20:14:30.922842] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-03T20:14:30.922979] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-03T20:14:30.923928] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-03T20:14:30.923993] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-03T20:14:30.924951] [DEBUG] [LOCAL ] MNR: Trimmed 36801 records to 24792 (keeping 200 days of data) [2025-10-03T20:14:31.085156] [DEBUG] [LOCAL ] MNR: Primary data saved (24792 records). [2025-10-03T20:14:31.085436] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-03T20:14:31.085750] [INFO ] [MAIN ] Update Progress: 1382/2370 symbols completed. MNR took 32.0s. Estimated remaining: 2h 19m 0s. Rate: 7.1 symbols/min [2025-10-03T20:14:31.193681] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-03T20:14:31.276396] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:31.307459] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-03T20:14:31.367749] [DEBUG] [LOCAL ] MODG: Loaded 51905 existing records from primary storage. [2025-10-03T20:14:31.368098] [INFO ] [MAIN ] MODG: Loaded 51905 existing records. [2025-10-03T20:14:31.559234] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:31.559478] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-03T20:14:31.559527] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-03T20:14:31.560767] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-03T20:14:31.560829] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-03T20:14:31.966038] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:31.990668] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-03T20:14:32.084781] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T20:14:32.458697] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T20:14:32.790694] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-03T20:14:33.590728] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-03T20:14:33.831938] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T20:14:34.390680] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-03T20:14:34.453455] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T20:14:35.172873] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T20:14:35.190620] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-03T20:14:35.990695] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-03T20:14:36.782337] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T20:14:36.794538] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-03T20:14:36.859080] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:14:37.302076] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T20:14:37.590712] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-03T20:14:38.158012] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T20:14:38.161627] [INFO ] [REMOTE ] MNSO: Full fetch complete (64288 records). [2025-10-03T20:14:38.161867] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-03T20:14:38.396513] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-03T20:14:38.610548] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-03T20:14:38.610675] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-03T20:14:38.611896] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-03T20:14:38.611965] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-03T20:14:38.613400] [DEBUG] [LOCAL ] MNSO: Trimmed 64288 records to 45106 (keeping 200 days of data) [2025-10-03T20:14:38.913249] [DEBUG] [LOCAL ] MNSO: Primary data saved (45106 records). [2025-10-03T20:14:38.913392] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-03T20:14:38.914747] [INFO ] [MAIN ] Update Progress: 1383/2370 symbols completed. MNSO took 37.8s. Estimated remaining: 2h 18m 52s. Rate: 7.1 symbols/min [2025-10-03T20:14:39.057157] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T20:14:39.138988] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:39.189553] [DEBUG] [LOCAL ] MOH: Loaded 42055 existing records from primary storage. [2025-10-03T20:14:39.189915] [INFO ] [MAIN ] MOH: Loaded 42055 existing records. [2025-10-03T20:14:39.201809] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-03T20:14:39.402536] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:39.402799] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-03T20:14:39.402850] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-03T20:14:39.403976] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-03T20:14:39.404037] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-03T20:14:39.805703] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:39.990704] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-03T20:14:40.141324] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T20:14:40.768395] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T20:14:40.790731] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-03T20:14:41.445257] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T20:14:41.590720] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-03T20:14:42.390735] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-03T20:14:42.995756] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T20:14:43.201256] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-03T20:14:43.211687] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T20:14:43.264360] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T20:14:43.990745] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-03T20:14:44.790711] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-03T20:14:45.340247] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T20:14:45.579082] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T20:14:45.590612] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-03T20:14:46.390627] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-03T20:14:46.582422] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T20:14:47.190705] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-03T20:14:47.338755] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T20:14:47.928455] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T20:14:47.990674] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-03T20:14:48.790727] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-03T20:14:49.090312] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T20:14:49.093212] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-03T20:14:49.093383] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-03T20:14:49.318954] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:14:49.319757] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:14:49.319846] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:14:49.319924] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-03T20:14:49.320018] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-03T20:14:49.320068] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-03T20:14:49.320149] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-03T20:14:49.320256] [INFO ] [MAIN ] Update Progress: 1384/2370 symbols completed. MO took 41.9s. Estimated remaining: 2h 18m 45s. Rate: 7.1 symbols/min [2025-10-03T20:14:49.510426] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:49.568677] [DEBUG] [LOCAL ] MOS: Loaded 53889 existing records from primary storage. [2025-10-03T20:14:49.569009] [INFO ] [MAIN ] MOS: Loaded 53889 existing records. [2025-10-03T20:14:49.600934] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-03T20:14:49.789020] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:49.803510] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-03T20:14:49.806256] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:14:49.804165] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-03T20:14:49.820684] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-03T20:14:49.820810] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-03T20:14:50.240711] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:50.390621] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-03T20:14:50.556493] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T20:14:51.190664] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-03T20:14:51.294380] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T20:14:51.686006] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T20:14:51.990712] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-03T20:14:52.790688] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-03T20:14:53.009030] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T20:14:53.590670] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-03T20:14:53.745186] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T20:14:54.257401] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T20:14:54.259867] [INFO ] [REMOTE ] MOD: Full fetch complete (66306 records). [2025-10-03T20:14:54.260026] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-03T20:14:54.395733] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-03T20:14:54.735164] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-03T20:14:54.735248] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-03T20:14:54.736450] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-03T20:14:54.736519] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-03T20:14:54.738017] [DEBUG] [LOCAL ] MOD: Trimmed 66306 records to 45809 (keeping 200 days of data) [2025-10-03T20:14:55.026345] [DEBUG] [LOCAL ] MOD: Primary data saved (45809 records). [2025-10-03T20:14:55.026490] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-03T20:14:55.026583] [INFO ] [MAIN ] Update Progress: 1385/2370 symbols completed. MOD took 31.2s. Estimated remaining: 2h 18m 34s. Rate: 7.1 symbols/min [2025-10-03T20:14:55.195411] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-03T20:14:55.222001] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:14:55.252067] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T20:14:55.278935] [DEBUG] [LOCAL ] MOV: Loaded 22121 existing records from primary storage. [2025-10-03T20:14:55.279200] [INFO ] [MAIN ] MOV: Loaded 22121 existing records. [2025-10-03T20:14:55.480432] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:14:55.480698] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-03T20:14:55.480757] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-03T20:14:55.481350] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-03T20:14:55.481410] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-03T20:14:55.891090] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:14:55.990706] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-03T20:14:56.350783] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T20:14:56.614368] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T20:14:56.790687] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-03T20:14:56.999723] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T20:14:57.590705] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-03T20:14:58.390637] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-03T20:14:58.594794] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T20:14:59.095667] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T20:14:59.190701] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-03T20:14:59.441203] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T20:14:59.990702] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-03T20:15:00.790635] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-03T20:15:01.214187] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T20:15:01.260526] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T20:15:01.590728] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-03T20:15:02.390709] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-03T20:15:02.515239] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T20:15:03.196217] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-03T20:15:03.202091] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T20:15:03.990677] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-03T20:15:04.329332] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T20:15:04.790688] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-03T20:15:05.134402] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T20:15:05.371033] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T20:15:05.590730] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-03T20:15:06.390675] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-03T20:15:06.761435] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T20:15:06.805889] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T20:15:06.808573] [INFO ] [REMOTE ] MODG: Full fetch complete (74824 records). [2025-10-03T20:15:06.808737] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-03T20:15:07.195871] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-03T20:15:07.290508] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-03T20:15:07.290609] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-03T20:15:07.291827] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-03T20:15:07.291934] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-03T20:15:07.293483] [DEBUG] [LOCAL ] MODG: Trimmed 74824 records to 52282 (keeping 200 days of data) [2025-10-03T20:15:07.613413] [DEBUG] [LOCAL ] MODG: Primary data saved (52282 records). [2025-10-03T20:15:07.613572] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-03T20:15:07.613704] [INFO ] [MAIN ] Update Progress: 1386/2370 symbols completed. MODG took 36.5s. Estimated remaining: 2h 18m 29s. Rate: 7.1 symbols/min [2025-10-03T20:15:07.812164] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:07.812537] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-10-03T20:15:07.812616] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-10-03T20:15:07.812783] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-03T20:15:07.812838] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-03T20:15:07.812885] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-03T20:15:07.812937] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-03T20:15:08.004402] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-03T20:15:08.210578] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:08.240926] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T20:15:08.688578] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T20:15:08.790709] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-03T20:15:09.590708] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-03T20:15:09.986281] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T20:15:10.346054] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T20:15:10.390628] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-03T20:15:10.799366] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T20:15:11.190717] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-03T20:15:11.990713] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-03T20:15:12.158506] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T20:15:12.785455] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T20:15:12.800777] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-03T20:15:13.590699] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-03T20:15:13.747261] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T20:15:14.357433] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T20:15:14.390676] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-03T20:15:14.615043] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T20:15:15.190724] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-03T20:15:15.990728] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-03T20:15:16.046971] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T20:15:16.049375] [INFO ] [REMOTE ] MOH: Full fetch complete (58556 records). [2025-10-03T20:15:16.049565] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-03T20:15:16.256171] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T20:15:16.501253] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-03T20:15:16.501362] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-03T20:15:16.502397] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-03T20:15:16.502463] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-03T20:15:16.504048] [DEBUG] [LOCAL ] MOH: Trimmed 58556 records to 42386 (keeping 200 days of data) [2025-10-03T20:15:16.784757] [DEBUG] [LOCAL ] MOH: Primary data saved (42386 records). [2025-10-03T20:15:16.785023] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-03T20:15:16.785215] [INFO ] [MAIN ] Update Progress: 1387/2370 symbols completed. MOH took 37.9s. Estimated remaining: 2h 18m 21s. Rate: 7.1 symbols/min [2025-10-03T20:15:16.799001] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-03T20:15:16.991639] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:16.999706] [DEBUG] [LOCAL ] MPA: Loaded 5304 existing records from primary storage. [2025-10-03T20:15:16.999928] [INFO ] [MAIN ] MPA: Loaded 5304 existing records. [2025-10-03T20:15:17.210763] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:15:17.211008] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-03T20:15:17.211057] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-03T20:15:17.211379] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-03T20:15:17.211441] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-03T20:15:17.595825] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-03T20:15:17.631163] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:17.864851] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T20:15:18.390664] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-03T20:15:18.553999] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T20:15:18.932830] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T20:15:18.952955] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T20:15:19.190735] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-03T20:15:19.990738] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-03T20:15:20.790675] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-03T20:15:21.051188] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T20:15:21.089328] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:15:21.590744] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-03T20:15:22.370211] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T20:15:22.371710] [INFO ] [REMOTE ] MOV: Full fetch complete (30630 records). [2025-10-03T20:15:22.371853] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-03T20:15:22.395812] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-03T20:15:22.790559] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-03T20:15:22.790697] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-03T20:15:22.791497] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-03T20:15:22.791579] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-03T20:15:22.792569] [DEBUG] [LOCAL ] MOV: Trimmed 30630 records to 22246 (keeping 200 days of data) [2025-10-03T20:15:22.935852] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:15:22.938606] [DEBUG] [LOCAL ] MOV: Primary data saved (22246 records). [2025-10-03T20:15:22.938714] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-03T20:15:22.938839] [INFO ] [MAIN ] Update Progress: 1388/2370 symbols completed. MOV took 27.9s. Estimated remaining: 2h 18m 11s. Rate: 7.1 symbols/min [2025-10-03T20:15:23.140202] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:23.192741] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-03T20:15:23.194988] [DEBUG] [LOCAL ] MPC: Loaded 52458 existing records from primary storage. [2025-10-03T20:15:23.211350] [INFO ] [MAIN ] MPC: Loaded 52458 existing records. [2025-10-03T20:15:23.296777] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-03T20:15:23.439547] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:15:23.439822] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-03T20:15:23.439875] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-03T20:15:23.441255] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-03T20:15:23.441317] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-03T20:15:23.815085] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:23.853271] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T20:15:23.990737] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-03T20:15:24.790715] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-03T20:15:25.590700] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-03T20:15:25.754027] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T20:15:25.963310] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-03T20:15:26.390707] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-03T20:15:26.618159] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T20:15:27.190731] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-03T20:15:27.846760] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T20:15:27.990689] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-03T20:15:28.790761] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-03T20:15:29.589593] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-03T20:15:29.601500] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-03T20:15:29.646307] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T20:15:30.125511] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T20:15:30.390691] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-03T20:15:30.661165] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T20:15:31.190748] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-03T20:15:31.990734] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-03T20:15:32.053147] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:15:32.219042] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T20:15:32.790713] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-03T20:15:33.590629] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-03T20:15:33.664020] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T20:15:33.668071] [INFO ] [REMOTE ] MOS: Full fetch complete (77454 records). [2025-10-03T20:15:33.668282] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-03T20:15:34.138211] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-03T20:15:34.138362] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-03T20:15:34.139547] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-03T20:15:34.139622] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-03T20:15:34.141255] [DEBUG] [LOCAL ] MOS: Trimmed 77454 records to 54279 (keeping 200 days of data) [2025-10-03T20:15:34.390855] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-03T20:15:34.511992] [DEBUG] [LOCAL ] MOS: Primary data saved (54279 records). [2025-10-03T20:15:34.512151] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-03T20:15:34.512254] [INFO ] [MAIN ] Update Progress: 1389/2370 symbols completed. MOS took 45.2s. Estimated remaining: 2h 18m 4s. Rate: 7.1 symbols/min [2025-10-03T20:15:34.710253] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:34.763067] [DEBUG] [LOCAL ] MPLX: Loaded 51112 existing records from primary storage. [2025-10-03T20:15:34.763433] [INFO ] [MAIN ] MPLX: Loaded 51112 existing records. [2025-10-03T20:15:34.972079] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:15:34.972356] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-03T20:15:34.972418] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-03T20:15:34.973719] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-03T20:15:34.973797] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-03T20:15:35.107131] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T20:15:35.199961] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-03T20:15:35.455878] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:35.562597] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-03T20:15:35.611288] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T20:15:35.931382] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T20:15:35.990736] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-03T20:15:36.630918] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T20:15:36.790733] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-03T20:15:37.590721] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-03T20:15:38.244720] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T20:15:38.390681] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-03T20:15:38.600499] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T20:15:38.922944] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:15:38.924150] [INFO ] [REMOTE ] MPA: Full fetch complete (7213 records). [2025-10-03T20:15:38.924240] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-03T20:15:39.198034] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-03T20:15:39.327565] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-03T20:15:39.327665] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-03T20:15:39.327979] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-03T20:15:39.328057] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-03T20:15:39.328825] [DEBUG] [LOCAL ] MPA: Trimmed 7213 records to 5349 (keeping 200 days of data) [2025-10-03T20:15:39.364769] [DEBUG] [LOCAL ] MPA: Primary data saved (5349 records). [2025-10-03T20:15:39.364919] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-03T20:15:39.365056] [INFO ] [MAIN ] Update Progress: 1390/2370 symbols completed. MPA took 22.6s. Estimated remaining: 2h 17m 53s. Rate: 7.1 symbols/min [2025-10-03T20:15:39.570926] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:39.579411] [DEBUG] [LOCAL ] MPV: Loaded 4975 existing records from primary storage. [2025-10-03T20:15:39.579624] [INFO ] [MAIN ] MPV: Loaded 4975 existing records. [2025-10-03T20:15:39.769616] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:15:39.769940] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-03T20:15:39.770006] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-03T20:15:39.770382] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-03T20:15:39.770444] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-03T20:15:39.995785] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-03T20:15:40.151166] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:40.790739] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-03T20:15:40.959984] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T20:15:41.590736] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-03T20:15:42.264663] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T20:15:42.390701] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-03T20:15:42.616245] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T20:15:42.784710] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-03T20:15:43.190706] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-03T20:15:43.999106] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-03T20:15:44.004844] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T20:15:44.790737] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-03T20:15:44.866460] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T20:15:45.590736] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-03T20:15:46.270302] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T20:15:46.390715] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-03T20:15:46.693988] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T20:15:46.725417] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-03T20:15:47.190720] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-03T20:15:47.990676] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-03T20:15:48.246364] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T20:15:48.790740] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-03T20:15:48.943084] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:15:49.590718] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-03T20:15:50.355365] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T20:15:50.358863] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T20:15:50.390619] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-03T20:15:50.425061] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-03T20:15:50.427779] [INFO ] [REMOTE ] MP: Full fetch complete (77354 records). [2025-10-03T20:15:50.427945] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-03T20:15:50.921545] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-03T20:15:50.921807] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-03T20:15:50.923187] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-03T20:15:50.923300] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-03T20:15:50.931407] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T20:15:50.934446] [DEBUG] [LOCAL ] MP: Trimmed 77354 records to 54456 (keeping 200 days of data) [2025-10-03T20:15:51.191267] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-03T20:15:51.288254] [DEBUG] [LOCAL ] MP: Primary data saved (54456 records). [2025-10-03T20:15:51.288447] [INFO ] [MAIN ] MP: Full history saved. [2025-10-03T20:15:51.288633] [INFO ] [MAIN ] Update Progress: 1391/2370 symbols completed. MP took 43.7s. Estimated remaining: 2h 17m 47s. Rate: 7.1 symbols/min [2025-10-03T20:15:51.488251] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:15:51.542534] [DEBUG] [LOCAL ] MPW: Loaded 53885 existing records from primary storage. [2025-10-03T20:15:51.542889] [INFO ] [MAIN ] MPW: Loaded 53885 existing records. [2025-10-03T20:15:51.750112] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:15:51.750329] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-03T20:15:51.750380] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-03T20:15:51.751565] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-03T20:15:51.751630] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-03T20:15:51.911023] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T20:15:52.000151] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-03T20:15:52.181288] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:15:52.790696] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-03T20:15:53.417199] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T20:15:53.590674] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-03T20:15:53.897416] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T20:15:54.390690] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-03T20:15:55.190696] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-03T20:15:55.712323] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T20:15:55.786328] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T20:15:55.872346] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:15:55.990711] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-03T20:15:56.790682] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-03T20:15:57.356138] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T20:15:57.590691] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-03T20:15:57.875067] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T20:15:58.161020] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-03T20:15:58.390705] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-03T20:15:59.190689] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-03T20:15:59.734950] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T20:15:59.815710] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T20:15:59.822332] [INFO ] [REMOTE ] MPC: Full fetch complete (75843 records). [2025-10-03T20:15:59.822524] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-03T20:15:59.996228] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-03T20:16:00.279977] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-03T20:16:00.280075] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-03T20:16:00.282129] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-03T20:16:00.282242] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-03T20:16:00.284228] [DEBUG] [LOCAL ] MPC: Trimmed 75843 records to 52839 (keeping 200 days of data) [2025-10-03T20:16:00.637568] [DEBUG] [LOCAL ] MPC: Primary data saved (52839 records). [2025-10-03T20:16:00.637741] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-03T20:16:00.637875] [INFO ] [MAIN ] Update Progress: 1392/2370 symbols completed. MPC took 37.7s. Estimated remaining: 2h 17m 40s. Rate: 7.1 symbols/min [2025-10-03T20:16:00.801081] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-03T20:16:00.832300] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:16:00.838564] [DEBUG] [LOCAL ] MPX: Loaded 4077 existing records from primary storage. [2025-10-03T20:16:00.838820] [INFO ] [MAIN ] MPX: Loaded 4077 existing records. [2025-10-03T20:16:01.111238] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:16:01.111476] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-03T20:16:01.111529] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-03T20:16:01.111794] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-03T20:16:01.111856] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-03T20:16:01.437022] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T20:16:01.464518] [INFO ] [REMOTE ] MPV: Full fetch complete (7999 records). [2025-10-03T20:16:01.491337] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-03T20:16:01.525450] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:16:01.597084] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-03T20:16:01.969255] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-03T20:16:01.969484] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-03T20:16:01.969949] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-03T20:16:01.970165] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-03T20:16:01.971127] [DEBUG] [LOCAL ] MPV: Trimmed 7999 records to 4992 (keeping 200 days of data) [2025-10-03T20:16:02.007694] [DEBUG] [LOCAL ] MPV: Primary data saved (4992 records). [2025-10-03T20:16:02.007907] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-03T20:16:02.008037] [INFO ] [MAIN ] Update Progress: 1393/2370 symbols completed. MPV took 22.6s. Estimated remaining: 2h 17m 26s. Rate: 7.1 symbols/min [2025-10-03T20:16:02.213108] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:16:02.221222] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T20:16:02.255576] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-03T20:16:02.259577] [DEBUG] [LOCAL ] MQT: Loaded 8739 existing records from primary storage. [2025-10-03T20:16:02.269786] [INFO ] [MAIN ] MQT: Loaded 8739 existing records. [2025-10-03T20:16:02.395845] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-03T20:16:02.466985] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:16:02.467216] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-03T20:16:02.467265] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-03T20:16:02.467589] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-03T20:16:02.467679] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-03T20:16:02.880585] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:16:03.190706] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-03T20:16:03.218441] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T20:16:03.990743] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-03T20:16:04.731955] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T20:16:04.790636] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-03T20:16:04.870794] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T20:16:05.590715] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-03T20:16:06.351809] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T20:16:06.390639] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-03T20:16:06.573215] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T20:16:07.130578] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T20:16:07.190707] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-03T20:16:07.990707] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-03T20:16:08.061053] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T20:16:08.790729] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-03T20:16:09.474955] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T20:16:09.590739] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-03T20:16:09.812154] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T20:16:10.390631] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-03T20:16:10.541703] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:16:11.190736] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-03T20:16:11.990694] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-03T20:16:12.285435] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T20:16:12.666946] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T20:16:12.790708] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-03T20:16:13.465332] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T20:16:13.548065] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T20:16:13.590737] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-03T20:16:14.392303] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-03T20:16:14.394371] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T20:16:15.190750] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-03T20:16:15.990634] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-03T20:16:16.478753] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T20:16:16.696047] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T20:16:16.790742] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-03T20:16:17.288387] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T20:16:17.327179] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T20:16:17.590705] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-03T20:16:18.390696] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-03T20:16:19.174540] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T20:16:19.177441] [INFO ] [REMOTE ] MPLX: Full fetch complete (74063 records). [2025-10-03T20:16:19.177602] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-03T20:16:19.200114] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-03T20:16:19.651618] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-03T20:16:19.651754] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-03T20:16:19.653053] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-03T20:16:19.653192] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-03T20:16:19.654951] [DEBUG] [LOCAL ] MPLX: Trimmed 74063 records to 51499 (keeping 200 days of data) [2025-10-03T20:16:19.991348] [DEBUG] [LOCAL ] MPLX: Primary data saved (51499 records). [2025-10-03T20:16:19.991477] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-03T20:16:19.991251] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-03T20:16:19.992564] [INFO ] [MAIN ] Update Progress: 1394/2370 symbols completed. MPLX took 45.5s. Estimated remaining: 2h 17m 25s. Rate: 7.1 symbols/min [2025-10-03T20:16:20.213517] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:16:20.250960] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T20:16:20.279594] [DEBUG] [LOCAL ] MQY: Loaded 17140 existing records from primary storage. [2025-10-03T20:16:20.279918] [INFO ] [MAIN ] MQY: Loaded 17140 existing records. [2025-10-03T20:16:20.418020] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T20:16:20.508959] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:16:20.513850] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-03T20:16:20.514163] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-03T20:16:20.514068] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T20:16:20.515981] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-03T20:16:20.516371] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-03T20:16:20.797266] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-03T20:16:20.981088] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:16:21.590720] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-03T20:16:22.276939] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T20:16:22.390746] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-03T20:16:23.002233] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T20:16:23.190692] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-03T20:16:23.701200] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:16:23.702060] [INFO ] [REMOTE ] MPX: Full fetch complete (6703 records). [2025-10-03T20:16:23.702137] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-03T20:16:23.976949] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T20:16:23.995692] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-03T20:16:24.148419] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-03T20:16:24.148498] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-03T20:16:24.148718] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-03T20:16:24.148781] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-03T20:16:24.149234] [DEBUG] [LOCAL ] MPX: Trimmed 6703 records to 4118 (keeping 200 days of data) [2025-10-03T20:16:24.175988] [DEBUG] [LOCAL ] MPX: Primary data saved (4118 records). [2025-10-03T20:16:24.176155] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-03T20:16:24.176255] [INFO ] [MAIN ] Update Progress: 1395/2370 symbols completed. MPX took 23.5s. Estimated remaining: 2h 17m 13s. Rate: 7.1 symbols/min [2025-10-03T20:16:24.363109] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:16:24.400190] [DEBUG] [LOCAL ] MRC: Loaded 37651 existing records from primary storage. [2025-10-03T20:16:24.400474] [INFO ] [MAIN ] MRC: Loaded 37651 existing records. [2025-10-03T20:16:24.586683] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:16:24.586924] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-03T20:16:24.586976] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-03T20:16:24.587887] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-03T20:16:24.587987] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-03T20:16:24.800864] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-03T20:16:25.024228] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:16:25.590704] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-03T20:16:26.047448] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-03T20:16:26.101141] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T20:16:26.390701] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-03T20:16:26.945586] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T20:16:27.190710] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-03T20:16:27.990724] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-03T20:16:28.466505] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T20:16:28.682686] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T20:16:28.707095] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T20:16:28.790768] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-03T20:16:29.590726] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-03T20:16:29.942537] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:16:30.363780] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T20:16:30.390718] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-03T20:16:31.190726] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-03T20:16:31.996376] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-03T20:16:31.997346] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T20:16:32.001416] [INFO ] [REMOTE ] MPW: Full fetch complete (77512 records). [2025-10-03T20:16:32.001566] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-03T20:16:32.445535] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-03T20:16:32.445637] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-03T20:16:32.446935] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-03T20:16:32.447002] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-03T20:16:32.448623] [DEBUG] [LOCAL ] MPW: Trimmed 77512 records to 54270 (keeping 200 days of data) [2025-10-03T20:16:32.685570] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:16:32.790858] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-03T20:16:32.821971] [DEBUG] [LOCAL ] MPW: Primary data saved (54270 records). [2025-10-03T20:16:32.822151] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-03T20:16:32.822246] [INFO ] [MAIN ] Update Progress: 1396/2370 symbols completed. MPW took 41.5s. Estimated remaining: 2h 17m 5s. Rate: 7.1 symbols/min [2025-10-03T20:16:32.949330] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T20:16:33.029953] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:16:33.030154] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-03T20:16:33.030195] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-03T20:16:33.030309] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-03T20:16:33.030353] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-03T20:16:33.030397] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-03T20:16:33.030431] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-03T20:16:33.439668] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:16:33.496750] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T20:16:33.590704] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-03T20:16:34.390715] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-03T20:16:34.644520] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:16:35.190738] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-03T20:16:35.212866] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T20:16:35.990705] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-03T20:16:36.695035] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T20:16:36.696638] [INFO ] [REMOTE ] MQT: Full fetch complete (13444 records). [2025-10-03T20:16:36.696807] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-03T20:16:36.796011] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-03T20:16:37.122505] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T20:16:37.204804] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-03T20:16:37.204919] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-03T20:16:37.205293] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-03T20:16:37.205339] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-03T20:16:37.205942] [DEBUG] [LOCAL ] MQT: Trimmed 13444 records to 8841 (keeping 200 days of data) [2025-10-03T20:16:37.262430] [DEBUG] [LOCAL ] MQT: Primary data saved (8841 records). [2025-10-03T20:16:37.262589] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-03T20:16:37.262752] [INFO ] [MAIN ] Update Progress: 1397/2370 symbols completed. MQT took 35.3s. Estimated remaining: 2h 16m 54s. Rate: 7.1 symbols/min [2025-10-03T20:16:37.590693] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-03T20:16:37.853503] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T20:16:38.390742] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-03T20:16:38.936046] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T20:16:39.190637] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-03T20:16:39.386592] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T20:16:39.990732] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-03T20:16:40.708581] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T20:16:40.790670] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-03T20:16:41.098118] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T20:16:41.590739] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-03T20:16:42.199251] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:16:42.390752] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-03T20:16:42.639400] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T20:16:43.190707] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-03T20:16:43.990738] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-03T20:16:44.045899] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T20:16:44.095039] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:16:44.790719] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-03T20:16:45.590696] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-03T20:16:46.264014] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-03T20:16:46.329100] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T20:16:46.390721] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-03T20:16:46.529264] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T20:16:46.531016] [INFO ] [REMOTE ] MQY: Full fetch complete (27153 records). [2025-10-03T20:16:46.531107] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-03T20:16:46.918263] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-03T20:16:46.918435] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-03T20:16:46.919024] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-03T20:16:46.919088] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-03T20:16:46.919824] [DEBUG] [LOCAL ] MQY: Trimmed 27153 records to 17389 (keeping 200 days of data) [2025-10-03T20:16:47.029878] [DEBUG] [LOCAL ] MQY: Primary data saved (17389 records). [2025-10-03T20:16:47.030027] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-03T20:16:47.030114] [INFO ] [MAIN ] Update Progress: 1398/2370 symbols completed. MQY took 27.0s. Estimated remaining: 2h 16m 46s. Rate: 7.1 symbols/min [2025-10-03T20:16:47.190720] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-03T20:16:47.751367] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T20:16:47.990637] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-03T20:16:49.146471] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T20:16:49.149336] [INFO ] [REMOTE ] MRC: Full fetch complete (54807 records). [2025-10-03T20:16:49.149462] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-03T20:16:49.608402] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-03T20:16:49.623973] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-03T20:16:49.637105] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-03T20:16:49.640471] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-03T20:16:49.643377] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-03T20:16:49.656104] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-03T20:16:49.657222] [DEBUG] [LOCAL ] MRC: Trimmed 54807 records to 37897 (keeping 200 days of data) [2025-10-03T20:16:49.897051] [DEBUG] [LOCAL ] MRC: Primary data saved (37897 records). [2025-10-03T20:16:49.897212] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-03T20:16:49.897300] [INFO ] [MAIN ] Update Progress: 1399/2370 symbols completed. MRC took 25.7s. Estimated remaining: 2h 16m 34s. Rate: 7.1 symbols/min [2025-10-03T20:16:52.156729] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-03T20:16:52.168131] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-03T20:16:54.239316] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T20:16:54.251353] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-03T20:16:56.599245] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-03T20:16:56.612105] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-03T20:16:59.165599] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-03T20:16:59.177514] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-03T20:17:01.514184] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-03T20:17:01.526341] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-03T20:17:04.215857] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-03T20:17:04.229332] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-03T20:17:06.614759] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-03T20:17:06.627838] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-03T20:17:07.656929] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T20:17:07.669683] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-03T20:17:08.196127] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:17:08.198440] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-03T20:17:08.198606] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-03T20:17:08.199450] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:17:08.199580] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:17:08.199678] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:17:08.199779] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-03T20:17:08.199891] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-03T20:17:08.199951] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-03T20:17:08.200015] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-03T20:17:08.200139] [INFO ] [MAIN ] Update Progress: 1400/2370 symbols completed. MRK took 35.4s. Estimated remaining: 2h 16m 32s. Rate: 7.1 symbols/min [2025-10-03T20:17:08.810031] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:08.920676] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:08.972685] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:08.973528] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:08.976155] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-03T20:17:08.976702] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-03T20:17:08.976884] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-03T20:17:08.976991] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-03T20:17:08.977278] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-03T20:17:08.981537] [DEBUG] [LOCAL ] MSB: Loaded 7883 existing records from primary storage. [2025-10-03T20:17:08.981075] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-03T20:17:08.987100] [INFO ] [MAIN ] MSB: Loaded 7883 existing records. [2025-10-03T20:17:09.299548] [DEBUG] [LOCAL ] MSA: Loaded 19007 existing records from primary storage. [2025-10-03T20:17:09.374522] [INFO ] [MAIN ] MSA: Loaded 19007 existing records. [2025-10-03T20:17:09.472986] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:09.494264] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-03T20:17:09.579101] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-03T20:17:09.602848] [DEBUG] [LOCAL ] MS: Loaded 54081 existing records from primary storage. [2025-10-03T20:17:09.633046] [INFO ] [MAIN ] MS: Loaded 54081 existing records. [2025-10-03T20:17:09.633143] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-03T20:17:09.649341] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-03T20:17:09.940591] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:09.962251] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-03T20:17:10.030540] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:10.050563] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-03T20:17:10.085175] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-03T20:17:10.118570] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-03T20:17:10.150946] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-03T20:17:10.208334] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:10.225459] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-03T20:17:10.247669] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-03T20:17:10.320359] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-03T20:17:10.334234] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:17:10.334406] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-03T20:17:10.398295] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-03T20:17:10.443758] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:17:10.518591] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-03T20:17:10.612498] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:17:10.669192] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-03T20:17:10.685401] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-03T20:17:10.701993] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-03T20:17:10.809085] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-03T20:17:10.874552] [INFO ] [MAIN ] Update Progress: 1401/2370 symbols completed. MRP took 2.7s. Estimated remaining: 2h 16m 20s. Rate: 7.1 symbols/min [2025-10-03T20:17:10.944703] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:10.967014] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-03T20:17:11.350277] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:11.382008] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-03T20:17:11.495305] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:11.520381] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-03T20:17:11.520042] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:11.520816] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-03T20:17:11.520472] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-03T20:17:11.522000] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-03T20:17:11.522057] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-03T20:17:11.522103] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-03T20:17:11.522137] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-03T20:17:11.911566] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:11.911963] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-03T20:17:11.919625] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T20:17:11.922783] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-03T20:17:12.370598] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T20:17:12.371559] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-03T20:17:12.387481] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T20:17:12.391802] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-03T20:17:12.674731] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:17:12.678819] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-03T20:17:12.938792] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T20:17:12.940321] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-03T20:17:13.404331] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T20:17:13.406409] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-03T20:17:13.418456] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T20:17:13.422262] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-03T20:17:13.535909] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:17:13.540170] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-03T20:17:13.637228] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T20:17:13.648585] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-03T20:17:13.934179] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T20:17:13.935390] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-03T20:17:14.037274] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T20:17:14.039971] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-03T20:17:14.389115] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T20:17:14.390373] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-03T20:17:14.464110] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T20:17:14.468374] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-03T20:17:14.782316] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T20:17:14.785202] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-03T20:17:14.850474] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T20:17:14.851566] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-03T20:17:15.279390] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T20:17:15.280463] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-03T20:17:15.465039] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T20:17:15.467605] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-03T20:17:15.544536] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T20:17:15.549222] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-03T20:17:15.725325] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T20:17:15.737463] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-03T20:17:15.848440] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T20:17:15.849724] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-03T20:17:16.260754] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T20:17:16.261852] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-03T20:17:16.304016] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T20:17:16.596440] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:17:16.790708] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-03T20:17:16.921191] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T20:17:17.590692] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-03T20:17:17.630576] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T20:17:17.783114] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T20:17:18.050333] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T20:17:18.051095] [INFO ] [REMOTE ] MSC: Full fetch complete (2544 records). [2025-10-03T20:17:18.051168] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-03T20:17:18.247272] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-03T20:17:18.247482] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:17:18.247549] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:17:18.247604] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-03T20:17:18.247760] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-03T20:17:18.247819] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-03T20:17:18.247919] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-03T20:17:18.248011] [INFO ] [MAIN ] Update Progress: 1402/2370 symbols completed. MSC took 7.3s. Estimated remaining: 2h 16m 10s. Rate: 7.1 symbols/min [2025-10-03T20:17:18.395872] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-03T20:17:18.430131] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:18.476277] [DEBUG] [LOCAL ] MSCI: Loaded 34810 existing records from primary storage. [2025-10-03T20:17:18.476568] [INFO ] [MAIN ] MSCI: Loaded 34810 existing records. [2025-10-03T20:17:18.669217] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:18.669455] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-03T20:17:18.669504] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-03T20:17:18.669923] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-03T20:17:18.669998] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-03T20:17:19.061800] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:19.190678] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-03T20:17:19.413444] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T20:17:19.990706] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-03T20:17:20.790632] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-03T20:17:20.835271] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T20:17:21.320117] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T20:17:21.590703] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-03T20:17:21.926520] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T20:17:22.390725] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-03T20:17:23.155476] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T20:17:23.174444] [INFO ] [REMOTE ] MSB: Full fetch complete (13044 records). [2025-10-03T20:17:23.174787] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-03T20:17:23.176286] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T20:17:23.197868] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-03T20:17:23.599914] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-03T20:17:23.599996] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-03T20:17:23.600348] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-03T20:17:23.600425] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-03T20:17:23.601207] [DEBUG] [LOCAL ] MSB: Trimmed 13044 records to 7924 (keeping 200 days of data) [2025-10-03T20:17:23.655590] [DEBUG] [LOCAL ] MSB: Primary data saved (7924 records). [2025-10-03T20:17:23.655793] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-03T20:17:23.655914] [INFO ] [MAIN ] Update Progress: 1403/2370 symbols completed. MSB took 15.4s. Estimated remaining: 2h 15m 60s. Rate: 7.1 symbols/min [2025-10-03T20:17:23.844347] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:23.861503] [DEBUG] [LOCAL ] MSD: Loaded 15944 existing records from primary storage. [2025-10-03T20:17:23.861778] [INFO ] [MAIN ] MSD: Loaded 15944 existing records. [2025-10-03T20:17:23.995880] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-03T20:17:24.061817] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:24.062102] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-03T20:17:24.062174] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-03T20:17:24.062424] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-03T20:17:24.062483] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-03T20:17:24.442975] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:24.455978] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T20:17:24.790744] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-03T20:17:25.586082] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T20:17:25.593716] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-03T20:17:26.390703] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-03T20:17:26.644093] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T20:17:27.028274] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T20:17:27.190713] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-03T20:17:27.672606] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T20:17:27.990710] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-03T20:17:28.790713] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-03T20:17:28.889587] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:17:29.385022] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-03T20:17:29.590728] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-03T20:17:30.386293] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T20:17:30.394058] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-03T20:17:30.598896] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T20:17:31.190700] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-03T20:17:31.561820] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T20:17:31.990721] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-03T20:17:32.232082] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T20:17:32.790720] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-03T20:17:33.590632] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-03T20:17:33.809017] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T20:17:34.053307] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T20:17:34.391979] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-03T20:17:34.393960] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T20:17:35.190725] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-03T20:17:35.990637] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-03T20:17:36.174748] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T20:17:36.273922] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:17:36.790720] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-03T20:17:37.481121] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T20:17:37.590698] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-03T20:17:38.292330] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-03T20:17:38.390753] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-03T20:17:38.661713] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T20:17:39.190713] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-03T20:17:39.486016] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:17:39.990684] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-03T20:17:40.439713] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T20:17:40.790717] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-03T20:17:41.393184] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T20:17:41.590738] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-03T20:17:41.914988] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T20:17:42.390703] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-03T20:17:42.465149] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T20:17:42.467800] [INFO ] [REMOTE ] MSA: Full fetch complete (25909 records). [2025-10-03T20:17:42.467929] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-03T20:17:42.903301] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-03T20:17:42.903386] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-03T20:17:42.903937] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-03T20:17:42.904001] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-03T20:17:42.904875] [DEBUG] [LOCAL ] MSA: Trimmed 25909 records to 19110 (keeping 200 days of data) [2025-10-03T20:17:43.033757] [DEBUG] [LOCAL ] MSA: Primary data saved (19110 records). [2025-10-03T20:17:43.033930] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-03T20:17:43.034024] [INFO ] [MAIN ] Update Progress: 1404/2370 symbols completed. MSA took 34.8s. Estimated remaining: 2h 15m 59s. Rate: 7.1 symbols/min [2025-10-03T20:17:43.198958] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-03T20:17:43.237373] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:43.264953] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T20:17:43.267140] [INFO ] [REMOTE ] MSD: Full fetch complete (22649 records). [2025-10-03T20:17:43.267278] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-03T20:17:43.398016] [DEBUG] [LOCAL ] MSDL: Loaded 38548 existing records from primary storage. [2025-10-03T20:17:43.409576] [INFO ] [MAIN ] MSDL: Loaded 38548 existing records. [2025-10-03T20:17:43.872375] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:43.903155] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-03T20:17:43.911119] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-03T20:17:43.940292] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-03T20:17:43.942236] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-03T20:17:43.942352] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-03T20:17:43.947613] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-03T20:17:43.969730] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-03T20:17:43.985601] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-03T20:17:44.000704] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-03T20:17:44.047314] [DEBUG] [LOCAL ] MSD: Trimmed 22649 records to 16204 (keeping 200 days of data) [2025-10-03T20:17:44.478505] [DEBUG] [LOCAL ] MSD: Primary data saved (16204 records). [2025-10-03T20:17:44.496228] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-03T20:17:44.502402] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:44.503232] [INFO ] [MAIN ] Update Progress: 1405/2370 symbols completed. MSD took 20.8s. Estimated remaining: 2h 15m 46s. Rate: 7.1 symbols/min [2025-10-03T20:17:44.703124] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:44.722357] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T20:17:44.751075] [DEBUG] [LOCAL ] MSGE: Loaded 27150 existing records from primary storage. [2025-10-03T20:17:44.751370] [INFO ] [MAIN ] MSGE: Loaded 27150 existing records. [2025-10-03T20:17:44.795786] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-03T20:17:44.960043] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:44.960524] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-03T20:17:44.960597] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-03T20:17:44.961221] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-03T20:17:44.961348] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-03T20:17:45.239673] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T20:17:45.396615] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:45.590725] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-03T20:17:46.317699] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T20:17:46.390674] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-03T20:17:47.190623] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-03T20:17:47.269495] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T20:17:47.324094] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T20:17:47.990685] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-03T20:17:48.611467] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T20:17:48.790712] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-03T20:17:49.254715] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T20:17:49.590704] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-03T20:17:50.072224] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T20:17:50.390685] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-03T20:17:50.925579] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:17:50.928203] [INFO ] [REMOTE ] MS: Full fetch complete (77329 records). [2025-10-03T20:17:50.928323] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-03T20:17:50.929184] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:17:50.929287] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:17:50.929344] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:17:50.929422] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-03T20:17:50.929489] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-03T20:17:50.929570] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-03T20:17:50.929932] [DEBUG] [LOCAL ] MS: Deleted derivative data file. [2025-10-03T20:17:50.930047] [INFO ] [MAIN ] Update Progress: 1406/2370 symbols completed. MS took 42.7s. Estimated remaining: 2h 15m 36s. Rate: 7.1 symbols/min [2025-10-03T20:17:51.104751] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T20:17:51.164276] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:51.185060] [DEBUG] [LOCAL ] MSGS: Loaded 17372 existing records from primary storage. [2025-10-03T20:17:51.185336] [INFO ] [MAIN ] MSGS: Loaded 17372 existing records. [2025-10-03T20:17:51.196947] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-03T20:17:51.394130] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:51.394426] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-03T20:17:51.394484] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-03T20:17:51.394692] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-03T20:17:51.394753] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-03T20:17:51.815294] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:51.990681] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-03T20:17:52.796188] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-03T20:17:52.819167] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T20:17:53.343767] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T20:17:53.590696] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-03T20:17:54.390673] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-03T20:17:54.578316] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:17:54.796223] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T20:17:55.190695] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-03T20:17:55.941743] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T20:17:55.990619] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-03T20:17:56.398287] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:17:56.790697] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-03T20:17:57.496107] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T20:17:57.590701] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-03T20:17:57.847940] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T20:17:57.849932] [INFO ] [REMOTE ] MSCI: Full fetch complete (50478 records). [2025-10-03T20:17:57.850040] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-03T20:17:58.283395] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-03T20:17:58.283489] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-03T20:17:58.284415] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-03T20:17:58.284479] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-03T20:17:58.285916] [DEBUG] [LOCAL ] MSCI: Trimmed 50478 records to 34977 (keeping 200 days of data) [2025-10-03T20:17:58.390821] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-03T20:17:58.509782] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T20:17:58.537661] [DEBUG] [LOCAL ] MSCI: Primary data saved (34977 records). [2025-10-03T20:17:58.537802] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-03T20:17:58.538807] [INFO ] [MAIN ] Update Progress: 1407/2370 symbols completed. MSCI took 40.3s. Estimated remaining: 2h 15m 27s. Rate: 7.1 symbols/min [2025-10-03T20:17:58.731280] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:17:58.776274] [DEBUG] [LOCAL ] MSI: Loaded 40527 existing records from primary storage. [2025-10-03T20:17:58.776598] [INFO ] [MAIN ] MSI: Loaded 40527 existing records. [2025-10-03T20:17:58.972914] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:17:58.973198] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-03T20:17:58.973259] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-03T20:17:58.973589] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-03T20:17:58.973683] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-03T20:17:59.201215] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-03T20:17:59.392526] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:17:59.755538] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:17:59.990691] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-03T20:18:00.721133] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T20:18:00.790672] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-03T20:18:01.026486] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T20:18:01.590755] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-03T20:18:02.390705] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-03T20:18:02.442923] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:18:03.009453] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T20:18:03.190713] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-03T20:18:03.621545] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T20:18:03.990730] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-03T20:18:04.318241] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T20:18:04.790716] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-03T20:18:05.233196] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T20:18:05.590671] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-03T20:18:05.633668] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:18:06.390726] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-03T20:18:06.755429] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T20:18:07.190747] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-03T20:18:07.990746] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-03T20:18:08.037120] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:18:08.098785] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T20:18:08.790777] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-03T20:18:09.590747] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-03T20:18:09.675009] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T20:18:10.033549] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T20:18:10.390729] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-03T20:18:10.652951] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T20:18:11.190718] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-03T20:18:11.939325] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T20:18:11.990634] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-03T20:18:12.305242] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:18:12.790696] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-03T20:18:13.336126] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T20:18:13.590736] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-03T20:18:14.390667] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-03T20:18:14.494811] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T20:18:14.666991] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T20:18:15.190733] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-03T20:18:15.902145] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T20:18:15.990725] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-03T20:18:16.790721] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-03T20:18:17.006217] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T20:18:17.005975] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T20:18:17.021191] [INFO ] [REMOTE ] MSDL: Full fetch complete (55097 records). [2025-10-03T20:18:17.021734] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-03T20:18:17.457720] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-03T20:18:17.457867] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-03T20:18:17.459224] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-03T20:18:17.459294] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-03T20:18:17.460794] [DEBUG] [LOCAL ] MSDL: Trimmed 55097 records to 38862 (keeping 200 days of data) [2025-10-03T20:18:17.591796] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-03T20:18:17.716816] [DEBUG] [LOCAL ] MSDL: Primary data saved (38862 records). [2025-10-03T20:18:17.716965] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-03T20:18:17.717076] [INFO ] [MAIN ] Update Progress: 1408/2370 symbols completed. MSDL took 34.7s. Estimated remaining: 2h 15m 26s. Rate: 7.1 symbols/min [2025-10-03T20:18:17.912034] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:17.922488] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-03T20:18:17.922596] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-03T20:18:17.923744] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T20:18:17.923282] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-03T20:18:17.928189] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-03T20:18:17.928581] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-03T20:18:17.928681] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-03T20:18:18.322440] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:18.390732] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-03T20:18:18.673867] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:18:18.674169] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-03T20:18:18.674272] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:18:18.674329] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-03T20:18:18.674364] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:18:18.674402] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-03T20:18:18.674470] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-03T20:18:18.674525] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-03T20:18:18.674570] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-03T20:18:18.674679] [INFO ] [MAIN ] Update Progress: 1409/2370 symbols completed. MSIF took 1.0s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-03T20:18:18.862380] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:18.898712] [DEBUG] [LOCAL ] MSM: Loaded 35699 existing records from primary storage. [2025-10-03T20:18:18.899066] [INFO ] [MAIN ] MSM: Loaded 35699 existing records. [2025-10-03T20:18:19.099639] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:19.099870] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-03T20:18:19.099920] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-03T20:18:19.100147] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-03T20:18:19.100206] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-03T20:18:19.195818] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-03T20:18:19.541676] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:19.571160] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T20:18:19.990730] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-03T20:18:20.119704] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:18:20.790733] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-03T20:18:21.590706] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-03T20:18:21.632073] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T20:18:21.827587] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:18:21.830630] [INFO ] [REMOTE ] MSGE: Full fetch complete (40294 records). [2025-10-03T20:18:21.830884] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-03T20:18:22.238954] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-03T20:18:22.239036] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-03T20:18:22.239842] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-03T20:18:22.239907] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-03T20:18:22.240926] [DEBUG] [LOCAL ] MSGE: Trimmed 40294 records to 27381 (keeping 200 days of data) [2025-10-03T20:18:22.392513] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-03T20:18:22.416878] [DEBUG] [LOCAL ] MSGE: Primary data saved (27381 records). [2025-10-03T20:18:22.417374] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-03T20:18:22.417639] [INFO ] [MAIN ] Update Progress: 1410/2370 symbols completed. MSGE took 37.9s. Estimated remaining: 2h 15m 1s. Rate: 7.1 symbols/min [2025-10-03T20:18:22.597515] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:22.646250] [DEBUG] [LOCAL ] MT: Loaded 50965 existing records from primary storage. [2025-10-03T20:18:22.646608] [INFO ] [MAIN ] MT: Loaded 50965 existing records. [2025-10-03T20:18:22.839867] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:22.840083] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-03T20:18:22.840134] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-03T20:18:22.840426] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-03T20:18:22.840487] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-03T20:18:23.203343] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-03T20:18:23.252424] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:23.278359] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T20:18:23.990718] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-03T20:18:24.103328] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T20:18:24.204017] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T20:18:24.205460] [INFO ] [REMOTE ] MSGS: Full fetch complete (23163 records). [2025-10-03T20:18:24.205551] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-03T20:18:24.610523] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-03T20:18:24.610607] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-03T20:18:24.611144] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-03T20:18:24.611207] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-03T20:18:24.612200] [DEBUG] [LOCAL ] MSGS: Trimmed 23163 records to 17502 (keeping 200 days of data) [2025-10-03T20:18:24.731200] [DEBUG] [LOCAL ] MSGS: Primary data saved (17502 records). [2025-10-03T20:18:24.731345] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-03T20:18:24.731453] [INFO ] [MAIN ] Update Progress: 1411/2370 symbols completed. MSGS took 33.8s. Estimated remaining: 2h 14m 48s. Rate: 7.1 symbols/min [2025-10-03T20:18:24.802205] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-03T20:18:24.950539] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:24.995754] [DEBUG] [LOCAL ] MTAL: Loaded 36775 existing records from primary storage. [2025-10-03T20:18:24.996094] [INFO ] [MAIN ] MTAL: Loaded 36775 existing records. [2025-10-03T20:18:25.227572] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:25.227804] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-03T20:18:25.227880] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-03T20:18:25.228115] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-10-03T20:18:25.228173] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-03T20:18:25.596255] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-03T20:18:25.621430] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:25.649793] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T20:18:26.304057] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T20:18:26.390710] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-03T20:18:27.190636] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-03T20:18:27.444255] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T20:18:27.871110] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T20:18:27.990701] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-03T20:18:28.523069] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T20:18:28.790728] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-03T20:18:29.205816] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T20:18:29.590687] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-03T20:18:30.390631] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-03T20:18:30.642021] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T20:18:30.742567] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T20:18:31.190738] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-03T20:18:31.572371] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T20:18:31.575472] [INFO ] [REMOTE ] MSI: Full fetch complete (58260 records). [2025-10-03T20:18:31.575709] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-03T20:18:31.995961] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-03T20:18:32.158071] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-03T20:18:32.158170] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-03T20:18:32.159605] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-03T20:18:32.159722] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-03T20:18:32.161399] [DEBUG] [LOCAL ] MSI: Trimmed 58260 records to 40771 (keeping 200 days of data) [2025-10-03T20:18:32.453559] [DEBUG] [LOCAL ] MSI: Primary data saved (40771 records). [2025-10-03T20:18:32.453724] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-03T20:18:32.454474] [INFO ] [MAIN ] Update Progress: 1412/2370 symbols completed. MSI took 33.9s. Estimated remaining: 2h 14m 39s. Rate: 7.1 symbols/min [2025-10-03T20:18:32.644831] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:32.693621] [DEBUG] [LOCAL ] MTB: Loaded 47003 existing records from primary storage. [2025-10-03T20:18:32.693968] [INFO ] [MAIN ] MTB: Loaded 47003 existing records. [2025-10-03T20:18:32.803718] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-03T20:18:32.899890] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T20:18:32.945747] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:32.946595] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-03T20:18:32.946739] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-03T20:18:32.947026] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-03T20:18:32.947088] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-03T20:18:33.330502] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:33.590724] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-03T20:18:34.016398] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T20:18:34.043377] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T20:18:34.390722] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-03T20:18:35.190672] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-03T20:18:35.297753] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T20:18:35.990722] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-03T20:18:36.559512] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T20:18:36.656577] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T20:18:36.790687] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-03T20:18:37.496354] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T20:18:37.590713] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-03T20:18:38.390705] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-03T20:18:38.602134] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T20:18:39.065999] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T20:18:39.190722] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-03T20:18:39.476967] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T20:18:39.990724] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-03T20:18:40.581668] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T20:18:40.790711] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-03T20:18:41.590731] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-03T20:18:41.731345] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T20:18:42.397334] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-03T20:18:42.420312] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T20:18:43.190678] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-03T20:18:43.290339] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:18:43.656006] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T20:18:43.990696] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-03T20:18:44.639881] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T20:18:44.790710] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-03T20:18:45.392157] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T20:18:45.590701] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-03T20:18:46.197526] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:18:46.390695] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-03T20:18:47.183821] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T20:18:47.195424] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-03T20:18:47.990636] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-03T20:18:48.023902] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T20:18:48.699141] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T20:18:48.790688] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-03T20:18:49.590625] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-03T20:18:49.780016] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T20:18:50.192333] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T20:18:50.390716] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-03T20:18:50.760260] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T20:18:50.762473] [INFO ] [REMOTE ] MSM: Full fetch complete (52130 records). [2025-10-03T20:18:50.762582] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-03T20:18:51.174811] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-03T20:18:51.174913] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-03T20:18:51.175922] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-03T20:18:51.175991] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-03T20:18:51.177275] [DEBUG] [LOCAL ] MSM: Trimmed 52130 records to 35994 (keeping 200 days of data) [2025-10-03T20:18:51.239990] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-03T20:18:51.414638] [DEBUG] [LOCAL ] MSM: Primary data saved (35994 records). [2025-10-03T20:18:51.414816] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-03T20:18:51.414917] [INFO ] [MAIN ] Update Progress: 1413/2370 symbols completed. MSM took 32.7s. Estimated remaining: 2h 14m 38s. Rate: 7.1 symbols/min [2025-10-03T20:18:51.597265] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:51.615633] [DEBUG] [LOCAL ] MTD: Loaded 15267 existing records from primary storage. [2025-10-03T20:18:51.615920] [INFO ] [MAIN ] MTD: Loaded 15267 existing records. [2025-10-03T20:18:51.804263] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:51.804505] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-03T20:18:51.804555] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-03T20:18:51.804848] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-03T20:18:51.804910] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-03T20:18:52.003603] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-03T20:18:52.219150] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:52.248662] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T20:18:52.766983] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T20:18:52.790731] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-03T20:18:53.590740] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-03T20:18:53.675465] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T20:18:54.390720] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-03T20:18:54.601466] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T20:18:54.642452] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T20:18:55.190728] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-03T20:18:55.612405] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T20:18:55.614832] [INFO ] [REMOTE ] MTAL: Full fetch complete (47925 records). [2025-10-03T20:18:55.614972] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-03T20:18:56.002142] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-03T20:18:56.030834] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-10-03T20:18:56.030919] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-10-03T20:18:56.031925] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-10-03T20:18:56.032027] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-10-03T20:18:56.033467] [DEBUG] [LOCAL ] MTAL: Trimmed 47925 records to 37135 (keeping 200 days of data) [2025-10-03T20:18:56.261196] [DEBUG] [LOCAL ] MTAL: Primary data saved (37135 records). [2025-10-03T20:18:56.261340] [INFO ] [MAIN ] MTAL: Full history saved. [2025-10-03T20:18:56.261423] [INFO ] [MAIN ] Update Progress: 1414/2370 symbols completed. MTAL took 31.5s. Estimated remaining: 2h 14m 27s. Rate: 7.1 symbols/min [2025-10-03T20:18:56.466022] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:18:56.532764] [DEBUG] [LOCAL ] MTDR: Loaded 51967 existing records from primary storage. [2025-10-03T20:18:56.533128] [INFO ] [MAIN ] MTDR: Loaded 51967 existing records. [2025-10-03T20:18:56.749416] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:18:56.749809] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-03T20:18:56.750179] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-03T20:18:56.750596] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-03T20:18:56.750687] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-03T20:18:56.815733] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-03T20:18:57.111521] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T20:18:57.161497] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:18:57.198157] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T20:18:57.590738] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-03T20:18:58.390693] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-03T20:18:58.499916] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T20:18:58.612377] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T20:18:59.190725] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-03T20:18:59.780398] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T20:18:59.783242] [INFO ] [REMOTE ] MT: Full fetch complete (73523 records). [2025-10-03T20:18:59.783366] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-03T20:18:59.995833] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-03T20:19:00.207459] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-03T20:19:00.207547] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-03T20:19:00.208764] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-03T20:19:00.208833] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-03T20:19:00.210392] [DEBUG] [LOCAL ] MT: Trimmed 73523 records to 51346 (keeping 200 days of data) [2025-10-03T20:19:00.529728] [DEBUG] [LOCAL ] MT: Primary data saved (51346 records). [2025-10-03T20:19:00.529875] [INFO ] [MAIN ] MT: Full history saved. [2025-10-03T20:19:00.529982] [INFO ] [MAIN ] Update Progress: 1415/2370 symbols completed. MT took 38.1s. Estimated remaining: 2h 14m 16s. Rate: 7.1 symbols/min [2025-10-03T20:19:00.727810] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:00.781670] [DEBUG] [LOCAL ] MTG: Loaded 51648 existing records from primary storage. [2025-10-03T20:19:00.782009] [INFO ] [MAIN ] MTG: Loaded 51648 existing records. [2025-10-03T20:19:00.804114] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-03T20:19:00.997163] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:00.997586] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-03T20:19:00.997717] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-03T20:19:00.998236] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-03T20:19:00.998322] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-03T20:19:01.106151] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T20:19:01.351626] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:19:01.468277] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:01.590722] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-03T20:19:02.390721] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-03T20:19:02.600493] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T20:19:03.019949] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T20:19:03.190693] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-03T20:19:03.990632] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-03T20:19:04.215035] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T20:19:04.509460] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T20:19:04.790735] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-03T20:19:05.590704] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-03T20:19:05.818184] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T20:19:06.390685] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-03T20:19:06.531106] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:19:07.134156] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T20:19:07.190702] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-03T20:19:07.415222] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T20:19:07.990727] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-03T20:19:08.790637] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-03T20:19:08.972534] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T20:19:09.590625] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-03T20:19:09.679289] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T20:19:09.750625] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T20:19:10.390701] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-03T20:19:11.190679] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-03T20:19:11.255468] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T20:19:11.990692] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-03T20:19:12.307204] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T20:19:12.790710] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-03T20:19:12.944787] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T20:19:13.437472] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T20:19:13.590699] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-03T20:19:13.760540] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T20:19:14.390672] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-03T20:19:14.534588] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T20:19:15.190725] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-03T20:19:15.729833] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:19:15.733350] [INFO ] [REMOTE ] MTB: Full fetch complete (68077 records). [2025-10-03T20:19:15.733537] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-03T20:19:16.000423] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-03T20:19:16.061638] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T20:19:16.077608] [INFO ] [REMOTE ] MTD: Full fetch complete (21094 records). [2025-10-03T20:19:16.078161] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-03T20:19:16.329013] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-03T20:19:16.348067] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-03T20:19:16.358937] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-03T20:19:16.365331] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-03T20:19:16.504535] [DEBUG] [LOCAL ] MTB: Trimmed 68077 records to 47340 (keeping 200 days of data) [2025-10-03T20:19:16.691383] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-03T20:19:16.691781] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-03T20:19:16.693094] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-03T20:19:16.693414] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-03T20:19:16.695751] [DEBUG] [LOCAL ] MTD: Trimmed 21094 records to 15389 (keeping 200 days of data) [2025-10-03T20:19:16.791624] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-03T20:19:17.017411] [DEBUG] [LOCAL ] MTB: Primary data saved (47340 records). [2025-10-03T20:19:17.018763] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-03T20:19:17.020135] [INFO ] [MAIN ] Update Progress: 1416/2370 symbols completed. MTB took 44.6s. Estimated remaining: 2h 14m 13s. Rate: 7.1 symbols/min [2025-10-03T20:19:17.152267] [DEBUG] [LOCAL ] MTD: Primary data saved (15389 records). [2025-10-03T20:19:17.162802] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-03T20:19:17.180276] [INFO ] [MAIN ] Update Progress: 1417/2370 symbols completed. MTD took 25.8s. Estimated remaining: 2h 13m 59s. Rate: 7.1 symbols/min [2025-10-03T20:19:17.291473] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:17.439816] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:17.471481] [DEBUG] [LOCAL ] MTH: Loaded 43930 existing records from primary storage. [2025-10-03T20:19:17.472002] [INFO ] [MAIN ] MTH: Loaded 43930 existing records. [2025-10-03T20:19:17.708835] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:17.709177] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-03T20:19:17.709229] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-03T20:19:17.709456] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-03T20:19:17.704555] [DEBUG] [LOCAL ] MTN: Loaded 39368 existing records from primary storage. [2025-10-03T20:19:17.709666] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-03T20:19:17.715205] [INFO ] [MAIN ] MTN: Loaded 39368 existing records. [2025-10-03T20:19:18.171165] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:18.231745] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-03T20:19:18.247526] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-03T20:19:18.269340] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-03T20:19:18.290258] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-03T20:19:18.375032] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:18.397245] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-03T20:19:18.610792] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T20:19:18.700118] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-03T20:19:18.799830] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:18.835574] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T20:19:19.190694] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-03T20:19:19.753271] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T20:19:19.990680] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-03T20:19:20.594673] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T20:19:20.756667] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T20:19:20.790711] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-03T20:19:21.590725] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-03T20:19:21.728712] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:19:22.390699] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-03T20:19:22.418866] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T20:19:23.190717] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-03T20:19:23.660620] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T20:19:24.002554] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-03T20:19:24.030180] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T20:19:24.795175] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-03T20:19:24.803267] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T20:19:25.590635] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-03T20:19:25.712332] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T20:19:26.390698] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-03T20:19:26.826605] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T20:19:27.108369] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T20:19:27.190710] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-03T20:19:27.967791] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:19:27.990679] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-03T20:19:28.790675] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-03T20:19:29.132485] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T20:19:29.590721] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-03T20:19:29.769238] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T20:19:30.390711] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-03T20:19:30.436884] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T20:19:31.190664] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-03T20:19:31.458263] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T20:19:31.726843] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T20:19:31.990706] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-03T20:19:32.628834] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T20:19:32.790778] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-03T20:19:33.502630] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T20:19:33.505218] [INFO ] [REMOTE ] MTDR: Full fetch complete (73631 records). [2025-10-03T20:19:33.505361] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-03T20:19:33.595858] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-03T20:19:33.934238] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-03T20:19:33.934326] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-03T20:19:33.935474] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-03T20:19:33.935543] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-03T20:19:33.937208] [DEBUG] [LOCAL ] MTDR: Trimmed 73631 records to 52341 (keeping 200 days of data) [2025-10-03T20:19:34.208884] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T20:19:34.349037] [DEBUG] [LOCAL ] MTDR: Primary data saved (52341 records). [2025-10-03T20:19:34.349193] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-03T20:19:34.349808] [INFO ] [MAIN ] Update Progress: 1418/2370 symbols completed. MTDR took 38.1s. Estimated remaining: 2h 13m 56s. Rate: 7.1 symbols/min [2025-10-03T20:19:34.399102] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-03T20:19:34.542184] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:34.542357] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-03T20:19:34.542395] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-03T20:19:34.542511] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-03T20:19:34.542554] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-03T20:19:34.542597] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-03T20:19:34.542631] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-03T20:19:34.938121] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:35.190714] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-03T20:19:35.416196] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T20:19:35.717255] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-03T20:19:35.990694] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-03T20:19:36.060085] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T20:19:36.533280] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:19:36.790698] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-03T20:19:37.590682] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-03T20:19:38.342272] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T20:19:38.390627] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-03T20:19:38.868381] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T20:19:38.871625] [INFO ] [REMOTE ] MTG: Full fetch complete (74034 records). [2025-10-03T20:19:38.871835] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-03T20:19:39.195804] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-03T20:19:39.337176] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-03T20:19:39.337269] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-03T20:19:39.338402] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-03T20:19:39.338486] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-03T20:19:39.340239] [DEBUG] [LOCAL ] MTG: Trimmed 74034 records to 52017 (keeping 200 days of data) [2025-10-03T20:19:39.666251] [DEBUG] [LOCAL ] MTG: Primary data saved (52017 records). [2025-10-03T20:19:39.666406] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-03T20:19:39.666495] [INFO ] [MAIN ] Update Progress: 1419/2370 symbols completed. MTG took 39.1s. Estimated remaining: 2h 13m 46s. Rate: 7.1 symbols/min [2025-10-03T20:19:39.858073] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:39.877577] [DEBUG] [LOCAL ] MTRN: Loaded 18219 existing records from primary storage. [2025-10-03T20:19:39.877920] [INFO ] [MAIN ] MTRN: Loaded 18219 existing records. [2025-10-03T20:19:39.993171] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-03T20:19:40.086863] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:40.087294] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-03T20:19:40.087392] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-03T20:19:40.087787] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-03T20:19:40.087939] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-03T20:19:40.438327] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T20:19:40.495373] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T20:19:40.577600] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:40.606491] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:19:40.790711] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-03T20:19:41.217977] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T20:19:41.590700] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-03T20:19:42.028749] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T20:19:42.390697] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-03T20:19:43.190630] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-03T20:19:43.379002] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T20:19:43.669851] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T20:19:43.990690] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-03T20:19:44.790690] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-03T20:19:45.590638] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-03T20:19:45.690721] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T20:19:45.691834] [DEBUG] [REMOTE ] MTR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-03T20:19:45.705980] [WARN ] [REMOTE ] MTR: No data returned for month 2025-06 [2025-10-03T20:19:45.706282] [FATAL] [REMOTE ] MTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:19:45.706396] [FATAL] [MAIN ] MTR: Failed to fetch primary data. [2025-10-03T20:19:45.706540] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:19:45.707162] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-03T20:19:45.707246] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-03T20:19:45.707288] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-03T20:19:45.707330] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-03T20:19:45.707383] [INFO ] [MAIN ] Update Progress: 1420/2370 symbols completed. MTR took 11.4s. Estimated remaining: 2h 13m 36s. Rate: 7.1 symbols/min [2025-10-03T20:19:45.850970] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:19:45.907316] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:45.942794] [DEBUG] [LOCAL ] MTUS: Loaded 28407 existing records from primary storage. [2025-10-03T20:19:45.943297] [INFO ] [MAIN ] MTUS: Loaded 28407 existing records. [2025-10-03T20:19:46.139337] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:46.139622] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-03T20:19:46.139705] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-03T20:19:46.140036] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-03T20:19:46.140097] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-03T20:19:46.395856] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-03T20:19:46.544521] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:47.190685] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-03T20:19:47.462190] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T20:19:47.990695] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-03T20:19:48.797341] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-03T20:19:48.802540] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T20:19:49.459734] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T20:19:49.590626] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-03T20:19:49.944746] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T20:19:50.390715] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-03T20:19:51.190701] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-03T20:19:51.349538] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T20:19:51.403700] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T20:19:51.990726] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-03T20:19:52.101486] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T20:19:52.790682] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-03T20:19:53.595750] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-03T20:19:53.609917] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T20:19:53.931336] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T20:19:54.390703] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-03T20:19:54.552273] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T20:19:55.190725] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-03T20:19:55.734203] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:19:55.737135] [INFO ] [REMOTE ] MTN: Full fetch complete (56281 records). [2025-10-03T20:19:55.737369] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-03T20:19:55.995872] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-03T20:19:56.172970] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-03T20:19:56.173090] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-03T20:19:56.174228] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-03T20:19:56.174311] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-03T20:19:56.176814] [DEBUG] [LOCAL ] MTN: Trimmed 56281 records to 39695 (keeping 200 days of data) [2025-10-03T20:19:56.283870] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T20:19:56.451444] [DEBUG] [LOCAL ] MTN: Primary data saved (39695 records). [2025-10-03T20:19:56.451598] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-03T20:19:56.451713] [INFO ] [MAIN ] Update Progress: 1421/2370 symbols completed. MTN took 39.3s. Estimated remaining: 2h 13m 29s. Rate: 7.1 symbols/min [2025-10-03T20:19:56.628470] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:19:56.657615] [DEBUG] [LOCAL ] MTW: Loaded 26640 existing records from primary storage. [2025-10-03T20:19:56.658062] [INFO ] [MAIN ] MTW: Loaded 26640 existing records. [2025-10-03T20:19:56.795728] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-03T20:19:56.859476] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:19:56.859695] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-03T20:19:56.859799] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-03T20:19:56.860030] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-03T20:19:56.860090] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-03T20:19:57.239617] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:19:57.487423] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:19:57.590703] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-03T20:19:58.390625] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-03T20:19:58.568468] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:19:58.779631] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:19:59.190690] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-03T20:19:59.878882] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T20:19:59.990722] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-03T20:20:00.120440] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T20:20:00.790732] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-03T20:20:01.590717] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-03T20:20:02.390724] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-03T20:20:03.062541] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-03T20:20:03.190738] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-03T20:20:03.308965] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T20:20:03.943470] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (3.15 seconds). [2025-10-03T20:20:03.990632] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-03T20:20:04.046161] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T20:20:04.286855] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:20:04.790731] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-03T20:20:05.463903] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:20:05.590708] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-03T20:20:06.116094] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T20:20:06.119188] [INFO ] [REMOTE ] MTH: Full fetch complete (63226 records). [2025-10-03T20:20:06.119393] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-03T20:20:06.395884] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-03T20:20:06.587221] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-03T20:20:06.587333] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-03T20:20:06.588613] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-03T20:20:06.588728] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-03T20:20:06.590391] [DEBUG] [LOCAL ] MTH: Trimmed 63226 records to 44160 (keeping 200 days of data) [2025-10-03T20:20:06.894444] [DEBUG] [LOCAL ] MTH: Primary data saved (44160 records). [2025-10-03T20:20:06.894795] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-03T20:20:06.895596] [INFO ] [MAIN ] Update Progress: 1422/2370 symbols completed. MTH took 49.9s. Estimated remaining: 2h 13m 22s. Rate: 7.1 symbols/min [2025-10-03T20:20:07.087780] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:07.114699] [DEBUG] [LOCAL ] MTX: Loaded 22888 existing records from primary storage. [2025-10-03T20:20:07.115042] [INFO ] [MAIN ] MTX: Loaded 22888 existing records. [2025-10-03T20:20:07.191897] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-03T20:20:07.264162] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T20:20:07.345890] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:07.346190] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-03T20:20:07.346264] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-03T20:20:07.346527] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-03T20:20:07.346587] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-03T20:20:07.721772] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T20:20:07.770681] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:07.990721] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-03T20:20:08.029075] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T20:20:08.030568] [INFO ] [REMOTE ] MTRN: Full fetch complete (23729 records). [2025-10-03T20:20:08.030691] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-03T20:20:08.458502] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-03T20:20:08.458591] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-03T20:20:08.459174] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-03T20:20:08.459242] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-03T20:20:08.460147] [DEBUG] [LOCAL ] MTRN: Trimmed 23729 records to 18300 (keeping 200 days of data) [2025-10-03T20:20:08.583833] [DEBUG] [LOCAL ] MTRN: Primary data saved (18300 records). [2025-10-03T20:20:08.584026] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-03T20:20:08.584199] [INFO ] [MAIN ] Update Progress: 1423/2370 symbols completed. MTRN took 28.9s. Estimated remaining: 2h 13m 9s. Rate: 7.1 symbols/min [2025-10-03T20:20:08.781426] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:08.790695] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-03T20:20:08.825751] [DEBUG] [LOCAL ] MTZ: Loaded 43383 existing records from primary storage. [2025-10-03T20:20:08.826080] [INFO ] [MAIN ] MTZ: Loaded 43383 existing records. [2025-10-03T20:20:09.040345] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:09.050340] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-03T20:20:09.050848] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T20:20:09.051005] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-03T20:20:09.055688] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-03T20:20:09.055759] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-03T20:20:09.474366] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:09.590731] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-03T20:20:10.037499] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T20:20:10.390712] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-03T20:20:11.190678] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-03T20:20:11.326016] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T20:20:11.452855] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:20:11.990708] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-03T20:20:12.206531] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T20:20:12.790747] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-03T20:20:13.296568] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T20:20:13.590733] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-03T20:20:14.390633] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-03T20:20:14.464928] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T20:20:14.505455] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T20:20:14.508175] [INFO ] [REMOTE ] MTUS: Full fetch complete (42159 records). [2025-10-03T20:20:14.508344] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-03T20:20:14.951035] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-03T20:20:14.951122] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-03T20:20:14.952029] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-03T20:20:14.952094] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-03T20:20:14.953075] [DEBUG] [LOCAL ] MTUS: Trimmed 42159 records to 28494 (keeping 200 days of data) [2025-10-03T20:20:15.132833] [DEBUG] [LOCAL ] MTUS: Primary data saved (28494 records). [2025-10-03T20:20:15.132983] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-03T20:20:15.133071] [INFO ] [MAIN ] Update Progress: 1424/2370 symbols completed. MTUS took 29.4s. Estimated remaining: 2h 12m 59s. Rate: 7.1 symbols/min [2025-10-03T20:20:15.200982] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-03T20:20:15.323418] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:15.338588] [DEBUG] [LOCAL ] MUA: Loaded 12395 existing records from primary storage. [2025-10-03T20:20:15.338899] [INFO ] [MAIN ] MUA: Loaded 12395 existing records. [2025-10-03T20:20:15.543027] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:15.543465] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-03T20:20:15.543551] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-03T20:20:15.549019] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-03T20:20:15.555343] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-03T20:20:15.561723] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T20:20:15.946596] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:15.990690] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-03T20:20:16.790733] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-03T20:20:16.994005] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T20:20:17.354217] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T20:20:17.590734] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-03T20:20:17.617610] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T20:20:18.388269] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T20:20:18.392636] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-03T20:20:19.190736] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-03T20:20:19.392584] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T20:20:19.990726] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-03T20:20:20.610844] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T20:20:20.790731] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-03T20:20:21.590735] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-03T20:20:21.898264] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T20:20:22.032779] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T20:20:22.390708] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-03T20:20:22.713125] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T20:20:23.190727] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-03T20:20:23.436829] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T20:20:23.990749] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-03T20:20:24.459124] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T20:20:24.790628] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-03T20:20:25.033746] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T20:20:25.590676] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-03T20:20:25.939333] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:20:26.390723] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-03T20:20:26.596368] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T20:20:27.190707] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-03T20:20:27.990628] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-03T20:20:28.060568] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T20:20:28.089888] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T20:20:28.790732] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-03T20:20:29.343446] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T20:20:29.590718] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-03T20:20:30.390679] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-03T20:20:30.546318] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T20:20:31.007375] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T20:20:31.190722] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-03T20:20:31.429257] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T20:20:31.990703] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-03T20:20:32.609037] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T20:20:32.790694] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-03T20:20:33.171236] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T20:20:33.590728] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-03T20:20:33.967252] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T20:20:34.390664] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-03T20:20:34.773873] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T20:20:35.190685] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-03T20:20:35.284491] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T20:20:35.990713] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-03T20:20:36.277140] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T20:20:36.278936] [INFO ] [REMOTE ] MTW: Full fetch complete (38397 records). [2025-10-03T20:20:36.279031] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-03T20:20:36.696036] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-03T20:20:36.696118] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-03T20:20:36.697031] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-03T20:20:36.697099] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-03T20:20:36.698195] [DEBUG] [LOCAL ] MTW: Trimmed 38397 records to 26848 (keeping 200 days of data) [2025-10-03T20:20:36.790695] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-03T20:20:36.866123] [DEBUG] [LOCAL ] MTW: Primary data saved (26848 records). [2025-10-03T20:20:36.866275] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-03T20:20:36.866370] [INFO ] [MAIN ] Update Progress: 1425/2370 symbols completed. MTW took 40.4s. Estimated remaining: 2h 12m 59s. Rate: 7.1 symbols/min [2025-10-03T20:20:37.049834] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:37.072754] [DEBUG] [LOCAL ] MUC: Loaded 20780 existing records from primary storage. [2025-10-03T20:20:37.073084] [INFO ] [MAIN ] MUC: Loaded 20780 existing records. [2025-10-03T20:20:37.273583] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:37.273883] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-03T20:20:37.273949] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-03T20:20:37.274309] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-03T20:20:37.274372] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-03T20:20:37.603725] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-03T20:20:37.598463] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T20:20:37.637192] [INFO ] [REMOTE ] MTX: Full fetch complete (31234 records). [2025-10-03T20:20:37.654002] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-03T20:20:37.676171] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:37.903807] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T20:20:38.139401] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-03T20:20:38.139492] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-03T20:20:38.140249] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-03T20:20:38.140320] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-03T20:20:38.141365] [DEBUG] [LOCAL ] MTX: Trimmed 31234 records to 23006 (keeping 200 days of data) [2025-10-03T20:20:38.291569] [DEBUG] [LOCAL ] MTX: Primary data saved (23006 records). [2025-10-03T20:20:38.291751] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-03T20:20:38.291872] [INFO ] [MAIN ] Update Progress: 1426/2370 symbols completed. MTX took 31.4s. Estimated remaining: 2h 12m 46s. Rate: 7.1 symbols/min [2025-10-03T20:20:38.400039] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-03T20:20:38.488632] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:38.502467] [DEBUG] [LOCAL ] MUE: Loaded 11972 existing records from primary storage. [2025-10-03T20:20:38.502762] [INFO ] [MAIN ] MUE: Loaded 11972 existing records. [2025-10-03T20:20:38.723312] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T20:20:38.730099] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:38.736638] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-03T20:20:38.736754] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-03T20:20:38.736956] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-03T20:20:38.737016] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-03T20:20:39.149594] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:39.190699] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-03T20:20:39.768555] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T20:20:39.990723] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-03T20:20:40.694959] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T20:20:40.790705] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-03T20:20:41.105529] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T20:20:41.590700] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-03T20:20:42.390634] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-03T20:20:42.421430] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T20:20:42.693491] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T20:20:43.190687] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-03T20:20:43.313615] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:20:43.990708] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-03T20:20:44.550678] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T20:20:44.790725] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-03T20:20:45.304828] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T20:20:45.449268] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:20:45.450676] [INFO ] [REMOTE ] MUA: Full fetch complete (18846 records). [2025-10-03T20:20:45.450758] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-03T20:20:45.605705] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-03T20:20:45.889521] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-03T20:20:45.889686] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-03T20:20:45.890189] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-03T20:20:45.890256] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-03T20:20:45.890953] [DEBUG] [LOCAL ] MUA: Trimmed 18846 records to 12468 (keeping 200 days of data) [2025-10-03T20:20:45.967339] [DEBUG] [LOCAL ] MUA: Primary data saved (12468 records). [2025-10-03T20:20:45.967488] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-03T20:20:45.967600] [INFO ] [MAIN ] Update Progress: 1427/2370 symbols completed. MUA took 30.8s. Estimated remaining: 2h 12m 37s. Rate: 7.1 symbols/min [2025-10-03T20:20:46.156295] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:46.217902] [DEBUG] [LOCAL ] MUFG: Loaded 52941 existing records from primary storage. [2025-10-03T20:20:46.218273] [INFO ] [MAIN ] MUFG: Loaded 52941 existing records. [2025-10-03T20:20:46.404833] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-03T20:20:46.411228] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:46.412241] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-03T20:20:46.412295] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-03T20:20:46.412522] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-03T20:20:46.412607] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-03T20:20:46.806375] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:47.095347] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T20:20:47.099934] [INFO ] [REMOTE ] MTZ: Full fetch complete (63412 records). [2025-10-03T20:20:47.100151] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-03T20:20:47.196028] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-03T20:20:47.520219] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:20:47.612123] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-03T20:20:47.612243] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-03T20:20:47.613448] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-03T20:20:47.613523] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-03T20:20:47.615606] [DEBUG] [LOCAL ] MTZ: Trimmed 63412 records to 43701 (keeping 200 days of data) [2025-10-03T20:20:47.894035] [DEBUG] [LOCAL ] MTZ: Primary data saved (43701 records). [2025-10-03T20:20:47.894185] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-03T20:20:47.894277] [INFO ] [MAIN ] Update Progress: 1428/2370 symbols completed. MTZ took 39.3s. Estimated remaining: 2h 12m 25s. Rate: 7.1 symbols/min [2025-10-03T20:20:47.999789] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-03T20:20:48.084965] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:20:48.107732] [DEBUG] [LOCAL ] MUJ: Loaded 13577 existing records from primary storage. [2025-10-03T20:20:48.108120] [INFO ] [MAIN ] MUJ: Loaded 13577 existing records. [2025-10-03T20:20:48.301536] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:20:48.301822] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-03T20:20:48.301875] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-03T20:20:48.302106] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-03T20:20:48.302167] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-03T20:20:48.710452] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:20:48.790681] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-03T20:20:48.847141] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T20:20:49.173430] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T20:20:49.591999] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-03T20:20:49.596497] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T20:20:50.390734] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-03T20:20:51.190722] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-03T20:20:51.478497] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T20:20:51.515413] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T20:20:51.715400] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T20:20:51.990718] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-03T20:20:52.790727] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-03T20:20:52.886816] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:20:53.590701] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-03T20:20:54.390677] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-03T20:20:54.564522] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T20:20:54.584739] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T20:20:55.190724] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-03T20:20:55.263546] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:20:55.990709] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-03T20:20:56.335448] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:20:56.790709] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-03T20:20:56.855104] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:20:57.590676] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-03T20:20:57.892329] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T20:20:58.390729] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-03T20:20:59.190757] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-03T20:20:59.563997] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T20:20:59.604788] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T20:20:59.990638] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-03T20:21:00.048478] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T20:21:00.790753] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-03T20:21:01.590726] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-03T20:21:01.622870] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T20:21:01.913336] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T20:21:02.390720] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-03T20:21:02.744222] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T20:21:03.190732] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-03T20:21:03.326160] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T20:21:03.990694] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-03T20:21:04.433381] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T20:21:04.790667] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-03T20:21:04.866553] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T20:21:05.590680] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-03T20:21:05.723669] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T20:21:05.725185] [INFO ] [REMOTE ] MUC: Full fetch complete (30234 records). [2025-10-03T20:21:05.725298] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-03T20:21:06.142429] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-03T20:21:06.142572] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-03T20:21:06.143546] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-03T20:21:06.143636] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-03T20:21:06.144688] [DEBUG] [LOCAL ] MUC: Trimmed 30234 records to 20852 (keeping 200 days of data) [2025-10-03T20:21:06.276025] [DEBUG] [LOCAL ] MUC: Primary data saved (20852 records). [2025-10-03T20:21:06.276157] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-03T20:21:06.276291] [INFO ] [MAIN ] Update Progress: 1429/2370 symbols completed. MUC took 29.4s. Estimated remaining: 2h 12m 23s. Rate: 7.1 symbols/min [2025-10-03T20:21:06.395112] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-03T20:21:06.474564] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:06.555125] [DEBUG] [LOCAL ] MUR: Loaded 53312 existing records from primary storage. [2025-10-03T20:21:06.555512] [INFO ] [MAIN ] MUR: Loaded 53312 existing records. [2025-10-03T20:21:06.778293] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:06.773753] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T20:21:06.782719] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-03T20:21:06.782823] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-03T20:21:06.783348] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-03T20:21:06.783443] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-03T20:21:07.190709] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:07.190920] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-03T20:21:07.990683] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-03T20:21:08.221901] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T20:21:08.388474] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T20:21:08.790707] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-03T20:21:09.128028] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T20:21:09.590739] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-03T20:21:10.390790] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-03T20:21:10.609503] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T20:21:11.152102] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T20:21:11.190681] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-03T20:21:11.446105] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T20:21:11.990683] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-03T20:21:12.125195] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T20:21:12.790752] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-03T20:21:13.124464] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:21:13.590768] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-03T20:21:14.390704] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-03T20:21:14.743831] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T20:21:15.043351] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T20:21:15.044999] [INFO ] [REMOTE ] MUJ: Full fetch complete (20535 records). [2025-10-03T20:21:15.045103] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-03T20:21:15.195783] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-03T20:21:15.495169] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-03T20:21:15.495321] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-03T20:21:15.496044] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-03T20:21:15.496184] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-03T20:21:15.497228] [DEBUG] [LOCAL ] MUJ: Trimmed 20535 records to 13667 (keeping 200 days of data) [2025-10-03T20:21:15.614816] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T20:21:15.629468] [DEBUG] [LOCAL ] MUJ: Primary data saved (13667 records). [2025-10-03T20:21:15.641292] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-03T20:21:15.642258] [INFO ] [MAIN ] Update Progress: 1430/2370 symbols completed. MUJ took 27.7s. Estimated remaining: 2h 12m 15s. Rate: 7.1 symbols/min [2025-10-03T20:21:15.818279] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:15.845220] [DEBUG] [LOCAL ] MUSA: Loaded 24863 existing records from primary storage. [2025-10-03T20:21:15.845595] [INFO ] [MAIN ] MUSA: Loaded 24863 existing records. [2025-10-03T20:21:15.995869] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-03T20:21:16.039749] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:16.040017] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-03T20:21:16.040068] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-03T20:21:16.040318] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-03T20:21:16.040377] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-03T20:21:16.407879] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:16.790716] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-03T20:21:17.094820] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:21:17.167737] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:21:17.590722] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-03T20:21:18.390694] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-03T20:21:18.679372] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T20:21:18.733268] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:21:18.984117] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T20:21:19.190686] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-03T20:21:19.990682] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-03T20:21:20.790727] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-03T20:21:21.063832] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T20:21:21.131153] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:21:21.590705] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-03T20:21:22.390719] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-03T20:21:22.602686] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T20:21:23.190706] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-03T20:21:23.359209] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:21:23.558772] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T20:21:23.990700] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-03T20:21:24.659743] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T20:21:24.662965] [INFO ] [REMOTE ] MUFG: Full fetch complete (75533 records). [2025-10-03T20:21:24.663192] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-03T20:21:24.795816] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-03T20:21:25.138003] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-03T20:21:25.138275] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-03T20:21:25.139791] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-03T20:21:25.139904] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-03T20:21:25.141778] [DEBUG] [LOCAL ] MUFG: Trimmed 75533 records to 53304 (keeping 200 days of data) [2025-10-03T20:21:25.262604] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T20:21:25.389896] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T20:21:25.392320] [INFO ] [REMOTE ] MUE: Full fetch complete (16027 records). [2025-10-03T20:21:25.393077] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-03T20:21:25.594662] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-03T20:21:25.859514] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-03T20:21:25.863738] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-03T20:21:25.867927] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-03T20:21:25.900564] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-03T20:21:25.933982] [DEBUG] [LOCAL ] MUE: Trimmed 16027 records to 12061 (keeping 200 days of data) [2025-10-03T20:21:25.985714] [DEBUG] [LOCAL ] MUFG: Primary data saved (53304 records). [2025-10-03T20:21:26.008629] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-03T20:21:26.011076] [INFO ] [MAIN ] Update Progress: 1431/2370 symbols completed. MUFG took 40.0s. Estimated remaining: 2h 12m 8s. Rate: 7.1 symbols/min [2025-10-03T20:21:26.215835] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:26.217365] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-03T20:21:26.217802] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-03T20:21:26.219165] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-03T20:21:26.219909] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-03T20:21:26.220594] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-03T20:21:26.220952] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-03T20:21:26.392740] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-03T20:21:26.433082] [DEBUG] [LOCAL ] MUE: Primary data saved (12061 records). [2025-10-03T20:21:26.452014] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-03T20:21:26.470572] [INFO ] [MAIN ] Update Progress: 1432/2370 symbols completed. MUE took 48.2s. Estimated remaining: 2h 11m 54s. Rate: 7.1 symbols/min [2025-10-03T20:21:26.783926] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:26.836696] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:26.882633] [DEBUG] [LOCAL ] MUX: Loaded 43201 existing records from primary storage. [2025-10-03T20:21:26.883058] [INFO ] [MAIN ] MUX: Loaded 43201 existing records. [2025-10-03T20:21:27.097867] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:27.098118] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-03T20:21:27.098261] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-03T20:21:27.098740] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-03T20:21:27.098862] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-03T20:21:27.192540] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-03T20:21:27.506711] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T20:21:27.606420] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:27.691036] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T20:21:27.717842] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T20:21:27.990740] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-03T20:21:28.790753] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-03T20:21:29.089056] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:21:29.089450] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-03T20:21:29.089592] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:21:29.089738] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-03T20:21:29.089818] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:21:29.089903] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-03T20:21:29.089984] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-03T20:21:29.090033] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-03T20:21:29.090101] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-03T20:21:29.090186] [INFO ] [MAIN ] Update Progress: 1433/2370 symbols completed. MUSE took 3.1s. Estimated remaining: 2h 11m 42s. Rate: 7.1 symbols/min [2025-10-03T20:21:29.306863] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:29.324311] [DEBUG] [LOCAL ] MVF: Loaded 13165 existing records from primary storage. [2025-10-03T20:21:29.324604] [INFO ] [MAIN ] MVF: Loaded 13165 existing records. [2025-10-03T20:21:29.537612] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:29.538098] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-03T20:21:29.538203] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-03T20:21:29.538512] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-03T20:21:29.538578] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-03T20:21:29.605233] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-03T20:21:29.613553] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T20:21:29.993160] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:30.390688] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-03T20:21:31.190669] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-03T20:21:31.555682] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T20:21:31.834173] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T20:21:31.990619] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-03T20:21:32.384282] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:21:32.790686] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-03T20:21:33.590667] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-03T20:21:33.981598] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T20:21:34.328313] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T20:21:34.390681] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-03T20:21:34.542411] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:21:35.190678] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-03T20:21:35.990686] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-03T20:21:36.156766] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:21:36.250999] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T20:21:36.790706] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-03T20:21:37.590699] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-03T20:21:37.891150] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T20:21:38.349370] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T20:21:38.390719] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-03T20:21:38.829617] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T20:21:39.190724] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-03T20:21:39.885844] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T20:21:39.990733] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-03T20:21:40.790694] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-03T20:21:40.973748] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:21:41.304335] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T20:21:41.590720] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-03T20:21:42.374441] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T20:21:42.390602] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-03T20:21:42.887609] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T20:21:43.190697] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-03T20:21:43.990730] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-03T20:21:44.075256] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:21:44.462210] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T20:21:44.790721] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-03T20:21:45.448791] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T20:21:45.452336] [INFO ] [REMOTE ] MUR: Full fetch complete (76510 records). [2025-10-03T20:21:45.452508] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-03T20:21:45.595770] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-03T20:21:45.913764] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-03T20:21:45.913869] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-03T20:21:45.915092] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-03T20:21:45.915160] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-03T20:21:45.918346] [DEBUG] [LOCAL ] MUR: Trimmed 76510 records to 53698 (keeping 200 days of data) [2025-10-03T20:21:46.278625] [DEBUG] [LOCAL ] MUR: Primary data saved (53698 records). [2025-10-03T20:21:46.278861] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-03T20:21:46.279005] [INFO ] [MAIN ] Update Progress: 1434/2370 symbols completed. MUR took 40.0s. Estimated remaining: 2h 11m 39s. Rate: 7.1 symbols/min [2025-10-03T20:21:46.392179] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-03T20:21:46.480636] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:46.493367] [DEBUG] [LOCAL ] MVO: Loaded 8973 existing records from primary storage. [2025-10-03T20:21:46.493617] [INFO ] [MAIN ] MVO: Loaded 8973 existing records. [2025-10-03T20:21:46.641726] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T20:21:46.703000] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:21:46.759945] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:46.760229] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-03T20:21:46.760286] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-03T20:21:46.760507] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-03T20:21:46.760566] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-03T20:21:47.153989] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:47.190693] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-03T20:21:47.340799] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T20:21:47.342721] [INFO ] [REMOTE ] MUSA: Full fetch complete (35166 records). [2025-10-03T20:21:47.342798] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-03T20:21:47.743091] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-03T20:21:47.743182] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-03T20:21:47.744097] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-03T20:21:47.744171] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-03T20:21:47.745264] [DEBUG] [LOCAL ] MUSA: Trimmed 35166 records to 24978 (keeping 200 days of data) [2025-10-03T20:21:47.911626] [DEBUG] [LOCAL ] MUSA: Primary data saved (24978 records). [2025-10-03T20:21:47.911803] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-03T20:21:47.911908] [INFO ] [MAIN ] Update Progress: 1435/2370 symbols completed. MUSA took 32.3s. Estimated remaining: 2h 11m 26s. Rate: 7.1 symbols/min [2025-10-03T20:21:47.995734] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-03T20:21:48.117341] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:48.132873] [DEBUG] [LOCAL ] MVT: Loaded 10328 existing records from primary storage. [2025-10-03T20:21:48.133139] [INFO ] [MAIN ] MVT: Loaded 10328 existing records. [2025-10-03T20:21:48.263417] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T20:21:48.350467] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:48.350738] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-03T20:21:48.350803] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-03T20:21:48.351044] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-03T20:21:48.351127] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-03T20:21:48.739494] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:48.790716] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-03T20:21:49.590637] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-03T20:21:49.714357] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T20:21:49.866947] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T20:21:50.390717] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-03T20:21:50.666991] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T20:21:51.190699] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-03T20:21:51.630117] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T20:21:51.990680] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-03T20:21:52.306079] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T20:21:52.790710] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-03T20:21:53.543661] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T20:21:53.546700] [INFO ] [REMOTE ] MUX: Full fetch complete (59483 records). [2025-10-03T20:21:53.546857] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-03T20:21:53.602563] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-03T20:21:53.768876] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T20:21:54.015174] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-03T20:21:54.015267] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-03T20:21:54.016359] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-03T20:21:54.016426] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-03T20:21:54.017924] [DEBUG] [LOCAL ] MUX: Trimmed 59483 records to 43578 (keeping 200 days of data) [2025-10-03T20:21:54.283745] [DEBUG] [LOCAL ] MUX: Primary data saved (43578 records). [2025-10-03T20:21:54.283877] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-03T20:21:54.283963] [INFO ] [MAIN ] Update Progress: 1436/2370 symbols completed. MUX took 27.8s. Estimated remaining: 2h 11m 16s. Rate: 7.1 symbols/min [2025-10-03T20:21:54.395817] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-03T20:21:54.476376] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:21:54.524866] [DEBUG] [LOCAL ] MWA: Loaded 46871 existing records from primary storage. [2025-10-03T20:21:54.525222] [INFO ] [MAIN ] MWA: Loaded 46871 existing records. [2025-10-03T20:21:54.740815] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:21:54.748880] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-03T20:21:54.749298] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-03T20:21:54.749201] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T20:21:54.752316] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-03T20:21:54.752704] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-03T20:21:55.159336] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:21:55.190713] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-03T20:21:55.381108] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T20:21:55.990683] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-03T20:21:56.089745] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T20:21:56.741269] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T20:21:56.790713] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-03T20:21:57.590712] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-03T20:21:57.662361] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T20:21:58.390665] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-03T20:21:58.520032] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T20:21:59.069819] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T20:21:59.190701] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-03T20:21:59.990693] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-03T20:22:00.097881] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T20:22:00.790692] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-03T20:22:01.027615] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T20:22:01.590728] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-03T20:22:02.390706] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-03T20:22:02.568948] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T20:22:02.569967] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T20:22:03.190721] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-03T20:22:03.429014] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T20:22:03.990722] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-03T20:22:04.015414] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T20:22:04.790701] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-03T20:22:04.832034] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T20:22:04.833489] [INFO ] [REMOTE ] MVF: Full fetch complete (19074 records). [2025-10-03T20:22:04.833565] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-03T20:22:05.255473] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-03T20:22:05.255588] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-03T20:22:05.256123] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-03T20:22:05.256190] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-03T20:22:05.256832] [DEBUG] [LOCAL ] MVF: Trimmed 19074 records to 13294 (keeping 200 days of data) [2025-10-03T20:22:05.340865] [DEBUG] [LOCAL ] MVF: Primary data saved (13294 records). [2025-10-03T20:22:05.341020] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-03T20:22:05.341126] [INFO ] [MAIN ] Update Progress: 1437/2370 symbols completed. MVF took 36.3s. Estimated remaining: 2h 11m 10s. Rate: 7.1 symbols/min [2025-10-03T20:22:05.548729] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T20:22:05.590799] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-03T20:22:06.390698] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-03T20:22:07.190672] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-03T20:22:07.247950] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:22:07.276850] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T20:22:07.990720] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-03T20:22:08.126215] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T20:22:08.790727] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-03T20:22:09.590739] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-03T20:22:09.651356] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T20:22:09.711942] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T20:22:10.311471] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T20:22:10.390662] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-03T20:22:11.190690] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-03T20:22:11.242280] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:22:11.797217] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T20:22:11.990696] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-03T20:22:12.655638] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:22:12.656857] [INFO ] [REMOTE ] MVO: Full fetch complete (14405 records). [2025-10-03T20:22:12.656935] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-03T20:22:12.795764] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-03T20:22:13.053676] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-03T20:22:13.053775] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-03T20:22:13.054139] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-03T20:22:13.054189] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-03T20:22:13.054792] [DEBUG] [LOCAL ] MVO: Trimmed 14405 records to 9019 (keeping 200 days of data) [2025-10-03T20:22:13.113944] [DEBUG] [LOCAL ] MVO: Primary data saved (9019 records). [2025-10-03T20:22:13.114118] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-03T20:22:13.114239] [INFO ] [MAIN ] Update Progress: 1438/2370 symbols completed. MVO took 26.8s. Estimated remaining: 2h 11m 1s. Rate: 7.1 symbols/min [2025-10-03T20:22:13.590741] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-03T20:22:14.694359] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:22:14.697225] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-03T20:22:14.799481] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T20:22:15.190739] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-03T20:22:15.590685] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T20:22:15.990741] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-03T20:22:16.537297] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T20:22:16.538823] [INFO ] [REMOTE ] MVT: Full fetch complete (14545 records). [2025-10-03T20:22:16.538951] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-03T20:22:16.978143] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-03T20:22:16.978309] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-03T20:22:16.978765] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-03T20:22:16.978856] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-03T20:22:16.979828] [DEBUG] [LOCAL ] MVT: Trimmed 14545 records to 10367 (keeping 200 days of data) [2025-10-03T20:22:17.061685] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T20:22:17.081896] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-03T20:22:17.098755] [DEBUG] [LOCAL ] MVT: Primary data saved (10367 records). [2025-10-03T20:22:17.098979] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-03T20:22:17.099094] [INFO ] [MAIN ] Update Progress: 1439/2370 symbols completed. MVT took 29.2s. Estimated remaining: 2h 10m 49s. Rate: 7.1 symbols/min [2025-10-03T20:22:18.967495] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T20:22:18.978695] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-03T20:22:20.394866] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T20:22:20.405253] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-03T20:22:22.129010] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T20:22:22.140142] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-03T20:22:23.917688] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T20:22:23.928902] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-03T20:22:25.629061] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T20:22:25.640945] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-03T20:22:26.985184] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:22:26.987550] [INFO ] [REMOTE ] MWA: Full fetch complete (67714 records). [2025-10-03T20:22:26.987785] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-03T20:22:27.425079] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-03T20:22:27.425182] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-03T20:22:27.426246] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-03T20:22:27.426312] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-03T20:22:27.427763] [DEBUG] [LOCAL ] MWA: Trimmed 67714 records to 47219 (keeping 200 days of data) [2025-10-03T20:22:27.736149] [DEBUG] [LOCAL ] MWA: Primary data saved (47219 records). [2025-10-03T20:22:27.736311] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-03T20:22:27.737170] [INFO ] [MAIN ] Update Progress: 1440/2370 symbols completed. MWA took 33.5s. Estimated remaining: 2h 10m 42s. Rate: 7.1 symbols/min [2025-10-03T20:22:28.341449] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:22:28.504835] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:22:28.427198] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:22:28.526639] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-03T20:22:28.546452] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-03T20:22:28.561319] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-03T20:22:28.564535] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-03T20:22:28.565526] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-03T20:22:28.592296] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:22:28.571873] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-03T20:22:28.607379] [DEBUG] [LOCAL ] MXF: Loaded 5795 existing records from primary storage. [2025-10-03T20:22:28.618114] [INFO ] [MAIN ] MXF: Loaded 5795 existing records. [2025-10-03T20:22:28.693118] [DEBUG] [LOCAL ] MX: Loaded 22864 existing records from primary storage. [2025-10-03T20:22:28.774105] [INFO ] [MAIN ] MX: Loaded 22864 existing records. [2025-10-03T20:22:28.825470] [DEBUG] [LOCAL ] MYD: Loaded 13825 existing records from primary storage. [2025-10-03T20:22:28.873800] [INFO ] [MAIN ] MYD: Loaded 13825 existing records. [2025-10-03T20:22:29.344189] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:22:29.460913] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-03T20:22:29.552717] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-03T20:22:29.591555] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-03T20:22:29.552595] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:22:29.605790] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:22:29.617355] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-03T20:22:29.606742] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-03T20:22:29.647940] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-03T20:22:29.648205] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-03T20:22:29.687923] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-03T20:22:29.726096] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-03T20:22:29.726330] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-03T20:22:29.725991] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:22:29.805852] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-03T20:22:29.770061] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-03T20:22:29.858411] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-03T20:22:30.671354] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T20:22:30.683168] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-03T20:22:30.872920] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:22:30.889711] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:22:30.905631] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-03T20:22:30.932479] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-03T20:22:30.983461] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:22:30.985131] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-03T20:22:31.377273] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T20:22:31.378774] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-03T20:22:31.828370] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T20:22:31.834516] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-03T20:22:31.844290] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T20:22:31.847932] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-03T20:22:31.896144] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T20:22:31.897390] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-03T20:22:32.074164] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T20:22:32.078864] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-03T20:22:32.414149] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-03T20:22:32.415267] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-03T20:22:32.769494] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T20:22:32.772877] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-03T20:22:32.797919] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T20:22:32.799229] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-03T20:22:32.879503] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T20:22:32.883381] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-03T20:22:33.008864] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T20:22:33.012207] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-03T20:22:33.247182] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T20:22:33.515549] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T20:22:33.590689] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-03T20:22:33.787852] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T20:22:33.992767] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T20:22:34.060965] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T20:22:34.390694] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-03T20:22:34.960014] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T20:22:35.190719] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-03T20:22:35.990667] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-03T20:22:36.217848] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T20:22:36.502210] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T20:22:36.790735] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-03T20:22:37.187182] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-03T20:22:37.590689] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-03T20:22:38.390711] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-03T20:22:38.442719] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T20:22:39.190905] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-03T20:22:39.592957] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T20:22:39.987913] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T20:22:39.990669] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-03T20:22:40.790624] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-03T20:22:40.875399] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T20:22:41.231949] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T20:22:41.232755] [INFO ] [REMOTE ] MXE: Full fetch complete (2657 records). [2025-10-03T20:22:41.232834] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-03T20:22:41.432760] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T20:22:41.433005] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:22:41.433084] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:22:41.433168] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-03T20:22:41.433247] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-03T20:22:41.433288] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-03T20:22:41.433331] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-03T20:22:41.433399] [INFO ] [MAIN ] Update Progress: 1441/2370 symbols completed. MXE took 13.7s. Estimated remaining: 2h 10m 37s. Rate: 7.1 symbols/min [2025-10-03T20:22:41.602454] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-03T20:22:41.639818] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:22:41.669270] [DEBUG] [LOCAL ] MYE: Loaded 24709 existing records from primary storage. [2025-10-03T20:22:41.669570] [INFO ] [MAIN ] MYE: Loaded 24709 existing records. [2025-10-03T20:22:41.861958] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:22:41.862195] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-03T20:22:41.862253] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-03T20:22:41.862507] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-03T20:22:41.862571] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-03T20:22:42.284148] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:22:42.390722] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-03T20:22:42.786079] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T20:22:43.190725] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-03T20:22:43.791789] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T20:22:43.990692] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-03T20:22:44.398769] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T20:22:44.790688] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-03T20:22:45.227768] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T20:22:45.590694] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-03T20:22:45.700604] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:22:46.390630] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-03T20:22:46.779109] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T20:22:47.190668] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-03T20:22:47.329730] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T20:22:47.990692] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-03T20:22:48.325363] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T20:22:48.790728] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-03T20:22:48.879358] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T20:22:49.590622] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-03T20:22:49.990288] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T20:22:50.390683] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-03T20:22:50.488716] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T20:22:51.190708] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-03T20:22:51.750025] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:22:51.990702] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-03T20:22:52.012418] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T20:22:52.790715] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-03T20:22:53.590745] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-03T20:22:54.390717] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-03T20:23:06.331209] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (11.94 seconds). [2025-10-03T20:23:06.335078] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-03T20:23:07.059638] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:23:07.061039] [INFO ] [REMOTE ] MYD: Full fetch complete (20728 records). [2025-10-03T20:23:07.061113] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-03T20:23:07.332927] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (13.74 seconds). [2025-10-03T20:23:07.375435] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-03T20:23:07.465295] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-03T20:23:07.465380] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-03T20:23:07.465911] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-03T20:23:07.465999] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-03T20:23:07.466610] [DEBUG] [LOCAL ] MYD: Trimmed 20728 records to 13877 (keeping 200 days of data) [2025-10-03T20:23:07.551336] [DEBUG] [LOCAL ] MYD: Primary data saved (13877 records). [2025-10-03T20:23:07.551485] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-03T20:23:07.551613] [INFO ] [MAIN ] Update Progress: 1442/2370 symbols completed. MYD took 39.8s. Estimated remaining: 2h 10m 40s. Rate: 7.1 symbols/min [2025-10-03T20:23:07.729784] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:07.751944] [DEBUG] [LOCAL ] MYI: Loaded 19536 existing records from primary storage. [2025-10-03T20:23:07.752260] [INFO ] [MAIN ] MYI: Loaded 19536 existing records. [2025-10-03T20:23:07.956148] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:07.956455] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-03T20:23:07.956532] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-03T20:23:07.956815] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-03T20:23:07.956893] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-03T20:23:08.188324] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T20:23:08.281017] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-03T20:23:08.403297] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:08.403775] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-03T20:23:09.023779] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (16.23 seconds). [2025-10-03T20:23:09.031464] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-03T20:23:09.434572] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (17.44 seconds). [2025-10-03T20:23:09.442483] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-03T20:23:09.803885] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T20:23:09.809946] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-03T20:23:10.010947] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T20:23:10.012480] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-03T20:23:10.041807] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T20:23:10.047921] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-03T20:23:10.429994] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T20:23:10.435701] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-03T20:23:10.739253] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T20:23:10.740799] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-03T20:23:11.013244] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T20:23:11.018160] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-03T20:23:11.174619] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T20:23:11.175660] [INFO ] [REMOTE ] MXF: Full fetch complete (10205 records). [2025-10-03T20:23:11.175745] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-03T20:23:11.479623] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:23:11.513942] [INFO ] [REMOTE ] MX: Full fetch complete (31809 records). [2025-10-03T20:23:11.514286] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-03T20:23:11.691192] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T20:23:11.734885] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-03T20:23:11.758222] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-03T20:23:11.765109] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-03T20:23:11.793057] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-03T20:23:11.811443] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-03T20:23:11.899684] [DEBUG] [LOCAL ] MXF: Trimmed 10205 records to 5813 (keeping 200 days of data) [2025-10-03T20:23:11.980320] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T20:23:12.027019] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-03T20:23:12.059009] [DEBUG] [LOCAL ] MXF: Primary data saved (5813 records). [2025-10-03T20:23:12.084619] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-03T20:23:12.101548] [INFO ] [MAIN ] Update Progress: 1443/2370 symbols completed. MXF took 44.4s. Estimated remaining: 2h 10m 29s. Rate: 7.1 symbols/min [2025-10-03T20:23:12.131676] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-03T20:23:12.176960] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-03T20:23:12.210218] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-03T20:23:12.222030] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-03T20:23:12.246325] [DEBUG] [LOCAL ] MX: Trimmed 31809 records to 22993 (keeping 200 days of data) [2025-10-03T20:23:12.402784] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:12.422363] [DEBUG] [LOCAL ] MYN: Loaded 10046 existing records from primary storage. [2025-10-03T20:23:12.423703] [INFO ] [MAIN ] MYN: Loaded 10046 existing records. [2025-10-03T20:23:12.629260] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:12.630060] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-03T20:23:12.630443] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-03T20:23:12.632615] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-03T20:23:12.632989] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-03T20:23:13.070408] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T20:23:13.097940] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:13.105677] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-03T20:23:13.106767] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-03T20:23:13.107591] [DEBUG] [LOCAL ] MX: Primary data saved (22993 records). [2025-10-03T20:23:13.108838] [INFO ] [MAIN ] MX: Full history saved. [2025-10-03T20:23:13.108976] [INFO ] [MAIN ] Update Progress: 1444/2370 symbols completed. MX took 45.4s. Estimated remaining: 2h 10m 16s. Rate: 7.1 symbols/min [2025-10-03T20:23:13.309456] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:13.355991] [DEBUG] [LOCAL ] NABL: Loaded 39614 existing records from primary storage. [2025-10-03T20:23:13.370210] [INFO ] [MAIN ] NABL: Loaded 39614 existing records. [2025-10-03T20:23:13.371529] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T20:23:13.414825] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-03T20:23:13.601291] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:13.601556] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-03T20:23:13.601633] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-03T20:23:13.601962] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-03T20:23:13.602037] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-03T20:23:14.130969] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:14.140200] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-03T20:23:14.142145] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T20:23:14.148898] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-03T20:23:14.410179] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T20:23:14.417545] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-03T20:23:14.830674] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T20:23:14.839700] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-03T20:23:15.090271] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T20:23:15.093872] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-03T20:23:15.303511] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T20:23:15.309569] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-03T20:23:15.590244] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T20:23:15.598994] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-03T20:23:15.650206] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T20:23:15.654680] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-03T20:23:16.008870] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T20:23:16.011837] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-03T20:23:16.027356] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:23:16.029106] [INFO ] [REMOTE ] MYE: Full fetch complete (36471 records). [2025-10-03T20:23:16.029194] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-03T20:23:16.465066] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-03T20:23:16.465163] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-03T20:23:16.466119] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-03T20:23:16.466190] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-03T20:23:16.467297] [DEBUG] [LOCAL ] MYE: Trimmed 36471 records to 24865 (keeping 200 days of data) [2025-10-03T20:23:16.640802] [DEBUG] [LOCAL ] MYE: Primary data saved (24865 records). [2025-10-03T20:23:16.641037] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-03T20:23:16.641158] [INFO ] [MAIN ] Update Progress: 1445/2370 symbols completed. MYE took 35.2s. Estimated remaining: 2h 10m 5s. Rate: 7.1 symbols/min [2025-10-03T20:23:16.881050] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:16.899469] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T20:23:16.900126] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T20:23:16.909884] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-03T20:23:16.910254] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-03T20:23:16.935601] [DEBUG] [LOCAL ] NAC: Loaded 25056 existing records from primary storage. [2025-10-03T20:23:16.936135] [INFO ] [MAIN ] NAC: Loaded 25056 existing records. [2025-10-03T20:23:17.133852] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T20:23:17.165190] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:17.173146] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-03T20:23:17.174072] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-03T20:23:17.174379] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-03T20:23:17.174462] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-03T20:23:17.564113] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:17.590618] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-03T20:23:17.817432] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T20:23:17.837324] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:23:18.390717] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-03T20:23:18.966237] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T20:23:19.190686] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-03T20:23:19.787870] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T20:23:19.990723] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-03T20:23:20.090117] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T20:23:20.790732] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-03T20:23:21.088816] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:23:21.472839] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T20:23:21.590745] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-03T20:23:22.390730] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-03T20:23:22.523775] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T20:23:23.190708] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-03T20:23:23.417251] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T20:23:23.990708] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-03T20:23:24.330010] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T20:23:24.790635] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-03T20:23:25.112279] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T20:23:25.590693] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-03T20:23:25.833225] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:23:25.834726] [INFO ] [REMOTE ] MYI: Full fetch complete (29369 records). [2025-10-03T20:23:25.834809] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-03T20:23:26.277053] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-03T20:23:26.277589] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T20:23:26.280098] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-03T20:23:26.281181] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-03T20:23:26.281559] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-03T20:23:26.282340] [DEBUG] [LOCAL ] MYI: Trimmed 29369 records to 19693 (keeping 200 days of data) [2025-10-03T20:23:26.390682] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-03T20:23:26.412045] [DEBUG] [LOCAL ] MYI: Primary data saved (19693 records). [2025-10-03T20:23:26.412428] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-03T20:23:26.412535] [INFO ] [MAIN ] Update Progress: 1446/2370 symbols completed. MYI took 18.9s. Estimated remaining: 2h 9m 57s. Rate: 7.1 symbols/min [2025-10-03T20:23:26.601065] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:26.641443] [DEBUG] [LOCAL ] NAD: Loaded 34199 existing records from primary storage. [2025-10-03T20:23:26.641755] [INFO ] [MAIN ] NAD: Loaded 34199 existing records. [2025-10-03T20:23:26.841789] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:26.842032] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-03T20:23:26.842084] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-03T20:23:26.842358] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-03T20:23:26.842417] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-03T20:23:27.191110] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-03T20:23:27.254597] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:27.264398] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T20:23:27.990696] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-03T20:23:28.790678] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-03T20:23:28.952609] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T20:23:29.320225] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T20:23:29.366404] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:23:29.367377] [INFO ] [REMOTE ] MYN: Full fetch complete (15341 records). [2025-10-03T20:23:29.367450] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-03T20:23:29.599262] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-03T20:23:29.781637] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-03T20:23:29.781820] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-03T20:23:29.782250] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-03T20:23:29.782507] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-03T20:23:29.783287] [DEBUG] [LOCAL ] MYN: Trimmed 15341 records to 10083 (keeping 200 days of data) [2025-10-03T20:23:29.866055] [DEBUG] [LOCAL ] MYN: Primary data saved (10083 records). [2025-10-03T20:23:29.866228] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-03T20:23:29.866385] [INFO ] [MAIN ] Update Progress: 1447/2370 symbols completed. MYN took 17.7s. Estimated remaining: 2h 9m 45s. Rate: 7.1 symbols/min [2025-10-03T20:23:30.060328] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:30.072046] [DEBUG] [LOCAL ] NAN: Loaded 8900 existing records from primary storage. [2025-10-03T20:23:30.072267] [INFO ] [MAIN ] NAN: Loaded 8900 existing records. [2025-10-03T20:23:30.271930] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:30.272178] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-03T20:23:30.272228] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-03T20:23:30.272412] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-03T20:23:30.272482] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-03T20:23:30.399140] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-03T20:23:30.693354] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:31.085439] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T20:23:31.190735] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-03T20:23:31.995895] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-03T20:23:32.008907] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T20:23:32.036140] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T20:23:32.790741] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-03T20:23:33.282411] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T20:23:33.590719] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-03T20:23:33.702308] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T20:23:34.390723] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-03T20:23:35.190636] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-03T20:23:35.371631] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:23:35.774888] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T20:23:35.990724] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-03T20:23:36.619358] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T20:23:36.790757] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-03T20:23:36.922389] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T20:23:37.590728] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-03T20:23:38.232625] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T20:23:38.390680] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-03T20:23:38.671052] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:23:39.190697] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-03T20:23:39.712685] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T20:23:39.990707] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-03T20:23:40.100204] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T20:23:40.790635] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-03T20:23:41.171297] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T20:23:41.590738] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-03T20:23:42.390713] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-03T20:23:42.432375] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:23:42.470480] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:23:43.190716] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-03T20:23:43.618498] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T20:23:43.990709] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-03T20:23:44.019200] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T20:23:44.790707] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-03T20:23:45.134747] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T20:23:45.590738] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-03T20:23:45.910271] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T20:23:46.390726] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-03T20:23:46.960317] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T20:23:47.190725] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-03T20:23:47.805136] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T20:23:47.990707] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-03T20:23:48.656970] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T20:23:48.790689] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-03T20:23:49.316544] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T20:23:49.585883] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T20:23:49.590605] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-03T20:23:50.390688] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-03T20:23:50.426615] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T20:23:51.190717] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-03T20:23:51.434397] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:23:51.436761] [INFO ] [REMOTE ] NABL: Full fetch complete (56819 records). [2025-10-03T20:23:51.436904] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-03T20:23:51.860559] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-03T20:23:51.860685] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-03T20:23:51.861738] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-03T20:23:51.861804] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-03T20:23:51.863388] [DEBUG] [LOCAL ] NABL: Trimmed 56819 records to 39908 (keeping 200 days of data) [2025-10-03T20:23:52.029454] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-03T20:23:52.103499] [DEBUG] [LOCAL ] NABL: Primary data saved (39908 records). [2025-10-03T20:23:52.103686] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-03T20:23:52.103809] [INFO ] [MAIN ] Update Progress: 1448/2370 symbols completed. NABL took 39.0s. Estimated remaining: 2h 9m 46s. Rate: 7.1 symbols/min [2025-10-03T20:23:52.226916] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:23:52.240236] [INFO ] [REMOTE ] NAC: Full fetch complete (36207 records). [2025-10-03T20:23:52.250737] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-03T20:23:52.371617] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:52.733308] [DEBUG] [LOCAL ] NAT: Loaded 49548 existing records from primary storage. [2025-10-03T20:23:52.748161] [INFO ] [MAIN ] NAT: Loaded 49548 existing records. [2025-10-03T20:23:52.750484] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-03T20:23:52.795907] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-03T20:23:52.795782] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-03T20:23:52.819022] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-03T20:23:52.843285] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-03T20:23:52.875704] [DEBUG] [LOCAL ] NAC: Trimmed 36207 records to 25229 (keeping 200 days of data) [2025-10-03T20:23:53.007197] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:23:53.017054] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-03T20:23:53.043324] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-03T20:23:53.059688] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-03T20:23:53.059790] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-03T20:23:53.505612] [DEBUG] [LOCAL ] NAC: Primary data saved (25229 records). [2025-10-03T20:23:53.550316] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-03T20:23:53.551615] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T20:23:53.555600] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:53.562732] [INFO ] [MAIN ] Update Progress: 1449/2370 symbols completed. NAC took 36.9s. Estimated remaining: 2h 9m 33s. Rate: 7.1 symbols/min [2025-10-03T20:23:53.596319] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-03T20:23:53.755279] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:23:53.755498] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-03T20:23:53.755594] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-03T20:23:53.755736] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-03T20:23:53.755781] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-03T20:23:53.755824] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-03T20:23:53.755857] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-03T20:23:53.873705] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T20:23:54.142723] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:23:54.390731] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-03T20:23:55.190707] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-03T20:23:55.592678] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T20:23:55.806716] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T20:23:55.990678] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-03T20:23:56.232705] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T20:23:56.790709] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-03T20:23:57.590700] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-03T20:23:57.654829] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T20:23:57.967853] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T20:23:58.390681] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-03T20:23:58.985983] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T20:23:59.190674] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-03T20:23:59.537604] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T20:23:59.698558] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:23:59.699554] [INFO ] [REMOTE ] NAN: Full fetch complete (13820 records). [2025-10-03T20:23:59.699693] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-03T20:23:59.995892] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-03T20:24:00.120050] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-03T20:24:00.120130] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-03T20:24:00.120477] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-03T20:24:00.120527] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-03T20:24:00.121083] [DEBUG] [LOCAL ] NAN: Trimmed 13820 records to 8941 (keeping 200 days of data) [2025-10-03T20:24:00.179067] [DEBUG] [LOCAL ] NAN: Primary data saved (8941 records). [2025-10-03T20:24:00.179211] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-03T20:24:00.179323] [INFO ] [MAIN ] Update Progress: 1450/2370 symbols completed. NAN took 30.3s. Estimated remaining: 2h 9m 23s. Rate: 7.1 symbols/min [2025-10-03T20:24:00.361261] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:00.370468] [DEBUG] [LOCAL ] NAZ: Loaded 2658 existing records from primary storage. [2025-10-03T20:24:00.370736] [INFO ] [MAIN ] NAZ: Loaded 2658 existing records. [2025-10-03T20:24:00.569603] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:00.570248] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-03T20:24:00.570310] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-03T20:24:00.570595] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-03T20:24:00.570734] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-03T20:24:00.794802] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-03T20:24:00.965796] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:01.182571] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T20:24:01.590694] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-03T20:24:02.206399] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T20:24:02.218325] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T20:24:02.390680] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-03T20:24:03.190693] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-03T20:24:03.830934] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T20:24:03.990725] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-03T20:24:04.739096] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T20:24:04.790721] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-03T20:24:05.387416] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T20:24:05.590693] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-03T20:24:06.390633] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-03T20:24:06.583127] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T20:24:06.946349] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T20:24:06.947695] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T20:24:07.190729] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-03T20:24:07.990737] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-03T20:24:08.538528] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T20:24:08.633003] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T20:24:08.790728] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-03T20:24:09.590693] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-03T20:24:10.238326] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T20:24:10.290431] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T20:24:10.390702] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-03T20:24:11.190695] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-03T20:24:11.839787] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T20:24:11.990699] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-03T20:24:12.193168] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T20:24:12.195187] [INFO ] [REMOTE ] NAD: Full fetch complete (49744 records). [2025-10-03T20:24:12.195282] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-03T20:24:12.583924] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T20:24:12.641795] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-03T20:24:12.641890] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-03T20:24:12.642867] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-03T20:24:12.642936] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-03T20:24:12.644194] [DEBUG] [LOCAL ] NAD: Trimmed 49744 records to 34402 (keeping 200 days of data) [2025-10-03T20:24:12.819461] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-03T20:24:12.877525] [DEBUG] [LOCAL ] NAD: Primary data saved (34402 records). [2025-10-03T20:24:12.877711] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-03T20:24:12.879684] [INFO ] [MAIN ] Update Progress: 1451/2370 symbols completed. NAD took 46.5s. Estimated remaining: 2h 9m 18s. Rate: 7.1 symbols/min [2025-10-03T20:24:13.060436] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:13.074515] [DEBUG] [LOCAL ] NBB: Loaded 9149 existing records from primary storage. [2025-10-03T20:24:13.074778] [INFO ] [MAIN ] NBB: Loaded 9149 existing records. [2025-10-03T20:24:13.263000] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:13.263211] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-03T20:24:13.263318] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-03T20:24:13.263583] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-03T20:24:13.263670] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-03T20:24:13.374732] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T20:24:13.595799] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-03T20:24:13.657940] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:14.390715] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-03T20:24:15.119951] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T20:24:15.143509] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T20:24:15.190732] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-03T20:24:15.990705] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-03T20:24:16.790633] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-03T20:24:16.906842] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T20:24:16.980427] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T20:24:17.391470] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T20:24:17.590695] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-03T20:24:18.390722] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-03T20:24:18.642497] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T20:24:18.644877] [INFO ] [REMOTE ] NATL: Full fetch complete (45428 records). [2025-10-03T20:24:18.644955] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-03T20:24:19.062981] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-03T20:24:19.063098] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-03T20:24:19.064220] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-03T20:24:19.064369] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-03T20:24:19.066814] [DEBUG] [LOCAL ] NATL: Trimmed 45428 records to 32994 (keeping 200 days of data) [2025-10-03T20:24:19.190949] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-03T20:24:19.300050] [DEBUG] [LOCAL ] NATL: Primary data saved (32994 records). [2025-10-03T20:24:19.300219] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-03T20:24:19.300349] [INFO ] [MAIN ] Update Progress: 1452/2370 symbols completed. NATL took 25.7s. Estimated remaining: 2h 9m 8s. Rate: 7.1 symbols/min [2025-10-03T20:24:19.500780] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:19.526489] [DEBUG] [LOCAL ] NBHC: Loaded 23469 existing records from primary storage. [2025-10-03T20:24:19.526994] [INFO ] [MAIN ] NBHC: Loaded 23469 existing records. [2025-10-03T20:24:19.748510] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:19.748787] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-03T20:24:19.748842] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-03T20:24:19.749101] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-03T20:24:19.749176] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-03T20:24:19.967011] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T20:24:19.995762] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-03T20:24:20.177716] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:20.299957] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T20:24:20.790676] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-03T20:24:20.810252] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T20:24:21.590692] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-03T20:24:21.876469] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T20:24:22.390701] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-03T20:24:23.072953] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T20:24:23.190679] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-03T20:24:23.336579] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T20:24:23.865218] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T20:24:23.990730] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-03T20:24:24.790688] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-03T20:24:25.590702] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-03T20:24:25.918389] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T20:24:25.941447] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T20:24:26.390686] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-03T20:24:26.398944] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T20:24:27.190668] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-03T20:24:27.365856] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T20:24:27.990636] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-03T20:24:28.130609] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T20:24:28.790717] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-03T20:24:29.229983] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T20:24:29.371985] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:24:29.372909] [INFO ] [REMOTE ] NAZ: Full fetch complete (4365 records). [2025-10-03T20:24:29.372987] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-03T20:24:29.595934] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-03T20:24:29.792272] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-03T20:24:29.792352] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-03T20:24:29.792511] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-03T20:24:29.792552] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-03T20:24:29.792954] [DEBUG] [LOCAL ] NAZ: Trimmed 4365 records to 2674 (keeping 200 days of data) [2025-10-03T20:24:29.810025] [DEBUG] [LOCAL ] NAZ: Primary data saved (2674 records). [2025-10-03T20:24:29.810125] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-03T20:24:29.810221] [INFO ] [MAIN ] Update Progress: 1453/2370 symbols completed. NAZ took 29.6s. Estimated remaining: 2h 9m 1s. Rate: 7.1 symbols/min [2025-10-03T20:24:29.986070] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:30.027123] [DEBUG] [LOCAL ] NBR: Loaded 34765 existing records from primary storage. [2025-10-03T20:24:30.027437] [INFO ] [MAIN ] NBR: Loaded 34765 existing records. [2025-10-03T20:24:30.212313] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:30.212536] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-03T20:24:30.212583] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-03T20:24:30.212845] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-03T20:24:30.212902] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-03T20:24:30.398798] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-03T20:24:30.598049] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:31.003733] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T20:24:31.190698] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-03T20:24:31.990684] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-03T20:24:32.082895] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T20:24:32.303888] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:24:32.790736] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-03T20:24:33.453624] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T20:24:33.590702] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-03T20:24:34.390668] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-03T20:24:34.464705] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T20:24:34.543487] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T20:24:35.190683] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-03T20:24:35.293921] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:24:35.990714] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-03T20:24:36.538514] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T20:24:36.541239] [INFO ] [REMOTE ] NAT: Full fetch complete (72127 records). [2025-10-03T20:24:36.541370] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-03T20:24:36.796326] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-03T20:24:36.850462] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T20:24:36.997795] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-03T20:24:36.997902] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-03T20:24:36.999024] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-03T20:24:36.999102] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-03T20:24:37.000742] [DEBUG] [LOCAL ] NAT: Trimmed 72127 records to 49921 (keeping 200 days of data) [2025-10-03T20:24:37.307736] [DEBUG] [LOCAL ] NAT: Primary data saved (49921 records). [2025-10-03T20:24:37.307909] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-03T20:24:37.308015] [INFO ] [MAIN ] Update Progress: 1454/2370 symbols completed. NAT took 45.2s. Estimated remaining: 2h 8m 52s. Rate: 7.1 symbols/min [2025-10-03T20:24:37.494861] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:37.519895] [DEBUG] [LOCAL ] NBXG: Loaded 22472 existing records from primary storage. [2025-10-03T20:24:37.520194] [INFO ] [MAIN ] NBXG: Loaded 22472 existing records. [2025-10-03T20:24:37.599241] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-03T20:24:37.734127] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:37.734479] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-03T20:24:37.734538] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-03T20:24:37.734811] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-03T20:24:37.734872] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-03T20:24:38.106037] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T20:24:38.176838] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:38.390730] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-03T20:24:38.829385] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T20:24:39.190638] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-03T20:24:39.470024] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T20:24:39.990736] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-03T20:24:40.448390] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T20:24:40.790728] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-03T20:24:41.225682] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T20:24:41.590631] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-03T20:24:41.897395] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T20:24:42.390706] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-03T20:24:43.190626] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-03T20:24:43.215367] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T20:24:43.576676] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T20:24:43.990712] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-03T20:24:44.440387] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T20:24:44.790697] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-03T20:24:45.437050] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T20:24:45.590692] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-03T20:24:45.749251] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T20:24:46.390717] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-03T20:24:46.851011] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T20:24:47.016162] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T20:24:47.190759] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-03T20:24:47.990706] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-03T20:24:48.090219] [DEBUG] [REMOTE ] NBXG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-03T20:24:48.090545] [WARN ] [REMOTE ] NBXG: No data returned for month 2025-04 [2025-10-03T20:24:48.090636] [FATAL] [REMOTE ] NBXG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:24:48.090819] [FATAL] [MAIN ] NBXG: Failed to fetch primary data. [2025-10-03T20:24:48.090893] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:24:48.090943] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-03T20:24:48.091001] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-03T20:24:48.091037] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-03T20:24:48.091417] [DEBUG] [LOCAL ] NBXG: Deleted derivative data file. [2025-10-03T20:24:48.091527] [INFO ] [MAIN ] Update Progress: 1455/2370 symbols completed. NBXG took 10.8s. Estimated remaining: 2h 8m 45s. Rate: 7.1 symbols/min [2025-10-03T20:24:48.275703] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:48.280588] [DEBUG] [LOCAL ] NC: Loaded 1944 existing records from primary storage. [2025-10-03T20:24:48.280826] [INFO ] [MAIN ] NC: Loaded 1944 existing records. [2025-10-03T20:24:48.478278] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:48.478713] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-03T20:24:48.479021] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-03T20:24:48.479237] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-03T20:24:48.479299] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-03T20:24:48.793002] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-03T20:24:48.889252] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:48.914074] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T20:24:49.481853] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T20:24:49.483037] [INFO ] [REMOTE ] NBB: Full fetch complete (13877 records). [2025-10-03T20:24:49.483113] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-03T20:24:49.596318] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-03T20:24:49.886946] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-03T20:24:49.887031] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-03T20:24:49.887449] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-03T20:24:49.887492] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-03T20:24:49.888489] [DEBUG] [LOCAL ] NBB: Trimmed 13877 records to 9215 (keeping 200 days of data) [2025-10-03T20:24:49.946855] [DEBUG] [LOCAL ] NBB: Primary data saved (9215 records). [2025-10-03T20:24:49.946995] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-03T20:24:49.947092] [INFO ] [MAIN ] Update Progress: 1456/2370 symbols completed. NBB took 37.1s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-03T20:24:50.073142] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T20:24:50.148907] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:50.161799] [DEBUG] [LOCAL ] NCA: Loaded 10308 existing records from primary storage. [2025-10-03T20:24:50.162106] [INFO ] [MAIN ] NCA: Loaded 10308 existing records. [2025-10-03T20:24:50.354838] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:50.355076] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-03T20:24:50.355126] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-03T20:24:50.355333] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-03T20:24:50.355391] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-03T20:24:50.395910] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-03T20:24:50.738466] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:51.002638] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T20:24:51.190773] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-03T20:24:51.990636] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-03T20:24:52.280820] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T20:24:52.549799] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T20:24:52.790686] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-03T20:24:53.590734] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-03T20:24:54.067848] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T20:24:54.390738] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-03T20:24:54.509795] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T20:24:55.190701] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-03T20:24:55.853005] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T20:24:55.990739] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-03T20:24:56.161594] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T20:24:56.163597] [INFO ] [REMOTE ] NBHC: Full fetch complete (32350 records). [2025-10-03T20:24:56.163720] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-03T20:24:56.561351] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-03T20:24:56.561433] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-03T20:24:56.562195] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-03T20:24:56.562293] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-03T20:24:56.563199] [DEBUG] [LOCAL ] NBHC: Trimmed 32350 records to 23679 (keeping 200 days of data) [2025-10-03T20:24:56.708250] [DEBUG] [LOCAL ] NBHC: Primary data saved (23679 records). [2025-10-03T20:24:56.708524] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-03T20:24:56.708742] [INFO ] [MAIN ] Update Progress: 1457/2370 symbols completed. NBHC took 37.4s. Estimated remaining: 2h 8m 23s. Rate: 7.1 symbols/min [2025-10-03T20:24:56.794756] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-03T20:24:56.904555] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:24:56.912410] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T20:24:56.936914] [DEBUG] [LOCAL ] NCDL: Loaded 21767 existing records from primary storage. [2025-10-03T20:24:56.937180] [INFO ] [MAIN ] NCDL: Loaded 21767 existing records. [2025-10-03T20:24:57.128023] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:24:57.128268] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-03T20:24:57.128319] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-03T20:24:57.128582] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-03T20:24:57.128817] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-03T20:24:57.541818] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:24:57.545964] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T20:24:57.590690] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-03T20:24:58.310873] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T20:24:58.390625] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-03T20:24:59.190718] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-03T20:24:59.225391] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T20:24:59.990696] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-03T20:25:00.449468] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T20:25:00.790725] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-03T20:25:00.915186] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T20:25:01.590736] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-03T20:25:02.390681] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-03T20:25:02.441919] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T20:25:02.825267] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T20:25:02.959613] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T20:25:03.190685] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-03T20:25:03.990679] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-03T20:25:04.419853] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T20:25:04.571524] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T20:25:04.790710] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-03T20:25:05.590677] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-03T20:25:05.638795] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T20:25:06.390707] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-03T20:25:07.111745] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T20:25:07.190722] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-03T20:25:07.257431] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:25:07.990693] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-03T20:25:08.480871] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T20:25:08.601292] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T20:25:08.790729] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-03T20:25:09.292550] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T20:25:09.590732] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-03T20:25:10.390685] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-03T20:25:10.871218] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T20:25:11.190689] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-03T20:25:11.903604] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T20:25:11.990751] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-03T20:25:12.495538] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T20:25:12.608149] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T20:25:12.790705] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-03T20:25:13.590693] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-03T20:25:13.621781] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T20:25:14.390741] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-03T20:25:14.725283] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T20:25:14.728759] [INFO ] [REMOTE ] NBR: Full fetch complete (49596 records). [2025-10-03T20:25:14.729068] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-03T20:25:15.166213] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-03T20:25:15.166339] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-03T20:25:15.167566] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-03T20:25:15.167687] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-03T20:25:15.169114] [DEBUG] [LOCAL ] NBR: Trimmed 49596 records to 34980 (keeping 200 days of data) [2025-10-03T20:25:15.222736] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-03T20:25:15.269184] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T20:25:15.397696] [DEBUG] [LOCAL ] NBR: Primary data saved (34980 records). [2025-10-03T20:25:15.397892] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-03T20:25:15.397995] [INFO ] [MAIN ] Update Progress: 1458/2370 symbols completed. NBR took 45.6s. Estimated remaining: 2h 8m 21s. Rate: 7.1 symbols/min [2025-10-03T20:25:15.585934] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:15.586148] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-03T20:25:15.586206] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-03T20:25:15.586330] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-03T20:25:15.586377] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-03T20:25:15.586472] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-03T20:25:15.586515] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-03T20:25:15.750835] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:25:15.763688] [INFO ] [REMOTE ] NC: Full fetch complete (2722 records). [2025-10-03T20:25:15.784696] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-03T20:25:16.001467] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-03T20:25:16.269138] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:16.424150] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-03T20:25:16.424251] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-03T20:25:16.424361] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-03T20:25:16.424403] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-03T20:25:16.424810] [DEBUG] [LOCAL ] NC: Trimmed 2722 records to 1954 (keeping 200 days of data) [2025-10-03T20:25:16.437425] [DEBUG] [LOCAL ] NC: Primary data saved (1954 records). [2025-10-03T20:25:16.437519] [INFO ] [MAIN ] NC: Full history saved. [2025-10-03T20:25:16.437616] [INFO ] [MAIN ] Update Progress: 1459/2370 symbols completed. NC took 28.3s. Estimated remaining: 2h 8m 8s. Rate: 7.1 symbols/min [2025-10-03T20:25:16.633070] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:16.651638] [DEBUG] [LOCAL ] NCV: Loaded 13797 existing records from primary storage. [2025-10-03T20:25:16.651926] [INFO ] [MAIN ] NCV: Loaded 13797 existing records. [2025-10-03T20:25:16.761066] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T20:25:16.795762] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-03T20:25:16.870205] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:25:16.870426] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-03T20:25:16.870522] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-03T20:25:16.870769] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-03T20:25:16.870828] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-03T20:25:17.286338] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:17.590743] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-03T20:25:18.179377] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T20:25:18.180549] [INFO ] [REMOTE ] NCA: Full fetch complete (15508 records). [2025-10-03T20:25:18.180630] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-03T20:25:18.396484] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-03T20:25:18.626563] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-03T20:25:18.626753] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-03T20:25:18.627161] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-03T20:25:18.627206] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-03T20:25:18.627953] [DEBUG] [LOCAL ] NCA: Trimmed 15508 records to 10346 (keeping 200 days of data) [2025-10-03T20:25:18.694926] [DEBUG] [LOCAL ] NCA: Primary data saved (10346 records). [2025-10-03T20:25:18.695075] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-03T20:25:18.695163] [INFO ] [MAIN ] Update Progress: 1460/2370 symbols completed. NCA took 28.7s. Estimated remaining: 2h 7m 55s. Rate: 7.1 symbols/min [2025-10-03T20:25:18.884867] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:18.900162] [DEBUG] [LOCAL ] NCZ: Loaded 12088 existing records from primary storage. [2025-10-03T20:25:18.900413] [INFO ] [MAIN ] NCZ: Loaded 12088 existing records. [2025-10-03T20:25:19.097623] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:25:19.097963] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-03T20:25:19.098164] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-03T20:25:19.108809] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-03T20:25:19.123697] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-03T20:25:19.198534] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-03T20:25:19.205742] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-03T20:25:19.531831] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:19.675393] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T20:25:19.990679] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-03T20:25:20.495986] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T20:25:20.790714] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-03T20:25:21.590631] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-03T20:25:21.925874] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T20:25:22.093896] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T20:25:22.390710] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-03T20:25:22.768098] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T20:25:23.190698] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-03T20:25:23.472322] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T20:25:23.990679] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-03T20:25:24.332352] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:25:24.790706] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-03T20:25:25.590815] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-03T20:25:25.930850] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T20:25:25.962776] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T20:25:26.390740] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-03T20:25:26.843237] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T20:25:27.190737] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-03T20:25:27.911074] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T20:25:27.990725] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-03T20:25:28.673090] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T20:25:28.790729] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-03T20:25:29.073771] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T20:25:29.590686] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-03T20:25:29.718483] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T20:25:29.720422] [INFO ] [REMOTE ] NCDL: Full fetch complete (32906 records). [2025-10-03T20:25:29.720548] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-03T20:25:30.132082] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-03T20:25:30.132220] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-03T20:25:30.133046] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-03T20:25:30.133113] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-03T20:25:30.134057] [DEBUG] [LOCAL ] NCDL: Trimmed 32906 records to 21949 (keeping 200 days of data) [2025-10-03T20:25:30.276937] [DEBUG] [LOCAL ] NCDL: Primary data saved (21949 records). [2025-10-03T20:25:30.277067] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-03T20:25:30.277168] [INFO ] [MAIN ] Update Progress: 1461/2370 symbols completed. NCDL took 33.6s. Estimated remaining: 2h 7m 49s. Rate: 7.1 symbols/min [2025-10-03T20:25:30.395809] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-03T20:25:30.461205] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:30.483834] [DEBUG] [LOCAL ] NDMO: Loaded 17082 existing records from primary storage. [2025-10-03T20:25:30.484796] [INFO ] [MAIN ] NDMO: Loaded 17082 existing records. [2025-10-03T20:25:30.683825] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:25:30.684265] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-03T20:25:30.684337] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-03T20:25:30.685132] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-03T20:25:30.685193] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-03T20:25:31.116739] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:31.190731] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-03T20:25:31.332742] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T20:25:31.617904] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T20:25:31.990707] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-03T20:25:32.402372] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:25:32.790683] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-03T20:25:33.590718] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-03T20:25:33.816813] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T20:25:34.271611] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-03T20:25:34.390633] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-03T20:25:34.472149] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T20:25:35.190716] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-03T20:25:35.332775] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T20:25:35.830589] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T20:25:35.990703] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-03T20:25:36.790695] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-03T20:25:36.824493] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T20:25:37.590725] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-03T20:25:38.390638] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-03T20:25:38.686321] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T20:25:38.892739] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T20:25:39.077731] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T20:25:39.190725] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-03T20:25:39.990705] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-03T20:25:40.091494] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:25:40.790633] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-03T20:25:40.865461] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T20:25:41.590731] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-03T20:25:42.390705] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-03T20:25:42.717039] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T20:25:43.191450] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-03T20:25:43.191368] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-03T20:25:43.407928] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T20:25:43.990634] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-03T20:25:44.204119] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T20:25:44.790633] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-03T20:25:45.023795] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T20:25:45.590689] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-03T20:25:45.744937] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T20:25:46.390677] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-03T20:25:46.527000] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T20:25:47.190639] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-03T20:25:47.302891] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:25:47.990734] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-03T20:25:48.790720] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-03T20:25:48.890325] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T20:25:48.891865] [INFO ] [REMOTE ] NCZ: Full fetch complete (21471 records). [2025-10-03T20:25:48.891942] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-03T20:25:49.319045] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-03T20:25:49.319302] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-03T20:25:49.320075] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-03T20:25:49.320159] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-03T20:25:49.321205] [DEBUG] [LOCAL ] NCZ: Trimmed 21471 records to 12247 (keeping 200 days of data) [2025-10-03T20:25:49.418398] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T20:25:49.455531] [DEBUG] [LOCAL ] NCZ: Primary data saved (12247 records). [2025-10-03T20:25:49.455725] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-03T20:25:49.455826] [INFO ] [MAIN ] Update Progress: 1462/2370 symbols completed. NCZ took 30.8s. Estimated remaining: 2h 7m 47s. Rate: 7.1 symbols/min [2025-10-03T20:25:49.595795] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-03T20:25:49.661257] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:49.719719] [DEBUG] [LOCAL ] NE: Loaded 52725 existing records from primary storage. [2025-10-03T20:25:49.720104] [INFO ] [MAIN ] NE: Loaded 52725 existing records. [2025-10-03T20:25:49.874115] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T20:25:49.944907] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:25:49.945150] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-03T20:25:49.945200] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-03T20:25:49.945466] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-03T20:25:49.945525] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-03T20:25:50.347104] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:50.390671] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-03T20:25:50.526851] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T20:25:51.190735] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-03T20:25:51.990634] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-03T20:25:52.061698] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T20:25:52.301011] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T20:25:52.790748] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-03T20:25:53.189795] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T20:25:53.590716] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-03T20:25:54.390726] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-03T20:25:54.684382] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T20:25:54.721375] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:25:55.190632] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-03T20:25:55.418960] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T20:25:55.698769] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:25:55.704157] [INFO ] [REMOTE ] NCLH: Full fetch complete (77419 records). [2025-10-03T20:25:55.704301] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-03T20:25:55.705196] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:25:55.705334] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:25:55.705406] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:25:55.705480] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-03T20:25:55.705547] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-03T20:25:55.705585] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-03T20:25:55.705626] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-03T20:25:55.705723] [INFO ] [MAIN ] Update Progress: 1463/2370 symbols completed. NCLH took 40.3s. Estimated remaining: 2h 7m 37s. Rate: 7.1 symbols/min [2025-10-03T20:25:55.892490] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:25:55.934053] [DEBUG] [LOCAL ] NEA: Loaded 35701 existing records from primary storage. [2025-10-03T20:25:55.934357] [INFO ] [MAIN ] NEA: Loaded 35701 existing records. [2025-10-03T20:25:55.998794] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-03T20:25:56.141516] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:25:56.141778] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-03T20:25:56.141830] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-03T20:25:56.142091] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-03T20:25:56.142150] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-03T20:25:56.522265] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:25:56.790701] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-03T20:25:57.590809] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-03T20:25:57.835408] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T20:25:57.910638] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T20:25:58.390736] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-03T20:25:59.197974] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-03T20:25:59.222836] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T20:25:59.990727] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-03T20:26:00.248194] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T20:26:00.250797] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T20:26:00.271593] [INFO ] [REMOTE ] NCV: Full fetch complete (22806 records). [2025-10-03T20:26:00.271812] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-03T20:26:00.672591] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-03T20:26:00.672716] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-03T20:26:00.673238] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-03T20:26:00.673300] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-03T20:26:00.674173] [DEBUG] [LOCAL ] NCV: Trimmed 22806 records to 13987 (keeping 200 days of data) [2025-10-03T20:26:00.765698] [DEBUG] [LOCAL ] NCV: Primary data saved (13987 records). [2025-10-03T20:26:00.765909] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-03T20:26:00.766064] [INFO ] [MAIN ] Update Progress: 1464/2370 symbols completed. NCV took 44.3s. Estimated remaining: 2h 7m 27s. Rate: 7.1 symbols/min [2025-10-03T20:26:00.802765] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-03T20:26:00.965799] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:00.966020] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-03T20:26:00.966082] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-03T20:26:00.966196] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-03T20:26:00.966241] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-03T20:26:00.966285] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-03T20:26:00.966319] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-03T20:26:01.367847] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:01.580243] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T20:26:01.590613] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-03T20:26:02.390717] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-03T20:26:02.774753] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T20:26:03.026298] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T20:26:03.190725] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-03T20:26:03.990735] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-03T20:26:04.437043] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T20:26:04.767094] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:26:04.790622] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-03T20:26:05.590631] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-03T20:26:05.769444] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:26:06.340386] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T20:26:06.368514] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T20:26:06.369862] [INFO ] [REMOTE ] NDMO: Full fetch complete (24651 records). [2025-10-03T20:26:06.369939] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-03T20:26:06.395826] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-03T20:26:06.786367] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-03T20:26:06.786447] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-03T20:26:06.787031] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-03T20:26:06.787103] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-03T20:26:06.787920] [DEBUG] [LOCAL ] NDMO: Trimmed 24651 records to 17210 (keeping 200 days of data) [2025-10-03T20:26:06.905253] [DEBUG] [LOCAL ] NDMO: Primary data saved (17210 records). [2025-10-03T20:26:06.905412] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-03T20:26:06.905504] [INFO ] [MAIN ] Update Progress: 1465/2370 symbols completed. NDMO took 36.6s. Estimated remaining: 2h 7m 17s. Rate: 7.1 symbols/min [2025-10-03T20:26:07.106180] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:07.106359] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-03T20:26:07.106404] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-03T20:26:07.106526] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-03T20:26:07.106613] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-03T20:26:07.106726] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-03T20:26:07.106781] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-03T20:26:07.195764] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-03T20:26:07.541699] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:07.990678] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-03T20:26:08.388359] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T20:26:08.750431] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T20:26:08.790634] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-03T20:26:09.590745] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-03T20:26:10.092725] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T20:26:10.334983] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T20:26:10.390729] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-03T20:26:11.190740] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-03T20:26:11.715365] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T20:26:11.751693] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T20:26:11.990729] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-03T20:26:12.790701] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-03T20:26:13.246874] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T20:26:13.464671] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T20:26:13.590754] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-03T20:26:14.390756] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-03T20:26:15.053100] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T20:26:15.190638] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-03T20:26:15.360361] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T20:26:15.831824] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T20:26:15.990684] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-03T20:26:16.790683] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-03T20:26:17.336353] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T20:26:17.590698] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-03T20:26:18.253796] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-03T20:26:18.318039] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T20:26:18.320841] [INFO ] [REMOTE ] NE: Full fetch complete (75552 records). [2025-10-03T20:26:18.321001] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-03T20:26:18.395748] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-03T20:26:18.758914] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-03T20:26:18.759032] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-03T20:26:18.760251] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-03T20:26:18.760319] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-03T20:26:18.762134] [DEBUG] [LOCAL ] NE: Trimmed 75552 records to 53111 (keeping 200 days of data) [2025-10-03T20:26:19.114084] [DEBUG] [LOCAL ] NE: Primary data saved (53111 records). [2025-10-03T20:26:19.114239] [INFO ] [MAIN ] NE: Full history saved. [2025-10-03T20:26:19.114965] [INFO ] [MAIN ] Update Progress: 1466/2370 symbols completed. NE took 29.7s. Estimated remaining: 2h 7m 11s. Rate: 7.1 symbols/min [2025-10-03T20:26:19.196248] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-03T20:26:19.300637] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:19.367213] [DEBUG] [LOCAL ] NET: Loaded 53363 existing records from primary storage. [2025-10-03T20:26:19.367553] [INFO ] [MAIN ] NET: Loaded 53363 existing records. [2025-10-03T20:26:19.567030] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:26:19.567425] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-03T20:26:19.567500] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-03T20:26:19.567971] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-03T20:26:19.568096] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-03T20:26:19.968053] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-03T20:26:20.016502] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-03T20:26:20.016013] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:20.043451] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T20:26:20.790692] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-03T20:26:21.448982] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-03T20:26:21.590695] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-03T20:26:21.876242] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T20:26:21.878426] [INFO ] [REMOTE ] NEA: Full fetch complete (52010 records). [2025-10-03T20:26:21.878578] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-03T20:26:22.320925] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-03T20:26:22.321152] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-03T20:26:22.322106] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-03T20:26:22.322188] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-03T20:26:22.323972] [DEBUG] [LOCAL ] NEA: Trimmed 52010 records to 35947 (keeping 200 days of data) [2025-10-03T20:26:22.391092] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-03T20:26:22.460151] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-03T20:26:22.629889] [DEBUG] [LOCAL ] NEA: Primary data saved (35947 records). [2025-10-03T20:26:22.630047] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-03T20:26:22.630135] [INFO ] [MAIN ] Update Progress: 1467/2370 symbols completed. NEA took 26.9s. Estimated remaining: 2h 6m 59s. Rate: 7.1 symbols/min [2025-10-03T20:26:22.832225] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:22.842870] [DEBUG] [LOCAL ] NEU: Loaded 8349 existing records from primary storage. [2025-10-03T20:26:22.843091] [INFO ] [MAIN ] NEU: Loaded 8349 existing records. [2025-10-03T20:26:23.033625] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:26:23.033862] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-03T20:26:23.033914] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-03T20:26:23.034114] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-03T20:26:23.034183] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-03T20:26:23.200077] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-03T20:26:23.438235] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:23.732254] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T20:26:23.990718] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-03T20:26:24.672446] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T20:26:24.790710] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-03T20:26:25.545057] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-03T20:26:25.590637] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-03T20:26:25.851335] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T20:26:26.390698] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-03T20:26:26.746536] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T20:26:27.190736] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-03T20:26:27.464057] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T20:26:27.990693] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-03T20:26:28.405285] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-03T20:26:28.666636] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T20:26:28.790696] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-03T20:26:29.398491] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-03T20:26:29.590713] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-03T20:26:30.390695] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-03T20:26:30.940393] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T20:26:31.190708] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-03T20:26:31.966734] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-03T20:26:31.965148] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T20:26:31.990668] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-03T20:26:32.292279] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T20:26:32.713940] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T20:26:32.790704] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-03T20:26:33.527981] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T20:26:33.590718] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-03T20:26:34.390632] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-03T20:26:34.525490] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T20:26:35.190698] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-03T20:26:35.990638] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-03T20:26:36.177962] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T20:26:36.496896] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T20:26:36.790679] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-03T20:26:37.590716] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-03T20:26:38.218346] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T20:26:38.339836] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T20:26:38.390738] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-03T20:26:39.117511] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T20:26:39.190703] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-03T20:26:39.234558] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T20:26:39.990741] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-03T20:26:40.564343] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T20:26:40.566417] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-03T20:26:40.566538] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-03T20:26:40.568114] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:26:40.568221] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:26:40.568267] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:26:40.568337] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-03T20:26:40.568419] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-03T20:26:40.568476] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-03T20:26:40.568579] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-03T20:26:40.568762] [INFO ] [MAIN ] Update Progress: 1468/2370 symbols completed. NEE took 39.8s. Estimated remaining: 2h 6m 57s. Rate: 7.1 symbols/min [2025-10-03T20:26:40.752471] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:40.760309] [DEBUG] [LOCAL ] NEXA: Loaded 4393 existing records from primary storage. [2025-10-03T20:26:40.760539] [INFO ] [MAIN ] NEXA: Loaded 4393 existing records. [2025-10-03T20:26:40.796221] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-03T20:26:40.964348] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:26:40.964599] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-03T20:26:40.964679] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-03T20:26:40.964968] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-03T20:26:40.965058] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-03T20:26:41.356599] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:41.396383] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-03T20:26:41.590763] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-03T20:26:41.950085] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:26:42.390693] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-03T20:26:42.428609] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T20:26:42.895555] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T20:26:42.898214] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-03T20:26:42.898557] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-03T20:26:42.901061] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:26:42.901247] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:26:42.901317] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:26:42.901405] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-03T20:26:42.901484] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-03T20:26:42.901523] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-03T20:26:42.901565] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-03T20:26:42.901685] [INFO ] [MAIN ] Update Progress: 1469/2370 symbols completed. NEM took 36.0s. Estimated remaining: 2h 6m 44s. Rate: 7.1 symbols/min [2025-10-03T20:26:43.084177] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:43.121746] [DEBUG] [LOCAL ] NFG: Loaded 38850 existing records from primary storage. [2025-10-03T20:26:43.122094] [INFO ] [MAIN ] NFG: Loaded 38850 existing records. [2025-10-03T20:26:43.195874] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-03T20:26:43.317059] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:26:43.317316] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-03T20:26:43.317369] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-03T20:26:43.317633] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-03T20:26:43.317729] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-03T20:26:43.704720] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:43.990721] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-03T20:26:44.127255] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T20:26:44.790736] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-03T20:26:45.590780] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-03T20:26:46.068523] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T20:26:46.269981] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:26:46.390729] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-03T20:26:46.422197] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T20:26:47.190701] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-03T20:26:47.264532] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T20:26:47.682866] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T20:26:47.990706] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-03T20:26:48.585791] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T20:26:48.790731] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-03T20:26:49.590691] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-03T20:26:49.648904] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T20:26:50.390737] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-03T20:26:51.190843] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-03T20:26:51.819326] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T20:26:51.820559] [INFO ] [REMOTE ] NEU: Full fetch complete (10548 records). [2025-10-03T20:26:51.820636] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-03T20:26:52.008698] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-03T20:26:52.195904] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-03T20:26:52.266668] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-03T20:26:52.266982] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-03T20:26:52.267462] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-03T20:26:52.267537] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-03T20:26:52.278381] [DEBUG] [LOCAL ] NEU: Trimmed 10548 records to 8405 (keeping 200 days of data) [2025-10-03T20:26:52.296181] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T20:26:52.364282] [DEBUG] [LOCAL ] NEU: Primary data saved (8405 records). [2025-10-03T20:26:52.364467] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-03T20:26:52.364587] [INFO ] [MAIN ] Update Progress: 1470/2370 symbols completed. NEU took 29.7s. Estimated remaining: 2h 6m 37s. Rate: 7.1 symbols/min [2025-10-03T20:26:52.537080] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:26:52.561515] [DEBUG] [LOCAL ] NFJ: Loaded 20601 existing records from primary storage. [2025-10-03T20:26:52.561882] [INFO ] [MAIN ] NFJ: Loaded 20601 existing records. [2025-10-03T20:26:52.726498] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T20:26:52.759481] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:26:52.762143] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-03T20:26:52.762204] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-03T20:26:52.763049] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-03T20:26:52.763118] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-03T20:26:52.797969] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-03T20:26:53.152760] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:26:53.590720] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-03T20:26:54.393746] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-03T20:26:54.411948] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T20:26:54.505559] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T20:26:55.126981] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T20:26:55.190633] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-03T20:26:55.869033] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T20:26:55.990699] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-03T20:26:56.790778] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-03T20:26:57.515585] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T20:26:57.590743] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-03T20:26:58.327876] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-03T20:26:58.390623] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-03T20:26:59.190682] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-03T20:26:59.356978] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:26:59.593619] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T20:26:59.990637] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-03T20:27:00.332747] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T20:27:00.790753] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-03T20:27:01.590726] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-03T20:27:01.706317] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T20:27:02.391098] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-03T20:27:02.416614] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T20:27:02.417566] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T20:27:02.423809] [INFO ] [REMOTE ] NET: Full fetch complete (76806 records). [2025-10-03T20:27:02.424057] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-03T20:27:02.859992] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-03T20:27:02.860104] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-03T20:27:02.861452] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-03T20:27:02.861560] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-03T20:27:02.863382] [DEBUG] [LOCAL ] NET: Trimmed 76806 records to 53750 (keeping 200 days of data) [2025-10-03T20:27:03.200747] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-03T20:27:03.234501] [DEBUG] [LOCAL ] NET: Primary data saved (53750 records). [2025-10-03T20:27:03.234710] [INFO ] [MAIN ] NET: Full history saved. [2025-10-03T20:27:03.238380] [INFO ] [MAIN ] Update Progress: 1471/2370 symbols completed. NET took 44.1s. Estimated remaining: 2h 6m 30s. Rate: 7.1 symbols/min [2025-10-03T20:27:03.445095] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:03.505404] [DEBUG] [LOCAL ] NGG: Loaded 46520 existing records from primary storage. [2025-10-03T20:27:03.505810] [INFO ] [MAIN ] NGG: Loaded 46520 existing records. [2025-10-03T20:27:03.767396] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:03.768018] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-03T20:27:03.768098] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-03T20:27:03.768534] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-03T20:27:03.768612] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-03T20:27:03.991435] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-03T20:27:04.362321] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T20:27:04.412486] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:04.435016] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T20:27:04.651303] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:27:04.652275] [INFO ] [REMOTE ] NEXA: Full fetch complete (7570 records). [2025-10-03T20:27:04.652352] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-03T20:27:04.802195] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-03T20:27:05.060677] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-03T20:27:05.060783] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-03T20:27:05.061042] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-03T20:27:05.061105] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-03T20:27:05.061974] [DEBUG] [LOCAL ] NEXA: Trimmed 7570 records to 4449 (keeping 200 days of data) [2025-10-03T20:27:05.089869] [DEBUG] [LOCAL ] NEXA: Primary data saved (4449 records). [2025-10-03T20:27:05.090017] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-03T20:27:05.090159] [INFO ] [MAIN ] Update Progress: 1472/2370 symbols completed. NEXA took 24.5s. Estimated remaining: 2h 6m 17s. Rate: 7.1 symbols/min [2025-10-03T20:27:05.281418] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:05.321786] [DEBUG] [LOCAL ] NGL: Loaded 30447 existing records from primary storage. [2025-10-03T20:27:05.322066] [INFO ] [MAIN ] NGL: Loaded 30447 existing records. [2025-10-03T20:27:05.521101] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:05.521362] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-03T20:27:05.521430] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-03T20:27:05.521742] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-03T20:27:05.521807] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-03T20:27:05.595762] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-03T20:27:05.932585] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:05.978088] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T20:27:06.390732] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-03T20:27:07.190715] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-03T20:27:07.244553] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:27:07.430221] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T20:27:07.990685] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-03T20:27:08.330815] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T20:27:08.790704] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-03T20:27:09.207491] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T20:27:09.590720] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-03T20:27:10.390687] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-03T20:27:10.511739] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T20:27:10.999528] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:27:11.190687] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-03T20:27:11.595168] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T20:27:11.990719] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-03T20:27:12.790632] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-03T20:27:12.824146] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T20:27:13.590634] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-03T20:27:13.719194] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T20:27:13.943833] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T20:27:14.390705] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-03T20:27:14.818257] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T20:27:15.190682] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-03T20:27:15.475104] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T20:27:15.990676] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-03T20:27:16.790695] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-03T20:27:16.997024] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T20:27:17.031239] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T20:27:17.590667] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-03T20:27:17.978870] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:27:18.390682] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-03T20:27:19.143459] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T20:27:19.190679] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-03T20:27:19.328848] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T20:27:19.990725] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-03T20:27:20.248858] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T20:27:20.790712] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-03T20:27:20.816251] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T20:27:21.590690] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-03T20:27:21.969104] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T20:27:22.390726] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-03T20:27:23.057256] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:27:23.190677] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-03T20:27:23.388369] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T20:27:23.390122] [INFO ] [REMOTE ] NFJ: Full fetch complete (30570 records). [2025-10-03T20:27:23.390237] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-03T20:27:23.792210] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-03T20:27:23.792302] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-03T20:27:23.792958] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-03T20:27:23.793048] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-03T20:27:23.793866] [DEBUG] [LOCAL ] NFJ: Trimmed 30570 records to 20735 (keeping 200 days of data) [2025-10-03T20:27:23.929690] [DEBUG] [LOCAL ] NFJ: Primary data saved (20735 records). [2025-10-03T20:27:23.929825] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-03T20:27:23.929927] [INFO ] [MAIN ] Update Progress: 1473/2370 symbols completed. NFJ took 31.6s. Estimated remaining: 2h 6m 15s. Rate: 7.1 symbols/min [2025-10-03T20:27:23.998568] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-03T20:27:24.119586] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:24.137325] [DEBUG] [LOCAL ] NGS: Loaded 11618 existing records from primary storage. [2025-10-03T20:27:24.137586] [INFO ] [MAIN ] NGS: Loaded 11618 existing records. [2025-10-03T20:27:24.340960] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:24.341210] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-03T20:27:24.341261] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-03T20:27:24.341536] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-03T20:27:24.341599] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-03T20:27:24.750321] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:24.772501] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:27:24.790615] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-03T20:27:25.590634] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-03T20:27:25.641105] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T20:27:26.146778] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T20:27:26.390631] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-03T20:27:26.466489] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:27:27.190689] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-03T20:27:27.990697] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-03T20:27:28.170184] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T20:27:28.401155] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T20:27:28.403480] [INFO ] [REMOTE ] NFG: Full fetch complete (56829 records). [2025-10-03T20:27:28.403693] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-03T20:27:28.791825] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-03T20:27:28.844050] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T20:27:28.843374] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-03T20:27:28.848614] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-03T20:27:28.849690] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-03T20:27:28.849759] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-03T20:27:28.851081] [DEBUG] [LOCAL ] NFG: Trimmed 56829 records to 39126 (keeping 200 days of data) [2025-10-03T20:27:29.113940] [DEBUG] [LOCAL ] NFG: Primary data saved (39126 records). [2025-10-03T20:27:29.114088] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-03T20:27:29.114190] [INFO ] [MAIN ] Update Progress: 1474/2370 symbols completed. NFG took 46.2s. Estimated remaining: 2h 6m 5s. Rate: 7.1 symbols/min [2025-10-03T20:27:29.319939] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:29.342714] [DEBUG] [LOCAL ] NGVC: Loaded 22532 existing records from primary storage. [2025-10-03T20:27:29.343003] [INFO ] [MAIN ] NGVC: Loaded 22532 existing records. [2025-10-03T20:27:29.545788] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:29.546058] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-03T20:27:29.546109] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-03T20:27:29.546369] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-03T20:27:29.546453] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-03T20:27:29.595837] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-03T20:27:29.939047] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:30.390667] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-03T20:27:30.678868] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T20:27:30.744770] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T20:27:31.190680] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-03T20:27:31.283930] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:27:31.990723] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-03T20:27:32.536190] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T20:27:32.790722] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-03T20:27:33.138807] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T20:27:33.590721] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-03T20:27:34.390673] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-03T20:27:34.574372] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T20:27:34.683901] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T20:27:35.195104] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-03T20:27:35.196876] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T20:27:35.990692] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-03T20:27:36.242324] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T20:27:36.244178] [INFO ] [REMOTE ] NGL: Full fetch complete (41264 records). [2025-10-03T20:27:36.244262] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-03T20:27:36.662076] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-03T20:27:36.662192] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-03T20:27:36.663033] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-03T20:27:36.663096] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-03T20:27:36.664140] [DEBUG] [LOCAL ] NGL: Trimmed 41264 records to 30563 (keeping 200 days of data) [2025-10-03T20:27:36.804251] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-03T20:27:36.843956] [DEBUG] [LOCAL ] NGL: Primary data saved (30563 records). [2025-10-03T20:27:36.844077] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-03T20:27:36.844177] [INFO ] [MAIN ] Update Progress: 1475/2370 symbols completed. NGL took 31.8s. Estimated remaining: 2h 5m 56s. Rate: 7.1 symbols/min [2025-10-03T20:27:37.026831] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:37.050294] [DEBUG] [LOCAL ] NGVT: Loaded 24311 existing records from primary storage. [2025-10-03T20:27:37.050676] [INFO ] [MAIN ] NGVT: Loaded 24311 existing records. [2025-10-03T20:27:37.246403] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:37.246684] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-03T20:27:37.246821] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-03T20:27:37.259568] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-03T20:27:37.260088] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-03T20:27:37.260513] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T20:27:37.595739] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-03T20:27:37.674056] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:37.854450] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:27:38.390680] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-03T20:27:39.190687] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-03T20:27:39.260545] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T20:27:39.362118] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T20:27:39.990696] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-03T20:27:40.314941] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:27:40.790630] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-03T20:27:40.947346] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T20:27:41.590710] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-03T20:27:42.060719] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T20:27:42.390700] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-03T20:27:43.190636] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-03T20:27:43.299415] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:27:43.348713] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T20:27:43.990632] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-03T20:27:44.380440] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:27:44.790696] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-03T20:27:45.428097] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T20:27:45.430607] [INFO ] [REMOTE ] NGG: Full fetch complete (66370 records). [2025-10-03T20:27:45.430754] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-03T20:27:45.598914] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-03T20:27:45.857916] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-03T20:27:45.858109] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-03T20:27:45.859353] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-03T20:27:45.859526] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-03T20:27:45.861157] [DEBUG] [LOCAL ] NGG: Trimmed 66370 records to 46850 (keeping 200 days of data) [2025-10-03T20:27:46.076909] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T20:27:46.191366] [DEBUG] [LOCAL ] NGG: Primary data saved (46850 records). [2025-10-03T20:27:46.191514] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-03T20:27:46.192236] [INFO ] [MAIN ] Update Progress: 1476/2370 symbols completed. NGG took 43.0s. Estimated remaining: 2h 5m 48s. Rate: 7.1 symbols/min [2025-10-03T20:27:46.351248] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T20:27:46.387804] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:27:46.390743] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-03T20:27:46.413005] [DEBUG] [LOCAL ] NHI: Loaded 22052 existing records from primary storage. [2025-10-03T20:27:46.413274] [INFO ] [MAIN ] NHI: Loaded 22052 existing records. [2025-10-03T20:27:46.605273] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:27:46.605589] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-03T20:27:46.605676] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-03T20:27:46.606045] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-03T20:27:46.606103] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-03T20:27:46.992613] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:27:47.190734] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-03T20:27:47.238847] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:27:47.990692] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-03T20:27:48.402327] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T20:27:48.467380] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T20:27:48.468735] [INFO ] [REMOTE ] NGS: Full fetch complete (17201 records). [2025-10-03T20:27:48.468819] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-03T20:27:48.795738] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-03T20:27:48.864581] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-03T20:27:48.864802] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-03T20:27:48.865229] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-03T20:27:48.865275] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-03T20:27:48.865946] [DEBUG] [LOCAL ] NGS: Trimmed 17201 records to 11679 (keeping 200 days of data) [2025-10-03T20:27:48.939938] [DEBUG] [LOCAL ] NGS: Primary data saved (11679 records). [2025-10-03T20:27:48.940114] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-03T20:27:48.940224] [INFO ] [MAIN ] Update Progress: 1477/2370 symbols completed. NGS took 25.0s. Estimated remaining: 2h 5m 36s. Rate: 7.1 symbols/min [2025-10-03T20:27:49.590704] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-03T20:27:50.126599] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T20:27:50.390688] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-03T20:27:50.860490] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T20:27:51.190702] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-03T20:27:51.680237] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T20:27:51.990681] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-03T20:27:52.088391] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:27:52.790713] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-03T20:27:53.210908] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T20:27:53.590729] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-03T20:27:53.620799] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T20:27:54.390714] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-03T20:27:54.517624] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T20:27:54.519936] [INFO ] [REMOTE ] NGVC: Full fetch complete (30494 records). [2025-10-03T20:27:54.520052] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-03T20:27:54.955973] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-03T20:27:54.956121] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-03T20:27:54.956800] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-03T20:27:54.956863] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-03T20:27:54.957615] [DEBUG] [LOCAL ] NGVC: Trimmed 30494 records to 22666 (keeping 200 days of data) [2025-10-03T20:27:55.107759] [DEBUG] [LOCAL ] NGVC: Primary data saved (22666 records). [2025-10-03T20:27:55.108157] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-03T20:27:55.108252] [INFO ] [MAIN ] Update Progress: 1478/2370 symbols completed. NGVC took 26.0s. Estimated remaining: 2h 5m 26s. Rate: 7.1 symbols/min [2025-10-03T20:27:55.190766] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-03T20:27:55.243973] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T20:27:55.990708] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-03T20:27:56.309352] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T20:27:56.790752] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-03T20:27:57.183442] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T20:27:57.590762] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-03T20:27:57.953595] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T20:27:58.390713] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-03T20:27:58.940114] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T20:27:59.190696] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-03T20:27:59.227872] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:27:59.990695] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-03T20:28:00.468697] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T20:28:00.790701] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-03T20:28:01.220693] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T20:28:01.590727] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-03T20:28:02.013391] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T20:28:02.390730] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-03T20:28:02.938598] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T20:28:03.190719] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-03T20:28:03.598224] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T20:28:03.990629] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-03T20:28:04.354939] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T20:28:04.790691] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-03T20:28:05.221726] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T20:28:05.590741] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-03T20:28:06.028301] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T20:28:06.390744] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-03T20:28:06.777550] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T20:28:07.190638] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-03T20:28:07.577352] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T20:28:07.990745] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-03T20:28:08.121761] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T20:28:08.123521] [INFO ] [REMOTE ] NGVT: Full fetch complete (34555 records). [2025-10-03T20:28:08.123609] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-03T20:28:08.542673] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-03T20:28:08.542784] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-03T20:28:08.543678] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-03T20:28:08.543743] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-03T20:28:08.544750] [DEBUG] [LOCAL ] NGVT: Trimmed 34555 records to 24460 (keeping 200 days of data) [2025-10-03T20:28:08.690243] [DEBUG] [LOCAL ] NGVT: Primary data saved (24460 records). [2025-10-03T20:28:08.690380] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-03T20:28:08.690482] [INFO ] [MAIN ] Update Progress: 1479/2370 symbols completed. NGVT took 31.8s. Estimated remaining: 2h 5m 21s. Rate: 7.1 symbols/min [2025-10-03T20:28:08.886830] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T20:28:08.888292] [INFO ] [REMOTE ] NHI: Full fetch complete (31513 records). [2025-10-03T20:28:08.888373] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-03T20:28:09.294591] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-03T20:28:09.294715] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-03T20:28:09.295437] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-03T20:28:09.295481] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-03T20:28:09.296511] [DEBUG] [LOCAL ] NHI: Trimmed 31513 records to 22136 (keeping 200 days of data) [2025-10-03T20:28:09.449226] [DEBUG] [LOCAL ] NHI: Primary data saved (22136 records). [2025-10-03T20:28:09.449360] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-03T20:28:09.449461] [INFO ] [MAIN ] Update Progress: 1480/2370 symbols completed. NHI took 23.3s. Estimated remaining: 2h 5m 8s. Rate: 7.1 symbols/min [2025-10-03T20:28:10.038482] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:10.170517] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:10.192620] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:10.249605] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-03T20:28:10.253760] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:10.254024] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-03T20:28:10.254523] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-03T20:28:10.254587] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-03T20:28:10.254643] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-03T20:28:10.254738] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-03T20:28:10.323082] [DEBUG] [LOCAL ] NIC: Loaded 9018 existing records from primary storage. [2025-10-03T20:28:10.336741] [DEBUG] [LOCAL ] NIM: Loaded 4079 existing records from primary storage. [2025-10-03T20:28:10.367820] [DEBUG] [LOCAL ] NIE: Loaded 11993 existing records from primary storage. [2025-10-03T20:28:10.368079] [INFO ] [MAIN ] NIC: Loaded 9018 existing records. [2025-10-03T20:28:10.362333] [INFO ] [MAIN ] NIM: Loaded 4079 existing records. [2025-10-03T20:28:10.392876] [INFO ] [MAIN ] NIE: Loaded 11993 existing records. [2025-10-03T20:28:11.072727] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:11.108400] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-03T20:28:11.123109] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-03T20:28:11.206242] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:11.222420] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-03T20:28:11.225951] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:11.251030] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-03T20:28:11.256350] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-03T20:28:11.256298] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-03T20:28:11.250847] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-03T20:28:11.272980] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-03T20:28:11.273129] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-03T20:28:11.294962] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-03T20:28:11.294792] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:11.300547] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-03T20:28:11.300447] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-03T20:28:11.312456] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-03T20:28:12.393098] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:12.440354] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-03T20:28:12.477954] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:12.509804] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-03T20:28:12.513914] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:12.514585] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-03T20:28:13.201335] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T20:28:13.213303] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-03T20:28:13.233571] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T20:28:13.235892] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-03T20:28:13.340400] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T20:28:13.407162] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T20:28:13.590692] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-03T20:28:14.184374] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:28:14.344172] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:28:14.390699] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-03T20:28:15.117095] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:28:15.154194] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T20:28:15.190687] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-03T20:28:15.878039] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T20:28:15.990682] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-03T20:28:16.790682] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-03T20:28:17.590683] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-03T20:28:17.623173] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T20:28:17.845590] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T20:28:18.390697] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-03T20:28:18.475496] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T20:28:19.190746] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-03T20:28:19.990693] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-03T20:28:20.066478] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T20:28:20.204288] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T20:28:20.540311] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T20:28:20.790686] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-03T20:28:21.590723] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-03T20:28:22.390690] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-03T20:28:22.462223] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T20:28:22.723859] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T20:28:23.190698] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-03T20:28:23.226890] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:28:23.803225] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T20:28:23.990679] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-03T20:28:24.790713] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-03T20:28:25.590690] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-03T20:28:25.629969] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T20:28:25.926489] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T20:28:26.332191] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T20:28:26.390676] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-03T20:28:27.190710] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-03T20:28:27.990705] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-03T20:28:28.135598] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T20:28:28.253594] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T20:28:28.791208] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-03T20:28:28.793936] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T20:28:29.590708] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-03T20:28:30.390628] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-03T20:28:30.472875] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T20:28:30.892005] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T20:28:30.892336] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T20:28:31.190699] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-03T20:28:31.990732] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-03T20:28:32.790637] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-03T20:28:32.913954] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T20:28:33.073603] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T20:28:33.412902] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T20:28:33.590697] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-03T20:28:34.381306] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T20:28:34.390618] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-03T20:28:35.189567] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T20:28:35.192123] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-03T20:28:35.990667] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-03T20:28:36.058469] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:28:36.790714] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-03T20:28:37.590742] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-03T20:28:37.780040] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T20:28:37.945256] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T20:28:38.341775] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T20:28:38.342805] [INFO ] [REMOTE ] NIC: Full fetch complete (12268 records). [2025-10-03T20:28:38.342878] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-03T20:28:38.400917] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-03T20:28:38.738292] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-03T20:28:38.738370] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-03T20:28:38.738676] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-03T20:28:38.738738] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-03T20:28:38.739244] [DEBUG] [LOCAL ] NIC: Trimmed 12268 records to 9103 (keeping 200 days of data) [2025-10-03T20:28:38.799343] [DEBUG] [LOCAL ] NIC: Primary data saved (9103 records). [2025-10-03T20:28:38.799485] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-03T20:28:38.799579] [INFO ] [MAIN ] Update Progress: 1481/2370 symbols completed. NIC took 29.3s. Estimated remaining: 2h 5m 12s. Rate: 7.1 symbols/min [2025-10-03T20:28:38.984267] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:39.012099] [DEBUG] [LOCAL ] NINE: Loaded 28398 existing records from primary storage. [2025-10-03T20:28:39.012379] [INFO ] [MAIN ] NINE: Loaded 28398 existing records. [2025-10-03T20:28:39.197574] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-03T20:28:39.204871] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:39.206070] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-03T20:28:39.206126] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-03T20:28:39.206367] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-03T20:28:39.206435] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-03T20:28:39.534250] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T20:28:39.609227] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:39.821086] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T20:28:39.826266] [INFO ] [REMOTE ] NI: Full fetch complete (76882 records). [2025-10-03T20:28:39.826430] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-03T20:28:39.827358] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:28:39.827452] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:28:39.827498] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:28:39.827588] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-03T20:28:39.827714] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-03T20:28:39.827805] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-03T20:28:39.827872] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-03T20:28:39.827957] [INFO ] [MAIN ] Update Progress: 1482/2370 symbols completed. NI took 30.4s. Estimated remaining: 2h 4m 59s. Rate: 7.1 symbols/min [2025-10-03T20:28:39.995767] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-03T20:28:40.024431] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:40.079036] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-10-03T20:28:40.079362] [INFO ] [MAIN ] NIO: Loaded 54192 existing records. [2025-10-03T20:28:40.268069] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:40.268299] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-03T20:28:40.268348] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-03T20:28:40.268690] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-03T20:28:40.268752] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-03T20:28:40.648402] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:40.790715] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-03T20:28:41.376018] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T20:28:41.591799] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-03T20:28:41.597427] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T20:28:42.186100] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T20:28:42.390720] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-03T20:28:43.190698] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-03T20:28:43.600566] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T20:28:43.601403] [INFO ] [REMOTE ] NIM: Full fetch complete (6723 records). [2025-10-03T20:28:43.601508] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-03T20:28:43.982054] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-03T20:28:43.982135] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-03T20:28:43.982340] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-03T20:28:43.982383] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-03T20:28:43.982832] [DEBUG] [LOCAL ] NIM: Trimmed 6723 records to 4097 (keeping 200 days of data) [2025-10-03T20:28:43.996357] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-03T20:28:44.011906] [DEBUG] [LOCAL ] NIM: Primary data saved (4097 records). [2025-10-03T20:28:44.012071] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-03T20:28:44.012169] [INFO ] [MAIN ] Update Progress: 1483/2370 symbols completed. NIM took 34.6s. Estimated remaining: 2h 4m 48s. Rate: 7.1 symbols/min [2025-10-03T20:28:44.203333] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:44.203564] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-03T20:28:44.203633] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-03T20:28:44.203793] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-03T20:28:44.203836] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-03T20:28:44.203879] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-03T20:28:44.203912] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-03T20:28:44.607099] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:44.790749] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-03T20:28:45.087471] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-03T20:28:45.590676] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-03T20:28:45.716427] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T20:28:45.892386] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:28:46.390688] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-03T20:28:47.190684] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-03T20:28:47.880505] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T20:28:47.883842] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:28:47.884179] [INFO ] [REMOTE ] NIE: Full fetch complete (16715 records). [2025-10-03T20:28:47.890918] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-03T20:28:47.996848] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-03T20:28:48.286370] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-03T20:28:48.286479] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-03T20:28:48.286985] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-03T20:28:48.287100] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-03T20:28:48.298218] [DEBUG] [LOCAL ] NIE: Trimmed 16715 records to 12087 (keeping 200 days of data) [2025-10-03T20:28:48.351132] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-03T20:28:48.411005] [DEBUG] [LOCAL ] NIE: Primary data saved (12087 records). [2025-10-03T20:28:48.411201] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-03T20:28:48.411297] [INFO ] [MAIN ] Update Progress: 1484/2370 symbols completed. NIE took 39.0s. Estimated remaining: 2h 4m 37s. Rate: 7.1 symbols/min [2025-10-03T20:28:48.587325] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:48.627999] [DEBUG] [LOCAL ] NJR: Loaded 38448 existing records from primary storage. [2025-10-03T20:28:48.628339] [INFO ] [MAIN ] NJR: Loaded 38448 existing records. [2025-10-03T20:28:48.800290] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-03T20:28:48.823265] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:28:48.824485] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-03T20:28:48.824558] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-03T20:28:48.824846] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-03T20:28:48.824927] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-03T20:28:49.164029] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:28:49.188177] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-03T20:28:49.204458] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:28:49.236026] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-03T20:28:49.236335] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:28:49.236521] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-03T20:28:49.235858] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:49.237095] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-03T20:28:49.237163] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-03T20:28:49.237239] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-03T20:28:49.237321] [INFO ] [MAIN ] Update Progress: 1485/2370 symbols completed. NIQ took 5.2s. Estimated remaining: 2h 4m 24s. Rate: 7.1 symbols/min [2025-10-03T20:28:49.429754] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:28:49.429943] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-03T20:28:49.429982] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-03T20:28:49.430095] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-03T20:28:49.430136] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-03T20:28:49.430177] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-03T20:28:49.430258] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-03T20:28:49.591609] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-03T20:28:49.768983] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:28:49.862016] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:28:50.390697] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-03T20:28:51.190708] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-03T20:28:51.869509] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:28:51.990700] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-03T20:28:52.119865] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-03T20:28:52.790708] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-03T20:28:53.547533] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T20:28:53.590626] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-03T20:28:53.790325] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-03T20:28:54.390718] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-03T20:28:55.058331] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T20:28:55.190684] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-03T20:28:55.582607] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-03T20:28:55.990682] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-03T20:28:56.780948] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T20:28:56.790625] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-03T20:28:56.960433] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-03T20:28:57.347414] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T20:28:57.590687] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-03T20:28:58.360794] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T20:28:58.390711] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-03T20:28:59.190700] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-03T20:28:59.617442] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T20:28:59.813870] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-03T20:28:59.990679] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-03T20:29:00.790725] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-03T20:29:01.590629] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-03T20:29:01.706220] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-03T20:29:01.866337] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T20:29:02.390703] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-03T20:29:03.190676] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-03T20:29:03.305380] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T20:29:03.399502] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-03T20:29:03.990707] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-03T20:29:04.391712] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T20:29:04.790685] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-03T20:29:04.855748] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-03T20:29:05.590748] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-03T20:29:06.101757] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T20:29:06.390737] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-03T20:29:06.914587] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-03T20:29:06.967928] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T20:29:07.190725] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-03T20:29:07.990740] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-03T20:29:08.614241] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-03T20:29:08.790702] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-03T20:29:09.209927] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T20:29:09.590728] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-03T20:29:09.999095] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-03T20:29:10.379748] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T20:29:10.381443] [INFO ] [REMOTE ] NINE: Full fetch complete (43799 records). [2025-10-03T20:29:10.381549] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-03T20:29:10.396420] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-03T20:29:10.798593] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-03T20:29:10.798707] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-03T20:29:10.799525] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-03T20:29:10.799568] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-03T20:29:10.800629] [DEBUG] [LOCAL ] NINE: Trimmed 43799 records to 28549 (keeping 200 days of data) [2025-10-03T20:29:10.980994] [DEBUG] [LOCAL ] NINE: Primary data saved (28549 records). [2025-10-03T20:29:10.981238] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-03T20:29:10.981381] [INFO ] [MAIN ] Update Progress: 1486/2370 symbols completed. NINE took 32.2s. Estimated remaining: 2h 4m 24s. Rate: 7.1 symbols/min [2025-10-03T20:29:11.172085] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:11.188105] [DEBUG] [LOCAL ] NKX: Loaded 13792 existing records from primary storage. [2025-10-03T20:29:11.188348] [INFO ] [MAIN ] NKX: Loaded 13792 existing records. [2025-10-03T20:29:11.221336] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-03T20:29:11.388409] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:11.388851] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-03T20:29:11.388918] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-03T20:29:11.389202] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-03T20:29:11.389267] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-03T20:29:11.658413] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-03T20:29:11.854386] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:11.990704] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-03T20:29:12.055220] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T20:29:12.790700] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-03T20:29:13.368665] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T20:29:13.590702] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-03T20:29:14.321994] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T20:29:14.390618] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-03T20:29:14.680140] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-03T20:29:15.190707] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-03T20:29:15.990687] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-03T20:29:16.096343] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:29:16.316832] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T20:29:16.413967] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-03T20:29:16.790730] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-03T20:29:17.590709] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-03T20:29:17.948852] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T20:29:17.951454] [INFO ] [REMOTE ] NJR: Full fetch complete (54744 records). [2025-10-03T20:29:17.951549] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-03T20:29:18.377155] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-03T20:29:18.377306] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-03T20:29:18.378384] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-03T20:29:18.378450] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-03T20:29:18.379842] [DEBUG] [LOCAL ] NJR: Trimmed 54744 records to 38713 (keeping 200 days of data) [2025-10-03T20:29:18.434812] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-03T20:29:18.643566] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-03T20:29:18.684831] [DEBUG] [LOCAL ] NJR: Primary data saved (38713 records). [2025-10-03T20:29:18.684997] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-03T20:29:18.685113] [INFO ] [MAIN ] Update Progress: 1487/2370 symbols completed. NJR took 30.3s. Estimated remaining: 2h 4m 15s. Rate: 7.1 symbols/min [2025-10-03T20:29:18.880755] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:18.881004] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-03T20:29:18.881064] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-03T20:29:18.881178] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-03T20:29:18.881222] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-03T20:29:18.881273] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-03T20:29:18.881313] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-03T20:29:19.195884] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-03T20:29:19.260450] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:19.338197] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:29:19.782923] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-03T20:29:19.805516] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T20:29:19.808352] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-10-03T20:29:19.808508] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-03T20:29:19.995590] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-03T20:29:20.264133] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-03T20:29:20.264226] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-03T20:29:20.265433] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-03T20:29:20.265500] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-03T20:29:20.267116] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54582 (keeping 200 days of data) [2025-10-03T20:29:20.619377] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T20:29:20.625392] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-10-03T20:29:20.625567] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-03T20:29:20.625704] [INFO ] [MAIN ] Update Progress: 1488/2370 symbols completed. NIO took 40.8s. Estimated remaining: 2h 4m 3s. Rate: 7.1 symbols/min [2025-10-03T20:29:20.795865] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-03T20:29:20.831781] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:20.847991] [DEBUG] [LOCAL ] NLOP: Loaded 11794 existing records from primary storage. [2025-10-03T20:29:20.848345] [INFO ] [MAIN ] NLOP: Loaded 11794 existing records. [2025-10-03T20:29:21.050518] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:21.050789] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-03T20:29:21.050880] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-03T20:29:21.051165] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-03T20:29:21.051224] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-03T20:29:21.480048] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:21.590768] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-03T20:29:22.346395] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T20:29:22.390704] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-03T20:29:22.815212] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T20:29:23.075296] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T20:29:23.190626] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-03T20:29:23.990628] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-03T20:29:24.053238] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T20:29:24.790722] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-03T20:29:25.524205] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T20:29:25.590733] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-03T20:29:26.193803] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-03T20:29:26.196735] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-10-03T20:29:26.196946] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-03T20:29:26.324136] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T20:29:26.404363] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-03T20:29:26.430181] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T20:29:26.433604] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:29:26.433851] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:29:26.433947] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-03T20:29:26.434038] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-03T20:29:26.434081] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-03T20:29:26.434143] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-03T20:29:26.434247] [INFO ] [MAIN ] Update Progress: 1489/2370 symbols completed. NKE took 37.2s. Estimated remaining: 2h 3m 53s. Rate: 7.1 symbols/min [2025-10-03T20:29:26.625236] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:26.687243] [DEBUG] [LOCAL ] NLY: Loaded 53969 existing records from primary storage. [2025-10-03T20:29:26.687618] [INFO ] [MAIN ] NLY: Loaded 53969 existing records. [2025-10-03T20:29:26.894733] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:26.894948] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-03T20:29:26.894998] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-03T20:29:26.895399] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-03T20:29:26.895461] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-03T20:29:27.195736] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-03T20:29:27.281392] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:27.551779] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T20:29:27.889128] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T20:29:27.990711] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-03T20:29:28.768420] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T20:29:28.790627] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-03T20:29:29.499753] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T20:29:29.590756] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-03T20:29:30.390723] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-03T20:29:30.558631] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:29:31.102237] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T20:29:31.190720] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-03T20:29:31.990674] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-03T20:29:32.790683] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-03T20:29:32.839989] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T20:29:33.221384] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T20:29:33.590701] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-03T20:29:33.714299] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T20:29:34.390690] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-03T20:29:35.076821] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T20:29:35.190741] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-03T20:29:35.552601] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T20:29:35.990687] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-03T20:29:36.140240] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T20:29:36.790738] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-03T20:29:37.590639] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-03T20:29:37.744843] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T20:29:37.945209] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-03T20:29:38.390714] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-03T20:29:38.408168] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T20:29:39.190630] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-03T20:29:39.415135] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T20:29:39.990679] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-03T20:29:40.240969] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T20:29:40.521383] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:29:40.522218] [INFO ] [REMOTE ] NL: Full fetch complete (6828 records). [2025-10-03T20:29:40.522291] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-03T20:29:40.712110] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:29:40.712391] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:29:40.712492] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:29:40.712567] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-03T20:29:40.712632] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-03T20:29:40.712795] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-03T20:29:40.712891] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-03T20:29:40.712974] [INFO ] [MAIN ] Update Progress: 1490/2370 symbols completed. NL took 22.0s. Estimated remaining: 2h 3m 48s. Rate: 7.1 symbols/min [2025-10-03T20:29:40.795736] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-03T20:29:40.891372] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:40.909733] [DEBUG] [LOCAL ] NMAI: Loaded 12985 existing records from primary storage. [2025-10-03T20:29:40.909995] [INFO ] [MAIN ] NMAI: Loaded 12985 existing records. [2025-10-03T20:29:41.103129] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:41.103367] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-03T20:29:41.103416] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-03T20:29:41.103595] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-03T20:29:41.103725] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-03T20:29:41.483895] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:41.590684] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-03T20:29:42.390737] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-03T20:29:42.479363] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T20:29:43.015163] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T20:29:43.190680] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-03T20:29:43.441785] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T20:29:43.990635] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-03T20:29:44.073488] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T20:29:44.790676] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-03T20:29:44.871027] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T20:29:45.590683] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-03T20:29:45.852426] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T20:29:46.390694] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-03T20:29:46.551097] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T20:29:47.190702] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-03T20:29:47.240090] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T20:29:47.990681] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-03T20:29:48.105213] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T20:29:48.106629] [INFO ] [REMOTE ] NKX: Full fetch complete (19417 records). [2025-10-03T20:29:48.106729] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-03T20:29:48.496258] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-03T20:29:48.496362] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-03T20:29:48.496886] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-03T20:29:48.496953] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-03T20:29:48.498511] [DEBUG] [LOCAL ] NKX: Trimmed 19417 records to 13878 (keeping 200 days of data) [2025-10-03T20:29:48.590965] [DEBUG] [LOCAL ] NKX: Primary data saved (13878 records). [2025-10-03T20:29:48.591146] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-03T20:29:48.591330] [INFO ] [MAIN ] Update Progress: 1491/2370 symbols completed. NKX took 37.6s. Estimated remaining: 2h 3m 39s. Rate: 7.1 symbols/min [2025-10-03T20:29:48.785607] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:48.785874] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-03T20:29:48.785930] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-03T20:29:48.786043] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-03T20:29:48.786085] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-03T20:29:48.786127] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-03T20:29:48.786160] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-03T20:29:48.797411] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-03T20:29:49.164303] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T20:29:49.200010] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:49.590637] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-03T20:29:49.897896] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T20:29:50.390674] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-03T20:29:50.622551] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T20:29:51.190734] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-03T20:29:51.949719] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T20:29:51.950903] [INFO ] [REMOTE ] NLOP: Full fetch complete (17757 records). [2025-10-03T20:29:51.950978] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-03T20:29:51.996193] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-03T20:29:52.347758] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-03T20:29:52.347936] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-03T20:29:52.348567] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-03T20:29:52.348682] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-03T20:29:52.349453] [DEBUG] [LOCAL ] NLOP: Trimmed 17757 records to 11886 (keeping 200 days of data) [2025-10-03T20:29:52.426767] [DEBUG] [LOCAL ] NLOP: Primary data saved (11886 records). [2025-10-03T20:29:52.427072] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-03T20:29:52.427245] [INFO ] [MAIN ] Update Progress: 1492/2370 symbols completed. NLOP took 31.8s. Estimated remaining: 2h 3m 28s. Rate: 7.1 symbols/min [2025-10-03T20:29:52.659059] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T20:29:52.663167] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:52.698059] [DEBUG] [LOCAL ] NMCO: Loaded 16840 existing records from primary storage. [2025-10-03T20:29:52.698327] [INFO ] [MAIN ] NMCO: Loaded 16840 existing records. [2025-10-03T20:29:52.795835] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-03T20:29:52.885241] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:29:52.911431] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:52.915074] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-03T20:29:52.915180] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-03T20:29:52.915455] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-03T20:29:52.915554] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-03T20:29:53.124006] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:29:53.193799] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-03T20:29:53.205675] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:29:53.217539] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-03T20:29:53.226350] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:29:53.229790] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-03T20:29:53.229949] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-03T20:29:53.235756] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-03T20:29:53.246181] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-03T20:29:53.256555] [INFO ] [MAIN ] Update Progress: 1493/2370 symbols completed. NMAX took 4.7s. Estimated remaining: 2h 3m 15s. Rate: 7.1 symbols/min [2025-10-03T20:29:53.414766] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:53.504208] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:29:53.514367] [DEBUG] [LOCAL ] NMG: Loaded 8349 existing records from primary storage. [2025-10-03T20:29:53.514559] [INFO ] [MAIN ] NMG: Loaded 8349 existing records. [2025-10-03T20:29:53.595736] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-03T20:29:53.706799] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:29:53.707069] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-03T20:29:53.707126] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-03T20:29:53.707394] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-03T20:29:53.707454] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-03T20:29:54.085464] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:29:54.390703] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-03T20:29:54.802634] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:29:55.190725] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-03T20:29:55.990738] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-03T20:29:56.252743] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:29:56.447973] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T20:29:56.790743] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-03T20:29:57.009725] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T20:29:57.590706] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-03T20:29:57.756284] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:29:58.390768] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-03T20:29:58.642448] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T20:29:59.176838] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T20:29:59.190689] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-03T20:29:59.773030] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T20:29:59.990729] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-03T20:30:00.790673] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-03T20:30:00.914137] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T20:30:01.590732] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-03T20:30:01.845236] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:30:02.390748] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-03T20:30:03.168306] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T20:30:03.190632] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-03T20:30:03.283244] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T20:30:03.990682] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-03T20:30:04.236189] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T20:30:04.790706] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-03T20:30:05.590710] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-03T20:30:05.846450] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T20:30:05.994095] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T20:30:06.262992] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T20:30:06.390681] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-03T20:30:07.190678] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-03T20:30:07.444514] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T20:30:07.990685] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-03T20:30:08.790682] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-03T20:30:09.108673] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T20:30:09.422742] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T20:30:09.590695] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-03T20:30:09.819860] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T20:30:10.390704] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-03T20:30:11.190669] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-03T20:30:11.392222] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T20:30:11.710104] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T20:30:11.966579] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T20:30:11.990672] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-03T20:30:12.790678] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-03T20:30:13.590798] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-03T20:30:14.123198] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T20:30:14.124439] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T20:30:14.289105] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T20:30:14.290411] [INFO ] [REMOTE ] NMAI: Full fetch complete (19947 records). [2025-10-03T20:30:14.290499] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-03T20:30:14.395921] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-03T20:30:14.730594] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-03T20:30:14.730724] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-03T20:30:14.731250] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-03T20:30:14.731302] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-03T20:30:14.732435] [DEBUG] [LOCAL ] NMAI: Trimmed 19947 records to 13073 (keeping 200 days of data) [2025-10-03T20:30:14.828628] [DEBUG] [LOCAL ] NMAI: Primary data saved (13073 records). [2025-10-03T20:30:14.828805] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-03T20:30:14.828895] [INFO ] [MAIN ] Update Progress: 1494/2370 symbols completed. NMAI took 34.1s. Estimated remaining: 2h 3m 14s. Rate: 7.1 symbols/min [2025-10-03T20:30:15.015578] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:15.023363] [DEBUG] [LOCAL ] NMI: Loaded 4082 existing records from primary storage. [2025-10-03T20:30:15.023605] [INFO ] [MAIN ] NMI: Loaded 4082 existing records. [2025-10-03T20:30:15.214589] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-03T20:30:15.220889] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:15.221979] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-03T20:30:15.222037] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-03T20:30:15.222220] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-03T20:30:15.222282] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-03T20:30:15.623877] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:15.990627] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-03T20:30:16.311458] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:30:16.312534] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-03T20:30:16.320017] [INFO ] [REMOTE ] NLY: Full fetch complete (77565 records). [2025-10-03T20:30:16.320189] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-03T20:30:16.673030] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-03T20:30:16.781506] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-03T20:30:16.781590] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-03T20:30:16.782690] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-03T20:30:16.782761] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-03T20:30:16.784297] [DEBUG] [LOCAL ] NLY: Trimmed 77565 records to 54355 (keeping 200 days of data) [2025-10-03T20:30:16.839736] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-03T20:30:17.140128] [DEBUG] [LOCAL ] NLY: Primary data saved (54355 records). [2025-10-03T20:30:17.140277] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-03T20:30:17.141957] [INFO ] [MAIN ] Update Progress: 1495/2370 symbols completed. NLY took 50.7s. Estimated remaining: 2h 3m 2s. Rate: 7.1 symbols/min [2025-10-03T20:30:17.330473] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:17.348827] [DEBUG] [LOCAL ] NMM: Loaded 14430 existing records from primary storage. [2025-10-03T20:30:17.349084] [INFO ] [MAIN ] NMM: Loaded 14430 existing records. [2025-10-03T20:30:17.554583] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:17.555049] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-03T20:30:17.555184] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-03T20:30:17.555536] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-03T20:30:17.555597] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-03T20:30:17.595842] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-03T20:30:17.647563] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T20:30:17.987466] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:18.306705] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T20:30:18.308348] [INFO ] [REMOTE ] NMCO: Full fetch complete (24259 records). [2025-10-03T20:30:18.308511] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-03T20:30:18.395816] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-03T20:30:18.739935] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-03T20:30:18.740121] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-03T20:30:18.741080] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-03T20:30:18.741187] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-03T20:30:18.742588] [DEBUG] [LOCAL ] NMCO: Trimmed 24259 records to 17047 (keeping 200 days of data) [2025-10-03T20:30:18.858204] [DEBUG] [LOCAL ] NMCO: Primary data saved (17047 records). [2025-10-03T20:30:18.858477] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-03T20:30:18.858812] [INFO ] [MAIN ] Update Progress: 1496/2370 symbols completed. NMCO took 26.4s. Estimated remaining: 2h 2m 50s. Rate: 7.1 symbols/min [2025-10-03T20:30:18.864942] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T20:30:19.058892] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:19.097908] [DEBUG] [LOCAL ] NMR: Loaded 35236 existing records from primary storage. [2025-10-03T20:30:19.098251] [INFO ] [MAIN ] NMR: Loaded 35236 existing records. [2025-10-03T20:30:19.195887] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-03T20:30:19.297669] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:19.297959] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-03T20:30:19.298022] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-03T20:30:19.298373] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-03T20:30:19.298435] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-03T20:30:19.711223] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:19.941931] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T20:30:19.990682] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-03T20:30:20.790728] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-03T20:30:21.195448] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T20:30:21.590736] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-03T20:30:21.997218] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:30:22.083005] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T20:30:22.390730] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-03T20:30:23.190630] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-03T20:30:23.488799] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T20:30:23.929918] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T20:30:23.990713] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-03T20:30:24.790690] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-03T20:30:25.004390] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T20:30:25.432790] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T20:30:25.590692] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-03T20:30:26.283638] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T20:30:26.390706] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-03T20:30:26.793231] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-03T20:30:27.190722] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-03T20:30:27.891783] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T20:30:27.990673] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-03T20:30:28.790745] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-03T20:30:28.922205] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T20:30:29.542120] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T20:30:29.590719] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-03T20:30:30.390722] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-03T20:30:30.432120] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T20:30:31.190734] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-03T20:30:31.795119] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T20:30:31.936166] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T20:30:31.990682] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-03T20:30:32.790712] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-03T20:30:33.498443] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T20:30:33.590671] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-03T20:30:33.723177] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T20:30:34.390772] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-03T20:30:35.190631] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-03T20:30:35.226902] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T20:30:35.423744] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T20:30:35.920639] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T20:30:35.922041] [INFO ] [REMOTE ] NMG: Full fetch complete (13482 records). [2025-10-03T20:30:35.922114] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-03T20:30:35.995751] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-03T20:30:36.320905] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-03T20:30:36.320989] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-03T20:30:36.321354] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-03T20:30:36.321397] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-03T20:30:36.321942] [DEBUG] [LOCAL ] NMG: Trimmed 13482 records to 8496 (keeping 200 days of data) [2025-10-03T20:30:36.382664] [DEBUG] [LOCAL ] NMG: Primary data saved (8496 records). [2025-10-03T20:30:36.383103] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-03T20:30:36.383236] [INFO ] [MAIN ] Update Progress: 1497/2370 symbols completed. NMG took 43.1s. Estimated remaining: 2h 2m 46s. Rate: 7.1 symbols/min [2025-10-03T20:30:36.557138] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:36.563733] [DEBUG] [LOCAL ] NMS: Loaded 2875 existing records from primary storage. [2025-10-03T20:30:36.563918] [INFO ] [MAIN ] NMS: Loaded 2875 existing records. [2025-10-03T20:30:36.751942] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:36.752266] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-03T20:30:36.752320] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-03T20:30:36.752977] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-03T20:30:36.753036] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-03T20:30:36.798543] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-03T20:30:37.144849] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:37.230547] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T20:30:37.562514] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T20:30:37.590665] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-03T20:30:38.069843] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T20:30:38.070630] [INFO ] [REMOTE ] NMI: Full fetch complete (6049 records). [2025-10-03T20:30:38.070748] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-03T20:30:38.395816] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-03T20:30:38.465199] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-03T20:30:38.465345] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-03T20:30:38.465621] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-03T20:30:38.465734] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-03T20:30:38.466428] [DEBUG] [LOCAL ] NMI: Trimmed 6049 records to 4096 (keeping 200 days of data) [2025-10-03T20:30:38.493155] [DEBUG] [LOCAL ] NMI: Primary data saved (4096 records). [2025-10-03T20:30:38.493312] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-03T20:30:38.493431] [INFO ] [MAIN ] Update Progress: 1498/2370 symbols completed. NMI took 23.7s. Estimated remaining: 2h 2m 34s. Rate: 7.1 symbols/min [2025-10-03T20:30:38.700257] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:38.706535] [DEBUG] [LOCAL ] NMT: Loaded 2883 existing records from primary storage. [2025-10-03T20:30:38.706815] [INFO ] [MAIN ] NMT: Loaded 2883 existing records. [2025-10-03T20:30:38.910175] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:38.910427] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-03T20:30:38.910479] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-03T20:30:38.910716] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-03T20:30:38.910780] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-03T20:30:39.195843] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-03T20:30:39.308054] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:39.831199] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T20:30:39.961120] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T20:30:39.990615] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-03T20:30:40.790710] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-03T20:30:41.494579] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T20:30:41.507436] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T20:30:41.590690] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-03T20:30:42.390739] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-03T20:30:42.995437] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T20:30:43.054947] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T20:30:43.190635] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-03T20:30:43.990672] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-03T20:30:44.529722] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:30:44.790920] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-03T20:30:44.793621] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T20:30:45.369868] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T20:30:45.590706] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-03T20:30:46.110975] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-03T20:30:46.390713] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-03T20:30:46.925155] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T20:30:47.190719] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-03T20:30:47.838194] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T20:30:47.990679] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-03T20:30:48.532858] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-03T20:30:48.790714] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-03T20:30:49.590708] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-03T20:30:50.298505] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T20:30:50.390687] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-03T20:30:50.468787] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T20:30:51.033362] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T20:30:51.190706] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-03T20:30:51.990677] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-03T20:30:52.221979] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T20:30:52.388543] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T20:30:52.790734] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-03T20:30:53.590720] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-03T20:30:54.297307] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T20:30:54.321435] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T20:30:54.390730] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-03T20:30:54.931835] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T20:30:55.190705] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-03T20:30:55.606392] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T20:30:55.607200] [INFO ] [REMOTE ] NMS: Full fetch complete (4029 records). [2025-10-03T20:30:55.607274] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-03T20:30:56.008144] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-03T20:30:55.998881] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-03T20:30:56.008381] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-03T20:30:56.009573] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-03T20:30:56.009671] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-03T20:30:56.010259] [DEBUG] [LOCAL ] NMS: Trimmed 4029 records to 2885 (keeping 200 days of data) [2025-10-03T20:30:56.031101] [DEBUG] [LOCAL ] NMS: Primary data saved (2885 records). [2025-10-03T20:30:56.031256] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-03T20:30:56.031367] [INFO ] [MAIN ] Update Progress: 1499/2370 symbols completed. NMS took 19.6s. Estimated remaining: 2h 2m 31s. Rate: 7.1 symbols/min [2025-10-03T20:30:56.217858] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:56.240368] [DEBUG] [LOCAL ] NMZ: Loaded 21855 existing records from primary storage. [2025-10-03T20:30:56.240629] [INFO ] [MAIN ] NMZ: Loaded 21855 existing records. [2025-10-03T20:30:56.436396] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:56.436714] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-03T20:30:56.436789] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-03T20:30:56.437491] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-03T20:30:56.437558] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-03T20:30:56.803891] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-03T20:30:56.853837] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:56.918157] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T20:30:57.590702] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-03T20:30:58.133961] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T20:30:58.137261] [INFO ] [REMOTE ] NMR: Full fetch complete (50680 records). [2025-10-03T20:30:58.137386] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-03T20:30:58.395888] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-03T20:30:58.557551] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-03T20:30:58.557665] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-03T20:30:58.558685] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-03T20:30:58.558791] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-03T20:30:58.559994] [DEBUG] [LOCAL ] NMR: Trimmed 50680 records to 35491 (keeping 200 days of data) [2025-10-03T20:30:58.775153] [DEBUG] [LOCAL ] NMR: Primary data saved (35491 records). [2025-10-03T20:30:58.775304] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-03T20:30:58.775403] [INFO ] [MAIN ] Update Progress: 1500/2370 symbols completed. NMR took 39.9s. Estimated remaining: 2h 2m 19s. Rate: 7.1 symbols/min [2025-10-03T20:30:58.950349] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T20:30:58.972274] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:30:58.991691] [DEBUG] [LOCAL ] NNI: Loaded 10284 existing records from primary storage. [2025-10-03T20:30:58.991973] [INFO ] [MAIN ] NNI: Loaded 10284 existing records. [2025-10-03T20:30:59.192056] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-03T20:30:59.196505] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:30:59.198214] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-03T20:30:59.198309] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-03T20:30:59.198796] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-03T20:30:59.198859] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-03T20:30:59.580685] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:30:59.690895] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T20:30:59.990700] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-03T20:31:00.342972] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T20:31:00.790686] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-03T20:31:00.898431] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T20:31:01.590744] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-03T20:31:02.182853] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T20:31:02.186108] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T20:31:02.390709] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-03T20:31:03.190726] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-03T20:31:03.543192] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:31:03.887122] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-03T20:31:03.990703] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-03T20:31:04.790722] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-03T20:31:05.215694] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T20:31:05.512204] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:31:05.513499] [INFO ] [REMOTE ] NMM: Full fetch complete (21854 records). [2025-10-03T20:31:05.513571] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-03T20:31:05.595793] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-03T20:31:05.944331] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-03T20:31:05.944425] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-03T20:31:05.944921] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-03T20:31:05.944987] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-03T20:31:05.945851] [DEBUG] [LOCAL ] NMM: Trimmed 21854 records to 14505 (keeping 200 days of data) [2025-10-03T20:31:06.039663] [DEBUG] [LOCAL ] NMM: Primary data saved (14505 records). [2025-10-03T20:31:06.039828] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-03T20:31:06.039937] [INFO ] [MAIN ] Update Progress: 1501/2370 symbols completed. NMM took 48.9s. Estimated remaining: 2h 2m 10s. Rate: 7.1 symbols/min [2025-10-03T20:31:06.238310] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:06.304020] [DEBUG] [LOCAL ] NNN: Loaded 48691 existing records from primary storage. [2025-10-03T20:31:06.304359] [INFO ] [MAIN ] NNN: Loaded 48691 existing records. [2025-10-03T20:31:06.394699] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-03T20:31:06.440329] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T20:31:06.521449] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:06.521775] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-03T20:31:06.521836] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-03T20:31:06.522943] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-03T20:31:06.523008] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-03T20:31:06.927257] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:07.190698] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-03T20:31:07.951066] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T20:31:07.990699] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-03T20:31:08.744960] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T20:31:08.790695] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-03T20:31:08.898935] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T20:31:09.225627] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T20:31:09.590728] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-03T20:31:10.317187] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T20:31:10.390697] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-03T20:31:11.190705] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-03T20:31:11.463346] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T20:31:11.735692] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T20:31:11.990687] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-03T20:31:12.790721] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-03T20:31:12.882854] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T20:31:13.590700] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-03T20:31:13.924016] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T20:31:14.025817] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T20:31:14.390737] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-03T20:31:15.190676] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-03T20:31:15.565678] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T20:31:15.990706] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-03T20:31:16.651504] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T20:31:16.790668] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-03T20:31:16.908506] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T20:31:17.288329] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T20:31:17.289395] [INFO ] [REMOTE ] NMT: Full fetch complete (4093 records). [2025-10-03T20:31:17.289469] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-03T20:31:17.595790] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-03T20:31:17.705707] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-03T20:31:17.705831] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-03T20:31:17.705994] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-03T20:31:17.706332] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-03T20:31:17.706861] [DEBUG] [LOCAL ] NMT: Trimmed 4093 records to 2905 (keeping 200 days of data) [2025-10-03T20:31:17.726185] [DEBUG] [LOCAL ] NMT: Primary data saved (2905 records). [2025-10-03T20:31:17.726338] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-03T20:31:17.726444] [INFO ] [MAIN ] Update Progress: 1502/2370 symbols completed. NMT took 39.2s. Estimated remaining: 2h 2m 4s. Rate: 7.1 symbols/min [2025-10-03T20:31:17.916670] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:17.925424] [DEBUG] [LOCAL ] NNY: Loaded 5763 existing records from primary storage. [2025-10-03T20:31:17.925697] [INFO ] [MAIN ] NNY: Loaded 5763 existing records. [2025-10-03T20:31:18.120594] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:18.120835] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-03T20:31:18.120905] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-03T20:31:18.121261] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-03T20:31:18.121321] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-03T20:31:18.395893] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-03T20:31:18.509389] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:18.809123] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T20:31:19.190707] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-03T20:31:19.323001] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:31:19.990695] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-03T20:31:20.790723] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-03T20:31:20.932365] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T20:31:20.951340] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T20:31:21.590632] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-03T20:31:21.656996] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T20:31:22.390712] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-03T20:31:23.190630] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-03T20:31:23.516797] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T20:31:23.650680] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T20:31:23.771721] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T20:31:23.990728] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-03T20:31:24.724394] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T20:31:24.790728] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-03T20:31:25.530354] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T20:31:25.590697] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-03T20:31:26.390714] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-03T20:31:26.445492] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T20:31:26.446942] [INFO ] [REMOTE ] NMZ: Full fetch complete (31870 records). [2025-10-03T20:31:26.447027] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-03T20:31:26.867386] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-03T20:31:26.867483] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-03T20:31:26.868296] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-03T20:31:26.868366] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-03T20:31:26.869325] [DEBUG] [LOCAL ] NMZ: Trimmed 31870 records to 22014 (keeping 200 days of data) [2025-10-03T20:31:27.015915] [DEBUG] [LOCAL ] NMZ: Primary data saved (22014 records). [2025-10-03T20:31:27.016061] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-03T20:31:27.016162] [INFO ] [MAIN ] Update Progress: 1503/2370 symbols completed. NMZ took 31.0s. Estimated remaining: 2h 1m 56s. Rate: 7.1 symbols/min [2025-10-03T20:31:27.204974] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-03T20:31:27.210757] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:27.230044] [DEBUG] [LOCAL ] NOA: Loaded 16282 existing records from primary storage. [2025-10-03T20:31:27.230337] [INFO ] [MAIN ] NOA: Loaded 16282 existing records. [2025-10-03T20:31:27.448630] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:27.449227] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-03T20:31:27.449293] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-03T20:31:27.449899] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-03T20:31:27.450008] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-03T20:31:27.879281] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:27.982311] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T20:31:27.990602] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-03T20:31:28.291495] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T20:31:28.655916] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T20:31:28.790732] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-03T20:31:29.590722] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-03T20:31:29.705218] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:31:30.390639] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-03T20:31:30.471381] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:31:31.190740] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-03T20:31:31.940874] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T20:31:31.990728] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-03T20:31:32.058954] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T20:31:32.790695] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-03T20:31:32.835305] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T20:31:33.590726] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-03T20:31:34.390701] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-03T20:31:34.465451] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T20:31:34.505832] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T20:31:35.190718] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-03T20:31:35.318046] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T20:31:35.990727] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-03T20:31:36.790697] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-03T20:31:36.934852] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T20:31:37.065247] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T20:31:37.272669] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T20:31:37.590728] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-03T20:31:38.390809] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-03T20:31:38.665081] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T20:31:38.952936] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T20:31:39.190702] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-03T20:31:39.990752] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-03T20:31:40.790693] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-03T20:31:40.832127] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:31:41.048568] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T20:31:41.590684] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-03T20:31:41.743067] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T20:31:42.390683] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-03T20:31:42.664589] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T20:31:43.190730] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-03T20:31:43.919872] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T20:31:43.920947] [INFO ] [REMOTE ] NNI: Full fetch complete (12936 records). [2025-10-03T20:31:43.921019] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-03T20:31:44.001316] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-03T20:31:44.333216] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-03T20:31:44.333459] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-03T20:31:44.334069] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-03T20:31:44.334169] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-03T20:31:44.335275] [DEBUG] [LOCAL ] NNI: Trimmed 12936 records to 10353 (keeping 200 days of data) [2025-10-03T20:31:44.371896] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T20:31:44.454986] [DEBUG] [LOCAL ] NNI: Primary data saved (10353 records). [2025-10-03T20:31:44.455145] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-03T20:31:44.455246] [INFO ] [MAIN ] Update Progress: 1504/2370 symbols completed. NNI took 45.7s. Estimated remaining: 2h 1m 53s. Rate: 7.1 symbols/min [2025-10-03T20:31:44.642311] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:44.665402] [DEBUG] [LOCAL ] NOAH: Loaded 20504 existing records from primary storage. [2025-10-03T20:31:44.665728] [INFO ] [MAIN ] NOAH: Loaded 20504 existing records. [2025-10-03T20:31:44.795875] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-03T20:31:44.883586] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:44.891666] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T20:31:44.891212] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-03T20:31:44.891908] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-03T20:31:44.895449] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-03T20:31:44.895529] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-03T20:31:45.372778] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:45.590746] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-03T20:31:46.341474] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T20:31:46.344280] [INFO ] [REMOTE ] NNN: Full fetch complete (70346 records). [2025-10-03T20:31:46.344386] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-03T20:31:46.395875] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-03T20:31:46.590351] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T20:31:46.811745] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-03T20:31:46.811833] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-03T20:31:46.812907] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-03T20:31:46.812976] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-03T20:31:46.814436] [DEBUG] [LOCAL ] NNN: Trimmed 70346 records to 49066 (keeping 200 days of data) [2025-10-03T20:31:47.134481] [DEBUG] [LOCAL ] NNN: Primary data saved (49066 records). [2025-10-03T20:31:47.134730] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-03T20:31:47.135382] [INFO ] [MAIN ] Update Progress: 1505/2370 symbols completed. NNN took 41.1s. Estimated remaining: 2h 1m 41s. Rate: 7.1 symbols/min [2025-10-03T20:31:47.201350] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-03T20:31:47.336491] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:47.387782] [DEBUG] [LOCAL ] NOC: Loaded 42344 existing records from primary storage. [2025-10-03T20:31:47.388111] [INFO ] [MAIN ] NOC: Loaded 42344 existing records. [2025-10-03T20:31:47.582218] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:47.582637] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-03T20:31:47.582730] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-03T20:31:47.583767] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-03T20:31:47.583831] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-03T20:31:47.740774] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T20:31:47.821134] [INFO ] [REMOTE ] NNY: Full fetch complete (8779 records). [2025-10-03T20:31:47.850523] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-03T20:31:47.993679] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-03T20:31:48.138025] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:48.156022] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T20:31:48.428823] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-03T20:31:48.428904] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-03T20:31:48.429122] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-03T20:31:48.429163] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-03T20:31:48.429613] [DEBUG] [LOCAL ] NNY: Trimmed 8779 records to 5784 (keeping 200 days of data) [2025-10-03T20:31:48.466882] [DEBUG] [LOCAL ] NNY: Primary data saved (5784 records). [2025-10-03T20:31:48.467053] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-03T20:31:48.467174] [INFO ] [MAIN ] Update Progress: 1506/2370 symbols completed. NNY took 30.7s. Estimated remaining: 2h 1m 28s. Rate: 7.1 symbols/min [2025-10-03T20:31:48.654240] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:48.715916] [DEBUG] [LOCAL ] NOG: Loaded 51580 existing records from primary storage. [2025-10-03T20:31:48.716274] [INFO ] [MAIN ] NOG: Loaded 51580 existing records. [2025-10-03T20:31:48.796298] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-03T20:31:48.913433] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:48.913779] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-03T20:31:48.913831] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-03T20:31:48.914051] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-03T20:31:48.914111] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-03T20:31:49.186055] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:31:49.320506] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:49.590708] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-03T20:31:49.722122] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T20:31:50.390738] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-03T20:31:50.810773] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T20:31:51.190727] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-03T20:31:51.912460] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T20:31:51.990691] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-03T20:31:52.631295] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T20:31:52.790683] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-03T20:31:53.590747] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-03T20:31:53.849088] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T20:31:53.940611] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T20:31:54.390710] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-03T20:31:54.677090] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T20:31:55.123222] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T20:31:55.124874] [INFO ] [REMOTE ] NOA: Full fetch complete (22033 records). [2025-10-03T20:31:55.124964] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-03T20:31:55.195794] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-03T20:31:55.550206] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-03T20:31:55.550291] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-03T20:31:55.550878] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-03T20:31:55.550951] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-03T20:31:55.551951] [DEBUG] [LOCAL ] NOA: Trimmed 22033 records to 16385 (keeping 200 days of data) [2025-10-03T20:31:55.668675] [DEBUG] [LOCAL ] NOA: Primary data saved (16385 records). [2025-10-03T20:31:55.668871] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-03T20:31:55.669003] [INFO ] [MAIN ] Update Progress: 1507/2370 symbols completed. NOA took 28.7s. Estimated remaining: 2h 1m 19s. Rate: 7.1 symbols/min [2025-10-03T20:31:55.858529] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:31:55.910737] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-10-03T20:31:55.911087] [INFO ] [MAIN ] NOK: Loaded 54011 existing records. [2025-10-03T20:31:55.995808] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-03T20:31:56.114007] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:31:56.114227] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-03T20:31:56.114286] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-03T20:31:56.114545] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-03T20:31:56.114614] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-03T20:31:56.517827] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:31:56.790714] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-03T20:31:57.096164] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:31:57.590635] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-03T20:31:57.958850] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T20:31:58.390691] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-03T20:31:58.885710] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T20:31:59.190628] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-03T20:31:59.376901] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T20:31:59.555445] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T20:31:59.990705] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-03T20:32:00.790623] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-03T20:32:01.205683] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T20:32:01.446857] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T20:32:01.590692] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-03T20:32:02.395746] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-03T20:32:02.413080] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T20:32:03.190703] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-03T20:32:03.825782] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-03T20:32:03.990634] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-03T20:32:04.507228] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T20:32:04.790675] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-03T20:32:04.894246] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T20:32:05.590733] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-03T20:32:06.176109] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-03T20:32:06.268503] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T20:32:06.390680] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-03T20:32:06.491631] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T20:32:07.190717] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-03T20:32:07.990729] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-03T20:32:08.118930] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T20:32:08.731334] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-03T20:32:08.790716] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-03T20:32:09.590680] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-03T20:32:09.874863] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T20:32:10.390754] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-03T20:32:10.723344] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T20:32:11.190674] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-03T20:32:11.500715] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T20:32:11.529609] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T20:32:11.990713] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-03T20:32:12.790708] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-03T20:32:13.102131] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T20:32:13.590684] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-03T20:32:13.783243] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T20:32:13.883940] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T20:32:14.390707] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-03T20:32:15.190674] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-03T20:32:15.350113] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T20:32:15.713736] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T20:32:15.990715] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-03T20:32:16.790677] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-03T20:32:16.965163] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T20:32:16.966849] [INFO ] [REMOTE ] NOAH: Full fetch complete (28444 records). [2025-10-03T20:32:16.966956] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-03T20:32:17.380687] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-03T20:32:17.380778] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-03T20:32:17.381423] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-03T20:32:17.381477] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-03T20:32:17.382337] [DEBUG] [LOCAL ] NOAH: Trimmed 28444 records to 20616 (keeping 200 days of data) [2025-10-03T20:32:17.511567] [DEBUG] [LOCAL ] NOAH: Primary data saved (20616 records). [2025-10-03T20:32:17.511850] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-03T20:32:17.512121] [INFO ] [MAIN ] Update Progress: 1508/2370 symbols completed. NOAH took 33.1s. Estimated remaining: 2h 1m 18s. Rate: 7.1 symbols/min [2025-10-03T20:32:17.598110] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-03T20:32:17.646480] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-03T20:32:17.774488] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:17.774760] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-03T20:32:17.774820] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-03T20:32:17.774940] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-03T20:32:17.775011] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-03T20:32:17.775072] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-03T20:32:17.775109] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-03T20:32:18.173882] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:32:18.390735] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-03T20:32:18.741861] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T20:32:18.968351] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T20:32:19.190717] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-03T20:32:19.498591] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T20:32:19.990659] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-03T20:32:20.790624] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-03T20:32:21.215840] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T20:32:21.266093] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T20:32:21.590714] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-03T20:32:21.664272] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T20:32:22.390705] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-03T20:32:22.896781] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T20:32:23.190704] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-03T20:32:23.479591] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T20:32:23.990689] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-03T20:32:24.483557] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T20:32:24.790720] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-03T20:32:25.501103] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-03T20:32:25.590679] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-03T20:32:26.127400] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:32:26.129551] [INFO ] [REMOTE ] NOC: Full fetch complete (61707 records). [2025-10-03T20:32:26.129705] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-03T20:32:26.398594] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-03T20:32:26.599717] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-03T20:32:26.599816] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-03T20:32:26.601014] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-03T20:32:26.601089] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-03T20:32:26.602496] [DEBUG] [LOCAL ] NOC: Trimmed 61707 records to 42554 (keeping 200 days of data) [2025-10-03T20:32:26.890183] [DEBUG] [LOCAL ] NOC: Primary data saved (42554 records). [2025-10-03T20:32:26.890319] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-03T20:32:26.891739] [INFO ] [MAIN ] Update Progress: 1509/2370 symbols completed. NOC took 39.8s. Estimated remaining: 2h 1m 10s. Rate: 7.1 symbols/min [2025-10-03T20:32:27.013151] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T20:32:27.089445] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:27.097615] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T20:32:27.100704] [INFO ] [REMOTE ] NOG: Full fetch complete (73914 records). [2025-10-03T20:32:27.100914] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-03T20:32:27.192576] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-03T20:32:27.461444] [DEBUG] [LOCAL ] NOMD: Loaded 41855 existing records from primary storage. [2025-10-03T20:32:27.483215] [INFO ] [MAIN ] NOMD: Loaded 41855 existing records. [2025-10-03T20:32:27.735754] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-03T20:32:27.761463] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-03T20:32:27.779522] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-03T20:32:27.803687] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-03T20:32:27.803489] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:32:27.804287] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-03T20:32:27.804357] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-03T20:32:27.804939] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-03T20:32:27.805018] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-03T20:32:27.897926] [DEBUG] [LOCAL ] NOG: Trimmed 73914 records to 51954 (keeping 200 days of data) [2025-10-03T20:32:27.998972] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-03T20:32:28.328256] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:32:28.578320] [DEBUG] [LOCAL ] NOG: Primary data saved (51954 records). [2025-10-03T20:32:28.578489] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-03T20:32:28.578603] [INFO ] [MAIN ] Update Progress: 1510/2370 symbols completed. NOG took 40.1s. Estimated remaining: 2h 0m 58s. Rate: 7.1 symbols/min [2025-10-03T20:32:28.682136] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T20:32:28.769602] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:28.796706] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-03T20:32:28.817961] [DEBUG] [LOCAL ] NOTE: Loaded 42000 existing records from primary storage. [2025-10-03T20:32:28.818335] [INFO ] [MAIN ] NOTE: Loaded 42000 existing records. [2025-10-03T20:32:29.017621] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:32:29.017999] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-03T20:32:29.018093] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-03T20:32:29.018406] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-03T20:32:29.018466] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-03T20:32:29.247881] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T20:32:29.434570] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:32:29.507627] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T20:32:29.590745] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-03T20:32:30.390715] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-03T20:32:31.190733] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-03T20:32:31.823863] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T20:32:31.953509] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T20:32:31.990729] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-03T20:32:32.790737] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-03T20:32:33.275205] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T20:32:33.478723] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T20:32:33.590699] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-03T20:32:34.390624] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-03T20:32:34.697929] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T20:32:34.700813] [INFO ] [REMOTE ] NOK: Full fetch complete (77637 records). [2025-10-03T20:32:34.700953] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-03T20:32:35.009218] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T20:32:35.175365] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-03T20:32:35.175508] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-03T20:32:35.177494] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-03T20:32:35.177853] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-03T20:32:35.192776] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-03T20:32:35.205485] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T20:32:35.215748] [DEBUG] [LOCAL ] NOK: Trimmed 77637 records to 54401 (keeping 200 days of data) [2025-10-03T20:32:35.572257] [DEBUG] [LOCAL ] NOK: Primary data saved (54401 records). [2025-10-03T20:32:35.572424] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-03T20:32:35.572547] [INFO ] [MAIN ] Update Progress: 1511/2370 symbols completed. NOK took 39.9s. Estimated remaining: 2h 0m 49s. Rate: 7.1 symbols/min [2025-10-03T20:32:35.761493] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:35.816818] [DEBUG] [LOCAL ] NOV: Loaded 53570 existing records from primary storage. [2025-10-03T20:32:35.817309] [INFO ] [MAIN ] NOV: Loaded 53570 existing records. [2025-10-03T20:32:36.025121] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:32:36.025396] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-03T20:32:36.025466] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-03T20:32:36.010317] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-03T20:32:36.026769] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-03T20:32:36.026829] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-03T20:32:36.429764] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:32:36.790741] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-03T20:32:37.269146] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T20:32:37.590689] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-03T20:32:37.661133] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T20:32:37.994548] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T20:32:38.390715] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-03T20:32:38.767492] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T20:32:39.190740] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-03T20:32:39.990620] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-03T20:32:40.106478] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T20:32:40.790720] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-03T20:32:41.180059] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-03T20:32:41.590733] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-03T20:32:41.888932] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:32:42.065169] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T20:32:42.390716] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-03T20:32:43.061838] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T20:32:43.190688] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-03T20:32:43.990733] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-03T20:32:44.230777] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T20:32:44.520069] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T20:32:44.790733] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-03T20:32:44.855392] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T20:32:45.148588] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T20:32:45.149377] [INFO ] [REMOTE ] NOM: Full fetch complete (1620 records). [2025-10-03T20:32:45.149448] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-03T20:32:45.356482] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-03T20:32:45.356693] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:32:45.356752] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:32:45.356821] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-03T20:32:45.356902] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-03T20:32:45.356994] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-03T20:32:45.357073] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-03T20:32:45.357168] [INFO ] [MAIN ] Update Progress: 1512/2370 symbols completed. NOM took 27.8s. Estimated remaining: 2h 0m 41s. Rate: 7.1 symbols/min [2025-10-03T20:32:45.537600] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:45.537858] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-03T20:32:45.537902] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-03T20:32:45.538017] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-03T20:32:45.538059] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-03T20:32:45.538110] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-03T20:32:45.538146] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-03T20:32:45.595981] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-03T20:32:45.922498] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:32:46.390728] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-03T20:32:47.190720] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-03T20:32:47.465203] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T20:32:47.972135] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T20:32:47.990699] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-03T20:32:48.790629] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-03T20:32:49.024120] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T20:32:49.590720] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-03T20:32:50.107739] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T20:32:50.167524] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T20:32:50.390698] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-03T20:32:51.190691] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-03T20:32:51.541563] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T20:32:51.990672] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-03T20:32:52.367154] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T20:32:52.790742] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-03T20:32:53.358215] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-03T20:32:53.591336] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T20:32:53.591606] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-03T20:32:54.390731] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-03T20:32:54.693978] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T20:32:55.190716] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-03T20:32:55.559266] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T20:32:55.990720] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-03T20:32:56.329123] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T20:32:56.458741] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T20:32:56.790726] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-03T20:32:57.590700] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-03T20:32:57.810403] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:32:58.390689] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-03T20:32:58.932230] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:32:58.935357] [INFO ] [REMOTE ] NOMD: Full fetch complete (59361 records). [2025-10-03T20:32:58.935632] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-03T20:32:59.144947] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-03T20:32:59.191711] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-03T20:32:59.434041] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-03T20:32:59.434214] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-03T20:32:59.435287] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-03T20:32:59.435354] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-03T20:32:59.436908] [DEBUG] [LOCAL ] NOMD: Trimmed 59361 records to 42192 (keeping 200 days of data) [2025-10-03T20:32:59.709344] [DEBUG] [LOCAL ] NOMD: Primary data saved (42192 records). [2025-10-03T20:32:59.709513] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-03T20:32:59.709619] [INFO ] [MAIN ] Update Progress: 1513/2370 symbols completed. NOMD took 32.8s. Estimated remaining: 2h 0m 36s. Rate: 7.1 symbols/min [2025-10-03T20:32:59.897274] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:32:59.897552] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-03T20:32:59.897624] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-03T20:32:59.897826] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-03T20:32:59.897885] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-03T20:32:59.898018] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-03T20:32:59.898122] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-03T20:32:59.996054] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-03T20:33:00.243535] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T20:33:00.370362] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:00.573732] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T20:33:00.790704] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-03T20:33:01.145475] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:33:01.145926] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-03T20:33:01.146045] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:33:01.146115] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-03T20:33:01.146190] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:33:01.146277] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-03T20:33:01.146364] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-03T20:33:01.146427] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-03T20:33:01.146511] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-03T20:33:01.146606] [INFO ] [MAIN ] Update Progress: 1514/2370 symbols completed. NP took 1.4s. Estimated remaining: 2h 0m 24s. Rate: 7.1 symbols/min [2025-10-03T20:33:01.339771] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:01.339968] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-03T20:33:01.340064] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-03T20:33:01.340220] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-03T20:33:01.340288] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-03T20:33:01.340344] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-03T20:33:01.340380] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-03T20:33:01.598060] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-03T20:33:01.731410] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:02.390637] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-03T20:33:02.477867] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-03T20:33:03.190727] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-03T20:33:03.474697] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T20:33:03.476454] [INFO ] [REMOTE ] NOTE: Full fetch complete (63443 records). [2025-10-03T20:33:03.476574] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-03T20:33:03.935151] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-03T20:33:03.935441] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-03T20:33:03.937031] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-03T20:33:03.938864] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T20:33:03.950212] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-03T20:33:03.952197] [DEBUG] [LOCAL ] NOTE: Trimmed 63443 records to 42206 (keeping 200 days of data) [2025-10-03T20:33:04.002151] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-03T20:33:04.211972] [DEBUG] [LOCAL ] NOTE: Primary data saved (42206 records). [2025-10-03T20:33:04.212152] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-03T20:33:04.212258] [INFO ] [MAIN ] Update Progress: 1515/2370 symbols completed. NOTE took 35.6s. Estimated remaining: 2h 0m 12s. Rate: 7.1 symbols/min [2025-10-03T20:33:04.396837] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:04.416583] [DEBUG] [LOCAL ] NPCT: Loaded 17141 existing records from primary storage. [2025-10-03T20:33:04.416915] [INFO ] [MAIN ] NPCT: Loaded 17141 existing records. [2025-10-03T20:33:04.618096] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:04.618331] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-03T20:33:04.618381] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-03T20:33:04.618606] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-03T20:33:04.618695] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-03T20:33:04.797002] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-03T20:33:05.039402] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:05.223599] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:33:05.223992] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-03T20:33:05.224089] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:33:05.224292] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-03T20:33:05.224687] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:33:05.224864] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-03T20:33:05.224950] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-03T20:33:05.224991] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-03T20:33:05.225033] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-03T20:33:05.225137] [INFO ] [MAIN ] Update Progress: 1516/2370 symbols completed. NPB took 4.1s. Estimated remaining: 1h 59m 60s. Rate: 7.1 symbols/min [2025-10-03T20:33:05.419665] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:05.450520] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T20:33:05.469765] [DEBUG] [LOCAL ] NPFD: Loaded 9915 existing records from primary storage. [2025-10-03T20:33:05.470013] [INFO ] [MAIN ] NPFD: Loaded 9915 existing records. [2025-10-03T20:33:05.595572] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-03T20:33:05.668110] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:05.668823] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-03T20:33:05.668978] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-03T20:33:05.669409] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-03T20:33:05.669580] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-03T20:33:05.888385] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T20:33:06.129268] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:06.390691] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-03T20:33:07.190666] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-03T20:33:07.477925] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T20:33:07.597106] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T20:33:07.990701] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-03T20:33:08.268055] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T20:33:08.790741] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-03T20:33:09.590713] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-03T20:33:09.645539] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T20:33:10.275620] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-03T20:33:10.390756] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-03T20:33:11.190718] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-03T20:33:11.216781] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T20:33:11.629883] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T20:33:11.990699] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-03T20:33:12.790729] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-03T20:33:13.353179] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T20:33:13.501088] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-03T20:33:13.590732] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-03T20:33:13.666410] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T20:33:14.390740] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-03T20:33:14.616215] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T20:33:15.190733] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-03T20:33:15.294783] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T20:33:15.990719] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-03T20:33:16.084468] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T20:33:16.513524] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T20:33:16.515580] [INFO ] [REMOTE ] NOW: Full fetch complete (70364 records). [2025-10-03T20:33:16.515808] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-03T20:33:16.516801] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:33:16.517089] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:33:16.517152] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:33:16.517224] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-03T20:33:16.517352] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-03T20:33:16.517411] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-03T20:33:16.517459] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-03T20:33:16.517551] [INFO ] [MAIN ] Update Progress: 1517/2370 symbols completed. NOW took 31.2s. Estimated remaining: 1h 59m 53s. Rate: 7.1 symbols/min [2025-10-03T20:33:16.790740] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-03T20:33:17.590710] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-03T20:33:18.273585] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T20:33:18.281165] [INFO ] [REMOTE ] NOV: Full fetch complete (76992 records). [2025-10-03T20:33:18.281365] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-03T20:33:18.395838] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-03T20:33:18.462242] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T20:33:18.738117] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-03T20:33:18.738218] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-03T20:33:18.739394] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-03T20:33:18.739465] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-03T20:33:18.741144] [DEBUG] [LOCAL ] NOV: Trimmed 76992 records to 53958 (keeping 200 days of data) [2025-10-03T20:33:19.092231] [DEBUG] [LOCAL ] NOV: Primary data saved (53958 records). [2025-10-03T20:33:19.092431] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-03T20:33:19.092540] [INFO ] [MAIN ] Update Progress: 1518/2370 symbols completed. NOV took 43.5s. Estimated remaining: 1h 59m 41s. Rate: 7.1 symbols/min [2025-10-03T20:33:19.190686] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-03T20:33:19.258523] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:33:19.990685] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-03T20:33:20.215510] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T20:33:20.790677] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-03T20:33:20.865212] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:33:21.590705] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-03T20:33:21.884860] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T20:33:22.249373] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T20:33:22.390717] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-03T20:33:23.190737] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-03T20:33:23.388234] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T20:33:23.976839] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T20:33:23.990622] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-03T20:33:24.790713] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-03T20:33:24.842926] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:33:25.590747] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-03T20:33:25.916603] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T20:33:26.276519] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T20:33:26.277708] [INFO ] [REMOTE ] NPFD: Full fetch complete (14816 records). [2025-10-03T20:33:26.277792] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-03T20:33:26.395798] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-03T20:33:26.762096] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-03T20:33:26.762179] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-03T20:33:26.762506] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-03T20:33:26.762589] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-03T20:33:26.763178] [DEBUG] [LOCAL ] NPFD: Trimmed 14816 records to 9999 (keeping 200 days of data) [2025-10-03T20:33:26.832392] [DEBUG] [LOCAL ] NPFD: Primary data saved (9999 records). [2025-10-03T20:33:26.832537] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-03T20:33:26.832624] [INFO ] [MAIN ] Update Progress: 1519/2370 symbols completed. NPFD took 21.6s. Estimated remaining: 1h 59m 32s. Rate: 7.1 symbols/min [2025-10-03T20:33:27.423085] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T20:33:27.427013] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-03T20:33:28.479294] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T20:33:28.485381] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-03T20:33:29.252047] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T20:33:29.253377] [INFO ] [REMOTE ] NPCT: Full fetch complete (25313 records). [2025-10-03T20:33:29.253458] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-03T20:33:29.649150] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-03T20:33:29.649233] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-03T20:33:29.649804] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-03T20:33:29.649870] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-03T20:33:29.650631] [DEBUG] [LOCAL ] NPCT: Trimmed 25313 records to 17236 (keeping 200 days of data) [2025-10-03T20:33:29.758385] [DEBUG] [LOCAL ] NPCT: Primary data saved (17236 records). [2025-10-03T20:33:29.758543] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-03T20:33:29.758669] [INFO ] [MAIN ] Update Progress: 1520/2370 symbols completed. NPCT took 25.5s. Estimated remaining: 1h 59m 21s. Rate: 7.1 symbols/min [2025-10-03T20:33:30.403792] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:30.480396] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:30.479472] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:30.533206] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:30.533606] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-03T20:33:30.533725] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-03T20:33:30.534023] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-03T20:33:30.534072] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-03T20:33:30.534134] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-03T20:33:30.534188] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-03T20:33:30.562852] [DEBUG] [LOCAL ] NPK: Loaded 8119 existing records from primary storage. [2025-10-03T20:33:30.583691] [INFO ] [MAIN ] NPK: Loaded 8119 existing records. [2025-10-03T20:33:30.632950] [DEBUG] [LOCAL ] NPO: Loaded 13098 existing records from primary storage. [2025-10-03T20:33:30.682059] [DEBUG] [LOCAL ] NPV: Loaded 5083 existing records from primary storage. [2025-10-03T20:33:30.715715] [INFO ] [MAIN ] NPV: Loaded 5083 existing records. [2025-10-03T20:33:30.682196] [INFO ] [MAIN ] NPO: Loaded 13098 existing records. [2025-10-03T20:33:31.315914] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:31.419406] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-03T20:33:31.419824] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-03T20:33:31.455695] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:31.499782] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-03T20:33:31.499904] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-03T20:33:31.499707] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-03T20:33:31.509195] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:31.520373] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-03T20:33:31.520500] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-03T20:33:31.544118] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:31.549551] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-03T20:33:31.566239] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-03T20:33:31.566767] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-03T20:33:31.549410] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-03T20:33:31.588512] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-03T20:33:31.626473] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-03T20:33:32.702951] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:32.682228] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:32.703554] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-03T20:33:32.704831] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-03T20:33:32.706806] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:33:32.717501] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-03T20:33:32.799586] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:32.800086] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-03T20:33:33.437866] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T20:33:33.439728] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-03T20:33:33.779200] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T20:33:33.781639] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-03T20:33:33.812441] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T20:33:34.156083] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T20:33:34.157439] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T20:33:34.390693] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-03T20:33:34.526953] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:33:35.142311] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:33:35.190695] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-03T20:33:35.990679] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-03T20:33:36.010154] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T20:33:36.790678] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-03T20:33:36.961816] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:33:37.525743] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T20:33:37.590677] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-03T20:33:38.248793] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T20:33:38.390694] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-03T20:33:39.094888] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T20:33:39.190703] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-03T20:33:39.990661] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-03T20:33:40.055759] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:33:40.790699] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-03T20:33:40.995356] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T20:33:41.590720] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-03T20:33:42.160104] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T20:33:42.390688] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-03T20:33:42.896095] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T20:33:43.190674] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-03T20:33:43.455259] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T20:33:43.990684] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-03T20:33:44.772569] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:33:44.790618] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-03T20:33:45.154905] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T20:33:45.590693] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-03T20:33:46.390680] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-03T20:33:46.513401] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T20:33:46.799413] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T20:33:47.190679] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-03T20:33:47.782738] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T20:33:47.891439] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T20:33:47.990679] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-03T20:33:48.790863] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-03T20:33:49.590729] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-03T20:33:49.721682] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T20:33:49.741387] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T20:33:50.292324] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T20:33:50.390677] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-03T20:33:51.190694] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-03T20:33:51.374890] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T20:33:51.789397] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T20:33:51.790946] [INFO ] [REMOTE ] NPK: Full fetch complete (10888 records). [2025-10-03T20:33:51.791047] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-03T20:33:51.996299] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-03T20:33:52.228048] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-03T20:33:52.228146] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-03T20:33:52.228473] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-03T20:33:52.228535] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-03T20:33:52.229061] [DEBUG] [LOCAL ] NPK: Trimmed 10888 records to 8174 (keeping 200 days of data) [2025-10-03T20:33:52.282236] [DEBUG] [LOCAL ] NPK: Primary data saved (8174 records). [2025-10-03T20:33:52.282373] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-03T20:33:52.282483] [INFO ] [MAIN ] Update Progress: 1521/2370 symbols completed. NPK took 22.5s. Estimated remaining: 1h 59m 20s. Rate: 7.1 symbols/min [2025-10-03T20:33:52.461300] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:33:52.505927] [DEBUG] [LOCAL ] NPWR: Loaded 43122 existing records from primary storage. [2025-10-03T20:33:52.506248] [INFO ] [MAIN ] NPWR: Loaded 43122 existing records. [2025-10-03T20:33:52.697161] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:33:52.697407] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-03T20:33:52.697457] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-03T20:33:52.697718] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-03T20:33:52.697778] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-03T20:33:52.795712] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-03T20:33:53.101784] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T20:33:53.107521] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:33:53.590682] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-03T20:33:54.298375] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T20:33:54.384103] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T20:33:54.392758] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-03T20:33:55.071468] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T20:33:55.190720] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-03T20:33:55.990726] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-03T20:33:56.666797] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T20:33:56.790631] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-03T20:33:56.816925] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T20:33:57.503882] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T20:33:57.590705] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-03T20:33:58.390685] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-03T20:33:58.560259] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T20:33:59.190733] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-03T20:33:59.868181] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T20:33:59.990720] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-03T20:34:00.723223] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T20:34:00.724794] [INFO ] [REMOTE ] NPO: Full fetch complete (18176 records). [2025-10-03T20:34:00.724873] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-03T20:34:00.792746] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-03T20:34:01.148631] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T20:34:01.192474] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-03T20:34:01.192570] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-03T20:34:01.193458] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-03T20:34:01.193523] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-03T20:34:01.194294] [DEBUG] [LOCAL ] NPO: Trimmed 18176 records to 13251 (keeping 200 days of data) [2025-10-03T20:34:01.282180] [DEBUG] [LOCAL ] NPO: Primary data saved (13251 records). [2025-10-03T20:34:01.282340] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-03T20:34:01.282429] [INFO ] [MAIN ] Update Progress: 1522/2370 symbols completed. NPO took 31.5s. Estimated remaining: 1h 59m 12s. Rate: 7.1 symbols/min [2025-10-03T20:34:01.466251] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:01.479113] [DEBUG] [LOCAL ] NQP: Loaded 9362 existing records from primary storage. [2025-10-03T20:34:01.479367] [INFO ] [MAIN ] NQP: Loaded 9362 existing records. [2025-10-03T20:34:01.596580] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-03T20:34:01.682722] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:01.682961] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-03T20:34:01.683011] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-03T20:34:01.683238] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-03T20:34:01.683298] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-03T20:34:02.082329] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:02.283836] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:34:02.390716] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-03T20:34:03.190705] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-03T20:34:03.294478] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T20:34:03.579450] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:34:03.990678] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-03T20:34:04.790714] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-03T20:34:04.857250] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:34:05.498496] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T20:34:05.511113] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T20:34:05.590717] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-03T20:34:06.154594] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T20:34:06.390713] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-03T20:34:07.190736] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-03T20:34:07.499191] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T20:34:07.501721] [INFO ] [REMOTE ] NPKI: Full fetch complete (54778 records). [2025-10-03T20:34:07.501885] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-03T20:34:07.731847] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T20:34:07.732554] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:34:07.732636] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:34:07.732737] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-03T20:34:07.732813] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-03T20:34:07.732852] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-03T20:34:07.732895] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-03T20:34:07.732970] [INFO ] [MAIN ] Update Progress: 1523/2370 symbols completed. NPKI took 38.0s. Estimated remaining: 1h 59m 3s. Rate: 7.1 symbols/min [2025-10-03T20:34:07.931343] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:07.966183] [DEBUG] [LOCAL ] NRDY: Loaded 32941 existing records from primary storage. [2025-10-03T20:34:07.966557] [INFO ] [MAIN ] NRDY: Loaded 32941 existing records. [2025-10-03T20:34:07.998903] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-03T20:34:08.162107] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:08.162342] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-03T20:34:08.162391] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-03T20:34:08.162603] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-03T20:34:08.162702] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-03T20:34:08.554036] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:08.790673] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-03T20:34:08.934745] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T20:34:08.934435] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T20:34:09.341638] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T20:34:09.590707] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-03T20:34:10.390733] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-03T20:34:11.190687] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-03T20:34:11.226831] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T20:34:11.518898] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T20:34:11.686547] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T20:34:11.687529] [INFO ] [REMOTE ] NPV: Full fetch complete (6900 records). [2025-10-03T20:34:11.687865] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-03T20:34:11.995823] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-03T20:34:12.107808] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-03T20:34:12.107910] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-03T20:34:12.108172] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-03T20:34:12.108221] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-03T20:34:12.108704] [DEBUG] [LOCAL ] NPV: Trimmed 6900 records to 5112 (keeping 200 days of data) [2025-10-03T20:34:12.152083] [DEBUG] [LOCAL ] NPV: Primary data saved (5112 records). [2025-10-03T20:34:12.152274] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-03T20:34:12.152442] [INFO ] [MAIN ] Update Progress: 1524/2370 symbols completed. NPV took 42.4s. Estimated remaining: 1h 58m 52s. Rate: 7.1 symbols/min [2025-10-03T20:34:12.353767] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:12.365265] [DEBUG] [LOCAL ] NREF: Loaded 7915 existing records from primary storage. [2025-10-03T20:34:12.365494] [INFO ] [MAIN ] NREF: Loaded 7915 existing records. [2025-10-03T20:34:12.566696] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:12.566961] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-03T20:34:12.567011] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-03T20:34:12.567175] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-03T20:34:12.567245] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-03T20:34:12.801674] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-03T20:34:12.961555] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:13.590739] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-03T20:34:13.731565] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:34:13.737438] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:34:14.390721] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-03T20:34:15.195735] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-03T20:34:15.208034] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T20:34:15.406753] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T20:34:15.990671] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-03T20:34:16.096857] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T20:34:16.790695] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-03T20:34:17.590703] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-03T20:34:17.828206] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T20:34:17.976986] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T20:34:18.390706] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-03T20:34:18.498275] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:34:19.093405] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T20:34:19.190731] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-03T20:34:19.990740] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-03T20:34:20.790742] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-03T20:34:20.852215] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T20:34:20.892499] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T20:34:21.590705] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-03T20:34:22.390666] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-03T20:34:22.537394] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:34:22.584570] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T20:34:23.190735] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-03T20:34:23.817195] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T20:34:23.990739] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-03T20:34:24.107697] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:34:24.790724] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-03T20:34:25.595854] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-03T20:34:25.618973] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T20:34:25.876444] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T20:34:26.345459] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T20:34:26.390632] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-03T20:34:27.190683] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-03T20:34:27.763612] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T20:34:27.764728] [INFO ] [REMOTE ] NQP: Full fetch complete (13460 records). [2025-10-03T20:34:27.764854] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-03T20:34:27.991697] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-03T20:34:28.101123] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:34:28.192159] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-03T20:34:28.192260] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-03T20:34:28.192850] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-03T20:34:28.192919] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-03T20:34:28.193464] [DEBUG] [LOCAL ] NQP: Trimmed 13460 records to 9406 (keeping 200 days of data) [2025-10-03T20:34:28.253459] [DEBUG] [LOCAL ] NQP: Primary data saved (9406 records). [2025-10-03T20:34:28.253639] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-03T20:34:28.254235] [INFO ] [MAIN ] Update Progress: 1525/2370 symbols completed. NQP took 27.0s. Estimated remaining: 1h 58m 48s. Rate: 7.1 symbols/min [2025-10-03T20:34:28.454979] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:28.455270] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-03T20:34:28.455329] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-03T20:34:28.455451] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-03T20:34:28.455495] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-03T20:34:28.455567] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-03T20:34:28.455611] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-03T20:34:28.798361] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-03T20:34:28.845967] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:28.888160] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:34:29.590741] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-03T20:34:30.116538] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T20:34:30.118945] [INFO ] [REMOTE ] NPWR: Full fetch complete (59337 records). [2025-10-03T20:34:30.119066] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-03T20:34:30.399690] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-03T20:34:30.573974] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-03T20:34:30.574073] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-03T20:34:30.575239] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-03T20:34:30.575307] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-03T20:34:30.576747] [DEBUG] [LOCAL ] NPWR: Trimmed 59337 records to 43483 (keeping 200 days of data) [2025-10-03T20:34:30.755329] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T20:34:30.920859] [DEBUG] [LOCAL ] NPWR: Primary data saved (43483 records). [2025-10-03T20:34:30.921001] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-03T20:34:30.921086] [INFO ] [MAIN ] Update Progress: 1526/2370 symbols completed. NPWR took 38.6s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-03T20:34:31.111410] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T20:34:31.120916] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:31.168336] [DEBUG] [LOCAL ] NRGV: Loaded 43740 existing records from primary storage. [2025-10-03T20:34:31.168712] [INFO ] [MAIN ] NRGV: Loaded 43740 existing records. [2025-10-03T20:34:31.199243] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-03T20:34:31.406794] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:31.407041] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-03T20:34:31.407098] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-03T20:34:31.407576] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-03T20:34:31.407687] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-03T20:34:31.800488] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:31.990719] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-03T20:34:32.016491] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T20:34:32.790751] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-03T20:34:33.590731] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-03T20:34:33.893469] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T20:34:34.319691] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:34:34.390625] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-03T20:34:34.458753] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:34:35.190759] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-03T20:34:35.820762] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T20:34:35.990693] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-03T20:34:36.066402] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T20:34:36.790747] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-03T20:34:37.473248] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T20:34:37.590691] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-03T20:34:38.390689] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-03T20:34:38.654508] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T20:34:38.656470] [INFO ] [REMOTE ] NRDY: Full fetch complete (51433 records). [2025-10-03T20:34:38.656570] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-03T20:34:39.123000] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-03T20:34:39.123142] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-03T20:34:39.124059] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-03T20:34:39.124329] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-03T20:34:39.126486] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-03T20:34:39.138593] [DEBUG] [LOCAL ] NRDY: Trimmed 51433 records to 33172 (keeping 200 days of data) [2025-10-03T20:34:39.191841] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-03T20:34:39.332631] [DEBUG] [LOCAL ] NRDY: Primary data saved (33172 records). [2025-10-03T20:34:39.332812] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-03T20:34:39.332916] [INFO ] [MAIN ] Update Progress: 1527/2370 symbols completed. NRDY took 31.6s. Estimated remaining: 1h 58m 28s. Rate: 7.1 symbols/min [2025-10-03T20:34:39.518982] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:39.541199] [DEBUG] [LOCAL ] NRK: Loaded 20132 existing records from primary storage. [2025-10-03T20:34:39.541470] [INFO ] [MAIN ] NRK: Loaded 20132 existing records. [2025-10-03T20:34:39.752248] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:39.752518] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-03T20:34:39.752608] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-03T20:34:39.753190] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-03T20:34:39.753273] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-03T20:34:40.010003] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-03T20:34:40.162070] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:40.190059] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T20:34:40.790688] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-03T20:34:40.873863] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T20:34:41.158423] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T20:34:41.590741] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-03T20:34:42.392073] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-03T20:34:42.395734] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T20:34:42.550503] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T20:34:43.190686] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-03T20:34:43.852478] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:34:43.853466] [INFO ] [REMOTE ] NREF: Full fetch complete (10875 records). [2025-10-03T20:34:43.853545] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-03T20:34:43.995888] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-03T20:34:44.271380] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-03T20:34:44.271491] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-03T20:34:44.271936] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-03T20:34:44.272054] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-03T20:34:44.272844] [DEBUG] [LOCAL ] NREF: Trimmed 10875 records to 7980 (keeping 200 days of data) [2025-10-03T20:34:44.349028] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T20:34:44.373262] [DEBUG] [LOCAL ] NREF: Primary data saved (7980 records). [2025-10-03T20:34:44.373425] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-03T20:34:44.373532] [INFO ] [MAIN ] Update Progress: 1528/2370 symbols completed. NREF took 32.2s. Estimated remaining: 1h 58m 17s. Rate: 7.1 symbols/min [2025-10-03T20:34:44.555148] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:34:44.563979] [DEBUG] [LOCAL ] NRP: Loaded 4103 existing records from primary storage. [2025-10-03T20:34:44.564253] [INFO ] [MAIN ] NRP: Loaded 4103 existing records. [2025-10-03T20:34:44.758157] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:34:44.758483] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-03T20:34:44.758536] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-03T20:34:44.758784] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-03T20:34:44.758846] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-03T20:34:44.795843] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-03T20:34:45.162853] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:34:45.532066] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T20:34:45.590689] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-03T20:34:46.390712] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-03T20:34:46.540740] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T20:34:46.949745] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-03T20:34:47.195259] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T20:34:47.192502] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-03T20:34:47.990685] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-03T20:34:48.607938] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T20:34:48.790699] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-03T20:34:49.590700] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-03T20:34:49.731178] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T20:34:50.243307] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T20:34:50.390682] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-03T20:34:50.636608] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T20:34:51.190688] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-03T20:34:51.986801] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T20:34:51.990607] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-03T20:34:52.462400] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T20:34:52.706513] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T20:34:52.790750] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-03T20:34:53.484565] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T20:34:53.590733] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-03T20:34:54.390725] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-03T20:34:55.190631] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-03T20:34:55.378463] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T20:34:55.990627] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-03T20:34:56.220731] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T20:34:56.463207] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T20:34:56.790693] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-03T20:34:57.552502] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T20:34:57.590725] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-03T20:34:57.670857] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T20:34:58.390714] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-03T20:34:59.116054] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T20:34:59.190666] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-03T20:34:59.220015] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T20:34:59.912331] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T20:34:59.990682] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-03T20:35:00.790706] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-03T20:35:01.507055] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T20:35:01.590712] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-03T20:35:02.390714] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-03T20:35:02.740130] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:35:02.944848] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T20:35:02.960788] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T20:35:03.190629] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-03T20:35:03.990709] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-03T20:35:04.448742] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T20:35:04.521012] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-03T20:35:04.790701] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-03T20:35:05.590682] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-03T20:35:06.390665] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-03T20:35:06.801519] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T20:35:06.854322] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T20:35:07.190722] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-03T20:35:07.990635] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-03T20:35:08.061486] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T20:35:08.410398] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T20:35:08.528338] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T20:35:08.790694] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-03T20:35:09.590723] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-03T20:35:09.681870] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T20:35:09.683520] [INFO ] [REMOTE ] NRK: Full fetch complete (27796 records). [2025-10-03T20:35:09.683607] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-03T20:35:10.089355] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-03T20:35:10.089510] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-03T20:35:10.090142] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-03T20:35:10.090207] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-03T20:35:10.091052] [DEBUG] [LOCAL ] NRK: Trimmed 27796 records to 20250 (keeping 200 days of data) [2025-10-03T20:35:10.227210] [DEBUG] [LOCAL ] NRK: Primary data saved (20250 records). [2025-10-03T20:35:10.227358] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-03T20:35:10.227521] [INFO ] [MAIN ] Update Progress: 1529/2370 symbols completed. NRK took 30.9s. Estimated remaining: 1h 58m 19s. Rate: 7.1 symbols/min [2025-10-03T20:35:10.395755] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-03T20:35:10.426225] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:10.436395] [DEBUG] [LOCAL ] NRT: Loaded 5012 existing records from primary storage. [2025-10-03T20:35:10.437167] [INFO ] [MAIN ] NRT: Loaded 5012 existing records. [2025-10-03T20:35:10.630063] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:35:10.630297] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-03T20:35:10.630346] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-03T20:35:10.630566] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-03T20:35:10.630680] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-03T20:35:11.009124] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:11.078757] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T20:35:11.190671] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-03T20:35:11.436556] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T20:35:11.703022] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:35:11.706152] [INFO ] [REMOTE ] NRG: Full fetch complete (76210 records). [2025-10-03T20:35:11.706339] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-03T20:35:11.707566] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:35:11.707751] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:35:11.707837] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:35:11.707927] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-03T20:35:11.708034] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-03T20:35:11.708111] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-03T20:35:11.708196] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-03T20:35:11.708338] [INFO ] [MAIN ] Update Progress: 1530/2370 symbols completed. NRG took 43.5s. Estimated remaining: 1h 58m 6s. Rate: 7.1 symbols/min [2025-10-03T20:35:11.928005] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:11.934101] [DEBUG] [LOCAL ] NRUC: Loaded 3105 existing records from primary storage. [2025-10-03T20:35:11.934305] [INFO ] [MAIN ] NRUC: Loaded 3105 existing records. [2025-10-03T20:35:11.998117] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-03T20:35:12.120236] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:35:12.120419] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-03T20:35:12.120527] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-03T20:35:12.120775] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-03T20:35:12.120834] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-03T20:35:12.500135] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:12.790734] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-03T20:35:12.951510] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T20:35:13.590717] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-03T20:35:14.390674] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-03T20:35:14.511737] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T20:35:14.762978] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T20:35:14.913582] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T20:35:14.914569] [INFO ] [REMOTE ] NRP: Full fetch complete (6480 records). [2025-10-03T20:35:14.914667] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-03T20:35:15.195764] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-03T20:35:15.304610] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-03T20:35:15.304840] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-03T20:35:15.305020] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-03T20:35:15.305061] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-03T20:35:15.305464] [DEBUG] [LOCAL ] NRP: Trimmed 6480 records to 4144 (keeping 200 days of data) [2025-10-03T20:35:15.331188] [DEBUG] [LOCAL ] NRP: Primary data saved (4144 records). [2025-10-03T20:35:15.331290] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-03T20:35:15.331368] [INFO ] [MAIN ] Update Progress: 1531/2370 symbols completed. NRP took 31.0s. Estimated remaining: 1h 57m 55s. Rate: 7.1 symbols/min [2025-10-03T20:35:15.505873] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:15.559560] [DEBUG] [LOCAL ] NSA: Loaded 45004 existing records from primary storage. [2025-10-03T20:35:15.559924] [INFO ] [MAIN ] NSA: Loaded 45004 existing records. [2025-10-03T20:35:15.754195] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:35:15.754436] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-03T20:35:15.754485] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-03T20:35:15.754818] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-03T20:35:15.754877] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-03T20:35:15.996486] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-03T20:35:16.164421] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:16.164806] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T20:35:16.790703] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-03T20:35:17.433035] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T20:35:17.590684] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-03T20:35:17.632840] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T20:35:17.635424] [INFO ] [REMOTE ] NRGV: Full fetch complete (62138 records). [2025-10-03T20:35:17.635556] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-03T20:35:18.070671] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-03T20:35:18.070832] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-03T20:35:18.072007] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-03T20:35:18.072077] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-03T20:35:18.073631] [DEBUG] [LOCAL ] NRGV: Trimmed 62138 records to 44114 (keeping 200 days of data) [2025-10-03T20:35:18.135215] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T20:35:18.341564] [DEBUG] [LOCAL ] NRGV: Primary data saved (44114 records). [2025-10-03T20:35:18.341720] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-03T20:35:18.341833] [INFO ] [MAIN ] Update Progress: 1532/2370 symbols completed. NRGV took 47.4s. Estimated remaining: 1h 57m 44s. Rate: 7.1 symbols/min [2025-10-03T20:35:18.400490] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-03T20:35:18.535837] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:18.536020] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-03T20:35:18.536077] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-03T20:35:18.536188] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-03T20:35:18.536232] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-03T20:35:18.536277] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-03T20:35:18.536358] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-03T20:35:18.919375] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:19.167478] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T20:35:19.190676] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-03T20:35:19.879225] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T20:35:19.990729] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-03T20:35:20.790685] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-03T20:35:21.590696] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-03T20:35:22.180724] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-03T20:35:22.262613] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T20:35:22.397132] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-03T20:35:22.401473] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T20:35:23.190723] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-03T20:35:23.990629] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-03T20:35:24.137030] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:35:24.720156] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T20:35:24.743300] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T20:35:24.790676] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-03T20:35:25.590680] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-03T20:35:26.390631] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-03T20:35:26.458441] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T20:35:26.634461] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T20:35:26.838824] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T20:35:27.190694] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-03T20:35:27.852126] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T20:35:27.990693] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-03T20:35:28.450039] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T20:35:28.790706] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-03T20:35:29.413685] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T20:35:29.590691] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-03T20:35:30.390631] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-03T20:35:31.090434] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T20:35:31.190696] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-03T20:35:31.278725] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T20:35:31.829209] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T20:35:31.990695] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-03T20:35:32.790695] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-03T20:35:33.313404] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T20:35:33.590706] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-03T20:35:33.663672] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T20:35:34.225257] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T20:35:34.390779] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-03T20:35:35.190730] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-03T20:35:35.731408] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T20:35:35.990708] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-03T20:35:36.520068] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:35:36.520915] [INFO ] [REMOTE ] NRUC: Full fetch complete (5450 records). [2025-10-03T20:35:36.521009] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-03T20:35:36.799288] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-03T20:35:36.935428] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-03T20:35:36.935587] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-03T20:35:36.935929] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-03T20:35:36.935996] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-03T20:35:36.936514] [DEBUG] [LOCAL ] NRUC: Trimmed 5450 records to 3117 (keeping 200 days of data) [2025-10-03T20:35:36.957901] [DEBUG] [LOCAL ] NRUC: Primary data saved (3117 records). [2025-10-03T20:35:36.958169] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-03T20:35:36.958302] [INFO ] [MAIN ] Update Progress: 1533/2370 symbols completed. NRUC took 25.2s. Estimated remaining: 1h 57m 41s. Rate: 7.1 symbols/min [2025-10-03T20:35:37.156384] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:37.190194] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T20:35:37.237470] [DEBUG] [LOCAL ] NSP: Loaded 35259 existing records from primary storage. [2025-10-03T20:35:37.237830] [INFO ] [MAIN ] NSP: Loaded 35259 existing records. [2025-10-03T20:35:37.429703] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:35:37.430011] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-03T20:35:37.430064] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-03T20:35:37.430442] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-03T20:35:37.430511] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-03T20:35:37.598488] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-03T20:35:37.833595] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:38.390697] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-03T20:35:38.519836] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T20:35:39.190461] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T20:35:39.193043] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-03T20:35:39.687767] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T20:35:39.990692] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-03T20:35:40.790680] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-03T20:35:41.017476] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T20:35:41.590636] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-03T20:35:41.749433] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T20:35:42.305084] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T20:35:42.390636] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-03T20:35:42.601187] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T20:35:42.972001] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:35:42.973349] [INFO ] [REMOTE ] NRT: Full fetch complete (8032 records). [2025-10-03T20:35:42.973461] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-03T20:35:43.195728] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-03T20:35:43.360888] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-03T20:35:43.360973] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-03T20:35:43.361249] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-03T20:35:43.361316] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-03T20:35:43.361772] [DEBUG] [LOCAL ] NRT: Trimmed 8032 records to 5039 (keeping 200 days of data) [2025-10-03T20:35:43.394940] [DEBUG] [LOCAL ] NRT: Primary data saved (5039 records). [2025-10-03T20:35:43.395092] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-03T20:35:43.395215] [INFO ] [MAIN ] Update Progress: 1534/2370 symbols completed. NRT took 33.2s. Estimated remaining: 1h 57m 31s. Rate: 7.1 symbols/min [2025-10-03T20:35:43.573688] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:35:43.597246] [DEBUG] [LOCAL ] NTB: Loaded 20329 existing records from primary storage. [2025-10-03T20:35:43.597487] [INFO ] [MAIN ] NTB: Loaded 20329 existing records. [2025-10-03T20:35:43.780296] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:35:43.780612] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-03T20:35:43.780714] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-03T20:35:43.781048] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-03T20:35:43.781109] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-03T20:35:44.000492] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-03T20:35:44.174340] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:35:44.630791] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T20:35:44.790703] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-03T20:35:45.496436] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T20:35:45.590702] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-03T20:35:45.926273] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:35:46.390689] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-03T20:35:47.120416] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:35:47.190696] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-03T20:35:47.563258] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T20:35:47.990692] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-03T20:35:48.632056] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T20:35:48.790702] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-03T20:35:49.590696] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-03T20:35:49.925161] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T20:35:49.969727] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T20:35:50.390691] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-03T20:35:51.015468] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T20:35:51.190690] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-03T20:35:51.990733] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-03T20:35:52.098343] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T20:35:52.644778] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T20:35:52.790635] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-03T20:35:53.171375] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T20:35:53.590724] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-03T20:35:54.390709] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-03T20:35:54.750918] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T20:35:54.873626] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T20:35:55.190742] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-03T20:35:55.990722] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-03T20:35:56.300168] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:35:56.795206] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-03T20:35:56.810326] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T20:35:57.186558] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T20:35:57.590718] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-03T20:35:58.390671] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-03T20:35:58.431503] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T20:35:59.057276] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T20:35:59.190638] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-03T20:35:59.990695] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-03T20:36:00.193354] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T20:36:00.790716] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-03T20:36:01.064554] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T20:36:01.326678] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:36:01.329075] [INFO ] [REMOTE ] NSA: Full fetch complete (62073 records). [2025-10-03T20:36:01.329175] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-03T20:36:01.595866] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-03T20:36:01.744784] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-03T20:36:01.744870] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-03T20:36:01.745972] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-03T20:36:01.746037] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-03T20:36:01.747513] [DEBUG] [LOCAL ] NSA: Trimmed 62073 records to 45345 (keeping 200 days of data) [2025-10-03T20:36:01.996080] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T20:36:02.073683] [DEBUG] [LOCAL ] NSA: Primary data saved (45345 records). [2025-10-03T20:36:02.073844] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-03T20:36:02.073937] [INFO ] [MAIN ] Update Progress: 1535/2370 symbols completed. NSA took 46.7s. Estimated remaining: 1h 57m 29s. Rate: 7.1 symbols/min [2025-10-03T20:36:02.205748] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T20:36:02.256232] [INFO ] [REMOTE ] NSC: Full fetch complete (70560 records). [2025-10-03T20:36:02.276991] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:02.277359] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-03T20:36:02.277142] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-03T20:36:02.277489] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-03T20:36:02.277996] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-03T20:36:02.278055] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-03T20:36:02.278102] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-03T20:36:02.278137] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-03T20:36:02.312455] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:36:02.353753] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:36:02.377299] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:36:02.389285] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-03T20:36:02.433768] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-03T20:36:02.439191] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-03T20:36:02.451510] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-03T20:36:02.469494] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-03T20:36:02.481352] [INFO ] [MAIN ] Update Progress: 1536/2370 symbols completed. NSC took 44.1s. Estimated remaining: 1h 57m 16s. Rate: 7.1 symbols/min [2025-10-03T20:36:02.872829] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:02.908604] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:02.960051] [DEBUG] [LOCAL ] NTR: Loaded 52959 existing records from primary storage. [2025-10-03T20:36:02.960375] [INFO ] [MAIN ] NTR: Loaded 52959 existing records. [2025-10-03T20:36:03.158720] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:36:03.158986] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-03T20:36:03.159048] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-03T20:36:03.159368] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-03T20:36:03.159441] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-03T20:36:03.195885] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-03T20:36:03.584252] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:03.617341] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T20:36:03.791840] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T20:36:03.990685] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-03T20:36:04.684632] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T20:36:04.790699] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-03T20:36:05.590693] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-03T20:36:06.296628] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T20:36:06.315308] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T20:36:06.390704] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-03T20:36:07.190705] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-03T20:36:07.551058] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T20:36:07.990703] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-03T20:36:08.790675] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-03T20:36:08.846532] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:36:08.847955] [INFO ] [REMOTE ] NTB: Full fetch complete (30672 records). [2025-10-03T20:36:08.848038] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-03T20:36:09.080725] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T20:36:09.303179] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-03T20:36:09.303256] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-03T20:36:09.303894] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-03T20:36:09.303957] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-03T20:36:09.304731] [DEBUG] [LOCAL ] NTB: Trimmed 30672 records to 20445 (keeping 200 days of data) [2025-10-03T20:36:09.433986] [DEBUG] [LOCAL ] NTB: Primary data saved (20445 records). [2025-10-03T20:36:09.434115] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-03T20:36:09.434202] [INFO ] [MAIN ] Update Progress: 1537/2370 symbols completed. NTB took 26.0s. Estimated remaining: 1h 57m 7s. Rate: 7.1 symbols/min [2025-10-03T20:36:09.591061] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-03T20:36:09.618429] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:09.667051] [DEBUG] [LOCAL ] NTST: Loaded 43828 existing records from primary storage. [2025-10-03T20:36:09.667360] [INFO ] [MAIN ] NTST: Loaded 43828 existing records. [2025-10-03T20:36:09.862876] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:36:09.863296] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-03T20:36:09.863345] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-03T20:36:09.863687] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-03T20:36:09.863756] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-03T20:36:10.246194] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:10.250164] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T20:36:10.274746] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T20:36:10.390639] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-03T20:36:11.190719] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-03T20:36:11.990677] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-03T20:36:12.030739] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T20:36:12.790763] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-03T20:36:13.010902] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T20:36:13.285567] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T20:36:13.336594] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T20:36:13.340834] [INFO ] [REMOTE ] NSP: Full fetch complete (49770 records). [2025-10-03T20:36:13.341036] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-03T20:36:13.595892] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-03T20:36:13.775802] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-03T20:36:13.775895] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-03T20:36:13.776997] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-03T20:36:13.777096] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-03T20:36:13.778487] [DEBUG] [LOCAL ] NSP: Trimmed 49770 records to 35539 (keeping 200 days of data) [2025-10-03T20:36:14.014783] [DEBUG] [LOCAL ] NSP: Primary data saved (35539 records). [2025-10-03T20:36:14.014935] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-03T20:36:14.015621] [INFO ] [MAIN ] Update Progress: 1538/2370 symbols completed. NSP took 37.1s. Estimated remaining: 1h 56m 56s. Rate: 7.1 symbols/min [2025-10-03T20:36:14.206364] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:14.273966] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-10-03T20:36:14.274325] [INFO ] [MAIN ] NU: Loaded 54136 existing records. [2025-10-03T20:36:14.395828] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-03T20:36:14.475565] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:36:14.475807] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-03T20:36:14.475857] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-03T20:36:14.476258] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-03T20:36:14.476316] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-03T20:36:14.865960] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:15.190639] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-03T20:36:15.438828] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T20:36:15.908677] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T20:36:15.990633] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-03T20:36:16.054872] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T20:36:16.623285] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T20:36:16.790752] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-03T20:36:17.590716] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-03T20:36:18.283795] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T20:36:18.390720] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-03T20:36:18.700695] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T20:36:19.190683] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-03T20:36:19.990721] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-03T20:36:20.617940] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T20:36:20.790710] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-03T20:36:20.841092] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-03T20:36:21.584260] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T20:36:21.596098] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-03T20:36:22.284199] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T20:36:22.314941] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T20:36:22.390729] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-03T20:36:23.190683] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-03T20:36:23.990679] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-03T20:36:24.076210] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T20:36:24.119504] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T20:36:24.790668] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-03T20:36:25.322703] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:36:25.323559] [INFO ] [REMOTE ] NTEST: Full fetch complete (1990 records). [2025-10-03T20:36:25.323676] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-03T20:36:25.530264] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-03T20:36:25.530476] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:36:25.530558] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:36:25.530633] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-03T20:36:25.530738] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-03T20:36:25.530779] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-03T20:36:25.530820] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-03T20:36:25.530890] [INFO ] [MAIN ] Update Progress: 1539/2370 symbols completed. NTEST took 23.5s. Estimated remaining: 1h 56m 49s. Rate: 7.1 symbols/min [2025-10-03T20:36:25.601180] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-03T20:36:25.733401] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:25.733569] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-03T20:36:25.733607] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-03T20:36:25.733743] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-03T20:36:25.733786] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-03T20:36:25.733828] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-03T20:36:25.733861] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-03T20:36:26.113173] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:26.362135] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-03T20:36:26.390634] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-03T20:36:27.196532] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-03T20:36:27.212687] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T20:36:27.990714] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-03T20:36:28.638892] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-03T20:36:28.790738] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-03T20:36:29.089086] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T20:36:29.491757] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T20:36:29.590701] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-03T20:36:30.390693] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-03T20:36:31.028370] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-03T20:36:31.190697] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-03T20:36:31.427388] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T20:36:31.990669] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-03T20:36:32.110239] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T20:36:32.790739] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-03T20:36:33.590673] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-03T20:36:33.822183] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-03T20:36:33.961319] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T20:36:34.390686] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-03T20:36:34.950047] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T20:36:35.190691] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-03T20:36:35.329883] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T20:36:35.990676] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-03T20:36:36.206197] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:36:36.763990] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T20:36:36.790616] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-03T20:36:37.590628] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-03T20:36:37.735218] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T20:36:38.390681] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-03T20:36:38.863534] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-03T20:36:39.190690] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-03T20:36:39.990638] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-03T20:36:40.071280] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T20:36:40.133422] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-03T20:36:40.372240] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T20:36:40.375237] [INFO ] [REMOTE ] NTST: Full fetch complete (61229 records). [2025-10-03T20:36:40.375359] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-03T20:36:40.799206] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-03T20:36:40.802301] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-03T20:36:40.802379] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-03T20:36:40.804349] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-03T20:36:40.804607] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-03T20:36:40.806037] [DEBUG] [LOCAL ] NTST: Trimmed 61229 records to 44169 (keeping 200 days of data) [2025-10-03T20:36:41.080309] [DEBUG] [LOCAL ] NTST: Primary data saved (44169 records). [2025-10-03T20:36:41.080444] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-03T20:36:41.080528] [INFO ] [MAIN ] Update Progress: 1540/2370 symbols completed. NTST took 31.6s. Estimated remaining: 1h 56m 45s. Rate: 7.1 symbols/min [2025-10-03T20:36:41.266496] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:41.302542] [DEBUG] [LOCAL ] NUS: Loaded 36660 existing records from primary storage. [2025-10-03T20:36:41.302908] [INFO ] [MAIN ] NUS: Loaded 36660 existing records. [2025-10-03T20:36:41.513003] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:36:41.513263] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-03T20:36:41.513314] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-03T20:36:41.513578] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-03T20:36:41.513638] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-03T20:36:41.597888] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-03T20:36:41.924322] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:42.198986] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T20:36:42.384139] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T20:36:42.386943] [INFO ] [REMOTE ] NTR: Full fetch complete (76298 records). [2025-10-03T20:36:42.387071] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-03T20:36:42.399458] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-03T20:36:42.816535] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-03T20:36:42.816629] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-03T20:36:42.817848] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-03T20:36:42.817918] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-03T20:36:42.819499] [DEBUG] [LOCAL ] NTR: Trimmed 76298 records to 53344 (keeping 200 days of data) [2025-10-03T20:36:43.159578] [DEBUG] [LOCAL ] NTR: Primary data saved (53344 records). [2025-10-03T20:36:43.159752] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-03T20:36:43.159862] [INFO ] [MAIN ] Update Progress: 1541/2370 symbols completed. NTR took 40.7s. Estimated remaining: 1h 56m 33s. Rate: 7.1 symbols/min [2025-10-03T20:36:43.192559] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-03T20:36:43.343130] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:36:43.366876] [DEBUG] [LOCAL ] NUV: Loaded 23717 existing records from primary storage. [2025-10-03T20:36:43.367142] [INFO ] [MAIN ] NUV: Loaded 23717 existing records. [2025-10-03T20:36:43.563346] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:36:43.563668] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-03T20:36:43.563734] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-03T20:36:43.563958] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-03T20:36:43.564037] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-03T20:36:44.082445] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:36:44.083503] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-03T20:36:44.122110] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T20:36:44.172639] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-03T20:36:44.790712] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-03T20:36:45.531155] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-03T20:36:45.564137] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:36:45.590685] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-03T20:36:46.390635] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-03T20:36:46.452211] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T20:36:46.646749] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:36:47.190694] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-03T20:36:47.990639] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-03T20:36:48.345066] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:36:48.467848] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-03T20:36:48.790758] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-03T20:36:49.494175] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T20:36:49.590664] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-03T20:36:50.045215] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T20:36:50.390708] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-03T20:36:50.720369] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T20:36:51.190733] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-03T20:36:51.890454] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T20:36:51.990702] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-03T20:36:52.795791] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-03T20:36:52.809121] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T20:36:53.124991] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T20:36:53.590722] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-03T20:36:54.390754] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-03T20:36:55.188287] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T20:36:55.199881] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-03T20:36:55.623581] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T20:36:55.643263] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T20:36:55.990685] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-03T20:36:56.796718] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-03T20:36:56.800811] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T20:36:57.137197] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T20:36:57.590733] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-03T20:36:58.390746] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-03T20:36:58.679559] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T20:36:58.987554] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T20:36:59.190636] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-03T20:36:59.990713] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-03T20:37:00.368379] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T20:37:00.781474] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-03T20:37:00.792714] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-03T20:37:01.590761] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-03T20:37:02.066026] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T20:37:02.280897] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-03T20:37:02.390732] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-03T20:37:03.190769] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-03T20:37:03.899278] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-03T20:37:03.990624] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-03T20:37:04.450080] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T20:37:04.509006] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T20:37:04.790737] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-03T20:37:05.590736] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-03T20:37:06.019888] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-03T20:37:06.022811] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-10-03T20:37:06.023191] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-03T20:37:06.386972] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T20:37:06.397777] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-03T20:37:06.407351] [INFO ] [REMOTE ] NUV: Full fetch complete (34472 records). [2025-10-03T20:37:06.473311] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-03T20:37:06.597981] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T20:37:06.622220] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-03T20:37:06.636020] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-03T20:37:06.643685] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-03T20:37:06.644064] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-03T20:37:06.727134] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54526 (keeping 200 days of data) [2025-10-03T20:37:07.075219] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-03T20:37:07.075672] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-03T20:37:07.076975] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-03T20:37:07.077066] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-03T20:37:07.081783] [DEBUG] [LOCAL ] NUV: Trimmed 34472 records to 23989 (keeping 200 days of data) [2025-10-03T20:37:07.191241] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-03T20:37:07.390187] [DEBUG] [LOCAL ] NUV: Primary data saved (23989 records). [2025-10-03T20:37:07.391002] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-03T20:37:07.393871] [INFO ] [MAIN ] Update Progress: 1542/2370 symbols completed. NUV took 24.2s. Estimated remaining: 1h 56m 33s. Rate: 7.1 symbols/min [2025-10-03T20:37:07.599721] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:07.742546] [DEBUG] [LOCAL ] NUVB: Loaded 51636 existing records from primary storage. [2025-10-03T20:37:07.744245] [INFO ] [MAIN ] NUVB: Loaded 51636 existing records. [2025-10-03T20:37:07.818676] [DEBUG] [LOCAL ] NU: Primary data saved (54526 records). [2025-10-03T20:37:07.848440] [INFO ] [MAIN ] NU: Full history saved. [2025-10-03T20:37:07.863333] [INFO ] [MAIN ] Update Progress: 1543/2370 symbols completed. NU took 53.8s. Estimated remaining: 1h 56m 20s. Rate: 7.1 symbols/min [2025-10-03T20:37:08.094235] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:08.100181] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T20:37:08.133944] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-03T20:37:08.134090] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-03T20:37:08.161724] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-03T20:37:08.166386] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:08.166721] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-03T20:37:08.166941] [INFO ] [REMOTE ] NUE: Full fetch complete (74855 records). [2025-10-03T20:37:08.172585] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-03T20:37:08.172435] [DEBUG] [LOCAL ] NUW: No existing data file found in primary storage. [2025-10-03T20:37:08.315750] [WARN ] [MAIN ] NUW: No existing data found, performing full refresh instead. [2025-10-03T20:37:08.386685] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-03T20:37:08.439183] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-03T20:37:08.500993] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-03T20:37:08.526342] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-03T20:37:08.829920] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:37:08.866286] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:37:08.884560] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:37:08.900493] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-03T20:37:09.017205] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:09.030682] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-03T20:37:09.086888] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-03T20:37:09.087027] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-03T20:37:09.108818] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-03T20:37:09.143766] [INFO ] [MAIN ] Update Progress: 1544/2370 symbols completed. NUE took 43.6s. Estimated remaining: 1h 56m 8s. Rate: 7.1 symbols/min [2025-10-03T20:37:09.241198] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T20:37:09.361480] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-03T20:37:09.422389] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:09.501550] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:09.541950] [DEBUG] [LOCAL ] NVG: Loaded 27690 existing records from primary storage. [2025-10-03T20:37:09.542377] [INFO ] [MAIN ] NVG: Loaded 27690 existing records. [2025-10-03T20:37:09.607057] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-03T20:37:09.773671] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:09.773999] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-03T20:37:09.774052] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-03T20:37:09.774426] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-03T20:37:09.774486] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-03T20:37:10.142528] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:10.390746] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-03T20:37:10.534314] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T20:37:10.763827] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T20:37:10.766441] [INFO ] [REMOTE ] NUS: Full fetch complete (53923 records). [2025-10-03T20:37:10.766562] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-03T20:37:11.073332] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T20:37:11.197382] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-03T20:37:11.218763] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-03T20:37:11.218865] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-03T20:37:11.219914] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-03T20:37:11.219982] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-03T20:37:11.221446] [DEBUG] [LOCAL ] NUS: Trimmed 53923 records to 36927 (keeping 200 days of data) [2025-10-03T20:37:11.450461] [DEBUG] [LOCAL ] NUS: Primary data saved (36927 records). [2025-10-03T20:37:11.450702] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-03T20:37:11.450831] [INFO ] [MAIN ] Update Progress: 1545/2370 symbols completed. NUS took 30.4s. Estimated remaining: 1h 55m 56s. Rate: 7.1 symbols/min [2025-10-03T20:37:11.627774] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:11.659801] [DEBUG] [LOCAL ] NVGS: Loaded 30804 existing records from primary storage. [2025-10-03T20:37:11.660086] [INFO ] [MAIN ] NVGS: Loaded 30804 existing records. [2025-10-03T20:37:11.851554] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:11.851899] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-03T20:37:11.851952] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-03T20:37:11.852388] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-03T20:37:11.852448] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-03T20:37:11.974940] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T20:37:11.990934] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-03T20:37:12.268248] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:12.262460] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T20:37:12.790723] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-03T20:37:13.590708] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-03T20:37:13.678701] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:37:13.835702] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T20:37:14.390759] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-03T20:37:14.921998] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T20:37:15.190733] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-03T20:37:15.811961] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T20:37:15.990639] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-03T20:37:16.116887] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T20:37:16.790695] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-03T20:37:17.246849] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T20:37:17.590736] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-03T20:37:17.976716] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T20:37:18.390722] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-03T20:37:18.726331] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T20:37:19.190712] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-03T20:37:19.636203] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T20:37:19.990699] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-03T20:37:20.785130] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T20:37:20.794042] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-03T20:37:20.825100] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T20:37:21.590720] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-03T20:37:22.390633] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-03T20:37:22.450909] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:37:22.503733] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T20:37:23.190720] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-03T20:37:23.974929] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T20:37:23.990683] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-03T20:37:24.091378] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T20:37:24.790723] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-03T20:37:25.262313] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T20:37:25.590743] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-03T20:37:26.196869] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T20:37:26.343194] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T20:37:26.390635] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-03T20:37:27.125161] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T20:37:27.190691] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-03T20:37:27.990697] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-03T20:37:28.392309] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T20:37:28.790688] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-03T20:37:29.448385] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T20:37:29.492035] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T20:37:29.590710] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-03T20:37:30.018091] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T20:37:30.018987] [INFO ] [REMOTE ] NUW: Full fetch complete (11570 records). [2025-10-03T20:37:30.019061] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-03T20:37:30.393267] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-03T20:37:30.422156] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-03T20:37:30.422219] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-03T20:37:30.422704] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-03T20:37:30.422768] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-03T20:37:30.423429] [DEBUG] [LOCAL ] NUW: Trimmed 11570 records to 7367 (keeping 200 days of data) [2025-10-03T20:37:30.470882] [DEBUG] [LOCAL ] NUW: Primary data saved (7367 records). [2025-10-03T20:37:30.471044] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-03T20:37:30.471171] [INFO ] [MAIN ] Update Progress: 1546/2370 symbols completed. NUW took 22.6s. Estimated remaining: 1h 55m 53s. Rate: 7.1 symbols/min [2025-10-03T20:37:30.650797] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:30.710367] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-10-03T20:37:30.710792] [INFO ] [MAIN ] NVO: Loaded 54174 existing records. [2025-10-03T20:37:30.895753] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:30.895983] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-03T20:37:30.896033] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-03T20:37:30.896519] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-03T20:37:30.896579] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-03T20:37:31.195757] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-03T20:37:31.265383] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:31.990720] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-03T20:37:32.742340] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-03T20:37:32.790701] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-03T20:37:32.918323] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T20:37:33.590686] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-03T20:37:34.390713] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-03T20:37:34.543758] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-03T20:37:34.740852] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T20:37:34.930236] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T20:37:35.190693] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-03T20:37:35.914933] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T20:37:35.990638] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-03T20:37:36.790730] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-03T20:37:37.076808] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T20:37:37.144597] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T20:37:37.590741] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-03T20:37:38.390726] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-03T20:37:39.190697] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-03T20:37:39.385961] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-03T20:37:39.697769] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T20:37:39.985497] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T20:37:39.992319] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-03T20:37:40.690847] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T20:37:40.790705] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-03T20:37:41.590699] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-03T20:37:41.942048] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T20:37:42.001266] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T20:37:42.390679] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-03T20:37:42.955473] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T20:37:43.190739] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-03T20:37:43.990687] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-03T20:37:44.252045] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T20:37:44.253810] [INFO ] [REMOTE ] NVG: Full fetch complete (40664 records). [2025-10-03T20:37:44.253898] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-03T20:37:44.718891] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-03T20:37:44.719072] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-03T20:37:44.720059] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-03T20:37:44.720226] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-03T20:37:44.721523] [DEBUG] [LOCAL ] NVG: Trimmed 40664 records to 27892 (keeping 200 days of data) [2025-10-03T20:37:44.793393] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-03T20:37:44.851375] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:37:44.858202] [INFO ] [REMOTE ] NVGS: Full fetch complete (41442 records). [2025-10-03T20:37:44.860911] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-03T20:37:45.013056] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-03T20:37:45.108564] [DEBUG] [LOCAL ] NVG: Primary data saved (27892 records). [2025-10-03T20:37:45.128542] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-03T20:37:45.142086] [INFO ] [MAIN ] Update Progress: 1547/2370 symbols completed. NVG took 36.0s. Estimated remaining: 1h 55m 48s. Rate: 7.1 symbols/min [2025-10-03T20:37:45.526000] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:45.572829] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-03T20:37:45.572914] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-03T20:37:45.573945] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-03T20:37:45.574056] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-03T20:37:45.580873] [DEBUG] [LOCAL ] NVGS: Trimmed 41442 records to 30976 (keeping 200 days of data) [2025-10-03T20:37:45.643684] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-03T20:37:45.643466] [DEBUG] [LOCAL ] NVR: Loaded 18746 existing records from primary storage. [2025-10-03T20:37:45.644922] [INFO ] [MAIN ] NVR: Loaded 18746 existing records. [2025-10-03T20:37:45.877305] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:45.879496] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-03T20:37:45.880004] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-03T20:37:45.881269] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-03T20:37:45.881949] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-03T20:37:46.344842] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:46.382549] [DEBUG] [LOCAL ] NVGS: Primary data saved (30976 records). [2025-10-03T20:37:46.382741] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-03T20:37:46.382850] [INFO ] [MAIN ] Update Progress: 1548/2370 symbols completed. NVGS took 34.9s. Estimated remaining: 1h 55m 36s. Rate: 7.1 symbols/min [2025-10-03T20:37:46.417457] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-03T20:37:46.576754] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:46.616204] [DEBUG] [LOCAL ] NVRI: Loaded 39035 existing records from primary storage. [2025-10-03T20:37:46.616525] [INFO ] [MAIN ] NVRI: Loaded 39035 existing records. [2025-10-03T20:37:46.810219] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:46.810505] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-03T20:37:46.810733] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-03T20:37:46.811213] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-03T20:37:46.811312] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-03T20:37:47.090318] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-03T20:37:47.195747] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-03T20:37:47.267081] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:47.796338] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T20:37:47.990699] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-03T20:37:48.413406] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-03T20:37:48.790716] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-03T20:37:49.073596] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T20:37:49.076346] [INFO ] [REMOTE ] NUVB: Full fetch complete (72864 records). [2025-10-03T20:37:49.076465] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-03T20:37:49.504149] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T20:37:49.532844] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-03T20:37:49.532947] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-03T20:37:49.534208] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-03T20:37:49.534280] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-03T20:37:49.535912] [DEBUG] [LOCAL ] NUVB: Trimmed 72864 records to 52012 (keeping 200 days of data) [2025-10-03T20:37:49.615629] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-03T20:37:49.837494] [DEBUG] [LOCAL ] NUVB: Primary data saved (52012 records). [2025-10-03T20:37:49.837719] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-03T20:37:49.837853] [INFO ] [MAIN ] Update Progress: 1549/2370 symbols completed. NUVB took 42.4s. Estimated remaining: 1h 55m 25s. Rate: 7.1 symbols/min [2025-10-03T20:37:50.010919] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:37:50.064600] [DEBUG] [LOCAL ] NVS: Loaded 51944 existing records from primary storage. [2025-10-03T20:37:50.064980] [INFO ] [MAIN ] NVS: Loaded 51944 existing records. [2025-10-03T20:37:50.252734] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:37:50.252972] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-03T20:37:50.253023] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-03T20:37:50.253266] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-03T20:37:50.253328] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-03T20:37:50.395873] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-03T20:37:50.642276] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:37:51.176033] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T20:37:51.190610] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-03T20:37:51.588218] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-03T20:37:51.617193] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T20:37:51.990712] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-03T20:37:52.553829] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T20:37:52.790691] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-03T20:37:53.355556] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:37:53.590728] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-03T20:37:54.390711] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-03T20:37:54.923089] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T20:37:55.190695] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-03T20:37:55.495906] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-03T20:37:55.522876] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T20:37:55.990717] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-03T20:37:56.757377] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T20:37:56.790670] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-03T20:37:57.099902] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T20:37:57.590697] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-03T20:37:58.315980] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T20:37:58.390627] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-03T20:37:59.190692] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-03T20:37:59.955829] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T20:37:59.990670] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-03T20:38:00.270010] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-03T20:38:00.528903] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T20:38:00.790717] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-03T20:38:01.590745] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-03T20:38:02.047392] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T20:38:02.256958] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:38:02.390692] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-03T20:38:02.808389] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T20:38:03.190696] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-03T20:38:03.990711] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-03T20:38:04.295088] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:38:04.790707] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-03T20:38:05.582054] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T20:38:05.594105] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-03T20:38:05.669565] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:38:06.245682] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T20:38:06.373605] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T20:38:06.390601] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-03T20:38:07.190698] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-03T20:38:07.990703] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-03T20:38:08.412835] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T20:38:08.453745] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T20:38:08.790708] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-03T20:38:09.590636] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-03T20:38:09.673713] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T20:38:10.390716] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-03T20:38:10.822997] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T20:38:11.190740] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-03T20:38:11.990752] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-03T20:38:12.073465] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T20:38:12.502772] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-03T20:38:12.790709] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-03T20:38:13.169164] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T20:38:13.172158] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T20:38:13.172490] [INFO ] [REMOTE ] NVR: Full fetch complete (29371 records). [2025-10-03T20:38:13.183980] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-03T20:38:13.598235] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-03T20:38:13.613615] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-03T20:38:13.613713] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-03T20:38:13.614404] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-03T20:38:13.614602] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-03T20:38:13.615562] [DEBUG] [LOCAL ] NVR: Trimmed 29371 records to 18866 (keeping 200 days of data) [2025-10-03T20:38:13.740826] [DEBUG] [LOCAL ] NVR: Primary data saved (18866 records). [2025-10-03T20:38:13.740982] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-03T20:38:13.741084] [INFO ] [MAIN ] Update Progress: 1550/2370 symbols completed. NVR took 28.6s. Estimated remaining: 1h 55m 25s. Rate: 7.1 symbols/min [2025-10-03T20:38:13.968084] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:14.018932] [DEBUG] [LOCAL ] NVST: Loaded 51965 existing records from primary storage. [2025-10-03T20:38:14.019266] [INFO ] [MAIN ] NVST: Loaded 51965 existing records. [2025-10-03T20:38:14.211939] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:38:14.215078] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:14.217472] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-03T20:38:14.217743] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-03T20:38:14.217977] [INFO ] [REMOTE ] NVRI: Full fetch complete (55873 records). [2025-10-03T20:38:14.218074] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-03T20:38:14.218114] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-03T20:38:14.218414] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-03T20:38:14.417378] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-03T20:38:15.067816] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:15.148784] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-03T20:38:15.148963] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-03T20:38:15.149994] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-03T20:38:15.150067] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-03T20:38:15.151638] [DEBUG] [LOCAL ] NVRI: Trimmed 55873 records to 39400 (keeping 200 days of data) [2025-10-03T20:38:15.198922] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-03T20:38:15.392770] [DEBUG] [LOCAL ] NVRI: Primary data saved (39400 records). [2025-10-03T20:38:15.393477] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-03T20:38:15.393758] [INFO ] [MAIN ] Update Progress: 1551/2370 symbols completed. NVRI took 29.0s. Estimated remaining: 1h 55m 13s. Rate: 7.1 symbols/min [2025-10-03T20:38:15.644567] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T20:38:15.648366] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:15.700885] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T20:38:15.758778] [DEBUG] [LOCAL ] NVT: Loaded 51890 existing records from primary storage. [2025-10-03T20:38:15.759181] [INFO ] [MAIN ] NVT: Loaded 51890 existing records. [2025-10-03T20:38:15.949452] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:15.949741] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-03T20:38:15.949800] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-03T20:38:15.950133] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-03T20:38:15.950193] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-03T20:38:15.995740] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-03T20:38:16.328547] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:16.790712] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-03T20:38:17.090053] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T20:38:17.316320] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T20:38:17.325047] [INFO ] [REMOTE ] NVO: Full fetch complete (77565 records). [2025-10-03T20:38:17.325477] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-03T20:38:17.327239] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:38:17.327382] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:38:17.327466] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:38:17.327507] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-03T20:38:17.327581] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-03T20:38:17.327688] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-03T20:38:17.328245] [DEBUG] [LOCAL ] NVO: Deleted derivative data file. [2025-10-03T20:38:17.329158] [INFO ] [MAIN ] Update Progress: 1552/2370 symbols completed. NVO took 46.9s. Estimated remaining: 1h 55m 1s. Rate: 7.1 symbols/min [2025-10-03T20:38:17.512237] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:17.576840] [DEBUG] [LOCAL ] NWG: Loaded 51874 existing records from primary storage. [2025-10-03T20:38:17.577164] [INFO ] [MAIN ] NWG: Loaded 51874 existing records. [2025-10-03T20:38:17.599321] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-03T20:38:17.781810] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:17.782259] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-03T20:38:17.782468] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-03T20:38:17.782917] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-03T20:38:17.783068] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-03T20:38:17.966015] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T20:38:18.221638] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:18.390695] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-03T20:38:19.190701] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-03T20:38:19.455820] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T20:38:19.990688] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-03T20:38:20.038358] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:38:20.790698] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-03T20:38:20.947550] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T20:38:21.496356] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T20:38:21.590691] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-03T20:38:22.170378] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T20:38:22.390715] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-03T20:38:23.033907] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T20:38:23.190707] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-03T20:38:23.990734] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-03T20:38:24.306847] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T20:38:24.717475] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T20:38:24.790705] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-03T20:38:25.590909] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-03T20:38:25.796029] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T20:38:26.390672] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-03T20:38:26.450604] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T20:38:26.453486] [INFO ] [REMOTE ] NVS: Full fetch complete (74799 records). [2025-10-03T20:38:26.453639] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-03T20:38:26.884137] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-03T20:38:26.884249] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-03T20:38:26.885455] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-03T20:38:26.885521] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-03T20:38:26.886987] [DEBUG] [LOCAL ] NVS: Trimmed 74799 records to 52306 (keeping 200 days of data) [2025-10-03T20:38:27.205532] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-03T20:38:27.231803] [DEBUG] [LOCAL ] NVS: Primary data saved (52306 records). [2025-10-03T20:38:27.231968] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-03T20:38:27.232129] [INFO ] [MAIN ] Update Progress: 1553/2370 symbols completed. NVS took 37.4s. Estimated remaining: 1h 54m 53s. Rate: 7.1 symbols/min [2025-10-03T20:38:27.422783] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:27.450938] [DEBUG] [LOCAL ] NWN: Loaded 26885 existing records from primary storage. [2025-10-03T20:38:27.451307] [INFO ] [MAIN ] NWN: Loaded 26885 existing records. [2025-10-03T20:38:27.654736] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:27.655516] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-03T20:38:27.655587] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-03T20:38:27.656231] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-03T20:38:27.656293] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-03T20:38:27.806130] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T20:38:28.012501] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-03T20:38:28.103751] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:28.132969] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T20:38:28.790706] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-03T20:38:29.043814] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T20:38:29.590739] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-03T20:38:29.979813] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T20:38:30.390718] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-03T20:38:30.711284] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T20:38:31.190731] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-03T20:38:31.301579] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T20:38:31.990679] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-03T20:38:32.247588] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T20:38:32.285631] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T20:38:32.790713] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-03T20:38:33.590724] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-03T20:38:33.883875] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T20:38:33.992957] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T20:38:34.390707] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-03T20:38:35.190724] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-03T20:38:35.248859] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T20:38:35.990673] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-03T20:38:36.227300] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T20:38:36.340958] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:38:36.790699] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-03T20:38:37.590699] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-03T20:38:37.872729] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T20:38:38.390718] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-03T20:38:38.546030] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:38:38.863836] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T20:38:39.190682] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-03T20:38:39.990704] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-03T20:38:40.124220] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T20:38:40.790687] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-03T20:38:41.136819] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T20:38:41.365366] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T20:38:41.590698] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-03T20:38:42.390696] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-03T20:38:42.597128] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T20:38:43.190678] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-03T20:38:43.416118] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T20:38:43.990699] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-03T20:38:44.271875] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T20:38:44.327631] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T20:38:44.790684] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-03T20:38:45.448575] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T20:38:45.451221] [INFO ] [REMOTE ] NVT: Full fetch complete (74544 records). [2025-10-03T20:38:45.451338] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-03T20:38:45.595833] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-03T20:38:45.898307] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-03T20:38:45.898404] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-03T20:38:45.899610] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-03T20:38:45.899705] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-03T20:38:45.901274] [DEBUG] [LOCAL ] NVT: Trimmed 74544 records to 52261 (keeping 200 days of data) [2025-10-03T20:38:46.152525] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T20:38:46.271304] [DEBUG] [LOCAL ] NVT: Primary data saved (52261 records). [2025-10-03T20:38:46.271473] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-03T20:38:46.271604] [INFO ] [MAIN ] Update Progress: 1554/2370 symbols completed. NVT took 30.9s. Estimated remaining: 1h 54m 50s. Rate: 7.1 symbols/min [2025-10-03T20:38:46.395922] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-03T20:38:46.458662] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:46.495896] [DEBUG] [LOCAL ] NX: Loaded 33364 existing records from primary storage. [2025-10-03T20:38:46.496223] [INFO ] [MAIN ] NX: Loaded 33364 existing records. [2025-10-03T20:38:46.687755] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:46.688002] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-03T20:38:46.688053] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-03T20:38:46.688267] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-03T20:38:46.688325] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-03T20:38:47.088921] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:47.190668] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-03T20:38:47.410622] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T20:38:47.990970] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-03T20:38:47.990850] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T20:38:48.415310] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T20:38:48.790728] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-03T20:38:49.590686] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-03T20:38:49.771883] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:38:50.163882] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T20:38:50.390713] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-03T20:38:50.930041] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T20:38:51.190718] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-03T20:38:51.900263] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T20:38:51.902880] [INFO ] [REMOTE ] NWG: Full fetch complete (73441 records). [2025-10-03T20:38:51.902995] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-03T20:38:51.995905] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-03T20:38:52.334925] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-03T20:38:52.335015] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-03T20:38:52.336216] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-03T20:38:52.336284] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-03T20:38:52.338123] [DEBUG] [LOCAL ] NWG: Trimmed 73441 records to 52239 (keeping 200 days of data) [2025-10-03T20:38:52.692047] [DEBUG] [LOCAL ] NWG: Primary data saved (52239 records). [2025-10-03T20:38:52.692198] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-03T20:38:52.693628] [INFO ] [MAIN ] Update Progress: 1555/2370 symbols completed. NWG took 35.4s. Estimated remaining: 1h 54m 41s. Rate: 7.1 symbols/min [2025-10-03T20:38:52.793070] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-03T20:38:52.890758] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:38:52.912597] [DEBUG] [LOCAL ] NXC: Loaded 4216 existing records from primary storage. [2025-10-03T20:38:52.912884] [INFO ] [MAIN ] NXC: Loaded 4216 existing records. [2025-10-03T20:38:53.106336] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:38:53.106986] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-03T20:38:53.107180] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-03T20:38:53.107483] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-03T20:38:53.107601] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-03T20:38:53.368188] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T20:38:53.568028] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:38:53.569736] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T20:38:53.590631] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-03T20:38:53.757032] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T20:38:54.390727] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-03T20:38:55.076916] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:38:55.190702] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-03T20:38:55.390090] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T20:38:55.990731] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-03T20:38:56.543413] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-03T20:38:56.790714] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-03T20:38:56.963399] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:38:57.220284] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T20:38:57.590694] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-03T20:38:58.390738] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-03T20:38:59.190671] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-03T20:38:59.374548] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T20:38:59.376204] [INFO ] [REMOTE ] NWN: Full fetch complete (37321 records). [2025-10-03T20:38:59.376283] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-03T20:38:59.735220] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T20:38:59.835024] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-03T20:38:59.835104] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-03T20:38:59.835856] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-03T20:38:59.835918] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-03T20:38:59.836775] [DEBUG] [LOCAL ] NWN: Trimmed 37321 records to 27050 (keeping 200 days of data) [2025-10-03T20:38:59.997684] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-03T20:39:00.012808] [DEBUG] [LOCAL ] NWN: Primary data saved (27050 records). [2025-10-03T20:39:00.013037] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-03T20:39:00.013133] [INFO ] [MAIN ] Update Progress: 1556/2370 symbols completed. NWN took 32.8s. Estimated remaining: 1h 54m 32s. Rate: 7.1 symbols/min [2025-10-03T20:39:00.197256] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:00.197490] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-03T20:39:00.197544] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-03T20:39:00.197727] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-03T20:39:00.197775] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-03T20:39:00.197816] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-03T20:39:00.197848] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-03T20:39:00.584812] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:00.718387] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T20:39:00.742179] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T20:39:00.790635] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-03T20:39:01.590712] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-03T20:39:02.257733] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T20:39:02.261499] [INFO ] [REMOTE ] NVST: Full fetch complete (74112 records). [2025-10-03T20:39:02.261750] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-03T20:39:02.397998] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-03T20:39:02.384467] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T20:39:02.719276] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-03T20:39:02.719400] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-03T20:39:02.720661] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-03T20:39:02.720737] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-03T20:39:02.722467] [DEBUG] [LOCAL ] NVST: Trimmed 74112 records to 52348 (keeping 200 days of data) [2025-10-03T20:39:02.777660] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:39:02.787008] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-03T20:39:02.787484] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:39:02.814416] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-03T20:39:02.819553] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:39:02.819700] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-03T20:39:02.823418] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-03T20:39:02.827561] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-03T20:39:02.832199] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-03T20:39:02.834244] [INFO ] [MAIN ] Update Progress: 1557/2370 symbols completed. NXDR took 2.8s. Estimated remaining: 1h 54m 20s. Rate: 7.1 symbols/min [2025-10-03T20:39:03.055373] [DEBUG] [LOCAL ] NVST: Primary data saved (52348 records). [2025-10-03T20:39:03.055552] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-03T20:39:03.055688] [INFO ] [MAIN ] Update Progress: 1558/2370 symbols completed. NVST took 49.3s. Estimated remaining: 1h 54m 8s. Rate: 7.1 symbols/min [2025-10-03T20:39:03.190723] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-03T20:39:03.990714] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-03T20:39:04.632055] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T20:39:04.700280] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T20:39:04.790754] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-03T20:39:05.433298] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T20:39:05.590691] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-03T20:39:06.322216] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T20:39:06.390741] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-03T20:39:07.190696] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-03T20:39:07.723984] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T20:39:07.865224] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:39:07.990701] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-03T20:39:08.634920] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T20:39:08.790746] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-03T20:39:09.590757] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-03T20:39:10.185781] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T20:39:10.186707] [INFO ] [REMOTE ] NXC: Full fetch complete (5931 records). [2025-10-03T20:39:10.186794] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-03T20:39:10.319091] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:39:10.399362] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-03T20:39:10.596032] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-03T20:39:10.596121] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-03T20:39:10.596297] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-03T20:39:10.596339] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-03T20:39:10.596763] [DEBUG] [LOCAL ] NXC: Trimmed 5931 records to 4226 (keeping 200 days of data) [2025-10-03T20:39:10.624346] [DEBUG] [LOCAL ] NXC: Primary data saved (4226 records). [2025-10-03T20:39:10.624464] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-03T20:39:10.624603] [INFO ] [MAIN ] Update Progress: 1559/2370 symbols completed. NXC took 17.9s. Estimated remaining: 1h 53m 59s. Rate: 7.1 symbols/min [2025-10-03T20:39:11.960390] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T20:39:11.968069] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-03T20:39:13.652870] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T20:39:13.662362] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-03T20:39:15.014124] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T20:39:15.016266] [INFO ] [REMOTE ] NX: Full fetch complete (48451 records). [2025-10-03T20:39:15.016356] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-03T20:39:15.431319] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-03T20:39:15.431407] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-03T20:39:15.432288] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-03T20:39:15.432355] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-03T20:39:15.433556] [DEBUG] [LOCAL ] NX: Trimmed 48451 records to 33616 (keeping 200 days of data) [2025-10-03T20:39:15.660313] [DEBUG] [LOCAL ] NX: Primary data saved (33616 records). [2025-10-03T20:39:15.660571] [INFO ] [MAIN ] NX: Full history saved. [2025-10-03T20:39:15.660810] [INFO ] [MAIN ] Update Progress: 1560/2370 symbols completed. NX took 29.4s. Estimated remaining: 1h 53m 48s. Rate: 7.1 symbols/min [2025-10-03T20:39:16.313742] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:16.429613] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:16.459692] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:16.479416] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:16.489231] [DEBUG] [LOCAL ] NXG: Loaded 10491 existing records from primary storage. [2025-10-03T20:39:16.489534] [INFO ] [MAIN ] NXG: Loaded 10491 existing records. [2025-10-03T20:39:16.618296] [DEBUG] [LOCAL ] NXJ: Loaded 15045 existing records from primary storage. [2025-10-03T20:39:16.619696] [INFO ] [MAIN ] NXJ: Loaded 15045 existing records. [2025-10-03T20:39:16.630509] [DEBUG] [LOCAL ] NXDT: Loaded 16245 existing records from primary storage. [2025-10-03T20:39:16.688577] [INFO ] [MAIN ] NXDT: Loaded 16245 existing records. [2025-10-03T20:39:16.779789] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:16.883878] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-03T20:39:16.916937] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-03T20:39:16.978533] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-03T20:39:16.994004] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-03T20:39:17.006891] [DEBUG] [LOCAL ] NXE: Loaded 53380 existing records from primary storage. [2025-10-03T20:39:17.043258] [INFO ] [MAIN ] NXE: Loaded 53380 existing records. [2025-10-03T20:39:17.185081] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:17.273177] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-03T20:39:17.340033] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-03T20:39:17.370202] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:17.376195] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-03T20:39:17.370926] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-03T20:39:17.381500] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-03T20:39:17.386745] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-03T20:39:17.473950] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-03T20:39:17.479753] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-03T20:39:17.643898] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:17.731972] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-03T20:39:17.772311] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-03T20:39:17.808878] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-03T20:39:17.831380] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-03T20:39:18.544224] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:18.678520] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-03T20:39:18.746982] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:18.851820] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-03T20:39:18.851489] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:18.874723] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-03T20:39:18.963256] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:18.963591] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-03T20:39:19.778901] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T20:39:19.782096] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-03T20:39:19.933605] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T20:39:19.939215] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-03T20:39:20.334518] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T20:39:20.338829] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-03T20:39:20.373071] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T20:39:20.375589] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-03T20:39:21.077180] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:39:21.083041] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-03T20:39:21.186150] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T20:39:21.190931] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-03T20:39:21.203461] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-03T20:39:21.192049] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-03T20:39:21.291561] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:39:21.590755] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-03T20:39:22.152148] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T20:39:22.174581] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T20:39:22.390741] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-03T20:39:22.474732] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T20:39:22.849959] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:39:23.190720] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-03T20:39:23.559087] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T20:39:23.765888] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T20:39:23.990699] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-03T20:39:24.790697] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-03T20:39:25.002508] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T20:39:25.365873] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T20:39:25.590712] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-03T20:39:26.390703] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-03T20:39:26.652859] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T20:39:27.190691] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-03T20:39:27.997981] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-03T20:39:28.003802] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T20:39:28.033054] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T20:39:28.790721] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-03T20:39:29.144804] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T20:39:29.517230] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T20:39:29.590747] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-03T20:39:30.390700] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-03T20:39:30.593149] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T20:39:31.190631] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-03T20:39:31.563285] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T20:39:31.990674] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-03T20:39:32.077016] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T20:39:32.790690] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-03T20:39:33.590724] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-03T20:39:33.688172] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:39:33.981055] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T20:39:34.390630] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-03T20:39:34.543545] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T20:39:35.190714] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-03T20:39:35.248347] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T20:39:35.990635] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-03T20:39:36.372365] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T20:39:36.790688] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-03T20:39:37.590686] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-03T20:39:37.989355] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T20:39:38.012205] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T20:39:38.350765] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T20:39:38.351836] [INFO ] [REMOTE ] NXG: Full fetch complete (14480 records). [2025-10-03T20:39:38.351973] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-03T20:39:38.395793] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-03T20:39:38.750435] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-03T20:39:38.750519] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-03T20:39:38.750915] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-03T20:39:38.750979] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-03T20:39:38.751609] [DEBUG] [LOCAL ] NXG: Trimmed 14480 records to 10573 (keeping 200 days of data) [2025-10-03T20:39:38.820423] [DEBUG] [LOCAL ] NXG: Primary data saved (10573 records). [2025-10-03T20:39:38.820572] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-03T20:39:38.820696] [INFO ] [MAIN ] Update Progress: 1561/2370 symbols completed. NXG took 23.2s. Estimated remaining: 1h 53m 48s. Rate: 7.1 symbols/min [2025-10-03T20:39:38.997519] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:39.002564] [DEBUG] [LOCAL ] NXN: Loaded 2335 existing records from primary storage. [2025-10-03T20:39:39.002774] [INFO ] [MAIN ] NXN: Loaded 2335 existing records. [2025-10-03T20:39:39.191617] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-03T20:39:39.191520] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:39.192860] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-03T20:39:39.192960] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-03T20:39:39.193179] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-03T20:39:39.193256] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-03T20:39:39.516267] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T20:39:39.593711] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:39.990628] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-03T20:39:40.348007] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T20:39:40.737502] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T20:39:40.790691] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-03T20:39:41.330361] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T20:39:41.590678] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-03T20:39:42.310036] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:39:42.311558] [INFO ] [REMOTE ] NXJ: Full fetch complete (21017 records). [2025-10-03T20:39:42.311672] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-03T20:39:42.395813] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-03T20:39:42.712721] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-03T20:39:42.712838] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-03T20:39:42.713343] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-03T20:39:42.713416] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-03T20:39:42.716116] [DEBUG] [LOCAL ] NXJ: Trimmed 21017 records to 15143 (keeping 200 days of data) [2025-10-03T20:39:42.811131] [DEBUG] [LOCAL ] NXJ: Primary data saved (15143 records). [2025-10-03T20:39:42.811280] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-03T20:39:42.811381] [INFO ] [MAIN ] Update Progress: 1562/2370 symbols completed. NXJ took 27.1s. Estimated remaining: 1h 53m 37s. Rate: 7.1 symbols/min [2025-10-03T20:39:43.005004] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:43.019620] [DEBUG] [LOCAL ] NXP: Loaded 12563 existing records from primary storage. [2025-10-03T20:39:43.019902] [INFO ] [MAIN ] NXP: Loaded 12563 existing records. [2025-10-03T20:39:43.191736] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-03T20:39:43.213734] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:43.214050] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-03T20:39:43.214101] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-03T20:39:43.214335] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-03T20:39:43.214396] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-03T20:39:43.591614] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T20:39:43.644717] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:43.836469] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T20:39:43.990722] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-03T20:39:44.606337] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T20:39:44.790715] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-03T20:39:45.328230] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T20:39:45.590684] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-03T20:39:46.390630] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-03T20:39:46.460686] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T20:39:47.190702] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-03T20:39:47.259154] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T20:39:47.932486] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T20:39:47.933694] [INFO ] [REMOTE ] NXDT: Full fetch complete (25528 records). [2025-10-03T20:39:47.933767] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-03T20:39:47.997367] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-03T20:39:48.315059] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-03T20:39:48.315148] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-03T20:39:48.315725] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-03T20:39:48.315792] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-03T20:39:48.316428] [DEBUG] [LOCAL ] NXDT: Trimmed 25528 records to 16344 (keeping 200 days of data) [2025-10-03T20:39:48.413832] [DEBUG] [LOCAL ] NXDT: Primary data saved (16344 records). [2025-10-03T20:39:48.413976] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-03T20:39:48.414077] [INFO ] [MAIN ] Update Progress: 1563/2370 symbols completed. NXDT took 32.8s. Estimated remaining: 1h 53m 27s. Rate: 7.1 symbols/min [2025-10-03T20:39:48.587595] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:39:48.607383] [DEBUG] [LOCAL ] NXRT: Loaded 19068 existing records from primary storage. [2025-10-03T20:39:48.607683] [INFO ] [MAIN ] NXRT: Loaded 19068 existing records. [2025-10-03T20:39:48.792547] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-03T20:39:48.796506] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:39:48.797797] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-03T20:39:48.797856] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-03T20:39:48.798300] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-03T20:39:48.798398] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-03T20:39:48.931687] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T20:39:49.189095] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:39:49.331819] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T20:39:49.590669] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-03T20:39:50.390724] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-03T20:39:50.564017] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T20:39:51.190681] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-03T20:39:51.990630] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-03T20:39:52.142769] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T20:39:52.326380] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T20:39:52.790708] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-03T20:39:52.820968] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T20:39:53.590685] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-03T20:39:53.793913] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T20:39:54.390666] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-03T20:39:54.494357] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:39:55.190695] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-03T20:39:55.471314] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T20:39:55.990729] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-03T20:39:56.651313] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T20:39:56.790722] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-03T20:39:56.976637] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T20:39:57.590630] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-03T20:39:57.818559] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T20:39:58.390731] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-03T20:39:58.884400] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T20:39:59.190692] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-03T20:39:59.990633] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-03T20:40:00.110935] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-03T20:40:00.448078] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T20:40:00.790635] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-03T20:40:01.100774] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T20:40:01.590734] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-03T20:40:01.789590] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T20:40:02.091449] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T20:40:02.390711] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-03T20:40:03.190726] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-03T20:40:03.990622] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-03T20:40:04.358667] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:40:04.384083] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T20:40:04.790729] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-03T20:40:05.191899] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T20:40:05.590717] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-03T20:40:06.159621] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-03T20:40:06.390704] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-03T20:40:06.656796] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T20:40:07.190675] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-03T20:40:07.279169] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T20:40:07.990703] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-03T20:40:08.790731] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-03T20:40:08.966342] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T20:40:08.969574] [INFO ] [REMOTE ] NXE: Full fetch complete (76701 records). [2025-10-03T20:40:08.969773] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-03T20:40:09.303392] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T20:40:09.442781] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-03T20:40:09.442874] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-03T20:40:09.444078] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-03T20:40:09.444149] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-03T20:40:09.445811] [DEBUG] [LOCAL ] NXE: Trimmed 76701 records to 53770 (keeping 200 days of data) [2025-10-03T20:40:09.628415] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-03T20:40:09.754213] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T20:40:09.810676] [DEBUG] [LOCAL ] NXE: Primary data saved (53770 records). [2025-10-03T20:40:09.810882] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-03T20:40:09.811073] [INFO ] [MAIN ] Update Progress: 1564/2370 symbols completed. NXE took 54.1s. Estimated remaining: 1h 53m 25s. Rate: 7.1 symbols/min [2025-10-03T20:40:09.998054] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:09.998243] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-03T20:40:09.998284] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-03T20:40:09.998401] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-03T20:40:09.998535] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-03T20:40:09.998597] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-03T20:40:09.998685] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-03T20:40:10.385224] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:10.390758] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-03T20:40:10.418574] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T20:40:10.421097] [INFO ] [REMOTE ] NXP: Full fetch complete (16935 records). [2025-10-03T20:40:10.421229] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-03T20:40:10.817329] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-03T20:40:10.817421] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-03T20:40:10.817906] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-03T20:40:10.817978] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-03T20:40:10.818930] [DEBUG] [LOCAL ] NXP: Trimmed 16935 records to 12677 (keeping 200 days of data) [2025-10-03T20:40:10.900580] [DEBUG] [LOCAL ] NXP: Primary data saved (12677 records). [2025-10-03T20:40:10.900753] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-03T20:40:10.900847] [INFO ] [MAIN ] Update Progress: 1565/2370 symbols completed. NXP took 28.1s. Estimated remaining: 1h 53m 13s. Rate: 7.1 symbols/min [2025-10-03T20:40:11.085845] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:11.135628] [DEBUG] [LOCAL ] NYT: Loaded 50204 existing records from primary storage. [2025-10-03T20:40:11.136042] [INFO ] [MAIN ] NYT: Loaded 50204 existing records. [2025-10-03T20:40:11.190845] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-03T20:40:11.336571] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:40:11.336819] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-03T20:40:11.336873] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-03T20:40:11.337153] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-03T20:40:11.337212] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-03T20:40:11.745522] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:11.761999] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T20:40:11.776827] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T20:40:11.990735] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-03T20:40:12.790632] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-03T20:40:13.175062] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T20:40:13.590726] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-03T20:40:14.390713] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-03T20:40:14.409176] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T20:40:14.411204] [INFO ] [REMOTE ] NXRT: Full fetch complete (25569 records). [2025-10-03T20:40:14.411281] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-03T20:40:14.777170] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T20:40:14.880061] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-03T20:40:14.880188] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-03T20:40:14.880953] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-03T20:40:14.881088] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-03T20:40:14.887192] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T20:40:14.898021] [DEBUG] [LOCAL ] NXRT: Trimmed 25569 records to 19242 (keeping 200 days of data) [2025-10-03T20:40:15.020301] [DEBUG] [LOCAL ] NXRT: Primary data saved (19242 records). [2025-10-03T20:40:15.020487] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-03T20:40:15.020664] [INFO ] [MAIN ] Update Progress: 1566/2370 symbols completed. NXRT took 26.6s. Estimated remaining: 1h 53m 2s. Rate: 7.1 symbols/min [2025-10-03T20:40:15.206307] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-03T20:40:15.242982] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:15.280551] [DEBUG] [LOCAL ] NZF: Loaded 29328 existing records from primary storage. [2025-10-03T20:40:15.280923] [INFO ] [MAIN ] NZF: Loaded 29328 existing records. [2025-10-03T20:40:15.479760] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:40:15.480063] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-03T20:40:15.480117] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-03T20:40:15.480924] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-03T20:40:15.480988] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-03T20:40:15.907165] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:15.990741] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-03T20:40:16.644004] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T20:40:16.790727] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-03T20:40:17.134013] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T20:40:17.338974] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T20:40:17.590740] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-03T20:40:18.390760] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-03T20:40:18.905920] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-03T20:40:19.190803] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-03T20:40:19.384585] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T20:40:19.932699] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T20:40:19.933486] [INFO ] [REMOTE ] NXN: Full fetch complete (3633 records). [2025-10-03T20:40:19.933561] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-03T20:40:19.995936] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-03T20:40:20.327632] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-03T20:40:20.327768] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-03T20:40:20.327984] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-03T20:40:20.328036] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-03T20:40:20.328415] [DEBUG] [LOCAL ] NXN: Trimmed 3633 records to 2339 (keeping 200 days of data) [2025-10-03T20:40:20.343506] [DEBUG] [LOCAL ] NXN: Primary data saved (2339 records). [2025-10-03T20:40:20.343602] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-03T20:40:20.343722] [INFO ] [MAIN ] Update Progress: 1567/2370 symbols completed. NXN took 41.5s. Estimated remaining: 1h 52m 52s. Rate: 7.1 symbols/min [2025-10-03T20:40:20.521990] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:20.522253] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-03T20:40:20.522301] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-03T20:40:20.522427] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-03T20:40:20.522471] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-03T20:40:20.522514] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-03T20:40:20.522548] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-03T20:40:20.795774] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-03T20:40:20.905397] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:21.370094] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T20:40:21.538097] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T20:40:21.590693] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-03T20:40:22.390729] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-03T20:40:22.762128] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T20:40:22.812711] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T20:40:23.190729] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-03T20:40:23.990709] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-03T20:40:24.790743] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-03T20:40:25.305357] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-03T20:40:25.387430] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T20:40:25.554317] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-03T20:40:25.590718] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-03T20:40:26.390738] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-03T20:40:27.190762] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-03T20:40:27.641350] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T20:40:27.726048] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T20:40:27.990672] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-03T20:40:28.247483] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-03T20:40:28.790723] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-03T20:40:29.559265] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T20:40:29.590620] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-03T20:40:29.958448] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T20:40:30.390831] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-03T20:40:30.803259] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T20:40:31.190764] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-03T20:40:31.455291] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T20:40:31.694491] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T20:40:31.990748] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-03T20:40:32.790697] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-03T20:40:33.590738] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-03T20:40:33.959255] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T20:40:33.960117] [INFO ] [REMOTE ] NYC: Full fetch complete (1893 records). [2025-10-03T20:40:33.960189] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-03T20:40:34.155460] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T20:40:34.155902] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:40:34.156051] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:40:34.156265] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-03T20:40:34.156585] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-03T20:40:34.156947] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-03T20:40:34.157256] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-03T20:40:34.157721] [INFO ] [MAIN ] Update Progress: 1568/2370 symbols completed. NYC took 24.3s. Estimated remaining: 1h 52m 47s. Rate: 7.1 symbols/min [2025-10-03T20:40:34.267001] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T20:40:34.386118] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:34.399019] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-03T20:40:34.422516] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-03T20:40:34.481144] [DEBUG] [LOCAL ] OBDC: Loaded 52051 existing records from primary storage. [2025-10-03T20:40:34.481491] [INFO ] [MAIN ] OBDC: Loaded 52051 existing records. [2025-10-03T20:40:34.663148] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:40:34.663382] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-03T20:40:34.663431] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-03T20:40:34.665213] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-03T20:40:34.665275] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-03T20:40:35.069428] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:35.190735] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-03T20:40:35.990696] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-03T20:40:36.283784] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T20:40:36.620724] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T20:40:36.790693] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-03T20:40:37.590690] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-03T20:40:38.048952] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T20:40:38.194673] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-03T20:40:38.390682] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-03T20:40:39.190675] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-03T20:40:39.437282] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T20:40:39.990690] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-03T20:40:40.790704] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-03T20:40:40.973880] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:40:40.997945] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T20:40:41.280367] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T20:40:41.590717] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-03T20:40:42.390724] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-03T20:40:42.657418] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T20:40:42.659550] [INFO ] [REMOTE ] NZF: Full fetch complete (43306 records). [2025-10-03T20:40:42.659679] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-03T20:40:42.923927] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-03T20:40:43.132525] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-03T20:40:43.132633] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-03T20:40:43.134068] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-03T20:40:43.134136] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-03T20:40:43.135314] [DEBUG] [LOCAL ] NZF: Trimmed 43306 records to 29526 (keeping 200 days of data) [2025-10-03T20:40:43.197375] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-03T20:40:43.323182] [DEBUG] [LOCAL ] NZF: Primary data saved (29526 records). [2025-10-03T20:40:43.323387] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-03T20:40:43.323498] [INFO ] [MAIN ] Update Progress: 1569/2370 symbols completed. NZF took 28.3s. Estimated remaining: 1h 52m 39s. Rate: 7.1 symbols/min [2025-10-03T20:40:43.516464] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:43.536397] [DEBUG] [LOCAL ] OBK: Loaded 16248 existing records from primary storage. [2025-10-03T20:40:43.536747] [INFO ] [MAIN ] OBK: Loaded 16248 existing records. [2025-10-03T20:40:43.730316] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:40:43.730792] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-03T20:40:43.730875] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-03T20:40:43.731766] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-03T20:40:43.731830] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-03T20:40:43.991078] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-03T20:40:44.111026] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:44.146576] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:40:44.790738] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-03T20:40:45.590712] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-03T20:40:45.914222] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T20:40:45.972344] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-03T20:40:46.134063] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T20:40:46.390808] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-03T20:40:47.190743] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-03T20:40:47.489094] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T20:40:47.990774] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-03T20:40:48.229919] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T20:40:48.790773] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-03T20:40:48.877779] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-03T20:40:49.590730] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-03T20:40:49.808567] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:40:50.390778] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-03T20:40:50.629975] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T20:40:51.190717] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-03T20:40:51.997092] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-03T20:40:52.018935] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T20:40:52.331943] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-03T20:40:52.338243] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:40:52.790744] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-03T20:40:53.590715] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-03T20:40:53.781618] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T20:40:53.837936] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T20:40:54.390668] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-03T20:40:54.601735] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T20:40:55.190724] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-03T20:40:55.990739] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-03T20:40:56.418158] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T20:40:56.478959] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T20:40:56.485780] [INFO ] [REMOTE ] NYT: Full fetch complete (72067 records). [2025-10-03T20:40:56.485963] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-03T20:40:56.795995] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-03T20:40:56.923827] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-03T20:40:56.923928] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-03T20:40:56.925156] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-03T20:40:56.925235] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-03T20:40:56.926893] [DEBUG] [LOCAL ] NYT: Trimmed 72067 records to 50552 (keeping 200 days of data) [2025-10-03T20:40:57.276050] [DEBUG] [LOCAL ] NYT: Primary data saved (50552 records). [2025-10-03T20:40:57.276238] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-03T20:40:57.276383] [INFO ] [MAIN ] Update Progress: 1570/2370 symbols completed. NYT took 46.4s. Estimated remaining: 1h 52m 33s. Rate: 7.1 symbols/min [2025-10-03T20:40:57.469584] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:40:57.521915] [DEBUG] [LOCAL ] OC: Loaded 44907 existing records from primary storage. [2025-10-03T20:40:57.522337] [INFO ] [MAIN ] OC: Loaded 44907 existing records. [2025-10-03T20:40:57.599093] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-03T20:40:57.723830] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:40:57.724168] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-03T20:40:57.724223] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-03T20:40:57.726314] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-03T20:40:57.726421] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-03T20:40:58.077213] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T20:40:58.155459] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:40:58.390683] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-03T20:40:58.507198] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-03T20:40:59.190677] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-03T20:40:59.496152] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T20:40:59.544247] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T20:40:59.990713] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-03T20:41:00.790718] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-03T20:41:01.214470] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T20:41:01.590715] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-03T20:41:01.896509] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:41:01.949889] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T20:41:02.390704] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-03T20:41:03.190673] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-03T20:41:03.333344] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:41:03.463121] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T20:41:03.990720] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-03T20:41:04.790716] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-03T20:41:05.275773] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-03T20:41:05.279106] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-10-03T20:41:05.279277] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-03T20:41:05.498206] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:41:05.499200] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:41:05.499536] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:41:05.499699] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-03T20:41:05.499960] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-03T20:41:05.500130] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-03T20:41:05.500304] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-03T20:41:05.500410] [INFO ] [MAIN ] Update Progress: 1571/2370 symbols completed. O took 45.2s. Estimated remaining: 1h 52m 24s. Rate: 7.1 symbols/min [2025-10-03T20:41:05.595826] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-03T20:41:05.701146] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:05.729911] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T20:41:05.745524] [DEBUG] [LOCAL ] OCFT: Loaded 8212 existing records from primary storage. [2025-10-03T20:41:05.745794] [INFO ] [MAIN ] OCFT: Loaded 8212 existing records. [2025-10-03T20:41:05.929032] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T20:41:05.950712] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:05.954447] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-03T20:41:05.954526] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-03T20:41:05.955192] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-03T20:41:05.955254] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-03T20:41:06.341245] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:06.390739] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-03T20:41:07.190698] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-03T20:41:07.482756] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T20:41:07.626761] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T20:41:07.990728] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-03T20:41:08.706352] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T20:41:08.790775] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-03T20:41:09.496944] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T20:41:09.590731] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-03T20:41:10.390635] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-03T20:41:10.681477] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-03T20:41:11.113949] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:41:11.115117] [INFO ] [REMOTE ] OBK: Full fetch complete (23816 records). [2025-10-03T20:41:11.115189] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-03T20:41:11.195758] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-03T20:41:11.525582] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-03T20:41:11.525722] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-03T20:41:11.526394] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-03T20:41:11.526555] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-03T20:41:11.527487] [DEBUG] [LOCAL ] OBK: Trimmed 23816 records to 16319 (keeping 200 days of data) [2025-10-03T20:41:11.634164] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T20:41:11.689459] [DEBUG] [LOCAL ] OBK: Primary data saved (16319 records). [2025-10-03T20:41:11.689611] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-03T20:41:11.689745] [INFO ] [MAIN ] Update Progress: 1572/2370 symbols completed. OBK took 28.4s. Estimated remaining: 1h 52m 15s. Rate: 7.1 symbols/min [2025-10-03T20:41:11.890212] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T20:41:11.911942] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:11.925754] [DEBUG] [LOCAL ] ODC: Loaded 8465 existing records from primary storage. [2025-10-03T20:41:11.925979] [INFO ] [MAIN ] ODC: Loaded 8465 existing records. [2025-10-03T20:41:11.995766] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-03T20:41:12.122305] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:12.122571] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-03T20:41:12.122632] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-03T20:41:12.122894] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-03T20:41:12.122953] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-03T20:41:12.527931] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:12.790731] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-03T20:41:13.590692] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-03T20:41:13.866639] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T20:41:13.890164] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T20:41:14.388609] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T20:41:14.391047] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-03T20:41:15.153334] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T20:41:15.190637] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-03T20:41:15.902239] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T20:41:15.990701] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-03T20:41:16.790698] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-03T20:41:17.590723] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-03T20:41:17.753499] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:41:18.317972] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T20:41:18.321518] [INFO ] [REMOTE ] OBDC: Full fetch complete (75039 records). [2025-10-03T20:41:18.321729] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-03T20:41:18.400550] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-03T20:41:18.474047] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T20:41:18.786073] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-03T20:41:18.786199] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-03T20:41:18.787591] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-03T20:41:18.787706] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-03T20:41:18.791991] [DEBUG] [LOCAL ] OBDC: Trimmed 75039 records to 52438 (keeping 200 days of data) [2025-10-03T20:41:19.139605] [DEBUG] [LOCAL ] OBDC: Primary data saved (52438 records). [2025-10-03T20:41:19.139786] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-03T20:41:19.139904] [INFO ] [MAIN ] Update Progress: 1573/2370 symbols completed. OBDC took 45.0s. Estimated remaining: 1h 52m 6s. Rate: 7.1 symbols/min [2025-10-03T20:41:19.197520] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-03T20:41:19.327922] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:19.356607] [DEBUG] [LOCAL ] ODV: Loaded 27146 existing records from primary storage. [2025-10-03T20:41:19.356936] [INFO ] [MAIN ] ODV: Loaded 27146 existing records. [2025-10-03T20:41:19.562049] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:19.562296] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-03T20:41:19.562346] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-03T20:41:19.562697] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-03T20:41:19.562758] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-03T20:41:20.003815] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-03T20:41:20.011153] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:20.116348] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T20:41:20.216444] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T20:41:20.790744] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-03T20:41:20.964478] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T20:41:21.590707] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-03T20:41:21.837184] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T20:41:22.390717] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-03T20:41:23.190752] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-03T20:41:23.200594] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T20:41:23.257591] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T20:41:23.990681] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-03T20:41:24.036290] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T20:41:24.790739] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-03T20:41:25.590686] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-03T20:41:25.700709] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:41:25.740384] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T20:41:26.390708] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-03T20:41:26.462530] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:41:27.157983] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T20:41:27.190699] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-03T20:41:27.990692] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-03T20:41:28.039857] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T20:41:28.790737] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-03T20:41:29.196969] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T20:41:29.199664] [INFO ] [REMOTE ] OC: Full fetch complete (64193 records). [2025-10-03T20:41:29.199809] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-03T20:41:29.597122] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-03T20:41:29.653530] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-03T20:41:29.653632] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-03T20:41:29.654918] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-03T20:41:29.654998] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-03T20:41:29.656553] [DEBUG] [LOCAL ] OC: Trimmed 64193 records to 45253 (keeping 200 days of data) [2025-10-03T20:41:29.762549] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T20:41:29.970794] [DEBUG] [LOCAL ] OC: Primary data saved (45253 records). [2025-10-03T20:41:29.970959] [INFO ] [MAIN ] OC: Full history saved. [2025-10-03T20:41:29.971055] [INFO ] [MAIN ] Update Progress: 1574/2370 symbols completed. OC took 32.7s. Estimated remaining: 1h 51m 59s. Rate: 7.1 symbols/min [2025-10-03T20:41:30.167946] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:30.206527] [DEBUG] [LOCAL ] OEC: Loaded 37258 existing records from primary storage. [2025-10-03T20:41:30.206857] [INFO ] [MAIN ] OEC: Loaded 37258 existing records. [2025-10-03T20:41:30.401394] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-03T20:41:30.382846] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T20:41:30.430921] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:30.431130] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-03T20:41:30.431217] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-03T20:41:30.431591] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-03T20:41:30.431678] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-03T20:41:30.855367] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:31.190727] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-03T20:41:31.306849] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T20:41:31.990701] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-03T20:41:32.122928] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T20:41:32.708242] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T20:41:32.790690] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-03T20:41:33.458909] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T20:41:33.590609] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-03T20:41:34.390693] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-03T20:41:34.975172] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T20:41:35.133240] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T20:41:35.190684] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-03T20:41:35.584635] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T20:41:35.585392] [INFO ] [REMOTE ] OCFT: Full fetch complete (11678 records). [2025-10-03T20:41:35.585461] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-03T20:41:35.988012] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-03T20:41:35.988126] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-03T20:41:35.988426] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-03T20:41:35.988487] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-03T20:41:35.989065] [DEBUG] [LOCAL ] OCFT: Trimmed 11678 records to 8222 (keeping 200 days of data) [2025-10-03T20:41:36.006518] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-03T20:41:36.039776] [DEBUG] [LOCAL ] OCFT: Primary data saved (8222 records). [2025-10-03T20:41:36.039933] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-03T20:41:36.040084] [INFO ] [MAIN ] Update Progress: 1575/2370 symbols completed. OCFT took 30.5s. Estimated remaining: 1h 51m 49s. Rate: 7.1 symbols/min [2025-10-03T20:41:36.219300] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:36.244692] [DEBUG] [LOCAL ] OFG: Loaded 21648 existing records from primary storage. [2025-10-03T20:41:36.244957] [INFO ] [MAIN ] OFG: Loaded 21648 existing records. [2025-10-03T20:41:36.440291] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:36.440820] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-03T20:41:36.440884] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-03T20:41:36.441155] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-03T20:41:36.441226] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-03T20:41:36.790774] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-03T20:41:36.830851] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:37.003104] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T20:41:37.590692] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-03T20:41:38.185557] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T20:41:38.390705] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-03T20:41:38.833161] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T20:41:39.190734] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-03T20:41:39.298412] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T20:41:39.771698] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:41:39.772671] [INFO ] [REMOTE ] ODC: Full fetch complete (10890 records). [2025-10-03T20:41:39.772751] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-03T20:41:39.995806] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-03T20:41:40.167799] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-03T20:41:40.167888] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-03T20:41:40.168152] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-03T20:41:40.168192] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-03T20:41:40.168744] [DEBUG] [LOCAL ] ODC: Trimmed 10890 records to 8504 (keeping 200 days of data) [2025-10-03T20:41:40.224962] [DEBUG] [LOCAL ] ODC: Primary data saved (8504 records). [2025-10-03T20:41:40.225104] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-03T20:41:40.225220] [INFO ] [MAIN ] Update Progress: 1576/2370 symbols completed. ODC took 28.5s. Estimated remaining: 1h 51m 38s. Rate: 7.1 symbols/min [2025-10-03T20:41:40.418286] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:41:40.463342] [DEBUG] [LOCAL ] OGE: Loaded 46690 existing records from primary storage. [2025-10-03T20:41:40.463802] [INFO ] [MAIN ] OGE: Loaded 46690 existing records. [2025-10-03T20:41:40.657033] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:41:40.657270] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-03T20:41:40.657319] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-03T20:41:40.657769] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-03T20:41:40.657830] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-03T20:41:40.795776] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-03T20:41:41.052401] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:41:41.590633] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-03T20:41:42.390718] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-03T20:41:43.263271] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (3.27 seconds). [2025-10-03T20:41:43.273134] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-03T20:41:43.480434] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T20:41:43.990715] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-03T20:41:44.681951] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T20:41:44.790733] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-03T20:41:45.877335] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (5.08 seconds). [2025-10-03T20:41:45.884917] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-03T20:41:46.218825] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T20:41:46.390703] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-03T20:41:47.196304] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T20:41:47.202784] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-03T20:41:47.749235] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T20:41:47.990726] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-03T20:41:48.581922] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T20:41:48.790630] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-03T20:41:49.558748] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (7.97 seconds). [2025-10-03T20:41:49.590668] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-03T20:41:50.194540] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T20:41:50.390716] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-03T20:41:51.058338] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T20:41:51.190745] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-03T20:41:51.513154] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T20:41:51.990736] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-03T20:41:52.088106] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (8.10 seconds). [2025-10-03T20:41:52.673433] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T20:41:52.790745] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-03T20:41:53.590719] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-03T20:41:53.671602] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (5.68 seconds). [2025-10-03T20:41:54.390635] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-03T20:41:54.590623] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T20:41:54.879151] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T20:41:55.190737] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-03T20:41:55.481022] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (3.49 seconds). [2025-10-03T20:41:55.842413] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T20:41:55.990725] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-03T20:41:56.790669] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-03T20:41:57.179157] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:41:57.590636] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-03T20:41:58.390721] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-03T20:41:59.498161] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T20:41:59.503443] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-03T20:41:59.950225] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (4.76 seconds). [2025-10-03T20:41:59.990628] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-03T20:42:01.734847] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T20:42:01.745876] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-03T20:42:02.380313] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (5.59 seconds). [2025-10-03T20:42:02.390495] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-03T20:42:03.927700] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T20:42:03.936039] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-03T20:42:04.906554] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (7.32 seconds). [2025-10-03T20:42:04.915130] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-03T20:42:04.979860] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T20:42:04.982581] [INFO ] [REMOTE ] OEC: Full fetch complete (52789 records). [2025-10-03T20:42:04.982755] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-03T20:42:05.397382] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-03T20:42:05.397508] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-03T20:42:05.398583] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-03T20:42:05.398671] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-03T20:42:05.401939] [DEBUG] [LOCAL ] OEC: Trimmed 52789 records to 37501 (keeping 200 days of data) [2025-10-03T20:42:05.629112] [DEBUG] [LOCAL ] OEC: Primary data saved (37501 records). [2025-10-03T20:42:05.629268] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-03T20:42:05.629378] [INFO ] [MAIN ] Update Progress: 1577/2370 symbols completed. OEC took 35.7s. Estimated remaining: 1h 51m 39s. Rate: 7.1 symbols/min [2025-10-03T20:42:05.821438] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:05.876754] [DEBUG] [LOCAL ] OGN: Loaded 53480 existing records from primary storage. [2025-10-03T20:42:05.877106] [INFO ] [MAIN ] OGN: Loaded 53480 existing records. [2025-10-03T20:42:06.085192] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:06.085458] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-03T20:42:06.085533] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-03T20:42:06.086071] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-03T20:42:06.086133] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-03T20:42:06.510573] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:06.511085] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-03T20:42:06.630896] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T20:42:06.641090] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-03T20:42:07.655675] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (8.15 seconds). [2025-10-03T20:42:07.661022] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-03T20:42:08.702122] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-03T20:42:08.713414] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-03T20:42:09.738141] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (7.99 seconds). [2025-10-03T20:42:09.749775] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-03T20:42:10.049910] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (3.41 seconds). [2025-10-03T20:42:10.052391] [INFO ] [REMOTE ] ODV: Full fetch complete (33345 records). [2025-10-03T20:42:10.052513] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-03T20:42:10.184717] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-03T20:42:10.219217] [INFO ] [REMOTE ] OFG: Full fetch complete (34227 records). [2025-10-03T20:42:10.240012] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-03T20:42:10.746597] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-03T20:42:10.782936] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-03T20:42:10.792040] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-03T20:42:10.805800] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-03T20:42:10.869897] [DEBUG] [LOCAL ] ODV: Trimmed 33345 records to 27495 (keeping 200 days of data) [2025-10-03T20:42:11.032554] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-03T20:42:11.043789] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-03T20:42:11.083258] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-03T20:42:11.085363] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-03T20:42:11.087426] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-03T20:42:11.088690] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-03T20:42:11.093375] [DEBUG] [LOCAL ] OFG: Trimmed 34227 records to 21781 (keeping 200 days of data) [2025-10-03T20:42:11.267162] [DEBUG] [LOCAL ] OFG: Primary data saved (21781 records). [2025-10-03T20:42:11.268316] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-03T20:42:11.268841] [INFO ] [MAIN ] Update Progress: 1578/2370 symbols completed. OFG took 35.2s. Estimated remaining: 1h 51m 29s. Rate: 7.1 symbols/min [2025-10-03T20:42:11.516522] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:11.551197] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T20:42:11.566228] [DEBUG] [LOCAL ] ODV: Primary data saved (27495 records). [2025-10-03T20:42:11.566767] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-03T20:42:11.566964] [INFO ] [MAIN ] Update Progress: 1579/2370 symbols completed. ODV took 52.4s. Estimated remaining: 1h 51m 16s. Rate: 7.1 symbols/min [2025-10-03T20:42:11.567375] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-03T20:42:11.756882] [DEBUG] [LOCAL ] OGS: Loaded 34415 existing records from primary storage. [2025-10-03T20:42:11.776290] [INFO ] [MAIN ] OGS: Loaded 34415 existing records. [2025-10-03T20:42:11.783671] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:11.983251] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:11.983566] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-03T20:42:11.983618] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-03T20:42:11.983937] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-03T20:42:11.984000] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-03T20:42:12.183526] [DEBUG] [LOCAL ] OHI: Loaded 52342 existing records from primary storage. [2025-10-03T20:42:12.221416] [INFO ] [MAIN ] OHI: Loaded 52342 existing records. [2025-10-03T20:42:12.676428] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:12.683402] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:12.684200] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-03T20:42:12.684449] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-03T20:42:12.685541] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-03T20:42:12.686550] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-03T20:42:12.686616] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-03T20:42:13.039896] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-03T20:42:13.083695] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-03T20:42:13.145639] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:13.146426] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-03T20:42:13.176387] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T20:42:13.187394] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-03T20:42:14.050372] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T20:42:14.057145] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-03T20:42:14.885747] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T20:42:14.897142] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-03T20:42:15.037395] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T20:42:15.050804] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-03T20:42:15.071695] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T20:42:15.190747] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-03T20:42:16.518372] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (3.37 seconds). [2025-10-03T20:42:16.529852] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-03T20:42:16.718471] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T20:42:16.724446] [INFO ] [REMOTE ] OGE: Full fetch complete (66789 records). [2025-10-03T20:42:16.724614] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-03T20:42:16.888374] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:42:16.938066] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-03T20:42:17.212819] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-03T20:42:17.213280] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-03T20:42:17.215316] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-03T20:42:17.215430] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-03T20:42:17.219905] [DEBUG] [LOCAL ] OGE: Trimmed 66789 records to 47004 (keeping 200 days of data) [2025-10-03T20:42:17.396875] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-03T20:42:17.604027] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-03T20:42:17.726792] [DEBUG] [LOCAL ] OGE: Primary data saved (47004 records). [2025-10-03T20:42:17.726996] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-03T20:42:17.727163] [INFO ] [MAIN ] Update Progress: 1580/2370 symbols completed. OGE took 37.5s. Estimated remaining: 1h 51m 7s. Rate: 7.1 symbols/min [2025-10-03T20:42:18.027714] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:18.084742] [DEBUG] [LOCAL ] OI: Loaded 47454 existing records from primary storage. [2025-10-03T20:42:18.085137] [INFO ] [MAIN ] OI: Loaded 47454 existing records. [2025-10-03T20:42:18.386112] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:18.389996] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T20:42:18.387943] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-03T20:42:18.424957] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-03T20:42:18.431562] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-03T20:42:18.431114] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:42:18.429595] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-03T20:42:18.444701] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-03T20:42:18.903244] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:19.190685] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-03T20:42:19.680886] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-03T20:42:19.990741] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-03T20:42:20.280975] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T20:42:20.748016] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T20:42:20.790739] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-03T20:42:21.590736] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-03T20:42:21.876538] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T20:42:22.390714] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-03T20:42:23.199219] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-03T20:42:23.201140] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T20:42:23.625796] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T20:42:23.990708] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-03T20:42:24.108188] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (3.32 seconds). [2025-10-03T20:42:24.790860] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-03T20:42:25.078193] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T20:42:25.141775] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:42:25.590713] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-03T20:42:26.390661] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-03T20:42:26.574710] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T20:42:27.015033] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T20:42:27.190687] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-03T20:42:27.990691] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-03T20:42:28.092112] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T20:42:28.563878] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T20:42:28.790684] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-03T20:42:29.573111] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T20:42:29.590636] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-03T20:42:30.390675] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-03T20:42:30.569757] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:42:31.190673] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-03T20:42:31.239084] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T20:42:31.990694] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-03T20:42:32.230927] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T20:42:32.622536] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T20:42:32.790707] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-03T20:42:33.590681] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-03T20:42:33.763764] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:42:34.347748] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T20:42:34.351060] [INFO ] [REMOTE ] OGN: Full fetch complete (76801 records). [2025-10-03T20:42:34.351233] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-03T20:42:34.398913] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-03T20:42:34.786620] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-03T20:42:34.786743] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-03T20:42:34.788039] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-03T20:42:34.788120] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-03T20:42:34.790703] [DEBUG] [LOCAL ] OGN: Trimmed 76801 records to 53867 (keeping 200 days of data) [2025-10-03T20:42:35.147475] [DEBUG] [LOCAL ] OGN: Primary data saved (53867 records). [2025-10-03T20:42:35.147678] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-03T20:42:35.147837] [INFO ] [MAIN ] Update Progress: 1581/2370 symbols completed. OGN took 29.5s. Estimated remaining: 1h 51m 3s. Rate: 7.1 symbols/min [2025-10-03T20:42:35.195829] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-03T20:42:35.312833] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T20:42:35.394248] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:35.410048] [DEBUG] [LOCAL ] OIA: Loaded 13841 existing records from primary storage. [2025-10-03T20:42:35.410353] [INFO ] [MAIN ] OIA: Loaded 13841 existing records. [2025-10-03T20:42:35.612535] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:35.617233] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-03T20:42:35.618040] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-03T20:42:35.618289] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T20:42:35.619938] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-03T20:42:35.620524] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-03T20:42:35.626136] [INFO ] [REMOTE ] OGS: Full fetch complete (48064 records). [2025-10-03T20:42:35.670008] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-03T20:42:36.000886] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-03T20:42:36.509332] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:36.544295] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-03T20:42:36.544379] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-03T20:42:36.545270] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-03T20:42:36.545336] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-03T20:42:36.546502] [DEBUG] [LOCAL ] OGS: Trimmed 48064 records to 34630 (keeping 200 days of data) [2025-10-03T20:42:36.769049] [DEBUG] [LOCAL ] OGS: Primary data saved (34630 records). [2025-10-03T20:42:36.769197] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-03T20:42:36.771196] [INFO ] [MAIN ] Update Progress: 1582/2370 symbols completed. OGS took 25.5s. Estimated remaining: 1h 50m 51s. Rate: 7.1 symbols/min [2025-10-03T20:42:36.805677] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-03T20:42:36.973911] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:37.019935] [DEBUG] [LOCAL ] OII: Loaded 42794 existing records from primary storage. [2025-10-03T20:42:37.020265] [INFO ] [MAIN ] OII: Loaded 42794 existing records. [2025-10-03T20:42:37.260968] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:37.261717] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-03T20:42:37.262029] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-03T20:42:37.262802] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-03T20:42:37.262873] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-03T20:42:37.266112] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T20:42:37.596916] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-03T20:42:37.692775] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:38.390735] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-03T20:42:39.316632] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-03T20:42:39.329342] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-03T20:42:39.389987] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T20:42:39.707437] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-10-03T20:42:40.001890] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-03T20:42:40.007229] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T20:42:40.790625] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-03T20:42:41.229476] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T20:42:41.601705] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-03T20:42:41.608888] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T20:42:42.362358] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T20:42:42.390626] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-03T20:42:43.190628] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-03T20:42:43.409572] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T20:42:43.616277] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T20:42:43.990698] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-03T20:42:44.790692] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-03T20:42:44.917196] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T20:42:45.590697] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-03T20:42:45.804050] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T20:42:46.252833] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T20:42:46.255709] [INFO ] [REMOTE ] OHI: Full fetch complete (75095 records). [2025-10-03T20:42:46.255826] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-03T20:42:46.406135] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-03T20:42:46.646893] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T20:42:46.708371] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-03T20:42:46.708455] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-03T20:42:46.709533] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-03T20:42:46.709599] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-03T20:42:46.711137] [DEBUG] [LOCAL ] OHI: Trimmed 75095 records to 52709 (keeping 200 days of data) [2025-10-03T20:42:47.042243] [DEBUG] [LOCAL ] OHI: Primary data saved (52709 records). [2025-10-03T20:42:47.042395] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-03T20:42:47.042485] [INFO ] [MAIN ] Update Progress: 1583/2370 symbols completed. OHI took 35.5s. Estimated remaining: 1h 50m 43s. Rate: 7.1 symbols/min [2025-10-03T20:42:47.198038] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-03T20:42:47.225457] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:47.264723] [DEBUG] [LOCAL ] OIS: Loaded 40676 existing records from primary storage. [2025-10-03T20:42:47.265018] [INFO ] [MAIN ] OIS: Loaded 40676 existing records. [2025-10-03T20:42:47.452842] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:47.453069] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-03T20:42:47.453118] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-03T20:42:47.453364] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-03T20:42:47.453422] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-03T20:42:47.873006] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:47.990694] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-03T20:42:48.162295] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T20:42:48.247175] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T20:42:48.790683] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-03T20:42:49.408843] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T20:42:49.590736] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-03T20:42:50.381003] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T20:42:50.390970] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-03T20:42:51.190695] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-03T20:42:51.391578] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T20:42:51.923964] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T20:42:51.990623] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-03T20:42:52.214318] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T20:42:52.790716] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-03T20:42:53.590727] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-03T20:42:54.132081] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:42:54.134780] [INFO ] [REMOTE ] OI: Full fetch complete (68113 records). [2025-10-03T20:42:54.134918] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-03T20:42:54.286205] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-03T20:42:54.401224] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-03T20:42:54.627333] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-03T20:42:54.627487] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-03T20:42:54.642298] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-03T20:42:54.643305] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-03T20:42:54.644539] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T20:42:54.651059] [DEBUG] [LOCAL ] OI: Trimmed 68113 records to 47791 (keeping 200 days of data) [2025-10-03T20:42:54.935994] [DEBUG] [LOCAL ] OI: Primary data saved (47791 records). [2025-10-03T20:42:54.936127] [INFO ] [MAIN ] OI: Full history saved. [2025-10-03T20:42:54.936211] [INFO ] [MAIN ] Update Progress: 1584/2370 symbols completed. OI took 37.2s. Estimated remaining: 1h 50m 35s. Rate: 7.1 symbols/min [2025-10-03T20:42:55.122184] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:42:55.177550] [DEBUG] [LOCAL ] OKE: Loaded 53927 existing records from primary storage. [2025-10-03T20:42:55.178063] [INFO ] [MAIN ] OKE: Loaded 53927 existing records. [2025-10-03T20:42:55.195986] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-03T20:42:55.390797] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:42:55.391013] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-03T20:42:55.391061] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-03T20:42:55.391421] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-10-03T20:42:55.391478] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-03T20:42:55.769988] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:42:55.990635] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-03T20:42:56.125605] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T20:42:56.635894] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-03T20:42:56.790692] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-03T20:42:57.590697] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-03T20:42:57.896363] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T20:42:57.976830] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:42:58.216082] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T20:42:58.390688] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-03T20:42:59.190725] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-03T20:42:59.990732] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-03T20:43:00.115040] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T20:43:00.363202] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T20:43:00.790734] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-03T20:43:01.599058] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-03T20:43:01.618129] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T20:43:02.360049] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T20:43:02.390618] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-03T20:43:03.190710] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-03T20:43:03.828554] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-03T20:43:03.972550] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:43:03.990617] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-03T20:43:04.790702] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-03T20:43:04.834773] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T20:43:05.590751] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-03T20:43:05.894361] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T20:43:06.358930] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T20:43:06.390620] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-03T20:43:07.019907] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-03T20:43:07.190732] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-03T20:43:07.376702] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T20:43:07.990700] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-03T20:43:08.364546] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T20:43:08.367250] [INFO ] [REMOTE ] OII: Full fetch complete (61985 records). [2025-10-03T20:43:08.367368] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-03T20:43:08.705354] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T20:43:08.743441] [INFO ] [REMOTE ] OIA: Full fetch complete (21161 records). [2025-10-03T20:43:08.754297] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-03T20:43:08.813104] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-03T20:43:08.866729] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-03T20:43:08.876186] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-03T20:43:08.889862] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-03T20:43:08.900806] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-03T20:43:08.960846] [DEBUG] [LOCAL ] OII: Trimmed 61985 records to 43127 (keeping 200 days of data) [2025-10-03T20:43:09.340294] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-03T20:43:09.340429] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-03T20:43:09.341263] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-03T20:43:09.388029] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-03T20:43:09.429302] [DEBUG] [LOCAL ] OIA: Trimmed 21161 records to 13898 (keeping 200 days of data) [2025-10-03T20:43:09.547444] [DEBUG] [LOCAL ] OII: Primary data saved (43127 records). [2025-10-03T20:43:09.548713] [INFO ] [MAIN ] OII: Full history saved. [2025-10-03T20:43:09.550168] [INFO ] [MAIN ] Update Progress: 1585/2370 symbols completed. OII took 32.8s. Estimated remaining: 1h 50m 29s. Rate: 7.1 symbols/min [2025-10-03T20:43:09.596488] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-03T20:43:09.810929] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:09.812700] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-03T20:43:09.812825] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-03T20:43:09.816246] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-03T20:43:09.818114] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-03T20:43:09.819948] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-03T20:43:09.820921] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-03T20:43:09.905093] [DEBUG] [LOCAL ] OIA: Primary data saved (13898 records). [2025-10-03T20:43:09.953005] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-03T20:43:09.977219] [INFO ] [MAIN ] Update Progress: 1586/2370 symbols completed. OIA took 34.8s. Estimated remaining: 1h 50m 17s. Rate: 7.1 symbols/min [2025-10-03T20:43:10.536693] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:10.712422] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:10.713214] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-03T20:43:10.756588] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T20:43:10.810685] [DEBUG] [LOCAL ] OLN: Loaded 52160 existing records from primary storage. [2025-10-03T20:43:10.811075] [INFO ] [MAIN ] OLN: Loaded 52160 existing records. [2025-10-03T20:43:11.021397] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:11.021678] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-03T20:43:11.021746] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-03T20:43:11.022237] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-03T20:43:11.022300] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-03T20:43:11.190875] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-03T20:43:11.425824] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:11.705233] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T20:43:11.990742] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-03T20:43:12.790715] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-03T20:43:12.921293] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T20:43:13.351858] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-03T20:43:13.590750] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-03T20:43:13.796535] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T20:43:14.390772] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-03T20:43:14.893016] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T20:43:15.190735] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-03T20:43:15.990732] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-03T20:43:16.227747] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T20:43:16.370027] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-03T20:43:16.496136] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T20:43:16.790731] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-03T20:43:17.590710] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-03T20:43:18.390678] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-03T20:43:18.580085] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T20:43:18.684488] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-03T20:43:19.190697] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-03T20:43:19.990750] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-03T20:43:20.140099] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T20:43:20.790699] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-03T20:43:20.908272] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-10-03T20:43:21.514359] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-03T20:43:21.590735] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-03T20:43:22.169747] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T20:43:22.284503] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T20:43:22.390722] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-03T20:43:23.190673] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-03T20:43:23.451492] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T20:43:23.990710] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-03T20:43:24.414425] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T20:43:24.416958] [INFO ] [REMOTE ] OIS: Full fetch complete (57099 records). [2025-10-03T20:43:24.417122] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-03T20:43:24.795785] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-03T20:43:24.875900] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-03T20:43:24.876121] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-03T20:43:24.877330] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-03T20:43:24.877400] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-03T20:43:24.878856] [DEBUG] [LOCAL ] OIS: Trimmed 57099 records to 40930 (keeping 200 days of data) [2025-10-03T20:43:25.128355] [DEBUG] [LOCAL ] OIS: Primary data saved (40930 records). [2025-10-03T20:43:25.128490] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-03T20:43:25.128638] [INFO ] [MAIN ] Update Progress: 1587/2370 symbols completed. OIS took 38.1s. Estimated remaining: 1h 50m 12s. Rate: 7.1 symbols/min [2025-10-03T20:43:25.315398] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:25.347808] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-10-03T20:43:25.368572] [DEBUG] [LOCAL ] OLP: Loaded 9962 existing records from primary storage. [2025-10-03T20:43:25.368865] [INFO ] [MAIN ] OLP: Loaded 9962 existing records. [2025-10-03T20:43:25.584743] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:25.585019] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-03T20:43:25.585081] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-03T20:43:25.585482] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-03T20:43:25.585540] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-03T20:43:25.598897] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-03T20:43:25.983859] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:26.016471] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T20:43:26.390694] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-03T20:43:26.634295] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T20:43:27.190692] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-03T20:43:27.990689] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-03T20:43:28.083667] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T20:43:28.117721] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T20:43:28.386873] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-03T20:43:28.790699] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-03T20:43:29.590711] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-03T20:43:30.101909] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T20:43:30.390667] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-03T20:43:30.462565] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T20:43:30.884879] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T20:43:31.190693] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-03T20:43:31.990736] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-03T20:43:32.034934] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T20:43:32.038348] [INFO ] [REMOTE ] OKE: Full fetch complete (77499 records). [2025-10-03T20:43:32.038528] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-03T20:43:32.470507] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-03T20:43:32.470596] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-03T20:43:32.471773] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-03T20:43:32.471843] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-03T20:43:32.473528] [DEBUG] [LOCAL ] OKE: Trimmed 77499 records to 54317 (keeping 200 days of data) [2025-10-03T20:43:32.791406] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-03T20:43:32.840313] [DEBUG] [LOCAL ] OKE: Primary data saved (54317 records). [2025-10-03T20:43:32.840460] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-03T20:43:32.840599] [INFO ] [MAIN ] Update Progress: 1588/2370 symbols completed. OKE took 37.9s. Estimated remaining: 1h 50m 3s. Rate: 7.1 symbols/min [2025-10-03T20:43:32.960779] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:43:33.042240] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:33.077054] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T20:43:33.134169] [DEBUG] [LOCAL ] OMC: Loaded 53679 existing records from primary storage. [2025-10-03T20:43:33.134506] [INFO ] [MAIN ] OMC: Loaded 53679 existing records. [2025-10-03T20:43:33.330788] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:33.331078] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-03T20:43:33.331130] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-03T20:43:33.331400] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-10-03T20:43:33.331461] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-03T20:43:33.595850] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-03T20:43:33.723504] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:34.390674] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-03T20:43:34.497054] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:43:35.190713] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-03T20:43:35.282010] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-03T20:43:35.990631] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-03T20:43:36.061778] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T20:43:36.297049] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T20:43:36.790722] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-03T20:43:37.590746] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-03T20:43:37.722762] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T20:43:38.390727] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-03T20:43:38.417461] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T20:43:39.190634] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-03T20:43:39.581013] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-03T20:43:39.994900] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-03T20:43:39.996711] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T20:43:40.291861] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T20:43:40.790691] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-03T20:43:41.414056] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:43:41.416787] [INFO ] [REMOTE ] OLN: Full fetch complete (74663 records). [2025-10-03T20:43:41.416929] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-03T20:43:41.591460] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-03T20:43:41.760113] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T20:43:41.891448] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-03T20:43:41.891539] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-03T20:43:41.892973] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-03T20:43:41.893042] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-03T20:43:41.894716] [DEBUG] [LOCAL ] OLN: Trimmed 74663 records to 52549 (keeping 200 days of data) [2025-10-03T20:43:42.244962] [DEBUG] [LOCAL ] OLN: Primary data saved (52549 records). [2025-10-03T20:43:42.245131] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-03T20:43:42.245278] [INFO ] [MAIN ] Update Progress: 1589/2370 symbols completed. OLN took 32.2s. Estimated remaining: 1h 49m 55s. Rate: 7.1 symbols/min [2025-10-03T20:43:42.403161] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-03T20:43:42.438892] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:42.482487] [DEBUG] [LOCAL ] OMF: Loaded 46561 existing records from primary storage. [2025-10-03T20:43:42.482888] [INFO ] [MAIN ] OMF: Loaded 46561 existing records. [2025-10-03T20:43:42.689801] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:42.690067] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-03T20:43:42.690122] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-03T20:43:42.690479] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-03T20:43:42.690539] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-03T20:43:43.089615] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:43.190704] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-03T20:43:43.990751] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-03T20:43:44.032682] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T20:43:44.108932] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T20:43:44.679936] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-03T20:43:44.790730] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-03T20:43:45.597707] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-03T20:43:45.602579] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T20:43:46.390688] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-03T20:43:47.190726] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-03T20:43:47.389281] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T20:43:47.551145] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-03T20:43:47.775411] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T20:43:47.990680] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-03T20:43:48.159853] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T20:43:48.790689] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-03T20:43:49.590682] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-03T20:43:50.232127] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T20:43:50.233290] [INFO ] [REMOTE ] OLP: Full fetch complete (14108 records). [2025-10-03T20:43:50.233382] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-03T20:43:50.393776] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-03T20:43:50.512880] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T20:43:50.715392] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-03T20:43:50.715567] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-03T20:43:50.716098] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-03T20:43:50.716169] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-03T20:43:50.716993] [DEBUG] [LOCAL ] OLP: Trimmed 14108 records to 10054 (keeping 200 days of data) [2025-10-03T20:43:50.783089] [DEBUG] [LOCAL ] OLP: Primary data saved (10054 records). [2025-10-03T20:43:50.783227] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-03T20:43:50.783319] [INFO ] [MAIN ] Update Progress: 1590/2370 symbols completed. OLP took 25.7s. Estimated remaining: 1h 49m 46s. Rate: 7.1 symbols/min [2025-10-03T20:43:50.970541] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:51.010223] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-10-03T20:43:51.054397] [DEBUG] [LOCAL ] OMI: Loaded 46195 existing records from primary storage. [2025-10-03T20:43:51.054735] [INFO ] [MAIN ] OMI: Loaded 46195 existing records. [2025-10-03T20:43:51.197576] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-03T20:43:51.241079] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:51.241342] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-03T20:43:51.241396] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-03T20:43:51.241621] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-03T20:43:51.241712] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-03T20:43:51.622326] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:51.808829] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T20:43:51.811113] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-03T20:43:51.811246] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-03T20:43:51.812924] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:43:51.813020] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:43:51.813096] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:43:51.813173] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-03T20:43:51.813239] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-03T20:43:51.813278] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-03T20:43:51.813334] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-03T20:43:51.813417] [INFO ] [MAIN ] Update Progress: 1591/2370 symbols completed. OKLO took 42.3s. Estimated remaining: 1h 49m 34s. Rate: 7.1 symbols/min [2025-10-03T20:43:51.994622] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-03T20:43:51.995564] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:52.007415] [DEBUG] [LOCAL ] ONIT: Loaded 7761 existing records from primary storage. [2025-10-03T20:43:52.007783] [INFO ] [MAIN ] ONIT: Loaded 7761 existing records. [2025-10-03T20:43:52.199400] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:52.199626] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-03T20:43:52.199711] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-03T20:43:52.199945] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-03T20:43:52.200004] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-03T20:43:52.598233] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:52.633229] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T20:43:52.790673] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-03T20:43:53.590726] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-03T20:43:53.651329] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T20:43:53.691854] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T20:43:54.390723] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-03T20:43:54.938482] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T20:43:55.190701] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-03T20:43:55.990635] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-03T20:43:56.144242] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:43:56.652475] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T20:43:56.790693] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-03T20:43:56.831956] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T20:43:57.590723] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-03T20:43:58.284300] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:43:58.390715] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-03T20:43:58.495921] [DEBUG] [REMOTE ] ONIT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-03T20:43:58.496271] [WARN ] [REMOTE ] ONIT: No data returned for month 2025-02 [2025-10-03T20:43:58.496385] [FATAL] [REMOTE ] ONIT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:43:58.496516] [FATAL] [MAIN ] ONIT: Failed to fetch primary data. [2025-10-03T20:43:58.496591] [WARN ] [MAIN ] ONIT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:43:58.496697] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-03T20:43:58.496772] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-03T20:43:58.496811] [INFO ] [LOCAL ] ONIT: Starting deletion of derivative data. [2025-10-03T20:43:58.497094] [DEBUG] [LOCAL ] ONIT: Deleted derivative data file. [2025-10-03T20:43:58.497210] [INFO ] [MAIN ] Update Progress: 1592/2370 symbols completed. ONIT took 6.7s. Estimated remaining: 1h 49m 25s. Rate: 7.1 symbols/min [2025-10-03T20:43:58.690450] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:43:58.731789] [DEBUG] [LOCAL ] ONL: Loaded 30689 existing records from primary storage. [2025-10-03T20:43:58.732069] [INFO ] [MAIN ] ONL: Loaded 30689 existing records. [2025-10-03T20:43:58.924122] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:43:58.924353] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-03T20:43:58.924400] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-03T20:43:58.924622] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-03T20:43:58.924727] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-03T20:43:59.197115] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-03T20:43:59.333408] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:43:59.369997] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T20:43:59.990733] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-03T20:44:00.790693] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-03T20:44:01.037674] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T20:44:01.590738] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-03T20:44:01.696574] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T20:44:02.390696] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-03T20:44:02.612714] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T20:44:02.922357] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T20:44:03.190747] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-03T20:44:03.990674] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-03T20:44:04.117240] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T20:44:04.790669] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-03T20:44:05.159593] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T20:44:05.590715] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-03T20:44:05.629952] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T20:44:06.255565] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T20:44:06.390952] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-03T20:44:07.190684] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-03T20:44:07.449774] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T20:44:07.498054] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T20:44:07.990724] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-03T20:44:08.568555] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T20:44:08.790704] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-03T20:44:09.590637] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-03T20:44:09.869568] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T20:44:10.390623] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-03T20:44:10.483045] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T20:44:11.190699] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-03T20:44:11.351153] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T20:44:11.898348] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T20:44:11.902070] [INFO ] [REMOTE ] OMC: Full fetch complete (76985 records). [2025-10-03T20:44:11.902260] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-03T20:44:11.995775] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-03T20:44:12.359266] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-03T20:44:12.360115] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-03T20:44:12.361736] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-03T20:44:12.362721] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T20:44:12.362815] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-03T20:44:12.369676] [DEBUG] [LOCAL ] OMC: Trimmed 76985 records to 54069 (keeping 200 days of data) [2025-10-03T20:44:12.729363] [DEBUG] [LOCAL ] OMC: Primary data saved (54069 records). [2025-10-03T20:44:12.729517] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-03T20:44:12.729673] [INFO ] [MAIN ] Update Progress: 1593/2370 symbols completed. OMC took 39.9s. Estimated remaining: 1h 49m 19s. Rate: 7.1 symbols/min [2025-10-03T20:44:12.798834] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-03T20:44:12.921098] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:44:12.974476] [DEBUG] [LOCAL ] ONON: Loaded 54003 existing records from primary storage. [2025-10-03T20:44:12.974948] [INFO ] [MAIN ] ONON: Loaded 54003 existing records. [2025-10-03T20:44:13.184498] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:44:13.184880] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-03T20:44:13.184941] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-03T20:44:13.185415] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-03T20:44:13.185479] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-03T20:44:13.584246] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:44:13.590615] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-03T20:44:13.754909] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T20:44:14.381350] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:44:14.390724] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-03T20:44:15.190629] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-03T20:44:15.685822] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T20:44:15.806785] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:44:15.809518] [INFO ] [REMOTE ] OMF: Full fetch complete (66963 records). [2025-10-03T20:44:15.809628] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-03T20:44:16.000626] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-03T20:44:16.301850] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-03T20:44:16.301942] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-03T20:44:16.302987] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-03T20:44:16.303094] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-03T20:44:16.304971] [DEBUG] [LOCAL ] OMF: Trimmed 66963 records to 46922 (keeping 200 days of data) [2025-10-03T20:44:16.604679] [DEBUG] [LOCAL ] OMF: Primary data saved (46922 records). [2025-10-03T20:44:16.604836] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-03T20:44:16.604928] [INFO ] [MAIN ] Update Progress: 1594/2370 symbols completed. OMF took 34.4s. Estimated remaining: 1h 49m 9s. Rate: 7.1 symbols/min [2025-10-03T20:44:16.807547] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:44:16.807900] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-03T20:44:16.849670] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T20:44:16.868034] [DEBUG] [LOCAL ] ONTF: Loaded 22684 existing records from primary storage. [2025-10-03T20:44:16.868372] [INFO ] [MAIN ] ONTF: Loaded 22684 existing records. [2025-10-03T20:44:17.071408] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:44:17.071677] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-03T20:44:17.071742] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-03T20:44:17.071999] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-03T20:44:17.072066] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-03T20:44:17.508429] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:44:17.590638] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-03T20:44:17.751486] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T20:44:18.390694] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-03T20:44:19.087560] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T20:44:19.143863] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-03T20:44:19.190733] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-03T20:44:19.597426] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:44:19.990730] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-03T20:44:20.723726] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T20:44:20.790737] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-03T20:44:21.590709] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-03T20:44:21.805484] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T20:44:22.065373] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T20:44:22.390698] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-03T20:44:22.663699] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T20:44:23.190693] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-03T20:44:23.568301] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T20:44:23.990689] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-03T20:44:24.790838] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-03T20:44:24.890625] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T20:44:25.120969] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:44:25.590697] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-03T20:44:26.390663] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-03T20:44:26.646588] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T20:44:26.934940] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:44:26.938720] [INFO ] [REMOTE ] OMI: Full fetch complete (64624 records). [2025-10-03T20:44:26.938883] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-03T20:44:27.195887] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-03T20:44:27.288357] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T20:44:27.396519] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-03T20:44:27.396673] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-03T20:44:27.397893] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-03T20:44:27.397966] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-03T20:44:27.399485] [DEBUG] [LOCAL ] OMI: Trimmed 64624 records to 46558 (keeping 200 days of data) [2025-10-03T20:44:27.679217] [DEBUG] [LOCAL ] OMI: Primary data saved (46558 records). [2025-10-03T20:44:27.679372] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-03T20:44:27.679539] [INFO ] [MAIN ] Update Progress: 1595/2370 symbols completed. OMI took 36.9s. Estimated remaining: 1h 49m 2s. Rate: 7.1 symbols/min [2025-10-03T20:44:27.863216] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:44:27.908735] [DEBUG] [LOCAL ] ONTO: Loaded 47013 existing records from primary storage. [2025-10-03T20:44:27.909114] [INFO ] [MAIN ] ONTO: Loaded 47013 existing records. [2025-10-03T20:44:27.995791] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-03T20:44:28.105836] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T20:44:28.112174] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:44:28.112484] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-03T20:44:28.113667] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-03T20:44:28.114002] [INFO ] [REMOTE ] ONL: Full fetch complete (43111 records). [2025-10-03T20:44:28.114109] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-03T20:44:28.114079] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-03T20:44:28.114216] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-03T20:44:28.794170] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-03T20:44:28.927193] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:44:28.954639] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-03T20:44:28.954751] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-03T20:44:28.955689] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-03T20:44:28.955752] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-03T20:44:28.956830] [DEBUG] [LOCAL ] ONL: Trimmed 43111 records to 30810 (keeping 200 days of data) [2025-10-03T20:44:29.151402] [DEBUG] [LOCAL ] ONL: Primary data saved (30810 records). [2025-10-03T20:44:29.151552] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-03T20:44:29.152699] [INFO ] [MAIN ] Update Progress: 1596/2370 symbols completed. ONL took 30.7s. Estimated remaining: 1h 48m 50s. Rate: 7.1 symbols/min [2025-10-03T20:44:29.358506] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T20:44:29.361881] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:44:29.389614] [DEBUG] [LOCAL ] OOMA: Loaded 18967 existing records from primary storage. [2025-10-03T20:44:29.389912] [INFO ] [MAIN ] OOMA: Loaded 18967 existing records. [2025-10-03T20:44:29.575775] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:44:29.575990] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-03T20:44:29.576039] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-03T20:44:29.576290] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-03T20:44:29.576350] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-03T20:44:29.598847] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-03T20:44:29.974501] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:44:30.390701] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-03T20:44:31.088368] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T20:44:31.190706] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-03T20:44:31.258551] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T20:44:31.539788] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T20:44:31.990735] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-03T20:44:32.790723] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-03T20:44:33.108903] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T20:44:33.296303] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T20:44:33.590715] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-03T20:44:34.390697] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-03T20:44:34.487305] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T20:44:35.190689] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-03T20:44:35.457512] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T20:44:35.830107] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-03T20:44:35.990707] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-03T20:44:36.790725] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-03T20:44:36.895405] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:44:37.590638] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-03T20:44:37.741831] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T20:44:37.908179] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T20:44:38.390710] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-03T20:44:39.019311] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T20:44:39.190722] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-03T20:44:39.479419] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T20:44:39.990710] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-03T20:44:40.790704] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-03T20:44:41.070924] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T20:44:41.399231] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T20:44:41.590721] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-03T20:44:41.923788] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T20:44:42.390732] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-03T20:44:43.190673] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-03T20:44:43.442683] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T20:44:43.990692] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-03T20:44:44.345155] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:44:44.560070] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T20:44:44.790735] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-03T20:44:45.501363] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T20:44:45.590728] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-03T20:44:46.390733] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-03T20:44:46.592864] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T20:44:46.777122] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T20:44:47.190685] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-03T20:44:47.656685] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T20:44:47.990692] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-03T20:44:48.790630] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-03T20:44:48.925608] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T20:44:48.928609] [INFO ] [REMOTE ] ONON: Full fetch complete (77582 records). [2025-10-03T20:44:48.928764] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-03T20:44:49.369219] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-03T20:44:49.369312] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-03T20:44:49.370560] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-03T20:44:49.370629] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-03T20:44:49.372282] [DEBUG] [LOCAL ] ONON: Trimmed 77582 records to 54393 (keeping 200 days of data) [2025-10-03T20:44:49.593942] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-03T20:44:49.713341] [DEBUG] [LOCAL ] ONON: Primary data saved (54393 records). [2025-10-03T20:44:49.713546] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-03T20:44:49.713973] [INFO ] [MAIN ] Update Progress: 1597/2370 symbols completed. ONON took 37.0s. Estimated remaining: 1h 48m 47s. Rate: 7.1 symbols/min [2025-10-03T20:44:49.751264] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T20:44:49.926178] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T20:44:50.390690] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-03T20:44:50.855778] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T20:44:51.190624] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-03T20:44:51.568043] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T20:44:51.990666] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-03T20:44:52.128997] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T20:44:52.790668] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-03T20:44:53.130639] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T20:44:53.590627] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-03T20:44:53.893361] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:44:54.390716] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-03T20:44:54.478727] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T20:44:54.480262] [INFO ] [REMOTE ] ONTF: Full fetch complete (31630 records). [2025-10-03T20:44:54.480401] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-03T20:44:54.883255] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-03T20:44:54.883352] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-03T20:44:54.884144] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-03T20:44:54.884215] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-03T20:44:54.885212] [DEBUG] [LOCAL ] ONTF: Trimmed 31630 records to 22832 (keeping 200 days of data) [2025-10-03T20:44:55.019779] [DEBUG] [LOCAL ] ONTF: Primary data saved (22832 records). [2025-10-03T20:44:55.019949] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-03T20:44:55.020068] [INFO ] [MAIN ] Update Progress: 1598/2370 symbols completed. ONTF took 38.4s. Estimated remaining: 1h 48m 37s. Rate: 7.1 symbols/min [2025-10-03T20:44:55.190730] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-03T20:44:55.364676] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T20:44:55.990703] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-03T20:44:56.996094] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T20:44:56.997522] [INFO ] [REMOTE ] OOMA: Full fetch complete (25886 records). [2025-10-03T20:44:56.997664] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-03T20:44:57.206062] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T20:44:57.312603] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-03T20:44:57.453216] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-03T20:44:57.453297] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-03T20:44:57.453928] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-03T20:44:57.453994] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-03T20:44:57.454836] [DEBUG] [LOCAL ] OOMA: Trimmed 25886 records to 19059 (keeping 200 days of data) [2025-10-03T20:44:57.569220] [DEBUG] [LOCAL ] OOMA: Primary data saved (19059 records). [2025-10-03T20:44:57.569404] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-03T20:44:57.569518] [INFO ] [MAIN ] Update Progress: 1599/2370 symbols completed. OOMA took 28.4s. Estimated remaining: 1h 48m 26s. Rate: 7.1 symbols/min [2025-10-03T20:44:59.239836] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T20:44:59.251020] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-03T20:45:00.795247] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T20:45:00.797922] [INFO ] [REMOTE ] ONTO: Full fetch complete (66223 records). [2025-10-03T20:45:00.798043] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-03T20:45:01.228369] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-03T20:45:01.228465] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-03T20:45:01.229698] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-03T20:45:01.229802] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-03T20:45:01.231406] [DEBUG] [LOCAL ] ONTO: Trimmed 66223 records to 47395 (keeping 200 days of data) [2025-10-03T20:45:01.541145] [DEBUG] [LOCAL ] ONTO: Primary data saved (47395 records). [2025-10-03T20:45:01.541299] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-03T20:45:01.541392] [INFO ] [MAIN ] Update Progress: 1600/2370 symbols completed. ONTO took 33.9s. Estimated remaining: 1h 48m 15s. Rate: 7.1 symbols/min [2025-10-03T20:45:02.271676] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:02.314557] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:02.354714] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:02.377353] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:02.378168] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-03T20:45:02.378226] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-03T20:45:02.378338] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-03T20:45:02.378380] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-03T20:45:02.378421] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-03T20:45:02.378453] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-03T20:45:02.520690] [DEBUG] [LOCAL ] OPP: Loaded 11686 existing records from primary storage. [2025-10-03T20:45:02.522247] [INFO ] [MAIN ] OPP: Loaded 11686 existing records. [2025-10-03T20:45:02.546635] [DEBUG] [LOCAL ] OPAD: Loaded 22121 existing records from primary storage. [2025-10-03T20:45:02.679167] [INFO ] [MAIN ] OPAD: Loaded 22121 existing records. [2025-10-03T20:45:02.810918] [DEBUG] [LOCAL ] OPFI: Loaded 46774 existing records from primary storage. [2025-10-03T20:45:02.868631] [INFO ] [MAIN ] OPFI: Loaded 46774 existing records. [2025-10-03T20:45:03.011810] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:03.134139] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-03T20:45:03.202147] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-03T20:45:03.246140] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-03T20:45:03.357385] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:03.332905] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-03T20:45:03.430322] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-03T20:45:03.473566] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:03.476865] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-03T20:45:03.512353] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-03T20:45:03.554670] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:03.555018] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-03T20:45:03.555075] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-03T20:45:03.555135] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-03T20:45:03.555225] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-03T20:45:03.560709] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-03T20:45:03.624576] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-03T20:45:04.489997] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:04.521050] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-03T20:45:04.546311] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:45:04.575162] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-03T20:45:04.640476] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:04.683169] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-03T20:45:04.705574] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:04.706187] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-03T20:45:05.404271] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T20:45:05.406206] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-03T20:45:05.557135] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T20:45:05.560019] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-03T20:45:05.645422] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:45:05.650661] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-03T20:45:05.993181] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T20:45:05.995355] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-03T20:45:06.100591] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T20:45:06.108835] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-03T20:45:06.125575] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T20:45:06.391381] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-03T20:45:06.392194] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T20:45:06.490335] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T20:45:07.086462] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T20:45:07.190676] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-03T20:45:07.990628] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-03T20:45:08.000632] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T20:45:08.183303] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T20:45:08.723322] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T20:45:08.790744] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-03T20:45:09.590630] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-03T20:45:09.656252] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T20:45:10.390629] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-03T20:45:10.472238] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T20:45:11.190715] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-03T20:45:11.990754] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-03T20:45:12.219493] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T20:45:12.440266] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T20:45:12.684100] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T20:45:12.790823] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-03T20:45:13.590709] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-03T20:45:13.634605] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T20:45:14.391436] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-03T20:45:14.392697] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T20:45:15.190724] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-03T20:45:15.834449] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T20:45:15.990721] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-03T20:45:16.025224] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T20:45:16.790717] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-03T20:45:17.496608] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T20:45:17.590710] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-03T20:45:17.647208] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T20:45:18.390695] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-03T20:45:19.190693] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-03T20:45:19.284602] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T20:45:19.990737] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T20:45:19.990950] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-03T20:45:20.280674] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T20:45:20.790717] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-03T20:45:20.949143] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T20:45:21.590685] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-03T20:45:21.620950] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T20:45:22.390686] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-03T20:45:23.190698] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-03T20:45:23.323326] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T20:45:23.962496] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-03T20:45:23.990674] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-03T20:45:24.790704] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-03T20:45:25.046383] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T20:45:25.365438] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T20:45:25.366383] [INFO ] [REMOTE ] OPY: Full fetch complete (10097 records). [2025-10-03T20:45:25.366453] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-03T20:45:25.555240] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:45:25.555509] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:45:25.555581] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:45:25.555679] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-03T20:45:25.555783] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-03T20:45:25.555854] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-03T20:45:25.555912] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-03T20:45:25.555989] [INFO ] [MAIN ] Update Progress: 1601/2370 symbols completed. OPY took 24.0s. Estimated remaining: 1h 48m 14s. Rate: 7.1 symbols/min [2025-10-03T20:45:25.595756] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-03T20:45:25.742604] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:25.786761] [DEBUG] [LOCAL ] OR: Loaded 46493 existing records from primary storage. [2025-10-03T20:45:25.787059] [INFO ] [MAIN ] OR: Loaded 46493 existing records. [2025-10-03T20:45:25.983820] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:25.984549] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T20:45:25.985009] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-03T20:45:25.987839] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-03T20:45:25.988541] [INFO ] [REMOTE ] OPAD: Full fetch complete (25424 records). [2025-10-03T20:45:25.988693] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-03T20:45:25.988875] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-03T20:45:25.989004] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-03T20:45:26.395849] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-03T20:45:26.703063] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:45:26.864710] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-03T20:45:26.874892] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-03T20:45:26.886967] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-03T20:45:26.894786] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-03T20:45:26.898791] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:26.900404] [DEBUG] [LOCAL ] OPAD: Trimmed 25424 records to 22500 (keeping 200 days of data) [2025-10-03T20:45:27.038458] [DEBUG] [LOCAL ] OPAD: Primary data saved (22500 records). [2025-10-03T20:45:27.038603] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-03T20:45:27.038718] [INFO ] [MAIN ] Update Progress: 1602/2370 symbols completed. OPAD took 25.5s. Estimated remaining: 1h 48m 3s. Rate: 7.1 symbols/min [2025-10-03T20:45:27.196237] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-03T20:45:27.234581] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:27.271380] [DEBUG] [LOCAL ] ORA: Loaded 32793 existing records from primary storage. [2025-10-03T20:45:27.271736] [INFO ] [MAIN ] ORA: Loaded 32793 existing records. [2025-10-03T20:45:27.472278] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:27.472493] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-03T20:45:27.472541] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-03T20:45:27.472956] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-03T20:45:27.473016] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-03T20:45:27.871514] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:27.990690] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-03T20:45:28.118938] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T20:45:28.364147] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-03T20:45:28.790726] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-03T20:45:29.529874] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T20:45:29.590693] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-03T20:45:29.653400] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T20:45:30.390698] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-03T20:45:31.176109] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T20:45:31.190607] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-03T20:45:31.990638] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-03T20:45:32.063395] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T20:45:32.790688] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-03T20:45:32.888259] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T20:45:33.590720] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-03T20:45:34.336261] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T20:45:34.390723] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-03T20:45:34.948704] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T20:45:35.190734] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-03T20:45:35.865490] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T20:45:35.990692] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-03T20:45:36.790751] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-03T20:45:36.807144] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (4.82 seconds). [2025-10-03T20:45:37.059093] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T20:45:37.590710] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-03T20:45:37.640841] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T20:45:38.279402] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:45:38.300573] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T20:45:38.301945] [INFO ] [REMOTE ] OPP: Full fetch complete (17440 records). [2025-10-03T20:45:38.302035] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-03T20:45:38.395882] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-03T20:45:38.738871] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-03T20:45:38.738957] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-03T20:45:38.739391] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-03T20:45:38.739434] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-03T20:45:38.740079] [DEBUG] [LOCAL ] OPP: Trimmed 17440 records to 11836 (keeping 200 days of data) [2025-10-03T20:45:38.813737] [DEBUG] [LOCAL ] OPP: Primary data saved (11836 records). [2025-10-03T20:45:38.813892] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-03T20:45:38.813989] [INFO ] [MAIN ] Update Progress: 1603/2370 symbols completed. OPP took 37.3s. Estimated remaining: 1h 47m 56s. Rate: 7.1 symbols/min [2025-10-03T20:45:39.006331] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:39.063804] [DEBUG] [LOCAL ] ORC: Loaded 52772 existing records from primary storage. [2025-10-03T20:45:39.064190] [INFO ] [MAIN ] ORC: Loaded 52772 existing records. [2025-10-03T20:45:39.192360] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-03T20:45:39.292219] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:45:39.292449] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-03T20:45:39.292539] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-03T20:45:39.293095] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-03T20:45:39.293158] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-03T20:45:39.715125] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:39.990739] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-03T20:45:40.067546] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T20:45:40.613024] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T20:45:40.790701] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-03T20:45:41.590720] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-03T20:45:41.985837] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T20:45:42.227198] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T20:45:42.390706] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-03T20:45:42.975714] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T20:45:42.978281] [INFO ] [REMOTE ] OPFI: Full fetch complete (68090 records). [2025-10-03T20:45:42.978386] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-03T20:45:43.198765] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-03T20:45:43.418801] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-03T20:45:43.418889] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-03T20:45:43.420021] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-03T20:45:43.420090] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-03T20:45:43.421619] [DEBUG] [LOCAL ] OPFI: Trimmed 68090 records to 47102 (keeping 200 days of data) [2025-10-03T20:45:43.709915] [DEBUG] [LOCAL ] OPFI: Primary data saved (47102 records). [2025-10-03T20:45:43.710073] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-03T20:45:43.710182] [INFO ] [MAIN ] Update Progress: 1604/2370 symbols completed. OPFI took 42.2s. Estimated remaining: 1h 47m 46s. Rate: 7.1 symbols/min [2025-10-03T20:45:43.915064] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:43.915545] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-03T20:45:43.915735] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-03T20:45:43.915860] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-03T20:45:43.915905] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-03T20:45:43.915998] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-03T20:45:43.916048] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-03T20:45:43.995111] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-03T20:45:44.225016] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T20:45:44.362604] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:44.790618] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-03T20:45:44.903922] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T20:45:45.590741] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-03T20:45:46.134639] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T20:45:46.390725] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-03T20:45:47.190673] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-03T20:45:47.351586] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-03T20:45:47.506740] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T20:45:47.922992] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:45:47.990691] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-03T20:45:48.790709] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-03T20:45:49.023621] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T20:45:49.597060] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-03T20:45:49.617195] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T20:45:50.390722] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-03T20:45:51.043532] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T20:45:51.190686] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-03T20:45:51.596987] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T20:45:51.990726] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-03T20:45:52.205355] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T20:45:52.718024] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T20:45:52.790707] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-03T20:45:53.590742] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-03T20:45:54.343706] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T20:45:54.390671] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-03T20:45:54.550942] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-03T20:45:55.190687] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-03T20:45:55.221711] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T20:45:55.990689] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-03T20:45:56.793768] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-03T20:45:56.798113] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-03T20:45:57.599158] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-03T20:45:57.623593] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T20:45:57.880382] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-03T20:45:58.002412] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T20:45:58.005491] [INFO ] [REMOTE ] ORA: Full fetch complete (49202 records). [2025-10-03T20:45:58.005722] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-03T20:45:58.395853] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-03T20:45:58.474381] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-03T20:45:58.474468] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-03T20:45:58.475383] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-03T20:45:58.475451] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-03T20:45:58.476697] [DEBUG] [LOCAL ] ORA: Trimmed 49202 records to 33070 (keeping 200 days of data) [2025-10-03T20:45:58.707419] [DEBUG] [LOCAL ] ORA: Primary data saved (33070 records). [2025-10-03T20:45:58.707638] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-03T20:45:58.707831] [INFO ] [MAIN ] Update Progress: 1605/2370 symbols completed. ORA took 31.7s. Estimated remaining: 1h 47m 40s. Rate: 7.1 symbols/min [2025-10-03T20:45:58.907221] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:45:58.907444] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-03T20:45:58.907548] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-03T20:45:58.907732] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-03T20:45:58.907789] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-03T20:45:58.907858] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-03T20:45:58.907893] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-03T20:45:59.196566] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-03T20:45:59.299429] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:45:59.837352] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T20:45:59.840500] [INFO ] [REMOTE ] OR: Full fetch complete (65557 records). [2025-10-03T20:45:59.840668] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-03T20:46:00.014838] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-03T20:46:00.296603] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-03T20:46:00.365043] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-03T20:46:00.365287] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-03T20:46:00.366570] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-03T20:46:00.366739] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-03T20:46:00.368775] [DEBUG] [LOCAL ] OR: Trimmed 65557 records to 46875 (keeping 200 days of data) [2025-10-03T20:46:00.676018] [DEBUG] [LOCAL ] OR: Primary data saved (46875 records). [2025-10-03T20:46:00.676165] [INFO ] [MAIN ] OR: Full history saved. [2025-10-03T20:46:00.676320] [INFO ] [MAIN ] Update Progress: 1606/2370 symbols completed. OR took 35.1s. Estimated remaining: 1h 47m 29s. Rate: 7.1 symbols/min [2025-10-03T20:46:00.795868] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-03T20:46:00.869708] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:00.903929] [DEBUG] [LOCAL ] ORN: Loaded 31198 existing records from primary storage. [2025-10-03T20:46:00.904254] [INFO ] [MAIN ] ORN: Loaded 31198 existing records. [2025-10-03T20:46:01.102345] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:46:01.102610] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-03T20:46:01.102687] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-03T20:46:01.103076] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-03T20:46:01.103133] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-03T20:46:01.549212] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:01.590706] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-03T20:46:01.986009] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T20:46:02.088418] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-03T20:46:02.390695] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-03T20:46:02.912175] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T20:46:03.108916] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T20:46:03.190714] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-03T20:46:03.990735] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-03T20:46:04.797916] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-03T20:46:04.836678] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:46:05.162924] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-03T20:46:05.590721] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-03T20:46:06.199881] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T20:46:06.273278] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T20:46:06.390680] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-03T20:46:07.190705] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-03T20:46:07.253596] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T20:46:07.319395] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T20:46:07.990717] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-03T20:46:08.790673] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-03T20:46:09.590712] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-03T20:46:09.765280] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-03T20:46:09.958752] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:46:10.390709] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-03T20:46:10.816968] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T20:46:11.083460] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T20:46:11.190691] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-03T20:46:11.990687] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-03T20:46:12.253975] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T20:46:12.790689] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-03T20:46:12.884079] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T20:46:13.590736] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-03T20:46:14.145909] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T20:46:14.390679] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-03T20:46:14.874251] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-03T20:46:15.190665] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-03T20:46:15.260563] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T20:46:15.263483] [INFO ] [REMOTE ] ORC: Full fetch complete (75393 records). [2025-10-03T20:46:15.263634] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-03T20:46:15.722749] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-03T20:46:15.722888] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-03T20:46:15.724370] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-03T20:46:15.724615] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-03T20:46:15.726804] [DEBUG] [LOCAL ] ORC: Trimmed 75393 records to 53146 (keeping 200 days of data) [2025-10-03T20:46:15.866972] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:46:16.009852] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-03T20:46:16.133123] [DEBUG] [LOCAL ] ORC: Primary data saved (53146 records). [2025-10-03T20:46:16.133275] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-03T20:46:16.133860] [INFO ] [MAIN ] Update Progress: 1607/2370 symbols completed. ORC took 37.3s. Estimated remaining: 1h 47m 24s. Rate: 7.1 symbols/min [2025-10-03T20:46:16.330842] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:16.395188] [DEBUG] [LOCAL ] OSCR: Loaded 54112 existing records from primary storage. [2025-10-03T20:46:16.395540] [INFO ] [MAIN ] OSCR: Loaded 54112 existing records. [2025-10-03T20:46:16.594708] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:46:16.594967] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-03T20:46:16.595040] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-03T20:46:16.595397] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-03T20:46:16.595460] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-03T20:46:16.795978] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-03T20:46:17.038766] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:17.415608] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T20:46:17.590687] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-03T20:46:17.945778] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-03T20:46:18.390707] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-03T20:46:18.683974] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T20:46:19.190696] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-03T20:46:19.325936] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T20:46:19.592392] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T20:46:19.990697] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-03T20:46:20.215441] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-03T20:46:20.217883] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-03T20:46:20.218005] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-03T20:46:20.218841] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:46:20.218934] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:46:20.218980] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:46:20.219021] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-03T20:46:20.219078] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-03T20:46:20.219114] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-03T20:46:20.219155] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-03T20:46:20.219211] [INFO ] [MAIN ] Update Progress: 1608/2370 symbols completed. ORCL took 36.5s. Estimated remaining: 1h 47m 13s. Rate: 7.1 symbols/min [2025-10-03T20:46:20.420165] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:20.420387] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-03T20:46:20.420454] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-03T20:46:20.420609] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-03T20:46:20.420702] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-03T20:46:20.420787] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-03T20:46:20.420852] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-03T20:46:20.792977] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-03T20:46:20.943194] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:20.946963] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T20:46:21.590717] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-03T20:46:21.992032] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T20:46:22.390684] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-03T20:46:23.190623] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-03T20:46:23.378137] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T20:46:23.746853] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T20:46:23.990729] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-03T20:46:24.790678] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-03T20:46:24.899761] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T20:46:25.590632] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-03T20:46:25.778636] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T20:46:25.895036] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:46:26.390695] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-03T20:46:26.832942] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T20:46:27.190741] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-03T20:46:27.990717] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-03T20:46:28.081391] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T20:46:28.529054] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T20:46:28.531771] [INFO ] [REMOTE ] ORI: Full fetch complete (70325 records). [2025-10-03T20:46:28.531900] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-03T20:46:28.742575] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:46:28.743477] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:46:28.743571] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:46:28.743674] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-03T20:46:28.743766] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-03T20:46:28.743817] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-03T20:46:28.743861] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-03T20:46:28.743942] [INFO ] [MAIN ] Update Progress: 1609/2370 symbols completed. ORI took 30.0s. Estimated remaining: 1h 47m 5s. Rate: 7.1 symbols/min [2025-10-03T20:46:28.795919] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-03T20:46:28.934862] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:28.935031] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-03T20:46:28.935070] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-03T20:46:28.935182] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-03T20:46:28.935224] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-03T20:46:28.935266] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-03T20:46:28.935300] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-03T20:46:29.335378] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:29.590865] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-03T20:46:29.599302] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T20:46:29.913384] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:46:29.913835] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-03T20:46:29.913961] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:46:29.914092] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-03T20:46:29.914234] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:46:29.914321] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-03T20:46:29.914420] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-03T20:46:29.914473] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-03T20:46:29.914518] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-03T20:46:29.914566] [INFO ] [MAIN ] Update Progress: 1610/2370 symbols completed. OTF took 1.2s. Estimated remaining: 1h 46m 53s. Rate: 7.1 symbols/min [2025-10-03T20:46:30.106349] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:30.162077] [DEBUG] [LOCAL ] OTIS: Loaded 53094 existing records from primary storage. [2025-10-03T20:46:30.162413] [INFO ] [MAIN ] OTIS: Loaded 53094 existing records. [2025-10-03T20:46:30.381813] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:46:30.382182] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-03T20:46:30.382241] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-03T20:46:30.382687] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-10-03T20:46:30.382748] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-03T20:46:30.395947] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-03T20:46:30.739353] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T20:46:30.849246] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:31.190737] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-03T20:46:31.990639] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-03T20:46:32.187511] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T20:46:32.790693] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-03T20:46:33.131589] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T20:46:33.590639] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-03T20:46:33.901833] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T20:46:33.904388] [INFO ] [REMOTE ] ORN: Full fetch complete (45414 records). [2025-10-03T20:46:33.932497] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-03T20:46:33.934416] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T20:46:34.355503] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-03T20:46:34.355587] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-03T20:46:34.356576] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-03T20:46:34.356664] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-03T20:46:34.357889] [DEBUG] [LOCAL ] ORN: Trimmed 45414 records to 31360 (keeping 200 days of data) [2025-10-03T20:46:34.402984] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-03T20:46:34.540382] [DEBUG] [LOCAL ] ORN: Primary data saved (31360 records). [2025-10-03T20:46:34.540539] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-03T20:46:34.540625] [INFO ] [MAIN ] Update Progress: 1611/2370 symbols completed. ORN took 33.9s. Estimated remaining: 1h 46m 43s. Rate: 7.1 symbols/min [2025-10-03T20:46:34.726538] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:34.775118] [DEBUG] [LOCAL ] OUT: Loaded 48152 existing records from primary storage. [2025-10-03T20:46:34.775450] [INFO ] [MAIN ] OUT: Loaded 48152 existing records. [2025-10-03T20:46:34.971691] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:46:34.971959] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-03T20:46:34.972024] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-03T20:46:34.972377] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-03T20:46:34.972438] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-03T20:46:35.201798] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-03T20:46:35.369433] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:35.424036] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T20:46:35.990740] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-03T20:46:36.314787] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T20:46:36.790635] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-03T20:46:37.060808] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T20:46:37.578746] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T20:46:37.590607] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-03T20:46:38.390720] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-03T20:46:38.916524] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-03T20:46:39.190697] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-03T20:46:39.578987] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T20:46:39.990672] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-03T20:46:40.051752] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T20:46:40.790725] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-03T20:46:41.590739] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-03T20:46:41.737852] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-03T20:46:42.038400] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T20:46:42.078191] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T20:46:42.390747] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-03T20:46:42.897181] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T20:46:43.190690] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-03T20:46:43.990729] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-03T20:46:44.072594] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T20:46:44.790717] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-03T20:46:45.590672] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-03T20:46:45.748099] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-03T20:46:45.849804] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T20:46:46.390740] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-03T20:46:46.435929] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T20:46:47.190690] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-03T20:46:47.359571] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:46:47.990751] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-03T20:46:48.291259] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T20:46:48.790714] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-03T20:46:49.590693] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-03T20:46:49.644575] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T20:46:50.021526] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-03T20:46:50.390711] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-03T20:46:50.508790] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T20:46:51.190705] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-03T20:46:51.584103] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T20:46:51.774569] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T20:46:51.777209] [INFO ] [REMOTE ] OSK: Full fetch complete (61333 records). [2025-10-03T20:46:51.777350] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-03T20:46:52.001450] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-03T20:46:52.004537] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:46:52.006701] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:46:52.006869] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:46:52.006950] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-03T20:46:52.007028] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-03T20:46:52.007069] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-03T20:46:52.007113] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-03T20:46:52.007190] [INFO ] [MAIN ] Update Progress: 1612/2370 symbols completed. OSK took 31.8s. Estimated remaining: 1h 46m 39s. Rate: 7.1 symbols/min [2025-10-03T20:46:52.202227] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:46:52.255630] [DEBUG] [LOCAL ] OVV: Loaded 53905 existing records from primary storage. [2025-10-03T20:46:52.256024] [INFO ] [MAIN ] OVV: Loaded 53905 existing records. [2025-10-03T20:46:52.450571] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:46:52.450878] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-03T20:46:52.450941] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-03T20:46:52.451217] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-03T20:46:52.451279] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-03T20:46:52.806602] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-03T20:46:52.851299] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:46:53.590713] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-03T20:46:53.961883] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-03T20:46:54.008748] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T20:46:54.390676] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-03T20:46:54.572020] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:46:55.190724] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-03T20:46:55.485230] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T20:46:55.990709] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-03T20:46:56.312306] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T20:46:56.790712] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-03T20:46:57.590742] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-03T20:46:57.722899] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T20:46:57.796820] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-03T20:46:58.390684] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-03T20:46:58.580720] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T20:46:59.070419] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T20:46:59.073461] [INFO ] [REMOTE ] OTIS: Full fetch complete (75942 records). [2025-10-03T20:46:59.073580] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-03T20:46:59.195758] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-03T20:46:59.511833] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-03T20:46:59.511924] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-03T20:46:59.513171] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-03T20:46:59.513252] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-03T20:46:59.515036] [DEBUG] [LOCAL ] OTIS: Trimmed 75942 records to 53475 (keeping 200 days of data) [2025-10-03T20:46:59.862338] [DEBUG] [LOCAL ] OTIS: Primary data saved (53475 records). [2025-10-03T20:46:59.862488] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-03T20:46:59.862610] [INFO ] [MAIN ] Update Progress: 1613/2370 symbols completed. OTIS took 29.9s. Estimated remaining: 1h 46m 30s. Rate: 7.1 symbols/min [2025-10-03T20:46:59.994490] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-03T20:47:00.071389] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:00.127889] [DEBUG] [LOCAL ] OWL: Loaded 53945 existing records from primary storage. [2025-10-03T20:47:00.128258] [INFO ] [MAIN ] OWL: Loaded 53945 existing records. [2025-10-03T20:47:00.342375] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:00.342619] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-03T20:47:00.342830] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-03T20:47:00.343103] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-03T20:47:00.343174] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-03T20:47:00.587496] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-03T20:47:00.804176] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-03T20:47:00.847724] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:01.215853] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-03T20:47:01.218851] [INFO ] [REMOTE ] OSCR: Full fetch complete (77500 records). [2025-10-03T20:47:01.219005] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-03T20:47:01.598686] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-03T20:47:01.672032] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-03T20:47:01.672194] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-03T20:47:01.673592] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-03T20:47:01.673754] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-03T20:47:01.675782] [DEBUG] [LOCAL ] OSCR: Trimmed 77500 records to 54502 (keeping 200 days of data) [2025-10-03T20:47:01.804139] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T20:47:02.070240] [DEBUG] [LOCAL ] OSCR: Primary data saved (54502 records). [2025-10-03T20:47:02.070397] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-03T20:47:02.071061] [INFO ] [MAIN ] Update Progress: 1614/2370 symbols completed. OSCR took 45.9s. Estimated remaining: 1h 46m 18s. Rate: 7.1 symbols/min [2025-10-03T20:47:02.260609] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:02.272769] [DEBUG] [LOCAL ] OWLT: Loaded 8861 existing records from primary storage. [2025-10-03T20:47:02.273041] [INFO ] [MAIN ] OWLT: Loaded 8861 existing records. [2025-10-03T20:47:02.394747] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-03T20:47:02.470819] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:02.471286] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-03T20:47:02.471391] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-03T20:47:02.471750] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-03T20:47:02.471814] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-03T20:47:02.872811] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:02.910289] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T20:47:03.190698] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-03T20:47:03.568917] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T20:47:03.745721] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T20:47:03.990707] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-03T20:47:03.998812] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T20:47:04.790706] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-03T20:47:05.590700] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-03T20:47:05.911857] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T20:47:06.221581] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T20:47:06.390701] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-03T20:47:07.142308] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T20:47:07.190678] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-03T20:47:07.490710] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T20:47:07.887297] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T20:47:07.990691] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-03T20:47:08.790736] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-03T20:47:09.590718] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-03T20:47:09.769140] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T20:47:10.313123] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T20:47:10.390682] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-03T20:47:11.190683] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-03T20:47:11.501785] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:47:11.990712] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-03T20:47:12.196048] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T20:47:12.790681] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-03T20:47:12.863480] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T20:47:12.896426] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T20:47:13.590685] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-03T20:47:14.297960] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T20:47:14.390688] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-03T20:47:14.483615] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T20:47:15.138025] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T20:47:15.190674] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-03T20:47:15.990624] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-03T20:47:16.143798] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T20:47:16.790672] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-03T20:47:17.590705] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-03T20:47:17.701287] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T20:47:17.952909] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T20:47:18.390702] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-03T20:47:19.190673] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-03T20:47:19.587017] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T20:47:19.589679] [INFO ] [REMOTE ] OUT: Full fetch complete (69057 records). [2025-10-03T20:47:19.589806] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-03T20:47:19.759625] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T20:47:19.995731] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-03T20:47:20.081102] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-03T20:47:20.081193] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-03T20:47:20.082257] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-03T20:47:20.082326] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-03T20:47:20.083820] [DEBUG] [LOCAL ] OUT: Trimmed 69057 records to 48517 (keeping 200 days of data) [2025-10-03T20:47:20.204951] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T20:47:20.421439] [DEBUG] [LOCAL ] OUT: Primary data saved (48517 records). [2025-10-03T20:47:20.421612] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-03T20:47:20.421781] [INFO ] [MAIN ] Update Progress: 1615/2370 symbols completed. OUT took 45.9s. Estimated remaining: 1h 46m 15s. Rate: 7.1 symbols/min [2025-10-03T20:47:20.619991] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:20.653820] [DEBUG] [LOCAL ] OXM: Loaded 33490 existing records from primary storage. [2025-10-03T20:47:20.654116] [INFO ] [MAIN ] OXM: Loaded 33490 existing records. [2025-10-03T20:47:20.805486] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-03T20:47:20.850175] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:20.851080] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-03T20:47:20.851132] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-03T20:47:20.851422] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-03T20:47:20.851491] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-03T20:47:21.249090] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:21.590696] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-03T20:47:22.077838] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T20:47:22.390696] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-03T20:47:22.439131] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T20:47:22.873198] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T20:47:23.190677] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-03T20:47:23.875996] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T20:47:23.990715] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-03T20:47:24.688695] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T20:47:24.689819] [INFO ] [REMOTE ] OWLT: Full fetch complete (11685 records). [2025-10-03T20:47:24.689896] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-03T20:47:24.800964] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-03T20:47:25.094469] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-03T20:47:25.094686] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-03T20:47:25.095077] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-03T20:47:25.095237] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-03T20:47:25.096414] [DEBUG] [LOCAL ] OWLT: Trimmed 11685 records to 8992 (keeping 200 days of data) [2025-10-03T20:47:25.180692] [DEBUG] [LOCAL ] OWLT: Primary data saved (8992 records). [2025-10-03T20:47:25.183460] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-03T20:47:25.183344] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T20:47:25.183730] [INFO ] [MAIN ] Update Progress: 1616/2370 symbols completed. OWLT took 23.1s. Estimated remaining: 1h 46m 5s. Rate: 7.1 symbols/min [2025-10-03T20:47:25.374832] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:25.375058] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-03T20:47:25.375115] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-03T20:47:25.375240] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-03T20:47:25.375286] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-03T20:47:25.375326] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-03T20:47:25.375359] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-03T20:47:25.595819] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-03T20:47:25.752750] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:26.390695] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-03T20:47:26.504031] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T20:47:26.963976] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T20:47:27.190684] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-03T20:47:27.942983] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T20:47:27.946962] [INFO ] [REMOTE ] OVV: Full fetch complete (77320 records). [2025-10-03T20:47:27.947114] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-03T20:47:27.998794] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-03T20:47:28.373151] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-03T20:47:28.373263] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-03T20:47:28.374538] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-03T20:47:28.374715] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-03T20:47:28.376462] [DEBUG] [LOCAL ] OVV: Trimmed 77320 records to 54295 (keeping 200 days of data) [2025-10-03T20:47:28.574302] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T20:47:28.739542] [DEBUG] [LOCAL ] OVV: Primary data saved (54295 records). [2025-10-03T20:47:28.739748] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-03T20:47:28.739858] [INFO ] [MAIN ] Update Progress: 1617/2370 symbols completed. OVV took 36.7s. Estimated remaining: 1h 45m 54s. Rate: 7.1 symbols/min [2025-10-03T20:47:28.798754] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-03T20:47:28.930144] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:28.985842] [DEBUG] [LOCAL ] PAAS: Loaded 53994 existing records from primary storage. [2025-10-03T20:47:28.986189] [INFO ] [MAIN ] PAAS: Loaded 53994 existing records. [2025-10-03T20:47:29.188589] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:29.188859] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-03T20:47:29.188910] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-03T20:47:29.189465] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-03T20:47:29.189526] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-03T20:47:29.577837] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:29.590617] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-03T20:47:30.390671] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-03T20:47:30.736301] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-03T20:47:30.778765] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T20:47:31.190699] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-03T20:47:31.832622] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T20:47:31.911824] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T20:47:31.990690] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-03T20:47:32.790721] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-03T20:47:33.266691] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T20:47:33.563337] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T20:47:33.590617] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-03T20:47:34.390735] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-03T20:47:35.048828] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T20:47:35.092621] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T20:47:35.190683] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-03T20:47:35.972108] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T20:47:35.990616] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-03T20:47:36.765453] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T20:47:36.790635] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-03T20:47:37.590632] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-03T20:47:37.873599] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-03T20:47:38.363838] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T20:47:38.390694] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-03T20:47:39.190687] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-03T20:47:39.990673] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-03T20:47:40.185726] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-03T20:47:40.576292] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T20:47:40.609571] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T20:47:40.790710] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-03T20:47:41.480386] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T20:47:41.590709] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-03T20:47:42.390718] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-03T20:47:43.190701] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-03T20:47:43.297085] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T20:47:43.806723] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T20:47:43.990631] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-03T20:47:44.060512] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T20:47:44.063581] [INFO ] [REMOTE ] OWL: Full fetch complete (77530 records). [2025-10-03T20:47:44.063778] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-03T20:47:44.521868] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-03T20:47:44.522037] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-03T20:47:44.523165] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-03T20:47:44.523234] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-03T20:47:44.524822] [DEBUG] [LOCAL ] OWL: Trimmed 77530 records to 54335 (keeping 200 days of data) [2025-10-03T20:47:44.771124] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T20:47:44.790808] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-03T20:47:44.897988] [DEBUG] [LOCAL ] OWL: Primary data saved (54335 records). [2025-10-03T20:47:44.898150] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-03T20:47:44.898257] [INFO ] [MAIN ] Update Progress: 1618/2370 symbols completed. OWL took 45.0s. Estimated remaining: 1h 45m 49s. Rate: 7.1 symbols/min [2025-10-03T20:47:45.081227] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:45.095208] [DEBUG] [LOCAL ] PAC: Loaded 11658 existing records from primary storage. [2025-10-03T20:47:45.095463] [INFO ] [MAIN ] PAC: Loaded 11658 existing records. [2025-10-03T20:47:45.295266] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:45.295505] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-03T20:47:45.295554] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-03T20:47:45.295816] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-03T20:47:45.295877] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-03T20:47:45.595877] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-03T20:47:45.697445] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:45.960064] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T20:47:45.958368] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T20:47:45.974387] [INFO ] [REMOTE ] OXM: Full fetch complete (46019 records). [2025-10-03T20:47:45.974581] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-03T20:47:46.391488] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-03T20:47:46.391162] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-03T20:47:46.391729] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-03T20:47:46.393043] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-03T20:47:46.394054] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-03T20:47:46.395475] [DEBUG] [LOCAL ] OXM: Trimmed 46019 records to 33720 (keeping 200 days of data) [2025-10-03T20:47:46.618666] [DEBUG] [LOCAL ] OXM: Primary data saved (33720 records). [2025-10-03T20:47:46.618827] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-03T20:47:46.618918] [INFO ] [MAIN ] Update Progress: 1619/2370 symbols completed. OXM took 26.2s. Estimated remaining: 1h 45m 37s. Rate: 7.1 symbols/min [2025-10-03T20:47:46.801914] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:47:46.836334] [DEBUG] [LOCAL ] PACK: Loaded 32109 existing records from primary storage. [2025-10-03T20:47:46.836636] [INFO ] [MAIN ] PACK: Loaded 32109 existing records. [2025-10-03T20:47:47.034010] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:47:47.034223] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-03T20:47:47.034275] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-03T20:47:47.034548] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-03T20:47:47.034617] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-03T20:47:47.205955] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-03T20:47:47.373443] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T20:47:47.453145] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:47:47.990686] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-03T20:47:48.255199] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-03T20:47:48.790673] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-03T20:47:48.963219] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T20:47:49.090065] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T20:47:49.590736] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-03T20:47:50.390690] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-03T20:47:50.461186] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T20:47:51.094516] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-03T20:47:51.190678] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-03T20:47:51.618118] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T20:47:51.990712] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-03T20:47:52.790719] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-03T20:47:53.590671] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-03T20:47:53.697488] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-03T20:47:53.771867] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T20:47:54.102961] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T20:47:54.390625] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-03T20:47:54.765314] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T20:47:55.190688] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-03T20:47:55.990701] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-03T20:47:56.319676] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T20:47:56.355842] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:47:56.790717] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-03T20:47:56.991792] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T20:47:57.590694] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-03T20:47:58.390714] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-03T20:47:59.190685] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-03T20:47:59.395514] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T20:47:59.486077] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-03T20:47:59.802984] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-03T20:47:59.990705] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-03T20:48:00.688903] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T20:48:00.790695] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-03T20:48:01.590711] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-03T20:48:01.887332] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T20:48:01.897271] [INFO ] [REMOTE ] PAAS: Full fetch complete (77404 records). [2025-10-03T20:48:01.909850] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-03T20:48:01.911352] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T20:48:02.351746] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-03T20:48:02.351849] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-03T20:48:02.353097] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-03T20:48:02.353172] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-03T20:48:02.354952] [DEBUG] [LOCAL ] PAAS: Trimmed 77404 records to 54384 (keeping 200 days of data) [2025-10-03T20:48:02.416728] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-03T20:48:02.722078] [DEBUG] [LOCAL ] PAAS: Primary data saved (54384 records). [2025-10-03T20:48:02.722277] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-03T20:48:02.722398] [INFO ] [MAIN ] Update Progress: 1620/2370 symbols completed. PAAS took 34.0s. Estimated remaining: 1h 45m 32s. Rate: 7.1 symbols/min [2025-10-03T20:48:02.907249] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:02.942321] [DEBUG] [LOCAL ] PACS: Loaded 34614 existing records from primary storage. [2025-10-03T20:48:02.942601] [INFO ] [MAIN ] PACS: Loaded 34614 existing records. [2025-10-03T20:48:03.131438] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:03.131754] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-03T20:48:03.131810] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-03T20:48:03.132277] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-03T20:48:03.132336] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-03T20:48:03.202464] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-03T20:48:03.528760] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:48:03.535404] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:03.748941] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T20:48:03.990692] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-03T20:48:04.769095] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T20:48:04.790615] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-03T20:48:05.590686] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-03T20:48:06.007423] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T20:48:06.390810] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-03T20:48:06.456561] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T20:48:06.981780] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T20:48:07.190726] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-03T20:48:07.364219] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T20:48:07.990703] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-03T20:48:08.697397] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T20:48:08.790714] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-03T20:48:09.523304] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:48:09.590718] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-03T20:48:10.390694] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-03T20:48:10.911380] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-03T20:48:10.914126] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-10-03T20:48:10.914251] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-03T20:48:11.130354] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T20:48:11.149546] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:48:11.152201] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:48:11.152354] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-03T20:48:11.153075] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-03T20:48:11.153827] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T20:48:11.154051] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-03T20:48:11.162214] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-03T20:48:11.162747] [INFO ] [MAIN ] Update Progress: 1621/2370 symbols completed. OXY took 46.0s. Estimated remaining: 1h 45m 24s. Rate: 7.1 symbols/min [2025-10-03T20:48:11.196947] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-03T20:48:11.352009] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:11.375942] [DEBUG] [LOCAL ] PAG: Loaded 21862 existing records from primary storage. [2025-10-03T20:48:11.376204] [INFO ] [MAIN ] PAG: Loaded 21862 existing records. [2025-10-03T20:48:11.568351] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:11.568559] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-03T20:48:11.568608] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-03T20:48:11.569132] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-03T20:48:11.569192] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-03T20:48:11.960659] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:11.982988] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T20:48:11.990604] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-03T20:48:12.800876] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-03T20:48:12.807579] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T20:48:13.428999] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T20:48:13.590686] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-03T20:48:13.920595] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:48:14.390706] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-03T20:48:15.142580] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T20:48:15.190675] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-03T20:48:15.527070] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T20:48:15.529437] [INFO ] [REMOTE ] PACK: Full fetch complete (44226 records). [2025-10-03T20:48:15.529551] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-03T20:48:15.954773] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-03T20:48:15.954889] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-03T20:48:15.955928] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-03T20:48:15.955995] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-03T20:48:15.959249] [DEBUG] [LOCAL ] PACK: Trimmed 44226 records to 32354 (keeping 200 days of data) [2025-10-03T20:48:16.009561] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-03T20:48:16.154690] [DEBUG] [LOCAL ] PACK: Primary data saved (32354 records). [2025-10-03T20:48:16.154853] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-03T20:48:16.154972] [INFO ] [MAIN ] Update Progress: 1622/2370 symbols completed. PACK took 29.5s. Estimated remaining: 1h 45m 14s. Rate: 7.1 symbols/min [2025-10-03T20:48:16.369591] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:16.428676] [DEBUG] [LOCAL ] PAGS: Loaded 53105 existing records from primary storage. [2025-10-03T20:48:16.429109] [INFO ] [MAIN ] PAGS: Loaded 53105 existing records. [2025-10-03T20:48:16.572600] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T20:48:16.667513] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:16.667782] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-03T20:48:16.667834] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-03T20:48:16.668077] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-03T20:48:16.668135] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-03T20:48:16.795812] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-03T20:48:16.993871] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T20:48:17.084506] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:17.590709] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-03T20:48:18.023282] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T20:48:18.193369] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T20:48:18.390679] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-03T20:48:19.190712] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-03T20:48:19.990703] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-03T20:48:20.284254] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T20:48:20.726844] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T20:48:20.728063] [INFO ] [REMOTE ] PAC: Full fetch complete (16528 records). [2025-10-03T20:48:20.728142] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-03T20:48:20.795843] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-03T20:48:20.881832] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T20:48:21.206545] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-03T20:48:21.206629] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-03T20:48:21.207071] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-03T20:48:21.207122] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-03T20:48:21.207959] [DEBUG] [LOCAL ] PAC: Trimmed 16528 records to 11760 (keeping 200 days of data) [2025-10-03T20:48:21.282151] [DEBUG] [LOCAL ] PAC: Primary data saved (11760 records). [2025-10-03T20:48:21.282313] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-03T20:48:21.282444] [INFO ] [MAIN ] Update Progress: 1623/2370 symbols completed. PAC took 36.4s. Estimated remaining: 1h 45m 4s. Rate: 7.1 symbols/min [2025-10-03T20:48:21.459360] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:21.465486] [DEBUG] [LOCAL ] PAI: Loaded 2695 existing records from primary storage. [2025-10-03T20:48:21.465708] [INFO ] [MAIN ] PAI: Loaded 2695 existing records. [2025-10-03T20:48:21.595862] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-03T20:48:21.653095] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:21.653310] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-03T20:48:21.653358] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-03T20:48:21.653550] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-03T20:48:21.653609] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-03T20:48:22.023102] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:22.040676] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T20:48:22.390701] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-03T20:48:23.190719] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-03T20:48:23.412504] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T20:48:23.584004] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T20:48:23.629833] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-03T20:48:23.990729] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-03T20:48:24.752172] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T20:48:24.790670] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-03T20:48:25.590729] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-03T20:48:26.211529] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T20:48:26.284415] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T20:48:26.390702] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-03T20:48:27.190696] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-03T20:48:27.797499] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T20:48:27.990716] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-03T20:48:28.790733] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-03T20:48:29.021875] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T20:48:29.069928] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:48:29.590712] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-03T20:48:30.183382] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T20:48:30.202843] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T20:48:30.390722] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-03T20:48:31.016752] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T20:48:31.190689] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-03T20:48:31.990728] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-03T20:48:32.632725] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T20:48:32.790671] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-03T20:48:33.045472] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T20:48:33.577126] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T20:48:33.590635] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-03T20:48:34.390722] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-03T20:48:35.041528] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T20:48:35.091015] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T20:48:35.190732] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-03T20:48:35.990712] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-03T20:48:36.464387] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T20:48:36.466616] [INFO ] [REMOTE ] PACS: Full fetch complete (50735 records). [2025-10-03T20:48:36.466805] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-03T20:48:36.795839] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-03T20:48:36.892874] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-03T20:48:36.892971] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-03T20:48:36.894343] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-03T20:48:36.894419] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-03T20:48:36.895919] [DEBUG] [LOCAL ] PACS: Trimmed 50735 records to 34910 (keeping 200 days of data) [2025-10-03T20:48:37.120795] [DEBUG] [LOCAL ] PACS: Primary data saved (34910 records). [2025-10-03T20:48:37.120953] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-03T20:48:37.121085] [INFO ] [MAIN ] Update Progress: 1624/2370 symbols completed. PACS took 34.4s. Estimated remaining: 1h 44m 59s. Rate: 7.1 symbols/min [2025-10-03T20:48:37.252892] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T20:48:37.312375] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T20:48:37.340288] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:37.340456] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-03T20:48:37.340513] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-03T20:48:37.340626] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-03T20:48:37.340703] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-03T20:48:37.340763] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-03T20:48:37.340836] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-03T20:48:37.595972] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-03T20:48:37.741171] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:38.318760] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T20:48:38.390734] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-03T20:48:39.190730] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-03T20:48:39.699770] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T20:48:39.990706] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-03T20:48:40.270076] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:48:40.270397] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-03T20:48:40.270490] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:48:40.270548] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-03T20:48:40.270623] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:48:40.270718] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-03T20:48:40.270783] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-03T20:48:40.270819] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-03T20:48:40.270889] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-03T20:48:40.270972] [INFO ] [MAIN ] Update Progress: 1625/2370 symbols completed. PAII took 3.1s. Estimated remaining: 1h 44m 48s. Rate: 7.1 symbols/min [2025-10-03T20:48:40.466207] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:40.496098] [DEBUG] [LOCAL ] PAM: Loaded 28448 existing records from primary storage. [2025-10-03T20:48:40.496377] [INFO ] [MAIN ] PAM: Loaded 28448 existing records. [2025-10-03T20:48:40.709295] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:40.710229] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-03T20:48:40.710316] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-03T20:48:40.710622] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-03T20:48:40.710707] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-03T20:48:40.795753] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-03T20:48:41.102762] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:41.210811] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T20:48:41.590743] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-03T20:48:41.903199] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T20:48:42.390731] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-03T20:48:43.064559] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T20:48:43.106002] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T20:48:43.190687] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-03T20:48:43.660384] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T20:48:43.661131] [INFO ] [REMOTE ] PAI: Full fetch complete (4054 records). [2025-10-03T20:48:43.661253] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-03T20:48:43.995772] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-03T20:48:44.059831] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-03T20:48:44.059910] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-03T20:48:44.060052] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-03T20:48:44.060093] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-03T20:48:44.060466] [DEBUG] [LOCAL ] PAI: Trimmed 4054 records to 2707 (keeping 200 days of data) [2025-10-03T20:48:44.078820] [DEBUG] [LOCAL ] PAI: Primary data saved (2707 records). [2025-10-03T20:48:44.078912] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-03T20:48:44.078989] [INFO ] [MAIN ] Update Progress: 1626/2370 symbols completed. PAI took 22.8s. Estimated remaining: 1h 44m 38s. Rate: 7.1 symbols/min [2025-10-03T20:48:44.269890] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:44.310555] [DEBUG] [LOCAL ] PAR: Loaded 33104 existing records from primary storage. [2025-10-03T20:48:44.310874] [INFO ] [MAIN ] PAR: Loaded 33104 existing records. [2025-10-03T20:48:44.511807] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:44.512079] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-03T20:48:44.512144] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-03T20:48:44.512553] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-03T20:48:44.512612] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-03T20:48:44.795966] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-03T20:48:44.918123] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T20:48:44.934005] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:44.934776] [INFO ] [REMOTE ] PAG: Full fetch complete (30345 records). [2025-10-03T20:48:44.935018] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-03T20:48:45.352132] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-03T20:48:45.352250] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-03T20:48:45.352973] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-03T20:48:45.353037] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-03T20:48:45.354052] [DEBUG] [LOCAL ] PAG: Trimmed 30345 records to 21976 (keeping 200 days of data) [2025-10-03T20:48:45.499890] [DEBUG] [LOCAL ] PAG: Primary data saved (21976 records). [2025-10-03T20:48:45.500020] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-03T20:48:45.500105] [INFO ] [MAIN ] Update Progress: 1627/2370 symbols completed. PAG took 34.3s. Estimated remaining: 1h 44m 26s. Rate: 7.1 symbols/min [2025-10-03T20:48:45.595902] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-03T20:48:45.682199] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:48:45.732618] [DEBUG] [LOCAL ] PARR: Loaded 48667 existing records from primary storage. [2025-10-03T20:48:45.733053] [INFO ] [MAIN ] PARR: Loaded 48667 existing records. [2025-10-03T20:48:45.931883] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:48:45.932158] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-03T20:48:45.932205] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-03T20:48:45.932448] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-03T20:48:45.932510] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-03T20:48:46.332954] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:48:46.355864] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T20:48:46.390685] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-03T20:48:47.190742] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-03T20:48:47.594764] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-03T20:48:47.807787] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T20:48:47.990706] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-03T20:48:48.184724] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T20:48:48.790716] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-03T20:48:49.205489] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T20:48:49.590703] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-03T20:48:50.390703] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-03T20:48:50.523587] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T20:48:51.000091] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T20:48:51.190701] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-03T20:48:51.818674] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T20:48:51.990666] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-03T20:48:52.790708] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-03T20:48:53.037860] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T20:48:53.386376] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T20:48:53.590694] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-03T20:48:54.390618] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-03T20:48:54.499151] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T20:48:55.175356] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:48:55.190605] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-03T20:48:55.990713] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-03T20:48:56.321273] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T20:48:56.720411] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T20:48:56.790722] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-03T20:48:57.373027] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T20:48:57.590702] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-03T20:48:58.390711] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-03T20:48:58.789665] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T20:48:58.974286] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T20:48:59.190761] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-03T20:48:59.372241] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T20:48:59.990742] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-03T20:49:00.790717] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-03T20:49:01.003145] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T20:49:01.073360] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T20:49:01.590725] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-03T20:49:02.390709] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-03T20:49:02.569863] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T20:49:03.151945] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T20:49:03.190666] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-03T20:49:03.990618] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-03T20:49:04.039450] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T20:49:04.730017] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T20:49:04.790703] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-03T20:49:05.510724] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T20:49:05.513595] [INFO ] [REMOTE ] PAGS: Full fetch complete (76335 records). [2025-10-03T20:49:05.513766] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-03T20:49:05.596443] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-03T20:49:05.947826] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-03T20:49:05.947910] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-03T20:49:05.948994] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-03T20:49:05.949060] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-03T20:49:05.950519] [DEBUG] [LOCAL ] PAGS: Trimmed 76335 records to 53489 (keeping 200 days of data) [2025-10-03T20:49:06.271052] [DEBUG] [LOCAL ] PAGS: Primary data saved (53489 records). [2025-10-03T20:49:06.271202] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-03T20:49:06.271286] [INFO ] [MAIN ] Update Progress: 1628/2370 symbols completed. PAGS took 50.1s. Estimated remaining: 1h 44m 23s. Rate: 7.1 symbols/min [2025-10-03T20:49:06.395752] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-03T20:49:06.462586] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:06.517623] [DEBUG] [LOCAL ] PATH: Loaded 54067 existing records from primary storage. [2025-10-03T20:49:06.518032] [INFO ] [MAIN ] PATH: Loaded 54067 existing records. [2025-10-03T20:49:06.726884] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:06.727264] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-03T20:49:06.727346] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-03T20:49:06.727835] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-03T20:49:06.727931] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-03T20:49:06.844994] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T20:49:07.157209] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:07.180992] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T20:49:07.190614] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-03T20:49:07.942839] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T20:49:07.990619] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-03T20:49:08.268545] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T20:49:08.270902] [INFO ] [REMOTE ] PAM: Full fetch complete (42087 records). [2025-10-03T20:49:08.271009] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-03T20:49:08.691859] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-03T20:49:08.692000] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-03T20:49:08.693012] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-03T20:49:08.693088] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-03T20:49:08.694439] [DEBUG] [LOCAL ] PAM: Trimmed 42087 records to 28652 (keeping 200 days of data) [2025-10-03T20:49:08.790628] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-03T20:49:08.870561] [DEBUG] [LOCAL ] PAM: Primary data saved (28652 records). [2025-10-03T20:49:08.870725] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-03T20:49:08.870821] [INFO ] [MAIN ] Update Progress: 1629/2370 symbols completed. PAM took 28.6s. Estimated remaining: 1h 44m 12s. Rate: 7.1 symbols/min [2025-10-03T20:49:09.060666] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:09.082560] [DEBUG] [LOCAL ] PAXS: Loaded 20955 existing records from primary storage. [2025-10-03T20:49:09.082872] [INFO ] [MAIN ] PAXS: Loaded 20955 existing records. [2025-10-03T20:49:09.282955] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:09.283546] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-03T20:49:09.283604] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-03T20:49:09.283981] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-03T20:49:09.284042] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-03T20:49:09.603722] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-03T20:49:09.698100] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:09.732491] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T20:49:10.112814] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T20:49:10.390706] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-03T20:49:11.190692] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-03T20:49:11.941442] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T20:49:11.990625] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-03T20:49:12.058707] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T20:49:12.497320] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T20:49:12.790691] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-03T20:49:13.590634] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-03T20:49:13.932832] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:49:14.390629] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-03T20:49:14.426471] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-03T20:49:15.190632] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-03T20:49:15.275347] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T20:49:15.541451] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T20:49:15.990669] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-03T20:49:16.606707] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:49:16.609053] [INFO ] [REMOTE ] PAR: Full fetch complete (48077 records). [2025-10-03T20:49:16.609165] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-03T20:49:16.794701] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-03T20:49:17.026242] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-03T20:49:17.026540] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-03T20:49:17.027834] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-03T20:49:17.027921] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-03T20:49:17.029382] [DEBUG] [LOCAL ] PAR: Trimmed 48077 records to 33393 (keeping 200 days of data) [2025-10-03T20:49:17.251834] [DEBUG] [LOCAL ] PAR: Primary data saved (33393 records). [2025-10-03T20:49:17.251991] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-03T20:49:17.252155] [INFO ] [MAIN ] Update Progress: 1630/2370 symbols completed. PAR took 33.2s. Estimated remaining: 1h 44m 4s. Rate: 7.1 symbols/min [2025-10-03T20:49:17.447227] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:17.484531] [DEBUG] [LOCAL ] PAY: Loaded 38293 existing records from primary storage. [2025-10-03T20:49:17.484923] [INFO ] [MAIN ] PAY: Loaded 38293 existing records. [2025-10-03T20:49:17.595813] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-03T20:49:17.683181] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:17.683458] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-03T20:49:17.683525] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-03T20:49:17.683825] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-03T20:49:17.683882] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-03T20:49:18.095397] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:18.134676] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T20:49:18.309281] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-03T20:49:18.390719] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-03T20:49:19.190622] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-03T20:49:19.316192] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T20:49:19.990709] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-03T20:49:20.098299] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T20:49:20.547790] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T20:49:20.790698] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-03T20:49:21.157296] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T20:49:21.590735] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-03T20:49:22.390733] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-03T20:49:22.846978] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T20:49:23.030801] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T20:49:23.190695] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-03T20:49:23.990683] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-03T20:49:24.108956] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T20:49:24.302971] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:49:24.790726] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-03T20:49:25.113033] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T20:49:25.590719] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-03T20:49:26.157340] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T20:49:26.390692] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-03T20:49:27.190668] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-03T20:49:27.460891] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T20:49:27.987468] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-03T20:49:27.998599] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-03T20:49:28.542015] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T20:49:28.790634] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-03T20:49:29.176259] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T20:49:29.590697] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-03T20:49:29.939630] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T20:49:29.942348] [INFO ] [REMOTE ] PARR: Full fetch complete (69014 records). [2025-10-03T20:49:29.942462] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-03T20:49:30.357275] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-03T20:49:30.360478] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-03T20:49:30.360677] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T20:49:30.361862] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-03T20:49:30.363112] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-03T20:49:30.363591] [INFO ] [REMOTE ] PAXS: Full fetch complete (30813 records). [2025-10-03T20:49:30.364012] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-03T20:49:30.396803] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-03T20:49:30.435490] [DEBUG] [LOCAL ] PARR: Trimmed 69014 records to 49031 (keeping 200 days of data) [2025-10-03T20:49:30.870841] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-03T20:49:30.872958] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-03T20:49:30.873974] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-03T20:49:30.874058] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-03T20:49:30.877077] [DEBUG] [LOCAL ] PAXS: Trimmed 30813 records to 21046 (keeping 200 days of data) [2025-10-03T20:49:31.151507] [DEBUG] [LOCAL ] PAXS: Primary data saved (21046 records). [2025-10-03T20:49:31.155171] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-03T20:49:31.155295] [INFO ] [MAIN ] Update Progress: 1631/2370 symbols completed. PAXS took 22.3s. Estimated remaining: 1h 43m 58s. Rate: 7.1 symbols/min [2025-10-03T20:49:31.205347] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-03T20:49:31.397194] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:31.408108] [DEBUG] [LOCAL ] PARR: Primary data saved (49031 records). [2025-10-03T20:49:31.408253] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-03T20:49:31.408369] [INFO ] [MAIN ] Update Progress: 1632/2370 symbols completed. PARR took 45.9s. Estimated remaining: 1h 43m 45s. Rate: 7.1 symbols/min [2025-10-03T20:49:31.624374] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:31.627136] [DEBUG] [LOCAL ] PAYC: Loaded 36666 existing records from primary storage. [2025-10-03T20:49:31.627569] [INFO ] [MAIN ] PAYC: Loaded 36666 existing records. [2025-10-03T20:49:31.833946] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:31.834217] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-03T20:49:31.834268] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-03T20:49:31.834611] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-10-03T20:49:31.834736] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-03T20:49:31.957920] [DEBUG] [LOCAL ] PB: Loaded 41835 existing records from primary storage. [2025-10-03T20:49:31.969269] [INFO ] [MAIN ] PB: Loaded 41835 existing records. [2025-10-03T20:49:32.397367] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:32.435882] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-03T20:49:32.448017] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-03T20:49:32.458366] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-03T20:49:32.458559] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-03T20:49:32.483594] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:32.489389] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-03T20:49:32.851952] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T20:49:32.901357] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-03T20:49:32.948026] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:32.981852] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-03T20:49:33.590706] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-03T20:49:34.136836] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:49:34.390716] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-03T20:49:34.583637] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T20:49:35.190700] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-03T20:49:35.821501] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T20:49:35.876257] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T20:49:35.990731] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-03T20:49:36.210451] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T20:49:36.790711] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-03T20:49:37.517241] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T20:49:37.590710] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-03T20:49:38.390728] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-03T20:49:38.468348] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T20:49:39.190750] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-03T20:49:39.967250] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-03T20:49:39.990619] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-03T20:49:40.082151] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T20:49:40.795898] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-03T20:49:40.814062] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T20:49:41.590700] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-03T20:49:42.279864] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-03T20:49:42.313193] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T20:49:42.390705] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-03T20:49:42.956942] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T20:49:43.190695] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-03T20:49:43.990697] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-03T20:49:44.023981] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T20:49:44.790720] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-03T20:49:45.381603] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-03T20:49:45.384485] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-10-03T20:49:45.384597] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-03T20:49:45.593331] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-03T20:49:45.878115] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T20:49:45.878313] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-03T20:49:45.886587] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-03T20:49:45.888010] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-03T20:49:45.888442] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-03T20:49:45.889890] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 54457 (keeping 200 days of data) [2025-10-03T20:49:46.239510] [DEBUG] [LOCAL ] PATH: Primary data saved (54457 records). [2025-10-03T20:49:46.239730] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-03T20:49:46.239844] [INFO ] [MAIN ] Update Progress: 1633/2370 symbols completed. PATH took 40.0s. Estimated remaining: 1h 43m 40s. Rate: 7.1 symbols/min [2025-10-03T20:49:46.406517] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-03T20:49:46.435625] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:46.462010] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T20:49:46.512897] [DEBUG] [LOCAL ] PBA: Loaded 49243 existing records from primary storage. [2025-10-03T20:49:46.513219] [INFO ] [MAIN ] PBA: Loaded 49243 existing records. [2025-10-03T20:49:46.710569] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:46.710834] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-03T20:49:46.710892] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-03T20:49:46.711137] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-03T20:49:46.711197] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-03T20:49:47.124836] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:47.190628] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-03T20:49:47.325429] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T20:49:47.990703] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-03T20:49:48.168013] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T20:49:48.790753] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-03T20:49:48.963161] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T20:49:49.573599] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:49:49.590615] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-03T20:49:50.312457] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T20:49:50.390707] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-03T20:49:51.195822] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-03T20:49:51.212799] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T20:49:51.990742] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-03T20:49:52.210877] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T20:49:52.774901] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:49:52.790606] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-03T20:49:53.200492] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T20:49:53.590706] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-03T20:49:54.252820] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T20:49:54.390740] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-03T20:49:54.790210] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T20:49:55.190699] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-03T20:49:55.990639] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-03T20:49:56.059079] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T20:49:56.753029] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T20:49:56.790636] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-03T20:49:57.398994] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:49:57.590736] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-03T20:49:57.810482] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T20:49:57.812935] [INFO ] [REMOTE ] PAYC: Full fetch complete (53107 records). [2025-10-03T20:49:57.813034] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-03T20:49:58.223801] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-03T20:49:58.223892] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-03T20:49:58.224822] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-03T20:49:58.224923] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-03T20:49:58.226242] [DEBUG] [LOCAL ] PAYC: Trimmed 53107 records to 36933 (keeping 200 days of data) [2025-10-03T20:49:58.402165] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-03T20:49:58.469059] [DEBUG] [LOCAL ] PAYC: Primary data saved (36933 records). [2025-10-03T20:49:58.469199] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-03T20:49:58.469316] [INFO ] [MAIN ] Update Progress: 1634/2370 symbols completed. PAYC took 27.3s. Estimated remaining: 1h 43m 33s. Rate: 7.1 symbols/min [2025-10-03T20:49:58.659509] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:49:58.718023] [DEBUG] [LOCAL ] PBF: Loaded 53502 existing records from primary storage. [2025-10-03T20:49:58.718578] [INFO ] [MAIN ] PBF: Loaded 53502 existing records. [2025-10-03T20:49:58.926840] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:49:58.927083] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-03T20:49:58.927134] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-03T20:49:58.927345] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-03T20:49:58.927407] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-03T20:49:59.194510] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-03T20:49:59.337958] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:49:59.364068] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T20:49:59.546482] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T20:49:59.548821] [INFO ] [REMOTE ] PAY: Full fetch complete (53448 records). [2025-10-03T20:49:59.548958] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-03T20:49:59.978962] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-03T20:49:59.979049] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-03T20:49:59.980078] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-03T20:49:59.980157] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-03T20:49:59.981430] [DEBUG] [LOCAL ] PAY: Trimmed 53448 records to 38592 (keeping 200 days of data) [2025-10-03T20:50:00.036508] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-03T20:50:00.225343] [DEBUG] [LOCAL ] PAY: Primary data saved (38592 records). [2025-10-03T20:50:00.225505] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-03T20:50:00.225596] [INFO ] [MAIN ] Update Progress: 1635/2370 symbols completed. PAY took 43.0s. Estimated remaining: 1h 43m 22s. Rate: 7.1 symbols/min [2025-10-03T20:50:00.414985] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:00.449531] [DEBUG] [LOCAL ] PBH: Loaded 32101 existing records from primary storage. [2025-10-03T20:50:00.449835] [INFO ] [MAIN ] PBH: Loaded 32101 existing records. [2025-10-03T20:50:00.648588] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:00.648855] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-03T20:50:00.648906] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-03T20:50:00.649139] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-03T20:50:00.649201] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-03T20:50:00.801156] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-03T20:50:01.033955] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:01.179674] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T20:50:01.590721] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-03T20:50:02.074198] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T20:50:02.390743] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-03T20:50:02.873215] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T20:50:03.190693] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-03T20:50:03.405581] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T20:50:03.708109] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T20:50:03.990713] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-03T20:50:04.790635] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-03T20:50:05.143247] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T20:50:05.590719] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-03T20:50:05.819253] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T20:50:06.390677] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-03T20:50:06.538854] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T20:50:07.047296] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T20:50:07.190718] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-03T20:50:07.291615] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:50:07.990684] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-03T20:50:08.790668] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-03T20:50:09.173076] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T20:50:09.347205] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T20:50:09.349768] [INFO ] [REMOTE ] PB: Full fetch complete (58838 records). [2025-10-03T20:50:09.349897] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-03T20:50:09.599005] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-03T20:50:09.774120] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-03T20:50:09.774207] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-03T20:50:09.775187] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-03T20:50:09.775254] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-03T20:50:09.776598] [DEBUG] [LOCAL ] PB: Trimmed 58838 records to 42171 (keeping 200 days of data) [2025-10-03T20:50:10.053453] [DEBUG] [LOCAL ] PB: Primary data saved (42171 records). [2025-10-03T20:50:10.053600] [INFO ] [MAIN ] PB: Full history saved. [2025-10-03T20:50:10.053772] [INFO ] [MAIN ] Update Progress: 1636/2370 symbols completed. PB took 38.6s. Estimated remaining: 1h 43m 14s. Rate: 7.1 symbols/min [2025-10-03T20:50:10.242983] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:10.301669] [DEBUG] [LOCAL ] PBI: Loaded 50322 existing records from primary storage. [2025-10-03T20:50:10.302088] [INFO ] [MAIN ] PBI: Loaded 50322 existing records. [2025-10-03T20:50:10.405983] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-03T20:50:10.507412] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:10.507841] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-03T20:50:10.507922] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-03T20:50:10.519059] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-03T20:50:10.539013] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-03T20:50:10.554599] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:50:10.880822] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T20:50:10.975433] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:11.190693] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-03T20:50:11.990694] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-03T20:50:12.158711] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:50:12.476119] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T20:50:12.790684] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-03T20:50:13.453228] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T20:50:13.590632] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-03T20:50:14.390693] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-03T20:50:14.536801] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T20:50:15.190697] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-03T20:50:15.261705] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T20:50:15.502219] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T20:50:15.990689] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-03T20:50:16.790672] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-03T20:50:17.037419] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T20:50:17.590681] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-03T20:50:17.905511] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:50:18.276770] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T20:50:18.390716] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-03T20:50:19.166340] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:50:19.190672] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-03T20:50:19.869549] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T20:50:19.990731] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-03T20:50:20.672115] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T20:50:20.790714] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-03T20:50:21.590699] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-03T20:50:21.760498] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T20:50:22.390707] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-03T20:50:22.704009] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T20:50:23.101979] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T20:50:23.190723] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-03T20:50:23.990686] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-03T20:50:24.139179] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T20:50:24.434903] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T20:50:24.790735] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-03T20:50:25.289909] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T20:50:25.292843] [INFO ] [REMOTE ] PBF: Full fetch complete (76631 records). [2025-10-03T20:50:25.292971] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-03T20:50:25.595875] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-03T20:50:25.738049] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-03T20:50:25.738143] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-03T20:50:25.739262] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-03T20:50:25.739332] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-03T20:50:25.740880] [DEBUG] [LOCAL ] PBF: Trimmed 76631 records to 53892 (keeping 200 days of data) [2025-10-03T20:50:26.091343] [DEBUG] [LOCAL ] PBF: Primary data saved (53892 records). [2025-10-03T20:50:26.091571] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-03T20:50:26.091748] [INFO ] [MAIN ] Update Progress: 1637/2370 symbols completed. PBF took 27.6s. Estimated remaining: 1h 43m 9s. Rate: 7.1 symbols/min [2025-10-03T20:50:26.154168] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T20:50:26.157025] [INFO ] [REMOTE ] PBA: Full fetch complete (71373 records). [2025-10-03T20:50:26.157159] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-03T20:50:26.402603] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-03T20:50:26.580743] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-03T20:50:26.580833] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-03T20:50:26.581897] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-03T20:50:26.581964] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-03T20:50:26.583400] [DEBUG] [LOCAL ] PBA: Trimmed 71373 records to 49592 (keeping 200 days of data) [2025-10-03T20:50:26.901035] [DEBUG] [LOCAL ] PBA: Primary data saved (49592 records). [2025-10-03T20:50:26.901183] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-03T20:50:26.901287] [INFO ] [MAIN ] Update Progress: 1638/2370 symbols completed. PBA took 40.7s. Estimated remaining: 1h 42m 57s. Rate: 7.1 symbols/min [2025-10-03T20:50:27.035926] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T20:50:27.190703] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-03T20:50:28.297473] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T20:50:28.309339] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-03T20:50:28.701720] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T20:50:28.790705] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-03T20:50:30.106623] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T20:50:30.118563] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-03T20:50:30.437304] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T20:50:30.446898] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-03T20:50:31.823413] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T20:50:31.825334] [INFO ] [REMOTE ] PBH: Full fetch complete (43621 records). [2025-10-03T20:50:31.825421] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-03T20:50:32.044389] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T20:50:32.166570] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-03T20:50:32.310136] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-03T20:50:32.310280] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-03T20:50:32.311414] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-03T20:50:32.311497] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-03T20:50:32.313316] [DEBUG] [LOCAL ] PBH: Trimmed 43621 records to 32356 (keeping 200 days of data) [2025-10-03T20:50:32.515147] [DEBUG] [LOCAL ] PBH: Primary data saved (32356 records). [2025-10-03T20:50:32.515302] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-03T20:50:32.515406] [INFO ] [MAIN ] Update Progress: 1639/2370 symbols completed. PBH took 32.3s. Estimated remaining: 1h 42m 47s. Rate: 7.1 symbols/min [2025-10-03T20:50:34.144880] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T20:50:34.159135] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-03T20:50:35.952862] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T20:50:35.964563] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-03T20:50:37.809147] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T20:50:37.823521] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-03T20:50:39.050480] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T20:50:39.053187] [INFO ] [REMOTE ] PBI: Full fetch complete (72100 records). [2025-10-03T20:50:39.053338] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-03T20:50:39.540326] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-03T20:50:39.540436] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-03T20:50:39.541737] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-03T20:50:39.541812] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-03T20:50:39.543396] [DEBUG] [LOCAL ] PBI: Trimmed 72100 records to 50683 (keeping 200 days of data) [2025-10-03T20:50:39.889715] [DEBUG] [LOCAL ] PBI: Primary data saved (50683 records). [2025-10-03T20:50:39.889911] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-03T20:50:39.891086] [INFO ] [MAIN ] Update Progress: 1640/2370 symbols completed. PBI took 29.8s. Estimated remaining: 1h 42m 38s. Rate: 7.1 symbols/min [2025-10-03T20:50:40.590924] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:40.655612] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:40.691791] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:40.736544] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-03T20:50:40.761324] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:40.761877] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-03T20:50:40.762516] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-03T20:50:40.762712] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-03T20:50:40.767015] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-03T20:50:40.767480] [DEBUG] [LOCAL ] PCF: Loaded 8961 existing records from primary storage. [2025-10-03T20:50:40.767787] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-03T20:50:40.767950] [INFO ] [MAIN ] PCF: Loaded 8961 existing records. [2025-10-03T20:50:41.073033] [DEBUG] [LOCAL ] PBT: Loaded 17399 existing records from primary storage. [2025-10-03T20:50:41.084849] [INFO ] [MAIN ] PBT: Loaded 17399 existing records. [2025-10-03T20:50:41.317510] [DEBUG] [LOCAL ] PBR: Loaded 54102 existing records from primary storage. [2025-10-03T20:50:41.321051] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:41.398277] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-03T20:50:41.377751] [INFO ] [MAIN ] PBR: Loaded 54102 existing records. [2025-10-03T20:50:41.424970] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-03T20:50:41.456592] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-03T20:50:41.532071] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-03T20:50:41.813836] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:41.912007] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-03T20:50:41.966545] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-03T20:50:42.019591] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:42.029982] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-03T20:50:42.069910] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-03T20:50:42.076163] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-03T20:50:42.046704] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:42.080431] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-03T20:50:42.119777] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-03T20:50:42.105550] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-03T20:50:42.131521] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-03T20:50:42.727148] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:42.801752] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-03T20:50:43.078832] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:43.104063] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-03T20:50:43.142898] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:43.143300] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-03T20:50:44.040259] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T20:50:44.045572] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-03T20:50:44.247533] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T20:50:44.265577] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-03T20:50:44.406433] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T20:50:44.424104] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-03T20:50:44.709472] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T20:50:44.712493] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-03T20:50:45.308393] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T20:50:45.320430] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-03T20:50:45.538586] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T20:50:45.542794] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-03T20:50:45.638543] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T20:50:45.641886] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-03T20:50:46.053355] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T20:50:46.065676] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-03T20:50:46.235942] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T20:50:46.239480] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-03T20:50:46.317202] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T20:50:46.321050] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-03T20:50:47.091548] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T20:50:47.094798] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-03T20:50:47.624815] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-03T20:50:47.649040] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-03T20:50:47.651879] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T20:50:47.656734] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-03T20:50:47.940999] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T20:50:47.990674] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-03T20:50:48.120073] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T20:50:48.433856] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T20:50:48.790691] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-03T20:50:48.902259] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:50:49.590671] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-03T20:50:49.757021] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T20:50:49.964710] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T20:50:50.390623] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-03T20:50:50.474626] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T20:50:51.190704] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-03T20:50:51.547986] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T20:50:51.990724] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-03T20:50:52.790702] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-03T20:50:53.203991] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T20:50:53.590732] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-03T20:50:53.946943] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T20:50:54.211160] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T20:50:54.390716] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-03T20:50:54.418587] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T20:50:55.191160] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-03T20:50:55.433958] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T20:50:55.990693] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-03T20:50:56.224419] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T20:50:56.790698] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-03T20:50:57.118701] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T20:50:57.572591] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T20:50:57.573633] [INFO ] [REMOTE ] PCF: Full fetch complete (14135 records). [2025-10-03T20:50:57.573771] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-03T20:50:57.596399] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-03T20:50:57.965602] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-03T20:50:57.965718] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-03T20:50:57.966156] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-03T20:50:57.966202] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-03T20:50:57.966761] [DEBUG] [LOCAL ] PCF: Trimmed 14135 records to 9033 (keeping 200 days of data) [2025-10-03T20:50:58.023996] [DEBUG] [LOCAL ] PCF: Primary data saved (9033 records). [2025-10-03T20:50:58.024149] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-03T20:50:58.024275] [INFO ] [MAIN ] Update Progress: 1641/2370 symbols completed. PCF took 18.1s. Estimated remaining: 1h 42m 34s. Rate: 7.1 symbols/min [2025-10-03T20:50:58.211801] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:58.222114] [DEBUG] [LOCAL ] PCM: Loaded 6752 existing records from primary storage. [2025-10-03T20:50:58.222328] [INFO ] [MAIN ] PCM: Loaded 6752 existing records. [2025-10-03T20:50:58.391511] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-03T20:50:58.422895] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:58.423175] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-03T20:50:58.423235] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-03T20:50:58.423700] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-03T20:50:58.423764] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-03T20:50:58.478557] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T20:50:58.533479] [INFO ] [REMOTE ] PBT: Full fetch complete (25298 records). [2025-10-03T20:50:58.554103] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-03T20:50:59.172957] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:50:59.195720] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-03T20:50:59.268840] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-03T20:50:59.268923] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-03T20:50:59.269498] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-03T20:50:59.269539] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-03T20:50:59.270278] [DEBUG] [LOCAL ] PBT: Trimmed 25298 records to 17494 (keeping 200 days of data) [2025-10-03T20:50:59.379486] [DEBUG] [LOCAL ] PBT: Primary data saved (17494 records). [2025-10-03T20:50:59.379660] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-03T20:50:59.379771] [INFO ] [MAIN ] Update Progress: 1642/2370 symbols completed. PBT took 19.5s. Estimated remaining: 1h 42m 23s. Rate: 7.1 symbols/min [2025-10-03T20:50:59.561282] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:50:59.586862] [DEBUG] [LOCAL ] PCN: Loaded 24652 existing records from primary storage. [2025-10-03T20:50:59.587181] [INFO ] [MAIN ] PCN: Loaded 24652 existing records. [2025-10-03T20:50:59.777227] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:50:59.777481] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-03T20:50:59.777531] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-03T20:50:59.777883] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-03T20:50:59.777940] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-03T20:50:59.994725] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-03T20:51:00.171055] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T20:51:00.197634] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:00.495392] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T20:51:00.790729] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-03T20:51:01.590709] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-03T20:51:01.755318] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T20:51:02.390697] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-03T20:51:02.433060] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-03T20:51:02.709162] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:51:02.895075] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T20:51:03.190706] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-03T20:51:03.908811] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T20:51:03.990697] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-03T20:51:04.771207] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T20:51:04.790616] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-03T20:51:05.590707] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-03T20:51:06.085671] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T20:51:06.390704] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-03T20:51:06.412561] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T20:51:07.190687] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-03T20:51:07.626388] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T20:51:07.990638] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-03T20:51:08.101610] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:51:08.790700] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-03T20:51:09.584038] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T20:51:09.590606] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-03T20:51:09.951066] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T20:51:10.141002] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T20:51:10.390690] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-03T20:51:11.190680] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-03T20:51:11.990717] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-03T20:51:12.002126] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T20:51:12.530227] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-03T20:51:12.790711] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-03T20:51:13.454817] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:51:13.456142] [INFO ] [REMOTE ] PCM: Full fetch complete (10452 records). [2025-10-03T20:51:13.456238] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-03T20:51:13.595759] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-03T20:51:13.865047] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-03T20:51:13.865127] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-03T20:51:13.865388] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-03T20:51:13.865428] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-03T20:51:13.865917] [DEBUG] [LOCAL ] PCM: Trimmed 10452 records to 6801 (keeping 200 days of data) [2025-10-03T20:51:13.907175] [DEBUG] [LOCAL ] PCM: Primary data saved (6801 records). [2025-10-03T20:51:13.907307] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-03T20:51:13.907392] [INFO ] [MAIN ] Update Progress: 1643/2370 symbols completed. PCM took 15.9s. Estimated remaining: 1h 42m 17s. Rate: 7.1 symbols/min [2025-10-03T20:51:14.093963] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:14.139424] [DEBUG] [LOCAL ] PCOR: Loaded 48348 existing records from primary storage. [2025-10-03T20:51:14.139793] [INFO ] [MAIN ] PCOR: Loaded 48348 existing records. [2025-10-03T20:51:14.362150] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:51:14.363364] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-03T20:51:14.363469] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-03T20:51:14.364585] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-03T20:51:14.364676] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-03T20:51:14.407949] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-03T20:51:14.532047] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-03T20:51:14.892487] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:14.905965] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T20:51:15.190724] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-03T20:51:15.990755] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-03T20:51:16.614754] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T20:51:16.790732] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-03T20:51:17.419699] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-03T20:51:17.590675] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-03T20:51:17.786478] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T20:51:17.891430] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T20:51:18.390719] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-03T20:51:19.190725] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-03T20:51:19.757041] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T20:51:19.881369] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T20:51:19.990732] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-03T20:51:20.790700] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-03T20:51:20.916100] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T20:51:21.590722] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-03T20:51:22.024808] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T20:51:22.390741] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-03T20:51:22.880704] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T20:51:22.999794] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T20:51:23.190677] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-03T20:51:23.553913] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T20:51:23.990714] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-03T20:51:24.790735] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-03T20:51:25.406223] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T20:51:25.590683] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-03T20:51:25.632037] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T20:51:25.838816] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T20:51:26.390744] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-03T20:51:26.722930] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-03T20:51:26.725257] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-10-03T20:51:26.725431] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-03T20:51:26.726485] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:51:26.726592] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:51:26.726665] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:51:26.726745] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-03T20:51:26.726815] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-03T20:51:26.726852] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-03T20:51:26.726918] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-03T20:51:26.727035] [INFO ] [MAIN ] Update Progress: 1644/2370 symbols completed. PCG took 46.8s. Estimated remaining: 1h 42m 10s. Rate: 7.1 symbols/min [2025-10-03T20:51:26.927863] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:26.941980] [DEBUG] [LOCAL ] PCQ: Loaded 12305 existing records from primary storage. [2025-10-03T20:51:26.942247] [INFO ] [MAIN ] PCQ: Loaded 12305 existing records. [2025-10-03T20:51:27.135917] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:51:27.136189] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-03T20:51:27.136244] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-03T20:51:27.136494] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-03T20:51:27.136553] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-03T20:51:27.196555] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-03T20:51:27.455190] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T20:51:27.489789] [INFO ] [REMOTE ] PBR: Full fetch complete (77776 records). [2025-10-03T20:51:27.500253] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-03T20:51:27.630623] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:27.998345] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-03T20:51:27.999195] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-03T20:51:28.000390] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-03T20:51:28.001527] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-03T20:51:28.001730] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-03T20:51:28.004255] [DEBUG] [LOCAL ] PBR: Trimmed 77776 records to 54491 (keeping 200 days of data) [2025-10-03T20:51:28.367172] [DEBUG] [LOCAL ] PBR: Primary data saved (54491 records). [2025-10-03T20:51:28.367315] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-03T20:51:28.367421] [INFO ] [MAIN ] Update Progress: 1645/2370 symbols completed. PBR took 48.5s. Estimated remaining: 1h 41m 59s. Rate: 7.1 symbols/min [2025-10-03T20:51:28.540895] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:28.587636] [DEBUG] [LOCAL ] PD: Loaded 48248 existing records from primary storage. [2025-10-03T20:51:28.588009] [INFO ] [MAIN ] PD: Loaded 48248 existing records. [2025-10-03T20:51:28.777958] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:51:28.778185] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-03T20:51:28.778233] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-03T20:51:28.778542] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-03T20:51:28.778601] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-03T20:51:28.800568] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-03T20:51:29.174855] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:29.205408] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T20:51:29.442256] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T20:51:29.590684] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-03T20:51:30.006998] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:51:30.390680] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-03T20:51:30.764351] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T20:51:31.190722] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-03T20:51:31.913854] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T20:51:31.990692] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-03T20:51:32.501257] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T20:51:32.790721] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-03T20:51:33.590731] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-03T20:51:33.630603] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T20:51:33.672358] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T20:51:34.390706] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-03T20:51:35.190634] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-03T20:51:35.281609] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:51:35.372813] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T20:51:35.990668] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-03T20:51:36.066201] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T20:51:36.068517] [INFO ] [REMOTE ] PCN: Full fetch complete (34124 records). [2025-10-03T20:51:36.068629] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-03T20:51:36.495840] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-03T20:51:36.495921] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-03T20:51:36.496713] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-03T20:51:36.496778] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-03T20:51:36.497724] [DEBUG] [LOCAL ] PCN: Trimmed 34124 records to 24844 (keeping 200 days of data) [2025-10-03T20:51:36.664418] [DEBUG] [LOCAL ] PCN: Primary data saved (24844 records). [2025-10-03T20:51:36.664559] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-03T20:51:36.664669] [INFO ] [MAIN ] Update Progress: 1646/2370 symbols completed. PCN took 37.3s. Estimated remaining: 1h 41m 51s. Rate: 7.1 symbols/min [2025-10-03T20:51:36.795820] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-03T20:51:36.867328] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:36.867698] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-03T20:51:36.867777] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-03T20:51:36.876564] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-03T20:51:36.876476] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T20:51:36.876812] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-03T20:51:36.880343] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-03T20:51:36.880405] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-03T20:51:37.331971] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:37.590754] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-03T20:51:38.390639] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-03T20:51:38.420698] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T20:51:38.740965] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T20:51:38.825115] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-03T20:51:39.190699] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-03T20:51:39.990699] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-03T20:51:40.702981] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T20:51:40.790730] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-03T20:51:41.282157] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T20:51:41.590634] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-03T20:51:41.706079] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T20:51:42.109793] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T20:51:42.390826] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-03T20:51:43.190719] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-03T20:51:43.218021] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T20:51:43.990735] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-03T20:51:44.790677] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-03T20:51:44.939681] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T20:51:45.590729] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-03T20:51:45.704995] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:51:45.750101] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T20:51:46.390688] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-03T20:51:47.190723] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-03T20:51:47.290370] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T20:51:47.421548] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T20:51:47.990720] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-03T20:51:48.790735] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-03T20:51:48.849778] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T20:51:49.010384] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T20:51:49.345092] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T20:51:49.590704] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-03T20:51:50.390682] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-03T20:51:50.985549] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T20:51:50.988263] [INFO ] [REMOTE ] PCOR: Full fetch complete (69591 records). [2025-10-03T20:51:50.988392] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-03T20:51:51.200716] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-03T20:51:51.425032] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-03T20:51:51.425125] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-03T20:51:51.426283] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-03T20:51:51.426351] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-03T20:51:51.427874] [DEBUG] [LOCAL ] PCOR: Trimmed 69591 records to 48706 (keeping 200 days of data) [2025-10-03T20:51:51.734690] [DEBUG] [LOCAL ] PCOR: Primary data saved (48706 records). [2025-10-03T20:51:51.734840] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-03T20:51:51.734959] [INFO ] [MAIN ] Update Progress: 1647/2370 symbols completed. PCOR took 37.8s. Estimated remaining: 1h 41m 45s. Rate: 7.1 symbols/min [2025-10-03T20:51:51.936480] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:51.992931] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-03T20:51:51.997914] [DEBUG] [LOCAL ] PDI: Loaded 50434 existing records from primary storage. [2025-10-03T20:51:51.998409] [INFO ] [MAIN ] PDI: Loaded 50434 existing records. [2025-10-03T20:51:52.225559] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:51:52.227191] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-03T20:51:52.229146] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T20:51:52.229694] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-03T20:51:52.240573] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-03T20:51:52.240707] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-03T20:51:52.368920] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T20:51:52.459051] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-03T20:51:52.681534] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:52.790709] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-03T20:51:53.590698] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-03T20:51:54.328338] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T20:51:54.329952] [INFO ] [REMOTE ] PCQ: Full fetch complete (17359 records). [2025-10-03T20:51:54.330075] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-03T20:51:54.393548] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-03T20:51:55.011818] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-03T20:51:55.012764] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-03T20:51:55.013386] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-03T20:51:55.016527] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-03T20:51:55.016773] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-03T20:51:55.031955] [DEBUG] [LOCAL ] PCQ: Trimmed 17359 records to 12462 (keeping 200 days of data) [2025-10-03T20:51:55.125115] [DEBUG] [LOCAL ] PCQ: Primary data saved (12462 records). [2025-10-03T20:51:55.125313] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-03T20:51:55.125443] [INFO ] [MAIN ] Update Progress: 1648/2370 symbols completed. PCQ took 28.4s. Estimated remaining: 1h 41m 34s. Rate: 7.1 symbols/min [2025-10-03T20:51:55.198276] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-03T20:51:55.374812] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:51:55.439443] [DEBUG] [LOCAL ] PDM: Loaded 39853 existing records from primary storage. [2025-10-03T20:51:55.439846] [INFO ] [MAIN ] PDM: Loaded 39853 existing records. [2025-10-03T20:51:55.649163] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:51:55.649415] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-03T20:51:55.649465] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-03T20:51:55.649857] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-03T20:51:55.649920] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-03T20:51:55.995595] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-03T20:51:56.059823] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:51:56.089833] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T20:51:56.523527] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T20:51:56.790675] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-03T20:51:57.192030] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-03T20:51:57.590717] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-03T20:51:58.390711] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-03T20:51:58.613588] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T20:51:59.190753] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-03T20:51:59.402687] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T20:51:59.894332] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T20:51:59.990715] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-03T20:52:00.790701] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-03T20:52:01.132944] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T20:52:01.523595] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T20:52:01.590669] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-03T20:52:02.390719] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-03T20:52:02.739175] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T20:52:02.822975] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T20:52:03.084710] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T20:52:03.190688] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-03T20:52:03.766339] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T20:52:03.990685] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-03T20:52:04.790690] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-03T20:52:05.590697] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-03T20:52:05.953109] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-03T20:52:05.997379] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T20:52:06.341736] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T20:52:06.390674] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-03T20:52:07.190685] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-03T20:52:07.990629] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-03T20:52:08.338325] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T20:52:08.790637] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-03T20:52:08.951483] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T20:52:09.590691] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-03T20:52:09.989280] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-03T20:52:10.029203] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-03T20:52:10.390707] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-03T20:52:10.449909] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T20:52:10.452843] [INFO ] [REMOTE ] PD: Full fetch complete (67798 records). [2025-10-03T20:52:10.453019] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-03T20:52:10.768790] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T20:52:10.782734] [INFO ] [REMOTE ] PDCC: Full fetch complete (1340 records). [2025-10-03T20:52:10.812423] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-03T20:52:11.050133] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-03T20:52:11.055349] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-03T20:52:11.061612] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-03T20:52:11.066877] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-03T20:52:11.126076] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-03T20:52:11.126607] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:52:11.126785] [DEBUG] [LOCAL ] PD: Trimmed 67798 records to 48630 (keeping 200 days of data) [2025-10-03T20:52:11.126967] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:52:11.127632] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-03T20:52:11.127778] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-03T20:52:11.127839] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-03T20:52:11.127901] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-03T20:52:11.128238] [INFO ] [MAIN ] Update Progress: 1649/2370 symbols completed. PDCC took 34.5s. Estimated remaining: 1h 41m 29s. Rate: 7.1 symbols/min [2025-10-03T20:52:11.216496] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-03T20:52:11.420927] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:11.421458] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-03T20:52:11.421916] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-03T20:52:11.422694] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-03T20:52:11.423115] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-03T20:52:11.423854] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-03T20:52:11.424509] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-03T20:52:11.850863] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:12.010547] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-03T20:52:12.046306] [DEBUG] [LOCAL ] PD: Primary data saved (48630 records). [2025-10-03T20:52:12.046469] [INFO ] [MAIN ] PD: Full history saved. [2025-10-03T20:52:12.046572] [INFO ] [MAIN ] Update Progress: 1650/2370 symbols completed. PD took 43.7s. Estimated remaining: 1h 41m 17s. Rate: 7.1 symbols/min [2025-10-03T20:52:12.229682] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:12.248379] [DEBUG] [LOCAL ] PDS: Loaded 17719 existing records from primary storage. [2025-10-03T20:52:12.248694] [INFO ] [MAIN ] PDS: Loaded 17719 existing records. [2025-10-03T20:52:12.438991] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:52:12.439204] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-03T20:52:12.439254] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-03T20:52:12.439514] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-03T20:52:12.439574] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-03T20:52:12.790817] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-03T20:52:12.830600] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:12.935233] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T20:52:13.590734] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-03T20:52:13.647315] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T20:52:14.390704] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-03T20:52:14.529974] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T20:52:14.741128] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T20:52:15.190714] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-03T20:52:15.949901] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T20:52:15.990700] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-03T20:52:16.511696] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T20:52:16.790709] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-03T20:52:17.079447] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T20:52:17.590744] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-03T20:52:18.161199] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T20:52:18.390712] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-03T20:52:19.190673] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-03T20:52:19.365437] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T20:52:19.991273] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-03T20:52:19.993786] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T20:52:20.354497] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T20:52:20.790717] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-03T20:52:21.590634] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-03T20:52:21.929687] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T20:52:22.389405] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T20:52:22.397528] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-03T20:52:22.495466] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T20:52:23.190686] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-03T20:52:23.990691] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-03T20:52:24.339998] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T20:52:24.393986] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T20:52:24.790728] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-03T20:52:25.463962] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T20:52:25.590724] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-03T20:52:26.068842] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T20:52:26.390697] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-03T20:52:27.190625] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-03T20:52:27.217407] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T20:52:27.291155] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T20:52:27.293229] [INFO ] [REMOTE ] PDM: Full fetch complete (57356 records). [2025-10-03T20:52:27.293326] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-03T20:52:27.726069] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-03T20:52:27.726254] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-03T20:52:27.727411] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-03T20:52:27.727492] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-03T20:52:27.730837] [DEBUG] [LOCAL ] PDM: Trimmed 57356 records to 40131 (keeping 200 days of data) [2025-10-03T20:52:27.965994] [DEBUG] [LOCAL ] PDM: Primary data saved (40131 records). [2025-10-03T20:52:27.966127] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-03T20:52:27.967674] [INFO ] [MAIN ] Update Progress: 1651/2370 symbols completed. PDM took 32.8s. Estimated remaining: 1h 41m 12s. Rate: 7.1 symbols/min [2025-10-03T20:52:27.998816] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-03T20:52:28.162045] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:28.183833] [DEBUG] [LOCAL ] PDT: Loaded 17545 existing records from primary storage. [2025-10-03T20:52:28.184186] [INFO ] [MAIN ] PDT: Loaded 17545 existing records. [2025-10-03T20:52:28.338398] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T20:52:28.400901] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:52:28.401192] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-03T20:52:28.401253] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-03T20:52:28.401574] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-03T20:52:28.401634] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-03T20:52:28.786716] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:28.790617] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-03T20:52:29.342569] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T20:52:29.590733] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-03T20:52:30.001617] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T20:52:30.390692] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-03T20:52:30.789342] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T20:52:31.190695] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-03T20:52:31.459594] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T20:52:31.990705] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-03T20:52:32.318539] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T20:52:32.790718] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-03T20:52:33.590676] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-03T20:52:33.610250] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T20:52:33.612930] [INFO ] [REMOTE ] PDI: Full fetch complete (73011 records). [2025-10-03T20:52:33.613036] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-03T20:52:34.043225] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-03T20:52:34.054049] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-03T20:52:34.060396] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-03T20:52:34.060499] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-03T20:52:34.075333] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T20:52:34.093483] [DEBUG] [LOCAL ] PDI: Trimmed 73011 records to 50810 (keeping 200 days of data) [2025-10-03T20:52:34.401111] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-03T20:52:34.425950] [DEBUG] [LOCAL ] PDI: Primary data saved (50810 records). [2025-10-03T20:52:34.426117] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-03T20:52:34.426236] [INFO ] [MAIN ] Update Progress: 1652/2370 symbols completed. PDI took 42.7s. Estimated remaining: 1h 41m 3s. Rate: 7.1 symbols/min [2025-10-03T20:52:34.619317] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:34.630990] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T20:52:34.650319] [DEBUG] [LOCAL ] PDX: Loaded 14464 existing records from primary storage. [2025-10-03T20:52:34.650670] [INFO ] [MAIN ] PDX: Loaded 14464 existing records. [2025-10-03T20:52:34.846673] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:52:34.846942] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-03T20:52:34.846993] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-03T20:52:34.847371] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-03T20:52:34.847431] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-03T20:52:35.196262] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-03T20:52:35.238420] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:35.252725] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T20:52:35.990693] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-03T20:52:36.323517] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T20:52:36.790638] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-03T20:52:36.945518] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:52:37.590696] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-03T20:52:37.819708] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T20:52:38.390674] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-03T20:52:38.564827] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T20:52:39.190752] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-03T20:52:39.693728] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T20:52:39.990713] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-03T20:52:40.654788] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T20:52:40.790723] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-03T20:52:40.840958] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T20:52:41.590739] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-03T20:52:41.902275] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T20:52:42.390677] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-03T20:52:42.651047] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T20:52:43.190697] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-03T20:52:43.819531] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T20:52:43.913303] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T20:52:43.915634] [INFO ] [REMOTE ] PDS: Full fetch complete (25575 records). [2025-10-03T20:52:43.915739] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-03T20:52:43.995860] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-03T20:52:44.345305] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-03T20:52:44.345385] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-03T20:52:44.345941] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-03T20:52:44.346004] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-03T20:52:44.346720] [DEBUG] [LOCAL ] PDS: Trimmed 25575 records to 17809 (keeping 200 days of data) [2025-10-03T20:52:44.452806] [DEBUG] [LOCAL ] PDS: Primary data saved (17809 records). [2025-10-03T20:52:44.452950] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-03T20:52:44.453043] [INFO ] [MAIN ] Update Progress: 1653/2370 symbols completed. PDS took 32.4s. Estimated remaining: 1h 40m 55s. Rate: 7.1 symbols/min [2025-10-03T20:52:44.630446] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:44.680342] [DEBUG] [LOCAL ] PEB: Loaded 51018 existing records from primary storage. [2025-10-03T20:52:44.680794] [INFO ] [MAIN ] PEB: Loaded 51018 existing records. [2025-10-03T20:52:44.793310] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-03T20:52:44.884535] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:52:44.884847] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-03T20:52:44.884898] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-03T20:52:44.885117] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-03T20:52:44.885177] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-03T20:52:45.283608] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:45.277323] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T20:52:45.590632] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-03T20:52:45.874110] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T20:52:46.390711] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-03T20:52:47.190729] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-03T20:52:47.242812] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T20:52:47.405123] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T20:52:47.407791] [INFO ] [REMOTE ] PDO: Full fetch complete (47473 records). [2025-10-03T20:52:47.407998] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-03T20:52:47.953011] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-03T20:52:47.953111] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-03T20:52:47.954294] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-03T20:52:47.954380] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-03T20:52:47.955893] [DEBUG] [LOCAL ] PDO: Trimmed 47473 records to 31781 (keeping 200 days of data) [2025-10-03T20:52:48.035372] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-03T20:52:48.218946] [DEBUG] [LOCAL ] PDO: Primary data saved (31781 records). [2025-10-03T20:52:48.219134] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-03T20:52:48.219277] [INFO ] [MAIN ] Update Progress: 1654/2370 symbols completed. PDO took 37.1s. Estimated remaining: 1h 40m 45s. Rate: 7.1 symbols/min [2025-10-03T20:52:48.340843] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T20:52:48.447140] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:48.447355] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-03T20:52:48.447413] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-03T20:52:48.447533] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-03T20:52:48.447610] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-03T20:52:48.447705] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-03T20:52:48.447795] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-03T20:52:48.794943] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-03T20:52:48.833870] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:49.590702] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-03T20:52:49.949275] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T20:52:49.949930] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T20:52:50.390721] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-03T20:52:50.420351] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T20:52:51.190719] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-03T20:52:51.990709] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-03T20:52:52.022601] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T20:52:52.790710] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-03T20:52:52.871858] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T20:52:53.092732] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:52:53.364933] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T20:52:53.590724] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-03T20:52:54.390684] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-03T20:52:55.167102] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T20:52:55.169394] [INFO ] [REMOTE ] PDT: Full fetch complete (25237 records). [2025-10-03T20:52:55.169695] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-03T20:52:55.195801] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-03T20:52:55.635084] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T20:52:55.675562] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-03T20:52:55.676091] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-03T20:52:55.676893] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-03T20:52:55.677018] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-03T20:52:55.678396] [DEBUG] [LOCAL ] PDT: Trimmed 25237 records to 17673 (keeping 200 days of data) [2025-10-03T20:52:55.798622] [DEBUG] [LOCAL ] PDT: Primary data saved (17673 records). [2025-10-03T20:52:55.798803] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-03T20:52:55.798913] [INFO ] [MAIN ] Update Progress: 1655/2370 symbols completed. PDT took 27.8s. Estimated remaining: 1h 40m 36s. Rate: 7.1 symbols/min [2025-10-03T20:52:55.978149] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:52:55.990692] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-03T20:52:56.018518] [DEBUG] [LOCAL ] PEN: Loaded 30405 existing records from primary storage. [2025-10-03T20:52:56.018865] [INFO ] [MAIN ] PEN: Loaded 30405 existing records. [2025-10-03T20:52:56.204205] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:52:56.204412] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-03T20:52:56.204459] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-03T20:52:56.204713] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-03T20:52:56.204771] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-03T20:52:56.500022] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T20:52:56.612890] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:52:56.790697] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-03T20:52:57.601107] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-03T20:52:57.631833] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T20:52:58.036316] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T20:52:58.390709] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-03T20:52:58.947220] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T20:52:59.190688] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-03T20:52:59.799932] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T20:52:59.990687] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-03T20:53:00.328788] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:53:00.790686] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-03T20:53:00.994740] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T20:53:01.590698] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-03T20:53:02.390686] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-03T20:53:02.585849] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T20:53:02.628803] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T20:53:03.190692] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-03T20:53:03.842954] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T20:53:03.895077] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T20:53:03.896249] [INFO ] [REMOTE ] PDX: Full fetch complete (24316 records). [2025-10-03T20:53:03.896349] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-03T20:53:03.995735] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-03T20:53:04.324539] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-03T20:53:04.324662] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-03T20:53:04.325258] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-03T20:53:04.325306] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-03T20:53:04.326224] [DEBUG] [LOCAL ] PDX: Trimmed 24316 records to 14525 (keeping 200 days of data) [2025-10-03T20:53:04.422044] [DEBUG] [LOCAL ] PDX: Primary data saved (14525 records). [2025-10-03T20:53:04.422201] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-03T20:53:04.422298] [INFO ] [MAIN ] Update Progress: 1656/2370 symbols completed. PDX took 30.0s. Estimated remaining: 1h 40m 28s. Rate: 7.1 symbols/min [2025-10-03T20:53:04.614663] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:04.614884] [DEBUG] [LOCAL ] PEO: No existing data file found in primary storage. [2025-10-03T20:53:04.614930] [WARN ] [MAIN ] PEO: No existing data found, performing full refresh instead. [2025-10-03T20:53:04.615053] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-03T20:53:04.615098] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-03T20:53:04.615141] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-03T20:53:04.615178] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-03T20:53:04.793947] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-03T20:53:05.036267] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:05.590665] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-03T20:53:06.069567] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T20:53:06.390702] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-03T20:53:06.465203] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T20:53:07.005582] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T20:53:07.190699] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-03T20:53:07.990703] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-03T20:53:08.431868] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T20:53:08.790708] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-03T20:53:08.837363] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T20:53:09.473481] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T20:53:09.590706] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-03T20:53:09.795528] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T20:53:10.390708] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-03T20:53:11.190628] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-03T20:53:11.336488] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T20:53:11.414825] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T20:53:11.990709] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-03T20:53:12.770514] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T20:53:12.790620] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-03T20:53:12.882284] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:53:13.590729] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-03T20:53:14.390716] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-03T20:53:14.516605] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T20:53:15.080771] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T20:53:15.190671] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-03T20:53:15.990677] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-03T20:53:16.093801] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T20:53:16.158907] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T20:53:16.790733] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-03T20:53:17.590692] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-03T20:53:17.727122] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T20:53:18.180233] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T20:53:18.390677] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-03T20:53:19.190710] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-03T20:53:19.399290] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T20:53:19.762591] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T20:53:19.776632] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T20:53:19.990684] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-03T20:53:20.790701] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-03T20:53:20.975350] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T20:53:21.590724] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-03T20:53:22.010271] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T20:53:22.390736] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-03T20:53:23.028176] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T20:53:23.031098] [INFO ] [REMOTE ] PEB: Full fetch complete (72890 records). [2025-10-03T20:53:23.031249] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-03T20:53:23.196606] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-03T20:53:23.458086] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-03T20:53:23.458179] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-03T20:53:23.459263] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-03T20:53:23.459327] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-03T20:53:23.461030] [DEBUG] [LOCAL ] PEB: Trimmed 72890 records to 51395 (keeping 200 days of data) [2025-10-03T20:53:23.789149] [DEBUG] [LOCAL ] PEB: Primary data saved (51395 records). [2025-10-03T20:53:23.789311] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-03T20:53:23.789405] [INFO ] [MAIN ] Update Progress: 1657/2370 symbols completed. PEB took 39.3s. Estimated remaining: 1h 40m 24s. Rate: 7.1 symbols/min [2025-10-03T20:53:23.985081] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:23.993830] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-03T20:53:24.002097] [DEBUG] [LOCAL ] PERF: Loaded 14100 existing records from primary storage. [2025-10-03T20:53:24.002832] [INFO ] [MAIN ] PERF: Loaded 14100 existing records. [2025-10-03T20:53:24.177243] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T20:53:24.223515] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:53:24.224027] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-03T20:53:24.224085] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-03T20:53:24.236429] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-03T20:53:24.249703] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-03T20:53:24.358128] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:53:24.670042] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:24.790724] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-03T20:53:24.826959] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T20:53:24.829273] [INFO ] [REMOTE ] PEN: Full fetch complete (44157 records). [2025-10-03T20:53:24.829360] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-03T20:53:25.254750] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-03T20:53:25.254993] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-03T20:53:25.256128] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-03T20:53:25.256198] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-03T20:53:25.257517] [DEBUG] [LOCAL ] PEN: Trimmed 44157 records to 30624 (keeping 200 days of data) [2025-10-03T20:53:25.450226] [DEBUG] [LOCAL ] PEN: Primary data saved (30624 records). [2025-10-03T20:53:25.450376] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-03T20:53:25.450490] [INFO ] [MAIN ] Update Progress: 1658/2370 symbols completed. PEN took 29.7s. Estimated remaining: 1h 40m 12s. Rate: 7.1 symbols/min [2025-10-03T20:53:25.595871] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-03T20:53:25.645400] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:25.645866] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-03T20:53:25.645976] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-03T20:53:25.646120] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-03T20:53:25.646223] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-03T20:53:25.646291] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-03T20:53:25.646327] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-03T20:53:25.982305] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:53:26.062525] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:26.390758] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-03T20:53:27.190710] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-03T20:53:27.510382] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T20:53:27.569783] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T20:53:27.990628] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-03T20:53:28.060975] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T20:53:28.790630] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-03T20:53:29.077912] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T20:53:29.078291] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-03T20:53:29.078391] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:53:29.078440] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-03T20:53:29.078477] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:53:29.078531] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-03T20:53:29.078615] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-03T20:53:29.078686] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-03T20:53:29.078770] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-03T20:53:29.078841] [INFO ] [MAIN ] Update Progress: 1659/2370 symbols completed. PEW took 3.6s. Estimated remaining: 1h 40m 2s. Rate: 7.1 symbols/min [2025-10-03T20:53:29.282817] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:29.295051] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T20:53:29.305135] [DEBUG] [LOCAL ] PFD: Loaded 5172 existing records from primary storage. [2025-10-03T20:53:29.305386] [INFO ] [MAIN ] PFD: Loaded 5172 existing records. [2025-10-03T20:53:29.498336] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:53:29.498585] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-03T20:53:29.498636] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-03T20:53:29.498914] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-03T20:53:29.498973] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-03T20:53:29.595810] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-03T20:53:29.892624] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:30.390708] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-03T20:53:30.531325] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T20:53:31.190671] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-03T20:53:31.396832] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T20:53:31.924793] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T20:53:31.990735] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-03T20:53:32.498155] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:53:32.502083] [INFO ] [REMOTE ] PEG: Full fetch complete (76310 records). [2025-10-03T20:53:32.502219] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-03T20:53:32.503097] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:53:32.503231] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:53:32.503304] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:53:32.503379] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-03T20:53:32.503448] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-03T20:53:32.503485] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-03T20:53:32.503527] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-03T20:53:32.503588] [INFO ] [MAIN ] Update Progress: 1660/2370 symbols completed. PEG took 44.3s. Estimated remaining: 1h 39m 51s. Rate: 7.1 symbols/min [2025-10-03T20:53:32.687188] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:32.687404] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-03T20:53:32.687459] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-03T20:53:32.687610] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-03T20:53:32.687688] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-03T20:53:32.687748] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-03T20:53:32.687783] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-03T20:53:32.795265] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-03T20:53:33.072377] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:33.590723] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-03T20:53:33.640043] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:53:34.240337] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T20:53:34.390712] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-03T20:53:35.190737] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-03T20:53:35.313498] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:53:35.990753] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-03T20:53:36.174158] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T20:53:36.790736] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-03T20:53:37.466835] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T20:53:37.468097] [INFO ] [REMOTE ] PEO: Full fetch complete (16311 records). [2025-10-03T20:53:37.468174] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-03T20:53:37.595752] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-03T20:53:37.854079] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-03T20:53:37.854159] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-03T20:53:37.854554] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-03T20:53:37.854595] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-03T20:53:37.855167] [DEBUG] [LOCAL ] PEO: Trimmed 16311 records to 11227 (keeping 200 days of data) [2025-10-03T20:53:37.924018] [DEBUG] [LOCAL ] PEO: Primary data saved (11227 records). [2025-10-03T20:53:37.924159] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-03T20:53:37.924237] [INFO ] [MAIN ] Update Progress: 1661/2370 symbols completed. PEO took 33.5s. Estimated remaining: 1h 39m 42s. Rate: 7.1 symbols/min [2025-10-03T20:53:38.111098] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:38.159066] [DEBUG] [LOCAL ] PFGC: Loaded 47161 existing records from primary storage. [2025-10-03T20:53:38.159413] [INFO ] [MAIN ] PFGC: Loaded 47161 existing records. [2025-10-03T20:53:38.352344] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T20:53:38.356438] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:53:38.358539] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-03T20:53:38.358601] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-03T20:53:38.358921] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-03T20:53:38.358986] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-03T20:53:38.391679] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-03T20:53:38.744876] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:38.867298] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-03T20:53:39.190620] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-03T20:53:39.197369] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T20:53:39.990757] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-03T20:53:40.790719] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-03T20:53:41.100425] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:53:41.273940] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T20:53:41.444553] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-03T20:53:41.590730] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-03T20:53:42.390735] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-03T20:53:43.190725] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-03T20:53:43.857845] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T20:53:43.899634] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T20:53:43.990718] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-03T20:53:44.206907] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-03T20:53:44.699597] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T20:53:44.790731] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-03T20:53:45.590699] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-03T20:53:45.871045] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T20:53:46.390707] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-03T20:53:47.147633] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T20:53:47.165897] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T20:53:47.190618] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-03T20:53:47.990686] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-03T20:53:48.694372] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T20:53:48.784579] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T20:53:48.785826] [INFO ] [REMOTE ] PERF: Full fetch complete (21865 records). [2025-10-03T20:53:48.785900] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-03T20:53:48.797788] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-03T20:53:49.195115] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-03T20:53:49.195196] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-03T20:53:49.195674] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-03T20:53:49.195737] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-03T20:53:49.196412] [DEBUG] [LOCAL ] PERF: Trimmed 21865 records to 14240 (keeping 200 days of data) [2025-10-03T20:53:49.279040] [DEBUG] [LOCAL ] PERF: Primary data saved (14240 records). [2025-10-03T20:53:49.279187] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-03T20:53:49.279290] [INFO ] [MAIN ] Update Progress: 1662/2370 symbols completed. PERF took 25.5s. Estimated remaining: 1h 39m 34s. Rate: 7.1 symbols/min [2025-10-03T20:53:49.482547] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:49.492878] [DEBUG] [LOCAL ] PFH: Loaded 6858 existing records from primary storage. [2025-10-03T20:53:49.493125] [INFO ] [MAIN ] PFH: Loaded 6858 existing records. [2025-10-03T20:53:49.593848] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-03T20:53:49.617288] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T20:53:49.703489] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:53:49.703767] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-03T20:53:49.703821] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-03T20:53:49.704016] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-03T20:53:49.704076] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-03T20:53:50.102703] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:53:50.390715] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-03T20:53:51.190711] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-03T20:53:51.725615] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-03T20:53:51.990637] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-03T20:53:52.058866] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T20:53:52.100316] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T20:53:52.622951] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T20:53:52.790699] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-03T20:53:53.590699] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-03T20:53:54.390674] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-03T20:53:54.488954] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T20:53:54.500409] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T20:53:55.164230] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T20:53:55.190713] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-03T20:53:55.990686] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-03T20:53:56.010034] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T20:53:56.790721] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-03T20:53:57.534145] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T20:53:57.590742] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-03T20:53:58.390742] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-03T20:53:58.442280] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-03T20:53:58.591534] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T20:53:58.900454] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T20:53:58.901345] [INFO ] [REMOTE ] PFD: Full fetch complete (7482 records). [2025-10-03T20:53:58.901416] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-03T20:53:59.195773] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-03T20:53:59.290350] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-03T20:53:59.290440] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-03T20:53:59.290690] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-03T20:53:59.290753] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-03T20:53:59.291196] [DEBUG] [LOCAL ] PFD: Trimmed 7482 records to 5226 (keeping 200 days of data) [2025-10-03T20:53:59.324473] [DEBUG] [LOCAL ] PFD: Primary data saved (5226 records). [2025-10-03T20:53:59.324610] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-03T20:53:59.324743] [INFO ] [MAIN ] Update Progress: 1663/2370 symbols completed. PFD took 30.2s. Estimated remaining: 1h 39m 27s. Rate: 7.1 symbols/min [2025-10-03T20:53:59.511316] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:53:59.529383] [DEBUG] [LOCAL ] PFL: Loaded 13775 existing records from primary storage. [2025-10-03T20:53:59.529666] [INFO ] [MAIN ] PFL: Loaded 13775 existing records. [2025-10-03T20:53:59.728701] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:53:59.728945] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-03T20:53:59.729009] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-03T20:53:59.729330] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-03T20:53:59.729389] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-03T20:53:59.992436] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-03T20:54:00.082489] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T20:54:00.167097] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:00.790668] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-03T20:54:01.590726] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-03T20:54:01.750727] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T20:54:02.390710] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-03T20:54:02.699539] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T20:54:03.190690] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-03T20:54:03.479290] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-03T20:54:03.990623] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-03T20:54:04.183455] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T20:54:04.210126] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T20:54:04.790684] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-03T20:54:04.875774] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T20:54:05.590633] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-03T20:54:05.821338] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T20:54:06.390678] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-03T20:54:07.048988] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T20:54:07.079223] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T20:54:07.190725] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-03T20:54:07.990736] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-03T20:54:08.790734] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-03T20:54:08.980855] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T20:54:09.041411] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T20:54:09.590712] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-03T20:54:10.372466] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T20:54:10.390621] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-03T20:54:11.145053] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T20:54:11.190638] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-03T20:54:11.192884] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-03T20:54:11.877279] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T20:54:11.990688] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-03T20:54:12.495465] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T20:54:12.496379] [INFO ] [REMOTE ] PFH: Full fetch complete (10500 records). [2025-10-03T20:54:12.496455] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-03T20:54:12.795899] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-03T20:54:12.899519] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-03T20:54:12.899599] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-03T20:54:12.899947] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-03T20:54:12.899998] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-03T20:54:12.900498] [DEBUG] [LOCAL ] PFH: Trimmed 10500 records to 6882 (keeping 200 days of data) [2025-10-03T20:54:12.946280] [DEBUG] [LOCAL ] PFH: Primary data saved (6882 records). [2025-10-03T20:54:12.946415] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-03T20:54:12.946503] [INFO ] [MAIN ] Update Progress: 1664/2370 symbols completed. PFH took 23.7s. Estimated remaining: 1h 39m 20s. Rate: 7.1 symbols/min [2025-10-03T20:54:13.128360] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:13.168562] [DEBUG] [LOCAL ] PFLT: Loaded 44136 existing records from primary storage. [2025-10-03T20:54:13.168894] [INFO ] [MAIN ] PFLT: Loaded 44136 existing records. [2025-10-03T20:54:13.358697] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:54:13.358937] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-03T20:54:13.359004] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-03T20:54:13.359333] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-03T20:54:13.359392] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-03T20:54:13.599408] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-03T20:54:13.758801] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:14.390728] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-03T20:54:14.567781] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:54:14.771545] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T20:54:15.190687] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-03T20:54:15.990722] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-03T20:54:16.790678] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-03T20:54:17.253863] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-03T20:54:17.298742] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T20:54:17.337486] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T20:54:17.365479] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T20:54:17.590708] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-03T20:54:18.390725] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-03T20:54:19.190717] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-03T20:54:19.299916] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T20:54:19.358206] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T20:54:19.990726] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-03T20:54:20.790706] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-03T20:54:21.590719] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-03T20:54:21.699045] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T20:54:21.815511] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-03T20:54:22.244850] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T20:54:22.247368] [INFO ] [REMOTE ] PFGC: Full fetch complete (67327 records). [2025-10-03T20:54:22.247528] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-03T20:54:22.398498] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-03T20:54:22.388028] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T20:54:22.743731] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-03T20:54:22.743827] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-03T20:54:22.745009] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-03T20:54:22.745103] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-03T20:54:22.747145] [DEBUG] [LOCAL ] PFGC: Trimmed 67327 records to 47509 (keeping 200 days of data) [2025-10-03T20:54:23.039578] [DEBUG] [LOCAL ] PFGC: Primary data saved (47509 records). [2025-10-03T20:54:23.039750] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-03T20:54:23.039900] [INFO ] [MAIN ] Update Progress: 1665/2370 symbols completed. PFGC took 45.1s. Estimated remaining: 1h 39m 13s. Rate: 7.1 symbols/min [2025-10-03T20:54:23.197629] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-03T20:54:23.227502] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:23.254413] [DEBUG] [LOCAL ] PFN: Loaded 22007 existing records from primary storage. [2025-10-03T20:54:23.254741] [INFO ] [MAIN ] PFN: Loaded 22007 existing records. [2025-10-03T20:54:23.449753] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:54:23.450032] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-03T20:54:23.450093] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-03T20:54:23.450420] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-03T20:54:23.450481] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-03T20:54:23.834224] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:23.990624] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-03T20:54:24.367348] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T20:54:24.790731] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-03T20:54:25.164456] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-03T20:54:25.427129] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T20:54:25.590686] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-03T20:54:25.639614] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T20:54:26.141605] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T20:54:26.143929] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-03T20:54:26.144048] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-03T20:54:26.144921] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:54:26.145013] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:54:26.145059] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:54:26.145187] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-03T20:54:26.145263] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-03T20:54:26.145299] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-03T20:54:26.145355] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-03T20:54:26.145441] [INFO ] [MAIN ] Update Progress: 1666/2370 symbols completed. PFE took 53.6s. Estimated remaining: 1h 39m 2s. Rate: 7.1 symbols/min [2025-10-03T20:54:26.335756] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:26.344504] [DEBUG] [LOCAL ] PFO: Loaded 6008 existing records from primary storage. [2025-10-03T20:54:26.344797] [INFO ] [MAIN ] PFO: Loaded 6008 existing records. [2025-10-03T20:54:26.400896] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-03T20:54:26.539706] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:54:26.539979] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-03T20:54:26.540033] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-03T20:54:26.540261] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-03T20:54:26.540326] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-03T20:54:26.957191] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:27.190737] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-03T20:54:27.990618] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-03T20:54:28.069524] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:54:28.470138] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T20:54:28.790694] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-03T20:54:29.001422] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T20:54:29.590724] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-03T20:54:30.119594] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T20:54:30.390683] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-03T20:54:30.660955] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T20:54:30.854680] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T20:54:31.190702] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-03T20:54:31.990877] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-03T20:54:32.790738] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-03T20:54:32.812978] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T20:54:32.814742] [INFO ] [REMOTE ] PFL: Full fetch complete (20114 records). [2025-10-03T20:54:32.814844] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-03T20:54:33.011489] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T20:54:33.359966] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-03T20:54:33.360055] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-03T20:54:33.360504] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-03T20:54:33.360546] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-03T20:54:33.361391] [DEBUG] [LOCAL ] PFL: Trimmed 20114 records to 13879 (keeping 200 days of data) [2025-10-03T20:54:33.446820] [DEBUG] [LOCAL ] PFL: Primary data saved (13879 records). [2025-10-03T20:54:33.446972] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-03T20:54:33.447064] [INFO ] [MAIN ] Update Progress: 1667/2370 symbols completed. PFL took 34.1s. Estimated remaining: 1h 38m 53s. Rate: 7.1 symbols/min [2025-10-03T20:54:33.549700] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T20:54:33.595842] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-03T20:54:33.658971] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:33.698715] [DEBUG] [LOCAL ] PFS: Loaded 35837 existing records from primary storage. [2025-10-03T20:54:33.699083] [INFO ] [MAIN ] PFS: Loaded 35837 existing records. [2025-10-03T20:54:33.894561] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:54:33.894822] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-03T20:54:33.894872] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-03T20:54:33.895156] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-03T20:54:33.895214] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-03T20:54:34.288271] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:34.323848] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T20:54:34.390679] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-03T20:54:35.190677] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-03T20:54:35.561094] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T20:54:35.990708] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-03T20:54:36.713223] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T20:54:36.790693] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-03T20:54:37.235924] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T20:54:37.590681] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-03T20:54:38.390669] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-03T20:54:38.433111] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T20:54:38.628796] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T20:54:39.190695] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-03T20:54:39.365334] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T20:54:39.659836] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T20:54:39.990712] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-03T20:54:40.790690] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-03T20:54:41.195610] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T20:54:41.590685] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-03T20:54:42.390727] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-03T20:54:42.663871] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T20:54:42.704477] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T20:54:43.190718] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-03T20:54:43.893351] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T20:54:43.990709] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-03T20:54:44.482349] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T20:54:44.790688] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-03T20:54:45.397710] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T20:54:45.590730] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-03T20:54:45.943809] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T20:54:46.189886] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T20:54:46.390692] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-03T20:54:47.190691] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-03T20:54:47.990638] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-03T20:54:48.243822] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T20:54:48.452701] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T20:54:48.790713] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-03T20:54:49.514806] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T20:54:49.590753] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-03T20:54:49.759792] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T20:54:49.761521] [INFO ] [REMOTE ] PFN: Full fetch complete (31001 records). [2025-10-03T20:54:49.761609] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-03T20:54:50.152953] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-03T20:54:50.153037] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-03T20:54:50.153781] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-03T20:54:50.153846] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-03T20:54:50.156123] [DEBUG] [LOCAL ] PFN: Trimmed 31001 records to 22188 (keeping 200 days of data) [2025-10-03T20:54:50.291056] [DEBUG] [LOCAL ] PFN: Primary data saved (22188 records). [2025-10-03T20:54:50.291185] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-03T20:54:50.291288] [INFO ] [MAIN ] Update Progress: 1668/2370 symbols completed. PFN took 27.3s. Estimated remaining: 1h 38m 48s. Rate: 7.1 symbols/min [2025-10-03T20:54:50.395796] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-03T20:54:50.482842] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:50.514008] [DEBUG] [LOCAL ] PFSI: Loaded 28951 existing records from primary storage. [2025-10-03T20:54:50.514326] [INFO ] [MAIN ] PFSI: Loaded 28951 existing records. [2025-10-03T20:54:50.703087] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:54:50.703317] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-03T20:54:50.703365] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-03T20:54:50.703569] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-03T20:54:50.703628] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-03T20:54:51.097717] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:51.190679] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-03T20:54:51.360819] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T20:54:51.805918] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T20:54:51.808952] [INFO ] [REMOTE ] PFLT: Full fetch complete (63872 records). [2025-10-03T20:54:51.809054] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-03T20:54:52.005132] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-03T20:54:52.138480] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T20:54:52.253385] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-03T20:54:52.253490] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-03T20:54:52.254696] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-03T20:54:52.254774] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-03T20:54:52.256389] [DEBUG] [LOCAL ] PFLT: Trimmed 63872 records to 44496 (keeping 200 days of data) [2025-10-03T20:54:52.546200] [DEBUG] [LOCAL ] PFLT: Primary data saved (44496 records). [2025-10-03T20:54:52.546336] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-03T20:54:52.546422] [INFO ] [MAIN ] Update Progress: 1669/2370 symbols completed. PFLT took 39.6s. Estimated remaining: 1h 38m 37s. Rate: 7.1 symbols/min [2025-10-03T20:54:52.736458] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:54:52.736757] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-03T20:54:52.736815] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-03T20:54:52.736929] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-03T20:54:52.736971] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-03T20:54:52.737015] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-03T20:54:52.737048] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-03T20:54:52.796947] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-03T20:54:53.139629] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:54:53.302933] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T20:54:53.590691] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-03T20:54:54.274540] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:54:54.390682] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-03T20:54:55.190699] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-03T20:54:55.786416] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T20:54:55.843877] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T20:54:55.990704] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-03T20:54:56.053927] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T20:54:56.790686] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-03T20:54:57.590712] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-03T20:54:58.041447] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T20:54:58.269259] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T20:54:58.390691] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-03T20:54:58.450732] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T20:54:59.190749] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-03T20:54:59.990665] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-03T20:55:00.129203] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T20:55:00.470073] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T20:55:00.790693] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-03T20:55:01.471461] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T20:55:01.590691] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-03T20:55:02.390686] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-03T20:55:03.065356] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T20:55:03.184401] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-03T20:55:03.195971] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-03T20:55:03.294917] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:55:03.990695] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-03T20:55:04.218220] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T20:55:04.220565] [INFO ] [REMOTE ] PFS: Full fetch complete (51803 records). [2025-10-03T20:55:04.220693] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-03T20:55:04.637145] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-03T20:55:04.637236] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-03T20:55:04.638359] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-03T20:55:04.638427] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-03T20:55:04.639681] [DEBUG] [LOCAL ] PFS: Trimmed 51803 records to 36112 (keeping 200 days of data) [2025-10-03T20:55:04.808481] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-03T20:55:04.872321] [DEBUG] [LOCAL ] PFS: Primary data saved (36112 records). [2025-10-03T20:55:04.872490] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-03T20:55:04.874843] [INFO ] [MAIN ] Update Progress: 1670/2370 symbols completed. PFS took 31.4s. Estimated remaining: 1h 38m 30s. Rate: 7.1 symbols/min [2025-10-03T20:55:05.078308] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:05.087268] [DEBUG] [LOCAL ] PGP: Loaded 5544 existing records from primary storage. [2025-10-03T20:55:05.087516] [INFO ] [MAIN ] PGP: Loaded 5544 existing records. [2025-10-03T20:55:05.288892] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:05.289106] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-03T20:55:05.289156] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-03T20:55:05.289382] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-03T20:55:05.289473] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-03T20:55:05.595874] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-03T20:55:05.665593] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:06.175105] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T20:55:06.250184] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T20:55:06.258711] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:55:06.259388] [INFO ] [REMOTE ] PFO: Full fetch complete (7941 records). [2025-10-03T20:55:06.259457] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-03T20:55:06.395780] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-03T20:55:06.640629] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-03T20:55:06.640739] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-03T20:55:06.640963] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-03T20:55:06.641005] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-03T20:55:06.641466] [DEBUG] [LOCAL ] PFO: Trimmed 7941 records to 6032 (keeping 200 days of data) [2025-10-03T20:55:06.679933] [DEBUG] [LOCAL ] PFO: Primary data saved (6032 records). [2025-10-03T20:55:06.680062] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-03T20:55:06.680146] [INFO ] [MAIN ] Update Progress: 1671/2370 symbols completed. PFO took 40.5s. Estimated remaining: 1h 38m 19s. Rate: 7.1 symbols/min [2025-10-03T20:55:06.861324] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:06.930058] [DEBUG] [LOCAL ] PGR: Loaded 53322 existing records from primary storage. [2025-10-03T20:55:06.930397] [INFO ] [MAIN ] PGR: Loaded 53322 existing records. [2025-10-03T20:55:07.132778] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:07.133113] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-03T20:55:07.133174] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-03T20:55:07.133639] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-10-03T20:55:07.133742] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-03T20:55:07.193580] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-03T20:55:07.275368] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T20:55:07.528733] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:07.990703] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-03T20:55:08.731578] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T20:55:08.790733] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-03T20:55:09.591506] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-03T20:55:09.595110] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-03T20:55:10.359277] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T20:55:10.390706] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-03T20:55:10.690431] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T20:55:11.109343] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T20:55:11.190668] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-03T20:55:11.990732] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-03T20:55:12.000977] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T20:55:12.790689] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-03T20:55:13.491760] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T20:55:13.590689] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-03T20:55:13.838180] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T20:55:14.390723] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-03T20:55:15.190703] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-03T20:55:15.848442] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-03T20:55:15.920209] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T20:55:15.995801] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-03T20:55:16.013327] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T20:55:16.790716] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-03T20:55:17.468709] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-03T20:55:17.590701] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-03T20:55:18.390636] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-03T20:55:18.558980] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T20:55:19.079223] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T20:55:19.190738] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-03T20:55:19.990683] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-03T20:55:20.184027] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T20:55:20.466286] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T20:55:20.790633] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-03T20:55:20.936295] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:55:21.590737] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-03T20:55:21.622632] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T20:55:22.390665] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-03T20:55:23.190688] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-03T20:55:23.663119] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T20:55:23.690461] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T20:55:23.990722] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-03T20:55:24.790745] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-03T20:55:25.555023] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-03T20:55:25.596210] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-03T20:55:25.619086] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T20:55:26.134353] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T20:55:26.136616] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-03T20:55:26.136920] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-03T20:55:26.137910] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:55:26.138027] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:55:26.138104] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:55:26.138199] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-03T20:55:26.138305] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-03T20:55:26.138347] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-03T20:55:26.138386] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-03T20:55:26.138447] [INFO ] [MAIN ] Update Progress: 1672/2370 symbols completed. PG took 33.6s. Estimated remaining: 1h 38m 15s. Rate: 7.1 symbols/min [2025-10-03T20:55:26.329501] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:26.353294] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T20:55:26.398236] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-03T20:55:26.401742] [DEBUG] [LOCAL ] PGRE: Loaded 46986 existing records from primary storage. [2025-10-03T20:55:26.402173] [INFO ] [MAIN ] PGRE: Loaded 46986 existing records. [2025-10-03T20:55:26.601197] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:26.601720] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-03T20:55:26.601794] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-03T20:55:26.602108] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-03T20:55:26.602166] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-03T20:55:26.987265] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:27.190747] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-03T20:55:27.789031] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T20:55:27.800256] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T20:55:27.990695] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-03T20:55:28.790743] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-03T20:55:29.521483] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T20:55:29.590743] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-03T20:55:30.390728] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-03T20:55:30.774249] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-03T20:55:30.920847] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T20:55:31.190701] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-03T20:55:31.964990] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T20:55:31.990688] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-03T20:55:32.790701] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-03T20:55:33.243048] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T20:55:33.335204] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T20:55:33.373191] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T20:55:33.374145] [INFO ] [REMOTE ] PGP: Full fetch complete (7864 records). [2025-10-03T20:55:33.374245] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-03T20:55:33.596679] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-03T20:55:33.760137] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-03T20:55:33.760214] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-03T20:55:33.760445] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-03T20:55:33.760508] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-03T20:55:33.760955] [DEBUG] [LOCAL ] PGP: Trimmed 7864 records to 5609 (keeping 200 days of data) [2025-10-03T20:55:33.795889] [DEBUG] [LOCAL ] PGP: Primary data saved (5609 records). [2025-10-03T20:55:33.796029] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-03T20:55:33.796172] [INFO ] [MAIN ] Update Progress: 1673/2370 symbols completed. PGP took 28.9s. Estimated remaining: 1h 38m 6s. Rate: 7.1 symbols/min [2025-10-03T20:55:33.976378] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:33.986225] [DEBUG] [LOCAL ] PGZ: Loaded 5505 existing records from primary storage. [2025-10-03T20:55:33.986460] [INFO ] [MAIN ] PGZ: Loaded 5505 existing records. [2025-10-03T20:55:34.178570] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:34.178854] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-03T20:55:34.178905] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-03T20:55:34.179071] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-03T20:55:34.179130] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-03T20:55:34.398731] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-03T20:55:34.566389] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:34.718348] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T20:55:34.720170] [INFO ] [REMOTE ] PFSI: Full fetch complete (41088 records). [2025-10-03T20:55:34.720259] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-03T20:55:35.129910] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-03T20:55:35.129991] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-03T20:55:35.130946] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-03T20:55:35.131011] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-03T20:55:35.132022] [DEBUG] [LOCAL ] PFSI: Trimmed 41088 records to 29124 (keeping 200 days of data) [2025-10-03T20:55:35.199466] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-03T20:55:35.325162] [DEBUG] [LOCAL ] PFSI: Primary data saved (29124 records). [2025-10-03T20:55:35.325313] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-03T20:55:35.325429] [INFO ] [MAIN ] Update Progress: 1674/2370 symbols completed. PFSI took 45.0s. Estimated remaining: 1h 37m 55s. Rate: 7.1 symbols/min [2025-10-03T20:55:35.509730] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:35.547387] [DEBUG] [LOCAL ] PH: Loaded 38286 existing records from primary storage. [2025-10-03T20:55:35.547758] [INFO ] [MAIN ] PH: Loaded 38286 existing records. [2025-10-03T20:55:35.747519] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:35.747814] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-03T20:55:35.747864] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-03T20:55:35.748184] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-10-03T20:55:35.748244] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-03T20:55:35.994756] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-03T20:55:36.169296] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:36.420148] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T20:55:36.630578] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T20:55:36.778503] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T20:55:36.790618] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-03T20:55:37.590727] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-03T20:55:37.691085] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T20:55:38.390703] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-03T20:55:39.190639] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-03T20:55:39.258623] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T20:55:39.612751] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T20:55:39.927148] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T20:55:39.990696] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-03T20:55:40.691830] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T20:55:40.790714] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-03T20:55:41.590729] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-03T20:55:42.325828] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T20:55:42.390624] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-03T20:55:42.424874] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T20:55:43.113330] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T20:55:43.190701] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-03T20:55:43.990694] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-03T20:55:44.716473] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T20:55:44.790696] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-03T20:55:44.983723] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T20:55:45.590682] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-03T20:55:46.262016] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T20:55:46.390720] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-03T20:55:47.112148] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T20:55:47.190738] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-03T20:55:47.316732] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T20:55:47.801138] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T20:55:47.990684] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-03T20:55:48.790749] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-03T20:55:49.590669] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-03T20:55:50.077276] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T20:55:50.183804] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T20:55:50.375121] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T20:55:50.390698] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-03T20:55:51.190713] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-03T20:55:51.735717] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T20:55:51.736607] [INFO ] [REMOTE ] PGZ: Full fetch complete (9021 records). [2025-10-03T20:55:51.736713] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-03T20:55:51.995898] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-03T20:55:52.146435] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-03T20:55:52.146781] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-03T20:55:52.147254] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-03T20:55:52.147358] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-03T20:55:52.148230] [DEBUG] [LOCAL ] PGZ: Trimmed 9021 records to 5549 (keeping 200 days of data) [2025-10-03T20:55:52.214325] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T20:55:52.216305] [DEBUG] [LOCAL ] PGZ: Primary data saved (5549 records). [2025-10-03T20:55:52.226823] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-03T20:55:52.227268] [INFO ] [MAIN ] Update Progress: 1675/2370 symbols completed. PGZ took 18.4s. Estimated remaining: 1h 37m 50s. Rate: 7.1 symbols/min [2025-10-03T20:55:52.403249] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:52.415876] [DEBUG] [LOCAL ] PHD: Loaded 10664 existing records from primary storage. [2025-10-03T20:55:52.416149] [INFO ] [MAIN ] PHD: Loaded 10664 existing records. [2025-10-03T20:55:52.605567] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:52.605855] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-03T20:55:52.605905] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-03T20:55:52.611730] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T20:55:52.611851] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-03T20:55:52.612121] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-03T20:55:52.692549] [INFO ] [REMOTE ] PGR: Full fetch complete (76169 records). [2025-10-03T20:55:52.707788] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-03T20:55:52.739178] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:55:52.743275] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:55:52.743754] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:55:52.754440] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-03T20:55:52.759721] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-03T20:55:52.764929] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-03T20:55:52.786336] [DEBUG] [LOCAL ] PGR: Deleted derivative data file. [2025-10-03T20:55:52.791580] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-03T20:55:52.829795] [INFO ] [MAIN ] Update Progress: 1676/2370 symbols completed. PGR took 46.1s. Estimated remaining: 1h 37m 39s. Rate: 7.1 symbols/min [2025-10-03T20:55:53.295748] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:55:53.321382] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:53.365687] [DEBUG] [LOCAL ] PHG: Loaded 46334 existing records from primary storage. [2025-10-03T20:55:53.366083] [INFO ] [MAIN ] PHG: Loaded 46334 existing records. [2025-10-03T20:55:53.566849] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:55:53.567066] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-03T20:55:53.567119] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-03T20:55:53.567390] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-03T20:55:53.567450] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-03T20:55:53.599700] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-03T20:55:53.955612] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:55:54.390690] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-03T20:55:54.830546] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T20:55:55.190734] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-03T20:55:55.397787] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T20:55:55.990713] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-03T20:55:56.044522] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T20:55:56.112130] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T20:55:56.790688] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-03T20:55:57.430226] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T20:55:57.433733] [INFO ] [REMOTE ] PGRE: Full fetch complete (64015 records). [2025-10-03T20:55:57.433915] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-03T20:55:57.594694] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-03T20:55:57.755453] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T20:55:57.917828] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-03T20:55:57.917921] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-03T20:55:57.919055] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-03T20:55:57.919139] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-03T20:55:57.920782] [DEBUG] [LOCAL ] PGRE: Trimmed 64015 records to 47369 (keeping 200 days of data) [2025-10-03T20:55:58.211514] [DEBUG] [LOCAL ] PGRE: Primary data saved (47369 records). [2025-10-03T20:55:58.211767] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-03T20:55:58.211927] [INFO ] [MAIN ] Update Progress: 1677/2370 symbols completed. PGRE took 32.1s. Estimated remaining: 1h 37m 29s. Rate: 7.1 symbols/min [2025-10-03T20:55:58.390721] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-03T20:55:59.190697] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-03T20:55:59.290578] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T20:55:59.543159] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T20:55:59.990686] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-03T20:56:00.790712] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-03T20:56:01.117452] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T20:56:01.590720] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-03T20:56:01.829118] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T20:56:01.847986] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T20:56:02.390717] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-03T20:56:03.190727] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-03T20:56:03.391548] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T20:56:03.908461] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T20:56:03.934093] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T20:56:03.990697] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-03T20:56:04.790701] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-03T20:56:05.590721] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-03T20:56:05.701685] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T20:56:05.845250] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T20:56:06.390706] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-03T20:56:07.074900] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T20:56:07.190705] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-03T20:56:07.990713] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-03T20:56:08.220337] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T20:56:08.465056] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T20:56:08.709396] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T20:56:08.790697] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-03T20:56:09.590705] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-03T20:56:10.229731] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T20:56:10.390710] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-03T20:56:11.190748] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-03T20:56:11.379527] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T20:56:11.480133] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T20:56:11.482041] [INFO ] [REMOTE ] PH: Full fetch complete (56179 records). [2025-10-03T20:56:11.482156] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-03T20:56:11.939435] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-03T20:56:11.939595] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-03T20:56:11.940720] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-03T20:56:11.940863] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-03T20:56:11.950222] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T20:56:11.954756] [DEBUG] [LOCAL ] PH: Trimmed 56179 records to 38442 (keeping 200 days of data) [2025-10-03T20:56:12.017047] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-03T20:56:12.236792] [DEBUG] [LOCAL ] PH: Primary data saved (38442 records). [2025-10-03T20:56:12.236972] [INFO ] [MAIN ] PH: Full history saved. [2025-10-03T20:56:12.237130] [INFO ] [MAIN ] Update Progress: 1678/2370 symbols completed. PH took 36.9s. Estimated remaining: 1h 37m 23s. Rate: 7.1 symbols/min [2025-10-03T20:56:12.790733] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-03T20:56:13.561420] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T20:56:13.590628] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-03T20:56:13.774192] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T20:56:14.390678] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-03T20:56:14.689299] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T20:56:15.190716] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-03T20:56:15.939699] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T20:56:15.941220] [INFO ] [REMOTE ] PHD: Full fetch complete (14950 records). [2025-10-03T20:56:15.941298] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-03T20:56:16.362371] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-03T20:56:16.362470] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-03T20:56:16.378858] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-03T20:56:16.392220] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-03T20:56:16.398594] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T20:56:16.398894] [DEBUG] [LOCAL ] PHD: Trimmed 14950 records to 10840 (keeping 200 days of data) [2025-10-03T20:56:16.412048] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-03T20:56:16.485133] [DEBUG] [LOCAL ] PHD: Primary data saved (10840 records). [2025-10-03T20:56:16.485296] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-03T20:56:16.485386] [INFO ] [MAIN ] Update Progress: 1679/2370 symbols completed. PHD took 24.3s. Estimated remaining: 1h 37m 13s. Rate: 7.1 symbols/min [2025-10-03T20:56:18.180120] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T20:56:18.190525] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-03T20:56:19.660754] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T20:56:19.670924] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-03T20:56:20.841883] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T20:56:20.844536] [INFO ] [REMOTE ] PHG: Full fetch complete (65709 records). [2025-10-03T20:56:20.844695] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-03T20:56:21.274051] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-03T20:56:21.274152] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-03T20:56:21.275408] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-03T20:56:21.275501] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-03T20:56:21.277009] [DEBUG] [LOCAL ] PHG: Trimmed 65709 records to 46644 (keeping 200 days of data) [2025-10-03T20:56:21.574748] [DEBUG] [LOCAL ] PHG: Primary data saved (46644 records). [2025-10-03T20:56:21.574893] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-03T20:56:21.574982] [INFO ] [MAIN ] Update Progress: 1680/2370 symbols completed. PHG took 28.7s. Estimated remaining: 1h 37m 3s. Rate: 7.1 symbols/min [2025-10-03T20:56:22.362998] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:22.396465] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:22.288775] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:22.411613] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:22.411876] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-03T20:56:22.412763] [DEBUG] [LOCAL ] PHK: No existing data file found in primary storage. [2025-10-03T20:56:22.412950] [WARN ] [MAIN ] PHK: No existing data found, performing full refresh instead. [2025-10-03T20:56:22.413169] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-03T20:56:22.413557] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-03T20:56:22.413790] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-03T20:56:22.413849] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-03T20:56:22.412877] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-03T20:56:22.433127] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-03T20:56:22.433213] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-03T20:56:22.444035] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-03T20:56:22.444217] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-03T20:56:22.657272] [DEBUG] [LOCAL ] PHI: Loaded 15208 existing records from primary storage. [2025-10-03T20:56:22.686439] [INFO ] [MAIN ] PHI: Loaded 15208 existing records. [2025-10-03T20:56:22.985078] [DEBUG] [LOCAL ] PHIN: Loaded 32840 existing records from primary storage. [2025-10-03T20:56:23.044136] [INFO ] [MAIN ] PHIN: Loaded 32840 existing records. [2025-10-03T20:56:23.379130] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:56:23.395042] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-03T20:56:23.499970] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-03T20:56:23.547973] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-03T20:56:23.536840] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:23.579247] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-03T20:56:23.683408] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-03T20:56:23.732141] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:23.777218] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:56:23.793005] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-03T20:56:23.808152] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-03T20:56:23.824712] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-03T20:56:23.850055] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-03T20:56:23.871306] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-03T20:56:24.463688] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:24.479579] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-03T20:56:24.542449] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:24.542821] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-03T20:56:25.251227] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T20:56:25.257871] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-03T20:56:25.315020] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T20:56:25.319020] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-03T20:56:25.719379] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T20:56:25.730258] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-03T20:56:26.023866] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T20:56:26.028081] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-03T20:56:26.069083] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T20:56:26.077702] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-03T20:56:26.665096] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T20:56:26.672385] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-03T20:56:26.964822] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T20:56:26.968216] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-03T20:56:27.532048] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T20:56:27.539709] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-03T20:56:27.650213] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T20:56:27.678280] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T20:56:27.860238] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T20:56:27.990686] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-03T20:56:28.790717] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-03T20:56:29.196493] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T20:56:29.590724] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-03T20:56:29.732185] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T20:56:29.813346] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T20:56:30.390632] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-03T20:56:30.693012] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T20:56:31.190694] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-03T20:56:31.990727] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-03T20:56:32.360098] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T20:56:32.698807] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T20:56:32.790715] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-03T20:56:33.055685] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T20:56:33.590698] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-03T20:56:34.018128] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T20:56:34.390730] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-03T20:56:35.016343] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T20:56:35.190720] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-03T20:56:35.428103] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T20:56:35.990682] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-03T20:56:36.697890] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T20:56:36.790676] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-03T20:56:37.019363] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T20:56:37.590683] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-03T20:56:38.084773] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T20:56:38.390715] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-03T20:56:38.681615] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T20:56:39.190697] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-03T20:56:39.405334] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T20:56:39.990638] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-03T20:56:40.361358] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T20:56:40.790684] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-03T20:56:41.388597] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T20:56:41.590700] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-03T20:56:42.390716] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-03T20:56:42.777588] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T20:56:42.898999] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T20:56:43.190681] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-03T20:56:43.748212] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T20:56:43.990695] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-03T20:56:44.720527] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T20:56:44.790697] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-03T20:56:44.958604] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T20:56:44.960240] [INFO ] [REMOTE ] PHI: Full fetch complete (21100 records). [2025-10-03T20:56:44.960346] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-03T20:56:45.368137] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-03T20:56:45.368222] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-03T20:56:45.368682] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-03T20:56:45.368745] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-03T20:56:45.369380] [DEBUG] [LOCAL ] PHI: Trimmed 21100 records to 15378 (keeping 200 days of data) [2025-10-03T20:56:45.468211] [DEBUG] [LOCAL ] PHI: Primary data saved (15378 records). [2025-10-03T20:56:45.468372] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-03T20:56:45.468464] [INFO ] [MAIN ] Update Progress: 1681/2370 symbols completed. PHI took 23.9s. Estimated remaining: 1h 37m 1s. Rate: 7.1 symbols/min [2025-10-03T20:56:45.595757] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-03T20:56:45.658557] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:45.694616] [DEBUG] [LOCAL ] PHR: Loaded 37647 existing records from primary storage. [2025-10-03T20:56:45.694955] [INFO ] [MAIN ] PHR: Loaded 37647 existing records. [2025-10-03T20:56:45.892212] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:56:45.892450] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-03T20:56:45.892500] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-03T20:56:45.892788] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-03T20:56:45.892848] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-03T20:56:46.281632] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:46.390680] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-03T20:56:46.694400] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T20:56:47.191555] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-03T20:56:47.195700] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T20:56:47.798887] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T20:56:47.990711] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-03T20:56:48.790696] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-03T20:56:48.985913] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T20:56:49.590633] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-03T20:56:49.684909] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T20:56:49.882895] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T20:56:49.884912] [INFO ] [REMOTE ] PHK: Full fetch complete (39481 records). [2025-10-03T20:56:49.885048] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-03T20:56:50.289749] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-03T20:56:50.289832] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-03T20:56:50.290663] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-03T20:56:50.290732] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-03T20:56:50.291687] [DEBUG] [LOCAL ] PHK: Trimmed 39481 records to 26746 (keeping 200 days of data) [2025-10-03T20:56:50.390805] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-03T20:56:50.457896] [DEBUG] [LOCAL ] PHK: Primary data saved (26746 records). [2025-10-03T20:56:50.458029] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-03T20:56:50.458106] [INFO ] [MAIN ] Update Progress: 1682/2370 symbols completed. PHK took 28.9s. Estimated remaining: 1h 36m 51s. Rate: 7.1 symbols/min [2025-10-03T20:56:50.638504] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:50.684967] [DEBUG] [LOCAL ] PII: Loaded 49297 existing records from primary storage. [2025-10-03T20:56:50.685319] [INFO ] [MAIN ] PII: Loaded 49297 existing records. [2025-10-03T20:56:50.884937] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:56:50.885295] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-03T20:56:50.885357] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-03T20:56:50.885605] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-03T20:56:50.885697] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-03T20:56:51.192117] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-03T20:56:51.224440] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T20:56:51.315588] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:51.990723] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-03T20:56:52.491847] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T20:56:52.550536] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T20:56:52.782306] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T20:56:52.784199] [INFO ] [REMOTE ] PHIN: Full fetch complete (48139 records). [2025-10-03T20:56:52.784304] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-03T20:56:52.796616] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-03T20:56:53.195158] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-03T20:56:53.195262] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-03T20:56:53.196402] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-03T20:56:53.196480] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-03T20:56:53.197718] [DEBUG] [LOCAL ] PHIN: Trimmed 48139 records to 33036 (keeping 200 days of data) [2025-10-03T20:56:53.404588] [DEBUG] [LOCAL ] PHIN: Primary data saved (33036 records). [2025-10-03T20:56:53.404769] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-03T20:56:53.404893] [INFO ] [MAIN ] Update Progress: 1683/2370 symbols completed. PHIN took 31.8s. Estimated remaining: 1h 36m 40s. Rate: 7.1 symbols/min [2025-10-03T20:56:53.580499] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:56:53.588106] [DEBUG] [LOCAL ] PIM: Loaded 4816 existing records from primary storage. [2025-10-03T20:56:53.588312] [INFO ] [MAIN ] PIM: Loaded 4816 existing records. [2025-10-03T20:56:53.600278] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-03T20:56:53.780746] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:56:53.780997] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-03T20:56:53.781054] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-03T20:56:53.781232] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-03T20:56:53.781304] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-03T20:56:54.187891] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T20:56:54.194111] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:56:54.390688] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-03T20:56:55.190676] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-03T20:56:55.570615] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T20:56:55.860797] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T20:56:55.914407] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T20:56:55.990707] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-03T20:56:56.686160] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T20:56:56.790713] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-03T20:56:57.590707] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-03T20:56:58.355096] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T20:56:58.390669] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-03T20:56:58.888686] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T20:56:59.190687] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-03T20:56:59.527220] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T20:56:59.990721] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-03T20:57:00.790714] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-03T20:57:01.152707] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T20:57:01.590727] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-03T20:57:01.608221] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T20:57:01.992354] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T20:57:02.390717] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-03T20:57:02.753050] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T20:57:02.755171] [INFO ] [REMOTE ] PHM: Full fetch complete (74555 records). [2025-10-03T20:57:02.755281] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-03T20:57:02.756369] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T20:57:02.756473] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T20:57:02.756518] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T20:57:02.756576] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-03T20:57:02.756688] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-03T20:57:02.756757] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-03T20:57:02.756811] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-03T20:57:02.756898] [INFO ] [MAIN ] Update Progress: 1684/2370 symbols completed. PHM took 41.2s. Estimated remaining: 1h 36m 32s. Rate: 7.1 symbols/min [2025-10-03T20:57:02.940239] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:02.956239] [DEBUG] [LOCAL ] PINE: Loaded 14200 existing records from primary storage. [2025-10-03T20:57:02.956487] [INFO ] [MAIN ] PINE: Loaded 14200 existing records. [2025-10-03T20:57:03.165511] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T20:57:03.171623] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:03.179821] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-03T20:57:03.179996] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-03T20:57:03.180351] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-03T20:57:03.180412] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-03T20:57:03.195801] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-03T20:57:03.556699] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:03.959276] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T20:57:03.990637] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-03T20:57:04.781910] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T20:57:04.790606] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-03T20:57:05.547601] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T20:57:05.590745] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-03T20:57:06.390687] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-03T20:57:07.043543] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T20:57:07.190714] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-03T20:57:07.260782] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T20:57:07.990721] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-03T20:57:08.697009] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T20:57:08.777751] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T20:57:08.790617] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-03T20:57:09.590705] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-03T20:57:10.347762] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T20:57:10.375969] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T20:57:10.390613] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-03T20:57:11.190692] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-03T20:57:11.990728] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-03T20:57:12.103140] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:57:12.785867] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T20:57:12.790602] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-03T20:57:13.078912] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T20:57:13.389976] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T20:57:13.390851] [INFO ] [REMOTE ] PIM: Full fetch complete (6523 records). [2025-10-03T20:57:13.390935] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-03T20:57:13.599521] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-03T20:57:13.784157] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-03T20:57:13.784238] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-03T20:57:13.784429] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-03T20:57:13.784471] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-03T20:57:13.784931] [DEBUG] [LOCAL ] PIM: Trimmed 6523 records to 4831 (keeping 200 days of data) [2025-10-03T20:57:13.814036] [DEBUG] [LOCAL ] PIM: Primary data saved (4831 records). [2025-10-03T20:57:13.814171] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-03T20:57:13.814296] [INFO ] [MAIN ] Update Progress: 1685/2370 symbols completed. PIM took 20.4s. Estimated remaining: 1h 36m 25s. Rate: 7.1 symbols/min [2025-10-03T20:57:13.993203] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:14.046222] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-10-03T20:57:14.046607] [INFO ] [MAIN ] PINS: Loaded 54083 existing records. [2025-10-03T20:57:14.239149] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:14.239362] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-03T20:57:14.239410] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-03T20:57:14.239667] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-03T20:57:14.239758] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-03T20:57:14.404605] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-03T20:57:14.689019] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:14.770909] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T20:57:15.190726] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-03T20:57:15.990680] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-03T20:57:16.476274] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T20:57:16.602004] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T20:57:16.604237] [INFO ] [REMOTE ] PHR: Full fetch complete (52449 records). [2025-10-03T20:57:16.604334] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-03T20:57:16.798093] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-03T20:57:17.025256] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-03T20:57:17.025405] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-03T20:57:17.026362] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-03T20:57:17.026509] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-03T20:57:17.027848] [DEBUG] [LOCAL ] PHR: Trimmed 52449 records to 37977 (keeping 200 days of data) [2025-10-03T20:57:17.123803] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T20:57:17.269699] [DEBUG] [LOCAL ] PHR: Primary data saved (37977 records). [2025-10-03T20:57:17.269842] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-03T20:57:17.269943] [INFO ] [MAIN ] Update Progress: 1686/2370 symbols completed. PHR took 31.8s. Estimated remaining: 1h 36m 14s. Rate: 7.1 symbols/min [2025-10-03T20:57:17.450026] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:17.466169] [DEBUG] [LOCAL ] PIPR: Loaded 14894 existing records from primary storage. [2025-10-03T20:57:17.466409] [INFO ] [MAIN ] PIPR: Loaded 14894 existing records. [2025-10-03T20:57:17.595769] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-03T20:57:17.660100] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:17.660290] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-03T20:57:17.660338] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-03T20:57:17.660554] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-03T20:57:17.660612] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-03T20:57:18.045290] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:18.390682] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-03T20:57:18.625563] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T20:57:19.023481] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-03T20:57:19.190693] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-03T20:57:19.990762] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-03T20:57:20.152513] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T20:57:20.348737] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T20:57:20.790672] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-03T20:57:20.939953] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T20:57:21.590628] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-03T20:57:21.753756] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T20:57:22.390717] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-03T20:57:22.596804] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T20:57:23.190625] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-03T20:57:23.361431] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T20:57:23.990624] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-03T20:57:24.275072] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T20:57:24.790716] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-03T20:57:25.590680] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-03T20:57:25.719576] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T20:57:26.390730] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-03T20:57:26.500735] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T20:57:26.912666] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T20:57:27.190734] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-03T20:57:27.990695] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-03T20:57:28.357884] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T20:57:28.380200] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T20:57:28.790728] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-03T20:57:29.046625] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T20:57:29.590733] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-03T20:57:30.390692] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-03T20:57:30.516807] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T20:57:30.537942] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:57:31.190746] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-03T20:57:31.677515] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T20:57:31.990743] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-03T20:57:32.106575] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T20:57:32.790721] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-03T20:57:33.590715] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-03T20:57:33.705336] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T20:57:34.332405] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T20:57:34.333717] [INFO ] [REMOTE ] PINE: Full fetch complete (21077 records). [2025-10-03T20:57:34.333840] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-03T20:57:34.395954] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-03T20:57:34.762136] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-03T20:57:34.762269] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-03T20:57:34.763059] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-03T20:57:34.763176] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-03T20:57:34.764745] [DEBUG] [LOCAL ] PINE: Trimmed 21077 records to 14278 (keeping 200 days of data) [2025-10-03T20:57:34.871084] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T20:57:34.910849] [DEBUG] [LOCAL ] PINE: Primary data saved (14278 records). [2025-10-03T20:57:34.911051] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-03T20:57:34.911181] [INFO ] [MAIN ] Update Progress: 1687/2370 symbols completed. PINE took 32.2s. Estimated remaining: 1h 36m 9s. Rate: 7.1 symbols/min [2025-10-03T20:57:35.103452] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:35.127281] [DEBUG] [LOCAL ] PJT: Loaded 21733 existing records from primary storage. [2025-10-03T20:57:35.127627] [INFO ] [MAIN ] PJT: Loaded 21733 existing records. [2025-10-03T20:57:35.199554] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-03T20:57:35.344635] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:35.344952] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-03T20:57:35.345046] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-03T20:57:35.345374] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-03T20:57:35.345437] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-03T20:57:35.759078] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:35.899811] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T20:57:35.902897] [INFO ] [REMOTE ] PII: Full fetch complete (71240 records). [2025-10-03T20:57:35.903027] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-03T20:57:35.999211] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-03T20:57:36.339963] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-03T20:57:36.340177] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-03T20:57:36.342978] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-03T20:57:36.343050] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-03T20:57:36.344948] [DEBUG] [LOCAL ] PII: Trimmed 71240 records to 49663 (keeping 200 days of data) [2025-10-03T20:57:36.685188] [DEBUG] [LOCAL ] PII: Primary data saved (49663 records). [2025-10-03T20:57:36.685351] [INFO ] [MAIN ] PII: Full history saved. [2025-10-03T20:57:36.686163] [INFO ] [MAIN ] Update Progress: 1688/2370 symbols completed. PII took 46.2s. Estimated remaining: 1h 35m 58s. Rate: 7.1 symbols/min [2025-10-03T20:57:36.798690] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-03T20:57:36.878077] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:36.936898] [DEBUG] [LOCAL ] PK: Loaded 53206 existing records from primary storage. [2025-10-03T20:57:36.937237] [INFO ] [MAIN ] PK: Loaded 53206 existing records. [2025-10-03T20:57:37.135748] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:37.136467] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-03T20:57:37.136631] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-03T20:57:37.137089] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-03T20:57:37.137151] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-03T20:57:37.261597] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T20:57:37.553917] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:37.584901] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-03T20:57:37.595974] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-03T20:57:38.056802] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T20:57:38.390674] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-03T20:57:38.698350] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T20:57:39.190715] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-03T20:57:39.621207] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T20:57:39.990709] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-03T20:57:40.790672] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-03T20:57:41.037147] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T20:57:41.590720] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-03T20:57:41.924625] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T20:57:42.353060] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T20:57:42.390666] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-03T20:57:42.828603] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T20:57:43.069970] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T20:57:43.190698] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-03T20:57:43.990708] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-03T20:57:44.089381] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T20:57:44.790716] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-03T20:57:45.590711] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-03T20:57:45.785939] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T20:57:46.283723] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T20:57:46.284859] [INFO ] [REMOTE ] PIPR: Full fetch complete (20505 records). [2025-10-03T20:57:46.284935] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-03T20:57:46.394532] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-03T20:57:46.681936] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-03T20:57:46.682045] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-03T20:57:46.682558] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-03T20:57:46.682639] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-03T20:57:46.683979] [DEBUG] [LOCAL ] PIPR: Trimmed 20505 records to 14998 (keeping 200 days of data) [2025-10-03T20:57:46.785549] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-03T20:57:46.825296] [DEBUG] [LOCAL ] PIPR: Primary data saved (14998 records). [2025-10-03T20:57:46.825452] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-03T20:57:46.825545] [INFO ] [MAIN ] Update Progress: 1689/2370 symbols completed. PIPR took 29.6s. Estimated remaining: 1h 35m 51s. Rate: 7.1 symbols/min [2025-10-03T20:57:47.003740] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:57:47.018738] [DEBUG] [LOCAL ] PKE: Loaded 13081 existing records from primary storage. [2025-10-03T20:57:47.019079] [INFO ] [MAIN ] PKE: Loaded 13081 existing records. [2025-10-03T20:57:47.192045] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-03T20:57:47.223020] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:57:47.223285] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-03T20:57:47.223339] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-03T20:57:47.223556] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-03T20:57:47.223613] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-03T20:57:47.613038] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:57:47.631088] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T20:57:47.990703] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-03T20:57:48.795864] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-03T20:57:48.814234] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T20:57:48.909278] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T20:57:49.590706] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-03T20:57:50.390696] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-03T20:57:50.866432] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T20:57:51.190699] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-03T20:57:51.540893] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T20:57:51.699345] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T20:57:51.990698] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-03T20:57:52.170256] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T20:57:52.790689] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-03T20:57:53.201237] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T20:57:53.590705] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-03T20:57:54.390624] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-03T20:57:54.475903] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T20:57:54.951171] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T20:57:55.190684] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-03T20:57:55.530169] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T20:57:55.993382] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-03T20:57:55.997149] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T20:57:56.790697] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-03T20:57:57.590685] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-03T20:57:57.837590] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T20:57:58.032839] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T20:57:58.390719] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-03T20:57:59.190704] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-03T20:57:59.672380] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T20:57:59.873365] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T20:57:59.990637] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-03T20:58:00.124554] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:58:00.790689] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-03T20:58:01.590752] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-03T20:58:01.718063] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T20:58:02.156152] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-03T20:58:02.390719] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-03T20:58:03.190728] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-03T20:58:03.475412] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T20:58:03.811757] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T20:58:03.814831] [INFO ] [REMOTE ] PINS: Full fetch complete (77740 records). [2025-10-03T20:58:03.814966] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-03T20:58:04.001217] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-03T20:58:04.154443] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T20:58:04.264232] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-03T20:58:04.264329] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-03T20:58:04.265572] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-03T20:58:04.265660] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-03T20:58:04.267405] [DEBUG] [LOCAL ] PINS: Trimmed 77740 records to 54473 (keeping 200 days of data) [2025-10-03T20:58:04.612713] [DEBUG] [LOCAL ] PINS: Primary data saved (54473 records). [2025-10-03T20:58:04.612900] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-03T20:58:04.613030] [INFO ] [MAIN ] Update Progress: 1690/2370 symbols completed. PINS took 50.8s. Estimated remaining: 1h 35m 46s. Rate: 7.1 symbols/min [2025-10-03T20:58:04.795971] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-03T20:58:04.799701] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:04.841633] [DEBUG] [LOCAL ] PKG: Loaded 39238 existing records from primary storage. [2025-10-03T20:58:04.841957] [INFO ] [MAIN ] PKG: Loaded 39238 existing records. [2025-10-03T20:58:05.026973] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:05.027212] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-03T20:58:05.027262] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-03T20:58:05.027791] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-10-03T20:58:05.027853] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-03T20:58:05.421511] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:05.435833] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T20:58:05.590677] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-03T20:58:06.390705] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-03T20:58:06.675033] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T20:58:06.732562] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T20:58:07.190735] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-03T20:58:07.465917] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T20:58:07.990725] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-03T20:58:08.440285] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T20:58:08.790723] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-03T20:58:09.149517] [DEBUG] [REMOTE ] PKG: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T20:58:09.149922] [WARN ] [REMOTE ] PKG: No data returned for month 2025-01 [2025-10-03T20:58:09.150044] [FATAL] [REMOTE ] PKG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T20:58:09.150160] [FATAL] [MAIN ] PKG: Failed to fetch primary data. [2025-10-03T20:58:09.150230] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T20:58:09.150304] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-03T20:58:09.150383] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-03T20:58:09.150436] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-03T20:58:09.150746] [DEBUG] [LOCAL ] PKG: Deleted derivative data file. [2025-10-03T20:58:09.150874] [INFO ] [MAIN ] Update Progress: 1691/2370 symbols completed. PKG took 4.5s. Estimated remaining: 1h 35m 36s. Rate: 7.1 symbols/min [2025-10-03T20:58:09.371438] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:09.392331] [DEBUG] [LOCAL ] PKST: Loaded 18921 existing records from primary storage. [2025-10-03T20:58:09.392667] [INFO ] [MAIN ] PKST: Loaded 18921 existing records. [2025-10-03T20:58:09.595811] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-03T20:58:09.600328] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:09.601886] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-03T20:58:09.601942] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-03T20:58:09.602223] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-03T20:58:09.602286] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-03T20:58:09.991877] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:10.023076] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T20:58:10.390738] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-03T20:58:10.405030] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T20:58:10.406945] [INFO ] [REMOTE ] PJT: Full fetch complete (31932 records). [2025-10-03T20:58:10.407080] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-03T20:58:10.819364] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-03T20:58:10.819460] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-03T20:58:10.820246] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-03T20:58:10.820314] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-03T20:58:10.821336] [DEBUG] [LOCAL ] PJT: Trimmed 31932 records to 21887 (keeping 200 days of data) [2025-10-03T20:58:10.963880] [DEBUG] [LOCAL ] PJT: Primary data saved (21887 records). [2025-10-03T20:58:10.964012] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-03T20:58:10.964122] [INFO ] [MAIN ] Update Progress: 1692/2370 symbols completed. PJT took 36.1s. Estimated remaining: 1h 35m 25s. Rate: 7.1 symbols/min [2025-10-03T20:58:11.138846] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:11.162897] [DEBUG] [LOCAL ] PKX: Loaded 24461 existing records from primary storage. [2025-10-03T20:58:11.163201] [INFO ] [MAIN ] PKX: Loaded 24461 existing records. [2025-10-03T20:58:11.195900] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-03T20:58:11.358051] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:11.358335] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-03T20:58:11.358395] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-03T20:58:11.359182] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-03T20:58:11.359245] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-03T20:58:11.729790] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:11.990633] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-03T20:58:12.339466] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T20:58:12.395838] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T20:58:12.790740] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-03T20:58:13.590669] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-03T20:58:13.778918] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T20:58:13.992259] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T20:58:14.390736] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-03T20:58:15.080312] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T20:58:15.082995] [INFO ] [REMOTE ] PK: Full fetch complete (76369 records). [2025-10-03T20:58:15.083138] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-03T20:58:15.195790] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-03T20:58:15.531417] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-03T20:58:15.531728] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-03T20:58:15.533211] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-03T20:58:15.533325] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-03T20:58:15.535234] [DEBUG] [LOCAL ] PK: Trimmed 76369 records to 53584 (keeping 200 days of data) [2025-10-03T20:58:15.665976] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T20:58:15.896388] [DEBUG] [LOCAL ] PK: Primary data saved (53584 records). [2025-10-03T20:58:15.896544] [INFO ] [MAIN ] PK: Full history saved. [2025-10-03T20:58:15.897548] [INFO ] [MAIN ] Update Progress: 1693/2370 symbols completed. PK took 39.2s. Estimated remaining: 1h 35m 15s. Rate: 7.1 symbols/min [2025-10-03T20:58:15.995839] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-03T20:58:16.083419] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:16.138546] [DEBUG] [LOCAL ] PL: Loaded 53521 existing records from primary storage. [2025-10-03T20:58:16.138974] [INFO ] [MAIN ] PL: Loaded 53521 existing records. [2025-10-03T20:58:16.352531] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:16.353963] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T20:58:16.354162] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-03T20:58:16.354240] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-03T20:58:16.357967] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-03T20:58:16.358464] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-03T20:58:16.745692] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:16.790694] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-03T20:58:17.305173] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T20:58:17.590698] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-03T20:58:18.390723] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-03T20:58:18.986995] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T20:58:19.153142] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T20:58:19.154671] [INFO ] [REMOTE ] PKE: Full fetch complete (17436 records). [2025-10-03T20:58:19.154768] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-03T20:58:19.202557] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-03T20:58:19.475018] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-03T20:58:19.797363] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-03T20:58:19.797493] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-03T20:58:19.798381] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-03T20:58:19.798472] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-03T20:58:19.799630] [DEBUG] [LOCAL ] PKE: Trimmed 17436 records to 13281 (keeping 200 days of data) [2025-10-03T20:58:19.938906] [DEBUG] [LOCAL ] PKE: Primary data saved (13281 records). [2025-10-03T20:58:19.939165] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-03T20:58:19.939323] [INFO ] [MAIN ] Update Progress: 1694/2370 symbols completed. PKE took 33.1s. Estimated remaining: 1h 35m 5s. Rate: 7.1 symbols/min [2025-10-03T20:58:19.995808] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-03T20:58:20.167394] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:20.239496] [DEBUG] [LOCAL ] PLD: Loaded 53823 existing records from primary storage. [2025-10-03T20:58:20.239919] [INFO ] [MAIN ] PLD: Loaded 53823 existing records. [2025-10-03T20:58:20.449160] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:20.449540] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-03T20:58:20.449597] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-03T20:58:20.449991] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-10-03T20:58:20.450063] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-03T20:58:20.793272] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-03T20:58:20.875674] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:20.896151] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T20:58:21.047425] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T20:58:21.590699] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-03T20:58:22.390731] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-03T20:58:22.988252] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-03T20:58:23.195774] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-03T20:58:23.206146] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T20:58:23.990711] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-03T20:58:24.164440] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T20:58:24.790717] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-03T20:58:25.335831] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T20:58:25.444589] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-03T20:58:25.590715] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-03T20:58:26.390724] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-03T20:58:26.531037] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T20:58:27.190715] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-03T20:58:27.607141] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T20:58:27.776788] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T20:58:27.990738] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-03T20:58:28.790701] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-03T20:58:29.033488] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T20:58:29.095347] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T20:58:29.590725] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-03T20:58:30.390720] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-03T20:58:30.783073] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T20:58:30.871064] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T20:58:31.146343] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T20:58:31.190704] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-03T20:58:31.990736] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-03T20:58:32.598122] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T20:58:32.790717] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-03T20:58:33.590713] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-03T20:58:34.267455] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-03T20:58:34.390713] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-03T20:58:35.018632] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T20:58:35.190701] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-03T20:58:35.990732] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-03T20:58:36.402825] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T20:58:36.697780] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (3.91 seconds). [2025-10-03T20:58:36.790747] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-03T20:58:37.590740] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-03T20:58:39.210444] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (4.02 seconds). [2025-10-03T20:58:39.215716] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-03T20:58:39.682195] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-03T20:58:39.694695] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-03T20:58:41.457070] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T20:58:41.469310] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-03T20:58:41.577912] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (3.99 seconds). [2025-10-03T20:58:41.590471] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-03T20:58:42.847115] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (6.86 seconds). [2025-10-03T20:58:42.851770] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-03T20:58:42.991945] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (3.78 seconds). [2025-10-03T20:58:42.999559] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-03T20:58:43.856250] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T20:58:43.857606] [INFO ] [REMOTE ] PKST: Full fetch complete (29621 records). [2025-10-03T20:58:43.857751] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-03T20:58:44.265665] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-03T20:58:44.265993] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-03T20:58:44.266954] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-03T20:58:44.267023] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-03T20:58:44.267948] [DEBUG] [LOCAL ] PKST: Trimmed 29621 records to 19053 (keeping 200 days of data) [2025-10-03T20:58:44.394337] [DEBUG] [LOCAL ] PKST: Primary data saved (19053 records). [2025-10-03T20:58:44.394487] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-03T20:58:44.394612] [INFO ] [MAIN ] Update Progress: 1695/2370 symbols completed. PKST took 35.2s. Estimated remaining: 1h 35m 3s. Rate: 7.1 symbols/min [2025-10-03T20:58:44.608750] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:44.658312] [DEBUG] [LOCAL ] PLNT: Loaded 48596 existing records from primary storage. [2025-10-03T20:58:44.658683] [INFO ] [MAIN ] PLNT: Loaded 48596 existing records. [2025-10-03T20:58:44.859348] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:44.859625] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-03T20:58:44.859718] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-03T20:58:44.860157] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-03T20:58:44.860218] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-03T20:58:45.269397] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:45.269792] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-03T20:58:45.715547] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (4.25 seconds). [2025-10-03T20:58:45.727581] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-03T20:58:45.783755] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-03T20:58:45.789560] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-03T20:58:47.814859] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T20:58:47.827057] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-03T20:58:48.254720] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-03T20:58:48.256316] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (6.67 seconds). [2025-10-03T20:58:48.269909] [INFO ] [REMOTE ] PKX: Full fetch complete (36817 records). [2025-10-03T20:58:48.270107] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-03T20:58:48.270423] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-03T20:58:48.695128] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-03T20:58:48.695244] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-03T20:58:48.696145] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-03T20:58:48.696214] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-03T20:58:48.697677] [DEBUG] [LOCAL ] PKX: Trimmed 36817 records to 24566 (keeping 200 days of data) [2025-10-03T20:58:48.865728] [DEBUG] [LOCAL ] PKX: Primary data saved (24566 records). [2025-10-03T20:58:48.865898] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-03T20:58:48.866047] [INFO ] [MAIN ] Update Progress: 1696/2370 symbols completed. PKX took 37.9s. Estimated remaining: 1h 34m 53s. Rate: 7.1 symbols/min [2025-10-03T20:58:49.080309] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:49.085263] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (3.82 seconds). [2025-10-03T20:58:49.095334] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-03T20:58:49.114430] [DEBUG] [LOCAL ] PLOW: Loaded 20445 existing records from primary storage. [2025-10-03T20:58:49.114804] [INFO ] [MAIN ] PLOW: Loaded 20445 existing records. [2025-10-03T20:58:49.305906] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:49.306137] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-03T20:58:49.306186] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-03T20:58:49.306402] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-03T20:58:49.306460] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-03T20:58:49.696117] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:49.696561] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-03T20:58:49.732938] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T20:58:49.745280] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-03T20:58:50.500108] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T20:58:50.512794] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-03T20:58:50.607343] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T20:58:50.618167] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-03T20:58:50.814323] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T20:58:51.190698] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-03T20:58:51.773983] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T20:58:51.990634] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-03T20:58:52.334393] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T20:58:52.387331] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T20:58:52.790685] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-03T20:58:53.102492] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-03T20:58:53.584257] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T20:58:53.590672] [INFO ] [REMOTE ] PLD: Full fetch complete (77381 records). [2025-10-03T20:58:53.591129] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-03T20:58:53.590811] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-03T20:58:53.907236] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T20:58:54.070383] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-03T20:58:54.070476] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-03T20:58:54.071682] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-03T20:58:54.071763] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-03T20:58:54.073573] [DEBUG] [LOCAL ] PLD: Trimmed 77381 records to 54213 (keeping 200 days of data) [2025-10-03T20:58:54.391895] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-03T20:58:54.441175] [DEBUG] [LOCAL ] PLD: Primary data saved (54213 records). [2025-10-03T20:58:54.441335] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-03T20:58:54.441481] [INFO ] [MAIN ] Update Progress: 1697/2370 symbols completed. PLD took 34.5s. Estimated remaining: 1h 34m 43s. Rate: 7.1 symbols/min [2025-10-03T20:58:54.622553] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:54.657858] [DEBUG] [LOCAL ] PLYM: Loaded 33746 existing records from primary storage. [2025-10-03T20:58:54.658159] [INFO ] [MAIN ] PLYM: Loaded 33746 existing records. [2025-10-03T20:58:54.855093] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:58:54.855339] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-03T20:58:54.855402] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-03T20:58:54.855727] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-03T20:58:54.855789] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-03T20:58:55.211965] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-03T20:58:55.251711] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:55.477399] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T20:58:55.515057] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:58:55.990739] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-03T20:58:56.790726] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-03T20:58:57.296155] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T20:58:57.437624] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-03T20:58:57.443820] [INFO ] [REMOTE ] PL: Full fetch complete (76964 records). [2025-10-03T20:58:57.443995] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-03T20:58:57.599050] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-03T20:58:57.896999] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-03T20:58:57.897088] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-03T20:58:57.898331] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-03T20:58:57.898403] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-03T20:58:57.900075] [DEBUG] [LOCAL ] PL: Trimmed 76964 records to 53911 (keeping 200 days of data) [2025-10-03T20:58:58.243054] [DEBUG] [LOCAL ] PL: Primary data saved (53911 records). [2025-10-03T20:58:58.243206] [INFO ] [MAIN ] PL: Full history saved. [2025-10-03T20:58:58.244220] [INFO ] [MAIN ] Update Progress: 1698/2370 symbols completed. PL took 42.3s. Estimated remaining: 1h 34m 33s. Rate: 7.1 symbols/min [2025-10-03T20:58:58.413799] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-03T20:58:58.442953] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:58:58.443128] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-03T20:58:58.443167] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-03T20:58:58.443279] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-03T20:58:58.443324] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-03T20:58:58.443366] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-03T20:58:58.443400] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-03T20:58:58.844184] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:58:58.873972] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T20:58:59.066442] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T20:58:59.190751] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-03T20:58:59.720616] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T20:58:59.990713] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-03T20:59:00.790699] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-03T20:59:01.098630] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T20:59:01.455265] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T20:59:01.590698] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-03T20:59:02.390771] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-03T20:59:02.876877] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T20:59:02.966915] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T20:59:03.190709] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-03T20:59:03.537905] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T20:59:03.990730] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-03T20:59:04.790730] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-03T20:59:05.155535] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T20:59:05.421311] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-03T20:59:05.590698] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-03T20:59:06.332511] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T20:59:06.390717] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-03T20:59:07.190677] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-03T20:59:07.637044] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T20:59:07.771610] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T20:59:07.990667] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-03T20:59:08.292718] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T20:59:08.790712] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-03T20:59:09.590712] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-03T20:59:09.727987] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T20:59:10.369544] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T20:59:10.390611] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-03T20:59:11.190739] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-03T20:59:11.691625] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T20:59:11.688177] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T20:59:11.990714] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-03T20:59:12.724350] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T20:59:12.790664] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-03T20:59:13.096328] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T20:59:13.590717] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-03T20:59:14.390713] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-03T20:59:14.495161] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T20:59:14.655312] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T20:59:15.190715] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-03T20:59:15.808811] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T20:59:15.811258] [INFO ] [REMOTE ] PLNT: Full fetch complete (70352 records). [2025-10-03T20:59:15.811364] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-03T20:59:16.006896] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-03T20:59:16.238208] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-03T20:59:16.238287] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-03T20:59:16.239434] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-03T20:59:16.239501] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-03T20:59:16.240899] [DEBUG] [LOCAL ] PLNT: Trimmed 70352 records to 48933 (keeping 200 days of data) [2025-10-03T20:59:16.550624] [DEBUG] [LOCAL ] PLNT: Primary data saved (48933 records). [2025-10-03T20:59:16.550822] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-03T20:59:16.550979] [INFO ] [MAIN ] Update Progress: 1699/2370 symbols completed. PLNT took 32.2s. Estimated remaining: 1h 34m 28s. Rate: 7.1 symbols/min [2025-10-03T20:59:16.667756] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T20:59:16.681213] [INFO ] [REMOTE ] PLOW: Full fetch complete (28690 records). [2025-10-03T20:59:16.681380] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-03T20:59:16.797684] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-03T20:59:16.809875] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-03T20:59:16.873131] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:59:17.098455] [DEBUG] [LOCAL ] PML: Loaded 21357 existing records from primary storage. [2025-10-03T20:59:17.127513] [INFO ] [MAIN ] PML: Loaded 21357 existing records. [2025-10-03T20:59:17.372201] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-03T20:59:17.377455] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-03T20:59:17.394341] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-03T20:59:17.417951] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:59:17.411703] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-03T20:59:17.418193] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-03T20:59:17.418369] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-03T20:59:17.418598] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-03T20:59:17.418841] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-03T20:59:17.478425] [DEBUG] [LOCAL ] PLOW: Trimmed 28690 records to 20552 (keeping 200 days of data) [2025-10-03T20:59:17.597783] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-03T20:59:17.916295] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:59:17.948176] [DEBUG] [LOCAL ] PLOW: Primary data saved (20552 records). [2025-10-03T20:59:17.948302] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-03T20:59:17.948399] [INFO ] [MAIN ] Update Progress: 1700/2370 symbols completed. PLOW took 29.1s. Estimated remaining: 1h 34m 17s. Rate: 7.1 symbols/min [2025-10-03T20:59:18.130071] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:59:18.143282] [DEBUG] [LOCAL ] PMM: Loaded 10876 existing records from primary storage. [2025-10-03T20:59:18.143518] [INFO ] [MAIN ] PMM: Loaded 10876 existing records. [2025-10-03T20:59:18.358273] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:59:18.360224] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T20:59:18.367746] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-03T20:59:18.368075] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-03T20:59:18.368701] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-03T20:59:18.368779] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-03T20:59:18.402286] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-03T20:59:18.748675] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:59:19.190735] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-03T20:59:19.887459] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-03T20:59:19.914946] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T20:59:19.990727] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-03T20:59:20.442849] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T20:59:20.790736] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-03T20:59:21.590679] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-03T20:59:21.792799] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T20:59:21.911384] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T20:59:22.390717] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-03T20:59:23.174756] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T20:59:23.190622] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-03T20:59:23.584807] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T20:59:23.990715] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-03T20:59:24.416862] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T20:59:24.419000] [INFO ] [REMOTE ] PLYM: Full fetch complete (47100 records). [2025-10-03T20:59:24.419102] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-03T20:59:24.804916] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-03T20:59:24.864359] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-03T20:59:24.864489] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-03T20:59:24.865454] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-03T20:59:24.865524] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-03T20:59:24.866787] [DEBUG] [LOCAL ] PLYM: Trimmed 47100 records to 34055 (keeping 200 days of data) [2025-10-03T20:59:25.070820] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T20:59:25.102051] [DEBUG] [LOCAL ] PLYM: Primary data saved (34055 records). [2025-10-03T20:59:25.102200] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-03T20:59:25.102350] [INFO ] [MAIN ] Update Progress: 1701/2370 symbols completed. PLYM took 30.7s. Estimated remaining: 1h 34m 8s. Rate: 7.1 symbols/min [2025-10-03T20:59:25.283542] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:59:25.295534] [DEBUG] [LOCAL ] PMO: Loaded 10556 existing records from primary storage. [2025-10-03T20:59:25.295772] [INFO ] [MAIN ] PMO: Loaded 10556 existing records. [2025-10-03T20:59:25.492568] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:59:25.492827] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-03T20:59:25.492940] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-03T20:59:25.493203] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-03T20:59:25.493266] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-03T20:59:25.595846] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-03T20:59:25.870962] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:59:25.972336] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T20:59:26.390638] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-03T20:59:26.674513] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T20:59:27.190639] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-03T20:59:27.487529] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T20:59:27.990686] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-03T20:59:28.790716] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-03T20:59:29.181934] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T20:59:29.528918] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T20:59:29.590731] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-03T20:59:30.067024] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T20:59:30.390672] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-03T20:59:30.538329] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T20:59:31.190673] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-03T20:59:31.403744] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T20:59:31.990696] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-03T20:59:32.790696] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-03T20:59:33.009320] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T20:59:33.352945] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T20:59:33.590696] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-03T20:59:33.923235] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T20:59:34.390712] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-03T20:59:35.190632] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-03T20:59:35.500542] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T20:59:35.503318] [INFO ] [REMOTE ] PM: Full fetch complete (77706 records). [2025-10-03T20:59:35.503434] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-03T20:59:35.668235] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T20:59:35.905518] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T20:59:35.986325] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-03T20:59:35.986429] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-03T20:59:35.987728] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-03T20:59:35.987797] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-03T20:59:35.989490] [DEBUG] [LOCAL ] PM: Trimmed 77706 records to 54447 (keeping 200 days of data) [2025-10-03T20:59:35.990668] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-03T20:59:36.356994] [DEBUG] [LOCAL ] PM: Primary data saved (54447 records). [2025-10-03T20:59:36.357144] [INFO ] [MAIN ] PM: Full history saved. [2025-10-03T20:59:36.357230] [INFO ] [MAIN ] Update Progress: 1702/2370 symbols completed. PM took 38.1s. Estimated remaining: 1h 34m 1s. Rate: 7.1 symbols/min [2025-10-03T20:59:36.547821] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:59:36.607941] [DEBUG] [LOCAL ] PMT: Loaded 40599 existing records from primary storage. [2025-10-03T20:59:36.608485] [INFO ] [MAIN ] PMT: Loaded 40599 existing records. [2025-10-03T20:59:36.799162] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-03T20:59:36.805676] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T20:59:36.806740] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-03T20:59:36.806797] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-03T20:59:36.807056] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-03T20:59:36.807119] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-03T20:59:37.191936] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:59:37.333366] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T20:59:37.590701] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-03T20:59:37.916910] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T20:59:38.390686] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-03T20:59:38.904502] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T20:59:39.190698] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-03T20:59:39.829925] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T20:59:39.848357] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T20:59:39.990691] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-03T20:59:40.790689] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-03T20:59:40.967195] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T20:59:40.968837] [INFO ] [REMOTE ] PML: Full fetch complete (29918 records). [2025-10-03T20:59:40.968914] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-03T20:59:41.382816] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-03T20:59:41.382929] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-03T20:59:41.383827] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-03T20:59:41.383899] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-03T20:59:41.385057] [DEBUG] [LOCAL ] PML: Trimmed 29918 records to 21631 (keeping 200 days of data) [2025-10-03T20:59:41.523186] [DEBUG] [LOCAL ] PML: Primary data saved (21631 records). [2025-10-03T20:59:41.523379] [INFO ] [MAIN ] PML: Full history saved. [2025-10-03T20:59:41.523490] [INFO ] [MAIN ] Update Progress: 1703/2370 symbols completed. PML took 25.0s. Estimated remaining: 1h 33m 51s. Rate: 7.1 symbols/min [2025-10-03T20:59:41.592939] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-03T20:59:41.713351] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T20:59:41.713553] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-03T20:59:41.713609] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-03T20:59:41.713746] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-03T20:59:41.713791] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-03T20:59:41.713834] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-03T20:59:41.713881] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-03T20:59:42.039810] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T20:59:42.124857] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T20:59:42.390698] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-03T20:59:42.523941] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T20:59:42.885945] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T20:59:43.190686] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-03T20:59:43.990668] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-03T20:59:44.054489] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T20:59:44.791119] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-03T20:59:44.949868] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T20:59:45.195995] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-03T20:59:45.590668] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-03T20:59:46.123898] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T20:59:46.390680] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-03T20:59:46.816289] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T20:59:47.190693] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-03T20:59:47.735309] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T20:59:47.990685] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-03T20:59:48.379306] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T20:59:48.790691] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-03T20:59:49.590685] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-03T20:59:50.390689] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-03T20:59:50.416797] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T20:59:50.442913] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T20:59:50.757544] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T20:59:51.190705] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-03T20:59:51.990738] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-03T20:59:52.403040] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-03T20:59:52.745607] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T20:59:52.790708] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-03T20:59:53.590708] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-03T20:59:54.379049] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T20:59:54.390607] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-03T20:59:54.473107] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T20:59:55.190739] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-03T20:59:55.990695] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-03T20:59:56.136295] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T20:59:56.170589] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T20:59:56.790639] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-03T20:59:56.866596] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T20:59:57.212418] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T20:59:57.590695] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-03T20:59:58.390709] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-03T20:59:58.403052] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T20:59:59.190639] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-03T20:59:59.246943] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T20:59:59.548826] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T20:59:59.990720] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-03T21:00:00.790695] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-03T21:00:00.852968] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T21:00:01.577429] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T21:00:01.578752] [INFO ] [REMOTE ] PMM: Full fetch complete (18364 records). [2025-10-03T21:00:01.578837] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-03T21:00:01.595820] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-03T21:00:01.999735] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-03T21:00:01.999831] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-03T21:00:02.000359] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-03T21:00:02.000425] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-03T21:00:02.001180] [DEBUG] [LOCAL ] PMM: Trimmed 18364 records to 10993 (keeping 200 days of data) [2025-10-03T21:00:02.051725] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:00:02.053253] [INFO ] [REMOTE ] PMTU: Full fetch complete (1226 records). [2025-10-03T21:00:02.053371] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-03T21:00:02.266607] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-03T21:00:02.267740] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:00:02.268112] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:00:02.268856] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-03T21:00:02.268954] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-03T21:00:02.269317] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-03T21:00:02.270271] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-03T21:00:02.271084] [INFO ] [MAIN ] Update Progress: 1704/2370 symbols completed. PMTU took 20.7s. Estimated remaining: 1h 33m 47s. Rate: 7.1 symbols/min [2025-10-03T21:00:02.391108] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-03T21:00:02.434622] [DEBUG] [LOCAL ] PMM: Primary data saved (10993 records). [2025-10-03T21:00:02.434992] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-03T21:00:02.455710] [INFO ] [MAIN ] Update Progress: 1705/2370 symbols completed. PMM took 44.5s. Estimated remaining: 1h 33m 36s. Rate: 7.1 symbols/min [2025-10-03T21:00:02.487319] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:02.498366] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-03T21:00:02.519853] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-03T21:00:02.558422] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-03T21:00:02.578712] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-03T21:00:02.611261] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-03T21:00:02.630439] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-03T21:00:02.941098] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:02.959492] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-03T21:00:02.972086] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-03T21:00:02.989105] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-03T21:00:03.025794] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-03T21:00:03.082179] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-03T21:00:03.098526] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-03T21:00:03.217126] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-03T21:00:03.324699] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:03.499334] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T21:00:03.647884] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:03.990689] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-03T21:00:04.384712] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:00:04.385065] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-03T21:00:04.385179] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:00:04.385274] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-03T21:00:04.385362] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:00:04.385461] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-03T21:00:04.385549] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-03T21:00:04.385590] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-03T21:00:04.385670] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-03T21:00:04.385751] [INFO ] [MAIN ] Update Progress: 1706/2370 symbols completed. PMTV took 2.1s. Estimated remaining: 1h 33m 25s. Rate: 7.1 symbols/min [2025-10-03T21:00:04.602084] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:04.602399] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-03T21:00:04.602456] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-03T21:00:04.602581] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-03T21:00:04.602623] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-03T21:00:04.602769] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-03T21:00:04.602847] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-03T21:00:04.805599] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-03T21:00:05.054390] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:05.078825] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T21:00:05.503121] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T21:00:05.504206] [INFO ] [REMOTE ] PMO: Full fetch complete (17015 records). [2025-10-03T21:00:05.504281] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-03T21:00:05.595842] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-03T21:00:05.890234] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-03T21:00:05.890359] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-03T21:00:05.890765] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-03T21:00:05.890827] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-03T21:00:05.891376] [DEBUG] [LOCAL ] PMO: Trimmed 17015 records to 10606 (keeping 200 days of data) [2025-10-03T21:00:05.959067] [DEBUG] [LOCAL ] PMO: Primary data saved (10606 records). [2025-10-03T21:00:05.959212] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-03T21:00:05.959310] [INFO ] [MAIN ] Update Progress: 1707/2370 symbols completed. PMO took 40.9s. Estimated remaining: 1h 33m 14s. Rate: 7.1 symbols/min [2025-10-03T21:00:06.136935] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:06.145585] [DEBUG] [LOCAL ] PNI: Loaded 6820 existing records from primary storage. [2025-10-03T21:00:06.145804] [INFO ] [MAIN ] PNI: Loaded 6820 existing records. [2025-10-03T21:00:06.336624] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:06.336895] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-03T21:00:06.336948] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-03T21:00:06.337214] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-03T21:00:06.337273] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-03T21:00:06.403015] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-03T21:00:06.726831] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:07.124096] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:00:07.124464] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-03T21:00:07.124561] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:00:07.124614] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-03T21:00:07.124706] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:00:07.124789] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-03T21:00:07.124873] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-03T21:00:07.124932] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-03T21:00:07.124978] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-03T21:00:07.125027] [INFO ] [MAIN ] Update Progress: 1708/2370 symbols completed. PMTW took 4.6s. Estimated remaining: 1h 33m 2s. Rate: 7.1 symbols/min [2025-10-03T21:00:07.196503] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-03T21:00:07.320190] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:07.358301] [DEBUG] [LOCAL ] PNNT: Loaded 33121 existing records from primary storage. [2025-10-03T21:00:07.358590] [INFO ] [MAIN ] PNNT: Loaded 33121 existing records. [2025-10-03T21:00:07.553804] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:07.554301] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-03T21:00:07.554361] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-03T21:00:07.554666] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-03T21:00:07.554733] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-03T21:00:08.000709] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-03T21:00:08.038860] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:08.061115] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T21:00:08.790712] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-03T21:00:09.070425] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T21:00:09.166575] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T21:00:09.590708] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-03T21:00:10.357487] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T21:00:10.379531] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T21:00:10.390620] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-03T21:00:10.493242] [DEBUG] [REMOTE ] PNI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-03T21:00:10.493536] [WARN ] [REMOTE ] PNI: No data returned for month 2025-02 [2025-10-03T21:00:10.493628] [FATAL] [REMOTE ] PNI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:00:10.493768] [FATAL] [MAIN ] PNI: Failed to fetch primary data. [2025-10-03T21:00:10.493852] [WARN ] [MAIN ] PNI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:00:10.493940] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-03T21:00:10.494022] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-03T21:00:10.494075] [INFO ] [LOCAL ] PNI: Starting deletion of derivative data. [2025-10-03T21:00:10.494412] [DEBUG] [LOCAL ] PNI: Deleted derivative data file. [2025-10-03T21:00:10.494532] [INFO ] [MAIN ] Update Progress: 1709/2370 symbols completed. PNI took 4.5s. Estimated remaining: 1h 32m 52s. Rate: 7.1 symbols/min [2025-10-03T21:00:10.695235] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:10.695454] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-03T21:00:10.695510] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-03T21:00:10.695670] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-03T21:00:10.695739] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-03T21:00:10.695801] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-03T21:00:10.695856] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-03T21:00:11.074284] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:11.190697] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-03T21:00:11.990732] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-03T21:00:12.790674] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-03T21:00:13.133713] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T21:00:13.590744] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-03T21:00:13.902456] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T21:00:14.390733] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-03T21:00:14.497706] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T21:00:15.119828] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:00:15.190640] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-03T21:00:15.660348] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T21:00:15.990708] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-03T21:00:16.790692] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-03T21:00:17.082627] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T21:00:17.305012] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T21:00:17.590749] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-03T21:00:18.390712] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-03T21:00:18.596036] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:00:18.931906] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T21:00:19.190689] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-03T21:00:19.990675] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-03T21:00:20.388200] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T21:00:20.712715] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T21:00:20.790739] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-03T21:00:21.590727] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-03T21:00:21.706401] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T21:00:22.096123] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T21:00:22.390741] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-03T21:00:23.190706] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-03T21:00:23.574395] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T21:00:23.631932] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T21:00:23.634524] [INFO ] [REMOTE ] PMT: Full fetch complete (58610 records). [2025-10-03T21:00:23.634698] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-03T21:00:24.001853] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-03T21:00:24.062303] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-03T21:00:24.062402] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-03T21:00:24.063482] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-03T21:00:24.063551] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-03T21:00:24.064930] [DEBUG] [LOCAL ] PMT: Trimmed 58610 records to 40904 (keeping 200 days of data) [2025-10-03T21:00:24.336381] [DEBUG] [LOCAL ] PMT: Primary data saved (40904 records). [2025-10-03T21:00:24.336556] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-03T21:00:24.338851] [INFO ] [MAIN ] Update Progress: 1710/2370 symbols completed. PMT took 48.0s. Estimated remaining: 1h 32m 46s. Rate: 7.1 symbols/min [2025-10-03T21:00:24.537365] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:24.586609] [DEBUG] [LOCAL ] PNW: Loaded 46137 existing records from primary storage. [2025-10-03T21:00:24.587024] [INFO ] [MAIN ] PNW: Loaded 46137 existing records. [2025-10-03T21:00:24.787116] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:24.787503] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-03T21:00:24.787588] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-03T21:00:24.787962] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-10-03T21:00:24.788024] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-03T21:00:24.809971] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-03T21:00:24.935637] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:00:25.242953] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:25.590682] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-03T21:00:25.965519] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T21:00:26.390677] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-03T21:00:26.857617] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T21:00:26.878872] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T21:00:27.190733] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-03T21:00:27.990669] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-03T21:00:28.110586] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T21:00:28.554106] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:00:28.790703] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-03T21:00:29.590706] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-03T21:00:29.630293] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T21:00:30.390724] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-03T21:00:30.919172] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T21:00:30.961348] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T21:00:31.190722] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-03T21:00:31.889272] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T21:00:31.990742] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-03T21:00:32.790622] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-03T21:00:32.887834] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:00:33.590721] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-03T21:00:33.880360] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T21:00:34.390707] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-03T21:00:34.648751] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:00:35.189993] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:00:35.193087] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-03T21:00:35.989793] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:00:36.000457] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-03T21:00:36.728934] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T21:00:36.790717] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-03T21:00:37.590714] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-03T21:00:37.802690] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T21:00:38.123574] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T21:00:38.125809] [INFO ] [REMOTE ] PNC: Full fetch complete (75059 records). [2025-10-03T21:00:38.125974] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-03T21:00:38.126863] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:00:38.126990] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:00:38.127036] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:00:38.127107] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-03T21:00:38.127197] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-03T21:00:38.127236] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-03T21:00:38.127307] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-03T21:00:38.127412] [INFO ] [MAIN ] Update Progress: 1711/2370 symbols completed. PNC took 33.7s. Estimated remaining: 1h 32m 39s. Rate: 7.1 symbols/min [2025-10-03T21:00:38.316324] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:38.358427] [DEBUG] [LOCAL ] POR: Loaded 47361 existing records from primary storage. [2025-10-03T21:00:38.358794] [INFO ] [MAIN ] POR: Loaded 47361 existing records. [2025-10-03T21:00:38.392159] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-03T21:00:38.598982] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:38.609584] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-03T21:00:38.609675] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-03T21:00:38.610429] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-03T21:00:38.611831] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-03T21:00:38.611752] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T21:00:39.013286] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:39.190738] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-03T21:00:39.990680] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-03T21:00:40.189860] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T21:00:40.623101] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T21:00:40.790688] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-03T21:00:41.201939] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:00:41.205713] [INFO ] [REMOTE ] PNNT: Full fetch complete (47544 records). [2025-10-03T21:00:41.206012] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-03T21:00:41.610236] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-03T21:00:41.630510] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-03T21:00:41.630606] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-03T21:00:41.631763] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-03T21:00:41.631839] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-03T21:00:41.633541] [DEBUG] [LOCAL ] PNNT: Trimmed 47544 records to 33359 (keeping 200 days of data) [2025-10-03T21:00:41.843991] [DEBUG] [LOCAL ] PNNT: Primary data saved (33359 records). [2025-10-03T21:00:41.844151] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-03T21:00:41.844308] [INFO ] [MAIN ] Update Progress: 1712/2370 symbols completed. PNNT took 34.7s. Estimated remaining: 1h 32m 29s. Rate: 7.1 symbols/min [2025-10-03T21:00:42.022927] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:42.061489] [DEBUG] [LOCAL ] POST: Loaded 39020 existing records from primary storage. [2025-10-03T21:00:42.061838] [INFO ] [MAIN ] POST: Loaded 39020 existing records. [2025-10-03T21:00:42.256340] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:42.256663] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-03T21:00:42.256805] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-03T21:00:42.257223] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-03T21:00:42.257286] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-03T21:00:42.395774] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-03T21:00:42.660229] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:42.690138] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T21:00:43.028482] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T21:00:43.190710] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-03T21:00:43.990681] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-03T21:00:44.408509] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T21:00:44.790681] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-03T21:00:44.998784] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T21:00:45.115128] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T21:00:45.590714] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-03T21:00:46.390690] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-03T21:00:46.612494] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T21:00:47.190635] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-03T21:00:47.403557] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:00:47.990630] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-03T21:00:48.087389] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T21:00:48.790685] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-03T21:00:48.873339] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T21:00:49.590768] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-03T21:00:49.666980] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T21:00:50.052153] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T21:00:50.139302] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T21:00:50.141554] [INFO ] [REMOTE ] PNR: Full fetch complete (68819 records). [2025-10-03T21:00:50.141828] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-03T21:00:50.142723] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:00:50.142866] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:00:50.142913] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:00:50.143035] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-03T21:00:50.143140] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-03T21:00:50.143200] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-03T21:00:50.143247] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-03T21:00:50.143320] [INFO ] [MAIN ] Update Progress: 1713/2370 symbols completed. PNR took 39.6s. Estimated remaining: 1h 32m 20s. Rate: 7.1 symbols/min [2025-10-03T21:00:50.341727] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:50.399167] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-03T21:00:50.403452] [DEBUG] [LOCAL ] PPG: Loaded 51055 existing records from primary storage. [2025-10-03T21:00:50.403961] [INFO ] [MAIN ] PPG: Loaded 51055 existing records. [2025-10-03T21:00:50.602039] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:00:50.602277] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-03T21:00:50.602325] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-03T21:00:50.602606] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-10-03T21:00:50.602702] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-03T21:00:51.002309] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:51.190710] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-03T21:00:51.990703] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-03T21:00:52.303051] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:00:52.653330] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T21:00:52.790722] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-03T21:00:53.287545] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T21:00:53.290332] [INFO ] [REMOTE ] PNW: Full fetch complete (66044 records). [2025-10-03T21:00:53.290466] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-03T21:00:53.595844] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-03T21:00:53.729976] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-03T21:00:53.730060] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-03T21:00:53.731247] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-03T21:00:53.731316] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-03T21:00:53.732770] [DEBUG] [LOCAL ] PNW: Trimmed 66044 records to 46446 (keeping 200 days of data) [2025-10-03T21:00:54.043274] [DEBUG] [LOCAL ] PNW: Primary data saved (46446 records). [2025-10-03T21:00:54.043425] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-03T21:00:54.043515] [INFO ] [MAIN ] Update Progress: 1714/2370 symbols completed. PNW took 29.7s. Estimated remaining: 1h 32m 10s. Rate: 7.1 symbols/min [2025-10-03T21:00:54.228723] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:00:54.228917] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-03T21:00:54.228975] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-03T21:00:54.229091] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-03T21:00:54.229135] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-03T21:00:54.229177] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-03T21:00:54.229211] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-03T21:00:54.393538] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-03T21:00:54.565587] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T21:00:54.657770] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:00:55.113229] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T21:00:55.190721] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-03T21:00:55.990636] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-03T21:00:56.343297] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T21:00:56.463759] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T21:00:56.790717] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-03T21:00:57.590667] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-03T21:00:57.878994] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T21:00:58.391828] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T21:00:58.391959] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-03T21:00:58.912562] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T21:00:59.190714] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-03T21:00:59.990735] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-03T21:01:00.252526] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T21:01:00.790670] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-03T21:01:01.590682] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-03T21:01:01.902998] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T21:01:02.083665] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-03T21:01:02.390715] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-03T21:01:02.620869] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:01:03.190673] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-03T21:01:03.399504] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T21:01:03.990674] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-03T21:01:04.246539] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T21:01:04.660332] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T21:01:04.790722] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-03T21:01:05.536516] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T21:01:05.590631] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-03T21:01:06.390632] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-03T21:01:06.874251] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T21:01:07.075821] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T21:01:07.190734] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-03T21:01:07.990722] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-03T21:01:08.278431] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T21:01:08.451421] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T21:01:08.790699] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-03T21:01:09.590639] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-03T21:01:09.911244] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T21:01:10.390699] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-03T21:01:10.616631] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T21:01:11.190639] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-03T21:01:11.298580] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:01:11.990684] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-03T21:01:12.390493] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-03T21:01:12.409961] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T21:01:12.413032] [INFO ] [REMOTE ] POR: Full fetch complete (68510 records). [2025-10-03T21:01:12.413193] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-03T21:01:12.801993] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-03T21:01:12.843385] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-03T21:01:12.843489] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-03T21:01:12.844692] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-03T21:01:12.844762] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-03T21:01:12.847452] [DEBUG] [LOCAL ] POR: Trimmed 68510 records to 47696 (keeping 200 days of data) [2025-10-03T21:01:13.154672] [DEBUG] [LOCAL ] POR: Primary data saved (47696 records). [2025-10-03T21:01:13.154824] [INFO ] [MAIN ] POR: Full history saved. [2025-10-03T21:01:13.154929] [INFO ] [MAIN ] Update Progress: 1715/2370 symbols completed. POR took 35.0s. Estimated remaining: 1h 32m 6s. Rate: 7.1 symbols/min [2025-10-03T21:01:13.338690] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:13.360314] [DEBUG] [LOCAL ] PPT: Loaded 20167 existing records from primary storage. [2025-10-03T21:01:13.360615] [INFO ] [MAIN ] PPT: Loaded 20167 existing records. [2025-10-03T21:01:13.578166] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:01:13.578469] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-03T21:01:13.578519] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-03T21:01:13.578846] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-03T21:01:13.578914] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-03T21:01:13.598291] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-03T21:01:14.111335] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:14.198669] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T21:01:14.390746] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-03T21:01:14.573118] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T21:01:15.190701] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-03T21:01:15.571380] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-03T21:01:15.704474] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T21:01:15.990760] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-03T21:01:16.790721] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-03T21:01:17.031954] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T21:01:17.590731] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-03T21:01:17.658463] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T21:01:18.145236] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T21:01:18.147626] [INFO ] [REMOTE ] POST: Full fetch complete (55773 records). [2025-10-03T21:01:18.147917] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-03T21:01:18.395835] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-03T21:01:18.565458] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-03T21:01:18.565550] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-03T21:01:18.566549] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-03T21:01:18.566615] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-03T21:01:18.568164] [DEBUG] [LOCAL ] POST: Trimmed 55773 records to 39260 (keeping 200 days of data) [2025-10-03T21:01:18.822829] [DEBUG] [LOCAL ] POST: Primary data saved (39260 records). [2025-10-03T21:01:18.823236] [INFO ] [MAIN ] POST: Full history saved. [2025-10-03T21:01:18.823590] [INFO ] [MAIN ] Update Progress: 1716/2370 symbols completed. POST took 37.0s. Estimated remaining: 1h 31m 56s. Rate: 7.1 symbols/min [2025-10-03T21:01:19.023034] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:19.083478] [DEBUG] [LOCAL ] PR: Loaded 54000 existing records from primary storage. [2025-10-03T21:01:19.084000] [INFO ] [MAIN ] PR: Loaded 54000 existing records. [2025-10-03T21:01:19.194798] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-03T21:01:19.288049] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:01:19.288473] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-03T21:01:19.288579] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-03T21:01:19.288932] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-03T21:01:19.288998] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-03T21:01:19.487100] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T21:01:19.735522] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:19.959983] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T21:01:19.990616] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-03T21:01:20.362595] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T21:01:20.790744] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-03T21:01:21.590687] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-03T21:01:22.018463] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T21:01:22.390725] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-03T21:01:22.635509] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T21:01:22.812246] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T21:01:23.190727] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-03T21:01:23.990675] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-03T21:01:24.302320] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T21:01:24.790730] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-03T21:01:24.964238] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T21:01:25.131752] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T21:01:25.590740] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-03T21:01:26.390720] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-03T21:01:26.635823] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T21:01:26.670091] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T21:01:27.190725] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-03T21:01:27.990712] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-03T21:01:28.455125] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T21:01:28.790703] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-03T21:01:28.930983] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T21:01:29.152466] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T21:01:29.300511] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T21:01:29.305227] [INFO ] [REMOTE ] PPL: Full fetch complete (77029 records). [2025-10-03T21:01:29.305461] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-03T21:01:29.306446] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:01:29.306576] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:01:29.306679] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:01:29.306759] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-03T21:01:29.306842] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-03T21:01:29.306901] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-03T21:01:29.306966] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-03T21:01:29.307053] [INFO ] [MAIN ] Update Progress: 1717/2370 symbols completed. PPL took 35.3s. Estimated remaining: 1h 31m 49s. Rate: 7.1 symbols/min [2025-10-03T21:01:29.590714] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-03T21:01:30.390681] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-03T21:01:30.781616] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T21:01:31.190714] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-03T21:01:31.829017] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T21:01:31.833360] [INFO ] [REMOTE ] PPG: Full fetch complete (73775 records). [2025-10-03T21:01:31.833559] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-03T21:01:31.996902] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-03T21:01:32.318271] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:01:32.408164] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-03T21:01:32.408267] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-03T21:01:32.409377] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-03T21:01:32.409444] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-03T21:01:32.410951] [DEBUG] [LOCAL ] PPG: Trimmed 73775 records to 51413 (keeping 200 days of data) [2025-10-03T21:01:32.750906] [DEBUG] [LOCAL ] PPG: Primary data saved (51413 records). [2025-10-03T21:01:32.751055] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-03T21:01:32.751155] [INFO ] [MAIN ] Update Progress: 1718/2370 symbols completed. PPG took 42.6s. Estimated remaining: 1h 31m 38s. Rate: 7.1 symbols/min [2025-10-03T21:01:32.790678] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-03T21:01:33.854983] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T21:01:33.859836] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-03T21:01:34.204128] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T21:01:34.390679] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-03T21:01:34.990680] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T21:01:35.190687] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-03T21:01:36.183710] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T21:01:36.185359] [INFO ] [REMOTE ] PPT: Full fetch complete (29086 records). [2025-10-03T21:01:36.185438] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-03T21:01:36.638453] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-03T21:01:36.638707] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-03T21:01:36.639523] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-03T21:01:36.639594] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-03T21:01:36.640874] [DEBUG] [LOCAL ] PPT: Trimmed 29086 records to 20416 (keeping 200 days of data) [2025-10-03T21:01:36.766479] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-03T21:01:36.780103] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-03T21:01:36.817024] [DEBUG] [LOCAL ] PPT: Primary data saved (20416 records). [2025-10-03T21:01:36.817152] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-03T21:01:36.817236] [INFO ] [MAIN ] Update Progress: 1719/2370 symbols completed. PPT took 23.7s. Estimated remaining: 1h 31m 28s. Rate: 7.1 symbols/min [2025-10-03T21:01:38.789340] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T21:01:38.804593] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-03T21:01:40.858259] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T21:01:40.870542] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-03T21:01:42.879198] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T21:01:42.892412] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-03T21:01:44.920597] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T21:01:44.933561] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-03T21:01:46.968338] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T21:01:46.980626] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-03T21:01:48.551699] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T21:01:48.555111] [INFO ] [REMOTE ] PR: Full fetch complete (77598 records). [2025-10-03T21:01:48.555253] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-03T21:01:48.996521] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-03T21:01:48.996606] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-03T21:01:48.997790] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-03T21:01:48.997857] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-03T21:01:48.999637] [DEBUG] [LOCAL ] PR: Trimmed 77598 records to 54390 (keeping 200 days of data) [2025-10-03T21:01:49.364186] [DEBUG] [LOCAL ] PR: Primary data saved (54390 records). [2025-10-03T21:01:49.364345] [INFO ] [MAIN ] PR: Full history saved. [2025-10-03T21:01:49.364467] [INFO ] [MAIN ] Update Progress: 1720/2370 symbols completed. PR took 30.5s. Estimated remaining: 1h 31m 21s. Rate: 7.1 symbols/min [2025-10-03T21:01:50.226281] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:50.230337] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:50.233992] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:50.239358] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-03T21:01:50.261449] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:01:50.262886] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-03T21:01:50.263089] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-03T21:01:50.263397] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-03T21:01:50.263903] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-03T21:01:50.264011] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-03T21:01:50.288407] [DEBUG] [LOCAL ] PRCS: Loaded 2760 existing records from primary storage. [2025-10-03T21:01:50.309606] [INFO ] [MAIN ] PRCS: Loaded 2760 existing records. [2025-10-03T21:01:50.689218] [DEBUG] [LOCAL ] PRG: Loaded 30059 existing records from primary storage. [2025-10-03T21:01:50.613864] [DEBUG] [LOCAL ] PRA: Loaded 35308 existing records from primary storage. [2025-10-03T21:01:50.753823] [INFO ] [MAIN ] PRA: Loaded 35308 existing records. [2025-10-03T21:01:50.747512] [INFO ] [MAIN ] PRG: Loaded 30059 existing records. [2025-10-03T21:01:50.848824] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:01:50.910161] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-03T21:01:50.955173] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-03T21:01:51.064550] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-03T21:01:51.149715] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:51.146276] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-03T21:01:51.195827] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-03T21:01:51.306769] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:01:51.312400] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-03T21:01:51.346225] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-03T21:01:51.411608] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-03T21:01:51.404216] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:01:51.411916] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-03T21:01:51.441684] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-03T21:01:51.550733] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-03T21:01:51.619958] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-03T21:01:51.640302] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-03T21:01:52.437042] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:52.480573] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-03T21:01:52.551834] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:52.562879] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-03T21:01:52.629361] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:01:52.629915] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-03T21:01:52.682352] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T21:01:52.692939] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-03T21:01:52.915288] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-03T21:01:52.916352] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-03T21:01:53.428365] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T21:01:53.429682] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-03T21:01:53.811171] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T21:01:53.816699] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-03T21:01:53.875253] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T21:01:53.877224] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-03T21:01:53.909625] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:01:53.916448] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-03T21:01:53.983052] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T21:01:53.995932] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-03T21:01:54.455688] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T21:01:54.457542] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-03T21:01:54.953259] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T21:01:54.957914] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-03T21:01:55.104982] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T21:01:55.106804] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-03T21:01:55.252251] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T21:01:55.262997] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-03T21:01:55.746241] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T21:01:55.747966] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-03T21:01:55.790989] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T21:01:55.801092] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-03T21:01:56.019329] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:01:56.023881] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-03T21:01:56.568327] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:01:56.569933] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-03T21:01:56.683116] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T21:01:56.693121] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-03T21:01:57.433098] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T21:01:57.438266] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-03T21:01:57.437867] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T21:01:57.527435] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:01:57.590676] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-03T21:01:57.988900] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T21:01:58.198520] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T21:01:58.390700] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-03T21:01:59.200179] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-03T21:01:59.206481] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T21:01:59.840848] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T21:01:59.862343] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T21:01:59.990736] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-03T21:02:00.790706] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-03T21:02:01.210902] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T21:02:01.211695] [INFO ] [REMOTE ] PRCS: Full fetch complete (3843 records). [2025-10-03T21:02:01.211772] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-03T21:02:01.597780] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-03T21:02:01.650166] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-03T21:02:01.650325] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-03T21:02:01.650767] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-03T21:02:01.650891] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-03T21:02:01.652092] [DEBUG] [LOCAL ] PRCS: Trimmed 3843 records to 2779 (keeping 200 days of data) [2025-10-03T21:02:01.671091] [DEBUG] [LOCAL ] PRCS: Primary data saved (2779 records). [2025-10-03T21:02:01.671254] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-03T21:02:01.671387] [INFO ] [MAIN ] Update Progress: 1721/2370 symbols completed. PRCS took 12.3s. Estimated remaining: 1h 31m 14s. Rate: 7.1 symbols/min [2025-10-03T21:02:01.874356] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:01.924564] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T21:02:01.928356] [DEBUG] [LOCAL ] PRH: Loaded 4816 existing records from primary storage. [2025-10-03T21:02:01.939687] [INFO ] [MAIN ] PRH: Loaded 4816 existing records. [2025-10-03T21:02:02.143086] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:02.143337] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-03T21:02:02.143389] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-03T21:02:02.143600] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-03T21:02:02.143704] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-03T21:02:02.395792] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-03T21:02:02.562326] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:03.188372] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T21:02:03.197510] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-03T21:02:03.990738] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-03T21:02:04.143860] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:02:04.463232] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T21:02:04.672243] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T21:02:04.790723] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-03T21:02:05.544028] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T21:02:05.590768] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-03T21:02:06.390724] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-03T21:02:06.926128] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T21:02:07.190725] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-03T21:02:07.736575] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T21:02:07.990673] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-03T21:02:08.790705] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-03T21:02:08.879595] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T21:02:09.590708] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-03T21:02:09.745870] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T21:02:09.847181] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T21:02:10.390722] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-03T21:02:10.425264] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T21:02:11.190737] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-03T21:02:11.872764] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T21:02:11.992069] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-03T21:02:11.991984] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:02:12.790729] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-03T21:02:13.485158] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T21:02:13.590726] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-03T21:02:14.110797] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T21:02:14.390689] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-03T21:02:14.973008] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T21:02:15.167197] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T21:02:15.190702] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-03T21:02:15.990721] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-03T21:02:16.790722] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-03T21:02:16.814864] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T21:02:17.080422] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T21:02:17.590733] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-03T21:02:17.793181] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T21:02:17.795252] [INFO ] [REMOTE ] PRA: Full fetch complete (43906 records). [2025-10-03T21:02:17.795366] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-03T21:02:18.217236] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-03T21:02:18.217339] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-03T21:02:18.218326] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-03T21:02:18.218394] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-03T21:02:18.219994] [DEBUG] [LOCAL ] PRA: Trimmed 43906 records to 35566 (keeping 200 days of data) [2025-10-03T21:02:18.393437] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-03T21:02:18.475162] [DEBUG] [LOCAL ] PRA: Primary data saved (35566 records). [2025-10-03T21:02:18.475325] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-03T21:02:18.475742] [INFO ] [MAIN ] Update Progress: 1722/2370 symbols completed. PRA took 29.1s. Estimated remaining: 1h 31m 9s. Rate: 7.1 symbols/min [2025-10-03T21:02:18.664800] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:18.685103] [DEBUG] [LOCAL ] PRI: Loaded 18394 existing records from primary storage. [2025-10-03T21:02:18.685364] [INFO ] [MAIN ] PRI: Loaded 18394 existing records. [2025-10-03T21:02:18.893017] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:18.893951] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-03T21:02:18.894016] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-03T21:02:18.894255] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-03T21:02:18.894324] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-03T21:02:19.198174] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-03T21:02:19.301292] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:19.376700] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T21:02:19.406127] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T21:02:19.990718] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-03T21:02:20.469016] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:02:20.790703] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-03T21:02:21.176177] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T21:02:21.590731] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-03T21:02:22.249311] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T21:02:22.283810] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T21:02:22.290492] [INFO ] [REMOTE ] PRGO: Full fetch complete (68517 records). [2025-10-03T21:02:22.290771] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-03T21:02:22.395849] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-03T21:02:22.762132] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-03T21:02:22.762236] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-03T21:02:22.763485] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-03T21:02:22.763573] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-03T21:02:22.765474] [DEBUG] [LOCAL ] PRGO: Trimmed 68517 records to 47657 (keeping 200 days of data) [2025-10-03T21:02:23.117306] [DEBUG] [LOCAL ] PRGO: Primary data saved (47657 records). [2025-10-03T21:02:23.123568] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-03T21:02:23.123812] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T21:02:23.124105] [INFO ] [MAIN ] Update Progress: 1723/2370 symbols completed. PRGO took 33.8s. Estimated remaining: 1h 30m 59s. Rate: 7.1 symbols/min [2025-10-03T21:02:23.195803] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-03T21:02:23.317079] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:23.363780] [DEBUG] [LOCAL ] PRIM: Loaded 44670 existing records from primary storage. [2025-10-03T21:02:23.364149] [INFO ] [MAIN ] PRIM: Loaded 44670 existing records. [2025-10-03T21:02:23.560842] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:23.561068] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-03T21:02:23.561117] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-03T21:02:23.561394] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-03T21:02:23.561453] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-03T21:02:23.986876] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:23.990627] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-03T21:02:24.366709] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T21:02:24.371787] [INFO ] [REMOTE ] PRG: Full fetch complete (44325 records). [2025-10-03T21:02:24.372012] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-03T21:02:24.794350] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-03T21:02:24.807913] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-03T21:02:24.808002] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-03T21:02:24.809045] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-03T21:02:24.809152] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-03T21:02:24.810512] [DEBUG] [LOCAL ] PRG: Trimmed 44325 records to 30280 (keeping 200 days of data) [2025-10-03T21:02:25.010661] [DEBUG] [LOCAL ] PRG: Primary data saved (30280 records). [2025-10-03T21:02:25.010829] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-03T21:02:25.010981] [INFO ] [MAIN ] Update Progress: 1724/2370 symbols completed. PRG took 35.6s. Estimated remaining: 1h 30m 48s. Rate: 7.1 symbols/min [2025-10-03T21:02:25.207439] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:25.265385] [DEBUG] [LOCAL ] PRKS: Loaded 42824 existing records from primary storage. [2025-10-03T21:02:25.265791] [INFO ] [MAIN ] PRKS: Loaded 42824 existing records. [2025-10-03T21:02:25.495065] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:25.500089] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-03T21:02:25.500300] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-03T21:02:25.499878] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T21:02:25.502736] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-03T21:02:25.502835] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-03T21:02:25.593629] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-03T21:02:25.817511] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:02:25.964803] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:26.141910] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T21:02:26.142813] [INFO ] [REMOTE ] PRH: Full fetch complete (7556 records). [2025-10-03T21:02:26.142907] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-03T21:02:26.396725] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-03T21:02:26.575401] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-03T21:02:26.575514] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-03T21:02:26.575811] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-03T21:02:26.575895] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-03T21:02:26.576853] [DEBUG] [LOCAL ] PRH: Trimmed 7556 records to 4837 (keeping 200 days of data) [2025-10-03T21:02:26.618349] [DEBUG] [LOCAL ] PRH: Primary data saved (4837 records). [2025-10-03T21:02:26.618529] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-03T21:02:26.618678] [INFO ] [MAIN ] Update Progress: 1725/2370 symbols completed. PRH took 24.9s. Estimated remaining: 1h 30m 37s. Rate: 7.1 symbols/min [2025-10-03T21:02:26.813016] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:26.834269] [DEBUG] [LOCAL ] PRLB: Loaded 20555 existing records from primary storage. [2025-10-03T21:02:26.834571] [INFO ] [MAIN ] PRLB: Loaded 20555 existing records. [2025-10-03T21:02:27.037837] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:27.038068] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-03T21:02:27.038118] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-03T21:02:27.038380] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-03T21:02:27.038442] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-03T21:02:27.195980] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-03T21:02:27.489533] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:27.990719] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-03T21:02:28.190225] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T21:02:28.413155] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T21:02:28.790725] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-03T21:02:29.236547] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T21:02:29.590705] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-03T21:02:29.884492] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T21:02:30.390728] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-03T21:02:31.201976] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-03T21:02:31.204628] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:02:31.566162] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T21:02:31.990697] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-03T21:02:32.790689] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-03T21:02:32.861269] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T21:02:33.519021] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:02:33.590636] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-03T21:02:33.908488] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T21:02:34.390709] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-03T21:02:35.114683] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:02:35.190689] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-03T21:02:35.406761] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T21:02:35.990706] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-03T21:02:36.646271] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T21:02:36.790972] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-03T21:02:37.208522] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T21:02:37.590763] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-03T21:02:38.320098] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T21:02:38.390678] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-03T21:02:39.190666] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-03T21:02:39.327706] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T21:02:39.866341] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T21:02:39.990676] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-03T21:02:40.358270] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T21:02:40.790681] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-03T21:02:41.509209] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:02:41.597865] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-03T21:02:41.603210] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T21:02:42.390729] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-03T21:02:43.190716] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-03T21:02:43.328558] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T21:02:43.537432] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T21:02:43.990704] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-03T21:02:44.790634] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-03T21:02:44.823369] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:02:45.273847] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T21:02:45.509220] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T21:02:45.590699] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-03T21:02:46.390685] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-03T21:02:46.852745] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T21:02:47.190725] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-03T21:02:47.996963] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-03T21:02:48.000351] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T21:02:48.446739] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T21:02:48.790718] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-03T21:02:49.191979] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T21:02:49.590732] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-03T21:02:49.929571] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T21:02:50.390669] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-03T21:02:51.171410] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:02:51.190639] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-03T21:02:51.634041] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T21:02:51.990720] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-03T21:02:52.783292] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:02:52.793266] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-03T21:02:53.090765] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:02:53.093020] [INFO ] [REMOTE ] PRKS: Full fetch complete (61493 records). [2025-10-03T21:02:53.093117] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-03T21:02:53.541881] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-03T21:02:53.541989] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-03T21:02:53.543109] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-03T21:02:53.543177] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-03T21:02:53.544591] [DEBUG] [LOCAL ] PRKS: Trimmed 61493 records to 43142 (keeping 200 days of data) [2025-10-03T21:02:53.595103] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-03T21:02:53.816175] [DEBUG] [LOCAL ] PRKS: Primary data saved (43142 records). [2025-10-03T21:02:53.816331] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-03T21:02:53.816447] [INFO ] [MAIN ] Update Progress: 1726/2370 symbols completed. PRKS took 28.8s. Estimated remaining: 1h 30m 36s. Rate: 7.1 symbols/min [2025-10-03T21:02:53.970367] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T21:02:54.035280] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:54.084089] [DEBUG] [LOCAL ] PRM: Loaded 45005 existing records from primary storage. [2025-10-03T21:02:54.084404] [INFO ] [MAIN ] PRM: Loaded 45005 existing records. [2025-10-03T21:02:54.281500] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:54.281799] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-03T21:02:54.281870] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-03T21:02:54.282155] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-03T21:02:54.282213] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-03T21:02:54.390689] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-03T21:02:54.710890] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:54.713636] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:02:55.124725] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T21:02:55.126057] [INFO ] [REMOTE ] PRI: Full fetch complete (25762 records). [2025-10-03T21:02:55.126158] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-03T21:02:55.195776] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-03T21:02:55.527884] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-03T21:02:55.527982] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-03T21:02:55.528521] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-03T21:02:55.528587] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-03T21:02:55.529564] [DEBUG] [LOCAL ] PRI: Trimmed 25762 records to 18492 (keeping 200 days of data) [2025-10-03T21:02:55.648119] [DEBUG] [LOCAL ] PRI: Primary data saved (18492 records). [2025-10-03T21:02:55.648269] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-03T21:02:55.648394] [INFO ] [MAIN ] Update Progress: 1727/2370 symbols completed. PRI took 37.2s. Estimated remaining: 1h 30m 25s. Rate: 7.1 symbols/min [2025-10-03T21:02:55.840141] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:55.902489] [DEBUG] [LOCAL ] PRMB: Loaded 53528 existing records from primary storage. [2025-10-03T21:02:55.902936] [INFO ] [MAIN ] PRMB: Loaded 53528 existing records. [2025-10-03T21:02:55.995759] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-03T21:02:56.114281] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:02:56.114583] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-03T21:02:56.114673] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-03T21:02:56.115031] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-03T21:02:56.115105] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-03T21:02:56.511630] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:02:56.790681] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-03T21:02:57.050701] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T21:02:57.257325] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T21:02:57.590727] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-03T21:02:58.390714] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-03T21:02:58.831034] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T21:02:59.093633] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T21:02:59.095188] [INFO ] [REMOTE ] PRLB: Full fetch complete (30598 records). [2025-10-03T21:02:59.095294] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-03T21:02:59.195798] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-03T21:02:59.529179] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-03T21:02:59.529303] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-03T21:02:59.530090] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-03T21:02:59.530256] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-03T21:02:59.553856] [DEBUG] [LOCAL ] PRLB: Trimmed 30598 records to 20678 (keeping 200 days of data) [2025-10-03T21:02:59.560266] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T21:02:59.706931] [DEBUG] [LOCAL ] PRLB: Primary data saved (20678 records). [2025-10-03T21:02:59.707061] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-03T21:02:59.707181] [INFO ] [MAIN ] Update Progress: 1728/2370 symbols completed. PRLB took 33.1s. Estimated remaining: 1h 30m 15s. Rate: 7.1 symbols/min [2025-10-03T21:02:59.892486] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:02:59.932495] [DEBUG] [LOCAL ] PRO: Loaded 38650 existing records from primary storage. [2025-10-03T21:02:59.932843] [INFO ] [MAIN ] PRO: Loaded 38650 existing records. [2025-10-03T21:02:59.994680] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-03T21:03:00.141772] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:03:00.141981] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-03T21:03:00.142030] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-03T21:03:00.142269] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-03T21:03:00.142329] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-03T21:03:00.544473] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:00.736545] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:03:00.790688] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-03T21:03:01.590686] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-03T21:03:01.786269] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T21:03:02.390620] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-03T21:03:02.590316] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:03:02.980636] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T21:03:03.190702] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-03T21:03:03.764027] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T21:03:03.990715] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-03T21:03:04.790619] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-03T21:03:04.824833] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:03:05.590631] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-03T21:03:05.864187] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T21:03:06.150806] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T21:03:06.153199] [INFO ] [REMOTE ] PRIM: Full fetch complete (63615 records). [2025-10-03T21:03:06.153308] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-03T21:03:06.395809] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-03T21:03:06.590672] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-03T21:03:06.590811] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-03T21:03:06.591879] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-03T21:03:06.591946] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-03T21:03:06.593423] [DEBUG] [LOCAL ] PRIM: Trimmed 63615 records to 45009 (keeping 200 days of data) [2025-10-03T21:03:06.886612] [DEBUG] [LOCAL ] PRIM: Primary data saved (45009 records). [2025-10-03T21:03:06.886776] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-03T21:03:06.886901] [INFO ] [MAIN ] Update Progress: 1729/2370 symbols completed. PRIM took 43.8s. Estimated remaining: 1h 30m 6s. Rate: 7.1 symbols/min [2025-10-03T21:03:07.070030] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:07.070344] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-03T21:03:07.070422] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-03T21:03:07.070710] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-03T21:03:07.070787] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-03T21:03:07.070873] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-03T21:03:07.070922] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-03T21:03:07.199346] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-03T21:03:07.380115] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T21:03:07.504262] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:07.990635] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-03T21:03:08.249368] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:03:08.249739] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-03T21:03:08.249836] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:03:08.249927] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-03T21:03:08.249998] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:03:08.250073] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-03T21:03:08.250139] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-03T21:03:08.250178] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-03T21:03:08.250253] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-03T21:03:08.250326] [INFO ] [MAIN ] Update Progress: 1730/2370 symbols completed. PRSU took 1.4s. Estimated remaining: 1h 29m 55s. Rate: 7.1 symbols/min [2025-10-03T21:03:08.452491] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:08.452945] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-03T21:03:08.453065] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-03T21:03:08.453435] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-03T21:03:08.453569] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-03T21:03:08.453883] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-03T21:03:08.454063] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-03T21:03:08.617558] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T21:03:08.739816] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:03:08.807242] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-03T21:03:08.933312] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:09.590705] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-03T21:03:10.227706] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T21:03:10.240240] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T21:03:10.390686] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-03T21:03:11.190723] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-03T21:03:11.990718] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-03T21:03:12.037720] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T21:03:12.555755] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T21:03:12.790731] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-03T21:03:13.590677] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-03T21:03:13.662465] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T21:03:13.662786] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T21:03:14.390715] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-03T21:03:14.884673] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T21:03:15.190723] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-03T21:03:15.990749] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-03T21:03:16.167151] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T21:03:16.194571] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T21:03:16.790723] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-03T21:03:17.595522] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-03T21:03:17.597573] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T21:03:17.680693] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T21:03:18.390676] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-03T21:03:19.190629] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-03T21:03:19.610133] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T21:03:19.990701] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-03T21:03:20.059900] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T21:03:20.147926] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T21:03:20.790713] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-03T21:03:21.590696] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-03T21:03:21.927229] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T21:03:22.338907] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T21:03:22.390706] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-03T21:03:23.190726] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-03T21:03:23.501184] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T21:03:23.903806] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T21:03:23.990734] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-03T21:03:24.203598] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:03:24.790726] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-03T21:03:25.377323] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T21:03:25.590706] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-03T21:03:26.269218] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T21:03:26.310427] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T21:03:26.313134] [INFO ] [REMOTE ] PRMB: Full fetch complete (76063 records). [2025-10-03T21:03:26.313245] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-03T21:03:26.395792] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-03T21:03:26.725171] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-03T21:03:26.725307] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-03T21:03:26.726418] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-03T21:03:26.726486] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-03T21:03:26.728061] [DEBUG] [LOCAL ] PRMB: Trimmed 76063 records to 53910 (keeping 200 days of data) [2025-10-03T21:03:27.071328] [DEBUG] [LOCAL ] PRMB: Primary data saved (53910 records). [2025-10-03T21:03:27.071505] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-03T21:03:27.072622] [INFO ] [MAIN ] Update Progress: 1731/2370 symbols completed. PRMB took 31.4s. Estimated remaining: 1h 29m 51s. Rate: 7.1 symbols/min [2025-10-03T21:03:27.195827] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-03T21:03:27.257470] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:27.323736] [DEBUG] [LOCAL ] PRU: Loaded 51747 existing records from primary storage. [2025-10-03T21:03:27.324110] [INFO ] [MAIN ] PRU: Loaded 51747 existing records. [2025-10-03T21:03:27.521944] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:03:27.522175] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-03T21:03:27.522222] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-03T21:03:27.522478] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-10-03T21:03:27.522536] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-03T21:03:27.913601] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:27.939959] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T21:03:27.990688] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-03T21:03:28.700125] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T21:03:28.790695] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-03T21:03:29.590710] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-03T21:03:29.831525] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T21:03:29.914033] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:03:29.916621] [INFO ] [REMOTE ] PRM: Full fetch complete (64486 records). [2025-10-03T21:03:29.916784] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-03T21:03:30.173931] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T21:03:30.336813] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-03T21:03:30.336916] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-03T21:03:30.337998] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-03T21:03:30.338063] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-03T21:03:30.339427] [DEBUG] [LOCAL ] PRM: Trimmed 64486 records to 45329 (keeping 200 days of data) [2025-10-03T21:03:30.399406] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-03T21:03:30.607974] [DEBUG] [LOCAL ] PRM: Primary data saved (45329 records). [2025-10-03T21:03:30.608114] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-03T21:03:30.608216] [INFO ] [MAIN ] Update Progress: 1732/2370 symbols completed. PRM took 36.8s. Estimated remaining: 1h 29m 40s. Rate: 7.1 symbols/min [2025-10-03T21:03:30.783019] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:30.783229] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-03T21:03:30.783287] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-03T21:03:30.783400] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-03T21:03:30.783464] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-03T21:03:30.783508] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-03T21:03:30.783539] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-03T21:03:31.176235] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:31.176863] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:03:31.190621] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-03T21:03:31.990689] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-03T21:03:32.790691] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-03T21:03:32.930315] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T21:03:33.239421] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T21:03:33.590678] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-03T21:03:33.662961] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T21:03:34.390669] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-03T21:03:34.842314] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:03:35.190682] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-03T21:03:35.454874] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T21:03:35.990702] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-03T21:03:36.734891] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T21:03:36.781518] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T21:03:36.790746] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-03T21:03:37.291564] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T21:03:37.590695] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-03T21:03:38.390727] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-03T21:03:38.814553] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T21:03:39.190700] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-03T21:03:39.267490] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T21:03:39.990721] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-03T21:03:40.790679] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-03T21:03:41.047098] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T21:03:41.219182] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T21:03:41.219077] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T21:03:41.222359] [INFO ] [REMOTE ] PRT: Full fetch complete (9097 records). [2025-10-03T21:03:41.222791] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-03T21:03:41.228548] [INFO ] [REMOTE ] PRO: Full fetch complete (52238 records). [2025-10-03T21:03:41.280064] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-03T21:03:41.592516] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-03T21:03:42.111103] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-03T21:03:42.111254] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-03T21:03:42.111374] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-03T21:03:42.111449] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-03T21:03:42.112308] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-03T21:03:42.112589] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-03T21:03:42.112708] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-03T21:03:42.112789] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-03T21:03:42.113769] [DEBUG] [LOCAL ] PRT: Trimmed 9097 records to 5333 (keeping 200 days of data) [2025-10-03T21:03:42.127229] [DEBUG] [LOCAL ] PRO: Trimmed 52238 records to 38992 (keeping 200 days of data) [2025-10-03T21:03:42.248537] [DEBUG] [LOCAL ] PRT: Primary data saved (5333 records). [2025-10-03T21:03:42.256816] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-03T21:03:42.257725] [INFO ] [MAIN ] Update Progress: 1733/2370 symbols completed. PRT took 34.0s. Estimated remaining: 1h 29m 33s. Rate: 7.1 symbols/min [2025-10-03T21:03:42.464984] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-03T21:03:42.569551] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:42.617476] [DEBUG] [LOCAL ] PRO: Primary data saved (38992 records). [2025-10-03T21:03:42.617681] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-03T21:03:42.617786] [INFO ] [MAIN ] Update Progress: 1734/2370 symbols completed. PRO took 42.9s. Estimated remaining: 1h 29m 22s. Rate: 7.1 symbols/min [2025-10-03T21:03:42.758995] [DEBUG] [LOCAL ] PSA: Loaded 42042 existing records from primary storage. [2025-10-03T21:03:42.787778] [INFO ] [MAIN ] PSA: Loaded 42042 existing records. [2025-10-03T21:03:42.817977] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:03:42.974076] [DEBUG] [LOCAL ] PSBD: Loaded 7150 existing records from primary storage. [2025-10-03T21:03:42.980197] [INFO ] [MAIN ] PSBD: Loaded 7150 existing records. [2025-10-03T21:03:43.020458] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T21:03:43.105089] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:03:43.121687] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-03T21:03:43.134022] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-03T21:03:43.134487] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-10-03T21:03:43.140018] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-03T21:03:43.192298] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-03T21:03:43.314989] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:03:43.339166] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-03T21:03:43.344879] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-03T21:03:43.385235] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-03T21:03:43.394020] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-03T21:03:43.703102] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T21:03:43.882239] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:43.990770] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-03T21:03:44.015425] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:03:44.049966] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-03T21:03:44.790693] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-03T21:03:45.459147] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T21:03:45.590738] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-03T21:03:45.636371] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T21:03:46.390681] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-03T21:03:46.398459] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T21:03:47.190725] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-03T21:03:47.990691] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-03T21:03:48.318190] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T21:03:48.446700] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T21:03:48.793334] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-03T21:03:48.806760] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T21:03:49.465507] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T21:03:49.590687] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-03T21:03:50.390685] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-03T21:03:51.190693] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-03T21:03:51.220159] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:03:51.585325] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T21:03:51.990688] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-03T21:03:52.045697] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:03:52.790680] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-03T21:03:53.539696] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T21:03:53.558396] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T21:03:53.590679] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-03T21:03:54.030679] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T21:03:54.390697] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-03T21:03:54.782208] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-03T21:03:55.190680] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-03T21:03:55.990695] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-03T21:03:56.748830] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T21:03:56.790622] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-03T21:03:57.240589] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:03:57.244955] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T21:03:57.590767] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-03T21:03:58.390964] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-03T21:03:58.424312] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T21:03:59.190733] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-03T21:03:59.620786] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T21:03:59.990742] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-03T21:04:00.280960] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T21:04:00.790686] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-03T21:04:01.142827] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T21:04:01.143561] [INFO ] [REMOTE ] PRVS: Full fetch complete (1277 records). [2025-10-03T21:04:01.143680] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-03T21:04:01.331570] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-03T21:04:01.331836] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:04:01.331911] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:04:01.332005] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-03T21:04:01.332098] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-03T21:04:01.332157] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-03T21:04:01.332205] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-03T21:04:01.332286] [INFO ] [MAIN ] Update Progress: 1735/2370 symbols completed. PRVS took 30.7s. Estimated remaining: 1h 29m 17s. Rate: 7.1 symbols/min [2025-10-03T21:04:01.517928] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:01.528569] [DEBUG] [LOCAL ] PSF: Loaded 7014 existing records from primary storage. [2025-10-03T21:04:01.528824] [INFO ] [MAIN ] PSF: Loaded 7014 existing records. [2025-10-03T21:04:01.595326] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-03T21:04:01.724979] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:01.725459] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-03T21:04:01.725586] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-03T21:04:01.725904] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-03T21:04:01.726103] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-03T21:04:02.139520] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-03T21:04:02.189612] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:02.390726] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-03T21:04:03.189066] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T21:04:03.191160] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-03T21:04:03.616903] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T21:04:03.990700] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-03T21:04:04.768619] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T21:04:04.790672] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-03T21:04:04.919151] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T21:04:05.590708] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-03T21:04:05.660478] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:04:06.390710] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-03T21:04:07.069568] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T21:04:07.070709] [INFO ] [REMOTE ] PSBD: Full fetch complete (9614 records). [2025-10-03T21:04:07.070786] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-03T21:04:07.195820] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-03T21:04:07.476162] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-03T21:04:07.476364] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-03T21:04:07.476749] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-03T21:04:07.476871] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-03T21:04:07.477746] [DEBUG] [LOCAL ] PSBD: Trimmed 9614 records to 7287 (keeping 200 days of data) [2025-10-03T21:04:07.541494] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T21:04:07.564399] [DEBUG] [LOCAL ] PSBD: Primary data saved (7287 records). [2025-10-03T21:04:07.565140] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-03T21:04:07.565287] [INFO ] [MAIN ] Update Progress: 1736/2370 symbols completed. PSBD took 24.9s. Estimated remaining: 1h 29m 8s. Rate: 7.1 symbols/min [2025-10-03T21:04:07.769361] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:07.799822] [DEBUG] [LOCAL ] PSFE: Loaded 30221 existing records from primary storage. [2025-10-03T21:04:07.800114] [INFO ] [MAIN ] PSFE: Loaded 30221 existing records. [2025-10-03T21:04:07.989178] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:07.989424] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-03T21:04:07.989473] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-03T21:04:07.989813] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-03T21:04:07.989874] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-03T21:04:08.001335] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-03T21:04:08.408426] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T21:04:08.418672] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:08.790751] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-03T21:04:09.590679] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-03T21:04:10.016563] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T21:04:10.062807] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T21:04:10.305316] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T21:04:10.390678] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-03T21:04:11.190716] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-03T21:04:11.609399] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T21:04:11.990732] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-03T21:04:12.651268] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T21:04:12.654243] [INFO ] [REMOTE ] PRU: Full fetch complete (74228 records). [2025-10-03T21:04:12.654417] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-03T21:04:12.795769] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-03T21:04:13.108392] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-03T21:04:13.108489] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-03T21:04:13.109723] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-03T21:04:13.109804] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-03T21:04:13.111571] [DEBUG] [LOCAL ] PRU: Trimmed 74228 records to 52123 (keeping 200 days of data) [2025-10-03T21:04:13.380217] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T21:04:13.497737] [DEBUG] [LOCAL ] PRU: Primary data saved (52123 records). [2025-10-03T21:04:13.497909] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-03T21:04:13.498675] [INFO ] [MAIN ] Update Progress: 1737/2370 symbols completed. PRU took 46.4s. Estimated remaining: 1h 28m 58s. Rate: 7.1 symbols/min [2025-10-03T21:04:13.595058] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-03T21:04:13.677939] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T21:04:13.709117] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:13.760606] [DEBUG] [LOCAL ] PSN: Loaded 46339 existing records from primary storage. [2025-10-03T21:04:13.760967] [INFO ] [MAIN ] PSN: Loaded 46339 existing records. [2025-10-03T21:04:13.964942] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:13.965205] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-03T21:04:13.965338] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-03T21:04:13.965619] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-03T21:04:13.965722] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-03T21:04:14.367205] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:14.390615] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-03T21:04:15.154446] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T21:04:15.190731] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-03T21:04:15.962131] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T21:04:15.990687] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-03T21:04:16.097329] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:04:16.790677] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-03T21:04:16.944743] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T21:04:17.590722] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-03T21:04:18.333939] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T21:04:18.390671] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-03T21:04:19.190704] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-03T21:04:19.252086] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T21:04:19.730500] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T21:04:19.990696] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-03T21:04:20.043633] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T21:04:20.790697] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-03T21:04:21.407266] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T21:04:21.590698] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-03T21:04:22.087499] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T21:04:22.099727] [INFO ] [REMOTE ] PSA: Full fetch complete (59288 records). [2025-10-03T21:04:22.099922] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-03T21:04:22.395768] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-03T21:04:22.536629] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-03T21:04:22.536759] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-03T21:04:22.537923] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-03T21:04:22.538003] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-03T21:04:22.539555] [DEBUG] [LOCAL ] PSA: Trimmed 59288 records to 42296 (keeping 200 days of data) [2025-10-03T21:04:22.829840] [DEBUG] [LOCAL ] PSA: Primary data saved (42296 records). [2025-10-03T21:04:22.830101] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-03T21:04:22.830240] [INFO ] [MAIN ] Update Progress: 1738/2370 symbols completed. PSA took 40.6s. Estimated remaining: 1h 28m 50s. Rate: 7.1 symbols/min [2025-10-03T21:04:23.038557] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:23.039010] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-03T21:04:23.039255] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-03T21:04:23.039548] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-03T21:04:23.039638] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-03T21:04:23.039817] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-03T21:04:23.039883] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-03T21:04:23.199932] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-03T21:04:23.210903] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:04:23.235941] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T21:04:23.505315] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:23.990706] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-03T21:04:24.790695] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-03T21:04:25.031939] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:04:25.282714] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T21:04:25.590712] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-03T21:04:26.383808] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:04:26.390759] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-03T21:04:26.408709] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T21:04:27.190706] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-03T21:04:27.885254] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T21:04:27.990689] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-03T21:04:28.748588] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T21:04:28.790636] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-03T21:04:29.513134] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T21:04:29.590680] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-03T21:04:30.020959] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T21:04:30.390681] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-03T21:04:30.437162] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T21:04:31.190687] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-03T21:04:31.990637] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-03T21:04:32.188748] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T21:04:32.189700] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T21:04:32.790705] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-03T21:04:33.036426] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T21:04:33.590714] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-03T21:04:34.115618] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:04:34.390696] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-03T21:04:35.037351] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T21:04:35.064000] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T21:04:35.065050] [INFO ] [REMOTE ] PSF: Full fetch complete (9960 records). [2025-10-03T21:04:35.065143] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-03T21:04:35.195826] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-03T21:04:35.460774] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-03T21:04:35.460867] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-03T21:04:35.461187] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-03T21:04:35.461252] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-03T21:04:35.461890] [DEBUG] [LOCAL ] PSF: Trimmed 9960 records to 7060 (keeping 200 days of data) [2025-10-03T21:04:35.507630] [DEBUG] [LOCAL ] PSF: Primary data saved (7060 records). [2025-10-03T21:04:35.507807] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-03T21:04:35.507913] [INFO ] [MAIN ] Update Progress: 1739/2370 symbols completed. PSF took 34.2s. Estimated remaining: 1h 28m 43s. Rate: 7.1 symbols/min [2025-10-03T21:04:35.700189] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:35.745365] [DEBUG] [LOCAL ] PSQH: Loaded 35064 existing records from primary storage. [2025-10-03T21:04:35.745730] [INFO ] [MAIN ] PSQH: Loaded 35064 existing records. [2025-10-03T21:04:35.944598] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:35.944903] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-03T21:04:35.944957] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-03T21:04:35.945194] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-03T21:04:35.945254] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-03T21:04:35.995902] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-03T21:04:36.347787] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:36.402246] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T21:04:36.790735] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-03T21:04:37.476318] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T21:04:37.590698] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-03T21:04:38.368151] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T21:04:38.390613] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-03T21:04:38.572412] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T21:04:38.574157] [INFO ] [REMOTE ] PSFE: Full fetch complete (43100 records). [2025-10-03T21:04:38.574244] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-03T21:04:38.998611] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-03T21:04:38.998740] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-03T21:04:38.999716] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-03T21:04:38.999784] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-03T21:04:39.000973] [DEBUG] [LOCAL ] PSFE: Trimmed 43100 records to 30388 (keeping 200 days of data) [2025-10-03T21:04:39.192730] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-03T21:04:39.214021] [DEBUG] [LOCAL ] PSFE: Primary data saved (30388 records). [2025-10-03T21:04:39.214271] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-03T21:04:39.214385] [INFO ] [MAIN ] Update Progress: 1740/2370 symbols completed. PSFE took 31.6s. Estimated remaining: 1h 28m 33s. Rate: 7.1 symbols/min [2025-10-03T21:04:39.397037] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:39.450933] [DEBUG] [LOCAL ] PSTG: Loaded 53227 existing records from primary storage. [2025-10-03T21:04:39.451283] [INFO ] [MAIN ] PSTG: Loaded 53227 existing records. [2025-10-03T21:04:39.650402] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:39.650626] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-03T21:04:39.650711] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-03T21:04:39.651071] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-03T21:04:39.651132] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-03T21:04:39.993606] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-03T21:04:40.042660] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:40.136492] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T21:04:40.790725] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-03T21:04:40.849034] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T21:04:41.590763] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-03T21:04:42.177743] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T21:04:42.390712] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-03T21:04:42.931268] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T21:04:42.973392] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T21:04:43.190736] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-03T21:04:43.990673] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-03T21:04:44.228427] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T21:04:44.790714] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-03T21:04:45.395954] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-03T21:04:45.426362] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T21:04:45.429028] [INFO ] [REMOTE ] PSN: Full fetch complete (67031 records). [2025-10-03T21:04:45.429191] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-03T21:04:45.600145] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-03T21:04:45.858904] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-03T21:04:45.859003] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-03T21:04:45.860138] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-03T21:04:45.860207] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-03T21:04:45.861761] [DEBUG] [LOCAL ] PSN: Trimmed 67031 records to 46674 (keeping 200 days of data) [2025-10-03T21:04:46.156984] [DEBUG] [LOCAL ] PSN: Primary data saved (46674 records). [2025-10-03T21:04:46.157153] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-03T21:04:46.157990] [INFO ] [MAIN ] Update Progress: 1741/2370 symbols completed. PSN took 32.7s. Estimated remaining: 1h 28m 24s. Rate: 7.1 symbols/min [2025-10-03T21:04:46.347897] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:04:46.371300] [DEBUG] [LOCAL ] PSTL: Loaded 20199 existing records from primary storage. [2025-10-03T21:04:46.371599] [INFO ] [MAIN ] PSTL: Loaded 20199 existing records. [2025-10-03T21:04:46.403542] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-03T21:04:46.512837] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T21:04:46.604854] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:04:46.605141] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-03T21:04:46.605199] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-03T21:04:46.605465] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-03T21:04:46.605533] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-03T21:04:47.019168] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:04:47.190706] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-03T21:04:47.572716] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T21:04:47.719280] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T21:04:47.990723] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-03T21:04:48.480850] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T21:04:48.790745] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-03T21:04:49.152593] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T21:04:49.590692] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-03T21:04:50.400801] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-03T21:04:50.406238] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T21:04:50.429913] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T21:04:51.190730] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-03T21:04:51.990726] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-03T21:04:52.401080] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T21:04:52.762522] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T21:04:52.790624] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-03T21:04:53.239226] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T21:04:53.590730] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-03T21:04:54.259920] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T21:04:54.390685] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-03T21:04:55.190668] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-03T21:04:55.647243] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T21:04:55.685877] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T21:04:55.990739] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-03T21:04:56.790704] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-03T21:04:56.829798] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T21:04:57.590658] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-03T21:04:57.933545] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T21:04:58.043912] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T21:04:58.390675] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-03T21:04:58.806067] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T21:04:59.190623] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-03T21:04:59.262565] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T21:04:59.990698] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-03T21:05:00.348546] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T21:05:00.350601] [INFO ] [REMOTE ] PSO: Full fetch complete (51983 records). [2025-10-03T21:05:00.350736] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-03T21:05:00.772026] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-03T21:05:00.772165] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-03T21:05:00.773367] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-03T21:05:00.773445] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-03T21:05:00.775113] [DEBUG] [LOCAL ] PSO: Trimmed 51983 records to 37454 (keeping 200 days of data) [2025-10-03T21:05:00.834248] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-03T21:05:01.042692] [DEBUG] [LOCAL ] PSO: Primary data saved (37454 records). [2025-10-03T21:05:01.042866] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-03T21:05:01.043016] [INFO ] [MAIN ] Update Progress: 1742/2370 symbols completed. PSO took 38.2s. Estimated remaining: 1h 28m 18s. Rate: 7.1 symbols/min [2025-10-03T21:05:01.259577] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:01.325028] [DEBUG] [LOCAL ] PSX: Loaded 53496 existing records from primary storage. [2025-10-03T21:05:01.325578] [INFO ] [MAIN ] PSX: Loaded 53496 existing records. [2025-10-03T21:05:01.600133] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-03T21:05:01.647000] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:01.648634] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-03T21:05:01.648747] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-03T21:05:01.649099] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-10-03T21:05:01.649177] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-03T21:05:02.177706] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-03T21:05:02.315420] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:02.332956] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T21:05:02.390680] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-03T21:05:03.190664] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-03T21:05:03.265561] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T21:05:03.990630] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-03T21:05:04.371539] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T21:05:04.564129] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T21:05:04.790747] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-03T21:05:05.547574] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T21:05:05.573066] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:05:05.590620] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-03T21:05:06.390679] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-03T21:05:06.809009] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T21:05:07.190692] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-03T21:05:07.990637] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-03T21:05:08.308144] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T21:05:08.389471] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T21:05:08.790724] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-03T21:05:09.590700] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-03T21:05:09.865589] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T21:05:10.390682] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-03T21:05:10.615501] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T21:05:11.201116] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-03T21:05:11.208236] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:05:11.990694] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-03T21:05:12.040669] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T21:05:12.042285] [INFO ] [REMOTE ] PSTL: Full fetch complete (29796 records). [2025-10-03T21:05:12.042374] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-03T21:05:12.465552] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-03T21:05:12.465686] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-03T21:05:12.466752] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-03T21:05:12.466865] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-03T21:05:12.468161] [DEBUG] [LOCAL ] PSTL: Trimmed 29796 records to 20371 (keeping 200 days of data) [2025-10-03T21:05:12.620348] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T21:05:12.673917] [DEBUG] [LOCAL ] PSTL: Primary data saved (20371 records). [2025-10-03T21:05:12.674065] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-03T21:05:12.674191] [INFO ] [MAIN ] Update Progress: 1743/2370 symbols completed. PSTL took 26.5s. Estimated remaining: 1h 28m 11s. Rate: 7.1 symbols/min [2025-10-03T21:05:12.796300] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-03T21:05:12.877816] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:12.895837] [DEBUG] [LOCAL ] PTA: Loaded 15033 existing records from primary storage. [2025-10-03T21:05:12.896073] [INFO ] [MAIN ] PTA: Loaded 15033 existing records. [2025-10-03T21:05:13.081031] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:13.081265] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-03T21:05:13.081314] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-03T21:05:13.081512] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-03T21:05:13.081570] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-03T21:05:13.467183] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:13.590631] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-03T21:05:14.034367] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T21:05:14.390635] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-03T21:05:14.835659] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T21:05:14.865689] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T21:05:15.190716] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-03T21:05:15.990681] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-03T21:05:16.235561] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:05:16.790693] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-03T21:05:16.897168] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T21:05:16.899891] [INFO ] [REMOTE ] PSTG: Full fetch complete (76545 records). [2025-10-03T21:05:16.900120] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-03T21:05:17.367902] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-03T21:05:17.368032] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-03T21:05:17.369334] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-03T21:05:17.369405] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-03T21:05:17.371125] [DEBUG] [LOCAL ] PSTG: Trimmed 76545 records to 53615 (keeping 200 days of data) [2025-10-03T21:05:17.595143] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-03T21:05:17.597765] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T21:05:17.737624] [DEBUG] [LOCAL ] PSTG: Primary data saved (53615 records). [2025-10-03T21:05:17.737798] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-03T21:05:17.737917] [INFO ] [MAIN ] Update Progress: 1744/2370 symbols completed. PSTG took 38.5s. Estimated remaining: 1h 28m 1s. Rate: 7.1 symbols/min [2025-10-03T21:05:17.937918] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:18.021527] [DEBUG] [LOCAL ] PTY: Loaded 37543 existing records from primary storage. [2025-10-03T21:05:18.021997] [INFO ] [MAIN ] PTY: Loaded 37543 existing records. [2025-10-03T21:05:18.096697] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T21:05:18.241752] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:18.242025] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-03T21:05:18.242076] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-03T21:05:18.242481] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-03T21:05:18.242544] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-03T21:05:18.400950] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-03T21:05:18.631418] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:19.107584] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T21:05:19.109663] [INFO ] [REMOTE ] PSQH: Full fetch complete (53463 records). [2025-10-03T21:05:19.109761] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-03T21:05:19.195854] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-03T21:05:19.518956] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T21:05:19.594243] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-03T21:05:19.594338] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-03T21:05:19.595262] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-03T21:05:19.595329] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-03T21:05:19.596540] [DEBUG] [LOCAL ] PSQH: Trimmed 53463 records to 35362 (keeping 200 days of data) [2025-10-03T21:05:19.813852] [DEBUG] [LOCAL ] PSQH: Primary data saved (35362 records). [2025-10-03T21:05:19.814035] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-03T21:05:19.814160] [INFO ] [MAIN ] Update Progress: 1745/2370 symbols completed. PSQH took 44.3s. Estimated remaining: 1h 27m 51s. Rate: 7.1 symbols/min [2025-10-03T21:05:19.993285] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-03T21:05:20.015388] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:20.058162] [DEBUG] [LOCAL ] PUK: Loaded 45020 existing records from primary storage. [2025-10-03T21:05:20.058555] [INFO ] [MAIN ] PUK: Loaded 45020 existing records. [2025-10-03T21:05:20.257912] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:20.258213] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-03T21:05:20.258267] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-03T21:05:20.258578] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-03T21:05:20.258636] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-03T21:05:20.644701] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:20.790733] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-03T21:05:21.118116] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T21:05:21.240774] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-03T21:05:21.590682] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-03T21:05:22.304937] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T21:05:22.390678] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-03T21:05:23.190693] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-03T21:05:23.540399] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T21:05:23.885489] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:05:23.990668] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-03T21:05:24.790702] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-03T21:05:24.937111] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T21:05:25.430496] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T21:05:25.590704] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-03T21:05:26.390706] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-03T21:05:26.673352] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T21:05:26.725040] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T21:05:27.190742] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-03T21:05:27.494405] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T21:05:27.990705] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-03T21:05:28.790694] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-03T21:05:28.930766] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T21:05:28.987343] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T21:05:29.590690] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-03T21:05:30.390694] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-03T21:05:30.448719] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T21:05:31.175584] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T21:05:31.190614] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-03T21:05:31.239129] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T21:05:31.990694] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-03T21:05:32.278823] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T21:05:32.790728] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-03T21:05:33.590701] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-03T21:05:33.659549] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T21:05:33.851422] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T21:05:34.390741] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-03T21:05:35.190710] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-03T21:05:35.311732] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T21:05:35.966690] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T21:05:35.990624] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-03T21:05:36.212425] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T21:05:36.723781] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T21:05:36.725324] [INFO ] [REMOTE ] PTA: Full fetch complete (23270 records). [2025-10-03T21:05:36.725443] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-03T21:05:36.795801] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-03T21:05:37.153230] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-03T21:05:37.153325] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-03T21:05:37.153904] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-03T21:05:37.153973] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-03T21:05:37.154826] [DEBUG] [LOCAL ] PTA: Trimmed 23270 records to 15164 (keeping 200 days of data) [2025-10-03T21:05:37.252424] [DEBUG] [LOCAL ] PTA: Primary data saved (15164 records). [2025-10-03T21:05:37.252589] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-03T21:05:37.252727] [INFO ] [MAIN ] Update Progress: 1746/2370 symbols completed. PTA took 24.6s. Estimated remaining: 1h 27m 45s. Rate: 7.1 symbols/min [2025-10-03T21:05:37.467665] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:37.512183] [DEBUG] [LOCAL ] PUMP: Loaded 49753 existing records from primary storage. [2025-10-03T21:05:37.512543] [INFO ] [MAIN ] PUMP: Loaded 49753 existing records. [2025-10-03T21:05:37.595863] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-03T21:05:37.715749] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:37.715974] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-03T21:05:37.716071] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-03T21:05:37.716350] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-03T21:05:37.716410] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-03T21:05:38.123111] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:38.390709] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-03T21:05:38.658666] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:05:39.172998] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T21:05:39.190614] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-03T21:05:39.990715] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-03T21:05:40.273513] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T21:05:40.801833] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-03T21:05:40.804775] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T21:05:41.590771] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-03T21:05:41.873447] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T21:05:42.390720] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-03T21:05:42.548192] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:05:43.115594] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T21:05:43.119544] [INFO ] [REMOTE ] PSX: Full fetch complete (77054 records). [2025-10-03T21:05:43.119820] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-03T21:05:43.195863] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-03T21:05:43.613603] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-03T21:05:43.613734] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-03T21:05:43.615061] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-03T21:05:43.615138] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-03T21:05:43.617077] [DEBUG] [LOCAL ] PSX: Trimmed 77054 records to 53881 (keeping 200 days of data) [2025-10-03T21:05:43.974887] [DEBUG] [LOCAL ] PSX: Primary data saved (53881 records). [2025-10-03T21:05:43.975044] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-03T21:05:43.977169] [INFO ] [MAIN ] Update Progress: 1747/2370 symbols completed. PSX took 42.9s. Estimated remaining: 1h 27m 36s. Rate: 7.1 symbols/min [2025-10-03T21:05:43.999347] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-03T21:05:44.169186] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:44.198358] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:05:44.271691] [DEBUG] [LOCAL ] PVH: Loaded 50697 existing records from primary storage. [2025-10-03T21:05:44.272100] [INFO ] [MAIN ] PVH: Loaded 50697 existing records. [2025-10-03T21:05:44.479968] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:44.480192] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-03T21:05:44.480242] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-03T21:05:44.481370] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-03T21:05:44.481432] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-03T21:05:44.794907] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-03T21:05:44.922914] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:44.926129] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T21:05:45.590689] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-03T21:05:45.624772] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T21:05:46.390694] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-03T21:05:46.533957] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T21:05:47.190721] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-03T21:05:47.545384] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T21:05:47.990722] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-03T21:05:48.113510] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T21:05:48.749268] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:05:48.790726] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-03T21:05:49.590703] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-03T21:05:49.792875] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T21:05:49.991544] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:05:49.993607] [INFO ] [REMOTE ] PTY: Full fetch complete (53875 records). [2025-10-03T21:05:49.993755] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-03T21:05:50.390691] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-03T21:05:50.406091] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-03T21:05:50.406158] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-03T21:05:50.407290] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-03T21:05:50.407501] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-03T21:05:50.408904] [DEBUG] [LOCAL ] PTY: Trimmed 53875 records to 37828 (keeping 200 days of data) [2025-10-03T21:05:50.655026] [DEBUG] [LOCAL ] PTY: Primary data saved (37828 records). [2025-10-03T21:05:50.655181] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-03T21:05:50.655312] [INFO ] [MAIN ] Update Progress: 1748/2370 symbols completed. PTY took 32.9s. Estimated remaining: 1h 27m 27s. Rate: 7.1 symbols/min [2025-10-03T21:05:50.843446] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:05:50.851366] [DEBUG] [LOCAL ] PVL: Loaded 4773 existing records from primary storage. [2025-10-03T21:05:50.851571] [INFO ] [MAIN ] PVL: Loaded 4773 existing records. [2025-10-03T21:05:51.046024] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:05:51.046311] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-03T21:05:51.046367] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-03T21:05:51.046568] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-03T21:05:51.046627] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-03T21:05:51.213158] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-03T21:05:51.461457] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:05:51.486493] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T21:05:51.990633] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-03T21:05:52.090283] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:05:52.790635] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-03T21:05:52.843232] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T21:05:53.114232] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:05:53.590740] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-03T21:05:54.345280] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T21:05:54.390873] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-03T21:05:54.398274] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:05:55.085713] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T21:05:55.190738] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-03T21:05:55.990737] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-03T21:05:56.679125] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T21:05:56.790688] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-03T21:05:57.163511] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T21:05:57.590691] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-03T21:05:58.390705] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-03T21:05:58.562286] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T21:05:59.190733] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-03T21:05:59.549484] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T21:05:59.915252] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T21:05:59.990735] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-03T21:06:00.198636] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:06:00.790694] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-03T21:06:01.590738] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-03T21:06:01.799117] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T21:06:02.235226] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T21:06:02.238462] [INFO ] [REMOTE ] PUK: Full fetch complete (65249 records). [2025-10-03T21:06:02.238630] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-03T21:06:02.392410] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-03T21:06:02.392253] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T21:06:02.711733] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-03T21:06:02.711834] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-03T21:06:02.712969] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-03T21:06:02.713035] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-03T21:06:02.714546] [DEBUG] [LOCAL ] PUK: Trimmed 65249 records to 45329 (keeping 200 days of data) [2025-10-03T21:06:03.012806] [DEBUG] [LOCAL ] PUK: Primary data saved (45329 records). [2025-10-03T21:06:03.012948] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-03T21:06:03.013033] [INFO ] [MAIN ] Update Progress: 1749/2370 symbols completed. PUK took 43.2s. Estimated remaining: 1h 27m 20s. Rate: 7.1 symbols/min [2025-10-03T21:06:03.201916] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-03T21:06:03.205760] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:03.253722] [DEBUG] [LOCAL ] PWR: Loaded 47367 existing records from primary storage. [2025-10-03T21:06:03.254060] [INFO ] [MAIN ] PWR: Loaded 47367 existing records. [2025-10-03T21:06:03.459376] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:03.459707] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-03T21:06:03.459768] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-03T21:06:03.460120] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-10-03T21:06:03.460207] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-03T21:06:03.864770] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:03.966561] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T21:06:03.990706] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-03T21:06:04.195046] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T21:06:04.790692] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-03T21:06:05.590701] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-03T21:06:06.005272] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T21:06:06.305120] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T21:06:06.390702] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-03T21:06:06.593760] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:06:07.190695] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-03T21:06:07.716408] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T21:06:07.759298] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T21:06:07.990691] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-03T21:06:08.790693] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-03T21:06:09.590638] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-03T21:06:10.054627] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T21:06:10.351616] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T21:06:10.390694] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-03T21:06:10.683427] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T21:06:11.190735] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-03T21:06:11.706638] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T21:06:11.707427] [INFO ] [REMOTE ] PVL: Full fetch complete (7460 records). [2025-10-03T21:06:11.707499] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-03T21:06:11.993541] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-03T21:06:12.115861] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-03T21:06:12.116084] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-03T21:06:12.116344] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-03T21:06:12.116436] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-03T21:06:12.117262] [DEBUG] [LOCAL ] PVL: Trimmed 7460 records to 4798 (keeping 200 days of data) [2025-10-03T21:06:12.172921] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:06:12.191831] [DEBUG] [LOCAL ] PVL: Primary data saved (4798 records). [2025-10-03T21:06:12.191985] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-03T21:06:12.192097] [INFO ] [MAIN ] Update Progress: 1750/2370 symbols completed. PVL took 21.5s. Estimated remaining: 1h 27m 12s. Rate: 7.1 symbols/min [2025-10-03T21:06:12.376955] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:12.377148] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-03T21:06:12.377186] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-03T21:06:12.377301] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-03T21:06:12.377344] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-03T21:06:12.377388] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-03T21:06:12.377420] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-03T21:06:12.795985] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-03T21:06:12.803584] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:13.590630] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-03T21:06:13.684560] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:06:13.695627] [DEBUG] [REMOTE ] PUMP: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T21:06:13.696361] [WARN ] [REMOTE ] PUMP: No data returned for month 2025-09 [2025-10-03T21:06:13.696466] [FATAL] [REMOTE ] PUMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:06:13.696567] [FATAL] [MAIN ] PUMP: Failed to fetch primary data. [2025-10-03T21:06:13.697038] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:06:13.697118] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-03T21:06:13.697186] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-03T21:06:13.697280] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-03T21:06:13.697723] [DEBUG] [LOCAL ] PUMP: Deleted derivative data file. [2025-10-03T21:06:13.699777] [INFO ] [MAIN ] Update Progress: 1751/2370 symbols completed. PUMP took 36.4s. Estimated remaining: 1h 27m 1s. Rate: 7.1 symbols/min [2025-10-03T21:06:13.881407] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:13.881594] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-03T21:06:13.881636] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-03T21:06:13.881783] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-03T21:06:13.881827] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-03T21:06:13.881869] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-03T21:06:13.881903] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-03T21:06:14.268812] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:14.390701] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-03T21:06:14.880458] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T21:06:15.190693] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-03T21:06:15.921529] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T21:06:15.990746] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-03T21:06:16.739339] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:06:16.790628] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-03T21:06:17.590700] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-03T21:06:18.170071] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:06:18.172730] [INFO ] [REMOTE ] PVH: Full fetch complete (70804 records). [2025-10-03T21:06:18.172869] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-03T21:06:18.406177] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-03T21:06:18.598626] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-03T21:06:18.598820] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-03T21:06:18.599948] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-03T21:06:18.600017] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-03T21:06:18.601509] [DEBUG] [LOCAL ] PVH: Trimmed 70804 records to 51026 (keeping 200 days of data) [2025-10-03T21:06:18.951765] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-10-03T21:06:18.982000] [DEBUG] [LOCAL ] PVH: Primary data saved (51026 records). [2025-10-03T21:06:18.982155] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-03T21:06:18.982263] [INFO ] [MAIN ] Update Progress: 1752/2370 symbols completed. PVH took 35.0s. Estimated remaining: 1h 26m 52s. Rate: 7.1 symbols/min [2025-10-03T21:06:19.196981] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-03T21:06:19.200183] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:19.234022] [DEBUG] [LOCAL ] QD: Loaded 28148 existing records from primary storage. [2025-10-03T21:06:19.234341] [INFO ] [MAIN ] QD: Loaded 28148 existing records. [2025-10-03T21:06:19.434682] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:19.435165] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-03T21:06:19.435247] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-03T21:06:19.435788] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-03T21:06:19.435869] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-03T21:06:19.838204] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:19.868488] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T21:06:19.947252] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T21:06:19.990628] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-03T21:06:20.790746] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-03T21:06:21.174293] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T21:06:21.590697] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-03T21:06:21.886262] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-03T21:06:22.390665] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-03T21:06:22.662805] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T21:06:22.960331] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T21:06:23.190682] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-03T21:06:23.990710] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-03T21:06:24.790695] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-03T21:06:25.010699] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-03T21:06:25.104832] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T21:06:25.378074] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T21:06:25.590695] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-03T21:06:26.083163] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T21:06:26.390701] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-03T21:06:27.089387] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T21:06:27.190680] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-03T21:06:27.990850] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-03T21:06:28.403620] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T21:06:28.716620] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-03T21:06:28.790623] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-03T21:06:29.477352] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T21:06:29.590597] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-03T21:06:30.390638] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-03T21:06:30.829921] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T21:06:30.899145] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T21:06:31.190706] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-03T21:06:31.990729] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-03T21:06:32.506237] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T21:06:32.790686] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-03T21:06:32.958235] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-03T21:06:33.209566] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:06:33.590721] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-03T21:06:34.119061] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T21:06:34.390687] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-03T21:06:35.190689] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-03T21:06:35.443808] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T21:06:35.927252] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T21:06:35.990626] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-03T21:06:36.790716] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-03T21:06:37.395119] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T21:06:37.590636] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-03T21:06:37.943681] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-03T21:06:38.390720] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-03T21:06:38.597689] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:06:38.803555] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T21:06:39.190691] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-03T21:06:39.777265] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T21:06:39.990631] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-03T21:06:40.601212] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T21:06:40.603792] [INFO ] [REMOTE ] PWR: Full fetch complete (68851 records). [2025-10-03T21:06:40.603992] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-03T21:06:40.798122] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-03T21:06:40.826003] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T21:06:40.898709] [INFO ] [REMOTE ] PX: Full fetch complete (50735 records). [2025-10-03T21:06:40.920811] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-03T21:06:41.232551] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-03T21:06:41.233990] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-03T21:06:41.257872] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-03T21:06:41.274610] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-03T21:06:41.389565] [DEBUG] [LOCAL ] PWR: Trimmed 68851 records to 47641 (keeping 200 days of data) [2025-10-03T21:06:41.541384] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-03T21:06:41.541536] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-03T21:06:41.542936] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-03T21:06:41.543046] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-03T21:06:41.593614] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-03T21:06:41.597041] [DEBUG] [LOCAL ] PX: Trimmed 50735 records to 34896 (keeping 200 days of data) [2025-10-03T21:06:41.961040] [DEBUG] [LOCAL ] PWR: Primary data saved (47641 records). [2025-10-03T21:06:41.962180] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-03T21:06:41.962573] [INFO ] [MAIN ] Update Progress: 1753/2370 symbols completed. PWR took 38.9s. Estimated remaining: 1h 26m 48s. Rate: 7.1 symbols/min [2025-10-03T21:06:42.222737] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:42.266307] [DEBUG] [LOCAL ] PX: Primary data saved (34896 records). [2025-10-03T21:06:42.266576] [INFO ] [MAIN ] PX: Full history saved. [2025-10-03T21:06:42.279091] [INFO ] [MAIN ] Update Progress: 1754/2370 symbols completed. PX took 30.1s. Estimated remaining: 1h 26m 37s. Rate: 7.1 symbols/min [2025-10-03T21:06:42.314255] [DEBUG] [LOCAL ] QGEN: Loaded 49452 existing records from primary storage. [2025-10-03T21:06:42.350178] [INFO ] [MAIN ] QGEN: Loaded 49452 existing records. [2025-10-03T21:06:42.581969] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:42.664296] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:42.664886] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-03T21:06:42.665004] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-03T21:06:42.665609] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-03T21:06:42.665950] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-03T21:06:42.819487] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T21:06:42.921873] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-03T21:06:43.053893] [DEBUG] [LOCAL ] QS: Loaded 54133 existing records from primary storage. [2025-10-03T21:06:43.075431] [INFO ] [MAIN ] QS: Loaded 54133 existing records. [2025-10-03T21:06:43.189275] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:43.213292] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-03T21:06:43.351757] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:43.352120] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-03T21:06:43.352229] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-03T21:06:43.352720] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-03T21:06:43.352798] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-03T21:06:43.721533] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-03T21:06:43.819556] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:43.990702] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-03T21:06:44.360521] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T21:06:44.790638] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-03T21:06:44.975610] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T21:06:45.590693] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-03T21:06:46.159390] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T21:06:46.390628] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-03T21:06:46.628159] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-03T21:06:47.190737] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-03T21:06:47.990728] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-03T21:06:48.125972] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T21:06:48.395430] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T21:06:48.636704] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-03T21:06:48.790768] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-03T21:06:49.590695] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-03T21:06:50.390638] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-03T21:06:50.449445] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-03T21:06:51.197047] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-03T21:06:51.202565] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:06:51.321050] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T21:06:51.322632] [INFO ] [REMOTE ] QD: Full fetch complete (40181 records). [2025-10-03T21:06:51.322784] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-03T21:06:51.734292] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-03T21:06:51.734401] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-03T21:06:51.735312] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-03T21:06:51.735399] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-03T21:06:51.736745] [DEBUG] [LOCAL ] QD: Trimmed 40181 records to 28286 (keeping 200 days of data) [2025-10-03T21:06:51.846820] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-03T21:06:51.943771] [DEBUG] [LOCAL ] QD: Primary data saved (28286 records). [2025-10-03T21:06:51.943931] [INFO ] [MAIN ] QD: Full history saved. [2025-10-03T21:06:51.944026] [INFO ] [MAIN ] Update Progress: 1755/2370 symbols completed. QD took 33.0s. Estimated remaining: 1h 26m 29s. Rate: 7.1 symbols/min [2025-10-03T21:06:52.002140] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-03T21:06:52.136176] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:52.190530] [DEBUG] [LOCAL ] QSR: Loaded 52816 existing records from primary storage. [2025-10-03T21:06:52.190903] [INFO ] [MAIN ] QSR: Loaded 52816 existing records. [2025-10-03T21:06:52.383858] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:52.384104] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-03T21:06:52.384202] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-03T21:06:52.385758] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-03T21:06:52.385821] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-03T21:06:52.764265] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:52.790738] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-03T21:06:53.547237] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-03T21:06:53.590713] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-03T21:06:53.812587] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:06:54.390716] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-03T21:06:55.190742] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-03T21:06:55.428342] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-03T21:06:55.824153] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-03T21:06:55.990636] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-03T21:06:56.280695] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T21:06:56.597372] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:06:56.599731] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-03T21:06:56.599859] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-03T21:06:56.601034] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:06:56.601131] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:06:56.601192] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:06:56.601266] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-03T21:06:56.601345] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-03T21:06:56.601393] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-03T21:06:56.601443] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-03T21:06:56.601517] [INFO ] [MAIN ] Update Progress: 1756/2370 symbols completed. QBTS took 42.9s. Estimated remaining: 1h 26m 19s. Rate: 7.1 symbols/min [2025-10-03T21:06:56.790114] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:06:56.790673] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-03T21:06:56.853445] [DEBUG] [LOCAL ] QTWO: Loaded 39408 existing records from primary storage. [2025-10-03T21:06:56.853806] [INFO ] [MAIN ] QTWO: Loaded 39408 existing records. [2025-10-03T21:06:57.047661] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:06:57.048058] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-03T21:06:57.048137] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-03T21:06:57.048780] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-03T21:06:57.048854] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-03T21:06:57.181442] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T21:06:57.477524] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:06:57.590727] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-03T21:06:58.390695] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-03T21:06:59.138310] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-03T21:06:59.190725] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-03T21:06:59.506731] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T21:06:59.990634] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-03T21:07:00.218931] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:07:00.790704] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-03T21:07:01.109436] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T21:07:01.590680] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-03T21:07:01.863010] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T21:07:02.390699] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-03T21:07:03.115425] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-03T21:07:03.190635] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-03T21:07:03.456986] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T21:07:03.950598] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T21:07:03.990736] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-03T21:07:04.790770] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-03T21:07:05.465625] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-03T21:07:05.590631] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-03T21:07:05.874196] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T21:07:06.390631] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-03T21:07:06.466348] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T21:07:07.190709] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-03T21:07:07.990628] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-03T21:07:08.255402] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:07:08.347865] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T21:07:08.471911] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-03T21:07:08.790696] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-03T21:07:09.590724] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-03T21:07:09.800403] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:07:10.390709] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-03T21:07:11.195765] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-03T21:07:11.212387] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T21:07:11.454399] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-03T21:07:11.504307] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T21:07:11.506834] [INFO ] [REMOTE ] QGEN: Full fetch complete (70211 records). [2025-10-03T21:07:11.506992] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-03T21:07:11.997269] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-03T21:07:12.070525] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-03T21:07:12.070630] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-03T21:07:12.071968] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-03T21:07:12.072042] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-03T21:07:12.073558] [DEBUG] [LOCAL ] QGEN: Trimmed 70211 records to 49814 (keeping 200 days of data) [2025-10-03T21:07:12.395116] [DEBUG] [LOCAL ] QGEN: Primary data saved (49814 records). [2025-10-03T21:07:12.395270] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-03T21:07:12.395399] [INFO ] [MAIN ] Update Progress: 1757/2370 symbols completed. QGEN took 30.4s. Estimated remaining: 1h 26m 13s. Rate: 7.1 symbols/min [2025-10-03T21:07:12.790700] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-03T21:07:13.430236] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T21:07:13.590690] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-03T21:07:14.445414] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:07:14.455516] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-03T21:07:14.824859] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-03T21:07:15.190620] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-03T21:07:15.418783] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T21:07:15.990668] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-03T21:07:16.171494] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T21:07:16.790710] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-03T21:07:17.892109] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T21:07:17.904973] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-03T21:07:17.917146] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-03T21:07:17.920082] [INFO ] [REMOTE ] QS: Full fetch complete (77886 records). [2025-10-03T21:07:17.920232] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-03T21:07:18.347288] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T21:07:18.382959] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-03T21:07:18.383473] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-03T21:07:18.384779] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-03T21:07:18.384905] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-03T21:07:18.386797] [DEBUG] [LOCAL ] QS: Trimmed 77886 records to 54523 (keeping 200 days of data) [2025-10-03T21:07:18.432297] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-03T21:07:18.716072] [DEBUG] [LOCAL ] QS: Primary data saved (54523 records). [2025-10-03T21:07:18.716218] [INFO ] [MAIN ] QS: Full history saved. [2025-10-03T21:07:18.716308] [INFO ] [MAIN ] Update Progress: 1758/2370 symbols completed. QS took 36.4s. Estimated remaining: 1h 26m 4s. Rate: 7.1 symbols/min [2025-10-03T21:07:19.874522] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T21:07:19.886601] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-03T21:07:19.947780] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:07:19.990636] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-03T21:07:21.510376] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T21:07:21.519281] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-03T21:07:21.612964] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:07:21.625549] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-03T21:07:22.944820] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T21:07:22.947786] [INFO ] [REMOTE ] QSR: Full fetch complete (75854 records). [2025-10-03T21:07:22.947908] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-03T21:07:23.325756] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:07:23.381534] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-03T21:07:23.434027] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-03T21:07:23.434127] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-03T21:07:23.435384] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-03T21:07:23.435453] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-03T21:07:23.437091] [DEBUG] [LOCAL ] QSR: Trimmed 75854 records to 53202 (keeping 200 days of data) [2025-10-03T21:07:23.784086] [DEBUG] [LOCAL ] QSR: Primary data saved (53202 records). [2025-10-03T21:07:23.784231] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-03T21:07:23.784319] [INFO ] [MAIN ] Update Progress: 1759/2370 symbols completed. QSR took 31.8s. Estimated remaining: 1h 25m 55s. Rate: 7.1 symbols/min [2025-10-03T21:07:25.224544] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:07:25.235307] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-03T21:07:26.593739] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T21:07:26.597127] [INFO ] [REMOTE ] QTWO: Full fetch complete (57518 records). [2025-10-03T21:07:26.597285] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-03T21:07:27.022021] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-03T21:07:27.022130] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-03T21:07:27.023378] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-03T21:07:27.023446] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-03T21:07:27.024783] [DEBUG] [LOCAL ] QTWO: Trimmed 57518 records to 39720 (keeping 200 days of data) [2025-10-03T21:07:27.271573] [DEBUG] [LOCAL ] QTWO: Primary data saved (39720 records). [2025-10-03T21:07:27.271751] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-03T21:07:27.272442] [INFO ] [MAIN ] Update Progress: 1760/2370 symbols completed. QTWO took 30.7s. Estimated remaining: 1h 25m 44s. Rate: 7.1 symbols/min [2025-10-03T21:07:27.875562] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:28.037432] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:28.045229] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:28.068223] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:28.081439] [DEBUG] [LOCAL ] QVCD: Loaded 4541 existing records from primary storage. [2025-10-03T21:07:28.081995] [INFO ] [MAIN ] QVCD: Loaded 4541 existing records. [2025-10-03T21:07:28.159333] [DEBUG] [LOCAL ] QVCC: Loaded 8967 existing records from primary storage. [2025-10-03T21:07:28.193611] [INFO ] [MAIN ] QVCC: Loaded 8967 existing records. [2025-10-03T21:07:28.347958] [DEBUG] [LOCAL ] QUAD: Loaded 23572 existing records from primary storage. [2025-10-03T21:07:28.386758] [INFO ] [MAIN ] QUAD: Loaded 23572 existing records. [2025-10-03T21:07:28.478427] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:28.493457] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-03T21:07:28.515603] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-03T21:07:28.529365] [DEBUG] [LOCAL ] QXO: Loaded 53656 existing records from primary storage. [2025-10-03T21:07:28.556623] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-03T21:07:28.556908] [INFO ] [MAIN ] QXO: Loaded 53656 existing records. [2025-10-03T21:07:28.572571] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-03T21:07:28.777186] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:28.919858] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-03T21:07:28.968568] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-03T21:07:29.038699] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:29.060248] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-03T21:07:29.065549] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-03T21:07:29.065788] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-03T21:07:29.072131] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-03T21:07:29.168563] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-03T21:07:29.267809] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-03T21:07:29.329720] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:29.429416] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-03T21:07:29.477011] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-03T21:07:29.560819] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-03T21:07:29.662773] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-03T21:07:29.871253] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:29.897521] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-03T21:07:30.320860] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:30.410894] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-03T21:07:30.663568] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:30.697989] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:30.698946] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-03T21:07:30.698506] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-03T21:07:30.785078] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T21:07:30.786965] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-03T21:07:31.226165] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T21:07:31.229200] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-03T21:07:31.349785] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T21:07:31.351835] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-03T21:07:31.873968] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T21:07:31.875710] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-03T21:07:32.012414] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T21:07:32.014419] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-03T21:07:32.058516] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T21:07:32.064924] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-03T21:07:32.238345] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:07:32.248853] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-03T21:07:32.717261] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:07:32.726755] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T21:07:32.790686] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-03T21:07:32.956806] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T21:07:33.590635] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-03T21:07:33.673536] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T21:07:33.821848] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T21:07:34.390711] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-03T21:07:34.956579] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T21:07:35.190701] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-03T21:07:35.990628] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-03T21:07:36.179482] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T21:07:36.400971] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T21:07:36.653445] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T21:07:36.790687] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-03T21:07:37.590737] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-03T21:07:38.147687] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T21:07:38.390714] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-03T21:07:39.183379] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T21:07:39.202062] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-03T21:07:39.218813] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T21:07:39.990691] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-03T21:07:40.132423] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T21:07:40.790710] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-03T21:07:41.414538] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T21:07:41.590748] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-03T21:07:41.628423] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T21:07:42.390694] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-03T21:07:42.738140] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T21:07:43.190676] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-03T21:07:43.251737] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T21:07:43.906486] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T21:07:43.990722] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-03T21:07:44.790764] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-03T21:07:45.590739] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-03T21:07:45.970392] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T21:07:46.008581] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T21:07:46.150607] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T21:07:46.390752] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-03T21:07:47.148759] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T21:07:47.190730] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-03T21:07:47.882207] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T21:07:47.990751] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-03T21:07:48.790760] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-03T21:07:49.590703] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-03T21:07:49.939237] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T21:07:50.099726] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T21:07:50.101083] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T21:07:50.390737] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-03T21:07:51.190722] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-03T21:07:51.990700] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-03T21:07:52.011518] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T21:07:52.379817] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T21:07:52.790689] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-03T21:07:53.075296] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T21:07:53.590749] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-03T21:07:53.633761] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T21:07:54.390732] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-03T21:07:54.415902] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T21:07:54.417744] [INFO ] [REMOTE ] QUAD: Full fetch complete (34402 records). [2025-10-03T21:07:54.417846] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-03T21:07:54.823517] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-03T21:07:54.823628] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-03T21:07:54.825254] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-03T21:07:54.825357] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-03T21:07:54.826514] [DEBUG] [LOCAL ] QUAD: Trimmed 34402 records to 23662 (keeping 200 days of data) [2025-10-03T21:07:54.987768] [DEBUG] [LOCAL ] QUAD: Primary data saved (23662 records). [2025-10-03T21:07:54.988441] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-03T21:07:54.988728] [INFO ] [MAIN ] Update Progress: 1761/2370 symbols completed. QUAD took 27.7s. Estimated remaining: 1h 25m 43s. Rate: 7.1 symbols/min [2025-10-03T21:07:55.076678] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T21:07:55.099735] [INFO ] [REMOTE ] QVCC: Full fetch complete (12031 records). [2025-10-03T21:07:55.105533] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-03T21:07:55.197410] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-03T21:07:55.240303] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:55.561671] [DEBUG] [LOCAL ] R: Loaded 29158 existing records from primary storage. [2025-10-03T21:07:55.588616] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-03T21:07:55.588736] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-03T21:07:55.589135] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-03T21:07:55.589212] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-03T21:07:55.589440] [INFO ] [MAIN ] R: Loaded 29158 existing records. [2025-10-03T21:07:55.653268] [DEBUG] [LOCAL ] QVCC: Trimmed 12031 records to 9027 (keeping 200 days of data) [2025-10-03T21:07:55.843252] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:55.844316] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-03T21:07:55.844815] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-03T21:07:55.845614] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-03T21:07:55.846295] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-03T21:07:55.966175] [DEBUG] [LOCAL ] QVCC: Primary data saved (9027 records). [2025-10-03T21:07:55.982104] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-03T21:07:56.007695] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-03T21:07:56.007493] [INFO ] [MAIN ] Update Progress: 1762/2370 symbols completed. QVCC took 28.7s. Estimated remaining: 1h 25m 32s. Rate: 7.1 symbols/min [2025-10-03T21:07:56.458134] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:56.513537] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:56.541773] [DEBUG] [LOCAL ] RA: Loaded 21986 existing records from primary storage. [2025-10-03T21:07:56.542134] [INFO ] [MAIN ] RA: Loaded 21986 existing records. [2025-10-03T21:07:56.646356] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T21:07:56.673001] [INFO ] [REMOTE ] QVCD: Full fetch complete (6219 records). [2025-10-03T21:07:56.673257] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-03T21:07:56.796549] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-03T21:07:57.026627] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:57.042720] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-03T21:07:57.067828] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-03T21:07:57.107712] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-03T21:07:57.167516] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-03T21:07:57.545926] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-03T21:07:57.568134] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-03T21:07:57.568838] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-03T21:07:57.586192] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-03T21:07:57.672564] [DEBUG] [LOCAL ] QVCD: Trimmed 6219 records to 4578 (keeping 200 days of data) [2025-10-03T21:07:57.819801] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:57.821553] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-03T21:07:57.861079] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T21:07:57.877859] [DEBUG] [LOCAL ] QVCD: Primary data saved (4578 records). [2025-10-03T21:07:57.878375] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-03T21:07:57.878483] [INFO ] [MAIN ] Update Progress: 1763/2370 symbols completed. QVCD took 30.6s. Estimated remaining: 1h 25m 21s. Rate: 7.1 symbols/min [2025-10-03T21:07:58.062241] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:07:58.099181] [DEBUG] [LOCAL ] RACE: Loaded 32781 existing records from primary storage. [2025-10-03T21:07:58.099620] [INFO ] [MAIN ] RACE: Loaded 32781 existing records. [2025-10-03T21:07:58.313231] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:07:58.322411] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-03T21:07:58.322502] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-03T21:07:58.324954] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-03T21:07:58.324867] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T21:07:58.325070] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-03T21:07:58.399789] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-03T21:07:58.731071] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:07:59.078844] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T21:07:59.190699] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-03T21:07:59.860503] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T21:07:59.971074] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T21:07:59.990676] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-03T21:08:00.790693] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-03T21:08:01.590721] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-03T21:08:02.214107] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-03T21:08:02.400061] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-03T21:08:02.401689] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:08:02.770479] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T21:08:03.190752] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-03T21:08:03.854318] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T21:08:03.990690] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-03T21:08:04.790722] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-03T21:08:05.173881] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T21:08:05.247768] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T21:08:05.590722] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-03T21:08:06.390632] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-03T21:08:06.481287] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:08:07.190624] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-03T21:08:07.471043] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T21:08:07.473746] [INFO ] [REMOTE ] QXO: Full fetch complete (75673 records). [2025-10-03T21:08:07.473863] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-03T21:08:07.917697] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-03T21:08:07.917814] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-03T21:08:07.918983] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-03T21:08:07.919068] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-03T21:08:07.920894] [DEBUG] [LOCAL ] QXO: Trimmed 75673 records to 54046 (keeping 200 days of data) [2025-10-03T21:08:07.992327] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-03T21:08:08.035857] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T21:08:08.300137] [DEBUG] [LOCAL ] QXO: Primary data saved (54046 records). [2025-10-03T21:08:08.300288] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-03T21:08:08.300396] [INFO ] [MAIN ] Update Progress: 1764/2370 symbols completed. QXO took 41.0s. Estimated remaining: 1h 25m 13s. Rate: 7.1 symbols/min [2025-10-03T21:08:08.478690] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:08.514783] [DEBUG] [LOCAL ] RAMP: Loaded 37750 existing records from primary storage. [2025-10-03T21:08:08.515069] [INFO ] [MAIN ] RAMP: Loaded 37750 existing records. [2025-10-03T21:08:08.705889] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:08:08.706212] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-03T21:08:08.706396] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-03T21:08:08.706868] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-03T21:08:08.706941] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-03T21:08:08.794101] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-03T21:08:09.150267] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:08:09.152727] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T21:08:09.258921] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T21:08:09.590693] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-03T21:08:10.390633] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-03T21:08:10.549532] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T21:08:11.069092] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T21:08:11.190702] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-03T21:08:11.479999] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T21:08:11.990714] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-03T21:08:12.790720] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-03T21:08:13.021491] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T21:08:13.467349] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T21:08:13.590696] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-03T21:08:14.073900] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T21:08:14.390726] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-03T21:08:15.089971] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T21:08:15.190722] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-03T21:08:15.609827] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:08:15.990729] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-03T21:08:16.223800] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T21:08:16.790672] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-03T21:08:17.592328] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-03T21:08:17.602015] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T21:08:18.390675] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-03T21:08:18.445099] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:08:19.190694] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-03T21:08:19.284572] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T21:08:19.624869] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T21:08:19.990694] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-03T21:08:20.790711] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-03T21:08:20.824963] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T21:08:21.356946] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T21:08:21.590691] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-03T21:08:22.390638] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-03T21:08:22.528725] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:08:22.712217] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:08:23.190675] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-03T21:08:23.957349] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T21:08:23.990699] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-03T21:08:24.375378] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T21:08:24.790684] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-03T21:08:25.237330] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T21:08:25.590637] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-03T21:08:25.706549] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:08:25.708256] [INFO ] [REMOTE ] RA: Full fetch complete (32004 records). [2025-10-03T21:08:25.708365] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-03T21:08:26.127531] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-03T21:08:26.127665] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-03T21:08:26.128430] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-03T21:08:26.128481] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-03T21:08:26.129349] [DEBUG] [LOCAL ] RA: Trimmed 32004 records to 22099 (keeping 200 days of data) [2025-10-03T21:08:26.277434] [DEBUG] [LOCAL ] RA: Primary data saved (22099 records). [2025-10-03T21:08:26.277624] [INFO ] [MAIN ] RA: Full history saved. [2025-10-03T21:08:26.277795] [INFO ] [MAIN ] Update Progress: 1765/2370 symbols completed. RA took 30.3s. Estimated remaining: 1h 25m 8s. Rate: 7.1 symbols/min [2025-10-03T21:08:26.395774] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-03T21:08:26.460854] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:26.461021] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-03T21:08:26.461061] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-03T21:08:26.461175] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-03T21:08:26.461218] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-03T21:08:26.461262] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-03T21:08:26.461296] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-03T21:08:26.874779] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:08:27.151346] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T21:08:27.190704] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-03T21:08:27.464128] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T21:08:27.465990] [INFO ] [REMOTE ] R: Full fetch complete (42279 records). [2025-10-03T21:08:27.466095] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-03T21:08:27.942806] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-03T21:08:27.942911] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-03T21:08:27.943922] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-03T21:08:27.944017] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-03T21:08:27.945677] [DEBUG] [LOCAL ] R: Trimmed 42279 records to 29355 (keeping 200 days of data) [2025-10-03T21:08:28.005876] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-03T21:08:28.153068] [DEBUG] [LOCAL ] R: Primary data saved (29355 records). [2025-10-03T21:08:28.153219] [INFO ] [MAIN ] R: Full history saved. [2025-10-03T21:08:28.153324] [INFO ] [MAIN ] Update Progress: 1766/2370 symbols completed. R took 33.2s. Estimated remaining: 1h 24m 57s. Rate: 7.1 symbols/min [2025-10-03T21:08:28.335639] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:28.354433] [DEBUG] [LOCAL ] RBC: Loaded 15344 existing records from primary storage. [2025-10-03T21:08:28.354738] [INFO ] [MAIN ] RBC: Loaded 15344 existing records. [2025-10-03T21:08:28.549156] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:08:28.549372] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-03T21:08:28.549421] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-03T21:08:28.549700] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-03T21:08:28.549760] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-03T21:08:28.797161] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-03T21:08:29.008324] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:08:29.011022] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T21:08:29.305355] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T21:08:29.590731] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-03T21:08:30.328222] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:08:30.390681] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-03T21:08:31.190730] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-03T21:08:31.264440] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T21:08:31.413985] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T21:08:31.990735] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-03T21:08:32.600516] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T21:08:32.790667] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-03T21:08:33.166561] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T21:08:33.590707] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-03T21:08:34.390710] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-03T21:08:34.507210] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T21:08:35.190712] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-03T21:08:35.242110] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T21:08:35.360525] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T21:08:35.990748] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-03T21:08:36.389344] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:08:36.391365] [INFO ] [REMOTE ] RACE: Full fetch complete (47723 records). [2025-10-03T21:08:36.391496] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-03T21:08:36.793457] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-03T21:08:36.793774] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-03T21:08:36.793850] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-03T21:08:36.795660] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-03T21:08:36.795836] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-03T21:08:36.797150] [DEBUG] [LOCAL ] RACE: Trimmed 47723 records to 33057 (keeping 200 days of data) [2025-10-03T21:08:37.011800] [DEBUG] [LOCAL ] RACE: Primary data saved (33057 records). [2025-10-03T21:08:37.011948] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-03T21:08:37.012056] [INFO ] [MAIN ] Update Progress: 1767/2370 symbols completed. RACE took 39.1s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-03T21:08:37.200146] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:37.256178] [DEBUG] [LOCAL ] RBLX: Loaded 54104 existing records from primary storage. [2025-10-03T21:08:37.256532] [INFO ] [MAIN ] RBLX: Loaded 54104 existing records. [2025-10-03T21:08:37.451274] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:08:37.451820] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-03T21:08:37.451978] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-03T21:08:37.452414] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-03T21:08:37.452479] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-03T21:08:37.603316] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-03T21:08:37.863604] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T21:08:37.899229] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:08:38.007854] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T21:08:38.390733] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-03T21:08:38.604770] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T21:08:39.190718] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-03T21:08:39.524997] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T21:08:39.527734] [INFO ] [REMOTE ] RAMP: Full fetch complete (53567 records). [2025-10-03T21:08:39.527851] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-03T21:08:39.953234] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-03T21:08:39.953573] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-03T21:08:39.955002] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-03T21:08:39.955095] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-03T21:08:39.956923] [DEBUG] [LOCAL ] RAMP: Trimmed 53567 records to 38075 (keeping 200 days of data) [2025-10-03T21:08:40.009127] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-03T21:08:40.194822] [DEBUG] [LOCAL ] RAMP: Primary data saved (38075 records). [2025-10-03T21:08:40.194982] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-03T21:08:40.196108] [INFO ] [MAIN ] Update Progress: 1768/2370 symbols completed. RAMP took 31.9s. Estimated remaining: 1h 24m 39s. Rate: 7.1 symbols/min [2025-10-03T21:08:40.375763] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:40.390577] [DEBUG] [LOCAL ] RBOT: Loaded 5275 existing records from primary storage. [2025-10-03T21:08:40.390837] [INFO ] [MAIN ] RBOT: Loaded 5275 existing records. [2025-10-03T21:08:40.580977] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:08:40.581246] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-03T21:08:40.581294] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-03T21:08:40.581744] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-03T21:08:40.581803] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-03T21:08:40.806273] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-03T21:08:40.992212] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:08:41.023731] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T21:08:41.090868] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T21:08:41.590696] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-03T21:08:42.390747] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-03T21:08:43.190673] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-03T21:08:43.440739] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-03T21:08:43.486951] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T21:08:43.571410] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T21:08:43.990670] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-03T21:08:44.081955] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T21:08:44.790723] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-03T21:08:45.590748] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-03T21:08:46.025599] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T21:08:46.311081] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-03T21:08:46.390686] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-03T21:08:47.190715] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-03T21:08:47.364003] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T21:08:47.520293] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T21:08:47.990700] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-03T21:08:48.790724] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-03T21:08:49.393927] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-03T21:08:49.590725] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-03T21:08:49.634483] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T21:08:49.802267] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:08:50.390706] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-03T21:08:51.190741] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-03T21:08:51.214526] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T21:08:51.825579] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-03T21:08:51.990712] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-03T21:08:52.790720] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-03T21:08:52.853863] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:08:53.590684] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-03T21:08:53.894505] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T21:08:54.262686] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T21:08:54.390702] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-03T21:08:55.038631] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T21:08:55.190703] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-03T21:08:55.561250] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T21:08:55.990731] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-03T21:08:56.790719] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-03T21:08:57.045355] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T21:08:57.230127] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-03T21:08:57.590736] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-03T21:08:58.390750] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-03T21:08:58.522479] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:08:59.036612] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T21:08:59.038050] [INFO ] [REMOTE ] RBC: Full fetch complete (21948 records). [2025-10-03T21:08:59.038122] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-03T21:08:59.195805] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-03T21:08:59.432622] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-03T21:08:59.432764] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-03T21:08:59.433310] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-03T21:08:59.433404] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-03T21:08:59.434450] [DEBUG] [LOCAL ] RBC: Trimmed 21948 records to 15487 (keeping 200 days of data) [2025-10-03T21:08:59.538220] [DEBUG] [LOCAL ] RBC: Primary data saved (15487 records). [2025-10-03T21:08:59.538371] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-03T21:08:59.538499] [INFO ] [MAIN ] Update Progress: 1769/2370 symbols completed. RBC took 31.4s. Estimated remaining: 1h 24m 34s. Rate: 7.1 symbols/min [2025-10-03T21:08:59.721588] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:08:59.780092] [DEBUG] [LOCAL ] RBRK: Loaded 53518 existing records from primary storage. [2025-10-03T21:08:59.780436] [INFO ] [MAIN ] RBRK: Loaded 53518 existing records. [2025-10-03T21:08:59.980873] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:08:59.981197] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-03T21:08:59.981425] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-03T21:08:59.982017] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-03T21:08:59.982137] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-03T21:08:59.996284] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-03T21:09:00.232740] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-03T21:09:00.426892] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:00.674110] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T21:09:00.676539] [INFO ] [REMOTE ] RBA: Full fetch complete (65862 records). [2025-10-03T21:09:00.676692] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-03T21:09:00.795811] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-03T21:09:00.945129] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T21:09:01.109526] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-03T21:09:01.109615] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-03T21:09:01.110687] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-03T21:09:01.110757] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-03T21:09:01.112225] [DEBUG] [LOCAL ] RBA: Trimmed 65862 records to 46530 (keeping 200 days of data) [2025-10-03T21:09:01.431057] [DEBUG] [LOCAL ] RBA: Primary data saved (46530 records). [2025-10-03T21:09:01.431194] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-03T21:09:01.431307] [INFO ] [MAIN ] Update Progress: 1770/2370 symbols completed. RBA took 35.2s. Estimated remaining: 1h 24m 23s. Rate: 7.1 symbols/min [2025-10-03T21:09:01.595905] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-03T21:09:01.628787] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:01.675856] [DEBUG] [LOCAL ] RC: Loaded 49291 existing records from primary storage. [2025-10-03T21:09:01.676222] [INFO ] [MAIN ] RC: Loaded 49291 existing records. [2025-10-03T21:09:01.872114] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:09:01.872362] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-03T21:09:01.872421] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-03T21:09:01.872690] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-03T21:09:01.872779] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-03T21:09:02.276043] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:02.390679] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-03T21:09:03.190622] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-03T21:09:03.447740] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-03T21:09:03.523257] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T21:09:03.896600] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T21:09:03.990686] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-03T21:09:04.166886] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T21:09:04.790688] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-03T21:09:05.233583] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T21:09:05.590694] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-03T21:09:06.072723] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T21:09:06.395806] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-03T21:09:06.420206] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-03T21:09:07.190737] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-03T21:09:07.990714] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-03T21:09:08.212337] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T21:09:08.790670] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-03T21:09:09.130999] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T21:09:09.167832] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T21:09:09.590697] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-03T21:09:09.623019] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T21:09:10.390701] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-03T21:09:11.190699] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-03T21:09:11.264235] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T21:09:11.555047] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T21:09:11.557296] [INFO ] [REMOTE ] RBLX: Full fetch complete (77387 records). [2025-10-03T21:09:11.557424] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-03T21:09:11.558410] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:09:11.558516] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:09:11.558562] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:09:11.558630] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-03T21:09:11.558750] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-03T21:09:11.558800] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-03T21:09:11.559149] [DEBUG] [LOCAL ] RBLX: Deleted derivative data file. [2025-10-03T21:09:11.559251] [INFO ] [MAIN ] Update Progress: 1771/2370 symbols completed. RBLX took 34.5s. Estimated remaining: 1h 24m 15s. Rate: 7.1 symbols/min [2025-10-03T21:09:11.755718] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:11.755965] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-03T21:09:11.756158] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-03T21:09:11.777852] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-03T21:09:11.787930] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-03T21:09:11.788175] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-03T21:09:11.790405] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-03T21:09:11.790491] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-03T21:09:11.996673] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-03T21:09:12.195236] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:12.603555] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T21:09:12.790683] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-03T21:09:13.541938] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T21:09:13.543137] [INFO ] [REMOTE ] RBOT: Full fetch complete (8707 records). [2025-10-03T21:09:13.543210] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-03T21:09:13.595793] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-03T21:09:13.942721] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-03T21:09:13.942837] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-03T21:09:13.943085] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-03T21:09:13.943161] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-03T21:09:13.943593] [DEBUG] [LOCAL ] RBOT: Trimmed 8707 records to 5519 (keeping 200 days of data) [2025-10-03T21:09:13.977988] [DEBUG] [LOCAL ] RBOT: Primary data saved (5519 records). [2025-10-03T21:09:13.978115] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-03T21:09:13.978216] [INFO ] [MAIN ] Update Progress: 1772/2370 symbols completed. RBOT took 33.8s. Estimated remaining: 1h 24m 5s. Rate: 7.1 symbols/min [2025-10-03T21:09:14.156976] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:14.157163] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-03T21:09:14.157204] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-03T21:09:14.157333] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-03T21:09:14.157385] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-03T21:09:14.157433] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-03T21:09:14.157467] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-03T21:09:14.398489] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-03T21:09:14.534704] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:15.101528] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T21:09:15.190666] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-03T21:09:15.664395] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T21:09:15.713267] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T21:09:15.990695] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-03T21:09:16.790687] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-03T21:09:17.590734] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-03T21:09:17.973983] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T21:09:18.015745] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T21:09:18.390682] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-03T21:09:18.476297] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:09:19.162851] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T21:09:19.190690] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-03T21:09:19.980639] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T21:09:19.990636] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-03T21:09:20.745159] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T21:09:20.790692] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-03T21:09:21.452769] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T21:09:21.590682] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-03T21:09:22.308392] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T21:09:22.390681] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-03T21:09:22.804074] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T21:09:23.190710] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-03T21:09:23.990691] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-03T21:09:24.790615] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-03T21:09:25.329181] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T21:09:25.340971] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T21:09:25.490741] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T21:09:25.590674] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-03T21:09:26.390724] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-03T21:09:27.190691] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-03T21:09:27.742622] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T21:09:27.846900] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T21:09:27.990714] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-03T21:09:28.309744] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T21:09:28.485715] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T21:09:28.790681] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-03T21:09:29.196243] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-03T21:09:29.590693] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-03T21:09:30.228316] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T21:09:30.390710] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-03T21:09:31.057196] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T21:09:31.190688] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-03T21:09:31.990744] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-03T21:09:32.597763] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T21:09:32.790706] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-03T21:09:33.116243] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T21:09:33.172359] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-03T21:09:33.590751] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-03T21:09:34.390752] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-03T21:09:34.825568] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T21:09:35.190712] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-03T21:09:35.546143] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T21:09:35.546870] [INFO ] [REMOTE ] RCB: Full fetch complete (3741 records). [2025-10-03T21:09:35.546944] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-03T21:09:35.746207] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T21:09:35.746542] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:09:35.746896] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:09:35.747052] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-03T21:09:35.747230] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-03T21:09:35.747421] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-03T21:09:35.747506] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-03T21:09:35.747718] [INFO ] [MAIN ] Update Progress: 1773/2370 symbols completed. RCB took 24.2s. Estimated remaining: 1h 24m 1s. Rate: 7.1 symbols/min [2025-10-03T21:09:35.960198] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:35.962779] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-03T21:09:35.998056] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-03T21:09:36.018938] [DEBUG] [LOCAL ] RCI: Loaded 48958 existing records from primary storage. [2025-10-03T21:09:36.019281] [INFO ] [MAIN ] RCI: Loaded 48958 existing records. [2025-10-03T21:09:36.209684] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:09:36.209943] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-03T21:09:36.209999] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-03T21:09:36.210245] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-03T21:09:36.210311] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-03T21:09:36.583184] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:36.790755] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-03T21:09:37.477361] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T21:09:37.590718] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-03T21:09:38.011727] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T21:09:38.390678] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-03T21:09:39.190707] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-03T21:09:39.332901] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T21:09:39.990665] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-03T21:09:40.173223] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T21:09:40.630969] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T21:09:40.790699] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-03T21:09:41.142081] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T21:09:41.145969] [INFO ] [REMOTE ] RBRK: Full fetch complete (76530 records). [2025-10-03T21:09:41.146176] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-03T21:09:41.319551] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T21:09:41.332507] [INFO ] [REMOTE ] RCD: Full fetch complete (6956 records). [2025-10-03T21:09:41.359013] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-03T21:09:41.598539] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-03T21:09:42.049671] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T21:09:42.077131] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:09:42.099555] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-03T21:09:42.099836] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-03T21:09:42.099722] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:09:42.100037] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-03T21:09:42.102559] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-03T21:09:42.102749] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-03T21:09:42.102864] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-03T21:09:42.102963] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-03T21:09:42.103340] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-03T21:09:42.103487] [INFO ] [MAIN ] Update Progress: 1774/2370 symbols completed. RCD took 28.1s. Estimated remaining: 1h 23m 52s. Rate: 7.1 symbols/min [2025-10-03T21:09:42.226127] [DEBUG] [LOCAL ] RBRK: Trimmed 76530 records to 53907 (keeping 200 days of data) [2025-10-03T21:09:42.398044] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-03T21:09:42.471845] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:42.474736] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-03T21:09:42.476035] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-03T21:09:42.476799] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-03T21:09:42.481050] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-03T21:09:42.484266] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-03T21:09:42.484580] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-03T21:09:42.906105] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:43.120508] [DEBUG] [LOCAL ] RBRK: Primary data saved (53907 records). [2025-10-03T21:09:43.120681] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-03T21:09:43.120804] [INFO ] [MAIN ] Update Progress: 1775/2370 symbols completed. RBRK took 43.6s. Estimated remaining: 1h 23m 41s. Rate: 7.1 symbols/min [2025-10-03T21:09:43.195893] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-03T21:09:43.325683] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:43.338979] [DEBUG] [LOCAL ] RCS: Loaded 11689 existing records from primary storage. [2025-10-03T21:09:43.339223] [INFO ] [MAIN ] RCS: Loaded 11689 existing records. [2025-10-03T21:09:43.553076] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:09:43.553458] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-03T21:09:43.554210] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-03T21:09:43.554555] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-03T21:09:43.554621] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-03T21:09:43.675527] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T21:09:43.985088] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:43.990620] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-03T21:09:44.418132] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T21:09:44.790722] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-03T21:09:45.229370] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T21:09:45.250252] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T21:09:45.590741] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-03T21:09:46.390632] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-03T21:09:46.487761] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T21:09:47.190712] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-03T21:09:47.622374] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-03T21:09:47.990703] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-03T21:09:48.052460] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T21:09:48.790732] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-03T21:09:49.072541] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T21:09:49.590668] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-03T21:09:49.634137] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T21:09:50.072101] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T21:09:50.390711] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-03T21:09:51.190710] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-03T21:09:51.389626] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:09:51.390749] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T21:09:51.990706] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-03T21:09:52.697410] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T21:09:52.790721] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-03T21:09:53.455945] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T21:09:53.461598] [INFO ] [REMOTE ] RC: Full fetch complete (70878 records). [2025-10-03T21:09:53.461796] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-03T21:09:53.595880] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-03T21:09:53.831906] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T21:09:53.926715] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-03T21:09:53.926834] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-03T21:09:53.928238] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-03T21:09:53.928325] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-03T21:09:53.931854] [DEBUG] [LOCAL ] RC: Trimmed 70878 records to 49655 (keeping 200 days of data) [2025-10-03T21:09:54.232832] [DEBUG] [LOCAL ] RC: Primary data saved (49655 records). [2025-10-03T21:09:54.233013] [INFO ] [MAIN ] RC: Full history saved. [2025-10-03T21:09:54.233126] [INFO ] [MAIN ] Update Progress: 1776/2370 symbols completed. RC took 52.8s. Estimated remaining: 1h 23m 33s. Rate: 7.1 symbols/min [2025-10-03T21:09:54.395784] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-03T21:09:54.423257] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:09:54.462956] [DEBUG] [LOCAL ] RCUS: Loaded 42717 existing records from primary storage. [2025-10-03T21:09:54.463274] [INFO ] [MAIN ] RCUS: Loaded 42717 existing records. [2025-10-03T21:09:54.651451] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:09:54.651736] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-03T21:09:54.651825] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-03T21:09:54.652104] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-03T21:09:54.652169] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-03T21:09:55.055734] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:09:55.190713] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-03T21:09:55.810306] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T21:09:55.990696] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-03T21:09:56.164219] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T21:09:56.203376] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T21:09:56.790736] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-03T21:09:57.590624] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-03T21:09:57.650947] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:09:57.668906] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T21:09:58.390725] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-03T21:09:59.190734] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-03T21:09:59.871150] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T21:09:59.990706] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-03T21:10:00.134292] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:10:00.615570] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T21:10:00.790724] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-03T21:10:01.590722] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-03T21:10:02.094929] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T21:10:02.390709] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-03T21:10:02.608854] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T21:10:03.190704] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-03T21:10:03.245132] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T21:10:03.364745] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T21:10:03.990703] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-03T21:10:04.790721] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-03T21:10:04.980431] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T21:10:05.438706] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-03T21:10:05.590690] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-03T21:10:06.390701] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-03T21:10:06.488624] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T21:10:06.507292] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T21:10:07.190688] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-03T21:10:07.990668] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-03T21:10:08.172129] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:10:08.172477] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T21:10:08.790702] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-03T21:10:09.590700] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-03T21:10:10.180316] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-03T21:10:10.390672] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-03T21:10:10.550339] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T21:10:11.190667] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-03T21:10:11.308625] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:10:11.310128] [INFO ] [REMOTE ] RCS: Full fetch complete (19157 records). [2025-10-03T21:10:11.310259] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-03T21:10:11.578769] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-03T21:10:11.819052] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-03T21:10:11.819144] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-03T21:10:11.819544] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-03T21:10:11.819585] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-03T21:10:11.820203] [DEBUG] [LOCAL ] RCS: Trimmed 19157 records to 11877 (keeping 200 days of data) [2025-10-03T21:10:11.894860] [DEBUG] [LOCAL ] RCS: Primary data saved (11877 records). [2025-10-03T21:10:11.895012] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-03T21:10:11.895101] [INFO ] [MAIN ] Update Progress: 1777/2370 symbols completed. RCS took 28.8s. Estimated remaining: 1h 23m 28s. Rate: 7.1 symbols/min [2025-10-03T21:10:12.000431] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-03T21:10:12.090611] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:12.145882] [DEBUG] [LOCAL ] RDDT: Loaded 54170 existing records from primary storage. [2025-10-03T21:10:12.146243] [INFO ] [MAIN ] RDDT: Loaded 54170 existing records. [2025-10-03T21:10:12.359881] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:12.360115] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-03T21:10:12.360169] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-03T21:10:12.360528] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-03T21:10:12.360611] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-03T21:10:12.751462] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:12.790705] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-03T21:10:12.944015] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:10:13.590703] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-03T21:10:13.796194] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:10:14.390708] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-03T21:10:15.104222] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T21:10:15.170559] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-03T21:10:15.190613] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-03T21:10:15.307249] [DEBUG] [REMOTE ] RDDT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T21:10:15.307591] [WARN ] [REMOTE ] RDDT: No data returned for month 2025-01 [2025-10-03T21:10:15.307760] [FATAL] [REMOTE ] RDDT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:10:15.307860] [FATAL] [MAIN ] RDDT: Failed to fetch primary data. [2025-10-03T21:10:15.307929] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:10:15.308004] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-03T21:10:15.308070] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-03T21:10:15.308108] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-03T21:10:15.308401] [DEBUG] [LOCAL ] RDDT: Deleted derivative data file. [2025-10-03T21:10:15.308534] [INFO ] [MAIN ] Update Progress: 1778/2370 symbols completed. RDDT took 3.4s. Estimated remaining: 1h 23m 18s. Rate: 7.1 symbols/min [2025-10-03T21:10:15.496279] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:15.541234] [DEBUG] [LOCAL ] RDN: Loaded 45366 existing records from primary storage. [2025-10-03T21:10:15.541585] [INFO ] [MAIN ] RDN: Loaded 45366 existing records. [2025-10-03T21:10:15.757511] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T21:10:15.762789] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:15.765710] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-03T21:10:15.765975] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-03T21:10:15.766252] [INFO ] [REMOTE ] RCI: Full fetch complete (70503 records). [2025-10-03T21:10:15.766377] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-03T21:10:15.766488] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-03T21:10:15.771759] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-03T21:10:15.997684] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-03T21:10:16.622421] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-03T21:10:16.626985] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-03T21:10:16.638709] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-03T21:10:16.655983] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-03T21:10:16.666051] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:16.667872] [DEBUG] [LOCAL ] RCI: Trimmed 70503 records to 49304 (keeping 200 days of data) [2025-10-03T21:10:16.790905] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-03T21:10:17.006161] [DEBUG] [LOCAL ] RCI: Primary data saved (49304 records). [2025-10-03T21:10:17.006311] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-03T21:10:17.006468] [INFO ] [MAIN ] Update Progress: 1779/2370 symbols completed. RCI took 41.3s. Estimated remaining: 1h 23m 7s. Rate: 7.1 symbols/min [2025-10-03T21:10:17.204245] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:17.259009] [DEBUG] [LOCAL ] RDW: Loaded 52434 existing records from primary storage. [2025-10-03T21:10:17.259549] [INFO ] [MAIN ] RDW: Loaded 52434 existing records. [2025-10-03T21:10:17.458696] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:17.459194] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-03T21:10:17.459313] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-03T21:10:17.459630] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-03T21:10:17.459737] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-03T21:10:17.603447] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-03T21:10:17.860053] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T21:10:17.945442] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:18.256311] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T21:10:18.390689] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-03T21:10:18.476932] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:10:19.190705] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-03T21:10:19.961386] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T21:10:19.990696] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-03T21:10:20.199157] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T21:10:20.790704] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-03T21:10:21.590703] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-03T21:10:21.933828] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T21:10:22.390682] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-03T21:10:22.535615] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T21:10:22.918364] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T21:10:23.190679] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-03T21:10:23.990672] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-03T21:10:24.401187] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:10:24.403434] [INFO ] [REMOTE ] RCUS: Full fetch complete (60169 records). [2025-10-03T21:10:24.403546] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-03T21:10:24.796829] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-03T21:10:24.804713] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-03T21:10:24.917180] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-03T21:10:24.917276] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-03T21:10:24.918375] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-03T21:10:24.918441] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-03T21:10:24.919810] [DEBUG] [LOCAL ] RCUS: Trimmed 60169 records to 43030 (keeping 200 days of data) [2025-10-03T21:10:25.187540] [DEBUG] [LOCAL ] RCUS: Primary data saved (43030 records). [2025-10-03T21:10:25.187786] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-03T21:10:25.187893] [INFO ] [MAIN ] Update Progress: 1780/2370 symbols completed. RCUS took 31.0s. Estimated remaining: 1h 22m 59s. Rate: 7.1 symbols/min [2025-10-03T21:10:25.323602] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T21:10:25.374044] [INFO ] [REMOTE ] RCL: Full fetch complete (75037 records). [2025-10-03T21:10:25.395574] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:25.395754] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-03T21:10:25.397576] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T21:10:25.397786] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:10:25.397967] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:10:25.398048] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-03T21:10:25.399776] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-03T21:10:25.399857] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-03T21:10:25.400070] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-03T21:10:25.400166] [INFO ] [MAIN ] Update Progress: 1781/2370 symbols completed. RCL took 43.3s. Estimated remaining: 1h 22m 48s. Rate: 7.1 symbols/min [2025-10-03T21:10:25.591884] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-03T21:10:25.631686] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:25.649543] [DEBUG] [LOCAL ] RDY: Loaded 47185 existing records from primary storage. [2025-10-03T21:10:25.650264] [INFO ] [MAIN ] RDY: Loaded 47185 existing records. [2025-10-03T21:10:25.861619] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T21:10:25.903100] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:25.917773] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-03T21:10:25.918398] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-03T21:10:25.919415] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-03T21:10:25.919488] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-03T21:10:26.056795] [DEBUG] [LOCAL ] RELX: Loaded 48282 existing records from primary storage. [2025-10-03T21:10:26.061373] [INFO ] [MAIN ] RELX: Loaded 48282 existing records. [2025-10-03T21:10:26.404369] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-03T21:10:26.480600] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:26.481296] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-03T21:10:26.481384] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-03T21:10:26.482123] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-03T21:10:26.503514] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-03T21:10:26.702162] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:26.979447] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:27.190746] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-03T21:10:27.902465] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-03T21:10:27.990745] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-03T21:10:28.281620] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T21:10:28.790677] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-03T21:10:29.051716] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T21:10:29.590717] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-03T21:10:30.224128] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-03T21:10:30.367152] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T21:10:30.390612] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-03T21:10:31.099182] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:10:31.190728] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-03T21:10:31.883152] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:10:31.990734] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-03T21:10:32.790741] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-03T21:10:33.112788] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T21:10:33.590709] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-03T21:10:33.988701] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T21:10:34.156137] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T21:10:34.390714] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-03T21:10:35.015229] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T21:10:35.190716] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-03T21:10:35.990736] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-03T21:10:36.530172] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T21:10:36.790692] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-03T21:10:36.998736] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:10:37.590701] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-03T21:10:37.660561] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T21:10:38.390699] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-03T21:10:38.648120] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T21:10:39.190721] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-03T21:10:39.372821] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T21:10:39.990691] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-03T21:10:40.157203] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T21:10:40.790737] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-03T21:10:40.881089] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:10:41.590745] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-03T21:10:42.390679] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-03T21:10:42.490599] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-03T21:10:42.728637] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T21:10:43.204264] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-03T21:10:43.230612] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T21:10:43.990671] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-03T21:10:44.343328] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T21:10:44.790637] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-03T21:10:44.979950] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T21:10:45.586833] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:10:45.595881] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-03T21:10:46.204426] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T21:10:46.390703] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-03T21:10:47.190692] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-03T21:10:47.327812] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T21:10:47.990628] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-03T21:10:48.207097] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T21:10:48.790734] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-03T21:10:49.590698] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-03T21:10:49.662747] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T21:10:49.786673] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:10:49.965676] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T21:10:49.968117] [INFO ] [REMOTE ] RDN: Full fetch complete (66046 records). [2025-10-03T21:10:49.968264] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-03T21:10:50.393589] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-03T21:10:50.412318] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-03T21:10:50.412409] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-03T21:10:50.413576] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-03T21:10:50.413718] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-03T21:10:50.415902] [DEBUG] [LOCAL ] RDN: Trimmed 66046 records to 45683 (keeping 200 days of data) [2025-10-03T21:10:50.706413] [DEBUG] [LOCAL ] RDN: Primary data saved (45683 records). [2025-10-03T21:10:50.706557] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-03T21:10:50.706676] [INFO ] [MAIN ] Update Progress: 1782/2370 symbols completed. RDN took 35.4s. Estimated remaining: 1h 22m 45s. Rate: 7.1 symbols/min [2025-10-03T21:10:50.902787] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:10:50.945039] [DEBUG] [LOCAL ] RERE: Loaded 41454 existing records from primary storage. [2025-10-03T21:10:50.945364] [INFO ] [MAIN ] RERE: Loaded 41454 existing records. [2025-10-03T21:10:51.145698] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:10:51.146141] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-03T21:10:51.146256] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-03T21:10:51.146930] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-03T21:10:51.146995] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-03T21:10:51.207448] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-03T21:10:51.589289] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:10:51.592232] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T21:10:51.990789] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-03T21:10:52.790738] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-03T21:10:52.912215] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-03T21:10:53.152804] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T21:10:53.407038] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T21:10:53.590704] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-03T21:10:54.252130] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:10:54.390699] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-03T21:10:54.539251] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T21:10:55.190721] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-03T21:10:55.990686] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-03T21:10:56.038902] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T21:10:56.210286] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T21:10:56.790742] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-03T21:10:57.590725] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-03T21:10:57.908024] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T21:10:58.390710] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-03T21:10:59.106213] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T21:10:59.121821] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-03T21:10:59.124741] [INFO ] [REMOTE ] RDW: Full fetch complete (74973 records). [2025-10-03T21:10:59.124928] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-03T21:10:59.195838] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-03T21:10:59.586250] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-03T21:10:59.586354] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-03T21:10:59.587788] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-03T21:10:59.587973] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-03T21:10:59.589839] [DEBUG] [LOCAL ] RDW: Trimmed 74973 records to 52824 (keeping 200 days of data) [2025-10-03T21:10:59.907132] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T21:10:59.911177] [INFO ] [REMOTE ] RELX: Full fetch complete (67517 records). [2025-10-03T21:10:59.911628] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-03T21:10:59.993568] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-03T21:11:00.383628] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-03T21:11:00.386201] [DEBUG] [LOCAL ] RDW: Primary data saved (52824 records). [2025-10-03T21:11:00.384091] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-03T21:11:00.387477] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-03T21:11:00.387721] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-03T21:11:00.387631] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-03T21:11:00.388136] [INFO ] [MAIN ] Update Progress: 1783/2370 symbols completed. RDW took 43.4s. Estimated remaining: 1h 22m 37s. Rate: 7.1 symbols/min [2025-10-03T21:11:00.501607] [DEBUG] [LOCAL ] RELX: Trimmed 67517 records to 48642 (keeping 200 days of data) [2025-10-03T21:11:00.646698] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:00.698798] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T21:11:00.712309] [INFO ] [REMOTE ] RDY: Full fetch complete (68945 records). [2025-10-03T21:11:00.714023] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-03T21:11:00.983055] [DEBUG] [LOCAL ] RES: Loaded 47702 existing records from primary storage. [2025-10-03T21:11:01.006004] [INFO ] [MAIN ] RES: Loaded 47702 existing records. [2025-10-03T21:11:01.510678] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-03T21:11:01.511121] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-03T21:11:01.448037] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:01.512422] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-03T21:11:01.513494] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-03T21:11:01.516311] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-03T21:11:01.517309] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-03T21:11:01.519734] [DEBUG] [LOCAL ] RDY: Trimmed 68945 records to 47521 (keeping 200 days of data) [2025-10-03T21:11:01.520300] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-03T21:11:01.536795] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-03T21:11:01.628847] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T21:11:01.683384] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-03T21:11:02.172790] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:02.174868] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-03T21:11:02.185202] [DEBUG] [LOCAL ] RELX: Primary data saved (48642 records). [2025-10-03T21:11:02.186436] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-03T21:11:02.189633] [INFO ] [MAIN ] Update Progress: 1784/2370 symbols completed. RELX took 36.8s. Estimated remaining: 1h 22m 26s. Rate: 7.1 symbols/min [2025-10-03T21:11:02.388338] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:02.547783] [DEBUG] [LOCAL ] REVG: Loaded 41014 existing records from primary storage. [2025-10-03T21:11:02.548965] [INFO ] [MAIN ] REVG: Loaded 41014 existing records. [2025-10-03T21:11:02.799021] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:02.799423] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-03T21:11:02.800021] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-03T21:11:02.801736] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-03T21:11:02.802465] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-03T21:11:03.064724] [DEBUG] [LOCAL ] RDY: Primary data saved (47521 records). [2025-10-03T21:11:03.104358] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-03T21:11:03.125562] [INFO ] [MAIN ] Update Progress: 1785/2370 symbols completed. RDY took 37.9s. Estimated remaining: 1h 22m 15s. Rate: 7.1 symbols/min [2025-10-03T21:11:03.314456] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:03.352778] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-03T21:11:03.361772] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T21:11:03.427101] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-03T21:11:03.447424] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:03.466667] [DEBUG] [LOCAL ] REX: Loaded 14244 existing records from primary storage. [2025-10-03T21:11:03.466914] [INFO ] [MAIN ] REX: Loaded 14244 existing records. [2025-10-03T21:11:03.659706] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:03.660010] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-03T21:11:03.660072] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-03T21:11:03.660535] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-03T21:11:03.660597] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-03T21:11:04.081338] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:04.084459] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-03T21:11:04.087410] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T21:11:04.790669] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-03T21:11:04.884291] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T21:11:04.976215] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T21:11:05.035215] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T21:11:05.590688] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-03T21:11:06.390661] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-03T21:11:06.421185] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T21:11:07.078292] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:11:07.190703] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-03T21:11:07.990674] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-03T21:11:08.103981] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T21:11:08.223486] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T21:11:08.790720] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-03T21:11:09.590684] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-03T21:11:09.746202] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T21:11:10.232365] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T21:11:10.390746] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-03T21:11:10.412465] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T21:11:11.190715] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-03T21:11:11.990682] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-03T21:11:12.030235] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T21:11:12.592015] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T21:11:12.790688] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-03T21:11:13.108981] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T21:11:13.590684] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-03T21:11:14.361319] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:11:14.390622] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-03T21:11:14.717277] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T21:11:15.190699] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-03T21:11:15.651679] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T21:11:15.655249] [INFO ] [REMOTE ] RERE: Full fetch complete (57545 records). [2025-10-03T21:11:15.655356] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-03T21:11:15.995761] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-03T21:11:16.087594] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-03T21:11:16.087842] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-03T21:11:16.088865] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-03T21:11:16.088934] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-03T21:11:16.090388] [DEBUG] [LOCAL ] RERE: Trimmed 57545 records to 41747 (keeping 200 days of data) [2025-10-03T21:11:16.336051] [DEBUG] [LOCAL ] RERE: Primary data saved (41747 records). [2025-10-03T21:11:16.336185] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-03T21:11:16.336311] [INFO ] [MAIN ] Update Progress: 1786/2370 symbols completed. RERE took 25.6s. Estimated remaining: 1h 22m 8s. Rate: 7.1 symbols/min [2025-10-03T21:11:16.517912] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:16.568761] [DEBUG] [LOCAL ] REXR: Loaded 52462 existing records from primary storage. [2025-10-03T21:11:16.569103] [INFO ] [MAIN ] REXR: Loaded 52462 existing records. [2025-10-03T21:11:16.768487] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:16.769199] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-03T21:11:16.769552] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-03T21:11:16.770143] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-03T21:11:16.770214] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-03T21:11:16.804111] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-03T21:11:17.104814] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T21:11:17.138496] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T21:11:17.255310] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:17.590697] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-03T21:11:18.136416] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T21:11:18.390686] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-03T21:11:18.413694] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:11:19.190689] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-03T21:11:19.990694] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-03T21:11:20.119081] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T21:11:20.580617] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T21:11:20.790701] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-03T21:11:21.097639] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T21:11:21.392914] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T21:11:21.590690] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-03T21:11:22.390676] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-03T21:11:23.190688] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-03T21:11:23.236034] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T21:11:23.765707] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T21:11:23.990729] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-03T21:11:24.798558] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-03T21:11:24.803873] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T21:11:25.590661] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-03T21:11:25.685638] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:11:25.732227] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T21:11:26.390682] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-03T21:11:27.187854] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T21:11:27.189441] [INFO ] [REMOTE ] REX: Full fetch complete (21186 records). [2025-10-03T21:11:27.189538] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-03T21:11:27.202303] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-03T21:11:27.670088] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-03T21:11:27.670406] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-03T21:11:27.670979] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-03T21:11:27.671546] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-03T21:11:27.673542] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T21:11:27.685162] [DEBUG] [LOCAL ] REX: Trimmed 21186 records to 14424 (keeping 200 days of data) [2025-10-03T21:11:27.787888] [DEBUG] [LOCAL ] REX: Primary data saved (14424 records). [2025-10-03T21:11:27.788058] [INFO ] [MAIN ] REX: Full history saved. [2025-10-03T21:11:27.788187] [INFO ] [MAIN ] Update Progress: 1787/2370 symbols completed. REX took 24.7s. Estimated remaining: 1h 22m 1s. Rate: 7.1 symbols/min [2025-10-03T21:11:27.980367] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:27.990709] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-03T21:11:28.027404] [DEBUG] [LOCAL ] REZI: Loaded 47292 existing records from primary storage. [2025-10-03T21:11:28.027835] [INFO ] [MAIN ] REZI: Loaded 47292 existing records. [2025-10-03T21:11:28.217567] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:28.217846] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-03T21:11:28.217952] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-03T21:11:28.218202] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-03T21:11:28.218266] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-03T21:11:28.620548] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:28.790742] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-03T21:11:28.863853] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:11:29.590683] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-03T21:11:29.780483] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T21:11:30.354329] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T21:11:30.390696] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-03T21:11:31.195843] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-03T21:11:31.208953] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T21:11:31.917491] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:11:31.990721] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-03T21:11:32.790676] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-03T21:11:32.822552] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T21:11:33.590693] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-03T21:11:33.636939] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:11:33.942227] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T21:11:34.390736] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-03T21:11:35.190678] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-03T21:11:35.347119] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T21:11:35.928112] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T21:11:35.990636] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-03T21:11:36.790635] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-03T21:11:36.992877] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:11:37.586251] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:11:37.595199] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-03T21:11:37.847812] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T21:11:37.850255] [INFO ] [REMOTE ] RES: Full fetch complete (68898 records). [2025-10-03T21:11:37.850368] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-03T21:11:38.266099] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-03T21:11:38.266188] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-03T21:11:38.267258] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-03T21:11:38.267323] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-03T21:11:38.268779] [DEBUG] [LOCAL ] RES: Trimmed 68898 records to 48031 (keeping 200 days of data) [2025-10-03T21:11:38.390676] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-03T21:11:38.574090] [DEBUG] [LOCAL ] RES: Primary data saved (48031 records). [2025-10-03T21:11:38.574254] [INFO ] [MAIN ] RES: Full history saved. [2025-10-03T21:11:38.574347] [INFO ] [MAIN ] Update Progress: 1788/2370 symbols completed. RES took 38.2s. Estimated remaining: 1h 21m 53s. Rate: 7.1 symbols/min [2025-10-03T21:11:38.768065] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:38.826000] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-10-03T21:11:38.826427] [INFO ] [MAIN ] RF: Loaded 54020 existing records. [2025-10-03T21:11:39.020457] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:39.020744] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-03T21:11:39.020801] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-03T21:11:39.021072] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-10-03T21:11:39.021132] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-03T21:11:39.191913] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-03T21:11:39.410101] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:39.441743] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T21:11:39.696025] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T21:11:39.698409] [INFO ] [REMOTE ] REVG: Full fetch complete (58100 records). [2025-10-03T21:11:39.698513] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-03T21:11:39.995876] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-03T21:11:40.122134] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-03T21:11:40.122216] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-03T21:11:40.123227] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-03T21:11:40.123293] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-03T21:11:40.124598] [DEBUG] [LOCAL ] REVG: Trimmed 58100 records to 41293 (keeping 200 days of data) [2025-10-03T21:11:40.395092] [DEBUG] [LOCAL ] REVG: Primary data saved (41293 records). [2025-10-03T21:11:40.395230] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-03T21:11:40.396060] [INFO ] [MAIN ] Update Progress: 1789/2370 symbols completed. REVG took 38.2s. Estimated remaining: 1h 21m 43s. Rate: 7.1 symbols/min [2025-10-03T21:11:40.578182] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:40.592142] [DEBUG] [LOCAL ] RFI: Loaded 10556 existing records from primary storage. [2025-10-03T21:11:40.592371] [INFO ] [MAIN ] RFI: Loaded 10556 existing records. [2025-10-03T21:11:40.794163] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:40.794227] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-03T21:11:40.795342] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-03T21:11:40.795398] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-03T21:11:40.795618] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-03T21:11:40.795707] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-03T21:11:41.291283] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:41.293812] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T21:11:41.596318] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-03T21:11:41.623836] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:11:42.390690] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-03T21:11:42.662019] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T21:11:43.190630] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-03T21:11:43.277066] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T21:11:43.384540] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T21:11:43.990726] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-03T21:11:44.790678] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-03T21:11:45.278825] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T21:11:45.590695] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-03T21:11:45.628959] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T21:11:45.961162] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T21:11:46.390704] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-03T21:11:47.190732] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-03T21:11:47.411535] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T21:11:47.990713] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-03T21:11:48.220924] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:11:48.391361] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T21:11:48.790696] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-03T21:11:49.590639] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-03T21:11:49.832014] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:11:50.008126] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:11:50.256697] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T21:11:50.390691] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-03T21:11:51.190715] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-03T21:11:51.990705] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-03T21:11:52.181948] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T21:11:52.790706] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-03T21:11:52.928616] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T21:11:53.296841] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T21:11:53.590719] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-03T21:11:54.390744] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-03T21:11:54.467085] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T21:11:55.089578] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T21:11:55.092114] [INFO ] [REMOTE ] REXR: Full fetch complete (75174 records). [2025-10-03T21:11:55.092224] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-03T21:11:55.199096] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-03T21:11:55.517464] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T21:11:55.549135] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-03T21:11:55.549248] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-03T21:11:55.550619] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-03T21:11:55.550759] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-03T21:11:55.552442] [DEBUG] [LOCAL ] REXR: Trimmed 75174 records to 52834 (keeping 200 days of data) [2025-10-03T21:11:55.905116] [DEBUG] [LOCAL ] REXR: Primary data saved (52834 records). [2025-10-03T21:11:55.905269] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-03T21:11:55.905386] [INFO ] [MAIN ] Update Progress: 1790/2370 symbols completed. REXR took 39.6s. Estimated remaining: 1h 21m 36s. Rate: 7.1 symbols/min [2025-10-03T21:11:56.001427] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-03T21:11:56.111060] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:11:56.124659] [DEBUG] [LOCAL ] RFL: Loaded 11222 existing records from primary storage. [2025-10-03T21:11:56.124942] [INFO ] [MAIN ] RFL: Loaded 11222 existing records. [2025-10-03T21:11:56.321872] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:11:56.322145] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-03T21:11:56.322205] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-03T21:11:56.322399] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-03T21:11:56.322467] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-03T21:11:56.712025] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:11:56.790692] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-03T21:11:57.180007] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T21:11:57.590672] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-03T21:11:57.658920] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T21:11:57.804508] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:11:58.390705] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-03T21:11:58.963082] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-03T21:11:59.190724] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-03T21:11:59.338951] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:11:59.990725] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-03T21:12:00.790722] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-03T21:12:00.833380] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T21:12:00.837155] [INFO ] [REMOTE ] REZI: Full fetch complete (66006 records). [2025-10-03T21:12:00.837348] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-03T21:12:00.996575] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T21:12:01.382603] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-03T21:12:01.382739] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-03T21:12:01.384017] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-03T21:12:01.384111] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-03T21:12:01.385981] [DEBUG] [LOCAL ] REZI: Trimmed 66006 records to 47649 (keeping 200 days of data) [2025-10-03T21:12:01.613231] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-03T21:12:01.702667] [DEBUG] [LOCAL ] REZI: Primary data saved (47649 records). [2025-10-03T21:12:01.702834] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-03T21:12:01.702932] [INFO ] [MAIN ] Update Progress: 1791/2370 symbols completed. REZI took 33.9s. Estimated remaining: 1h 21m 27s. Rate: 7.1 symbols/min [2025-10-03T21:12:01.898603] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:01.905851] [DEBUG] [LOCAL ] RFM: Loaded 4188 existing records from primary storage. [2025-10-03T21:12:01.906040] [INFO ] [MAIN ] RFM: Loaded 4188 existing records. [2025-10-03T21:12:02.114353] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:02.114621] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-03T21:12:02.114762] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-03T21:12:02.115057] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-03T21:12:02.115116] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-03T21:12:02.405617] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T21:12:02.391895] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-03T21:12:02.521191] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:02.810079] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T21:12:03.190664] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-03T21:12:03.415183] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T21:12:03.872912] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T21:12:03.990707] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-03T21:12:04.790698] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-03T21:12:05.492864] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T21:12:05.590672] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-03T21:12:06.030196] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T21:12:06.390765] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-03T21:12:06.580905] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T21:12:07.077291] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T21:12:07.190728] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-03T21:12:07.990779] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-03T21:12:08.104103] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T21:12:08.790731] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-03T21:12:09.314727] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T21:12:09.316224] [INFO ] [REMOTE ] RFI: Full fetch complete (15759 records). [2025-10-03T21:12:09.316305] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-03T21:12:09.599726] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-03T21:12:09.764408] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-03T21:12:09.764595] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-03T21:12:09.765613] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-03T21:12:09.765719] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-03T21:12:09.766452] [DEBUG] [LOCAL ] RFI: Trimmed 15759 records to 10606 (keeping 200 days of data) [2025-10-03T21:12:09.863742] [DEBUG] [LOCAL ] RFI: Primary data saved (10606 records). [2025-10-03T21:12:09.864063] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-03T21:12:09.864268] [INFO ] [MAIN ] Update Progress: 1792/2370 symbols completed. RFI took 29.5s. Estimated remaining: 1h 21m 19s. Rate: 7.1 symbols/min [2025-10-03T21:12:10.102339] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:10.149943] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T21:12:10.167729] [DEBUG] [LOCAL ] RFMZ: Loaded 8813 existing records from primary storage. [2025-10-03T21:12:10.168699] [INFO ] [MAIN ] RFMZ: Loaded 8813 existing records. [2025-10-03T21:12:10.349275] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T21:12:10.379789] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:10.380599] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-03T21:12:10.380730] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-03T21:12:10.381002] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-03T21:12:10.381064] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-03T21:12:10.395803] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-03T21:12:10.811310] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:11.059077] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T21:12:11.190700] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-03T21:12:11.990698] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-03T21:12:12.379778] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T21:12:12.790713] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-03T21:12:13.575845] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T21:12:13.590612] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-03T21:12:13.838946] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T21:12:14.244344] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T21:12:14.390695] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-03T21:12:15.190689] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-03T21:12:15.230100] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:12:15.990746] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-03T21:12:16.673134] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T21:12:16.676271] [INFO ] [REMOTE ] RF: Full fetch complete (77627 records). [2025-10-03T21:12:16.676441] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-03T21:12:16.790990] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-03T21:12:16.936423] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T21:12:17.108518] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-03T21:12:17.108679] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-03T21:12:17.110292] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-03T21:12:17.110368] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-03T21:12:17.112614] [DEBUG] [LOCAL ] RF: Trimmed 77627 records to 54410 (keeping 200 days of data) [2025-10-03T21:12:17.465304] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T21:12:17.484435] [DEBUG] [LOCAL ] RF: Primary data saved (54410 records). [2025-10-03T21:12:17.484705] [INFO ] [MAIN ] RF: Full history saved. [2025-10-03T21:12:17.484914] [INFO ] [MAIN ] Update Progress: 1793/2370 symbols completed. RF took 38.9s. Estimated remaining: 1h 21m 10s. Rate: 7.1 symbols/min [2025-10-03T21:12:17.595842] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-03T21:12:17.672997] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:17.711170] [DEBUG] [LOCAL ] RGA: Loaded 29832 existing records from primary storage. [2025-10-03T21:12:17.711677] [INFO ] [MAIN ] RGA: Loaded 29832 existing records. [2025-10-03T21:12:17.895742] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:17.896127] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-03T21:12:17.896187] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-03T21:12:17.896552] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-03T21:12:17.896616] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-03T21:12:18.268116] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:18.390724] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-03T21:12:18.560586] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T21:12:19.190727] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-03T21:12:19.763740] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T21:12:19.990636] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-03T21:12:20.351341] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:12:20.790683] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-03T21:12:21.581049] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:12:21.590924] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-03T21:12:21.696344] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T21:12:22.390760] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-03T21:12:22.568018] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T21:12:23.071156] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-03T21:12:23.190696] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-03T21:12:23.977244] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T21:12:23.990608] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-03T21:12:24.527297] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-03T21:12:24.790689] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-03T21:12:25.590715] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-03T21:12:26.399308] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-03T21:12:26.417154] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:12:26.495356] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T21:12:27.190632] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-03T21:12:27.241705] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T21:12:27.990725] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-03T21:12:28.274878] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T21:12:28.596751] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T21:12:28.790722] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-03T21:12:29.443454] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T21:12:29.444505] [INFO ] [REMOTE ] RFL: Full fetch complete (13004 records). [2025-10-03T21:12:29.444585] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-03T21:12:29.595782] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-03T21:12:29.880205] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-03T21:12:29.880283] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-03T21:12:29.880597] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-03T21:12:29.880638] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-03T21:12:29.881278] [DEBUG] [LOCAL ] RFL: Trimmed 13004 records to 11269 (keeping 200 days of data) [2025-10-03T21:12:29.948235] [DEBUG] [LOCAL ] RFL: Primary data saved (11269 records). [2025-10-03T21:12:29.948398] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-03T21:12:29.948517] [INFO ] [MAIN ] Update Progress: 1794/2370 symbols completed. RFL took 34.0s. Estimated remaining: 1h 21m 3s. Rate: 7.1 symbols/min [2025-10-03T21:12:30.135518] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:30.158906] [DEBUG] [LOCAL ] RGR: Loaded 20763 existing records from primary storage. [2025-10-03T21:12:30.159171] [INFO ] [MAIN ] RGR: Loaded 20763 existing records. [2025-10-03T21:12:30.351898] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:30.352150] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-03T21:12:30.352201] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-03T21:12:30.352486] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-03T21:12:30.352551] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-03T21:12:30.400929] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-03T21:12:30.751219] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:31.190715] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-03T21:12:31.216369] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:12:31.239215] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T21:12:31.949965] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T21:12:31.990700] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-03T21:12:32.790676] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-03T21:12:33.153367] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T21:12:33.590666] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-03T21:12:33.643603] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T21:12:34.180576] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T21:12:34.390729] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-03T21:12:35.190724] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-03T21:12:35.885393] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T21:12:35.990696] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-03T21:12:36.276288] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T21:12:36.790737] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-03T21:12:37.418220] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T21:12:37.462821] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T21:12:37.590725] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-03T21:12:38.256192] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T21:12:38.390735] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-03T21:12:39.190667] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-03T21:12:39.567317] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T21:12:39.805377] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:12:39.806340] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12714 records). [2025-10-03T21:12:39.806412] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-03T21:12:39.997484] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-03T21:12:40.203276] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-03T21:12:40.203374] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-03T21:12:40.203769] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-03T21:12:40.203832] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-03T21:12:40.204342] [DEBUG] [LOCAL ] RFMZ: Trimmed 12714 records to 8851 (keeping 200 days of data) [2025-10-03T21:12:40.260919] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8851 records). [2025-10-03T21:12:40.261059] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-03T21:12:40.261186] [INFO ] [MAIN ] Update Progress: 1795/2370 symbols completed. RFMZ took 30.4s. Estimated remaining: 1h 20m 55s. Rate: 7.1 symbols/min [2025-10-03T21:12:40.443023] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:40.448623] [DEBUG] [LOCAL ] RGT: Loaded 2781 existing records from primary storage. [2025-10-03T21:12:40.448860] [INFO ] [MAIN ] RGT: Loaded 2781 existing records. [2025-10-03T21:12:40.642515] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:40.642756] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-03T21:12:40.642833] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-03T21:12:40.643068] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-03T21:12:40.643139] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-03T21:12:40.800566] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-03T21:12:41.032098] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:41.303008] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T21:12:41.590691] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-03T21:12:41.950243] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T21:12:42.135197] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T21:12:42.136138] [INFO ] [REMOTE ] RFM: Full fetch complete (5900 records). [2025-10-03T21:12:42.136215] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-03T21:12:42.398235] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-03T21:12:42.534676] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-03T21:12:42.534769] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-03T21:12:42.534982] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-03T21:12:42.535040] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-03T21:12:42.535483] [DEBUG] [LOCAL ] RFM: Trimmed 5900 records to 4209 (keeping 200 days of data) [2025-10-03T21:12:42.566285] [DEBUG] [LOCAL ] RFM: Primary data saved (4209 records). [2025-10-03T21:12:42.566433] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-03T21:12:42.566560] [INFO ] [MAIN ] Update Progress: 1796/2370 symbols completed. RFM took 40.9s. Estimated remaining: 1h 20m 44s. Rate: 7.1 symbols/min [2025-10-03T21:12:42.747719] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:12:42.803372] [DEBUG] [LOCAL ] RH: Loaded 47866 existing records from primary storage. [2025-10-03T21:12:42.803743] [INFO ] [MAIN ] RH: Loaded 47866 existing records. [2025-10-03T21:12:42.997514] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:12:42.997790] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-03T21:12:42.997841] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-03T21:12:42.998153] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-03T21:12:42.998250] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-03T21:12:43.195860] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-03T21:12:43.374544] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:12:43.912195] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T21:12:43.990688] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-03T21:12:44.024366] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T21:12:44.790727] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-03T21:12:45.596475] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-03T21:12:45.599454] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:12:46.307192] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T21:12:46.390716] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-03T21:12:46.773241] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T21:12:47.079094] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T21:12:47.190730] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-03T21:12:47.990734] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-03T21:12:48.491866] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T21:12:48.680417] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T21:12:48.790729] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-03T21:12:49.590673] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-03T21:12:49.745661] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:12:49.747417] [INFO ] [REMOTE ] RGA: Full fetch complete (45528 records). [2025-10-03T21:12:49.747502] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-03T21:12:50.158397] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-03T21:12:50.158479] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-03T21:12:50.159475] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-03T21:12:50.159543] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-03T21:12:50.160601] [DEBUG] [LOCAL ] RGA: Trimmed 45528 records to 30097 (keeping 200 days of data) [2025-10-03T21:12:50.354006] [DEBUG] [LOCAL ] RGA: Primary data saved (30097 records). [2025-10-03T21:12:50.354160] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-03T21:12:50.354263] [INFO ] [MAIN ] Update Progress: 1797/2370 symbols completed. RGA took 32.9s. Estimated remaining: 1h 20m 36s. Rate: 7.1 symbols/min [2025-10-03T21:12:50.390671] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-03T21:12:50.752624] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T21:12:51.051788] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T21:12:51.190682] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-03T21:12:51.990712] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-03T21:12:52.667901] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-03T21:12:52.790722] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-03T21:12:52.905173] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T21:12:53.346582] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T21:12:53.590706] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-03T21:12:54.235177] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T21:12:54.390696] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-03T21:12:54.908674] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T21:12:55.190729] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-03T21:12:55.990673] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-03T21:12:56.348962] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:12:56.790756] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-03T21:12:57.281735] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T21:12:57.559525] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T21:12:57.590718] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-03T21:12:58.390695] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-03T21:12:59.190671] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-03T21:12:59.293692] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T21:12:59.343384] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T21:12:59.734121] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T21:12:59.990700] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-03T21:13:00.790738] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-03T21:13:01.141685] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T21:13:01.264089] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T21:13:01.264836] [INFO ] [REMOTE ] RGT: Full fetch complete (4132 records). [2025-10-03T21:13:01.264908] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-03T21:13:01.595772] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-03T21:13:01.665931] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-03T21:13:01.666011] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-03T21:13:01.666151] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-03T21:13:01.666192] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-03T21:13:01.666597] [DEBUG] [LOCAL ] RGT: Trimmed 4132 records to 2794 (keeping 200 days of data) [2025-10-03T21:13:01.684869] [DEBUG] [LOCAL ] RGT: Primary data saved (2794 records). [2025-10-03T21:13:01.684996] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-03T21:13:01.685102] [INFO ] [MAIN ] Update Progress: 1798/2370 symbols completed. RGT took 21.4s. Estimated remaining: 1h 20m 28s. Rate: 7.1 symbols/min [2025-10-03T21:13:02.390720] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-03T21:13:03.743342] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T21:13:03.749841] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-03T21:13:03.873251] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T21:13:03.990680] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-03T21:13:04.700144] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:13:04.702778] [INFO ] [REMOTE ] RGR: Full fetch complete (28846 records). [2025-10-03T21:13:04.702869] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-03T21:13:05.096269] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-03T21:13:05.096421] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-03T21:13:05.097063] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-03T21:13:05.097131] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-03T21:13:05.098001] [DEBUG] [LOCAL ] RGR: Trimmed 28846 records to 20929 (keeping 200 days of data) [2025-10-03T21:13:05.233960] [DEBUG] [LOCAL ] RGR: Primary data saved (20929 records). [2025-10-03T21:13:05.234259] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-03T21:13:05.234406] [INFO ] [MAIN ] Update Progress: 1799/2370 symbols completed. RGR took 35.3s. Estimated remaining: 1h 20m 18s. Rate: 7.1 symbols/min [2025-10-03T21:13:05.981795] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T21:13:05.992311] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-03T21:13:08.087777] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T21:13:08.098634] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-03T21:13:10.137279] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T21:13:10.148287] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-03T21:13:11.995716] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T21:13:12.006354] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-03T21:13:13.973247] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T21:13:13.988296] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-03T21:13:15.593446] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T21:13:15.599546] [INFO ] [REMOTE ] RH: Full fetch complete (65673 records). [2025-10-03T21:13:15.599756] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-03T21:13:16.035917] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-03T21:13:16.036013] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-03T21:13:16.037244] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-03T21:13:16.037326] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-03T21:13:16.038923] [DEBUG] [LOCAL ] RH: Trimmed 65673 records to 48202 (keeping 200 days of data) [2025-10-03T21:13:16.354517] [DEBUG] [LOCAL ] RH: Primary data saved (48202 records). [2025-10-03T21:13:16.354710] [INFO ] [MAIN ] RH: Full history saved. [2025-10-03T21:13:16.354846] [INFO ] [MAIN ] Update Progress: 1800/2370 symbols completed. RH took 33.8s. Estimated remaining: 1h 20m 11s. Rate: 7.1 symbols/min [2025-10-03T21:13:17.055514] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:17.092896] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:17.145924] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:17.148140] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-03T21:13:17.148583] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-03T21:13:17.168011] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:17.168462] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-03T21:13:17.169385] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-03T21:13:17.169528] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-03T21:13:17.169639] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-03T21:13:17.475028] [DEBUG] [LOCAL ] RHP: Loaded 41502 existing records from primary storage. [2025-10-03T21:13:17.516360] [INFO ] [MAIN ] RHP: Loaded 41502 existing records. [2025-10-03T21:13:17.510825] [DEBUG] [LOCAL ] RIG: Loaded 54060 existing records from primary storage. [2025-10-03T21:13:17.570032] [DEBUG] [LOCAL ] RHI: Loaded 49625 existing records from primary storage. [2025-10-03T21:13:17.581925] [INFO ] [MAIN ] RIG: Loaded 54060 existing records. [2025-10-03T21:13:17.642213] [INFO ] [MAIN ] RHI: Loaded 49625 existing records. [2025-10-03T21:13:18.116490] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:18.181147] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-03T21:13:18.181026] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:18.190208] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-03T21:13:18.190604] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-03T21:13:18.210670] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-03T21:13:18.233385] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-03T21:13:18.239495] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:18.359739] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-03T21:13:18.399106] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-03T21:13:18.375727] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:18.404560] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-03T21:13:18.430018] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-03T21:13:18.435356] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-03T21:13:18.533285] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-03T21:13:18.639292] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:13:18.644544] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-03T21:13:18.673374] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-03T21:13:18.706768] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-03T21:13:18.738988] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:13:18.862105] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-03T21:13:19.014515] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:13:19.061010] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-03T21:13:19.116606] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:19.122171] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-03T21:13:19.114254] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-03T21:13:19.153706] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-03T21:13:19.196189] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-03T21:13:19.306035] [INFO ] [MAIN ] Update Progress: 1801/2370 symbols completed. RHLD took 2.9s. Estimated remaining: 1h 20m 1s. Rate: 7.1 symbols/min [2025-10-03T21:13:19.574676] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:19.624308] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-03T21:13:19.700737] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:19.721472] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-03T21:13:19.751535] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:19.817455] [DEBUG] [LOCAL ] RIO: Loaded 53783 existing records from primary storage. [2025-10-03T21:13:19.817876] [INFO ] [MAIN ] RIO: Loaded 53783 existing records. [2025-10-03T21:13:20.005278] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:20.005517] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-03T21:13:20.005567] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-03T21:13:20.005834] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-03T21:13:20.005893] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-03T21:13:20.394803] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:20.395119] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-03T21:13:20.843552] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T21:13:20.853439] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-03T21:13:21.279380] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T21:13:21.288667] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-03T21:13:21.794412] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T21:13:21.806548] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-03T21:13:22.126252] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T21:13:22.136385] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-03T21:13:22.221761] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:13:22.233444] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-03T21:13:22.910699] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T21:13:22.920265] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-03T21:13:23.339856] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T21:13:23.347537] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-03T21:13:23.585993] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:13:23.597835] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-03T21:13:23.834542] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T21:13:23.846060] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-03T21:13:24.547051] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:13:24.557515] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-03T21:13:25.100598] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:13:25.111847] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-03T21:13:25.298301] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:13:25.309718] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-03T21:13:25.678621] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:13:25.690573] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-03T21:13:26.430948] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T21:13:26.441850] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-03T21:13:26.964140] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T21:13:26.974522] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-03T21:13:27.055860] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:13:27.067604] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-03T21:13:27.781031] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T21:13:27.793512] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-03T21:13:27.897328] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T21:13:27.908551] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-03T21:13:28.666228] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T21:13:28.677749] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-03T21:13:29.302477] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-03T21:13:29.322842] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-03T21:13:29.370247] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T21:13:29.393431] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-03T21:13:29.719303] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T21:13:29.731735] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-03T21:13:29.831627] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T21:13:30.390697] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-03T21:13:31.167060] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T21:13:31.190607] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-03T21:13:31.303806] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T21:13:31.624832] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T21:13:31.950145] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-03T21:13:31.990632] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-03T21:13:32.790624] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-03T21:13:33.148626] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T21:13:33.590695] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-03T21:13:33.889834] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T21:13:34.390716] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-03T21:13:34.572763] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T21:13:35.046107] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:13:35.190697] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-03T21:13:35.501866] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T21:13:35.990721] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-03T21:13:36.790637] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-03T21:13:36.993147] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:13:37.474859] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T21:13:37.590730] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-03T21:13:38.395146] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-03T21:13:38.398466] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T21:13:39.190687] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-03T21:13:39.577111] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T21:13:39.579327] [INFO ] [REMOTE ] RHP: Full fetch complete (58110 records). [2025-10-03T21:13:39.579429] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-03T21:13:39.999627] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-03T21:13:40.003012] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-03T21:13:40.003180] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-03T21:13:40.005358] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-03T21:13:40.005620] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-03T21:13:40.037793] [DEBUG] [LOCAL ] RHP: Trimmed 58110 records to 41824 (keeping 200 days of data) [2025-10-03T21:13:40.039696] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-03T21:13:40.324177] [DEBUG] [LOCAL ] RHP: Primary data saved (41824 records). [2025-10-03T21:13:40.324316] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-03T21:13:40.324481] [INFO ] [MAIN ] Update Progress: 1802/2370 symbols completed. RHP took 24.0s. Estimated remaining: 1h 19m 56s. Rate: 7.1 symbols/min [2025-10-03T21:13:40.517971] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:40.579757] [DEBUG] [LOCAL ] RITM: Loaded 53221 existing records from primary storage. [2025-10-03T21:13:40.586630] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T21:13:40.587046] [INFO ] [MAIN ] RITM: Loaded 53221 existing records. [2025-10-03T21:13:40.594970] [INFO ] [REMOTE ] RHI: Full fetch complete (70091 records). [2025-10-03T21:13:40.642210] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-03T21:13:40.799322] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-03T21:13:40.927925] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:40.933927] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-03T21:13:40.934029] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-03T21:13:40.959877] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-03T21:13:40.959978] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-03T21:13:41.543068] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-03T21:13:41.551384] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-03T21:13:41.555602] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-03T21:13:41.555756] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-03T21:13:41.607828] [DEBUG] [LOCAL ] RHI: Trimmed 70091 records to 49999 (keeping 200 days of data) [2025-10-03T21:13:41.694588] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:41.704490] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-03T21:13:41.964382] [DEBUG] [LOCAL ] RHI: Primary data saved (49999 records). [2025-10-03T21:13:41.964537] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-03T21:13:41.964661] [INFO ] [MAIN ] Update Progress: 1803/2370 symbols completed. RHI took 25.6s. Estimated remaining: 1h 19m 46s. Rate: 7.1 symbols/min [2025-10-03T21:13:42.156019] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:42.192826] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-03T21:13:42.214750] [DEBUG] [LOCAL ] RIV: Loaded 12377 existing records from primary storage. [2025-10-03T21:13:42.215037] [INFO ] [MAIN ] RIV: Loaded 12377 existing records. [2025-10-03T21:13:42.401774] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-03T21:13:42.408184] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:42.408454] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-03T21:13:42.408529] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-03T21:13:42.409685] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-03T21:13:42.409774] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-03T21:13:42.807069] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:43.050276] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-03T21:13:43.190693] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-03T21:13:43.861005] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T21:13:43.990689] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-03T21:13:44.337461] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T21:13:44.628263] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T21:13:44.790700] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-03T21:13:45.590691] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-03T21:13:45.862178] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T21:13:46.390689] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-03T21:13:46.929400] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T21:13:47.190718] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-03T21:13:47.367786] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T21:13:47.370613] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-10-03T21:13:47.370757] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-03T21:13:47.816087] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-03T21:13:47.816241] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-03T21:13:47.817541] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-03T21:13:47.817686] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-03T21:13:47.819626] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 54450 (keeping 200 days of data) [2025-10-03T21:13:47.939246] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T21:13:48.026154] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-03T21:13:48.188795] [DEBUG] [LOCAL ] RIG: Primary data saved (54450 records). [2025-10-03T21:13:48.188961] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-03T21:13:48.189068] [INFO ] [MAIN ] Update Progress: 1804/2370 symbols completed. RIG took 31.8s. Estimated remaining: 1h 19m 36s. Rate: 7.1 symbols/min [2025-10-03T21:13:48.418154] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:48.468127] [DEBUG] [LOCAL ] RJF: Loaded 47283 existing records from primary storage. [2025-10-03T21:13:48.468535] [INFO ] [MAIN ] RJF: Loaded 47283 existing records. [2025-10-03T21:13:48.665503] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:48.665772] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-03T21:13:48.665830] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-03T21:13:48.666091] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-10-03T21:13:48.666153] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-03T21:13:48.791337] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-03T21:13:49.062835] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T21:13:49.071470] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:49.072168] [INFO ] [REMOTE ] RIO: Full fetch complete (77360 records). [2025-10-03T21:13:49.072334] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-03T21:13:49.528034] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-03T21:13:49.528156] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-03T21:13:49.529516] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-03T21:13:49.529701] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-03T21:13:49.531504] [DEBUG] [LOCAL ] RIO: Trimmed 77360 records to 54173 (keeping 200 days of data) [2025-10-03T21:13:49.606794] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-03T21:13:49.804944] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T21:13:49.937127] [DEBUG] [LOCAL ] RIO: Primary data saved (54173 records). [2025-10-03T21:13:49.937457] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-03T21:13:49.937701] [INFO ] [MAIN ] Update Progress: 1805/2370 symbols completed. RIO took 30.6s. Estimated remaining: 1h 19m 26s. Rate: 7.1 symbols/min [2025-10-03T21:13:50.090424] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T21:13:50.177382] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:13:50.231462] [DEBUG] [LOCAL ] RKT: Loaded 54111 existing records from primary storage. [2025-10-03T21:13:50.231845] [INFO ] [MAIN ] RKT: Loaded 54111 existing records. [2025-10-03T21:13:50.391816] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-03T21:13:50.422399] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:13:50.423749] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-03T21:13:50.423828] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-03T21:13:50.424089] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-03T21:13:50.424211] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-03T21:13:50.800021] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:13:51.190696] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-03T21:13:51.332934] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T21:13:51.990704] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-03T21:13:52.038214] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T21:13:52.592820] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-03T21:13:52.790690] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-03T21:13:53.590733] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-03T21:13:53.822371] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T21:13:54.390715] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-03T21:13:54.901883] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T21:13:55.190740] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-03T21:13:55.643322] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T21:13:55.990688] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-03T21:13:56.153695] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T21:13:56.790714] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-03T21:13:57.163791] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T21:13:57.590666] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-03T21:13:57.682558] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T21:13:57.951944] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T21:13:58.390693] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-03T21:13:59.190751] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-03T21:13:59.438927] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T21:13:59.990749] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-03T21:14:00.507932] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T21:14:00.790691] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-03T21:14:01.099435] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T21:14:01.590739] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-03T21:14:02.077304] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T21:14:02.390728] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-03T21:14:02.599874] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:14:03.190709] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-03T21:14:03.793116] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-03T21:14:03.990673] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-03T21:14:04.180881] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:14:04.790622] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-03T21:14:05.328800] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T21:14:05.392989] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T21:14:05.590728] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-03T21:14:06.286163] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-03T21:14:06.390700] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-03T21:14:06.403431] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T21:14:07.190691] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-03T21:14:07.990612] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-03T21:14:08.553997] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T21:14:08.790639] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-03T21:14:08.860297] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T21:14:09.590687] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-03T21:14:09.625003] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T21:14:09.633787] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T21:14:09.636428] [INFO ] [REMOTE ] RITM: Full fetch complete (76592 records). [2025-10-03T21:14:09.636577] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-03T21:14:10.082672] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-03T21:14:10.082782] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-03T21:14:10.084098] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-03T21:14:10.084184] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-03T21:14:10.085955] [DEBUG] [LOCAL ] RITM: Trimmed 76592 records to 53610 (keeping 200 days of data) [2025-10-03T21:14:10.393205] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-03T21:14:10.442473] [DEBUG] [LOCAL ] RITM: Primary data saved (53610 records). [2025-10-03T21:14:10.442635] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-03T21:14:10.442796] [INFO ] [MAIN ] Update Progress: 1806/2370 symbols completed. RITM took 30.1s. Estimated remaining: 1h 19m 21s. Rate: 7.1 symbols/min [2025-10-03T21:14:10.627909] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:10.669526] [DEBUG] [LOCAL ] RL: Loaded 41302 existing records from primary storage. [2025-10-03T21:14:10.669910] [INFO ] [MAIN ] RL: Loaded 41302 existing records. [2025-10-03T21:14:10.865513] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:10.866427] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-03T21:14:10.866556] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-03T21:14:10.866904] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-10-03T21:14:10.866967] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-03T21:14:11.198388] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-03T21:14:11.293169] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:11.359830] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T21:14:11.870246] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T21:14:11.990633] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-03T21:14:12.500126] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-03T21:14:12.790699] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-03T21:14:12.844663] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T21:14:13.590700] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-03T21:14:14.390733] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-03T21:14:14.552711] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T21:14:15.190634] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-03T21:14:15.361505] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T21:14:15.990682] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-03T21:14:16.743235] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-03T21:14:16.790680] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-03T21:14:17.091806] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T21:14:17.590679] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-03T21:14:17.721309] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T21:14:17.986047] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T21:14:18.390720] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-03T21:14:19.101242] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T21:14:19.103810] [INFO ] [REMOTE ] RJF: Full fetch complete (68379 records). [2025-10-03T21:14:19.103985] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-03T21:14:19.195866] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-03T21:14:19.545989] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-03T21:14:19.546083] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-03T21:14:19.547197] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-03T21:14:19.547269] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-03T21:14:19.548776] [DEBUG] [LOCAL ] RJF: Trimmed 68379 records to 47609 (keeping 200 days of data) [2025-10-03T21:14:19.868479] [DEBUG] [LOCAL ] RJF: Primary data saved (47609 records). [2025-10-03T21:14:19.869097] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-03T21:14:19.869362] [INFO ] [MAIN ] Update Progress: 1807/2370 symbols completed. RJF took 31.7s. Estimated remaining: 1h 19m 13s. Rate: 7.1 symbols/min [2025-10-03T21:14:19.995745] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-03T21:14:20.059604] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:20.094120] [DEBUG] [LOCAL ] RLI: Loaded 33827 existing records from primary storage. [2025-10-03T21:14:20.094399] [INFO ] [MAIN ] RLI: Loaded 33827 existing records. [2025-10-03T21:14:20.279810] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:20.280019] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-03T21:14:20.280068] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-03T21:14:20.280331] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-03T21:14:20.280391] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-03T21:14:20.668719] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:20.753113] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T21:14:20.774051] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T21:14:20.775506] [INFO ] [REMOTE ] RIV: Full fetch complete (17748 records). [2025-10-03T21:14:20.775741] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-03T21:14:20.799366] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-03T21:14:21.219964] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-03T21:14:21.228174] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-03T21:14:21.244132] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-03T21:14:21.244372] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-03T21:14:21.246849] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T21:14:21.255984] [DEBUG] [LOCAL ] RIV: Trimmed 17748 records to 12542 (keeping 200 days of data) [2025-10-03T21:14:21.341065] [DEBUG] [LOCAL ] RIV: Primary data saved (12542 records). [2025-10-03T21:14:21.341214] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-03T21:14:21.341303] [INFO ] [MAIN ] Update Progress: 1808/2370 symbols completed. RIV took 39.4s. Estimated remaining: 1h 19m 2s. Rate: 7.1 symbols/min [2025-10-03T21:14:21.533750] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:21.583929] [DEBUG] [LOCAL ] RLJ: Loaded 48448 existing records from primary storage. [2025-10-03T21:14:21.584341] [INFO ] [MAIN ] RLJ: Loaded 48448 existing records. [2025-10-03T21:14:21.591050] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-03T21:14:21.799607] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:21.799924] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-03T21:14:21.799976] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-03T21:14:21.800292] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-03T21:14:21.800352] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-03T21:14:22.224248] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:22.390711] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-03T21:14:23.159366] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-03T21:14:23.190624] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-03T21:14:23.256177] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T21:14:23.990729] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-03T21:14:24.216702] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:14:24.790707] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-03T21:14:24.856775] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T21:14:25.228499] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-03T21:14:25.231199] [INFO ] [REMOTE ] RKT: Full fetch complete (77408 records). [2025-10-03T21:14:25.231314] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-03T21:14:25.595793] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-03T21:14:25.709128] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-03T21:14:25.709213] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-03T21:14:25.710403] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-03T21:14:25.710470] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-03T21:14:25.712069] [DEBUG] [LOCAL ] RKT: Trimmed 77408 records to 54501 (keeping 200 days of data) [2025-10-03T21:14:26.069511] [DEBUG] [LOCAL ] RKT: Primary data saved (54501 records). [2025-10-03T21:14:26.069677] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-03T21:14:26.069868] [INFO ] [MAIN ] Update Progress: 1809/2370 symbols completed. RKT took 36.1s. Estimated remaining: 1h 18m 53s. Rate: 7.1 symbols/min [2025-10-03T21:14:26.260358] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:26.273568] [DEBUG] [LOCAL ] RLTY: Loaded 11252 existing records from primary storage. [2025-10-03T21:14:26.273848] [INFO ] [MAIN ] RLTY: Loaded 11252 existing records. [2025-10-03T21:14:26.393923] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-03T21:14:26.475043] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:26.475461] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-03T21:14:26.475534] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-03T21:14:26.475893] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-03T21:14:26.476100] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-03T21:14:26.837168] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T21:14:26.935013] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:27.190626] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-03T21:14:27.297705] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T21:14:27.990634] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-03T21:14:28.093673] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T21:14:28.111808] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T21:14:28.790718] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-03T21:14:29.578866] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T21:14:29.590622] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-03T21:14:30.061736] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T21:14:30.173202] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T21:14:30.390707] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-03T21:14:31.190711] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-03T21:14:31.763887] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T21:14:31.990727] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-03T21:14:32.794393] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-03T21:14:32.800437] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:14:32.851938] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T21:14:33.590732] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-03T21:14:34.371798] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T21:14:34.390613] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-03T21:14:35.190632] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-03T21:14:35.345216] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T21:14:35.463137] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T21:14:35.990695] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-03T21:14:36.790633] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-03T21:14:36.988816] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:14:37.568289] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T21:14:37.590770] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-03T21:14:37.606898] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T21:14:38.390741] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-03T21:14:39.189746] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:14:39.191786] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-03T21:14:39.210495] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T21:14:39.990696] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-03T21:14:40.555004] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:14:40.790674] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-03T21:14:41.454118] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:14:41.590743] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-03T21:14:42.348138] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T21:14:42.390639] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-03T21:14:42.440237] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T21:14:43.190681] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-03T21:14:43.594282] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T21:14:43.990671] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-03T21:14:44.089496] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T21:14:44.790713] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-03T21:14:45.474957] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T21:14:45.590701] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-03T21:14:45.688262] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T21:14:46.390726] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-03T21:14:46.857743] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T21:14:46.859969] [INFO ] [REMOTE ] RL: Full fetch complete (59902 records). [2025-10-03T21:14:46.860069] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-03T21:14:47.195774] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-03T21:14:47.273031] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-03T21:14:47.273128] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-03T21:14:47.274283] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-03T21:14:47.274363] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-03T21:14:47.275788] [DEBUG] [LOCAL ] RL: Trimmed 59902 records to 41526 (keeping 200 days of data) [2025-10-03T21:14:47.377022] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T21:14:47.559675] [DEBUG] [LOCAL ] RL: Primary data saved (41526 records). [2025-10-03T21:14:47.559844] [INFO ] [MAIN ] RL: Full history saved. [2025-10-03T21:14:47.559954] [INFO ] [MAIN ] Update Progress: 1810/2370 symbols completed. RL took 37.1s. Estimated remaining: 1h 18m 48s. Rate: 7.1 symbols/min [2025-10-03T21:14:47.742709] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:47.787777] [DEBUG] [LOCAL ] RLX: Loaded 48653 existing records from primary storage. [2025-10-03T21:14:47.788132] [INFO ] [MAIN ] RLX: Loaded 48653 existing records. [2025-10-03T21:14:47.985483] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:47.985793] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-03T21:14:47.985848] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-03T21:14:47.986126] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-03T21:14:47.986190] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-03T21:14:47.998050] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-03T21:14:48.387764] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:48.790707] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-03T21:14:48.861832] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T21:14:49.590715] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-03T21:14:49.647915] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T21:14:49.871856] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T21:14:50.390691] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-03T21:14:50.786059] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:14:50.788254] [INFO ] [REMOTE ] RLI: Full fetch complete (47303 records). [2025-10-03T21:14:50.788345] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-03T21:14:51.198349] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-03T21:14:51.201521] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-03T21:14:51.202306] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-03T21:14:51.203267] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-03T21:14:51.203466] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-03T21:14:51.204757] [DEBUG] [LOCAL ] RLI: Trimmed 47303 records to 34136 (keeping 200 days of data) [2025-10-03T21:14:51.439438] [DEBUG] [LOCAL ] RLI: Primary data saved (34136 records). [2025-10-03T21:14:51.439586] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-03T21:14:51.439717] [INFO ] [MAIN ] Update Progress: 1811/2370 symbols completed. RLI took 31.6s. Estimated remaining: 1h 18m 39s. Rate: 7.1 symbols/min [2025-10-03T21:14:51.625988] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:51.635713] [DEBUG] [LOCAL ] RM: Loaded 7680 existing records from primary storage. [2025-10-03T21:14:51.635917] [INFO ] [MAIN ] RM: Loaded 7680 existing records. [2025-10-03T21:14:51.831236] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:51.831456] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-03T21:14:51.831506] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-03T21:14:51.831773] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-03T21:14:51.831834] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-03T21:14:51.993091] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-03T21:14:52.224600] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:52.257052] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T21:14:52.584978] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T21:14:52.586194] [INFO ] [REMOTE ] RLTY: Full fetch complete (17870 records). [2025-10-03T21:14:52.586292] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-03T21:14:52.795757] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-03T21:14:52.991996] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-03T21:14:52.992106] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-03T21:14:52.992558] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-03T21:14:52.992691] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-03T21:14:52.993802] [DEBUG] [LOCAL ] RLTY: Trimmed 17870 records to 11318 (keeping 200 days of data) [2025-10-03T21:14:53.074505] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T21:14:53.104431] [DEBUG] [LOCAL ] RLTY: Primary data saved (11318 records). [2025-10-03T21:14:53.104590] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-03T21:14:53.104727] [INFO ] [MAIN ] Update Progress: 1812/2370 symbols completed. RLTY took 27.0s. Estimated remaining: 1h 18m 28s. Rate: 7.1 symbols/min [2025-10-03T21:14:53.291989] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:14:53.312935] [DEBUG] [LOCAL ] RMAX: Loaded 21594 existing records from primary storage. [2025-10-03T21:14:53.313209] [INFO ] [MAIN ] RMAX: Loaded 21594 existing records. [2025-10-03T21:14:53.555192] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:14:53.555666] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-03T21:14:53.555732] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-03T21:14:53.556469] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-03T21:14:53.556552] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-03T21:14:53.592625] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-03T21:14:53.755759] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T21:14:53.979872] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:14:54.390702] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-03T21:14:55.190727] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-03T21:14:55.246312] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T21:14:55.462948] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T21:14:55.990714] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-03T21:14:56.419852] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T21:14:56.539196] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T21:14:56.790716] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-03T21:14:57.590682] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-03T21:14:58.390691] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-03T21:14:58.530127] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T21:14:59.190698] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-03T21:14:59.408019] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T21:14:59.468077] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T21:14:59.990687] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-03T21:15:00.085473] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T21:15:00.790694] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-03T21:15:01.590733] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-03T21:15:01.681748] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:15:01.735996] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T21:15:02.390727] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-03T21:15:03.190678] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-03T21:15:03.409526] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T21:15:03.448466] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T21:15:03.990686] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-03T21:15:04.409405] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T21:15:04.662855] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T21:15:04.790732] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-03T21:15:05.590717] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-03T21:15:06.390633] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-03T21:15:06.681551] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T21:15:07.005586] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T21:15:07.008322] [INFO ] [REMOTE ] RLJ: Full fetch complete (69283 records). [2025-10-03T21:15:07.008520] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-03T21:15:07.199280] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-03T21:15:07.448992] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-03T21:15:07.449216] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-03T21:15:07.450580] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-03T21:15:07.450774] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-03T21:15:07.452800] [DEBUG] [LOCAL ] RLJ: Trimmed 69283 records to 48812 (keeping 200 days of data) [2025-10-03T21:15:07.565254] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T21:15:07.791740] [DEBUG] [LOCAL ] RLJ: Primary data saved (48812 records). [2025-10-03T21:15:07.792195] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-03T21:15:07.792355] [INFO ] [MAIN ] Update Progress: 1813/2370 symbols completed. RLJ took 46.5s. Estimated remaining: 1h 18m 22s. Rate: 7.1 symbols/min [2025-10-03T21:15:07.975474] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:07.990698] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-03T21:15:08.025486] [DEBUG] [LOCAL ] RMD: Loaded 42317 existing records from primary storage. [2025-10-03T21:15:08.025830] [INFO ] [MAIN ] RMD: Loaded 42317 existing records. [2025-10-03T21:15:08.216845] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:08.217167] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-03T21:15:08.217228] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-03T21:15:08.217864] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-10-03T21:15:08.217925] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-03T21:15:08.654133] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:08.790690] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-03T21:15:09.089781] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T21:15:09.114228] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T21:15:09.590712] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-03T21:15:10.332880] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:15:10.390625] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-03T21:15:10.942126] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T21:15:11.190695] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-03T21:15:11.990633] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-03T21:15:12.412154] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T21:15:12.502219] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T21:15:12.772200] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T21:15:12.790667] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-03T21:15:13.590686] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-03T21:15:14.390692] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-03T21:15:14.494567] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:15:14.909634] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T21:15:15.190679] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-03T21:15:15.235301] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T21:15:15.990698] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-03T21:15:16.790730] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-03T21:15:16.855780] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T21:15:17.112342] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T21:15:17.590687] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-03T21:15:18.390710] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-03T21:15:18.495310] [DEBUG] [REMOTE ] RMAX: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T21:15:18.495737] [WARN ] [REMOTE ] RMAX: No data returned for month 2025-09 [2025-10-03T21:15:18.495853] [FATAL] [REMOTE ] RMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:15:18.495978] [FATAL] [MAIN ] RMAX: Failed to fetch primary data. [2025-10-03T21:15:18.496068] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:15:18.496171] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-03T21:15:18.496256] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-03T21:15:18.496303] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-03T21:15:18.496868] [DEBUG] [LOCAL ] RMAX: Deleted derivative data file. [2025-10-03T21:15:18.497032] [INFO ] [MAIN ] Update Progress: 1814/2370 symbols completed. RMAX took 25.4s. Estimated remaining: 1h 18m 14s. Rate: 7.1 symbols/min [2025-10-03T21:15:18.737388] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T21:15:18.741352] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:18.752793] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T21:15:18.765851] [DEBUG] [LOCAL ] RMI: Loaded 4733 existing records from primary storage. [2025-10-03T21:15:18.766126] [INFO ] [MAIN ] RMI: Loaded 4733 existing records. [2025-10-03T21:15:18.958555] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:18.958797] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-03T21:15:18.958851] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-03T21:15:18.959076] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-03T21:15:18.959143] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-03T21:15:19.195776] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-03T21:15:19.363826] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:19.990627] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-03T21:15:20.555935] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T21:15:20.556871] [INFO ] [REMOTE ] RM: Full fetch complete (11599 records). [2025-10-03T21:15:20.556944] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-03T21:15:20.793812] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-03T21:15:20.956379] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-03T21:15:20.956525] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-03T21:15:20.957002] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-03T21:15:20.957098] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-03T21:15:20.957691] [DEBUG] [LOCAL ] RM: Trimmed 11599 records to 7730 (keeping 200 days of data) [2025-10-03T21:15:21.009418] [DEBUG] [LOCAL ] RM: Primary data saved (7730 records). [2025-10-03T21:15:21.009694] [INFO ] [MAIN ] RM: Full history saved. [2025-10-03T21:15:21.009894] [INFO ] [MAIN ] Update Progress: 1815/2370 symbols completed. RM took 29.6s. Estimated remaining: 1h 18m 4s. Rate: 7.1 symbols/min [2025-10-03T21:15:21.198825] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:21.234289] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T21:15:21.249383] [DEBUG] [LOCAL ] RMM: Loaded 10625 existing records from primary storage. [2025-10-03T21:15:21.249897] [INFO ] [MAIN ] RMM: Loaded 10625 existing records. [2025-10-03T21:15:21.431854] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:21.432098] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-03T21:15:21.432172] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-03T21:15:21.432441] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-03T21:15:21.432504] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-03T21:15:21.600379] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-03T21:15:21.839080] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:22.390735] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-03T21:15:22.407126] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T21:15:22.451609] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:15:23.190707] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-03T21:15:23.722441] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-03T21:15:23.990703] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-03T21:15:24.197906] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T21:15:24.790686] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-03T21:15:25.019950] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T21:15:25.590731] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-03T21:15:26.254096] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T21:15:26.390664] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-03T21:15:27.141332] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T21:15:27.192331] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-03T21:15:27.198808] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T21:15:27.990739] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-03T21:15:28.522993] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T21:15:28.790681] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-03T21:15:29.159443] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T21:15:29.590730] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-03T21:15:30.390677] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-03T21:15:30.431059] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T21:15:30.624536] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T21:15:31.036974] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-03T21:15:31.190747] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-03T21:15:31.898434] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T21:15:31.990729] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-03T21:15:32.718786] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T21:15:32.790706] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-03T21:15:33.590736] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-03T21:15:34.390702] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-03T21:15:34.484377] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T21:15:34.531801] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T21:15:35.001594] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T21:15:35.190720] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-03T21:15:35.990730] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-03T21:15:36.646361] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T21:15:36.790635] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-03T21:15:36.960472] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T21:15:37.400885] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T21:15:37.590750] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-03T21:15:38.390708] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-03T21:15:38.457901] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:15:39.190732] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-03T21:15:39.812522] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T21:15:39.815902] [INFO ] [REMOTE ] RLX: Full fetch complete (70186 records). [2025-10-03T21:15:39.816050] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-03T21:15:40.016721] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-03T21:15:40.095582] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T21:15:40.259817] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-03T21:15:40.259907] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-03T21:15:40.260979] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-03T21:15:40.261047] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-03T21:15:40.262485] [DEBUG] [LOCAL ] RLX: Trimmed 70186 records to 48956 (keeping 200 days of data) [2025-10-03T21:15:40.575477] [DEBUG] [LOCAL ] RLX: Primary data saved (48956 records). [2025-10-03T21:15:40.575630] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-03T21:15:40.575777] [INFO ] [MAIN ] Update Progress: 1816/2370 symbols completed. RLX took 53.0s. Estimated remaining: 1h 17m 59s. Rate: 7.1 symbols/min [2025-10-03T21:15:40.759947] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:40.767816] [DEBUG] [LOCAL ] RMMZ: Loaded 4867 existing records from primary storage. [2025-10-03T21:15:40.768034] [INFO ] [MAIN ] RMMZ: Loaded 4867 existing records. [2025-10-03T21:15:40.801334] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-03T21:15:40.966417] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T21:15:40.983453] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:40.984122] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-03T21:15:40.984176] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-03T21:15:40.984377] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-03T21:15:40.984464] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-03T21:15:41.372919] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:41.590634] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-03T21:15:41.654272] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T21:15:42.279252] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T21:15:42.390698] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-03T21:15:43.186950] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T21:15:43.190602] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-03T21:15:43.889369] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T21:15:43.990717] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-03T21:15:44.790739] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-03T21:15:45.079211] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T21:15:45.088960] [INFO ] [REMOTE ] RMD: Full fetch complete (61194 records). [2025-10-03T21:15:45.089159] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-03T21:15:45.281847] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T21:15:45.318558] [INFO ] [REMOTE ] RMI: Full fetch complete (6290 records). [2025-10-03T21:15:45.363774] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-03T21:15:45.593508] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-03T21:15:45.755900] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-03T21:15:45.801725] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-03T21:15:45.827730] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-03T21:15:45.841723] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-03T21:15:45.891389] [DEBUG] [LOCAL ] RMD: Trimmed 61194 records to 42565 (keeping 200 days of data) [2025-10-03T21:15:46.031807] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-03T21:15:46.058073] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-03T21:15:46.059614] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-03T21:15:46.060295] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-03T21:15:46.061798] [DEBUG] [LOCAL ] RMI: Trimmed 6290 records to 4750 (keeping 200 days of data) [2025-10-03T21:15:46.105985] [DEBUG] [LOCAL ] RMI: Primary data saved (4750 records). [2025-10-03T21:15:46.107207] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-03T21:15:46.107360] [INFO ] [MAIN ] Update Progress: 1817/2370 symbols completed. RMI took 27.6s. Estimated remaining: 1h 17m 49s. Rate: 7.1 symbols/min [2025-10-03T21:15:46.332819] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:46.407980] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-03T21:15:46.452095] [DEBUG] [LOCAL ] RMT: Loaded 17436 existing records from primary storage. [2025-10-03T21:15:46.453202] [INFO ] [MAIN ] RMT: Loaded 17436 existing records. [2025-10-03T21:15:46.660105] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:46.664956] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-03T21:15:46.669860] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-03T21:15:46.683932] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-03T21:15:46.684679] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-03T21:15:46.686821] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T21:15:47.048189] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T21:15:47.067078] [DEBUG] [LOCAL ] RMD: Primary data saved (42565 records). [2025-10-03T21:15:47.077492] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-03T21:15:47.098106] [INFO ] [MAIN ] Update Progress: 1818/2370 symbols completed. RMD took 39.3s. Estimated remaining: 1h 17m 38s. Rate: 7.1 symbols/min [2025-10-03T21:15:47.194685] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-03T21:15:47.261785] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:47.339626] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:47.388977] [DEBUG] [LOCAL ] RNG: Loaded 48381 existing records from primary storage. [2025-10-03T21:15:47.389360] [INFO ] [MAIN ] RNG: Loaded 48381 existing records. [2025-10-03T21:15:47.579547] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:47.579805] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-03T21:15:47.579857] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-03T21:15:47.580143] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-03T21:15:47.580203] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-03T21:15:47.980088] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:47.990671] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-03T21:15:48.211095] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T21:15:48.740858] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T21:15:48.790722] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-03T21:15:49.427969] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T21:15:49.590716] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-03T21:15:50.367245] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T21:15:50.390702] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-03T21:15:51.190673] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-03T21:15:51.341044] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T21:15:51.830035] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T21:15:51.990738] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-03T21:15:52.717358] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T21:15:52.718509] [INFO ] [REMOTE ] RMM: Full fetch complete (15108 records). [2025-10-03T21:15:52.718599] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-03T21:15:52.795753] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-03T21:15:53.129998] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-03T21:15:53.130088] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-03T21:15:53.130529] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-03T21:15:53.130605] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-03T21:15:53.131235] [DEBUG] [LOCAL ] RMM: Trimmed 15108 records to 10691 (keeping 200 days of data) [2025-10-03T21:15:53.202490] [DEBUG] [LOCAL ] RMM: Primary data saved (10691 records). [2025-10-03T21:15:53.202639] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-03T21:15:53.202791] [INFO ] [MAIN ] Update Progress: 1819/2370 symbols completed. RMM took 32.2s. Estimated remaining: 1h 17m 29s. Rate: 7.1 symbols/min [2025-10-03T21:15:53.395732] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:15:53.416927] [DEBUG] [LOCAL ] RNGR: Loaded 20543 existing records from primary storage. [2025-10-03T21:15:53.417222] [INFO ] [MAIN ] RNGR: Loaded 20543 existing records. [2025-10-03T21:15:53.600758] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-03T21:15:53.606472] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:15:53.607483] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-03T21:15:53.607557] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-03T21:15:53.607900] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-03T21:15:53.607985] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-03T21:15:53.993992] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:15:54.390724] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-03T21:15:54.454332] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T21:15:54.492090] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:15:55.072342] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T21:15:55.190709] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-03T21:15:55.990696] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-03T21:15:56.290964] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T21:15:56.790733] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-03T21:15:57.590702] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-03T21:15:57.788294] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T21:15:57.880367] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T21:15:58.326245] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T21:15:58.390728] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-03T21:15:59.168032] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T21:15:59.190704] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-03T21:15:59.990632] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-03T21:16:00.076783] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T21:16:00.790805] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-03T21:16:00.904166] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T21:16:01.590697] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-03T21:16:01.904910] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T21:16:02.390714] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-03T21:16:02.850548] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T21:16:03.061927] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T21:16:03.190700] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-03T21:16:03.990708] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-03T21:16:04.790696] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-03T21:16:04.903954] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T21:16:05.057340] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T21:16:05.282839] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T21:16:05.283709] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7089 records). [2025-10-03T21:16:05.283820] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-03T21:16:05.595868] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-03T21:16:05.710506] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-03T21:16:05.710668] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-03T21:16:05.710929] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-03T21:16:05.711002] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-03T21:16:05.711720] [DEBUG] [LOCAL ] RMMZ: Trimmed 7089 records to 4894 (keeping 200 days of data) [2025-10-03T21:16:05.744482] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4894 records). [2025-10-03T21:16:05.744615] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-03T21:16:05.744753] [INFO ] [MAIN ] Update Progress: 1820/2370 symbols completed. RMMZ took 25.2s. Estimated remaining: 1h 17m 22s. Rate: 7.1 symbols/min [2025-10-03T21:16:05.984725] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:06.001753] [DEBUG] [LOCAL ] RNP: Loaded 15980 existing records from primary storage. [2025-10-03T21:16:06.002024] [INFO ] [MAIN ] RNP: Loaded 15980 existing records. [2025-10-03T21:16:06.198189] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:06.198463] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-03T21:16:06.198522] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-03T21:16:06.198743] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-03T21:16:06.198805] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-03T21:16:06.401072] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-03T21:16:06.608994] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:06.710336] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:16:07.190767] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-03T21:16:07.651873] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T21:16:07.990708] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-03T21:16:08.790713] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-03T21:16:08.848694] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T21:16:09.163076] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T21:16:09.590682] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-03T21:16:10.102720] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T21:16:10.390689] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-03T21:16:11.190725] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-03T21:16:11.334067] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T21:16:11.377791] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T21:16:11.949957] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T21:16:11.990711] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-03T21:16:12.790687] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-03T21:16:13.416433] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T21:16:13.590711] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-03T21:16:14.143192] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T21:16:14.390684] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-03T21:16:14.607003] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T21:16:15.190732] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-03T21:16:15.561073] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T21:16:15.990732] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-03T21:16:16.320205] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:16:16.790691] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-03T21:16:17.590637] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-03T21:16:17.704315] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T21:16:17.837151] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T21:16:18.381711] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T21:16:18.390615] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-03T21:16:19.190625] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-03T21:16:19.489442] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T21:16:19.990635] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-03T21:16:20.292957] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T21:16:20.790711] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-03T21:16:21.078255] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T21:16:21.590686] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-03T21:16:21.706800] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:16:21.708238] [INFO ] [REMOTE ] RNGR: Full fetch complete (28222 records). [2025-10-03T21:16:21.708317] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-03T21:16:22.142233] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-03T21:16:22.142330] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-03T21:16:22.143001] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-03T21:16:22.143069] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-03T21:16:22.144062] [DEBUG] [LOCAL ] RNGR: Trimmed 28222 records to 20656 (keeping 200 days of data) [2025-10-03T21:16:22.310668] [DEBUG] [LOCAL ] RNGR: Primary data saved (20656 records). [2025-10-03T21:16:22.310815] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-03T21:16:22.310901] [INFO ] [MAIN ] Update Progress: 1821/2370 symbols completed. RNGR took 29.1s. Estimated remaining: 1h 17m 16s. Rate: 7.1 symbols/min [2025-10-03T21:16:22.395794] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-03T21:16:22.514859] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:22.549482] [DEBUG] [LOCAL ] RNR: Loaded 34119 existing records from primary storage. [2025-10-03T21:16:22.549844] [INFO ] [MAIN ] RNR: Loaded 34119 existing records. [2025-10-03T21:16:22.749069] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:22.749303] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-03T21:16:22.749354] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-03T21:16:22.749633] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-03T21:16:22.749728] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-03T21:16:23.150876] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:23.190627] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-03T21:16:23.411138] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T21:16:23.500773] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T21:16:23.990732] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-03T21:16:24.732724] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:16:24.751064] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T21:16:24.790704] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-03T21:16:25.590727] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-03T21:16:26.396033] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-03T21:16:26.401925] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T21:16:26.571738] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T21:16:27.190682] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-03T21:16:27.990632] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-03T21:16:28.067751] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T21:16:28.069435] [INFO ] [REMOTE ] RMT: Full fetch complete (25464 records). [2025-10-03T21:16:28.069577] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-03T21:16:28.528250] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-03T21:16:28.528476] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-03T21:16:28.529091] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-03T21:16:28.529173] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-03T21:16:28.535502] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T21:16:28.534073] [DEBUG] [LOCAL ] RMT: Trimmed 25464 records to 17594 (keeping 200 days of data) [2025-10-03T21:16:28.660920] [DEBUG] [LOCAL ] RMT: Primary data saved (17594 records). [2025-10-03T21:16:28.661086] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-03T21:16:28.661201] [INFO ] [MAIN ] Update Progress: 1822/2370 symbols completed. RMT took 42.6s. Estimated remaining: 1h 17m 7s. Rate: 7.1 symbols/min [2025-10-03T21:16:28.795845] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-03T21:16:28.860134] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:28.905016] [DEBUG] [LOCAL ] RNST: Loaded 37313 existing records from primary storage. [2025-10-03T21:16:28.905320] [INFO ] [MAIN ] RNST: Loaded 37313 existing records. [2025-10-03T21:16:29.093349] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:29.093614] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-03T21:16:29.093697] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-03T21:16:29.093969] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-03T21:16:29.094039] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-03T21:16:29.524188] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:29.547212] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T21:16:29.590670] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-03T21:16:30.390716] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-03T21:16:30.671251] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T21:16:31.100859] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T21:16:31.190700] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-03T21:16:31.858340] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T21:16:31.990699] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-03T21:16:32.736694] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T21:16:32.790755] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-03T21:16:33.509431] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T21:16:33.590713] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-03T21:16:34.087039] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T21:16:34.390717] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-03T21:16:34.702812] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T21:16:35.190723] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-03T21:16:35.870820] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T21:16:35.873420] [INFO ] [REMOTE ] RNG: Full fetch complete (69408 records). [2025-10-03T21:16:35.873521] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-03T21:16:35.995810] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-03T21:16:36.316680] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-03T21:16:36.316791] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-03T21:16:36.318011] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-03T21:16:36.318099] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-03T21:16:36.331243] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T21:16:36.336325] [DEBUG] [LOCAL ] RNG: Trimmed 69408 records to 48745 (keeping 200 days of data) [2025-10-03T21:16:36.627765] [DEBUG] [LOCAL ] RNG: Primary data saved (48745 records). [2025-10-03T21:16:36.627908] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-03T21:16:36.627991] [INFO ] [MAIN ] Update Progress: 1823/2370 symbols completed. RNG took 49.5s. Estimated remaining: 1h 16m 58s. Rate: 7.1 symbols/min [2025-10-03T21:16:36.795794] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-03T21:16:36.825866] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:36.850940] [DEBUG] [LOCAL ] ROG: Loaded 22995 existing records from primary storage. [2025-10-03T21:16:36.851223] [INFO ] [MAIN ] ROG: Loaded 22995 existing records. [2025-10-03T21:16:37.074629] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:37.075294] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-03T21:16:37.075372] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-03T21:16:37.076007] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-03T21:16:37.076079] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-03T21:16:37.478081] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T21:16:37.504327] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:37.590686] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-03T21:16:38.385509] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T21:16:38.394778] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-03T21:16:38.724908] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T21:16:39.190703] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-03T21:16:39.990676] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-03T21:16:40.060479] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T21:16:40.196690] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:16:40.790737] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-03T21:16:41.487358] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T21:16:41.590699] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-03T21:16:41.912594] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T21:16:42.390735] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-03T21:16:42.642106] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T21:16:43.190698] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-03T21:16:43.531000] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T21:16:43.990727] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-03T21:16:44.010774] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T21:16:44.012367] [INFO ] [REMOTE ] RNP: Full fetch complete (23641 records). [2025-10-03T21:16:44.012448] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-03T21:16:44.411087] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-03T21:16:44.411170] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-03T21:16:44.411720] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-03T21:16:44.411792] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-03T21:16:44.412717] [DEBUG] [LOCAL ] RNP: Trimmed 23641 records to 16151 (keeping 200 days of data) [2025-10-03T21:16:44.514448] [DEBUG] [LOCAL ] RNP: Primary data saved (16151 records). [2025-10-03T21:16:44.514602] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-03T21:16:44.514765] [INFO ] [MAIN ] Update Progress: 1824/2370 symbols completed. RNP took 38.8s. Estimated remaining: 1h 16m 50s. Rate: 7.1 symbols/min [2025-10-03T21:16:44.695811] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:44.743244] [DEBUG] [LOCAL ] ROK: Loaded 44054 existing records from primary storage. [2025-10-03T21:16:44.743565] [INFO ] [MAIN ] ROK: Loaded 44054 existing records. [2025-10-03T21:16:44.800464] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-03T21:16:44.933849] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:44.934055] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-03T21:16:44.934103] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-03T21:16:44.934373] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-10-03T21:16:44.934432] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-03T21:16:45.329923] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:45.549256] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T21:16:45.590724] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-03T21:16:46.167724] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T21:16:46.390718] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-03T21:16:47.057503] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T21:16:47.190683] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-03T21:16:47.822588] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T21:16:47.990715] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-03T21:16:48.790685] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-03T21:16:48.903522] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:16:49.590804] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-03T21:16:49.623799] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:16:49.857490] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T21:16:49.859605] [INFO ] [REMOTE ] RNR: Full fetch complete (51155 records). [2025-10-03T21:16:49.859759] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-03T21:16:50.272559] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-03T21:16:50.272666] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-03T21:16:50.273597] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-03T21:16:50.273666] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-03T21:16:50.274926] [DEBUG] [LOCAL ] RNR: Trimmed 51155 records to 34345 (keeping 200 days of data) [2025-10-03T21:16:50.390992] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-03T21:16:50.517947] [DEBUG] [LOCAL ] RNR: Primary data saved (34345 records). [2025-10-03T21:16:50.518109] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-03T21:16:50.518269] [INFO ] [MAIN ] Update Progress: 1825/2370 symbols completed. RNR took 28.2s. Estimated remaining: 1h 16m 41s. Rate: 7.1 symbols/min [2025-10-03T21:16:50.712023] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:16:50.765515] [DEBUG] [LOCAL ] ROL: Loaded 50678 existing records from primary storage. [2025-10-03T21:16:50.765901] [INFO ] [MAIN ] ROL: Loaded 50678 existing records. [2025-10-03T21:16:50.986624] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:16:50.988425] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T21:16:50.988555] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-03T21:16:50.994682] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-03T21:16:50.994956] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-10-03T21:16:50.995332] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-03T21:16:51.201625] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-03T21:16:51.388599] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:16:51.990741] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-03T21:16:52.203374] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:16:52.791062] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T21:16:52.791142] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-03T21:16:53.457539] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T21:16:53.590706] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-03T21:16:54.390714] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-03T21:16:54.534107] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T21:16:55.190701] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-03T21:16:55.358348] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T21:16:55.677556] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T21:16:55.990685] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-03T21:16:56.790698] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-03T21:16:57.004259] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:16:57.050328] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T21:16:57.590690] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-03T21:16:58.390678] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-03T21:16:58.548955] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T21:16:58.836617] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T21:16:59.190692] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-03T21:16:59.990757] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-03T21:17:00.275599] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T21:17:00.421357] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T21:17:00.790747] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-03T21:17:01.590738] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-03T21:17:01.796441] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T21:17:02.390729] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-03T21:17:02.602531] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T21:17:02.781744] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T21:17:03.190720] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-03T21:17:03.990639] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-03T21:17:04.051465] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T21:17:04.053765] [INFO ] [REMOTE ] ROG: Full fetch complete (30963 records). [2025-10-03T21:17:04.053856] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-03T21:17:04.463550] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-03T21:17:04.463636] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-03T21:17:04.464434] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-03T21:17:04.464501] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-03T21:17:04.465751] [DEBUG] [LOCAL ] ROG: Trimmed 30963 records to 23154 (keeping 200 days of data) [2025-10-03T21:17:04.610126] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T21:17:04.658831] [DEBUG] [LOCAL ] ROG: Primary data saved (23154 records). [2025-10-03T21:17:04.658982] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-03T21:17:04.659087] [INFO ] [MAIN ] Update Progress: 1826/2370 symbols completed. ROG took 28.0s. Estimated remaining: 1h 16m 34s. Rate: 7.1 symbols/min [2025-10-03T21:17:04.795733] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-03T21:17:04.851194] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:04.899314] [DEBUG] [LOCAL ] RPM: Loaded 41852 existing records from primary storage. [2025-10-03T21:17:04.899718] [INFO ] [MAIN ] RPM: Loaded 41852 existing records. [2025-10-03T21:17:05.097466] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:05.097727] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-03T21:17:05.097785] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-03T21:17:05.098062] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-03T21:17:05.098121] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-03T21:17:05.496264] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:05.519801] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T21:17:05.590694] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-03T21:17:06.390710] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-03T21:17:06.979661] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T21:17:07.190737] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-03T21:17:07.221823] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T21:17:07.304386] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T21:17:07.306502] [INFO ] [REMOTE ] RNST: Full fetch complete (53288 records). [2025-10-03T21:17:07.306604] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-03T21:17:07.748083] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-03T21:17:07.748179] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-03T21:17:07.749293] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-03T21:17:07.749377] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-03T21:17:07.750699] [DEBUG] [LOCAL ] RNST: Trimmed 53288 records to 37572 (keeping 200 days of data) [2025-10-03T21:17:07.990886] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-03T21:17:07.991133] [DEBUG] [LOCAL ] RNST: Primary data saved (37572 records). [2025-10-03T21:17:07.992333] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-03T21:17:07.993983] [INFO ] [MAIN ] Update Progress: 1827/2370 symbols completed. RNST took 39.3s. Estimated remaining: 1h 16m 24s. Rate: 7.1 symbols/min [2025-10-03T21:17:08.183396] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:08.207697] [DEBUG] [LOCAL ] RPT: Loaded 19143 existing records from primary storage. [2025-10-03T21:17:08.207983] [INFO ] [MAIN ] RPT: Loaded 19143 existing records. [2025-10-03T21:17:08.405809] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:08.406041] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-03T21:17:08.406097] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-03T21:17:08.406328] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-03T21:17:08.406387] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-03T21:17:08.803275] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-03T21:17:08.895278] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:08.936673] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:17:09.590719] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-03T21:17:09.736057] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T21:17:10.207312] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T21:17:10.390699] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-03T21:17:10.753600] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T21:17:11.190683] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-03T21:17:11.609540] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:17:11.990725] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-03T21:17:12.790688] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-03T21:17:13.056123] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T21:17:13.590687] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-03T21:17:13.835499] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T21:17:13.859320] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T21:17:14.390750] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-03T21:17:15.043723] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T21:17:15.190713] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-03T21:17:15.990727] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-03T21:17:16.319172] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T21:17:16.384715] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T21:17:16.790724] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-03T21:17:17.590681] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-03T21:17:17.768419] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:17:18.390667] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-03T21:17:18.445186] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T21:17:19.190694] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-03T21:17:19.519005] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T21:17:19.990715] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-03T21:17:20.242887] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T21:17:20.269191] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T21:17:20.790724] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-03T21:17:21.590731] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-03T21:17:21.794005] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T21:17:21.837611] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T21:17:22.390732] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-03T21:17:22.422220] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T21:17:23.190724] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-03T21:17:23.863988] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T21:17:23.990699] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-03T21:17:24.766144] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T21:17:24.771794] [INFO ] [REMOTE ] ROL: Full fetch complete (72862 records). [2025-10-03T21:17:24.771919] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-03T21:17:24.795755] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-03T21:17:25.124216] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T21:17:25.214042] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-03T21:17:25.214135] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-03T21:17:25.215369] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-03T21:17:25.215469] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-03T21:17:25.217138] [DEBUG] [LOCAL ] ROL: Trimmed 72862 records to 51042 (keeping 200 days of data) [2025-10-03T21:17:25.553246] [DEBUG] [LOCAL ] ROL: Primary data saved (51042 records). [2025-10-03T21:17:25.553688] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-03T21:17:25.554001] [INFO ] [MAIN ] Update Progress: 1828/2370 symbols completed. ROL took 35.0s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-03T21:17:25.595902] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-03T21:17:25.744251] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:25.778366] [DEBUG] [LOCAL ] RQI: Loaded 29347 existing records from primary storage. [2025-10-03T21:17:25.778732] [INFO ] [MAIN ] RQI: Loaded 29347 existing records. [2025-10-03T21:17:25.981416] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:25.981701] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-03T21:17:25.981780] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-03T21:17:25.982094] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-03T21:17:25.982154] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-03T21:17:26.181715] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T21:17:26.262831] [INFO ] [REMOTE ] ROK: Full fetch complete (63018 records). [2025-10-03T21:17:26.281860] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-03T21:17:26.390812] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-03T21:17:26.546692] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:26.928012] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-03T21:17:26.928684] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T21:17:26.928894] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-03T21:17:26.936320] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-03T21:17:26.936809] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-03T21:17:26.938333] [DEBUG] [LOCAL ] ROK: Trimmed 63018 records to 44301 (keeping 200 days of data) [2025-10-03T21:17:27.191619] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-03T21:17:27.240241] [DEBUG] [LOCAL ] ROK: Primary data saved (44301 records). [2025-10-03T21:17:27.240379] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-03T21:17:27.240471] [INFO ] [MAIN ] Update Progress: 1829/2370 symbols completed. ROK took 42.7s. Estimated remaining: 1h 16m 8s. Rate: 7.1 symbols/min [2025-10-03T21:17:27.420930] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:27.471547] [DEBUG] [LOCAL ] RRC: Loaded 53186 existing records from primary storage. [2025-10-03T21:17:27.471903] [INFO ] [MAIN ] RRC: Loaded 53186 existing records. [2025-10-03T21:17:27.667738] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:27.668600] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-03T21:17:27.668696] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-03T21:17:27.669359] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-03T21:17:27.669422] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-03T21:17:27.995636] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-03T21:17:28.107366] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:28.136630] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T21:17:28.372275] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T21:17:28.790686] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-03T21:17:29.079188] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T21:17:29.570663] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T21:17:29.590719] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-03T21:17:30.390636] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-03T21:17:30.607716] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T21:17:31.190691] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-03T21:17:31.852841] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T21:17:31.990737] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-03T21:17:32.790705] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-03T21:17:32.897122] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:17:33.109149] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:17:33.590691] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-03T21:17:34.070986] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T21:17:34.165417] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T21:17:34.168377] [INFO ] [REMOTE ] RPT: Full fetch complete (28398 records). [2025-10-03T21:17:34.168474] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-03T21:17:34.397238] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-03T21:17:34.584809] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-03T21:17:34.584901] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-03T21:17:34.585692] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-03T21:17:34.585768] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-03T21:17:34.586757] [DEBUG] [LOCAL ] RPT: Trimmed 28398 records to 19194 (keeping 200 days of data) [2025-10-03T21:17:34.713014] [DEBUG] [LOCAL ] RPT: Primary data saved (19194 records). [2025-10-03T21:17:34.713162] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-03T21:17:34.713251] [INFO ] [MAIN ] Update Progress: 1830/2370 symbols completed. RPT took 26.7s. Estimated remaining: 1h 15m 59s. Rate: 7.1 symbols/min [2025-10-03T21:17:34.900052] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:34.954755] [DEBUG] [LOCAL ] RRX: Loaded 41307 existing records from primary storage. [2025-10-03T21:17:34.955060] [INFO ] [MAIN ] RRX: Loaded 41307 existing records. [2025-10-03T21:17:35.153300] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:35.153542] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-03T21:17:35.153593] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-03T21:17:35.153910] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-03T21:17:35.153970] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-03T21:17:35.201196] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-03T21:17:35.553008] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:35.990731] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-03T21:17:36.425442] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-03T21:17:36.601725] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T21:17:36.790694] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-03T21:17:37.590631] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-03T21:17:37.684550] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T21:17:38.389047] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T21:17:38.396275] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-03T21:17:39.190693] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-03T21:17:39.228124] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T21:17:39.912305] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T21:17:39.990718] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-03T21:17:40.520152] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T21:17:40.790736] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-03T21:17:41.334460] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T21:17:41.590735] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-03T21:17:41.968280] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T21:17:41.975701] [INFO ] [REMOTE ] RPM: Full fetch complete (59439 records). [2025-10-03T21:17:41.975849] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-03T21:17:42.393605] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-03T21:17:42.394900] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-03T21:17:42.395000] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-03T21:17:42.396165] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-03T21:17:42.396360] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-03T21:17:42.399369] [DEBUG] [LOCAL ] RPM: Trimmed 59439 records to 42177 (keeping 200 days of data) [2025-10-03T21:17:42.689160] [DEBUG] [LOCAL ] RPM: Primary data saved (42177 records). [2025-10-03T21:17:42.689297] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-03T21:17:42.689393] [INFO ] [MAIN ] Update Progress: 1831/2370 symbols completed. RPM took 38.0s. Estimated remaining: 1h 15m 50s. Rate: 7.1 symbols/min [2025-10-03T21:17:42.873769] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:42.901767] [DEBUG] [LOCAL ] RS: Loaded 25543 existing records from primary storage. [2025-10-03T21:17:42.902056] [INFO ] [MAIN ] RS: Loaded 25543 existing records. [2025-10-03T21:17:43.101302] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:43.101789] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-03T21:17:43.101937] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-03T21:17:43.102257] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-03T21:17:43.102320] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-03T21:17:43.190779] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-03T21:17:43.447797] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T21:17:43.542377] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:43.574861] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T21:17:43.990723] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-03T21:17:44.790634] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-03T21:17:45.123885] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T21:17:45.590630] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-03T21:17:45.705285] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T21:17:45.768176] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T21:17:46.390685] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-03T21:17:47.190671] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-03T21:17:47.480178] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T21:17:47.972610] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T21:17:47.990612] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-03T21:17:48.790712] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-03T21:17:48.932560] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T21:17:49.590692] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-03T21:17:49.643467] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T21:17:50.200294] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T21:17:50.390705] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-03T21:17:51.190738] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-03T21:17:51.336709] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:17:51.856820] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T21:17:51.990722] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-03T21:17:52.790665] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-03T21:17:53.078439] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T21:17:53.414918] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T21:17:53.590703] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-03T21:17:53.696822] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T21:17:53.702993] [INFO ] [REMOTE ] RQI: Full fetch complete (43325 records). [2025-10-03T21:17:53.703177] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-03T21:17:54.128595] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-03T21:17:54.128704] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-03T21:17:54.129554] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-03T21:17:54.129600] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-03T21:17:54.130711] [DEBUG] [LOCAL ] RQI: Trimmed 43325 records to 29489 (keeping 200 days of data) [2025-10-03T21:17:54.320453] [DEBUG] [LOCAL ] RQI: Primary data saved (29489 records). [2025-10-03T21:17:54.320603] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-03T21:17:54.320760] [INFO ] [MAIN ] Update Progress: 1832/2370 symbols completed. RQI took 28.8s. Estimated remaining: 1h 15m 43s. Rate: 7.1 symbols/min [2025-10-03T21:17:54.395765] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-03T21:17:54.513569] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:17:54.520530] [DEBUG] [LOCAL ] RSF: Loaded 4250 existing records from primary storage. [2025-10-03T21:17:54.520737] [INFO ] [MAIN ] RSF: Loaded 4250 existing records. [2025-10-03T21:17:54.714568] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:17:54.714877] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-03T21:17:54.714932] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-03T21:17:54.715196] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-03T21:17:54.715258] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-03T21:17:55.120493] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:17:55.139256] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T21:17:55.190698] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-03T21:17:55.990733] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-03T21:17:56.376966] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-03T21:17:56.742402] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T21:17:56.790628] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-03T21:17:57.547419] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T21:17:57.560336] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T21:17:57.590700] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-03T21:17:58.223280] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T21:17:58.390685] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-03T21:17:58.915801] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T21:17:59.190694] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-03T21:17:59.990714] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-03T21:18:00.790693] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-03T21:18:01.387422] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T21:18:01.590699] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-03T21:18:01.701846] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:18:02.224060] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T21:18:02.390693] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-03T21:18:03.190638] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-03T21:18:03.469286] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T21:18:03.598295] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-03T21:18:03.990639] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-03T21:18:04.202441] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:18:04.689920] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-03T21:18:04.790685] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-03T21:18:05.496248] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T21:18:05.590680] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-03T21:18:06.390685] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-03T21:18:06.839294] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T21:18:06.841471] [INFO ] [REMOTE ] RRX: Full fetch complete (58223 records). [2025-10-03T21:18:06.841594] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-03T21:18:07.167938] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T21:18:07.195735] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-03T21:18:07.282808] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-03T21:18:07.282944] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-03T21:18:07.284082] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-03T21:18:07.284153] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-03T21:18:07.285488] [DEBUG] [LOCAL ] RRX: Trimmed 58223 records to 41590 (keeping 200 days of data) [2025-10-03T21:18:07.562224] [DEBUG] [LOCAL ] RRX: Primary data saved (41590 records). [2025-10-03T21:18:07.562357] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-03T21:18:07.563016] [INFO ] [MAIN ] Update Progress: 1833/2370 symbols completed. RRX took 32.8s. Estimated remaining: 1h 15m 36s. Rate: 7.1 symbols/min [2025-10-03T21:18:07.748232] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:07.798823] [DEBUG] [LOCAL ] RSG: Loaded 47804 existing records from primary storage. [2025-10-03T21:18:07.799231] [INFO ] [MAIN ] RSG: Loaded 47804 existing records. [2025-10-03T21:18:07.995723] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-03T21:18:07.995594] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:07.997053] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-03T21:18:07.997114] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-03T21:18:07.997337] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-10-03T21:18:07.997429] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-03T21:18:08.050872] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T21:18:08.424725] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:08.790704] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-03T21:18:09.255890] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T21:18:09.590680] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-03T21:18:10.390637] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-03T21:18:10.550686] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T21:18:11.190624] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-03T21:18:11.526106] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T21:18:11.845068] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T21:18:11.990706] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-03T21:18:12.001620] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T21:18:12.790731] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-03T21:18:13.495065] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T21:18:13.497812] [INFO ] [REMOTE ] RRC: Full fetch complete (76393 records). [2025-10-03T21:18:13.497954] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-03T21:18:13.599907] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-03T21:18:13.916310] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-03T21:18:13.916417] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-03T21:18:13.917966] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-03T21:18:13.918037] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-03T21:18:13.919593] [DEBUG] [LOCAL ] RRC: Trimmed 76393 records to 53576 (keeping 200 days of data) [2025-10-03T21:18:14.264546] [DEBUG] [LOCAL ] RRC: Primary data saved (53576 records). [2025-10-03T21:18:14.264724] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-03T21:18:14.264857] [INFO ] [MAIN ] Update Progress: 1834/2370 symbols completed. RRC took 47.0s. Estimated remaining: 1h 15m 27s. Rate: 7.1 symbols/min [2025-10-03T21:18:14.395851] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-03T21:18:14.450212] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:14.497396] [DEBUG] [LOCAL ] RSI: Loaded 47217 existing records from primary storage. [2025-10-03T21:18:14.497767] [INFO ] [MAIN ] RSI: Loaded 47217 existing records. [2025-10-03T21:18:14.697497] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:14.698156] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-03T21:18:14.698402] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-03T21:18:14.698844] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-03T21:18:14.698984] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-03T21:18:14.900920] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-03T21:18:15.127714] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T21:18:15.152165] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:15.172814] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T21:18:15.190624] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-03T21:18:15.990688] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-03T21:18:16.492724] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T21:18:16.493803] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T21:18:16.495384] [INFO ] [REMOTE ] RSF: Full fetch complete (5678 records). [2025-10-03T21:18:16.502049] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-03T21:18:16.799899] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-03T21:18:16.964427] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-03T21:18:16.964522] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-03T21:18:16.964768] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-03T21:18:16.964842] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-03T21:18:16.965382] [DEBUG] [LOCAL ] RSF: Trimmed 5678 records to 4294 (keeping 200 days of data) [2025-10-03T21:18:16.994001] [DEBUG] [LOCAL ] RSF: Primary data saved (4294 records). [2025-10-03T21:18:16.994148] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-03T21:18:16.994271] [INFO ] [MAIN ] Update Progress: 1835/2370 symbols completed. RSF took 22.7s. Estimated remaining: 1h 15m 17s. Rate: 7.1 symbols/min [2025-10-03T21:18:17.182870] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:17.214959] [DEBUG] [LOCAL ] RSKD: Loaded 33740 existing records from primary storage. [2025-10-03T21:18:17.215245] [INFO ] [MAIN ] RSKD: Loaded 33740 existing records. [2025-10-03T21:18:17.409039] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:17.409317] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-03T21:18:17.409372] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-03T21:18:17.409605] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-03T21:18:17.409693] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-03T21:18:17.591544] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-03T21:18:17.815749] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:18.236788] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T21:18:18.390704] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-03T21:18:19.190673] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-03T21:18:19.444971] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T21:18:19.990680] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-03T21:18:20.098682] [DEBUG] [REMOTE ] RS: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-03T21:18:20.099043] [WARN ] [REMOTE ] RS: No data returned for month 2025-10 [2025-10-03T21:18:20.099149] [FATAL] [REMOTE ] RS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:18:20.099238] [FATAL] [MAIN ] RS: Failed to fetch primary data. [2025-10-03T21:18:20.099279] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:18:20.099352] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-03T21:18:20.099452] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-03T21:18:20.099501] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-03T21:18:20.099831] [DEBUG] [LOCAL ] RS: Deleted derivative data file. [2025-10-03T21:18:20.099950] [INFO ] [MAIN ] Update Progress: 1836/2370 symbols completed. RS took 37.4s. Estimated remaining: 1h 15m 7s. Rate: 7.1 symbols/min [2025-10-03T21:18:20.335566] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:20.338199] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T21:18:20.393291] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T21:18:20.415924] [DEBUG] [LOCAL ] RTO: Loaded 40295 existing records from primary storage. [2025-10-03T21:18:20.416252] [INFO ] [MAIN ] RTO: Loaded 40295 existing records. [2025-10-03T21:18:20.613832] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:20.614121] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-03T21:18:20.614178] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-03T21:18:20.614424] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-03T21:18:20.614484] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-03T21:18:20.804380] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-03T21:18:21.001989] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:21.590667] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-03T21:18:22.237740] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T21:18:22.390720] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-03T21:18:23.190666] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-03T21:18:23.491496] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:18:23.990675] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-03T21:18:24.237348] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T21:18:24.599411] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T21:18:24.790731] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-03T21:18:25.590684] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-03T21:18:25.653048] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T21:18:26.403735] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-03T21:18:26.434722] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T21:18:26.686153] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T21:18:27.190730] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-03T21:18:27.895474] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T21:18:27.990683] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-03T21:18:28.640890] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T21:18:28.790734] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-03T21:18:29.391355] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T21:18:29.590723] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-03T21:18:30.256053] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T21:18:30.390722] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-03T21:18:31.190677] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-03T21:18:31.294269] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T21:18:31.801272] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T21:18:31.990730] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-03T21:18:32.379947] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T21:18:32.790725] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-03T21:18:33.590633] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-03T21:18:34.059616] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T21:18:34.127310] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T21:18:34.390734] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-03T21:18:34.928904] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T21:18:35.190736] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-03T21:18:35.893314] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T21:18:35.990699] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-03T21:18:36.790673] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-03T21:18:36.987193] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T21:18:37.016162] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T21:18:37.590707] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-03T21:18:38.390667] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-03T21:18:38.418073] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:18:38.434403] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T21:18:38.436251] [INFO ] [REMOTE ] RSKD: Full fetch complete (48243 records). [2025-10-03T21:18:38.436336] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-03T21:18:38.844825] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-03T21:18:38.844922] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-03T21:18:38.845838] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-03T21:18:38.845900] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-03T21:18:38.847091] [DEBUG] [LOCAL ] RSKD: Trimmed 48243 records to 33954 (keeping 200 days of data) [2025-10-03T21:18:39.042341] [DEBUG] [LOCAL ] RSKD: Primary data saved (33954 records). [2025-10-03T21:18:39.042523] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-03T21:18:39.042706] [INFO ] [MAIN ] Update Progress: 1837/2370 symbols completed. RSKD took 22.0s. Estimated remaining: 1h 15m 1s. Rate: 7.1 symbols/min [2025-10-03T21:18:39.190728] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-03T21:18:39.990675] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-03T21:18:40.217102] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T21:18:40.790748] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-03T21:18:40.839329] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T21:18:41.590670] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-03T21:18:41.872238] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T21:18:42.390709] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-03T21:18:42.560098] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T21:18:43.190700] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-03T21:18:43.494373] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T21:18:43.990676] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-03T21:18:44.153145] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T21:18:44.242605] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T21:18:44.790724] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-03T21:18:45.451739] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:18:45.590685] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-03T21:18:46.320750] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T21:18:46.390754] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-03T21:18:46.429410] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T21:18:47.190706] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-03T21:18:47.720705] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T21:18:47.724450] [INFO ] [REMOTE ] RSI: Full fetch complete (69469 records). [2025-10-03T21:18:47.724701] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-03T21:18:47.998279] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-03T21:18:48.166010] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-03T21:18:48.166174] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-03T21:18:48.167338] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-03T21:18:48.167402] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-03T21:18:48.169178] [DEBUG] [LOCAL ] RSI: Trimmed 69469 records to 47575 (keeping 200 days of data) [2025-10-03T21:18:48.356089] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T21:18:48.387747] [INFO ] [REMOTE ] RSG: Full fetch complete (68077 records). [2025-10-03T21:18:48.391705] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-03T21:18:48.897581] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-03T21:18:48.898020] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-03T21:18:48.899416] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-03T21:18:48.899796] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-03T21:18:48.902019] [DEBUG] [LOCAL ] RSI: Primary data saved (47575 records). [2025-10-03T21:18:48.902200] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-03T21:18:48.902427] [INFO ] [MAIN ] Update Progress: 1838/2370 symbols completed. RSI took 34.6s. Estimated remaining: 1h 14m 53s. Rate: 7.1 symbols/min [2025-10-03T21:18:48.903184] [DEBUG] [LOCAL ] RSG: Trimmed 68077 records to 48147 (keeping 200 days of data) [2025-10-03T21:18:49.226380] [DEBUG] [LOCAL ] RSG: Primary data saved (48147 records). [2025-10-03T21:18:49.226525] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-03T21:18:49.230537] [INFO ] [MAIN ] Update Progress: 1839/2370 symbols completed. RSG took 41.7s. Estimated remaining: 1h 14m 43s. Rate: 7.1 symbols/min [2025-10-03T21:18:49.630401] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:18:49.638567] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-03T21:18:51.060212] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T21:18:51.069858] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-03T21:18:52.729747] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T21:18:52.739211] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-03T21:18:54.310830] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:18:54.320078] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-03T21:18:55.552103] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T21:18:55.555091] [INFO ] [REMOTE ] RTO: Full fetch complete (58570 records). [2025-10-03T21:18:55.555287] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-03T21:18:55.979832] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-03T21:18:55.979914] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-03T21:18:55.980879] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-03T21:18:55.980944] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-03T21:18:55.982152] [DEBUG] [LOCAL ] RTO: Trimmed 58570 records to 40642 (keeping 200 days of data) [2025-10-03T21:18:56.235321] [DEBUG] [LOCAL ] RTO: Primary data saved (40642 records). [2025-10-03T21:18:56.235464] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-03T21:18:56.235770] [INFO ] [MAIN ] Update Progress: 1840/2370 symbols completed. RTO took 36.1s. Estimated remaining: 1h 14m 34s. Rate: 7.1 symbols/min [2025-10-03T21:18:56.908951] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:57.033441] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:57.011874] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:57.057494] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:18:57.090313] [DEBUG] [LOCAL ] RVT: Loaded 26786 existing records from primary storage. [2025-10-03T21:18:57.091062] [INFO ] [MAIN ] RVT: Loaded 26786 existing records. [2025-10-03T21:18:57.350703] [DEBUG] [LOCAL ] RVLV: Loaded 47921 existing records from primary storage. [2025-10-03T21:18:57.355525] [DEBUG] [LOCAL ] RVTY: Loaded 47883 existing records from primary storage. [2025-10-03T21:18:57.361929] [INFO ] [MAIN ] RVTY: Loaded 47883 existing records. [2025-10-03T21:18:57.362862] [DEBUG] [LOCAL ] RTX: Loaded 54094 existing records from primary storage. [2025-10-03T21:18:57.440118] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:57.427970] [INFO ] [MAIN ] RVLV: Loaded 47921 existing records. [2025-10-03T21:18:57.453218] [INFO ] [MAIN ] RTX: Loaded 54094 existing records. [2025-10-03T21:18:57.480040] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-03T21:18:57.506955] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-03T21:18:57.653241] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-03T21:18:57.684570] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-03T21:18:58.117543] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:58.195771] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:58.184194] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-03T21:18:58.200079] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:18:58.216117] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-03T21:18:58.216323] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-03T21:18:58.232065] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-03T21:18:58.216007] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-03T21:18:58.243666] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-03T21:18:58.277704] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-03T21:18:58.279841] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-03T21:18:58.285893] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-10-03T21:18:58.301821] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-03T21:18:58.309323] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-03T21:18:58.342014] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-03T21:18:59.348818] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:59.363621] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-03T21:18:59.611825] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:59.626377] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-03T21:18:59.723945] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:59.749088] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-03T21:18:59.781079] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:18:59.781621] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-03T21:19:00.830415] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T21:19:00.840542] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-03T21:19:01.644546] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T21:19:01.655059] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-03T21:19:01.681592] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T21:19:01.691004] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-03T21:19:01.774114] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T21:19:01.785405] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-03T21:19:02.370914] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:19:02.377560] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-03T21:19:03.171151] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T21:19:03.181787] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-03T21:19:03.451974] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T21:19:03.462258] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-03T21:19:03.556898] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T21:19:03.573364] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-03T21:19:03.651373] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T21:19:03.657699] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-03T21:19:04.414320] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T21:19:04.424355] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-03T21:19:05.044383] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T21:19:05.051891] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-03T21:19:05.278617] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T21:19:05.288305] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-03T21:19:05.373730] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T21:19:05.386745] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-03T21:19:06.287530] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T21:19:06.298778] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-03T21:19:06.514306] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T21:19:06.521110] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-03T21:19:06.942517] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:19:07.190681] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-03T21:19:07.657847] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-03T21:19:07.701475] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T21:19:07.740389] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T21:19:07.990677] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-03T21:19:08.790630] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-03T21:19:08.953868] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T21:19:09.590693] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-03T21:19:09.865279] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T21:19:10.127032] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T21:19:10.390699] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-03T21:19:11.190730] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-03T21:19:11.255352] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T21:19:11.784193] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T21:19:11.990693] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-03T21:19:12.790676] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-03T21:19:12.985507] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:19:13.585883] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T21:19:13.595018] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-03T21:19:14.390719] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-03T21:19:14.911130] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T21:19:15.146073] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-03T21:19:15.190669] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-03T21:19:15.998989] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-03T21:19:16.019964] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:19:16.790632] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-03T21:19:17.219036] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T21:19:17.590696] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-03T21:19:17.810293] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:19:18.287442] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T21:19:18.390753] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-03T21:19:19.190732] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-03T21:19:19.835068] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T21:19:19.991238] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-03T21:19:19.996666] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T21:19:20.790681] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-03T21:19:20.946879] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T21:19:21.138140] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T21:19:21.397853] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T21:19:21.590702] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-03T21:19:22.390624] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-03T21:19:22.585687] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T21:19:22.587156] [INFO ] [REMOTE ] RVT: Full fetch complete (39561 records). [2025-10-03T21:19:22.587235] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-03T21:19:22.998468] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-03T21:19:22.998585] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-03T21:19:22.999533] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-03T21:19:22.999611] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-03T21:19:23.000694] [DEBUG] [LOCAL ] RVT: Trimmed 39561 records to 26927 (keeping 200 days of data) [2025-10-03T21:19:23.171691] [DEBUG] [LOCAL ] RVT: Primary data saved (26927 records). [2025-10-03T21:19:23.171859] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-03T21:19:23.171986] [INFO ] [MAIN ] Update Progress: 1841/2370 symbols completed. RVT took 26.9s. Estimated remaining: 1h 14m 31s. Rate: 7.1 symbols/min [2025-10-03T21:19:23.197131] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-03T21:19:23.362327] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:23.395358] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T21:19:23.440635] [DEBUG] [LOCAL ] RWT: Loaded 41129 existing records from primary storage. [2025-10-03T21:19:23.440975] [INFO ] [MAIN ] RWT: Loaded 41129 existing records. [2025-10-03T21:19:23.626805] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:19:23.627041] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-03T21:19:23.627089] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-03T21:19:23.627310] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-03T21:19:23.627368] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-03T21:19:24.002036] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-03T21:19:24.007751] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:24.790704] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-03T21:19:24.957296] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T21:19:25.485292] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T21:19:25.488092] [INFO ] [REMOTE ] RVTY: Full fetch complete (66830 records). [2025-10-03T21:19:25.488226] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-03T21:19:25.595749] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-03T21:19:25.911217] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-03T21:19:25.911312] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-03T21:19:25.912398] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-03T21:19:25.912471] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-03T21:19:25.914048] [DEBUG] [LOCAL ] RVTY: Trimmed 66830 records to 48261 (keeping 200 days of data) [2025-10-03T21:19:26.236195] [DEBUG] [LOCAL ] RVTY: Primary data saved (48261 records). [2025-10-03T21:19:26.236344] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-03T21:19:26.236435] [INFO ] [MAIN ] Update Progress: 1842/2370 symbols completed. RVTY took 30.0s. Estimated remaining: 1h 14m 21s. Rate: 7.1 symbols/min [2025-10-03T21:19:26.399835] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-03T21:19:26.431201] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:26.431840] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-03T21:19:26.432004] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-03T21:19:26.432215] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-03T21:19:26.432374] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-03T21:19:26.432555] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-03T21:19:26.432604] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-03T21:19:26.572487] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T21:19:26.873282] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:27.190639] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-03T21:19:27.456394] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T21:19:27.460089] [INFO ] [REMOTE ] RTX: Full fetch complete (77730 records). [2025-10-03T21:19:27.460265] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-03T21:19:27.791146] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T21:19:27.898748] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-03T21:19:27.898863] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-03T21:19:27.900198] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-03T21:19:27.900345] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-03T21:19:27.911820] [DEBUG] [LOCAL ] RTX: Trimmed 77730 records to 54484 (keeping 200 days of data) [2025-10-03T21:19:27.933347] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T21:19:27.998557] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-03T21:19:28.313493] [DEBUG] [LOCAL ] RTX: Primary data saved (54484 records). [2025-10-03T21:19:28.313666] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-03T21:19:28.313779] [INFO ] [MAIN ] Update Progress: 1843/2370 symbols completed. RTX took 32.1s. Estimated remaining: 1h 14m 10s. Rate: 7.1 symbols/min [2025-10-03T21:19:28.503749] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:28.503950] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-03T21:19:28.503991] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-03T21:19:28.504104] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-03T21:19:28.504148] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-03T21:19:28.504191] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-03T21:19:28.504229] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-03T21:19:28.620960] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T21:19:28.795796] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-03T21:19:28.905006] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:29.590700] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-03T21:19:30.384278] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:19:30.392452] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-03T21:19:30.769981] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T21:19:30.772618] [INFO ] [REMOTE ] RVLV: Full fetch complete (68719 records). [2025-10-03T21:19:30.772779] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-03T21:19:30.895423] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T21:19:31.201346] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-03T21:19:31.231597] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-03T21:19:31.231727] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-03T21:19:31.232934] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-03T21:19:31.233003] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-03T21:19:31.234596] [DEBUG] [LOCAL ] RVLV: Trimmed 68719 records to 48281 (keeping 200 days of data) [2025-10-03T21:19:31.538729] [DEBUG] [LOCAL ] RVLV: Primary data saved (48281 records). [2025-10-03T21:19:31.538884] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-03T21:19:31.538974] [INFO ] [MAIN ] Update Progress: 1844/2370 symbols completed. RVLV took 35.3s. Estimated remaining: 1h 14m 0s. Rate: 7.1 symbols/min [2025-10-03T21:19:31.748472] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:31.748972] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-03T21:19:31.749030] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-03T21:19:31.749245] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-03T21:19:31.749331] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-03T21:19:31.749384] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-03T21:19:31.749463] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-03T21:19:31.843307] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T21:19:31.995951] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-03T21:19:32.145629] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:32.592821] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T21:19:32.790704] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-03T21:19:33.544800] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T21:19:33.590682] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-03T21:19:34.101787] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T21:19:34.390731] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-03T21:19:35.190724] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-03T21:19:35.465282] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:19:35.465632] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-03T21:19:35.465757] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:19:35.465807] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-03T21:19:35.465867] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:19:35.465940] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-03T21:19:35.466005] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-03T21:19:35.466043] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-03T21:19:35.466118] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-03T21:19:35.466233] [INFO ] [MAIN ] Update Progress: 1845/2370 symbols completed. RWTP took 3.9s. Estimated remaining: 1h 13m 51s. Rate: 7.1 symbols/min [2025-10-03T21:19:35.650749] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:35.697171] [DEBUG] [LOCAL ] RXO: Loaded 48199 existing records from primary storage. [2025-10-03T21:19:35.697499] [INFO ] [MAIN ] RXO: Loaded 48199 existing records. [2025-10-03T21:19:35.899163] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:19:35.899564] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-03T21:19:35.899639] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-03T21:19:35.900099] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-03T21:19:35.900386] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-03T21:19:35.995671] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-03T21:19:36.003131] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:19:36.320327] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:36.427341] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T21:19:36.790718] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-03T21:19:37.324723] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T21:19:37.590937] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-03T21:19:38.042983] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T21:19:38.390718] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-03T21:19:38.781722] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-03T21:19:39.190733] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-03T21:19:39.990733] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-03T21:19:40.655810] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T21:19:40.780066] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T21:19:40.790615] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-03T21:19:41.590695] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-03T21:19:42.395945] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-03T21:19:42.397997] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T21:19:42.827802] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T21:19:42.976914] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T21:19:43.190694] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-03T21:19:43.566724] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T21:19:43.567948] [INFO ] [REMOTE ] RWTN: Full fetch complete (3151 records). [2025-10-03T21:19:43.568104] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-03T21:19:43.763196] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T21:19:43.763492] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:19:43.763565] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:19:43.763668] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-03T21:19:43.763822] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-03T21:19:43.763880] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-03T21:19:43.763926] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-03T21:19:43.764028] [INFO ] [MAIN ] Update Progress: 1846/2370 symbols completed. RWTN took 17.5s. Estimated remaining: 1h 13m 42s. Rate: 7.1 symbols/min [2025-10-03T21:19:43.937862] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:19:43.995790] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-03T21:19:43.999124] [DEBUG] [LOCAL ] RY: Loaded 48218 existing records from primary storage. [2025-10-03T21:19:43.999559] [INFO ] [MAIN ] RY: Loaded 48218 existing records. [2025-10-03T21:19:44.180205] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:19:44.180534] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-03T21:19:44.180663] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-03T21:19:44.180971] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-03T21:19:44.181030] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-03T21:19:44.562046] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:19:44.566464] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T21:19:44.790724] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-03T21:19:45.590712] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-03T21:19:46.136107] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T21:19:46.390762] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-03T21:19:46.617695] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:19:47.190723] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-03T21:19:47.542175] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T21:19:47.990692] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-03T21:19:48.049127] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T21:19:48.519726] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-03T21:19:48.790737] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-03T21:19:49.503390] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T21:19:49.590743] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-03T21:19:50.390722] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-03T21:19:51.190735] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-03T21:19:51.318082] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:19:51.990698] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-03T21:19:52.174882] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T21:19:52.790728] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-03T21:19:52.969188] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:19:53.590683] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-03T21:19:53.835586] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T21:19:54.390736] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-03T21:19:54.485584] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T21:19:55.190708] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-03T21:19:55.383178] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T21:19:55.813707] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T21:19:55.990705] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-03T21:19:56.509989] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T21:19:56.790764] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-03T21:19:57.602165] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-03T21:19:57.621735] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:19:58.280027] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T21:19:58.390677] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-03T21:19:58.717188] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T21:19:58.981759] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T21:19:59.190730] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-03T21:19:59.990722] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-03T21:20:00.797183] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-03T21:20:00.837294] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T21:20:01.590737] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-03T21:20:01.778407] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T21:20:02.135566] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T21:20:02.136586] [INFO ] [REMOTE ] RWTO: Full fetch complete (4854 records). [2025-10-03T21:20:02.136713] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-03T21:20:02.331872] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T21:20:02.332141] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:20:02.332221] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:20:02.332320] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-03T21:20:02.332394] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-03T21:20:02.332433] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-03T21:20:02.332474] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-03T21:20:02.332548] [INFO ] [MAIN ] Update Progress: 1847/2370 symbols completed. RWTO took 34.0s. Estimated remaining: 1h 13m 37s. Rate: 7.1 symbols/min [2025-10-03T21:20:02.395883] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-03T21:20:02.545702] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:02.588067] [DEBUG] [LOCAL ] RYAM: Loaded 35276 existing records from primary storage. [2025-10-03T21:20:02.588417] [INFO ] [MAIN ] RYAM: Loaded 35276 existing records. [2025-10-03T21:20:02.790959] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:02.791625] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-03T21:20:02.791906] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-03T21:20:02.792473] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-03T21:20:02.792540] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-03T21:20:03.211498] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-03T21:20:03.221091] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:03.226127] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T21:20:03.990696] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-03T21:20:04.235362] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:20:04.790701] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-03T21:20:04.922752] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:20:05.590726] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-03T21:20:06.021743] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T21:20:06.274359] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T21:20:06.390735] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-03T21:20:06.978689] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T21:20:07.190733] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-03T21:20:07.990736] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-03T21:20:08.213542] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T21:20:08.790627] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-03T21:20:09.185186] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T21:20:09.590734] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-03T21:20:09.768148] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-03T21:20:10.156481] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T21:20:10.161615] [INFO ] [REMOTE ] RWT: Full fetch complete (58753 records). [2025-10-03T21:20:10.161833] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-03T21:20:10.399413] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-03T21:20:10.575363] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-03T21:20:10.575467] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-03T21:20:10.577417] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-03T21:20:10.577486] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-03T21:20:10.579229] [DEBUG] [LOCAL ] RWT: Trimmed 58753 records to 41431 (keeping 200 days of data) [2025-10-03T21:20:10.851083] [DEBUG] [LOCAL ] RWT: Primary data saved (41431 records). [2025-10-03T21:20:10.851276] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-03T21:20:10.852163] [INFO ] [MAIN ] Update Progress: 1848/2370 symbols completed. RWT took 47.7s. Estimated remaining: 1h 13m 28s. Rate: 7.1 symbols/min [2025-10-03T21:20:10.955687] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T21:20:10.988814] [INFO ] [REMOTE ] RXO: Full fetch complete (68433 records). [2025-10-03T21:20:11.013395] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-03T21:20:11.049035] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:11.199343] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-03T21:20:11.509191] [DEBUG] [LOCAL ] RYAN: Loaded 44815 existing records from primary storage. [2025-10-03T21:20:11.529266] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-03T21:20:11.529151] [INFO ] [MAIN ] RYAN: Loaded 44815 existing records. [2025-10-03T21:20:11.529574] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-03T21:20:11.531227] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-03T21:20:11.531379] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-03T21:20:11.627815] [DEBUG] [LOCAL ] RXO: Trimmed 68433 records to 48570 (keeping 200 days of data) [2025-10-03T21:20:11.876727] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:11.882518] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-03T21:20:11.882638] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-03T21:20:11.891018] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-03T21:20:11.895765] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-03T21:20:12.118255] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T21:20:12.153969] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-03T21:20:12.607588] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:12.709797] [DEBUG] [LOCAL ] RXO: Primary data saved (48570 records). [2025-10-03T21:20:12.709986] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-03T21:20:12.710135] [INFO ] [MAIN ] Update Progress: 1849/2370 symbols completed. RXO took 37.2s. Estimated remaining: 1h 13m 18s. Rate: 7.1 symbols/min [2025-10-03T21:20:12.811404] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-03T21:20:12.971221] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:12.994901] [DEBUG] [LOCAL ] RYI: Loaded 21688 existing records from primary storage. [2025-10-03T21:20:12.995232] [INFO ] [MAIN ] RYI: Loaded 21688 existing records. [2025-10-03T21:20:13.230176] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:13.230639] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-03T21:20:13.230753] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-03T21:20:13.231214] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-03T21:20:13.231334] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-03T21:20:13.397105] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T21:20:13.601536] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-03T21:20:13.691914] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:13.761690] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:20:14.390711] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-03T21:20:14.563489] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T21:20:15.190730] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-03T21:20:15.444030] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:20:15.741687] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T21:20:15.990732] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-03T21:20:16.773846] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T21:20:16.790609] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-03T21:20:17.228468] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T21:20:17.590696] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-03T21:20:17.944911] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T21:20:18.390624] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-03T21:20:18.417093] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T21:20:19.190729] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-03T21:20:19.774054] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T21:20:19.990723] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-03T21:20:20.403143] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T21:20:20.790691] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-03T21:20:21.442847] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T21:20:21.590727] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-03T21:20:22.203867] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T21:20:22.390711] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-03T21:20:23.105997] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T21:20:23.190722] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-03T21:20:23.625441] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T21:20:23.990678] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-03T21:20:24.466238] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T21:20:24.790709] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-03T21:20:25.373840] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:20:25.376391] [INFO ] [REMOTE ] RY: Full fetch complete (68842 records). [2025-10-03T21:20:25.376513] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-03T21:20:25.592529] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-03T21:20:25.816824] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-03T21:20:25.817049] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-03T21:20:25.818458] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-03T21:20:25.818721] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-03T21:20:25.820483] [DEBUG] [LOCAL ] RY: Trimmed 68842 records to 48550 (keeping 200 days of data) [2025-10-03T21:20:25.942356] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T21:20:26.160909] [DEBUG] [LOCAL ] RY: Primary data saved (48550 records). [2025-10-03T21:20:26.161066] [INFO ] [MAIN ] RY: Full history saved. [2025-10-03T21:20:26.161200] [INFO ] [MAIN ] Update Progress: 1850/2370 symbols completed. RY took 42.4s. Estimated remaining: 1h 13m 11s. Rate: 7.1 symbols/min [2025-10-03T21:20:26.342328] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:26.387455] [DEBUG] [LOCAL ] RYN: Loaded 45908 existing records from primary storage. [2025-10-03T21:20:26.387855] [INFO ] [MAIN ] RYN: Loaded 45908 existing records. [2025-10-03T21:20:26.399483] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-03T21:20:26.585923] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:26.586168] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-03T21:20:26.586240] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-03T21:20:26.586503] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-03T21:20:26.586573] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-03T21:20:26.988953] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:27.048073] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:20:27.190732] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-03T21:20:27.587931] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T21:20:27.990692] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-03T21:20:28.790635] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-03T21:20:28.980482] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T21:20:29.131261] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T21:20:29.590746] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-03T21:20:30.107327] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T21:20:30.390693] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-03T21:20:30.692474] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:20:30.694546] [INFO ] [REMOTE ] RYAM: Full fetch complete (49070 records). [2025-10-03T21:20:30.694705] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-03T21:20:31.110473] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-03T21:20:31.110582] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-03T21:20:31.111518] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-03T21:20:31.111597] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-03T21:20:31.112810] [DEBUG] [LOCAL ] RYAM: Trimmed 49070 records to 35553 (keeping 200 days of data) [2025-10-03T21:20:31.197881] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-03T21:20:31.336344] [DEBUG] [LOCAL ] RYAM: Primary data saved (35553 records). [2025-10-03T21:20:31.336494] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-03T21:20:31.336603] [INFO ] [MAIN ] Update Progress: 1851/2370 symbols completed. RYAM took 29.0s. Estimated remaining: 1h 13m 2s. Rate: 7.1 symbols/min [2025-10-03T21:20:31.519021] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:31.528164] [DEBUG] [LOCAL ] RZB: Loaded 6232 existing records from primary storage. [2025-10-03T21:20:31.528351] [INFO ] [MAIN ] RZB: Loaded 6232 existing records. [2025-10-03T21:20:31.727073] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:31.727335] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-03T21:20:31.727388] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-03T21:20:31.727597] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-03T21:20:31.727810] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-03T21:20:31.936475] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T21:20:31.999849] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-03T21:20:32.155307] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:32.681972] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:20:32.790703] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-03T21:20:33.549722] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T21:20:33.590632] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-03T21:20:33.992431] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T21:20:34.390703] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-03T21:20:34.425930] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T21:20:35.190724] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-03T21:20:35.879674] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T21:20:35.990701] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-03T21:20:36.071849] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T21:20:36.643074] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T21:20:36.790697] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-03T21:20:37.590674] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-03T21:20:38.099128] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T21:20:38.337165] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T21:20:38.338981] [INFO ] [REMOTE ] RYI: Full fetch complete (32374 records). [2025-10-03T21:20:38.339105] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-03T21:20:38.398488] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-03T21:20:38.742663] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-03T21:20:38.742777] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-03T21:20:38.743509] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-03T21:20:38.743568] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-03T21:20:38.744425] [DEBUG] [LOCAL ] RYI: Trimmed 32374 records to 21847 (keeping 200 days of data) [2025-10-03T21:20:38.888229] [DEBUG] [LOCAL ] RYI: Primary data saved (21847 records). [2025-10-03T21:20:38.888416] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-03T21:20:38.888603] [INFO ] [MAIN ] Update Progress: 1852/2370 symbols completed. RYI took 26.2s. Estimated remaining: 1h 12m 53s. Rate: 7.1 symbols/min [2025-10-03T21:20:39.066599] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:39.076097] [DEBUG] [LOCAL ] RZC: Loaded 6820 existing records from primary storage. [2025-10-03T21:20:39.076340] [INFO ] [MAIN ] RZC: Loaded 6820 existing records. [2025-10-03T21:20:39.195805] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-03T21:20:39.276879] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:39.277082] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-03T21:20:39.277129] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-03T21:20:39.277316] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-03T21:20:39.277382] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-03T21:20:39.682165] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:39.927351] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:20:39.990717] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-03T21:20:40.790674] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-03T21:20:40.806149] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T21:20:40.861097] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T21:20:41.590671] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-03T21:20:42.172892] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T21:20:42.390742] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-03T21:20:43.071356] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T21:20:43.190679] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-03T21:20:43.283700] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:20:43.967784] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T21:20:43.990698] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-03T21:20:44.686979] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T21:20:44.790728] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-03T21:20:45.590715] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-03T21:20:46.390733] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-03T21:20:46.452058] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T21:20:46.486144] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T21:20:47.139560] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T21:20:47.190706] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-03T21:20:47.810191] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T21:20:47.990712] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-03T21:20:48.572873] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T21:20:48.790722] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-03T21:20:49.450138] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T21:20:49.590673] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-03T21:20:50.310247] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T21:20:50.390686] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-03T21:20:51.116866] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T21:20:51.190668] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-03T21:20:51.775895] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T21:20:51.990718] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-03T21:20:52.790672] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-03T21:20:53.595258] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-03T21:20:53.623493] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T21:20:53.751728] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T21:20:54.390700] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-03T21:20:54.994276] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T21:20:55.190699] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-03T21:20:55.277806] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T21:20:55.990690] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-03T21:20:56.790669] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-03T21:20:56.925485] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T21:20:57.151284] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T21:20:57.157487] [INFO ] [REMOTE ] RYAN: Full fetch complete (64052 records). [2025-10-03T21:20:57.157713] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-03T21:20:57.485066] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T21:20:57.606660] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-03T21:20:57.603161] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-03T21:20:57.607768] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-03T21:20:57.609494] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-03T21:20:57.609783] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-03T21:20:57.611670] [DEBUG] [LOCAL ] RYAN: Trimmed 64052 records to 45175 (keeping 200 days of data) [2025-10-03T21:20:57.908151] [DEBUG] [LOCAL ] RYAN: Primary data saved (45175 records). [2025-10-03T21:20:57.908299] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-03T21:20:57.908444] [INFO ] [MAIN ] Update Progress: 1853/2370 symbols completed. RYAN took 47.1s. Estimated remaining: 1h 12m 47s. Rate: 7.1 symbols/min [2025-10-03T21:20:58.090704] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:58.147081] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T21:20:58.149406] [INFO ] [REMOTE ] RZC: Full fetch complete (9790 records). [2025-10-03T21:20:58.149305] [DEBUG] [LOCAL ] S: Loaded 53922 existing records from primary storage. [2025-10-03T21:20:58.149562] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-03T21:20:58.149939] [INFO ] [MAIN ] S: Loaded 53922 existing records. [2025-10-03T21:20:58.403811] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-03T21:20:58.556360] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:58.574189] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-03T21:20:58.576151] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-03T21:20:58.651942] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-03T21:20:58.688284] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-03T21:20:58.983001] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-03T21:20:58.983131] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-03T21:20:59.000448] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-03T21:20:59.020212] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-03T21:20:59.103595] [DEBUG] [LOCAL ] RZC: Trimmed 9790 records to 6845 (keeping 200 days of data) [2025-10-03T21:20:59.193093] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-03T21:20:59.280572] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:20:59.289680] [DEBUG] [LOCAL ] RZC: Primary data saved (6845 records). [2025-10-03T21:20:59.289791] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-03T21:20:59.289893] [INFO ] [MAIN ] Update Progress: 1854/2370 symbols completed. RZC took 20.4s. Estimated remaining: 1h 12m 37s. Rate: 7.1 symbols/min [2025-10-03T21:20:59.497496] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:20:59.543521] [DEBUG] [LOCAL ] SA: Loaded 43787 existing records from primary storage. [2025-10-03T21:20:59.543913] [INFO ] [MAIN ] SA: Loaded 43787 existing records. [2025-10-03T21:20:59.738332] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:20:59.738590] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-03T21:20:59.738677] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-03T21:20:59.738977] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-03T21:20:59.739036] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-03T21:20:59.911204] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T21:20:59.999439] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-03T21:21:00.190724] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:00.217684] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:21:00.790717] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-03T21:21:01.203288] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T21:21:01.590687] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-03T21:21:02.390632] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-03T21:21:02.525663] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-03T21:21:02.730870] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T21:21:02.801266] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T21:21:02.802156] [INFO ] [REMOTE ] RZB: Full fetch complete (8643 records). [2025-10-03T21:21:02.802230] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-03T21:21:03.203524] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-03T21:21:03.213678] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-03T21:21:03.213896] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-03T21:21:03.214183] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-03T21:21:03.214270] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-03T21:21:03.216143] [DEBUG] [LOCAL ] RZB: Trimmed 8643 records to 6252 (keeping 200 days of data) [2025-10-03T21:21:03.259487] [DEBUG] [LOCAL ] RZB: Primary data saved (6252 records). [2025-10-03T21:21:03.259688] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-03T21:21:03.259798] [INFO ] [MAIN ] Update Progress: 1855/2370 symbols completed. RZB took 31.9s. Estimated remaining: 1h 12m 27s. Rate: 7.1 symbols/min [2025-10-03T21:21:03.452242] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:03.464029] [DEBUG] [LOCAL ] SABA: Loaded 9335 existing records from primary storage. [2025-10-03T21:21:03.464325] [INFO ] [MAIN ] SABA: Loaded 9335 existing records. [2025-10-03T21:21:03.660091] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:03.660332] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-03T21:21:03.660383] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-03T21:21:03.660575] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-03T21:21:03.660635] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-03T21:21:03.997945] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-03T21:21:04.045939] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:04.790770] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-03T21:21:05.257468] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T21:21:05.590772] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-03T21:21:05.641758] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T21:21:05.701841] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T21:21:06.390720] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-03T21:21:07.190701] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-03T21:21:07.528262] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T21:21:07.965447] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T21:21:07.990617] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-03T21:21:08.270971] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T21:21:08.790694] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-03T21:21:09.466949] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T21:21:09.590688] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-03T21:21:10.366480] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T21:21:10.392021] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-03T21:21:10.397310] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T21:21:11.190690] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-03T21:21:11.200797] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T21:21:11.990744] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-03T21:21:12.790699] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-03T21:21:12.824845] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T21:21:13.193069] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T21:21:13.590744] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-03T21:21:14.390639] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-03T21:21:14.530405] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T21:21:15.117550] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T21:21:15.194303] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-03T21:21:15.199639] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:21:15.990728] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-03T21:21:16.524290] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T21:21:16.526753] [INFO ] [REMOTE ] RYN: Full fetch complete (65003 records). [2025-10-03T21:21:16.526888] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-03T21:21:16.795892] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-03T21:21:16.966821] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-03T21:21:16.966937] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-03T21:21:16.968237] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-03T21:21:16.968307] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-03T21:21:16.969871] [DEBUG] [LOCAL ] RYN: Trimmed 65003 records to 46225 (keeping 200 days of data) [2025-10-03T21:21:17.272712] [DEBUG] [LOCAL ] RYN: Primary data saved (46225 records). [2025-10-03T21:21:17.272923] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-03T21:21:17.273080] [INFO ] [MAIN ] Update Progress: 1856/2370 symbols completed. RYN took 51.1s. Estimated remaining: 1h 12m 20s. Rate: 7.1 symbols/min [2025-10-03T21:21:17.497460] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:17.539573] [DEBUG] [LOCAL ] SAFE: Loaded 30374 existing records from primary storage. [2025-10-03T21:21:17.539896] [INFO ] [MAIN ] SAFE: Loaded 30374 existing records. [2025-10-03T21:21:17.604773] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-03T21:21:17.794715] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:21:17.791799] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:17.805089] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-03T21:21:17.805373] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-03T21:21:17.806328] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-03T21:21:17.806392] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-03T21:21:18.189732] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:18.390733] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-03T21:21:18.452738] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T21:21:18.721080] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T21:21:19.190740] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-03T21:21:19.955897] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T21:21:19.956216] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T21:21:19.990613] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-03T21:21:20.790725] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-03T21:21:21.491474] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T21:21:21.590701] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-03T21:21:21.606550] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T21:21:22.390731] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-03T21:21:22.719458] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:21:23.190727] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-03T21:21:23.201454] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T21:21:23.990727] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-03T21:21:24.172554] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T21:21:24.790739] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-03T21:21:25.400685] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:21:25.402753] [INFO ] [REMOTE ] SABA: Full fetch complete (15519 records). [2025-10-03T21:21:25.402832] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-03T21:21:25.601043] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-03T21:21:25.676875] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:21:25.855864] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-03T21:21:25.855951] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-03T21:21:25.856329] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-03T21:21:25.856373] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-03T21:21:25.856984] [DEBUG] [LOCAL ] SABA: Trimmed 15519 records to 9395 (keeping 200 days of data) [2025-10-03T21:21:25.916269] [DEBUG] [LOCAL ] SABA: Primary data saved (9395 records). [2025-10-03T21:21:25.916452] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-03T21:21:25.916559] [INFO ] [MAIN ] Update Progress: 1857/2370 symbols completed. SABA took 22.7s. Estimated remaining: 1h 12m 12s. Rate: 7.1 symbols/min [2025-10-03T21:21:26.105254] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:26.127350] [DEBUG] [LOCAL ] SAH: Loaded 22028 existing records from primary storage. [2025-10-03T21:21:26.127634] [INFO ] [MAIN ] SAH: Loaded 22028 existing records. [2025-10-03T21:21:26.322307] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:26.322547] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-03T21:21:26.322595] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-03T21:21:26.322853] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-03T21:21:26.322914] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-03T21:21:26.402678] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-03T21:21:26.788260] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:27.190715] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-03T21:21:27.855906] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-03T21:21:27.990699] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-03T21:21:28.208223] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T21:21:28.591585] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T21:21:28.790702] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-03T21:21:28.813061] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T21:21:29.590760] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-03T21:21:30.390614] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-03T21:21:30.509557] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T21:21:30.830853] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T21:21:31.190694] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-03T21:21:31.468230] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T21:21:31.471001] [INFO ] [REMOTE ] SA: Full fetch complete (62612 records). [2025-10-03T21:21:31.471120] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-03T21:21:31.941662] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-03T21:21:31.941761] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-03T21:21:31.942812] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-03T21:21:31.942885] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-03T21:21:31.944951] [DEBUG] [LOCAL ] SA: Trimmed 62612 records to 44164 (keeping 200 days of data) [2025-10-03T21:21:31.994152] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-03T21:21:32.218688] [DEBUG] [LOCAL ] SA: Primary data saved (44164 records). [2025-10-03T21:21:32.218840] [INFO ] [MAIN ] SA: Full history saved. [2025-10-03T21:21:32.218984] [INFO ] [MAIN ] Update Progress: 1858/2370 symbols completed. SA took 32.9s. Estimated remaining: 1h 12m 3s. Rate: 7.1 symbols/min [2025-10-03T21:21:32.399376] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:32.399637] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-03T21:21:32.399888] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-03T21:21:32.400087] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-03T21:21:32.400617] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-03T21:21:32.400813] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-03T21:21:32.401020] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-03T21:21:32.545781] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T21:21:32.813614] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-03T21:21:32.820467] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:33.590671] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-03T21:21:34.263375] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T21:21:34.291926] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:21:34.386963] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T21:21:34.398231] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-03T21:21:35.190677] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-03T21:21:35.542919] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T21:21:35.659928] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T21:21:35.990726] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-03T21:21:36.790731] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-03T21:21:37.040548] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T21:21:37.590688] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-03T21:21:37.857813] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-03T21:21:38.390709] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-03T21:21:38.795685] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-03T21:21:38.950226] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T21:21:39.190703] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-03T21:21:39.990627] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-03T21:21:40.343395] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T21:21:40.347705] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:21:40.790721] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-03T21:21:41.113469] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T21:21:41.590697] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-03T21:21:42.390787] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-03T21:21:42.723328] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-03T21:21:42.974336] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T21:21:43.190776] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-03T21:21:43.990769] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-03T21:21:44.790634] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-03T21:21:45.149335] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-03T21:21:45.175388] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T21:21:45.358371] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-03T21:21:45.590689] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-03T21:21:46.390629] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-03T21:21:46.770352] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T21:21:47.190694] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-03T21:21:47.522442] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T21:21:47.754602] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T21:21:47.990756] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-03T21:21:48.790953] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-03T21:21:49.267492] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T21:21:49.590692] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-03T21:21:50.094213] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T21:21:50.390670] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-03T21:21:50.694883] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T21:21:51.128868] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T21:21:51.131330] [INFO ] [REMOTE ] SAFE: Full fetch complete (44994 records). [2025-10-03T21:21:51.131521] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-03T21:21:51.195842] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-03T21:21:51.543711] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-03T21:21:51.543818] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-03T21:21:51.545067] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-03T21:21:51.545132] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-03T21:21:51.546309] [DEBUG] [LOCAL ] SAFE: Trimmed 44994 records to 30539 (keeping 200 days of data) [2025-10-03T21:21:51.613586] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T21:21:51.745612] [DEBUG] [LOCAL ] SAFE: Primary data saved (30539 records). [2025-10-03T21:21:51.745844] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-03T21:21:51.746012] [INFO ] [MAIN ] Update Progress: 1859/2370 symbols completed. SAFE took 34.5s. Estimated remaining: 1h 11m 58s. Rate: 7.1 symbols/min [2025-10-03T21:21:51.928507] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:51.956461] [DEBUG] [LOCAL ] SAM: Loaded 21580 existing records from primary storage. [2025-10-03T21:21:51.956860] [INFO ] [MAIN ] SAM: Loaded 21580 existing records. [2025-10-03T21:21:51.995939] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-03T21:21:52.146736] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:52.147069] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-03T21:21:52.147124] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-03T21:21:52.147426] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-03T21:21:52.147486] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-03T21:21:52.508827] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:52.790695] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-03T21:21:53.098674] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T21:21:53.590730] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-03T21:21:53.859278] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-03T21:21:53.860012] [INFO ] [REMOTE ] SAJ: Full fetch complete (928 records). [2025-10-03T21:21:53.860082] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-03T21:21:54.045964] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-03T21:21:54.046188] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:21:54.046270] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:21:54.046343] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-03T21:21:54.046441] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-03T21:21:54.046500] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-03T21:21:54.046565] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-03T21:21:54.046704] [INFO ] [MAIN ] Update Progress: 1860/2370 symbols completed. SAJ took 21.8s. Estimated remaining: 1h 11m 47s. Rate: 7.1 symbols/min [2025-10-03T21:21:54.225621] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:54.285062] [DEBUG] [LOCAL ] SAN: Loaded 53375 existing records from primary storage. [2025-10-03T21:21:54.286188] [INFO ] [MAIN ] SAN: Loaded 53375 existing records. [2025-10-03T21:21:54.397533] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-03T21:21:54.491465] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:54.491872] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-03T21:21:54.491951] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-03T21:21:54.492305] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-03T21:21:54.492395] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-03T21:21:54.664743] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T21:21:54.694534] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-03T21:21:54.707881] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-03T21:21:55.168473] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:55.196350] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-03T21:21:55.337337] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T21:21:55.403481] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-03T21:21:55.403583] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-03T21:21:55.405296] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-03T21:21:55.405376] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-03T21:21:55.407570] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 54312 (keeping 200 days of data) [2025-10-03T21:21:55.767324] [DEBUG] [LOCAL ] S: Primary data saved (54312 records). [2025-10-03T21:21:55.767545] [INFO ] [MAIN ] S: Full history saved. [2025-10-03T21:21:55.767706] [INFO ] [MAIN ] Update Progress: 1861/2370 symbols completed. S took 57.9s. Estimated remaining: 1h 11m 37s. Rate: 7.1 symbols/min [2025-10-03T21:21:55.952201] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:21:55.990725] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-03T21:21:56.015081] [DEBUG] [LOCAL ] SAND: Loaded 52192 existing records from primary storage. [2025-10-03T21:21:56.015612] [INFO ] [MAIN ] SAND: Loaded 52192 existing records. [2025-10-03T21:21:56.220980] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:21:56.221468] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-03T21:21:56.221555] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-03T21:21:56.222285] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-03T21:21:56.222437] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-03T21:21:56.346063] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T21:21:56.630748] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:21:56.790636] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-03T21:21:57.192346] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T21:21:57.590714] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-03T21:21:58.390735] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-03T21:21:58.488316] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:21:58.691716] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T21:21:59.190732] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-03T21:21:59.507931] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:21:59.990757] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-03T21:22:00.790822] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-03T21:22:01.037759] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T21:22:01.116486] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T21:22:01.538396] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T21:22:01.590706] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-03T21:22:02.390686] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-03T21:22:02.814810] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T21:22:03.190720] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-03T21:22:03.990629] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-03T21:22:04.105136] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T21:22:04.258510] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T21:22:04.790752] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-03T21:22:05.590671] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-03T21:22:05.848493] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T21:22:05.928434] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T21:22:06.390724] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-03T21:22:07.197909] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-03T21:22:07.219919] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:22:07.667588] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T21:22:07.769090] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T21:22:07.770560] [INFO ] [REMOTE ] SAH: Full fetch complete (30564 records). [2025-10-03T21:22:07.770635] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-03T21:22:07.995858] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-03T21:22:08.193183] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-03T21:22:08.193274] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-03T21:22:08.193989] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-03T21:22:08.194066] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-03T21:22:08.197267] [DEBUG] [LOCAL ] SAH: Trimmed 30564 records to 22154 (keeping 200 days of data) [2025-10-03T21:22:08.347584] [DEBUG] [LOCAL ] SAH: Primary data saved (22154 records). [2025-10-03T21:22:08.347781] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-03T21:22:08.347928] [INFO ] [MAIN ] Update Progress: 1862/2370 symbols completed. SAH took 42.4s. Estimated remaining: 1h 11m 30s. Rate: 7.1 symbols/min [2025-10-03T21:22:08.548842] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:22:08.607521] [DEBUG] [LOCAL ] SAP: Loaded 50362 existing records from primary storage. [2025-10-03T21:22:08.607998] [INFO ] [MAIN ] SAP: Loaded 50362 existing records. [2025-10-03T21:22:08.793414] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-03T21:22:08.820712] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:22:08.820986] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-03T21:22:08.821068] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-03T21:22:08.822610] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-03T21:22:08.822696] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-03T21:22:09.223528] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:22:09.590636] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-03T21:22:09.851925] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T21:22:09.956432] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T21:22:10.390697] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-03T21:22:11.190693] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-03T21:22:11.404139] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:22:11.990717] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-03T21:22:12.358130] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T21:22:12.790692] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-03T21:22:13.004211] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T21:22:13.590690] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-03T21:22:13.821097] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T21:22:13.896492] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T21:22:14.390743] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-03T21:22:15.190687] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-03T21:22:15.249376] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T21:22:15.251054] [INFO ] [REMOTE ] SAM: Full fetch complete (30749 records). [2025-10-03T21:22:15.251171] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-03T21:22:15.661578] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T21:22:15.702517] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-03T21:22:15.702869] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-03T21:22:15.703621] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-03T21:22:15.703856] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-03T21:22:15.704969] [DEBUG] [LOCAL ] SAM: Trimmed 30749 records to 21716 (keeping 200 days of data) [2025-10-03T21:22:15.853227] [DEBUG] [LOCAL ] SAM: Primary data saved (21716 records). [2025-10-03T21:22:15.853668] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-03T21:22:15.853788] [INFO ] [MAIN ] Update Progress: 1863/2370 symbols completed. SAM took 24.1s. Estimated remaining: 1h 11m 21s. Rate: 7.1 symbols/min [2025-10-03T21:22:16.006347] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-03T21:22:16.041710] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:22:16.061073] [DEBUG] [LOCAL ] SAR: Loaded 16340 existing records from primary storage. [2025-10-03T21:22:16.061333] [INFO ] [MAIN ] SAR: Loaded 16340 existing records. [2025-10-03T21:22:16.246866] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:22:16.247178] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-03T21:22:16.247226] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-03T21:22:16.247771] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-03T21:22:16.247830] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-03T21:22:16.636597] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:22:16.790702] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-03T21:22:17.098353] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T21:22:17.568853] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T21:22:17.590683] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-03T21:22:18.062745] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T21:22:18.390735] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-03T21:22:18.491504] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T21:22:19.190753] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-03T21:22:19.990711] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-03T21:22:20.213802] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T21:22:20.258743] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T21:22:20.790727] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-03T21:22:21.590705] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-03T21:22:21.771268] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T21:22:22.390718] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-03T21:22:22.521327] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T21:22:23.195843] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-03T21:22:23.217968] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:22:23.990767] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-03T21:22:24.118972] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T21:22:24.790695] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-03T21:22:25.231382] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T21:22:25.590673] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-03T21:22:25.855744] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T21:22:25.985812] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T21:22:26.390691] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-03T21:22:27.190631] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-03T21:22:27.536812] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T21:22:27.990628] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-03T21:22:28.170108] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:22:28.790716] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-03T21:22:28.982985] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T21:22:29.111034] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T21:22:29.590674] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-03T21:22:30.390688] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-03T21:22:30.774413] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T21:22:31.190695] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-03T21:22:31.502281] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T21:22:31.990734] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-03T21:22:32.351301] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T21:22:32.790628] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-03T21:22:32.993063] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T21:22:33.097981] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:22:33.590719] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-03T21:22:34.185918] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T21:22:34.188624] [INFO ] [REMOTE ] SAND: Full fetch complete (74457 records). [2025-10-03T21:22:34.188771] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-03T21:22:34.425058] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-03T21:22:34.683626] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-03T21:22:34.683755] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-03T21:22:34.685117] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-03T21:22:34.685206] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-03T21:22:34.687806] [DEBUG] [LOCAL ] SAND: Trimmed 74457 records to 52561 (keeping 200 days of data) [2025-10-03T21:22:35.026487] [DEBUG] [LOCAL ] SAND: Primary data saved (52561 records). [2025-10-03T21:22:35.026666] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-03T21:22:35.027890] [INFO ] [MAIN ] Update Progress: 1864/2370 symbols completed. SAND took 39.3s. Estimated remaining: 1h 11m 16s. Rate: 7.1 symbols/min [2025-10-03T21:22:35.171136] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T21:22:35.193383] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-03T21:22:35.231296] [INFO ] [REMOTE ] SAN: Full fetch complete (76282 records). [2025-10-03T21:22:35.230053] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:22:35.231598] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-03T21:22:35.610986] [DEBUG] [LOCAL ] SARO: Loaded 48990 existing records from primary storage. [2025-10-03T21:22:35.663174] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T21:22:35.656628] [INFO ] [MAIN ] SARO: Loaded 48990 existing records. [2025-10-03T21:22:35.764365] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-03T21:22:35.786172] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-03T21:22:35.818289] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-03T21:22:35.838431] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-03T21:22:35.942683] [DEBUG] [LOCAL ] SAN: Trimmed 76282 records to 53758 (keeping 200 days of data) [2025-10-03T21:22:35.948413] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:22:35.948701] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-03T21:22:35.948787] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-03T21:22:35.949328] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-03T21:22:35.949418] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-03T21:22:36.045541] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-03T21:22:36.526502] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:22:36.683184] [DEBUG] [LOCAL ] SAN: Primary data saved (53758 records). [2025-10-03T21:22:36.683349] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-03T21:22:36.683457] [INFO ] [MAIN ] Update Progress: 1865/2370 symbols completed. SAN took 42.6s. Estimated remaining: 1h 11m 5s. Rate: 7.1 symbols/min [2025-10-03T21:22:36.798201] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-03T21:22:36.892176] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:22:36.892826] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-03T21:22:36.892881] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-03T21:22:36.892999] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-03T21:22:36.893043] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-03T21:22:36.893088] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-03T21:22:36.893123] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-03T21:22:37.177836] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:22:37.333490] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:22:37.363374] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T21:22:37.590737] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-03T21:22:38.347995] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T21:22:38.390747] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-03T21:22:38.596159] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T21:22:39.190766] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-03T21:22:39.699630] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T21:22:39.990673] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-03T21:22:40.020711] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T21:22:40.354136] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T21:22:40.790720] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-03T21:22:41.128877] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T21:22:41.590746] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-03T21:22:42.390737] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-03T21:22:42.818219] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T21:22:43.190683] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-03T21:22:43.610687] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T21:22:43.705533] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T21:22:43.990700] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-03T21:22:44.790699] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-03T21:22:45.379754] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T21:22:45.590679] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-03T21:22:46.390636] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-03T21:22:46.717849] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T21:22:46.733754] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T21:22:46.763245] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T21:22:47.190691] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-03T21:22:47.990700] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-03T21:22:48.790683] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-03T21:22:48.800161] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T21:22:48.802996] [INFO ] [REMOTE ] SAP: Full fetch complete (71899 records). [2025-10-03T21:22:48.803105] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-03T21:22:49.214710] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T21:22:49.257153] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-03T21:22:49.257297] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-03T21:22:49.258458] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-03T21:22:49.258528] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-03T21:22:49.260072] [DEBUG] [LOCAL ] SAP: Trimmed 71899 records to 50718 (keeping 200 days of data) [2025-10-03T21:22:49.520797] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T21:22:49.591805] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-03T21:22:49.633758] [DEBUG] [LOCAL ] SAP: Primary data saved (50718 records). [2025-10-03T21:22:49.634015] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-03T21:22:49.634159] [INFO ] [MAIN ] Update Progress: 1866/2370 symbols completed. SAP took 41.3s. Estimated remaining: 1h 10m 58s. Rate: 7.1 symbols/min [2025-10-03T21:22:49.819026] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:22:49.819216] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-03T21:22:49.819254] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-03T21:22:49.819422] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-03T21:22:49.819472] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-03T21:22:49.819514] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-03T21:22:49.819545] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-03T21:22:49.984156] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-03T21:22:50.215967] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:22:50.390692] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-03T21:22:50.941638] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T21:22:51.190689] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-03T21:22:51.990700] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-03T21:22:52.790694] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-03T21:22:53.590700] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-03T21:23:05.254274] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (13.26 seconds). [2025-10-03T21:23:05.255448] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-03T21:23:06.852293] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:23:06.853995] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-03T21:23:07.216098] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T21:23:07.217497] [INFO ] [REMOTE ] SAT: Full fetch complete (1584 records). [2025-10-03T21:23:07.217760] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-03T21:23:07.252356] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (16.06 seconds). [2025-10-03T21:23:07.345923] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-03T21:23:07.360953] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (13.77 seconds). [2025-10-03T21:23:07.405458] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-03T21:23:07.515497] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-03T21:23:07.515804] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:23:07.515899] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:23:07.515996] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-03T21:23:07.516095] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-03T21:23:07.516158] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-03T21:23:07.516260] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-03T21:23:07.516375] [INFO ] [MAIN ] Update Progress: 1867/2370 symbols completed. SAT took 30.8s. Estimated remaining: 1h 10m 52s. Rate: 7.1 symbols/min [2025-10-03T21:23:07.748783] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:07.748968] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-03T21:23:07.749008] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-03T21:23:07.749125] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-03T21:23:07.749168] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-03T21:23:07.749212] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-03T21:23:07.749246] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-03T21:23:07.853636] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T21:23:07.867186] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-03T21:23:08.153454] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:08.153800] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-03T21:23:08.162552] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (15.37 seconds). [2025-10-03T21:23:08.164196] [INFO ] [REMOTE ] SAR: Full fetch complete (22818 records). [2025-10-03T21:23:08.164272] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-03T21:23:08.265386] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-03T21:23:08.279111] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-03T21:23:08.581474] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-03T21:23:08.581565] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-03T21:23:08.582095] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-03T21:23:08.582158] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-03T21:23:08.583065] [DEBUG] [LOCAL ] SAR: Trimmed 22818 records to 16503 (keeping 200 days of data) [2025-10-03T21:23:08.660046] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T21:23:08.661980] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-03T21:23:08.696750] [DEBUG] [LOCAL ] SAR: Primary data saved (16503 records). [2025-10-03T21:23:08.696909] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-03T21:23:08.696998] [INFO ] [MAIN ] Update Progress: 1868/2370 symbols completed. SAR took 52.8s. Estimated remaining: 1h 10m 42s. Rate: 7.1 symbols/min [2025-10-03T21:23:08.891409] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:08.931684] [DEBUG] [LOCAL ] SB: Loaded 33455 existing records from primary storage. [2025-10-03T21:23:08.931830] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-03T21:23:08.933199] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-03T21:23:08.933333] [INFO ] [MAIN ] SB: Loaded 33455 existing records. [2025-10-03T21:23:09.102363] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T21:23:09.123574] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-03T21:23:09.146525] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:09.146977] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-03T21:23:09.147146] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-03T21:23:09.147492] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-03T21:23:09.147564] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-03T21:23:09.335749] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T21:23:09.420850] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-03T21:23:09.469673] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T21:23:09.535811] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-03T21:23:09.603711] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T21:23:09.615235] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-03T21:23:09.630903] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:09.631336] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-03T21:23:09.896852] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-03T21:23:09.898224] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-03T21:23:09.900523] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-03T21:23:09.902792] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-03T21:23:10.314407] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T21:23:10.315692] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-03T21:23:10.319071] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-03T21:23:10.320168] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-03T21:23:10.652564] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T21:23:10.653703] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-03T21:23:10.826299] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T21:23:10.828210] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-03T21:23:10.969929] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-03T21:23:10.970723] [INFO ] [REMOTE ] SAY: Full fetch complete (1404 records). [2025-10-03T21:23:10.970797] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-03T21:23:11.173096] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-03T21:23:11.173398] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:23:11.173612] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:23:11.173924] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-03T21:23:11.174042] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-03T21:23:11.182602] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-03T21:23:11.188168] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-03T21:23:11.195115] [INFO ] [MAIN ] Update Progress: 1869/2370 symbols completed. SAY took 21.6s. Estimated remaining: 1h 10m 32s. Rate: 7.1 symbols/min [2025-10-03T21:23:11.281161] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T21:23:11.368787] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-03T21:23:11.366777] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T21:23:11.372122] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-03T21:23:11.374759] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T21:23:11.470896] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:11.471106] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-03T21:23:11.471151] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-03T21:23:11.471289] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-03T21:23:11.471345] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-03T21:23:11.471394] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-03T21:23:11.471428] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-03T21:23:11.808837] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T21:23:11.895928] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:11.990907] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-03T21:23:12.790701] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-03T21:23:12.920202] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T21:23:13.187960] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-03T21:23:13.590731] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-03T21:23:13.942211] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T21:23:14.135375] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T21:23:14.390720] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-03T21:23:15.190696] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-03T21:23:15.990693] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-03T21:23:16.045924] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T21:23:16.204736] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:23:16.205069] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-03T21:23:16.205162] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:23:16.205211] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-03T21:23:16.205246] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:23:16.205310] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-03T21:23:16.205377] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-03T21:23:16.205413] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-03T21:23:16.205453] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-03T21:23:16.205524] [INFO ] [MAIN ] Update Progress: 1870/2370 symbols completed. SBDS took 5.0s. Estimated remaining: 1h 10m 22s. Rate: 7.1 symbols/min [2025-10-03T21:23:16.389094] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:16.434609] [DEBUG] [LOCAL ] SBH: Loaded 50147 existing records from primary storage. [2025-10-03T21:23:16.434966] [INFO ] [MAIN ] SBH: Loaded 50147 existing records. [2025-10-03T21:23:16.638092] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:16.638489] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-03T21:23:16.638581] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-03T21:23:16.639966] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-03T21:23:16.640038] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-03T21:23:16.795182] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-03T21:23:16.840571] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T21:23:17.068596] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:17.590703] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-03T21:23:17.929840] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T21:23:18.390730] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-03T21:23:18.469160] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T21:23:18.666131] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-03T21:23:18.666822] [INFO ] [REMOTE ] SAZ: Full fetch complete (1831 records). [2025-10-03T21:23:18.666920] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-03T21:23:18.852042] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T21:23:18.852255] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:23:18.852377] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:23:18.852455] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-03T21:23:18.852524] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-03T21:23:18.852562] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-03T21:23:18.852603] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-03T21:23:18.852686] [INFO ] [MAIN ] Update Progress: 1871/2370 symbols completed. SAZ took 11.3s. Estimated remaining: 1h 10m 12s. Rate: 7.1 symbols/min [2025-10-03T21:23:19.028448] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:19.037828] [DEBUG] [LOCAL ] SBI: Loaded 7614 existing records from primary storage. [2025-10-03T21:23:19.038044] [INFO ] [MAIN ] SBI: Loaded 7614 existing records. [2025-10-03T21:23:19.200342] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-03T21:23:19.223956] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:19.224994] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-03T21:23:19.225046] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-03T21:23:19.225253] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-03T21:23:19.225313] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-03T21:23:19.601706] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:19.990691] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-03T21:23:20.714064] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T21:23:20.790720] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-03T21:23:20.839551] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T21:23:21.590750] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-03T21:23:22.251774] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T21:23:22.398532] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-03T21:23:22.404094] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:23:23.014215] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T21:23:23.190712] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-03T21:23:23.990741] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-03T21:23:24.790713] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-03T21:23:24.859858] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T21:23:25.431624] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T21:23:25.575393] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T21:23:25.590618] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-03T21:23:26.376622] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T21:23:26.390686] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-03T21:23:27.190737] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-03T21:23:27.736143] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T21:23:27.990708] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-03T21:23:28.568821] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T21:23:28.612167] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T21:23:28.790730] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-03T21:23:29.590730] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-03T21:23:30.014238] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:23:30.390709] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-03T21:23:30.481086] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T21:23:31.190722] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-03T21:23:31.508526] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T21:23:31.897620] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T21:23:31.990698] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-03T21:23:32.789664] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T21:23:32.791770] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-03T21:23:33.590730] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-03T21:23:34.098764] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T21:23:34.390726] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-03T21:23:35.190727] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-03T21:23:35.372835] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T21:23:35.659224] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:23:35.990668] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-03T21:23:36.151430] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T21:23:36.154493] [INFO ] [REMOTE ] SARO: Full fetch complete (69010 records). [2025-10-03T21:23:36.154686] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-03T21:23:36.607936] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-03T21:23:36.608043] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-03T21:23:36.609427] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-03T21:23:36.609520] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-03T21:23:36.611731] [DEBUG] [LOCAL ] SARO: Trimmed 69010 records to 49327 (keeping 200 days of data) [2025-10-03T21:23:36.797213] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-03T21:23:36.921967] [DEBUG] [LOCAL ] SARO: Primary data saved (49327 records). [2025-10-03T21:23:36.922117] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-03T21:23:36.922822] [INFO ] [MAIN ] Update Progress: 1872/2370 symbols completed. SARO took 1m 2s. Estimated remaining: 1h 10m 6s. Rate: 7.1 symbols/min [2025-10-03T21:23:37.116964] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:37.130147] [DEBUG] [LOCAL ] SBR: Loaded 7447 existing records from primary storage. [2025-10-03T21:23:37.130394] [INFO ] [MAIN ] SBR: Loaded 7447 existing records. [2025-10-03T21:23:37.339372] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:37.339614] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-03T21:23:37.339696] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-03T21:23:37.339928] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-03T21:23:37.339989] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-03T21:23:37.594417] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-03T21:23:37.624346] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T21:23:37.666337] [INFO ] [REMOTE ] SB: Full fetch complete (50207 records). [2025-10-03T21:23:37.671960] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-03T21:23:37.852934] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:37.906134] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T21:23:38.236707] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-03T21:23:38.236858] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-03T21:23:38.238080] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-03T21:23:38.238162] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-03T21:23:38.239984] [DEBUG] [LOCAL ] SB: Trimmed 50207 records to 33642 (keeping 200 days of data) [2025-10-03T21:23:38.335776] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T21:23:38.405178] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-03T21:23:38.456587] [DEBUG] [LOCAL ] SB: Primary data saved (33642 records). [2025-10-03T21:23:38.456776] [INFO ] [MAIN ] SB: Full history saved. [2025-10-03T21:23:38.456893] [INFO ] [MAIN ] Update Progress: 1873/2370 symbols completed. SB took 29.8s. Estimated remaining: 1h 9m 56s. Rate: 7.1 symbols/min [2025-10-03T21:23:38.648064] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:38.699270] [DEBUG] [LOCAL ] SBS: Loaded 49841 existing records from primary storage. [2025-10-03T21:23:38.699724] [INFO ] [MAIN ] SBS: Loaded 49841 existing records. [2025-10-03T21:23:38.878372] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T21:23:38.903281] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:38.903456] [INFO ] [REMOTE ] SBI: Full fetch complete (10597 records). [2025-10-03T21:23:38.903747] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-03T21:23:38.904170] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-03T21:23:38.909735] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-03T21:23:38.993757] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-03T21:23:39.012074] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-03T21:23:39.191429] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-03T21:23:39.742199] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-03T21:23:39.741974] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:39.742584] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-03T21:23:39.742897] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-03T21:23:39.742961] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-03T21:23:39.743408] [DEBUG] [LOCAL ] SBI: Trimmed 10597 records to 7638 (keeping 200 days of data) [2025-10-03T21:23:39.790660] [DEBUG] [LOCAL ] SBI: Primary data saved (7638 records). [2025-10-03T21:23:39.790810] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-03T21:23:39.790898] [INFO ] [MAIN ] Update Progress: 1874/2370 symbols completed. SBI took 20.9s. Estimated remaining: 1h 9m 46s. Rate: 7.1 symbols/min [2025-10-03T21:23:39.998995] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-03T21:23:40.004442] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:40.024611] [DEBUG] [LOCAL ] SBSI: Loaded 14892 existing records from primary storage. [2025-10-03T21:23:40.025058] [INFO ] [MAIN ] SBSI: Loaded 14892 existing records. [2025-10-03T21:23:40.214162] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:40.221695] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-03T21:23:40.222159] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-03T21:23:40.221980] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T21:23:40.225242] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-03T21:23:40.225319] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-03T21:23:40.595849] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:23:40.790685] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-03T21:23:41.590689] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-03T21:23:41.648017] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T21:23:41.738752] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T21:23:42.390735] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-03T21:23:43.190638] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-03T21:23:43.253154] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:23:44.001078] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-03T21:23:44.012548] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T21:23:44.014982] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T21:23:44.790683] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-03T21:23:45.010067] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T21:23:45.544199] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T21:23:45.590711] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-03T21:23:46.390688] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-03T21:23:47.129023] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T21:23:47.190699] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-03T21:23:47.249217] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:23:47.990685] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-03T21:23:48.071732] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T21:23:48.790723] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-03T21:23:49.466636] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T21:23:49.590736] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-03T21:23:50.390713] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-03T21:23:50.526969] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T21:23:51.190722] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-03T21:23:51.269731] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T21:23:51.454262] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T21:23:51.952747] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T21:23:51.990617] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-03T21:23:52.709318] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T21:23:52.790708] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-03T21:23:53.590731] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-03T21:23:53.832136] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T21:23:54.390739] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-03T21:23:55.109513] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T21:23:55.190695] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-03T21:23:55.384469] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T21:23:55.810096] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T21:23:55.990709] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-03T21:23:56.590951] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T21:23:56.790708] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-03T21:23:57.590728] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-03T21:23:58.130107] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T21:23:58.137359] [INFO ] [REMOTE ] SBH: Full fetch complete (72834 records). [2025-10-03T21:23:58.137575] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-03T21:23:58.397444] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-03T21:23:58.548570] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-03T21:23:58.548703] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-03T21:23:58.550386] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-03T21:23:58.550458] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-03T21:23:58.553265] [DEBUG] [LOCAL ] SBH: Trimmed 72834 records to 50518 (keeping 200 days of data) [2025-10-03T21:23:58.887783] [DEBUG] [LOCAL ] SBH: Primary data saved (50518 records). [2025-10-03T21:23:58.888438] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-03T21:23:58.888594] [INFO ] [MAIN ] Update Progress: 1875/2370 symbols completed. SBH took 42.7s. Estimated remaining: 1h 9m 40s. Rate: 7.1 symbols/min [2025-10-03T21:23:59.094188] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:23:59.154906] [DEBUG] [LOCAL ] SBSW: Loaded 53424 existing records from primary storage. [2025-10-03T21:23:59.155385] [INFO ] [MAIN ] SBSW: Loaded 53424 existing records. [2025-10-03T21:23:59.197027] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-03T21:23:59.423182] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T21:23:59.492854] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T21:23:59.506294] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:23:59.511840] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-03T21:23:59.511933] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-03T21:23:59.512508] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-03T21:23:59.512900] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-03T21:24:00.005455] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-03T21:24:00.013489] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:00.364584] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T21:24:00.783774] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T21:24:00.790666] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-03T21:24:01.590730] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-03T21:24:01.791761] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T21:24:02.390761] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-03T21:24:03.190717] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-03T21:24:03.481344] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T21:24:03.817920] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T21:24:03.990639] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-03T21:24:04.225398] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T21:24:04.790685] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-03T21:24:05.590718] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-03T21:24:05.723305] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T21:24:05.776380] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:24:06.238122] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T21:24:06.239236] [INFO ] [REMOTE ] SBR: Full fetch complete (11144 records). [2025-10-03T21:24:06.239311] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-03T21:24:06.395831] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-03T21:24:06.648422] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-03T21:24:06.648505] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-03T21:24:06.648952] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-03T21:24:06.649015] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-03T21:24:06.649560] [DEBUG] [LOCAL ] SBR: Trimmed 11144 records to 7573 (keeping 200 days of data) [2025-10-03T21:24:06.698638] [DEBUG] [LOCAL ] SBR: Primary data saved (7573 records). [2025-10-03T21:24:06.698816] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-03T21:24:06.698964] [INFO ] [MAIN ] Update Progress: 1876/2370 symbols completed. SBR took 29.8s. Estimated remaining: 1h 9m 32s. Rate: 7.1 symbols/min [2025-10-03T21:24:06.903443] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:06.903661] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-03T21:24:06.903722] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-03T21:24:06.903842] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-03T21:24:06.903886] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-03T21:24:06.903931] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-03T21:24:06.903969] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-03T21:24:07.200280] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-03T21:24:07.330917] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:07.990700] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-03T21:24:08.017752] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T21:24:08.019144] [INFO ] [REMOTE ] SBSI: Full fetch complete (21262 records). [2025-10-03T21:24:08.019227] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-03T21:24:08.255879] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T21:24:08.487390] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-03T21:24:08.487491] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-03T21:24:08.488308] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-03T21:24:08.488376] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-03T21:24:08.489306] [DEBUG] [LOCAL ] SBSI: Trimmed 21262 records to 15017 (keeping 200 days of data) [2025-10-03T21:24:08.592452] [DEBUG] [LOCAL ] SBSI: Primary data saved (15017 records). [2025-10-03T21:24:08.592615] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-03T21:24:08.592782] [INFO ] [MAIN ] Update Progress: 1877/2370 symbols completed. SBSI took 28.8s. Estimated remaining: 1h 9m 21s. Rate: 7.1 symbols/min [2025-10-03T21:24:08.790705] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-03T21:24:09.018563] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-10-03T21:24:09.590720] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-03T21:24:09.962842] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T21:24:10.390742] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-03T21:24:11.203209] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-03T21:24:11.208878] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T21:24:11.451796] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-03T21:24:11.990621] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-03T21:24:12.261895] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T21:24:12.790721] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-03T21:24:13.388387] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T21:24:13.590729] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-03T21:24:14.390638] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-03T21:24:14.693344] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-03T21:24:14.733634] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T21:24:15.190618] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-03T21:24:15.309730] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T21:24:15.990750] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-03T21:24:16.790727] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-03T21:24:17.009346] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-03T21:24:17.138377] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T21:24:17.168400] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T21:24:17.171013] [INFO ] [REMOTE ] SBS: Full fetch complete (70148 records). [2025-10-03T21:24:17.171152] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-03T21:24:17.590362] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-03T21:24:17.590500] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-03T21:24:17.591769] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-03T21:24:17.591875] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-03T21:24:17.592050] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-03T21:24:17.594524] [DEBUG] [LOCAL ] SBS: Trimmed 70148 records to 50163 (keeping 200 days of data) [2025-10-03T21:24:17.879523] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-03T21:24:17.920705] [DEBUG] [LOCAL ] SBS: Primary data saved (50163 records). [2025-10-03T21:24:17.920989] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-03T21:24:17.921110] [INFO ] [MAIN ] Update Progress: 1878/2370 symbols completed. SBS took 39.5s. Estimated remaining: 1h 9m 13s. Rate: 7.1 symbols/min [2025-10-03T21:24:18.390735] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-03T21:24:18.686999] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-03T21:24:19.190728] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-03T21:24:19.990640] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-03T21:24:20.044792] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T21:24:20.790739] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-03T21:24:21.361292] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T21:24:21.590795] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-03T21:24:21.992066] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-03T21:24:22.011894] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T21:24:22.390699] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-03T21:24:23.190747] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-03T21:24:23.523348] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T21:24:23.990714] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-03T21:24:24.092731] [DEBUG] [REMOTE ] SBXD: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-03T21:24:24.093063] [WARN ] [REMOTE ] SBXD: No data returned for month 2025-10 [2025-10-03T21:24:24.093186] [FATAL] [REMOTE ] SBXD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:24:24.093271] [FATAL] [MAIN ] SBXD: Failed to fetch primary data. [2025-10-03T21:24:24.093311] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:24:24.093357] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-03T21:24:24.093420] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-03T21:24:24.093457] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-03T21:24:24.093523] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-03T21:24:24.093595] [INFO ] [MAIN ] Update Progress: 1879/2370 symbols completed. SBXD took 17.4s. Estimated remaining: 1h 9m 4s. Rate: 7.1 symbols/min [2025-10-03T21:24:24.279064] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T21:24:24.790931] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-03T21:24:26.512817] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T21:24:26.526210] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-03T21:24:28.508495] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T21:24:28.522764] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-03T21:24:30.648725] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T21:24:30.660985] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-03T21:24:32.019209] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T21:24:32.023251] [INFO ] [REMOTE ] SBSW: Full fetch complete (76526 records). [2025-10-03T21:24:32.023507] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-03T21:24:32.458554] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-03T21:24:32.458671] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-03T21:24:32.459850] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-03T21:24:32.459926] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-03T21:24:32.461598] [DEBUG] [LOCAL ] SBSW: Trimmed 76526 records to 53812 (keeping 200 days of data) [2025-10-03T21:24:32.789618] [DEBUG] [LOCAL ] SBSW: Primary data saved (53812 records). [2025-10-03T21:24:32.789816] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-03T21:24:32.789968] [INFO ] [MAIN ] Update Progress: 1880/2370 symbols completed. SBSW took 33.9s. Estimated remaining: 1h 8m 56s. Rate: 7.1 symbols/min [2025-10-03T21:24:33.419561] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:33.515195] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:33.586074] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:33.611365] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:33.625745] [DEBUG] [LOCAL ] SCD: Loaded 12919 existing records from primary storage. [2025-10-03T21:24:33.626089] [INFO ] [MAIN ] SCD: Loaded 12919 existing records. [2025-10-03T21:24:33.875499] [DEBUG] [LOCAL ] SCI: Loaded 46770 existing records from primary storage. [2025-10-03T21:24:33.874179] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:24:33.876175] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-03T21:24:33.876432] [INFO ] [MAIN ] SCI: Loaded 46770 existing records. [2025-10-03T21:24:33.889109] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-03T21:24:33.916794] [DEBUG] [LOCAL ] SCCO: Loaded 49786 existing records from primary storage. [2025-10-03T21:24:33.941900] [INFO ] [MAIN ] SCCO: Loaded 49786 existing records. [2025-10-03T21:24:33.989263] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-03T21:24:34.045462] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-03T21:24:34.237219] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-03T21:24:34.309410] [INFO ] [MAIN ] SCHW: Loaded 54075 existing records. [2025-10-03T21:24:34.438377] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:24:34.468586] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-03T21:24:34.471765] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:24:34.487000] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-03T21:24:34.497378] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-03T21:24:34.528959] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-03T21:24:34.555222] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-03T21:24:34.587043] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-03T21:24:34.592270] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-03T21:24:34.634483] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-03T21:24:35.062811] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:24:35.084372] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-03T21:24:35.104050] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-03T21:24:35.264355] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-03T21:24:35.293873] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:35.313509] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-03T21:24:35.333831] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-03T21:24:35.801768] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:35.836087] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-03T21:24:36.061149] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:36.080225] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-03T21:24:36.177836] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:36.178253] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-03T21:24:36.389228] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T21:24:36.391609] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-03T21:24:37.202092] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T21:24:37.204701] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-03T21:24:37.544963] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:24:37.554956] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-03T21:24:37.624944] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:24:37.634166] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-03T21:24:37.644935] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T21:24:37.648850] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-03T21:24:38.030476] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T21:24:38.042480] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-03T21:24:38.374696] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T21:24:38.377136] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-03T21:24:39.025365] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T21:24:39.035947] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-03T21:24:39.142061] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T21:24:39.145166] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-03T21:24:39.391220] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T21:24:39.401444] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-03T21:24:39.861676] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T21:24:39.864072] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-03T21:24:39.967533] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T21:24:39.990627] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-03T21:24:40.485502] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T21:24:40.790693] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-03T21:24:40.842395] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T21:24:41.011356] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:24:41.577553] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T21:24:41.591499] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-03T21:24:42.390674] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-03T21:24:42.613316] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T21:24:42.691714] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T21:24:43.190685] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-03T21:24:43.990632] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-03T21:24:44.054569] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T21:24:44.588542] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T21:24:44.790698] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-03T21:24:45.188146] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T21:24:45.590676] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-03T21:24:46.390677] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-03T21:24:46.467390] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T21:24:46.741713] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T21:24:47.190704] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-03T21:24:47.740935] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T21:24:47.802692] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:24:47.803875] [INFO ] [REMOTE ] SCD: Full fetch complete (16562 records). [2025-10-03T21:24:47.803951] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-03T21:24:47.998049] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-03T21:24:48.202717] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-03T21:24:48.202813] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-03T21:24:48.203198] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-03T21:24:48.203239] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-03T21:24:48.203952] [DEBUG] [LOCAL ] SCD: Trimmed 16562 records to 13029 (keeping 200 days of data) [2025-10-03T21:24:48.288464] [DEBUG] [LOCAL ] SCD: Primary data saved (13029 records). [2025-10-03T21:24:48.288598] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-03T21:24:48.288742] [INFO ] [MAIN ] Update Progress: 1881/2370 symbols completed. SCD took 15.5s. Estimated remaining: 1h 8m 49s. Rate: 7.1 symbols/min [2025-10-03T21:24:48.467684] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:24:48.485548] [DEBUG] [LOCAL ] SCL: Loaded 15009 existing records from primary storage. [2025-10-03T21:24:48.485829] [INFO ] [MAIN ] SCL: Loaded 15009 existing records. [2025-10-03T21:24:48.718183] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:24:48.718426] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-03T21:24:48.718497] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-03T21:24:48.718828] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-03T21:24:48.718887] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-03T21:24:48.797355] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-03T21:24:49.097803] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:24:49.590638] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-03T21:24:49.858162] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:24:50.390638] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-03T21:24:50.509327] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T21:24:50.542852] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:24:51.190738] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-03T21:24:51.990735] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-03T21:24:52.182122] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:24:52.790726] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-03T21:24:53.171836] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T21:24:53.590734] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-03T21:24:53.799036] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T21:24:54.003960] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T21:24:54.390713] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-03T21:24:55.190637] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-03T21:24:55.257587] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T21:24:55.308331] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T21:24:55.990702] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-03T21:24:56.790715] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-03T21:24:57.142080] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T21:24:57.590668] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-03T21:24:57.756727] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T21:24:57.867424] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T21:24:58.390722] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-03T21:24:58.944196] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T21:24:59.190750] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-03T21:24:59.990636] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-03T21:25:00.241592] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T21:25:00.742976] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T21:25:00.745730] [INFO ] [REMOTE ] SCCO: Full fetch complete (70990 records). [2025-10-03T21:25:00.745857] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-03T21:25:00.795890] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-03T21:25:01.187364] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-03T21:25:01.187545] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-03T21:25:01.188941] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-03T21:25:01.189051] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-03T21:25:01.202108] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T21:25:01.207752] [DEBUG] [LOCAL ] SCCO: Trimmed 70990 records to 50173 (keeping 200 days of data) [2025-10-03T21:25:01.591734] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-03T21:25:01.610554] [DEBUG] [LOCAL ] SCCO: Primary data saved (50173 records). [2025-10-03T21:25:01.610764] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-03T21:25:01.610918] [INFO ] [MAIN ] Update Progress: 1882/2370 symbols completed. SCCO took 28.8s. Estimated remaining: 1h 8m 42s. Rate: 7.1 symbols/min [2025-10-03T21:25:01.826919] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:01.848961] [DEBUG] [LOCAL ] SCM: Loaded 19959 existing records from primary storage. [2025-10-03T21:25:01.849272] [INFO ] [MAIN ] SCM: Loaded 19959 existing records. [2025-10-03T21:25:02.053410] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:02.053744] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-03T21:25:02.053823] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-03T21:25:02.054082] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-03T21:25:02.054142] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-03T21:25:02.395902] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-03T21:25:02.466959] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:02.647326] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T21:25:03.120161] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T21:25:03.190679] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-03T21:25:03.894145] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T21:25:03.990698] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-03T21:25:04.790705] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-03T21:25:05.590758] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-03T21:25:06.758364] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T21:25:06.769611] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-03T21:25:07.177161] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T21:25:07.190602] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-03T21:25:08.330288] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:25:08.342097] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-03T21:25:08.368533] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T21:25:08.476070] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (5.29 seconds). [2025-10-03T21:25:08.790721] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-03T21:25:09.590720] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-03T21:25:09.637900] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (5.65 seconds). [2025-10-03T21:25:09.679608] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T21:25:09.682866] [INFO ] [REMOTE ] SCI: Full fetch complete (67365 records). [2025-10-03T21:25:09.683005] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-03T21:25:10.103562] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-03T21:25:10.103699] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-03T21:25:10.105319] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-03T21:25:10.105400] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-03T21:25:10.107400] [DEBUG] [LOCAL ] SCI: Trimmed 67365 records to 47113 (keeping 200 days of data) [2025-10-03T21:25:10.399303] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-03T21:25:10.414808] [DEBUG] [LOCAL ] SCI: Primary data saved (47113 records). [2025-10-03T21:25:10.414982] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-03T21:25:10.415095] [INFO ] [MAIN ] Update Progress: 1883/2370 symbols completed. SCI took 37.6s. Estimated remaining: 1h 8m 34s. Rate: 7.1 symbols/min [2025-10-03T21:25:10.612025] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:10.617789] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T21:25:10.665230] [DEBUG] [LOCAL ] SCS: Loaded 43770 existing records from primary storage. [2025-10-03T21:25:10.665745] [INFO ] [MAIN ] SCS: Loaded 43770 existing records. [2025-10-03T21:25:10.875415] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:10.875927] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-03T21:25:10.876044] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-03T21:25:10.876358] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-03T21:25:10.876489] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-03T21:25:11.181944] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-03T21:25:11.206024] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-03T21:25:11.314879] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:11.356685] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T21:25:11.990718] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-03T21:25:12.533624] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T21:25:12.790728] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-03T21:25:13.567916] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T21:25:13.571035] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-03T21:25:13.571210] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-03T21:25:13.595770] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-03T21:25:14.011094] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-03T21:25:14.011356] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-03T21:25:14.012630] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-03T21:25:14.012732] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-03T21:25:14.014493] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 54465 (keeping 200 days of data) [2025-10-03T21:25:14.269180] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T21:25:14.390688] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-03T21:25:14.407702] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-10-03T21:25:14.407843] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-03T21:25:14.408747] [INFO ] [MAIN ] Update Progress: 1884/2370 symbols completed. SCHW took 41.6s. Estimated remaining: 1h 8m 24s. Rate: 7.1 symbols/min [2025-10-03T21:25:14.587620] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:14.628449] [DEBUG] [LOCAL ] SD: Loaded 28887 existing records from primary storage. [2025-10-03T21:25:14.628772] [INFO ] [MAIN ] SD: Loaded 28887 existing records. [2025-10-03T21:25:14.860816] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:14.873267] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-03T21:25:14.874697] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T21:25:14.874106] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-03T21:25:14.880504] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-03T21:25:14.880588] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-03T21:25:15.195889] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-03T21:25:15.303619] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:15.920678] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:25:15.990712] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-03T21:25:16.121068] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T21:25:16.790684] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-03T21:25:17.476178] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T21:25:17.590699] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-03T21:25:18.048845] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T21:25:18.390631] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-03T21:25:18.625358] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T21:25:19.190630] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-03T21:25:19.486110] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T21:25:19.990678] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-03T21:25:20.296992] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:25:20.790745] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-03T21:25:21.588072] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T21:25:21.589695] [INFO ] [REMOTE ] SCL: Full fetch complete (21376 records). [2025-10-03T21:25:21.589929] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-03T21:25:21.598794] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-03T21:25:21.717119] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:25:22.040274] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-03T21:25:22.040357] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-03T21:25:22.040922] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-03T21:25:22.040988] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-03T21:25:22.041693] [DEBUG] [LOCAL ] SCL: Trimmed 21376 records to 15145 (keeping 200 days of data) [2025-10-03T21:25:22.142683] [DEBUG] [LOCAL ] SCL: Primary data saved (15145 records). [2025-10-03T21:25:22.142836] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-03T21:25:22.142922] [INFO ] [MAIN ] Update Progress: 1885/2370 symbols completed. SCL took 33.9s. Estimated remaining: 1h 8m 16s. Rate: 7.1 symbols/min [2025-10-03T21:25:22.330608] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:22.344490] [DEBUG] [LOCAL ] SDHC: Loaded 10414 existing records from primary storage. [2025-10-03T21:25:22.344756] [INFO ] [MAIN ] SDHC: Loaded 10414 existing records. [2025-10-03T21:25:22.395873] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-03T21:25:22.556836] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:22.557110] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-03T21:25:22.557164] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-03T21:25:22.557436] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-03T21:25:22.557498] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-03T21:25:22.750108] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T21:25:22.998668] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:23.190635] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-03T21:25:23.474561] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T21:25:23.990687] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-03T21:25:24.601196] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T21:25:24.790719] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-03T21:25:25.298956] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T21:25:25.590715] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-03T21:25:25.911531] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T21:25:26.390732] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-03T21:25:26.983490] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T21:25:27.190702] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-03T21:25:27.514408] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:25:27.780995] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T21:25:27.990696] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-03T21:25:28.790634] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-03T21:25:29.083526] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T21:25:29.590690] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-03T21:25:29.904939] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:25:30.390730] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-03T21:25:30.495320] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T21:25:31.190683] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-03T21:25:31.618019] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T21:25:31.990728] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-03T21:25:32.702316] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T21:25:32.790617] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-03T21:25:32.945502] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:25:32.947192] [INFO ] [REMOTE ] SCM: Full fetch complete (28671 records). [2025-10-03T21:25:32.947281] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-03T21:25:33.353339] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-03T21:25:33.353426] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-03T21:25:33.354136] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-03T21:25:33.354201] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-03T21:25:33.355147] [DEBUG] [LOCAL ] SCM: Trimmed 28671 records to 20092 (keeping 200 days of data) [2025-10-03T21:25:33.486270] [DEBUG] [LOCAL ] SCM: Primary data saved (20092 records). [2025-10-03T21:25:33.486402] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-03T21:25:33.486508] [INFO ] [MAIN ] Update Progress: 1886/2370 symbols completed. SCM took 31.9s. Estimated remaining: 1h 8m 8s. Rate: 7.1 symbols/min [2025-10-03T21:25:33.590803] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-03T21:25:33.685714] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:33.698784] [DEBUG] [LOCAL ] SDHY: Loaded 10624 existing records from primary storage. [2025-10-03T21:25:33.699034] [INFO ] [MAIN ] SDHY: Loaded 10624 existing records. [2025-10-03T21:25:33.907960] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:33.916208] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-03T21:25:33.916859] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-03T21:25:33.917183] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T21:25:33.920328] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-03T21:25:33.921135] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-03T21:25:34.309703] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:34.390696] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-03T21:25:35.044928] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T21:25:35.190693] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-03T21:25:35.319317] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T21:25:35.990633] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-03T21:25:36.404605] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T21:25:36.541077] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T21:25:36.790699] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-03T21:25:37.531352] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T21:25:37.590631] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-03T21:25:38.323615] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T21:25:38.390696] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-03T21:25:39.190719] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-03T21:25:39.990637] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-03T21:25:40.128024] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T21:25:40.150168] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T21:25:40.790634] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-03T21:25:41.163814] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T21:25:41.263813] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T21:25:41.590694] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-03T21:25:42.364284] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T21:25:42.390709] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-03T21:25:43.190711] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-03T21:25:43.990702] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-03T21:25:44.085130] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:25:44.194172] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T21:25:44.790639] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-03T21:25:45.183392] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T21:25:45.384950] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T21:25:45.386007] [INFO ] [REMOTE ] SDHC: Full fetch complete (17207 records). [2025-10-03T21:25:45.386079] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-03T21:25:45.595816] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-03T21:25:45.784536] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-03T21:25:45.784629] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-03T21:25:45.785107] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-03T21:25:45.785174] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-03T21:25:45.785754] [DEBUG] [LOCAL ] SDHC: Trimmed 17207 records to 10487 (keeping 200 days of data) [2025-10-03T21:25:45.853818] [DEBUG] [LOCAL ] SDHC: Primary data saved (10487 records). [2025-10-03T21:25:45.854042] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-03T21:25:45.854201] [INFO ] [MAIN ] Update Progress: 1887/2370 symbols completed. SDHC took 23.7s. Estimated remaining: 1h 8m 0s. Rate: 7.1 symbols/min [2025-10-03T21:25:46.033540] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:46.080175] [DEBUG] [LOCAL ] SDRL: Loaded 41889 existing records from primary storage. [2025-10-03T21:25:46.080476] [INFO ] [MAIN ] SDRL: Loaded 41889 existing records. [2025-10-03T21:25:46.269457] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:46.269850] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-03T21:25:46.269906] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-03T21:25:46.270187] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-03T21:25:46.270245] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-03T21:25:46.395877] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-03T21:25:46.650441] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:46.661516] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T21:25:46.664287] [INFO ] [REMOTE ] SD: Full fetch complete (41127 records). [2025-10-03T21:25:46.664440] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-03T21:25:47.155308] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-03T21:25:47.155409] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-03T21:25:47.156529] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-03T21:25:47.156602] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-03T21:25:47.157907] [DEBUG] [LOCAL ] SD: Trimmed 41127 records to 29193 (keeping 200 days of data) [2025-10-03T21:25:47.213172] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-03T21:25:47.351379] [DEBUG] [LOCAL ] SD: Primary data saved (29193 records). [2025-10-03T21:25:47.351532] [INFO ] [MAIN ] SD: Full history saved. [2025-10-03T21:25:47.353206] [INFO ] [MAIN ] Update Progress: 1888/2370 symbols completed. SD took 32.9s. Estimated remaining: 1h 7m 50s. Rate: 7.1 symbols/min [2025-10-03T21:25:47.544226] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:47.605270] [DEBUG] [LOCAL ] SE: Loaded 53751 existing records from primary storage. [2025-10-03T21:25:47.605745] [INFO ] [MAIN ] SE: Loaded 53751 existing records. [2025-10-03T21:25:47.831008] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:47.831372] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-03T21:25:47.831435] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-03T21:25:47.831791] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-03T21:25:47.831871] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-03T21:25:48.003346] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-03T21:25:48.097357] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T21:25:48.282004] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:48.302799] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T21:25:48.790718] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-03T21:25:49.590717] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-03T21:25:49.712469] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:25:50.390673] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-03T21:25:50.400302] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T21:25:50.849852] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T21:25:51.190725] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-03T21:25:51.904316] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:25:51.990722] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-03T21:25:52.487300] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T21:25:52.494134] [INFO ] [REMOTE ] SCS: Full fetch complete (60875 records). [2025-10-03T21:25:52.494321] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-03T21:25:52.795779] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-03T21:25:52.925028] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-03T21:25:52.925122] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-03T21:25:52.926312] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-03T21:25:52.926383] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-03T21:25:52.927824] [DEBUG] [LOCAL ] SCS: Trimmed 60875 records to 44100 (keeping 200 days of data) [2025-10-03T21:25:53.212446] [DEBUG] [LOCAL ] SCS: Primary data saved (44100 records). [2025-10-03T21:25:53.212594] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-03T21:25:53.212724] [INFO ] [MAIN ] Update Progress: 1889/2370 symbols completed. SCS took 42.8s. Estimated remaining: 1h 7m 41s. Rate: 7.1 symbols/min [2025-10-03T21:25:53.402186] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:25:53.448384] [DEBUG] [LOCAL ] SEE: Loaded 48623 existing records from primary storage. [2025-10-03T21:25:53.448762] [INFO ] [MAIN ] SEE: Loaded 48623 existing records. [2025-10-03T21:25:53.600612] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-03T21:25:53.670317] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:25:53.683993] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:25:53.682942] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-03T21:25:53.693789] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-03T21:25:53.694533] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-03T21:25:53.694617] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-03T21:25:54.099786] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:25:54.390632] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-03T21:25:54.664086] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T21:25:54.702694] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T21:25:55.190715] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-03T21:25:55.993442] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-03T21:25:55.998980] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:25:56.792856] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-03T21:25:56.796234] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:25:57.590709] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-03T21:25:57.687395] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:25:58.390712] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-03T21:25:58.447607] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T21:25:58.485704] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T21:25:59.190725] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-03T21:25:59.975881] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T21:25:59.990604] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-03T21:26:00.517144] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T21:26:00.794371] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-03T21:26:00.797823] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T21:26:01.590741] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-03T21:26:02.390746] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-03T21:26:02.992017] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-03T21:26:03.034227] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T21:26:03.190685] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-03T21:26:03.224786] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T21:26:03.990695] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-03T21:26:04.723036] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T21:26:04.790689] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-03T21:26:04.853079] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T21:26:05.590727] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-03T21:26:05.643859] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T21:26:06.390692] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-03T21:26:06.996142] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:26:06.997240] [INFO ] [REMOTE ] SDHY: Full fetch complete (15786 records). [2025-10-03T21:26:06.997314] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-03T21:26:07.200589] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-03T21:26:07.410202] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-03T21:26:07.410303] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-03T21:26:07.410720] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-03T21:26:07.410814] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-03T21:26:07.411634] [DEBUG] [LOCAL ] SDHY: Trimmed 15786 records to 10731 (keeping 200 days of data) [2025-10-03T21:26:07.494571] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:26:07.527371] [DEBUG] [LOCAL ] SDHY: Primary data saved (10731 records). [2025-10-03T21:26:07.527540] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-03T21:26:07.527731] [INFO ] [MAIN ] Update Progress: 1890/2370 symbols completed. SDHY took 34.0s. Estimated remaining: 1h 7m 34s. Rate: 7.1 symbols/min [2025-10-03T21:26:07.713173] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:07.729035] [DEBUG] [LOCAL ] SEG: Loaded 13706 existing records from primary storage. [2025-10-03T21:26:07.729298] [INFO ] [MAIN ] SEG: Loaded 13706 existing records. [2025-10-03T21:26:07.918632] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:07.918869] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-03T21:26:07.918963] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-03T21:26:07.919213] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-03T21:26:07.919273] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-03T21:26:08.000012] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-03T21:26:08.300186] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:08.790707] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-03T21:26:09.355878] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T21:26:09.471052] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T21:26:09.590745] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-03T21:26:09.721578] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T21:26:10.390728] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-03T21:26:11.187750] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T21:26:11.191513] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-03T21:26:11.990686] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-03T21:26:12.087627] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T21:26:12.462876] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T21:26:12.790709] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-03T21:26:13.470393] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T21:26:13.590717] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-03T21:26:14.390731] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-03T21:26:15.000495] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T21:26:15.141068] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T21:26:15.190709] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-03T21:26:15.990675] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-03T21:26:16.126302] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T21:26:16.762181] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:26:16.790618] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-03T21:26:16.993824] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T21:26:17.590732] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-03T21:26:17.908691] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:26:17.910882] [INFO ] [REMOTE ] SDRL: Full fetch complete (61670 records). [2025-10-03T21:26:17.910981] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-03T21:26:18.324232] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-03T21:26:18.324332] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-03T21:26:18.325428] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-03T21:26:18.325497] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-03T21:26:18.326897] [DEBUG] [LOCAL ] SDRL: Trimmed 61670 records to 42190 (keeping 200 days of data) [2025-10-03T21:26:18.413063] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-03T21:26:18.584275] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T21:26:18.613332] [DEBUG] [LOCAL ] SDRL: Primary data saved (42190 records). [2025-10-03T21:26:18.613473] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-03T21:26:18.613581] [INFO ] [MAIN ] Update Progress: 1891/2370 symbols completed. SDRL took 32.8s. Estimated remaining: 1h 7m 26s. Rate: 7.1 symbols/min [2025-10-03T21:26:18.805698] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:18.852849] [DEBUG] [LOCAL ] SEI: Loaded 50044 existing records from primary storage. [2025-10-03T21:26:18.853181] [INFO ] [MAIN ] SEI: Loaded 50044 existing records. [2025-10-03T21:26:19.062496] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:19.062755] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-03T21:26:19.062893] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-03T21:26:19.063161] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-03T21:26:19.063220] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-03T21:26:19.195874] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-03T21:26:19.470995] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:19.990716] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-03T21:26:20.169590] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T21:26:20.307767] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T21:26:20.790712] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-03T21:26:21.590742] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-03T21:26:21.734607] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T21:26:22.368418] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T21:26:22.390617] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-03T21:26:23.190702] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-03T21:26:23.259099] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T21:26:23.718662] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T21:26:23.990681] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-03T21:26:24.031924] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T21:26:24.790703] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-03T21:26:25.590667] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-03T21:26:25.706485] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T21:26:26.317176] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T21:26:26.376839] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T21:26:26.390613] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-03T21:26:27.190621] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-03T21:26:27.350056] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T21:26:27.990738] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-03T21:26:28.790691] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-03T21:26:28.948907] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T21:26:29.376063] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T21:26:29.590695] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-03T21:26:30.118728] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T21:26:30.390686] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-03T21:26:31.146821] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T21:26:31.190709] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-03T21:26:31.246946] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T21:26:31.249835] [INFO ] [REMOTE ] SE: Full fetch complete (77076 records). [2025-10-03T21:26:31.249993] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-03T21:26:31.733027] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-03T21:26:31.733120] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-03T21:26:31.734322] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-03T21:26:31.734427] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-03T21:26:31.735996] [DEBUG] [LOCAL ] SE: Trimmed 77076 records to 54129 (keeping 200 days of data) [2025-10-03T21:26:31.990906] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-03T21:26:32.099092] [DEBUG] [LOCAL ] SE: Primary data saved (54129 records). [2025-10-03T21:26:32.099361] [INFO ] [MAIN ] SE: Full history saved. [2025-10-03T21:26:32.100070] [INFO ] [MAIN ] Update Progress: 1892/2370 symbols completed. SE took 44.7s. Estimated remaining: 1h 7m 19s. Rate: 7.1 symbols/min [2025-10-03T21:26:32.281529] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:32.326263] [DEBUG] [LOCAL ] SEM: Loaded 43065 existing records from primary storage. [2025-10-03T21:26:32.326563] [INFO ] [MAIN ] SEM: Loaded 43065 existing records. [2025-10-03T21:26:32.516314] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:32.516852] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-03T21:26:32.516912] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-03T21:26:32.517248] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-03T21:26:32.517306] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-03T21:26:32.604062] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:26:32.632350] [INFO ] [REMOTE ] SEG: Full fetch complete (19833 records). [2025-10-03T21:26:32.632564] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-03T21:26:32.817510] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-03T21:26:33.201424] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:33.292717] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T21:26:33.370117] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-03T21:26:33.370199] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-03T21:26:33.370733] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-03T21:26:33.370797] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-03T21:26:33.371369] [DEBUG] [LOCAL ] SEG: Trimmed 19833 records to 13766 (keeping 200 days of data) [2025-10-03T21:26:33.455302] [DEBUG] [LOCAL ] SEG: Primary data saved (13766 records). [2025-10-03T21:26:33.455446] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-03T21:26:33.455557] [INFO ] [MAIN ] Update Progress: 1893/2370 symbols completed. SEG took 25.9s. Estimated remaining: 1h 7m 9s. Rate: 7.1 symbols/min [2025-10-03T21:26:33.604300] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-03T21:26:33.642327] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:33.687731] [DEBUG] [LOCAL ] SEMR: Loaded 41963 existing records from primary storage. [2025-10-03T21:26:33.688036] [INFO ] [MAIN ] SEMR: Loaded 41963 existing records. [2025-10-03T21:26:33.885798] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:33.886043] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-03T21:26:33.886094] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-03T21:26:33.886388] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-03T21:26:33.886448] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-03T21:26:34.283601] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:34.390629] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-03T21:26:34.591991] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T21:26:35.190677] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-03T21:26:35.245366] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T21:26:35.956887] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:26:35.990735] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-03T21:26:36.790630] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-03T21:26:36.905432] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T21:26:37.484676] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:26:37.590733] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-03T21:26:38.085274] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T21:26:38.390714] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-03T21:26:38.883168] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T21:26:38.887414] [INFO ] [REMOTE ] SEE: Full fetch complete (69731 records). [2025-10-03T21:26:38.887599] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-03T21:26:39.197590] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-03T21:26:39.325839] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-03T21:26:39.325929] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-03T21:26:39.327145] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-03T21:26:39.327216] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-03T21:26:39.328747] [DEBUG] [LOCAL ] SEE: Trimmed 69731 records to 48990 (keeping 200 days of data) [2025-10-03T21:26:39.644801] [DEBUG] [LOCAL ] SEE: Primary data saved (48990 records). [2025-10-03T21:26:39.644930] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-03T21:26:39.645072] [INFO ] [MAIN ] Update Progress: 1894/2370 symbols completed. SEE took 46.4s. Estimated remaining: 1h 6m 60s. Rate: 7.1 symbols/min [2025-10-03T21:26:39.838169] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:39.893898] [DEBUG] [LOCAL ] SES: Loaded 51946 existing records from primary storage. [2025-10-03T21:26:39.894279] [INFO ] [MAIN ] SES: Loaded 51946 existing records. [2025-10-03T21:26:39.993439] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-03T21:26:40.089088] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:40.089499] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-03T21:26:40.089585] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-03T21:26:40.090219] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-03T21:26:40.090279] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-03T21:26:40.233278] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T21:26:40.541124] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:40.638357] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T21:26:40.790725] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-03T21:26:41.472574] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T21:26:41.590706] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-03T21:26:42.265116] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T21:26:42.390680] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-03T21:26:43.190619] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-03T21:26:43.285633] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:26:43.911420] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T21:26:43.990688] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-03T21:26:44.790621] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-03T21:26:44.991935] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:26:45.590694] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-03T21:26:46.301556] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-03T21:26:46.387381] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T21:26:46.395842] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-03T21:26:47.190721] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-03T21:26:47.281126] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:26:47.864152] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T21:26:47.990673] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-03T21:26:48.790721] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-03T21:26:49.526410] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T21:26:49.601499] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-03T21:26:49.607444] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T21:26:49.840953] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T21:26:50.390691] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-03T21:26:51.190706] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-03T21:26:51.891173] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T21:26:51.894024] [INFO ] [REMOTE ] SEI: Full fetch complete (69975 records). [2025-10-03T21:26:51.894153] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-03T21:26:51.992095] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-03T21:26:52.364156] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-03T21:26:52.367498] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-03T21:26:52.368827] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-03T21:26:52.368946] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-03T21:26:52.372492] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-03T21:26:52.384690] [DEBUG] [LOCAL ] SEI: Trimmed 69975 records to 50431 (keeping 200 days of data) [2025-10-03T21:26:52.505431] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T21:26:52.768922] [DEBUG] [LOCAL ] SEI: Primary data saved (50431 records). [2025-10-03T21:26:52.769074] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-03T21:26:52.769177] [INFO ] [MAIN ] Update Progress: 1895/2370 symbols completed. SEI took 34.2s. Estimated remaining: 1h 6m 53s. Rate: 7.1 symbols/min [2025-10-03T21:26:52.803149] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-03T21:26:52.951907] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:26:52.991993] [DEBUG] [LOCAL ] SF: Loaded 41845 existing records from primary storage. [2025-10-03T21:26:52.992322] [INFO ] [MAIN ] SF: Loaded 41845 existing records. [2025-10-03T21:26:53.181915] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:26:53.182236] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-03T21:26:53.182292] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-03T21:26:53.182526] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-03T21:26:53.182585] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-03T21:26:53.571494] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:26:53.602614] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-03T21:26:53.608902] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T21:26:54.390720] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-03T21:26:55.111942] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T21:26:55.197732] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-03T21:26:55.204359] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-03T21:26:55.862798] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T21:26:55.990710] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-03T21:26:56.740383] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:26:56.790696] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-03T21:26:57.590734] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-03T21:26:58.316516] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T21:26:58.390672] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-03T21:26:58.457061] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T21:26:59.176932] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:26:59.190602] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-03T21:26:59.990693] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-03T21:27:00.574750] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-03T21:27:00.608492] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T21:27:00.790692] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-03T21:27:01.198194] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T21:27:01.590724] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-03T21:27:02.390734] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-03T21:27:02.521705] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:27:03.190692] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-03T21:27:03.283903] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T21:27:03.990706] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-03T21:27:04.471202] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T21:27:04.642856] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T21:27:04.790687] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-03T21:27:05.438612] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T21:27:05.590696] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-03T21:27:06.053214] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T21:27:06.057255] [INFO ] [REMOTE ] SEMR: Full fetch complete (59411 records). [2025-10-03T21:27:06.057376] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-03T21:27:06.395822] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-03T21:27:06.472395] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-03T21:27:06.472480] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-03T21:27:06.473513] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-03T21:27:06.473579] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-03T21:27:06.474934] [DEBUG] [LOCAL ] SEMR: Trimmed 59411 records to 42290 (keeping 200 days of data) [2025-10-03T21:27:06.725036] [DEBUG] [LOCAL ] SEMR: Primary data saved (42290 records). [2025-10-03T21:27:06.725165] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-03T21:27:06.725248] [INFO ] [MAIN ] Update Progress: 1896/2370 symbols completed. SEMR took 33.3s. Estimated remaining: 1h 6m 46s. Rate: 7.1 symbols/min [2025-10-03T21:27:06.902789] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:06.909688] [DEBUG] [LOCAL ] SFB: Loaded 4158 existing records from primary storage. [2025-10-03T21:27:06.909901] [INFO ] [MAIN ] SFB: Loaded 4158 existing records. [2025-10-03T21:27:07.091730] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:07.091925] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-03T21:27:07.091972] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-03T21:27:07.092140] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-03T21:27:07.092196] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-03T21:27:07.197593] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-03T21:27:07.483345] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:07.587839] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T21:27:07.996529] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-03T21:27:08.014660] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T21:27:08.671044] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T21:27:08.790668] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-03T21:27:08.890349] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:27:09.590735] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-03T21:27:10.155971] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T21:27:10.259705] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T21:27:10.390725] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-03T21:27:11.190687] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-03T21:27:11.649709] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T21:27:11.990689] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-03T21:27:12.541920] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-03T21:27:12.615988] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T21:27:12.790712] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-03T21:27:13.590726] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-03T21:27:14.306206] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T21:27:14.390719] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-03T21:27:14.798093] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T21:27:15.190721] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-03T21:27:15.793403] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T21:27:15.990717] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-03T21:27:16.395117] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T21:27:16.397910] [INFO ] [REMOTE ] SES: Full fetch complete (75283 records). [2025-10-03T21:27:16.398024] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-03T21:27:16.797241] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-03T21:27:16.851117] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-03T21:27:16.851212] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-03T21:27:16.852539] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-03T21:27:16.852613] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-03T21:27:16.854241] [DEBUG] [LOCAL ] SES: Trimmed 75283 records to 52336 (keeping 200 days of data) [2025-10-03T21:27:17.154807] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T21:27:17.162537] [INFO ] [REMOTE ] SEM: Full fetch complete (61437 records). [2025-10-03T21:27:17.162994] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-03T21:27:17.319912] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T21:27:17.596974] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-03T21:27:17.623352] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-03T21:27:17.626224] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-03T21:27:17.626136] [DEBUG] [LOCAL ] SES: Primary data saved (52336 records). [2025-10-03T21:27:17.626725] [INFO ] [MAIN ] SES: Full history saved. [2025-10-03T21:27:17.628219] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-03T21:27:17.628457] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-03T21:27:17.628376] [INFO ] [MAIN ] Update Progress: 1897/2370 symbols completed. SES took 38.0s. Estimated remaining: 1h 6m 38s. Rate: 7.1 symbols/min [2025-10-03T21:27:17.739314] [DEBUG] [LOCAL ] SEM: Trimmed 61437 records to 43391 (keeping 200 days of data) [2025-10-03T21:27:17.909792] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:17.942458] [DEBUG] [LOCAL ] SFBS: Loaded 21253 existing records from primary storage. [2025-10-03T21:27:17.944576] [INFO ] [MAIN ] SFBS: Loaded 21253 existing records. [2025-10-03T21:27:18.161363] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:18.162816] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-03T21:27:18.163441] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-03T21:27:18.164152] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-03T21:27:18.164447] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-03T21:27:18.392738] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-03T21:27:18.676295] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:18.724247] [DEBUG] [LOCAL ] SEM: Primary data saved (43391 records). [2025-10-03T21:27:18.724396] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-03T21:27:18.725093] [INFO ] [MAIN ] Update Progress: 1898/2370 symbols completed. SEM took 46.6s. Estimated remaining: 1h 6m 27s. Rate: 7.1 symbols/min [2025-10-03T21:27:18.907714] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:18.953693] [DEBUG] [LOCAL ] SFL: Loaded 45558 existing records from primary storage. [2025-10-03T21:27:18.954019] [INFO ] [MAIN ] SFL: Loaded 45558 existing records. [2025-10-03T21:27:19.153990] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T21:27:19.153535] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:19.157422] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-03T21:27:19.157543] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-03T21:27:19.158084] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-03T21:27:19.158240] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-03T21:27:19.198717] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-03T21:27:19.302720] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:27:19.582548] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:19.833947] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T21:27:19.990693] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-03T21:27:20.790687] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-03T21:27:20.958138] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T21:27:21.590729] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-03T21:27:22.075065] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T21:27:22.397095] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-03T21:27:22.417122] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T21:27:23.033117] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T21:27:23.190676] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-03T21:27:23.591685] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T21:27:23.592532] [INFO ] [REMOTE ] SFB: Full fetch complete (5866 records). [2025-10-03T21:27:23.592604] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-03T21:27:23.982004] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-03T21:27:23.982119] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-03T21:27:23.982305] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-03T21:27:23.982347] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-03T21:27:23.982762] [DEBUG] [LOCAL ] SFB: Trimmed 5866 records to 4170 (keeping 200 days of data) [2025-10-03T21:27:23.993955] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-03T21:27:24.011604] [DEBUG] [LOCAL ] SFB: Primary data saved (4170 records). [2025-10-03T21:27:24.011786] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-03T21:27:24.011887] [INFO ] [MAIN ] Update Progress: 1899/2370 symbols completed. SFB took 17.3s. Estimated remaining: 1h 6m 18s. Rate: 7.1 symbols/min [2025-10-03T21:27:24.196423] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:24.196621] [DEBUG] [LOCAL ] SG: No existing data file found in primary storage. [2025-10-03T21:27:24.196696] [WARN ] [MAIN ] SG: No existing data found, performing full refresh instead. [2025-10-03T21:27:24.196819] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-03T21:27:24.196861] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-03T21:27:24.196902] [DEBUG] [LOCAL ] SG: No primary data file found to delete. [2025-10-03T21:27:24.196935] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-03T21:27:24.600713] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:24.790682] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-03T21:27:25.438052] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T21:27:25.590680] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-03T21:27:25.694743] [DEBUG] [REMOTE ] SFL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-03T21:27:25.694988] [WARN ] [REMOTE ] SFL: No data returned for month 2025-02 [2025-10-03T21:27:25.695074] [FATAL] [REMOTE ] SFL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:27:25.695157] [FATAL] [MAIN ] SFL: Failed to fetch primary data. [2025-10-03T21:27:25.695194] [WARN ] [MAIN ] SFL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:27:25.695233] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-03T21:27:25.695288] [DEBUG] [LOCAL ] SFL: No primary data file found to delete. [2025-10-03T21:27:25.695328] [INFO ] [LOCAL ] SFL: Starting deletion of derivative data. [2025-10-03T21:27:25.695616] [DEBUG] [LOCAL ] SFL: Deleted derivative data file. [2025-10-03T21:27:25.696311] [INFO ] [MAIN ] Update Progress: 1900/2370 symbols completed. SFL took 7.0s. Estimated remaining: 1h 6m 8s. Rate: 7.1 symbols/min [2025-10-03T21:27:25.893273] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:25.907629] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T21:27:25.956988] [DEBUG] [LOCAL ] SGHC: Loaded 46455 existing records from primary storage. [2025-10-03T21:27:25.957348] [INFO ] [MAIN ] SGHC: Loaded 46455 existing records. [2025-10-03T21:27:26.138882] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:26.139089] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-03T21:27:26.139138] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-03T21:27:26.139391] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-03T21:27:26.139450] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-03T21:27:26.396530] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-03T21:27:26.524673] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:27.190692] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-03T21:27:27.990668] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-03T21:27:28.398320] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T21:27:28.628924] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T21:27:28.790698] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-03T21:27:29.453399] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T21:27:29.590708] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-03T21:27:30.224366] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T21:27:30.390683] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-03T21:27:31.190678] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-03T21:27:31.424755] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T21:27:31.459197] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T21:27:31.990702] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-03T21:27:32.454052] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T21:27:32.456419] [INFO ] [REMOTE ] SF: Full fetch complete (59914 records). [2025-10-03T21:27:32.456560] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-03T21:27:32.795751] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-03T21:27:32.883759] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-03T21:27:32.883853] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-03T21:27:32.884887] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-03T21:27:32.884950] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-03T21:27:32.886399] [DEBUG] [LOCAL ] SF: Trimmed 59914 records to 42143 (keeping 200 days of data) [2025-10-03T21:27:33.121134] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T21:27:33.178258] [DEBUG] [LOCAL ] SF: Primary data saved (42143 records). [2025-10-03T21:27:33.178393] [INFO ] [MAIN ] SF: Full history saved. [2025-10-03T21:27:33.178499] [INFO ] [MAIN ] Update Progress: 1901/2370 symbols completed. SF took 40.4s. Estimated remaining: 1h 5m 59s. Rate: 7.1 symbols/min [2025-10-03T21:27:33.363485] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:33.363863] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-03T21:27:33.363919] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-03T21:27:33.364060] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-03T21:27:33.364113] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-03T21:27:33.364157] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-03T21:27:33.364201] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-03T21:27:33.595868] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-03T21:27:33.750958] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:34.316404] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:27:34.390729] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-03T21:27:34.589601] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:27:34.589965] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-03T21:27:34.590069] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:27:34.590305] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-03T21:27:34.590440] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:27:34.590517] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-03T21:27:34.590584] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-03T21:27:34.590669] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-03T21:27:34.590739] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-03T21:27:34.590818] [INFO ] [MAIN ] Update Progress: 1902/2370 symbols completed. SGI took 1.4s. Estimated remaining: 1h 5m 49s. Rate: 7.1 symbols/min [2025-10-03T21:27:34.775875] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:34.786888] [DEBUG] [LOCAL ] SGU: Loaded 6739 existing records from primary storage. [2025-10-03T21:27:34.787155] [INFO ] [MAIN ] SGU: Loaded 6739 existing records. [2025-10-03T21:27:34.997587] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:34.999242] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T21:27:34.999399] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-03T21:27:35.005962] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-03T21:27:35.006249] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-03T21:27:35.006309] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-03T21:27:35.195059] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-03T21:27:35.395360] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:35.990692] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-03T21:27:36.790700] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-03T21:27:37.119964] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T21:27:37.418232] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T21:27:37.543684] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T21:27:37.590621] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-03T21:27:38.390705] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-03T21:27:39.010340] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T21:27:39.124829] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T21:27:39.190619] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-03T21:27:39.786367] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T21:27:39.990686] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-03T21:27:40.790660] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-03T21:27:41.570541] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:27:41.590616] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-03T21:27:41.785752] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T21:27:42.390701] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-03T21:27:43.195719] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-03T21:27:43.214337] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T21:27:43.422733] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T21:27:43.646917] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T21:27:43.990698] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-03T21:27:44.790685] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-03T21:27:45.590747] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-03T21:27:45.796279] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:27:46.253031] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T21:27:46.390767] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-03T21:27:46.536112] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T21:27:47.190748] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-03T21:27:47.990689] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-03T21:27:48.175394] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T21:27:48.319177] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:27:48.540260] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T21:27:48.790686] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-03T21:27:49.590715] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-03T21:27:50.285467] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T21:27:50.390639] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-03T21:27:50.796870] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T21:27:51.184456] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T21:27:51.190629] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-03T21:27:51.924393] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T21:27:51.990752] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-03T21:27:52.790692] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-03T21:27:53.059576] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T21:27:53.590689] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-03T21:27:54.390673] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-03T21:27:54.719972] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T21:27:54.834517] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T21:27:55.190664] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-03T21:27:55.437410] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T21:27:55.990729] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-03T21:27:56.788626] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T21:27:56.790129] [INFO ] [REMOTE ] SFBS: Full fetch complete (30328 records). [2025-10-03T21:27:56.790233] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-03T21:27:56.795990] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-03T21:27:57.228824] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-03T21:27:57.229008] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-03T21:27:57.229879] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-03T21:27:57.229962] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-03T21:27:57.231108] [DEBUG] [LOCAL ] SFBS: Trimmed 30328 records to 21398 (keeping 200 days of data) [2025-10-03T21:27:57.362384] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T21:27:57.425830] [DEBUG] [LOCAL ] SFBS: Primary data saved (21398 records). [2025-10-03T21:27:57.425965] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-03T21:27:57.426050] [INFO ] [MAIN ] Update Progress: 1903/2370 symbols completed. SFBS took 39.8s. Estimated remaining: 1h 5m 44s. Rate: 7.1 symbols/min [2025-10-03T21:27:57.593460] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-03T21:27:57.625673] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:27:57.669264] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:27:57.689525] [DEBUG] [LOCAL ] SHAK: Loaded 49276 existing records from primary storage. [2025-10-03T21:27:57.690015] [INFO ] [MAIN ] SHAK: Loaded 49276 existing records. [2025-10-03T21:27:57.883777] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:27:57.884101] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-03T21:27:57.884154] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-03T21:27:57.884496] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-03T21:27:57.884557] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-03T21:27:58.257890] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:27:58.390727] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-03T21:27:59.190725] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-03T21:27:59.505950] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T21:27:59.937566] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T21:27:59.990632] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-03T21:28:00.790630] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-03T21:28:01.073130] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T21:28:01.590631] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-03T21:28:01.715516] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T21:28:02.390707] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-03T21:28:02.831494] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T21:28:02.898323] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T21:28:02.899195] [INFO ] [REMOTE ] SGU: Full fetch complete (9006 records). [2025-10-03T21:28:02.899267] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-03T21:28:03.015605] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T21:28:03.045187] [INFO ] [REMOTE ] SGHC: Full fetch complete (63841 records). [2025-10-03T21:28:03.069354] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-03T21:28:03.195777] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-03T21:28:03.632140] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-03T21:28:03.632370] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-03T21:28:03.632748] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-03T21:28:03.638554] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-03T21:28:03.675091] [DEBUG] [LOCAL ] SGU: Trimmed 9006 records to 6770 (keeping 200 days of data) [2025-10-03T21:28:03.764193] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-03T21:28:03.764623] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-03T21:28:03.769236] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-03T21:28:03.769866] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-03T21:28:03.778846] [DEBUG] [LOCAL ] SGU: Primary data saved (6770 records). [2025-10-03T21:28:03.778997] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-03T21:28:03.779277] [INFO ] [MAIN ] Update Progress: 1904/2370 symbols completed. SGU took 29.2s. Estimated remaining: 1h 5m 35s. Rate: 7.1 symbols/min [2025-10-03T21:28:03.779139] [DEBUG] [LOCAL ] SGHC: Trimmed 63841 records to 46831 (keeping 200 days of data) [2025-10-03T21:28:03.991201] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-03T21:28:04.055293] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:04.204707] [DEBUG] [LOCAL ] SHCO: Loaded 26008 existing records from primary storage. [2025-10-03T21:28:04.212176] [INFO ] [MAIN ] SHCO: Loaded 26008 existing records. [2025-10-03T21:28:04.426353] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:04.427417] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-03T21:28:04.427828] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-03T21:28:04.428682] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-03T21:28:04.429245] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-03T21:28:04.849288] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:04.851260] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-03T21:28:04.901388] [DEBUG] [LOCAL ] SGHC: Primary data saved (46831 records). [2025-10-03T21:28:04.901533] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-03T21:28:04.902179] [INFO ] [MAIN ] Update Progress: 1905/2370 symbols completed. SGHC took 39.2s. Estimated remaining: 1h 5m 25s. Rate: 7.1 symbols/min [2025-10-03T21:28:05.089289] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:05.120440] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T21:28:05.181548] [DEBUG] [LOCAL ] SHEL: Loaded 54061 existing records from primary storage. [2025-10-03T21:28:05.181949] [INFO ] [MAIN ] SHEL: Loaded 54061 existing records. [2025-10-03T21:28:05.365489] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:05.365728] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-03T21:28:05.365784] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-03T21:28:05.366042] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-03T21:28:05.366101] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-03T21:28:05.600637] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-03T21:28:05.748989] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:05.791674] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T21:28:05.794495] [INFO ] [REMOTE ] SG: Full fetch complete (77296 records). [2025-10-03T21:28:05.794673] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-03T21:28:06.230176] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-03T21:28:06.231081] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T21:28:06.231286] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-03T21:28:06.238584] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-03T21:28:06.238727] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-03T21:28:06.240389] [DEBUG] [LOCAL ] SG: Trimmed 77296 records to 54228 (keeping 200 days of data) [2025-10-03T21:28:06.410798] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-03T21:28:06.570604] [DEBUG] [LOCAL ] SG: Primary data saved (54228 records). [2025-10-03T21:28:06.570784] [INFO ] [MAIN ] SG: Full history saved. [2025-10-03T21:28:06.570880] [INFO ] [MAIN ] Update Progress: 1906/2370 symbols completed. SG took 42.6s. Estimated remaining: 1h 5m 15s. Rate: 7.1 symbols/min [2025-10-03T21:28:06.752336] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:06.779849] [DEBUG] [LOCAL ] SHG: Loaded 26756 existing records from primary storage. [2025-10-03T21:28:06.780150] [INFO ] [MAIN ] SHG: Loaded 26756 existing records. [2025-10-03T21:28:06.975130] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:06.975702] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-03T21:28:06.975764] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-03T21:28:06.976044] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-03T21:28:06.976105] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-03T21:28:07.200949] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-03T21:28:07.357296] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:07.434397] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T21:28:07.990632] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-03T21:28:08.335465] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T21:28:08.589036] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T21:28:08.790701] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-03T21:28:09.590719] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-03T21:28:09.779088] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T21:28:10.390697] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-03T21:28:10.636121] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T21:28:11.010803] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T21:28:11.190716] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-03T21:28:11.990704] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-03T21:28:12.149660] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T21:28:12.180061] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T21:28:12.790731] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-03T21:28:13.590715] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-03T21:28:13.827400] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T21:28:14.390685] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-03T21:28:14.593441] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T21:28:14.885898] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T21:28:15.190717] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-03T21:28:15.990686] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-03T21:28:16.427475] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T21:28:16.551416] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T21:28:16.790751] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-03T21:28:17.590693] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-03T21:28:17.766072] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:28:17.806378] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T21:28:18.390690] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-03T21:28:18.945031] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T21:28:19.190695] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-03T21:28:19.420116] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T21:28:19.990727] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-03T21:28:20.790703] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-03T21:28:21.003392] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:28:21.106408] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T21:28:21.590632] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-03T21:28:21.978892] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T21:28:22.390684] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-03T21:28:22.919768] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T21:28:23.190693] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-03T21:28:23.736485] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T21:28:23.990704] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-03T21:28:24.790728] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-03T21:28:25.374032] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T21:28:25.445134] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T21:28:25.590686] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-03T21:28:26.390724] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-03T21:28:26.487929] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T21:28:27.190681] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-03T21:28:27.654158] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T21:28:27.691012] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T21:28:27.990694] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-03T21:28:28.567685] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:28:28.570559] [INFO ] [REMOTE ] SHAK: Full fetch complete (70469 records). [2025-10-03T21:28:28.570719] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-03T21:28:28.799114] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-03T21:28:28.907780] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:28:28.936180] [INFO ] [REMOTE ] SHCO: Full fetch complete (37888 records). [2025-10-03T21:28:28.952999] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-03T21:28:29.117772] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-03T21:28:29.117925] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-03T21:28:29.119366] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-03T21:28:29.131687] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-03T21:28:29.193031] [DEBUG] [LOCAL ] SHAK: Trimmed 70469 records to 49652 (keeping 200 days of data) [2025-10-03T21:28:29.531715] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-03T21:28:29.532073] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-03T21:28:29.533302] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-03T21:28:29.533670] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-03T21:28:29.542970] [DEBUG] [LOCAL ] SHCO: Trimmed 37888 records to 26144 (keeping 200 days of data) [2025-10-03T21:28:29.601800] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-03T21:28:29.833742] [DEBUG] [LOCAL ] SHCO: Primary data saved (26144 records). [2025-10-03T21:28:29.834376] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-03T21:28:29.834885] [INFO ] [MAIN ] Update Progress: 1907/2370 symbols completed. SHCO took 26.1s. Estimated remaining: 1h 5m 10s. Rate: 7.1 symbols/min [2025-10-03T21:28:30.030468] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:30.103145] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T21:28:30.148571] [DEBUG] [LOCAL ] SHO: Loaded 50021 existing records from primary storage. [2025-10-03T21:28:30.150196] [INFO ] [MAIN ] SHO: Loaded 50021 existing records. [2025-10-03T21:28:30.292485] [DEBUG] [LOCAL ] SHAK: Primary data saved (49652 records). [2025-10-03T21:28:30.312846] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-03T21:28:30.324394] [INFO ] [MAIN ] Update Progress: 1908/2370 symbols completed. SHAK took 32.9s. Estimated remaining: 1h 4m 60s. Rate: 7.1 symbols/min [2025-10-03T21:28:30.391386] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-03T21:28:30.373686] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:30.445288] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-03T21:28:30.470128] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-03T21:28:30.475885] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-03T21:28:30.481063] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-03T21:28:30.622085] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:30.728929] [DEBUG] [LOCAL ] SHOC: Loaded 3502 existing records from primary storage. [2025-10-03T21:28:30.762235] [INFO ] [MAIN ] SHOC: Loaded 3502 existing records. [2025-10-03T21:28:31.186586] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:31.190880] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:31.191196] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-03T21:28:31.192324] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-03T21:28:31.192388] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-03T21:28:31.192591] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-03T21:28:31.192689] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-03T21:28:31.615796] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:31.632982] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T21:28:31.774888] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T21:28:31.990712] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-03T21:28:32.790717] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-03T21:28:32.952611] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T21:28:33.293617] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T21:28:33.590713] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-03T21:28:34.390713] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-03T21:28:34.505322] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T21:28:35.017578] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T21:28:35.190697] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-03T21:28:35.983386] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:28:35.992948] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-03T21:28:36.787351] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T21:28:36.790606] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-03T21:28:37.337761] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T21:28:37.354090] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T21:28:37.590715] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-03T21:28:38.390705] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-03T21:28:39.156611] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T21:28:39.190725] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-03T21:28:39.834917] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-03T21:28:39.851397] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T21:28:39.990703] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-03T21:28:40.790703] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-03T21:28:41.104133] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T21:28:41.590687] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-03T21:28:42.293324] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T21:28:42.362372] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T21:28:42.390694] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-03T21:28:43.190704] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-03T21:28:43.344474] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:28:43.347968] [INFO ] [REMOTE ] SHG: Full fetch complete (41119 records). [2025-10-03T21:28:43.348105] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-03T21:28:43.811401] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-03T21:28:43.811494] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-03T21:28:43.812498] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-03T21:28:43.812565] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-03T21:28:43.813619] [DEBUG] [LOCAL ] SHG: Trimmed 41119 records to 26900 (keeping 200 days of data) [2025-10-03T21:28:43.986429] [DEBUG] [LOCAL ] SHG: Primary data saved (26900 records). [2025-10-03T21:28:43.986574] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-03T21:28:43.986698] [INFO ] [MAIN ] Update Progress: 1909/2370 symbols completed. SHG took 37.4s. Estimated remaining: 1h 4m 53s. Rate: 7.1 symbols/min [2025-10-03T21:28:43.992036] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-03T21:28:44.168500] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:44.217638] [DEBUG] [LOCAL ] SHW: Loaded 50680 existing records from primary storage. [2025-10-03T21:28:44.218021] [INFO ] [MAIN ] SHW: Loaded 50680 existing records. [2025-10-03T21:28:44.411481] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:44.411729] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-03T21:28:44.411787] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-03T21:28:44.412045] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-03T21:28:44.412104] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-03T21:28:44.534954] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T21:28:44.745167] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T21:28:44.775276] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-03T21:28:44.794801] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-03T21:28:44.802136] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-03T21:28:44.872755] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:45.267814] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-03T21:28:45.267935] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-03T21:28:45.269786] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-03T21:28:45.269858] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-03T21:28:45.271988] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 54451 (keeping 200 days of data) [2025-10-03T21:28:45.372858] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T21:28:45.598883] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-03T21:28:45.649754] [DEBUG] [LOCAL ] SHEL: Primary data saved (54451 records). [2025-10-03T21:28:45.649970] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-03T21:28:45.652611] [INFO ] [MAIN ] Update Progress: 1910/2370 symbols completed. SHEL took 40.8s. Estimated remaining: 1h 4m 43s. Rate: 7.1 symbols/min [2025-10-03T21:28:45.851558] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:45.851868] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-03T21:28:45.851914] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-03T21:28:45.852047] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-03T21:28:45.852089] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-03T21:28:45.852131] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-03T21:28:45.852165] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-03T21:28:46.141778] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T21:28:46.224002] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:46.390712] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-03T21:28:47.190697] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-03T21:28:47.682476] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T21:28:48.001698] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-03T21:28:48.008076] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T21:28:48.506418] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T21:28:48.790750] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-03T21:28:49.590737] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-03T21:28:50.054888] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:28:50.055705] [INFO ] [REMOTE ] SHOC: Full fetch complete (7309 records). [2025-10-03T21:28:50.055786] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-03T21:28:50.393415] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-03T21:28:50.462391] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-03T21:28:50.462669] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-03T21:28:50.463016] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-03T21:28:50.463295] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-03T21:28:50.464043] [DEBUG] [LOCAL ] SHOC: Trimmed 7309 records to 3520 (keeping 200 days of data) [2025-10-03T21:28:50.488271] [DEBUG] [LOCAL ] SHOC: Primary data saved (3520 records). [2025-10-03T21:28:50.488375] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-03T21:28:50.488478] [INFO ] [MAIN ] Update Progress: 1911/2370 symbols completed. SHOC took 20.2s. Estimated remaining: 1h 4m 33s. Rate: 7.1 symbols/min [2025-10-03T21:28:50.671016] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:28:50.674835] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:50.675344] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-03T21:28:50.676488] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:28:50.676572] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-03T21:28:50.691683] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:28:50.705132] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-03T21:28:50.706017] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-03T21:28:50.708175] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T21:28:50.708309] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-03T21:28:50.720103] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-03T21:28:50.720425] [INFO ] [MAIN ] Update Progress: 1912/2370 symbols completed. SI took 5.1s. Estimated remaining: 1h 4m 23s. Rate: 7.1 symbols/min [2025-10-03T21:28:50.924590] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:28:50.940070] [DEBUG] [LOCAL ] SID: Loaded 42611 existing records from primary storage. [2025-10-03T21:28:50.940618] [INFO ] [MAIN ] SID: Loaded 42611 existing records. [2025-10-03T21:28:51.164738] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:51.164994] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-03T21:28:51.165043] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-03T21:28:51.165558] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-03T21:28:51.165618] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-03T21:28:51.197442] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-03T21:28:51.323113] [DEBUG] [LOCAL ] SIG: Loaded 46516 existing records from primary storage. [2025-10-03T21:28:51.350161] [INFO ] [MAIN ] SIG: Loaded 46516 existing records. [2025-10-03T21:28:51.812730] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:28:51.817491] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-03T21:28:51.817250] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:51.817583] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-03T21:28:51.818490] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-03T21:28:51.818557] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-03T21:28:52.003875] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-03T21:28:52.205196] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:28:52.790675] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-03T21:28:53.009471] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T21:28:53.590701] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-03T21:28:53.862026] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T21:28:54.390637] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-03T21:28:54.497355] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:28:55.190699] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-03T21:28:55.312803] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T21:28:55.990714] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-03T21:28:56.065054] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T21:28:56.790685] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-03T21:28:57.058232] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T21:28:57.336468] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T21:28:57.590734] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-03T21:28:58.318035] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:28:58.390685] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-03T21:28:58.965777] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T21:28:59.190701] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-03T21:28:59.740869] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T21:28:59.990690] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-03T21:29:00.790718] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-03T21:29:00.989390] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T21:29:01.590724] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-03T21:29:02.016173] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T21:29:02.390677] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-03T21:29:02.530449] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T21:29:03.201478] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-03T21:29:03.206831] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T21:29:03.990639] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-03T21:29:04.259549] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T21:29:04.790712] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-03T21:29:05.258019] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-03T21:29:05.596798] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-03T21:29:05.611769] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:29:05.947511] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T21:29:06.390683] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-03T21:29:07.190724] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-03T21:29:07.413391] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T21:29:07.990728] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-03T21:29:08.130771] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T21:29:08.607173] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T21:29:08.790682] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-03T21:29:09.590681] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-03T21:29:09.738787] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:29:10.390699] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-03T21:29:10.709809] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:29:10.711718] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T21:29:10.724540] [INFO ] [REMOTE ] SHO: Full fetch complete (71039 records). [2025-10-03T21:29:10.724755] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-03T21:29:11.157250] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-03T21:29:11.157488] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-03T21:29:11.159126] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-03T21:29:11.159212] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-03T21:29:11.161273] [DEBUG] [LOCAL ] SHO: Trimmed 71039 records to 50371 (keeping 200 days of data) [2025-10-03T21:29:11.218974] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-03T21:29:11.490259] [DEBUG] [LOCAL ] SHO: Primary data saved (50371 records). [2025-10-03T21:29:11.490486] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-03T21:29:11.490761] [INFO ] [MAIN ] Update Progress: 1913/2370 symbols completed. SHO took 41.7s. Estimated remaining: 1h 4m 17s. Rate: 7.1 symbols/min [2025-10-03T21:29:11.680520] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:11.704156] [DEBUG] [LOCAL ] SII: Loaded 23725 existing records from primary storage. [2025-10-03T21:29:11.704420] [INFO ] [MAIN ] SII: Loaded 23725 existing records. [2025-10-03T21:29:11.891344] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:29:11.891593] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-03T21:29:11.891671] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-03T21:29:11.891953] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-03T21:29:11.892012] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-03T21:29:11.991490] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-03T21:29:12.275298] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:29:12.321335] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T21:29:12.750518] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T21:29:12.790631] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-03T21:29:13.590672] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-03T21:29:13.674303] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T21:29:14.285309] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T21:29:14.390699] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-03T21:29:15.190727] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-03T21:29:15.313538] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T21:29:15.990670] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-03T21:29:16.141138] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T21:29:16.790759] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-03T21:29:16.921722] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T21:29:17.590625] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-03T21:29:17.717993] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:29:18.390712] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-03T21:29:18.465608] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T21:29:18.688222] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T21:29:19.190709] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-03T21:29:19.798513] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T21:29:19.804985] [INFO ] [REMOTE ] SHW: Full fetch complete (72996 records). [2025-10-03T21:29:19.805159] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-03T21:29:19.996085] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-03T21:29:20.191755] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T21:29:20.291478] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-03T21:29:20.291604] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-03T21:29:20.293013] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-03T21:29:20.293097] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-03T21:29:20.295014] [DEBUG] [LOCAL ] SHW: Trimmed 72996 records to 51050 (keeping 200 days of data) [2025-10-03T21:29:20.645160] [DEBUG] [LOCAL ] SHW: Primary data saved (51050 records). [2025-10-03T21:29:20.645315] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-03T21:29:20.645418] [INFO ] [MAIN ] Update Progress: 1914/2370 symbols completed. SHW took 36.7s. Estimated remaining: 1h 4m 9s. Rate: 7.1 symbols/min [2025-10-03T21:29:20.800996] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-03T21:29:20.835350] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:20.871126] [DEBUG] [LOCAL ] SILA: Loaded 31038 existing records from primary storage. [2025-10-03T21:29:20.871471] [INFO ] [MAIN ] SILA: Loaded 31038 existing records. [2025-10-03T21:29:21.071155] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:29:21.071449] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-03T21:29:21.071511] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-03T21:29:21.071853] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-03T21:29:21.071961] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-03T21:29:21.480289] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:29:21.590724] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-03T21:29:21.702517] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T21:29:22.390767] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-03T21:29:22.513786] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:29:22.889192] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T21:29:23.190751] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-03T21:29:23.676831] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T21:29:23.680333] [INFO ] [REMOTE ] SID: Full fetch complete (60765 records). [2025-10-03T21:29:23.680485] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-03T21:29:23.995758] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-03T21:29:24.138632] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-03T21:29:24.138743] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-03T21:29:24.139833] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-03T21:29:24.139899] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-03T21:29:24.141378] [DEBUG] [LOCAL ] SID: Trimmed 60765 records to 42878 (keeping 200 days of data) [2025-10-03T21:29:24.393417] [DEBUG] [LOCAL ] SID: Primary data saved (42878 records). [2025-10-03T21:29:24.393550] [INFO ] [MAIN ] SID: Full history saved. [2025-10-03T21:29:24.393631] [INFO ] [MAIN ] Update Progress: 1915/2370 symbols completed. SID took 33.9s. Estimated remaining: 1h 3m 60s. Rate: 7.1 symbols/min [2025-10-03T21:29:24.578026] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:24.617837] [DEBUG] [LOCAL ] SITC: Loaded 41887 existing records from primary storage. [2025-10-03T21:29:24.618185] [INFO ] [MAIN ] SITC: Loaded 41887 existing records. [2025-10-03T21:29:24.798081] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-03T21:29:24.803571] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:29:24.805279] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-03T21:29:24.805374] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-03T21:29:24.805752] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-03T21:29:24.805813] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-03T21:29:25.040156] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T21:29:25.231706] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:29:25.251350] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T21:29:25.590703] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-03T21:29:25.844839] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T21:29:26.390713] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-03T21:29:26.908259] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:29:27.190757] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-03T21:29:27.435038] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T21:29:27.990724] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-03T21:29:28.408235] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T21:29:28.410829] [INFO ] [REMOTE ] SIG: Full fetch complete (67964 records). [2025-10-03T21:29:28.410961] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-03T21:29:28.804791] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-03T21:29:28.831825] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-03T21:29:28.831959] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-03T21:29:28.833778] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-03T21:29:28.834050] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-03T21:29:28.835825] [DEBUG] [LOCAL ] SIG: Trimmed 67964 records to 46801 (keeping 200 days of data) [2025-10-03T21:29:29.149825] [DEBUG] [LOCAL ] SIG: Primary data saved (46801 records). [2025-10-03T21:29:29.149992] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-03T21:29:29.150890] [INFO ] [MAIN ] Update Progress: 1916/2370 symbols completed. SIG took 38.4s. Estimated remaining: 1h 3m 50s. Rate: 7.1 symbols/min [2025-10-03T21:29:29.346371] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:29.394122] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T21:29:29.414332] [DEBUG] [LOCAL ] SITE: Loaded 35303 existing records from primary storage. [2025-10-03T21:29:29.414624] [INFO ] [MAIN ] SITE: Loaded 35303 existing records. [2025-10-03T21:29:29.592596] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-03T21:29:29.617961] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:29:29.618421] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-03T21:29:29.618474] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-03T21:29:29.618795] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-03T21:29:29.618855] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-03T21:29:30.006064] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:29:30.076634] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T21:29:30.390716] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-03T21:29:31.046806] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T21:29:31.190756] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-03T21:29:31.998732] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-03T21:29:32.005364] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:29:32.337059] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T21:29:32.790629] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-03T21:29:32.896567] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T21:29:33.590723] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-03T21:29:33.941567] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T21:29:34.390683] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-03T21:29:34.890440] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T21:29:35.190705] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-03T21:29:35.558992] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T21:29:35.990718] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-03T21:29:36.507848] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T21:29:36.790733] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-03T21:29:37.430950] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T21:29:37.590695] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-03T21:29:38.307845] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:29:38.390687] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-03T21:29:39.115234] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:29:39.190678] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-03T21:29:39.301864] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T21:29:39.990682] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-03T21:29:40.793377] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-03T21:29:40.798984] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:29:41.046543] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T21:29:41.590755] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-03T21:29:41.948264] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T21:29:42.390706] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-03T21:29:43.190697] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-03T21:29:43.262393] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T21:29:43.335149] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T21:29:43.990830] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-03T21:29:44.737700] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T21:29:44.790692] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-03T21:29:44.872246] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T21:29:45.590718] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-03T21:29:46.311298] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T21:29:46.390752] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-03T21:29:46.709558] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T21:29:47.190738] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-03T21:29:47.262034] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:29:47.990762] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-03T21:29:48.621086] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T21:29:48.790734] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-03T21:29:49.320346] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T21:29:49.590708] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-03T21:29:49.748941] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T21:29:49.751194] [INFO ] [REMOTE ] SILA: Full fetch complete (44961 records). [2025-10-03T21:29:49.751335] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-03T21:29:50.140275] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-03T21:29:50.140383] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-03T21:29:50.142545] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-03T21:29:50.142617] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-03T21:29:50.144020] [DEBUG] [LOCAL ] SILA: Trimmed 44961 records to 31215 (keeping 200 days of data) [2025-10-03T21:29:50.376892] [DEBUG] [LOCAL ] SILA: Primary data saved (31215 records). [2025-10-03T21:29:50.377202] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-03T21:29:50.377391] [INFO ] [MAIN ] Update Progress: 1917/2370 symbols completed. SILA took 29.7s. Estimated remaining: 1h 3m 45s. Rate: 7.1 symbols/min [2025-10-03T21:29:50.390710] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-03T21:29:51.109042] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:29:51.190772] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-03T21:29:51.824215] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T21:29:51.990754] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-03T21:29:52.099746] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T21:29:52.102637] [INFO ] [REMOTE ] SII: Full fetch complete (30268 records). [2025-10-03T21:29:52.102884] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-03T21:29:52.613815] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-03T21:29:52.613903] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-03T21:29:52.614590] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-03T21:29:52.614632] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-03T21:29:52.615986] [DEBUG] [LOCAL ] SII: Trimmed 30268 records to 23889 (keeping 200 days of data) [2025-10-03T21:29:52.783766] [DEBUG] [LOCAL ] SII: Primary data saved (23889 records). [2025-10-03T21:29:52.783951] [INFO ] [MAIN ] SII: Full history saved. [2025-10-03T21:29:52.784146] [INFO ] [MAIN ] Update Progress: 1918/2370 symbols completed. SII took 41.3s. Estimated remaining: 1h 3m 35s. Rate: 7.1 symbols/min [2025-10-03T21:29:52.790826] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-03T21:29:53.523414] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T21:29:53.590773] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-03T21:29:54.148308] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T21:29:54.390717] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-03T21:29:55.166962] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T21:29:55.190619] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-03T21:29:55.466673] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T21:29:55.990712] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-03T21:29:56.801949] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T21:29:56.812638] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-03T21:29:57.083838] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T21:29:57.085841] [INFO ] [REMOTE ] SITE: Full fetch complete (49794 records). [2025-10-03T21:29:57.085943] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-03T21:29:57.490237] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-03T21:29:57.490327] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-03T21:29:57.491422] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-03T21:29:57.491490] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-03T21:29:57.492788] [DEBUG] [LOCAL ] SITE: Trimmed 49794 records to 35569 (keeping 200 days of data) [2025-10-03T21:29:57.722387] [DEBUG] [LOCAL ] SITE: Primary data saved (35569 records). [2025-10-03T21:29:57.722576] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-03T21:29:57.723284] [INFO ] [MAIN ] Update Progress: 1919/2370 symbols completed. SITE took 28.6s. Estimated remaining: 1h 3m 26s. Rate: 7.1 symbols/min [2025-10-03T21:29:57.963921] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T21:29:57.966407] [INFO ] [REMOTE ] SITC: Full fetch complete (60841 records). [2025-10-03T21:29:57.966733] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-03T21:29:58.397715] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-03T21:29:58.397808] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-03T21:29:58.398848] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-03T21:29:58.398912] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-03T21:29:58.400188] [DEBUG] [LOCAL ] SITC: Trimmed 60841 records to 42184 (keeping 200 days of data) [2025-10-03T21:29:58.663906] [DEBUG] [LOCAL ] SITC: Primary data saved (42184 records). [2025-10-03T21:29:58.664059] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-03T21:29:58.664160] [INFO ] [MAIN ] Update Progress: 1920/2370 symbols completed. SITC took 34.3s. Estimated remaining: 1h 3m 15s. Rate: 7.1 symbols/min [2025-10-03T21:29:59.347541] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:59.431444] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:59.493247] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:59.470147] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:29:59.501347] [DEBUG] [LOCAL ] SKIL: Loaded 6387 existing records from primary storage. [2025-10-03T21:29:59.508015] [INFO ] [MAIN ] SKIL: Loaded 6387 existing records. [2025-10-03T21:29:59.606630] [DEBUG] [LOCAL ] SJT: Loaded 22551 existing records from primary storage. [2025-10-03T21:29:59.638958] [INFO ] [MAIN ] SJT: Loaded 22551 existing records. [2025-10-03T21:29:59.813545] [DEBUG] [LOCAL ] SKE: Loaded 36337 existing records from primary storage. [2025-10-03T21:29:59.875480] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:29:59.869241] [INFO ] [MAIN ] SKE: Loaded 36337 existing records. [2025-10-03T21:29:59.887266] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-03T21:29:59.893764] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-03T21:29:59.965134] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-03T21:30:00.020999] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-03T21:30:00.066775] [DEBUG] [LOCAL ] SJM: Loaded 50512 existing records from primary storage. [2025-10-03T21:30:00.171317] [INFO ] [MAIN ] SJM: Loaded 50512 existing records. [2025-10-03T21:30:00.266715] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:00.378736] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-03T21:30:00.398721] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-03T21:30:00.452636] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-03T21:30:00.436782] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:00.469256] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-03T21:30:00.475114] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-03T21:30:00.491465] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-03T21:30:00.613400] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-03T21:30:00.703295] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-03T21:30:00.742391] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:00.893218] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-03T21:30:00.956832] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-03T21:30:01.103317] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-03T21:30:01.123091] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-03T21:30:01.428499] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:01.542097] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-03T21:30:01.816502] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:01.894668] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-03T21:30:02.067968] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:02.093994] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-03T21:30:02.183935] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:02.184264] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-03T21:30:02.441088] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T21:30:02.443335] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-03T21:30:03.103630] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T21:30:03.110132] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-03T21:30:03.249420] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T21:30:03.253305] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-03T21:30:03.479311] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T21:30:03.486792] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-03T21:30:04.008235] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T21:30:04.019117] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-03T21:30:04.047091] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T21:30:04.215001] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T21:30:04.771613] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T21:30:04.790632] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-03T21:30:05.388893] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T21:30:05.590702] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-03T21:30:06.127857] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T21:30:06.309745] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T21:30:06.390682] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-03T21:30:07.190728] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-03T21:30:07.981015] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T21:30:08.000095] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-03T21:30:08.021179] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:30:08.617182] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T21:30:08.790716] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-03T21:30:09.590688] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-03T21:30:09.624016] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T21:30:10.390691] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-03T21:30:10.646033] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:30:11.160353] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T21:30:11.190612] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-03T21:30:11.799111] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T21:30:11.990685] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-03T21:30:12.790708] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-03T21:30:13.360775] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T21:30:13.505103] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T21:30:13.590727] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-03T21:30:14.200554] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:30:14.201795] [INFO ] [REMOTE ] SKIL: Full fetch complete (10017 records). [2025-10-03T21:30:14.201876] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-03T21:30:14.396040] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-03T21:30:14.619366] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-03T21:30:14.619449] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-03T21:30:14.619769] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-03T21:30:14.619837] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-03T21:30:14.620375] [DEBUG] [LOCAL ] SKIL: Trimmed 10017 records to 6547 (keeping 200 days of data) [2025-10-03T21:30:14.660062] [DEBUG] [LOCAL ] SKIL: Primary data saved (6547 records). [2025-10-03T21:30:14.660194] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-03T21:30:14.660282] [INFO ] [MAIN ] Update Progress: 1921/2370 symbols completed. SKIL took 16.0s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-03T21:30:14.842084] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:14.855900] [DEBUG] [LOCAL ] SKLZ: Loaded 11809 existing records from primary storage. [2025-10-03T21:30:14.856176] [INFO ] [MAIN ] SKLZ: Loaded 11809 existing records. [2025-10-03T21:30:15.056150] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:15.056459] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-03T21:30:15.056520] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-03T21:30:15.056755] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-03T21:30:15.056815] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-03T21:30:15.205844] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-03T21:30:15.438352] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:15.990632] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-03T21:30:16.427932] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T21:30:16.540490] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T21:30:16.790747] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-03T21:30:17.241138] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T21:30:17.590730] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-03T21:30:18.350395] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T21:30:18.390621] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-03T21:30:18.681895] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T21:30:19.190726] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-03T21:30:19.990756] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-03T21:30:20.052314] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T21:30:20.597717] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T21:30:20.623569] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T21:30:20.790710] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-03T21:30:21.590732] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-03T21:30:21.611456] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T21:30:22.390727] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-03T21:30:23.190684] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-03T21:30:23.440165] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T21:30:23.641424] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T21:30:23.990675] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-03T21:30:24.712622] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:30:24.790683] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-03T21:30:25.219773] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T21:30:25.590684] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-03T21:30:25.909695] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T21:30:26.390730] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-03T21:30:27.065166] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T21:30:27.190709] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-03T21:30:27.372032] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:30:27.990771] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-03T21:30:28.217012] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T21:30:28.790775] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-03T21:30:29.590711] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-03T21:30:29.785170] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T21:30:29.812780] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T21:30:30.390707] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-03T21:30:30.594144] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T21:30:31.190726] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-03T21:30:31.482970] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T21:30:31.990731] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-03T21:30:32.752471] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T21:30:32.791167] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:30:32.791283] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-03T21:30:33.590695] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-03T21:30:33.906299] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T21:30:34.390703] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-03T21:30:34.981385] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T21:30:34.984329] [INFO ] [REMOTE ] SJM: Full fetch complete (72131 records). [2025-10-03T21:30:34.984497] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-03T21:30:35.191940] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-03T21:30:35.223701] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T21:30:35.267567] [INFO ] [REMOTE ] SJT: Full fetch complete (32054 records). [2025-10-03T21:30:35.287524] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-03T21:30:35.667038] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-03T21:30:35.667917] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-03T21:30:35.698839] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-03T21:30:35.736392] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-03T21:30:35.833342] [DEBUG] [LOCAL ] SJM: Trimmed 72131 records to 50853 (keeping 200 days of data) [2025-10-03T21:30:35.997471] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-03T21:30:36.045427] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-03T21:30:36.048115] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-03T21:30:36.050026] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-03T21:30:36.050635] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-03T21:30:36.057215] [DEBUG] [LOCAL ] SJT: Trimmed 32054 records to 22695 (keeping 200 days of data) [2025-10-03T21:30:36.163692] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T21:30:36.348290] [DEBUG] [LOCAL ] SJT: Primary data saved (22695 records). [2025-10-03T21:30:36.349700] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-03T21:30:36.349966] [INFO ] [MAIN ] Update Progress: 1922/2370 symbols completed. SJT took 37.7s. Estimated remaining: 1h 3m 3s. Rate: 7.1 symbols/min [2025-10-03T21:30:36.555534] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:36.609310] [DEBUG] [LOCAL ] SKM: Loaded 35157 existing records from primary storage. [2025-10-03T21:30:36.615214] [INFO ] [MAIN ] SKM: Loaded 35157 existing records. [2025-10-03T21:30:36.795753] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-03T21:30:36.868738] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:36.871412] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-03T21:30:36.872146] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-03T21:30:36.873811] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-03T21:30:36.874138] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-03T21:30:37.255515] [DEBUG] [LOCAL ] SJM: Primary data saved (50853 records). [2025-10-03T21:30:37.271343] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-03T21:30:37.292819] [INFO ] [MAIN ] Update Progress: 1923/2370 symbols completed. SJM took 38.6s. Estimated remaining: 1h 2m 53s. Rate: 7.1 symbols/min [2025-10-03T21:30:37.356237] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:37.455383] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T21:30:37.462439] [INFO ] [REMOTE ] SKE: Full fetch complete (50695 records). [2025-10-03T21:30:37.489050] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-03T21:30:37.548614] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:37.591937] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-03T21:30:37.787428] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T21:30:37.952872] [DEBUG] [LOCAL ] SKT: Loaded 42800 existing records from primary storage. [2025-10-03T21:30:37.993084] [INFO ] [MAIN ] SKT: Loaded 42800 existing records. [2025-10-03T21:30:38.079465] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-03T21:30:38.105102] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-03T21:30:38.122801] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-03T21:30:38.134529] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-03T21:30:38.180285] [DEBUG] [LOCAL ] SKE: Trimmed 50695 records to 36657 (keeping 200 days of data) [2025-10-03T21:30:38.302610] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:38.312038] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-03T21:30:38.339776] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-03T21:30:38.341442] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-03T21:30:38.342944] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-03T21:30:38.394299] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-03T21:30:38.772214] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:38.890713] [DEBUG] [LOCAL ] SKE: Primary data saved (36657 records). [2025-10-03T21:30:38.890878] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-03T21:30:38.893044] [INFO ] [MAIN ] Update Progress: 1924/2370 symbols completed. SKE took 40.2s. Estimated remaining: 1h 2m 43s. Rate: 7.1 symbols/min [2025-10-03T21:30:39.077579] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:39.101507] [DEBUG] [LOCAL ] SKY: No existing data file found in primary storage. [2025-10-03T21:30:39.101616] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-10-03T21:30:39.101857] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-03T21:30:39.101936] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-03T21:30:39.102073] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-03T21:30:39.103101] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-03T21:30:39.110015] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T21:30:39.191985] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-03T21:30:39.383034] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T21:30:39.518738] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:39.990714] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-03T21:30:40.419182] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T21:30:40.790733] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-03T21:30:41.590709] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-03T21:30:41.780757] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T21:30:42.238439] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T21:30:42.396262] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-03T21:30:42.405873] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T21:30:43.190746] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-03T21:30:43.504200] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T21:30:43.990735] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-03T21:30:44.601576] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T21:30:44.790747] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-03T21:30:45.016176] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T21:30:45.590788] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-03T21:30:46.327837] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T21:30:46.390696] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-03T21:30:46.633311] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T21:30:47.190712] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-03T21:30:47.611829] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T21:30:47.990768] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-03T21:30:48.615798] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T21:30:48.790719] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-03T21:30:48.886116] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T21:30:49.590717] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-03T21:30:50.258813] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T21:30:50.390696] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-03T21:30:51.153759] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T21:30:51.190698] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-03T21:30:51.973602] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T21:30:51.990606] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-03T21:30:52.624407] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T21:30:52.790719] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-03T21:30:53.476635] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T21:30:53.477916] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18748 records). [2025-10-03T21:30:53.478005] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-03T21:30:53.592310] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-03T21:30:53.926627] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-03T21:30:53.929273] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-03T21:30:53.930016] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-03T21:30:53.930101] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-03T21:30:53.932154] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T21:30:53.943493] [DEBUG] [LOCAL ] SKLZ: Trimmed 18748 records to 11895 (keeping 200 days of data) [2025-10-03T21:30:54.013661] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11895 records). [2025-10-03T21:30:54.013818] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-03T21:30:54.013908] [INFO ] [MAIN ] Update Progress: 1925/2370 symbols completed. SKLZ took 39.4s. Estimated remaining: 1h 2m 36s. Rate: 7.1 symbols/min [2025-10-03T21:30:54.196715] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:54.215179] [DEBUG] [LOCAL ] SKYH: Loaded 16683 existing records from primary storage. [2025-10-03T21:30:54.215429] [INFO ] [MAIN ] SKYH: Loaded 16683 existing records. [2025-10-03T21:30:54.403218] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-03T21:30:54.410473] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:54.411775] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-03T21:30:54.411838] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-03T21:30:54.412122] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-03T21:30:54.412184] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-03T21:30:54.811133] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:54.967732] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T21:30:55.190713] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-03T21:30:55.948269] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T21:30:55.990742] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-03T21:30:56.741875] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T21:30:56.790693] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-03T21:30:56.879414] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T21:30:57.590704] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-03T21:30:58.127954] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T21:30:58.343129] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T21:30:58.347008] [INFO ] [REMOTE ] SKM: Full fetch complete (48177 records). [2025-10-03T21:30:58.347129] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-03T21:30:58.395896] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-03T21:30:58.764452] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-03T21:30:58.764548] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-03T21:30:58.765575] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-03T21:30:58.765664] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-03T21:30:58.766885] [DEBUG] [LOCAL ] SKM: Trimmed 48177 records to 35367 (keeping 200 days of data) [2025-10-03T21:30:58.985783] [DEBUG] [LOCAL ] SKM: Primary data saved (35367 records). [2025-10-03T21:30:58.985966] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-03T21:30:58.986102] [INFO ] [MAIN ] Update Progress: 1926/2370 symbols completed. SKM took 22.6s. Estimated remaining: 1h 2m 27s. Rate: 7.1 symbols/min [2025-10-03T21:30:59.168383] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:30:59.197522] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-03T21:30:59.220215] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-03T21:30:59.220558] [INFO ] [MAIN ] SLB: Loaded 54087 existing records. [2025-10-03T21:30:59.408426] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:30:59.408708] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-03T21:30:59.408768] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-03T21:30:59.409309] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-03T21:30:59.409369] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-03T21:30:59.814520] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:30:59.990702] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-03T21:31:00.134165] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T21:31:00.790768] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-03T21:31:00.887360] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:31:01.590692] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-03T21:31:01.765210] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T21:31:02.157301] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T21:31:02.390709] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-03T21:31:03.142698] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T21:31:03.190705] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-03T21:31:03.990720] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-03T21:31:04.687260] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T21:31:04.790677] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-03T21:31:04.873503] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-03T21:31:05.478596] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T21:31:05.590702] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-03T21:31:05.662557] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T21:31:06.390668] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-03T21:31:07.053759] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T21:31:07.190764] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-03T21:31:07.611555] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T21:31:07.614031] [INFO ] [REMOTE ] SKT: Full fetch complete (60479 records). [2025-10-03T21:31:07.614150] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-03T21:31:07.995775] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-03T21:31:08.044680] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-03T21:31:08.044770] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-03T21:31:08.045973] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-03T21:31:08.046041] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-03T21:31:08.047606] [DEBUG] [LOCAL ] SKT: Trimmed 60479 records to 43120 (keeping 200 days of data) [2025-10-03T21:31:08.313398] [DEBUG] [LOCAL ] SKT: Primary data saved (43120 records). [2025-10-03T21:31:08.313535] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-03T21:31:08.313624] [INFO ] [MAIN ] Update Progress: 1927/2370 symbols completed. SKT took 31.0s. Estimated remaining: 1h 2m 19s. Rate: 7.1 symbols/min [2025-10-03T21:31:08.515050] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:31:08.558470] [DEBUG] [LOCAL ] SLF: Loaded 38970 existing records from primary storage. [2025-10-03T21:31:08.558824] [INFO ] [MAIN ] SLF: Loaded 38970 existing records. [2025-10-03T21:31:08.757235] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:31:08.757731] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-03T21:31:08.757841] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-03T21:31:08.758458] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-03T21:31:08.758530] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-03T21:31:08.800984] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-03T21:31:08.906897] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T21:31:09.193475] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:31:09.590688] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-03T21:31:09.654716] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T21:31:09.900549] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T21:31:10.390704] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-03T21:31:10.617909] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T21:31:11.190700] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-03T21:31:11.990722] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-03T21:31:12.267472] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T21:31:12.405830] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T21:31:12.790704] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-03T21:31:13.357476] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T21:31:13.590708] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-03T21:31:13.822626] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T21:31:14.390699] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-03T21:31:15.099335] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T21:31:15.190718] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-03T21:31:15.856598] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T21:31:15.990694] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-03T21:31:16.166006] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T21:31:16.790693] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-03T21:31:17.590692] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-03T21:31:18.303350] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-03T21:31:18.390735] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-03T21:31:18.455584] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T21:31:18.578416] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T21:31:19.190733] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-03T21:31:19.872027] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T21:31:19.918719] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T21:31:19.990715] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-03T21:31:20.790694] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-03T21:31:21.590689] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-03T21:31:21.830046] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T21:31:22.016776] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T21:31:22.390681] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-03T21:31:23.100791] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T21:31:23.190680] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-03T21:31:23.373259] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T21:31:23.990721] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-03T21:31:24.558432] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T21:31:24.559719] [INFO ] [REMOTE ] SKYH: Full fetch complete (22274 records). [2025-10-03T21:31:24.559795] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-03T21:31:24.796023] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-03T21:31:24.996937] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-03T21:31:25.006958] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-03T21:31:25.008254] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-03T21:31:25.009438] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T21:31:25.009675] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-03T21:31:25.020759] [DEBUG] [LOCAL ] SKYH: Trimmed 22274 records to 16789 (keeping 200 days of data) [2025-10-03T21:31:25.135389] [DEBUG] [LOCAL ] SKYH: Primary data saved (16789 records). [2025-10-03T21:31:25.135546] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-03T21:31:25.135732] [INFO ] [MAIN ] Update Progress: 1928/2370 symbols completed. SKYH took 31.1s. Estimated remaining: 1h 2m 12s. Rate: 7.1 symbols/min [2025-10-03T21:31:25.317946] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:31:25.367324] [DEBUG] [LOCAL ] SLG: Loaded 45570 existing records from primary storage. [2025-10-03T21:31:25.367752] [INFO ] [MAIN ] SLG: Loaded 45570 existing records. [2025-10-03T21:31:25.560222] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:31:25.560485] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-03T21:31:25.560545] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-03T21:31:25.560890] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-03T21:31:25.560950] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-03T21:31:25.595845] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-03T21:31:25.971745] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:31:26.050022] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T21:31:26.063142] [INFO ] [REMOTE ] SKY: Full fetch complete (54515 records). [2025-10-03T21:31:26.063448] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-03T21:31:26.395826] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-03T21:31:26.482735] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-03T21:31:26.482875] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-03T21:31:26.484778] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-03T21:31:26.484880] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-03T21:31:26.486742] [DEBUG] [LOCAL ] SKY: Trimmed 54515 records to 38237 (keeping 200 days of data) [2025-10-03T21:31:26.761920] [DEBUG] [LOCAL ] SKY: Primary data saved (38237 records). [2025-10-03T21:31:26.762160] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-03T21:31:26.762301] [INFO ] [MAIN ] Update Progress: 1929/2370 symbols completed. SKY took 47.9s. Estimated remaining: 1h 2m 2s. Rate: 7.1 symbols/min [2025-10-03T21:31:26.970471] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:31:27.017079] [DEBUG] [LOCAL ] SLGN: Loaded 40713 existing records from primary storage. [2025-10-03T21:31:27.017472] [INFO ] [MAIN ] SLGN: Loaded 40713 existing records. [2025-10-03T21:31:27.191190] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-03T21:31:27.198426] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T21:31:27.248300] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:31:27.249712] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-03T21:31:27.249797] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-03T21:31:27.250919] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-03T21:31:27.250984] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-03T21:31:27.633464] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:31:27.990705] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-03T21:31:28.526133] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T21:31:28.790708] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-03T21:31:28.956214] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T21:31:29.579318] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:31:29.590616] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-03T21:31:30.390687] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-03T21:31:31.090025] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-03T21:31:31.187148] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:31:31.196802] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-03T21:31:31.970887] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T21:31:31.990632] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-03T21:31:32.794297] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-03T21:31:32.799440] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T21:31:33.574301] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T21:31:33.590635] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-03T21:31:34.361345] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T21:31:34.390619] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-03T21:31:35.190662] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-03T21:31:35.358774] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T21:31:35.869817] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T21:31:35.990696] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-03T21:31:36.647780] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T21:31:36.790731] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-03T21:31:37.538033] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T21:31:37.590721] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-03T21:31:38.318234] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T21:31:38.390710] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-03T21:31:39.190634] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-03T21:31:39.280684] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T21:31:39.990701] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-03T21:31:40.039399] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:31:40.790747] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-03T21:31:40.962179] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T21:31:41.023953] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T21:31:41.028153] [INFO ] [REMOTE ] SLF: Full fetch complete (56255 records). [2025-10-03T21:31:41.028250] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-03T21:31:41.447521] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-03T21:31:41.447612] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-03T21:31:41.448838] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-03T21:31:41.448907] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-03T21:31:41.452640] [DEBUG] [LOCAL ] SLF: Trimmed 56255 records to 39218 (keeping 200 days of data) [2025-10-03T21:31:41.590707] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-03T21:31:41.715355] [DEBUG] [LOCAL ] SLF: Primary data saved (39218 records). [2025-10-03T21:31:41.715525] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-03T21:31:41.715635] [INFO ] [MAIN ] Update Progress: 1930/2370 symbols completed. SLF took 33.4s. Estimated remaining: 1h 1m 55s. Rate: 7.1 symbols/min [2025-10-03T21:31:41.910792] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:31:41.911001] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-03T21:31:41.911053] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-03T21:31:41.911208] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-03T21:31:41.911263] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-03T21:31:41.911349] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-03T21:31:41.911392] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-03T21:31:42.298017] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:31:42.390677] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-03T21:31:42.487639] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T21:31:43.190682] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-03T21:31:43.339418] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T21:31:43.342758] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-03T21:31:43.342931] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-03T21:31:43.818595] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-03T21:31:43.818754] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-03T21:31:43.819971] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-03T21:31:43.820120] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-03T21:31:43.821964] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54477 (keeping 200 days of data) [2025-10-03T21:31:43.960989] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T21:31:43.990869] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-03T21:31:44.241342] [DEBUG] [LOCAL ] SLB: Primary data saved (54477 records). [2025-10-03T21:31:44.241507] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-03T21:31:44.241624] [INFO ] [MAIN ] Update Progress: 1931/2370 symbols completed. SLB took 45.3s. Estimated remaining: 1h 1m 46s. Rate: 7.1 symbols/min [2025-10-03T21:31:44.359479] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-03T21:31:44.445949] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:31:44.494201] [DEBUG] [LOCAL ] SLQT: Loaded 43830 existing records from primary storage. [2025-10-03T21:31:44.494591] [INFO ] [MAIN ] SLQT: Loaded 43830 existing records. [2025-10-03T21:31:44.703908] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:31:44.704347] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-03T21:31:44.704409] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-03T21:31:44.712106] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-03T21:31:44.717898] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-03T21:31:44.765825] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:31:44.793585] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-03T21:31:45.140991] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:31:45.590724] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-03T21:31:45.936991] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T21:31:46.390625] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-03T21:31:46.657195] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T21:31:46.708478] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-03T21:31:47.190732] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-03T21:31:47.509814] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-03T21:31:47.990703] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-03T21:31:48.322081] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-03T21:31:48.790698] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-03T21:31:49.590687] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-03T21:31:50.390718] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-03T21:31:50.461062] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T21:31:51.031444] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T21:31:51.190718] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-03T21:31:51.950171] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T21:31:51.990694] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-03T21:31:52.722491] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T21:31:52.790675] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-03T21:31:53.451226] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T21:31:53.590702] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-03T21:31:53.987627] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-03T21:31:54.390736] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-03T21:31:54.437702] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T21:31:55.190710] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-03T21:31:55.996684] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-03T21:31:56.015155] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:31:56.733391] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T21:31:56.790673] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-03T21:31:57.590710] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-03T21:31:57.641488] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T21:31:58.390691] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-03T21:31:58.513816] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T21:31:58.750990] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T21:31:59.190690] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-03T21:31:59.916265] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T21:31:59.990665] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-03T21:32:00.379113] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T21:32:00.381308] [INFO ] [REMOTE ] SLG: Full fetch complete (65015 records). [2025-10-03T21:32:00.381428] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-03T21:32:00.471469] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T21:32:00.791560] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-03T21:32:00.836011] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-03T21:32:00.836108] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-03T21:32:00.837390] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-03T21:32:00.837459] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-03T21:32:00.839176] [DEBUG] [LOCAL ] SLG: Trimmed 65015 records to 45832 (keeping 200 days of data) [2025-10-03T21:32:01.142439] [DEBUG] [LOCAL ] SLG: Primary data saved (45832 records). [2025-10-03T21:32:01.142576] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-03T21:32:01.142706] [INFO ] [MAIN ] Update Progress: 1932/2370 symbols completed. SLG took 36.0s. Estimated remaining: 1h 1m 39s. Rate: 7.1 symbols/min [2025-10-03T21:32:01.343372] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:01.373554] [DEBUG] [LOCAL ] SLVM: Loaded 28253 existing records from primary storage. [2025-10-03T21:32:01.373939] [INFO ] [MAIN ] SLVM: Loaded 28253 existing records. [2025-10-03T21:32:01.574993] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:01.575335] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-03T21:32:01.575390] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-03T21:32:01.575739] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-03T21:32:01.575802] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-03T21:32:01.597458] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-03T21:32:01.975366] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:01.992885] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:32:01.995755] [INFO ] [REMOTE ] SLGN: Full fetch complete (58593 records). [2025-10-03T21:32:01.996082] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-03T21:32:02.086607] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T21:32:02.399095] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-03T21:32:02.422097] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-03T21:32:02.422201] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-03T21:32:02.423333] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-03T21:32:02.423517] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-03T21:32:02.425164] [DEBUG] [LOCAL ] SLGN: Trimmed 58593 records to 41038 (keeping 200 days of data) [2025-10-03T21:32:02.694924] [DEBUG] [LOCAL ] SLGN: Primary data saved (41038 records). [2025-10-03T21:32:02.695060] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-03T21:32:02.696051] [INFO ] [MAIN ] Update Progress: 1933/2370 symbols completed. SLGN took 35.9s. Estimated remaining: 1h 1m 29s. Rate: 7.1 symbols/min [2025-10-03T21:32:02.816788] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T21:32:02.900017] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:02.957888] [DEBUG] [LOCAL ] SM: Loaded 52712 existing records from primary storage. [2025-10-03T21:32:02.958252] [INFO ] [MAIN ] SM: Loaded 52712 existing records. [2025-10-03T21:32:03.180206] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:03.180418] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-03T21:32:03.180467] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-03T21:32:03.182030] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-03T21:32:03.182092] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-03T21:32:03.195886] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-03T21:32:03.581852] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:03.990711] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-03T21:32:04.450044] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T21:32:04.790735] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-03T21:32:05.590736] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-03T21:32:05.637866] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T21:32:05.707262] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T21:32:05.945972] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T21:32:06.390730] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-03T21:32:06.634382] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-03T21:32:06.635286] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1054 records). [2025-10-03T21:32:06.635358] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-03T21:32:06.833760] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T21:32:06.833999] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:32:06.834106] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:32:06.834182] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-03T21:32:06.834267] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-03T21:32:06.834326] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-03T21:32:06.834452] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-03T21:32:06.834593] [INFO ] [MAIN ] Update Progress: 1934/2370 symbols completed. SLNZ took 25.1s. Estimated remaining: 1h 1m 20s. Rate: 7.1 symbols/min [2025-10-03T21:32:07.024295] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:07.024502] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-03T21:32:07.024541] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-03T21:32:07.024684] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-03T21:32:07.024739] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-03T21:32:07.024781] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-03T21:32:07.024813] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-03T21:32:07.192899] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-03T21:32:07.445391] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:07.990729] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-03T21:32:08.457478] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:32:08.458179] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-03T21:32:08.458300] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:32:08.458378] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-03T21:32:08.458446] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:32:08.458523] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-03T21:32:08.458601] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-03T21:32:08.458667] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-03T21:32:08.458752] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-03T21:32:08.459067] [INFO ] [MAIN ] Update Progress: 1935/2370 symbols completed. SMA took 1.6s. Estimated remaining: 1h 1m 10s. Rate: 7.1 symbols/min [2025-10-03T21:32:08.663514] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:08.675341] [DEBUG] [LOCAL ] SMBK: Loaded 8194 existing records from primary storage. [2025-10-03T21:32:08.675595] [INFO ] [MAIN ] SMBK: Loaded 8194 existing records. [2025-10-03T21:32:08.790807] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-03T21:32:08.886096] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:08.886451] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-03T21:32:08.886670] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-03T21:32:08.886996] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-03T21:32:08.887067] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-03T21:32:09.080949] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T21:32:09.405595] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:09.590750] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-03T21:32:10.390693] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-03T21:32:10.589587] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T21:32:11.053464] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T21:32:11.190743] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-03T21:32:11.685961] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T21:32:11.990724] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-03T21:32:12.790697] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-03T21:32:12.885309] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:32:12.951287] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T21:32:13.590723] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-03T21:32:13.601816] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T21:32:14.390719] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-03T21:32:14.841287] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T21:32:15.190668] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-03T21:32:15.243702] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T21:32:15.990783] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-03T21:32:16.694629] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T21:32:16.790743] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-03T21:32:17.555192] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T21:32:17.590690] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-03T21:32:17.934135] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T21:32:18.390754] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-03T21:32:19.190796] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-03T21:32:19.348199] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T21:32:19.990672] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-03T21:32:20.072507] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T21:32:20.140544] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T21:32:20.633146] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T21:32:20.790639] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-03T21:32:21.590720] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-03T21:32:22.390685] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-03T21:32:22.646951] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:32:23.190725] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-03T21:32:23.244316] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T21:32:23.357386] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T21:32:23.677811] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T21:32:23.990728] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-03T21:32:24.790634] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-03T21:32:25.232510] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T21:32:25.590722] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-03T21:32:26.355021] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T21:32:26.390623] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-03T21:32:26.561627] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T21:32:26.564079] [INFO ] [REMOTE ] SLVM: Full fetch complete (40069 records). [2025-10-03T21:32:26.564239] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-03T21:32:26.945018] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-03T21:32:26.945134] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-03T21:32:26.946661] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-03T21:32:26.946729] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-03T21:32:26.947952] [DEBUG] [LOCAL ] SLVM: Trimmed 40069 records to 28511 (keeping 200 days of data) [2025-10-03T21:32:27.146070] [DEBUG] [LOCAL ] SLVM: Primary data saved (28511 records). [2025-10-03T21:32:27.146341] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-03T21:32:27.146520] [INFO ] [MAIN ] Update Progress: 1936/2370 symbols completed. SLVM took 26.0s. Estimated remaining: 1h 1m 4s. Rate: 7.1 symbols/min [2025-10-03T21:32:27.195794] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-03T21:32:27.326630] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:27.341126] [DEBUG] [LOCAL ] SMC: Loaded 11513 existing records from primary storage. [2025-10-03T21:32:27.341429] [INFO ] [MAIN ] SMC: Loaded 11513 existing records. [2025-10-03T21:32:27.522075] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:27.522356] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-03T21:32:27.522410] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-03T21:32:27.522755] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-03T21:32:27.522823] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-03T21:32:27.934162] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:27.990683] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-03T21:32:28.102905] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T21:32:28.102404] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T21:32:28.790769] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-03T21:32:29.025292] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T21:32:29.029168] [INFO ] [REMOTE ] SLQT: Full fetch complete (63859 records). [2025-10-03T21:32:29.029407] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-03T21:32:29.593137] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-03T21:32:29.614887] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-03T21:32:29.616590] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-03T21:32:29.619336] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-03T21:32:29.619750] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-03T21:32:29.622145] [DEBUG] [LOCAL ] SLQT: Trimmed 63859 records to 44168 (keeping 200 days of data) [2025-10-03T21:32:29.743398] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T21:32:29.942745] [DEBUG] [LOCAL ] SLQT: Primary data saved (44168 records). [2025-10-03T21:32:29.942901] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-03T21:32:29.943036] [INFO ] [MAIN ] Update Progress: 1937/2370 symbols completed. SLQT took 45.7s. Estimated remaining: 1h 0m 54s. Rate: 7.1 symbols/min [2025-10-03T21:32:30.135831] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:30.189817] [DEBUG] [LOCAL ] SMFG: Loaded 48480 existing records from primary storage. [2025-10-03T21:32:30.190153] [INFO ] [MAIN ] SMFG: Loaded 48480 existing records. [2025-10-03T21:32:30.391928] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-03T21:32:30.396240] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:30.397948] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-03T21:32:30.398037] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-03T21:32:30.399354] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-03T21:32:30.399441] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-03T21:32:30.505814] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T21:32:30.808857] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:31.190719] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-03T21:32:31.288953] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T21:32:31.990719] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-03T21:32:32.790742] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-03T21:32:33.456307] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T21:32:33.578171] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T21:32:33.590619] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-03T21:32:33.685466] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:32:34.390679] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-03T21:32:34.425388] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T21:32:35.186427] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T21:32:35.190602] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-03T21:32:35.969221] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:32:35.990677] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-03T21:32:36.790744] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-03T21:32:36.798527] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T21:32:37.590690] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-03T21:32:37.745488] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T21:32:38.304137] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T21:32:38.390743] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-03T21:32:39.190721] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-03T21:32:39.754275] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T21:32:39.755389] [INFO ] [REMOTE ] SMBK: Full fetch complete (11777 records). [2025-10-03T21:32:39.755473] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-03T21:32:40.001520] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-03T21:32:40.184799] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-03T21:32:40.184951] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-03T21:32:40.185419] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-03T21:32:40.185626] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-03T21:32:40.186536] [DEBUG] [LOCAL ] SMBK: Trimmed 11777 records to 8281 (keeping 200 days of data) [2025-10-03T21:32:40.256934] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T21:32:40.284901] [DEBUG] [LOCAL ] SMBK: Primary data saved (8281 records). [2025-10-03T21:32:40.285057] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-03T21:32:40.285189] [INFO ] [MAIN ] Update Progress: 1938/2370 symbols completed. SMBK took 31.8s. Estimated remaining: 1h 0m 46s. Rate: 7.1 symbols/min [2025-10-03T21:32:40.487628] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:40.530490] [DEBUG] [LOCAL ] SMG: Loaded 43987 existing records from primary storage. [2025-10-03T21:32:40.530856] [INFO ] [MAIN ] SMG: Loaded 43987 existing records. [2025-10-03T21:32:40.737482] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:40.737766] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-03T21:32:40.737822] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-03T21:32:40.739062] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-03T21:32:40.739127] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-03T21:32:40.794985] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-03T21:32:40.879735] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T21:32:41.154961] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:41.590701] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-03T21:32:42.376981] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T21:32:42.390692] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-03T21:32:42.779620] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T21:32:43.190727] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-03T21:32:43.990724] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-03T21:32:44.042967] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T21:32:44.790686] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-03T21:32:44.874327] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T21:32:45.032936] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:32:45.590736] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-03T21:32:46.390633] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-03T21:32:46.427380] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T21:32:46.950233] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T21:32:46.952989] [INFO ] [REMOTE ] SM: Full fetch complete (75418 records). [2025-10-03T21:32:46.953099] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-03T21:32:47.198517] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-03T21:32:47.300502] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T21:32:47.407009] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-03T21:32:47.407103] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-03T21:32:47.408559] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-03T21:32:47.408637] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-03T21:32:47.410731] [DEBUG] [LOCAL ] SM: Trimmed 75418 records to 53098 (keeping 200 days of data) [2025-10-03T21:32:47.752516] [DEBUG] [LOCAL ] SM: Primary data saved (53098 records). [2025-10-03T21:32:47.752679] [INFO ] [MAIN ] SM: Full history saved. [2025-10-03T21:32:47.753697] [INFO ] [MAIN ] Update Progress: 1939/2370 symbols completed. SM took 45.1s. Estimated remaining: 1h 0m 37s. Rate: 7.1 symbols/min [2025-10-03T21:32:47.938772] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:47.955003] [DEBUG] [LOCAL ] SMHI: Loaded 13233 existing records from primary storage. [2025-10-03T21:32:47.955271] [INFO ] [MAIN ] SMHI: Loaded 13233 existing records. [2025-10-03T21:32:47.995925] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-03T21:32:48.153514] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:32:48.153787] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-03T21:32:48.153839] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-03T21:32:48.154358] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-03T21:32:48.154420] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-03T21:32:48.559049] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:48.750479] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T21:32:48.790676] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-03T21:32:48.841319] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T21:32:49.590735] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-03T21:32:50.178696] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T21:32:50.180056] [INFO ] [REMOTE ] SMC: Full fetch complete (16507 records). [2025-10-03T21:32:50.180136] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-03T21:32:50.395892] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-03T21:32:50.620760] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-03T21:32:50.620615] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:32:50.629608] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-03T21:32:50.630493] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-03T21:32:50.631029] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-03T21:32:50.632023] [DEBUG] [LOCAL ] SMC: Trimmed 16507 records to 11572 (keeping 200 days of data) [2025-10-03T21:32:50.702592] [DEBUG] [LOCAL ] SMC: Primary data saved (11572 records). [2025-10-03T21:32:50.702773] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-03T21:32:50.702872] [INFO ] [MAIN ] Update Progress: 1940/2370 symbols completed. SMC took 23.6s. Estimated remaining: 1h 0m 28s. Rate: 7.1 symbols/min [2025-10-03T21:32:50.905033] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:32:50.905239] [DEBUG] [LOCAL ] SMP: No existing data file found in primary storage. [2025-10-03T21:32:50.905283] [WARN ] [MAIN ] SMP: No existing data found, performing full refresh instead. [2025-10-03T21:32:50.905407] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-03T21:32:50.905460] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-03T21:32:50.905513] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-03T21:32:50.905552] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-03T21:32:51.195879] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-03T21:32:51.298042] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:32:51.990728] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-03T21:32:52.185368] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T21:32:52.521103] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T21:32:52.790737] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-03T21:32:52.910744] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T21:32:53.590712] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-03T21:32:53.901195] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T21:32:54.390685] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-03T21:32:55.190718] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-03T21:32:55.329871] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T21:32:55.385575] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T21:32:55.990726] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-03T21:32:56.790636] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-03T21:32:56.911847] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T21:32:56.948746] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T21:32:57.590732] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-03T21:32:58.388714] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T21:32:58.391723] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-03T21:32:58.630867] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T21:32:59.190636] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-03T21:32:59.430066] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T21:32:59.990709] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-03T21:33:00.695357] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T21:33:00.790693] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-03T21:33:01.405304] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T21:33:01.590729] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-03T21:33:02.335700] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T21:33:02.390701] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-03T21:33:02.620074] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T21:33:03.190691] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-03T21:33:03.990728] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-03T21:33:04.284964] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T21:33:04.795771] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-03T21:33:04.811577] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T21:33:04.860665] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T21:33:05.596289] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-03T21:33:05.599004] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T21:33:06.390709] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-03T21:33:07.191375] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T21:33:07.191508] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-03T21:33:07.615741] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T21:33:07.990685] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-03T21:33:08.035862] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T21:33:08.790684] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-03T21:33:09.059298] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T21:33:09.590705] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-03T21:33:10.390805] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-03T21:33:10.390727] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:33:11.190682] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-03T21:33:11.215413] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T21:33:11.313920] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T21:33:11.990680] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-03T21:33:12.368907] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T21:33:12.790708] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-03T21:33:13.278916] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T21:33:13.590638] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-03T21:33:13.824877] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T21:33:14.339220] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T21:33:14.390686] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-03T21:33:15.190698] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-03T21:33:15.482976] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T21:33:15.737631] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T21:33:15.738885] [INFO ] [REMOTE ] SMHI: Full fetch complete (22915 records). [2025-10-03T21:33:15.738961] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-03T21:33:15.995839] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-03T21:33:16.161676] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-03T21:33:16.161781] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-03T21:33:16.162522] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-03T21:33:16.162574] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-03T21:33:16.163479] [DEBUG] [LOCAL ] SMHI: Trimmed 22915 records to 13294 (keeping 200 days of data) [2025-10-03T21:33:16.241175] [DEBUG] [LOCAL ] SMHI: Primary data saved (13294 records). [2025-10-03T21:33:16.241329] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-03T21:33:16.241419] [INFO ] [MAIN ] Update Progress: 1941/2370 symbols completed. SMHI took 28.5s. Estimated remaining: 1h 0m 23s. Rate: 7.1 symbols/min [2025-10-03T21:33:16.422931] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:16.484563] [DEBUG] [LOCAL ] SMR: Loaded 54187 existing records from primary storage. [2025-10-03T21:33:16.484976] [INFO ] [MAIN ] SMR: Loaded 54187 existing records. [2025-10-03T21:33:16.676403] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:16.676702] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-03T21:33:16.676771] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-03T21:33:16.677205] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-03T21:33:16.677265] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-03T21:33:16.795751] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-03T21:33:17.054714] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:17.590723] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-03T21:33:17.742352] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T21:33:17.813433] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T21:33:18.390747] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-03T21:33:18.954172] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T21:33:18.955526] [INFO ] [REMOTE ] SMP: Full fetch complete (26220 records). [2025-10-03T21:33:18.955631] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-03T21:33:19.200292] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-03T21:33:19.356333] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-03T21:33:19.356437] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-03T21:33:19.357459] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-03T21:33:19.357529] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-03T21:33:19.358419] [DEBUG] [LOCAL ] SMP: Trimmed 26220 records to 19514 (keeping 200 days of data) [2025-10-03T21:33:19.490425] [DEBUG] [LOCAL ] SMP: Primary data saved (19514 records). [2025-10-03T21:33:19.490633] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-03T21:33:19.490771] [INFO ] [MAIN ] Update Progress: 1942/2370 symbols completed. SMP took 28.8s. Estimated remaining: 1h 0m 13s. Rate: 7.1 symbols/min [2025-10-03T21:33:19.672178] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:19.722584] [DEBUG] [LOCAL ] SMRT: Loaded 44172 existing records from primary storage. [2025-10-03T21:33:19.723024] [INFO ] [MAIN ] SMRT: Loaded 44172 existing records. [2025-10-03T21:33:19.927075] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:19.927631] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-03T21:33:19.927745] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-03T21:33:19.928027] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-03T21:33:19.928088] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-03T21:33:20.000842] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-03T21:33:20.353014] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:20.406742] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-10-03T21:33:20.554082] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T21:33:20.556682] [INFO ] [REMOTE ] SMFG: Full fetch complete (68995 records). [2025-10-03T21:33:20.556806] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-03T21:33:20.795818] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-03T21:33:20.999276] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-03T21:33:20.999381] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-03T21:33:21.000528] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-03T21:33:21.000595] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-03T21:33:21.002163] [DEBUG] [LOCAL ] SMFG: Trimmed 68995 records to 48805 (keeping 200 days of data) [2025-10-03T21:33:21.317306] [DEBUG] [LOCAL ] SMFG: Primary data saved (48805 records). [2025-10-03T21:33:21.317463] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-03T21:33:21.317561] [INFO ] [MAIN ] Update Progress: 1943/2370 symbols completed. SMFG took 51.4s. Estimated remaining: 1h 0m 3s. Rate: 7.1 symbols/min [2025-10-03T21:33:21.532317] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:21.572793] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:33:21.596676] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-03T21:33:21.613111] [DEBUG] [LOCAL ] SMWB: Loaded 32631 existing records from primary storage. [2025-10-03T21:33:21.613619] [INFO ] [MAIN ] SMWB: Loaded 32631 existing records. [2025-10-03T21:33:21.814894] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:21.815198] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-03T21:33:21.815247] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-03T21:33:21.815616] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-03T21:33:21.815722] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-03T21:33:22.186866] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:22.390737] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-03T21:33:22.701151] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:33:22.704073] [INFO ] [REMOTE ] SMG: Full fetch complete (62679 records). [2025-10-03T21:33:22.704267] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-03T21:33:23.203795] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-03T21:33:23.266347] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-03T21:33:23.266474] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-03T21:33:23.268417] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-03T21:33:23.268491] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-03T21:33:23.270365] [DEBUG] [LOCAL ] SMG: Trimmed 62679 records to 44276 (keeping 200 days of data) [2025-10-03T21:33:23.581201] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-03T21:33:23.620977] [DEBUG] [LOCAL ] SMG: Primary data saved (44276 records). [2025-10-03T21:33:23.621182] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-03T21:33:23.621455] [INFO ] [MAIN ] Update Progress: 1944/2370 symbols completed. SMG took 43.3s. Estimated remaining: 59m 54s. Rate: 7.1 symbols/min [2025-10-03T21:33:23.805427] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:23.862544] [DEBUG] [LOCAL ] SN: Loaded 50121 existing records from primary storage. [2025-10-03T21:33:23.863109] [INFO ] [MAIN ] SN: Loaded 50121 existing records. [2025-10-03T21:33:23.995364] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-03T21:33:24.082606] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:33:24.088932] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:24.099502] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-03T21:33:24.099572] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-03T21:33:24.099916] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-03T21:33:24.099980] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-03T21:33:24.462324] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:24.630758] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T21:33:24.790727] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-03T21:33:25.590696] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-03T21:33:26.298774] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:33:26.390700] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-03T21:33:26.512398] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-03T21:33:27.086585] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T21:33:27.190781] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-03T21:33:27.655770] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T21:33:27.990735] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-03T21:33:28.790718] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-03T21:33:29.590748] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-03T21:33:29.646438] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:33:29.811393] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-03T21:33:29.855167] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:33:30.390742] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-03T21:33:31.040484] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T21:33:31.190761] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-03T21:33:31.990790] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-03T21:33:32.077766] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T21:33:32.530207] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T21:33:32.790744] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-03T21:33:33.590712] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-03T21:33:34.390673] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-03T21:33:34.466665] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T21:33:34.573870] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-03T21:33:34.622264] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T21:33:35.190714] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-03T21:33:35.990741] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T21:33:35.990848] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-03T21:33:36.790683] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-03T21:33:36.943827] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:33:37.314942] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T21:33:37.590737] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-03T21:33:38.390772] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-03T21:33:39.190693] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-03T21:33:39.415758] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-03T21:33:39.518366] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T21:33:39.952635] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T21:33:39.990623] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-03T21:33:40.163013] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T21:33:40.790697] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-03T21:33:41.590676] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-03T21:33:41.676997] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T21:33:42.191801] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T21:33:42.390727] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-03T21:33:43.190756] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-03T21:33:43.990765] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-03T21:33:44.198544] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:33:44.259812] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-03T21:33:44.592187] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T21:33:44.790723] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-03T21:33:45.548797] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T21:33:45.590705] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-03T21:33:45.732283] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T21:33:45.734343] [INFO ] [REMOTE ] SMWB: Full fetch complete (49516 records). [2025-10-03T21:33:45.734450] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-03T21:33:46.125749] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-03T21:33:46.125864] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-03T21:33:46.127319] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-03T21:33:46.127389] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-03T21:33:46.128906] [DEBUG] [LOCAL ] SMWB: Trimmed 49516 records to 32764 (keeping 200 days of data) [2025-10-03T21:33:46.348534] [DEBUG] [LOCAL ] SMWB: Primary data saved (32764 records). [2025-10-03T21:33:46.348775] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-03T21:33:46.348973] [INFO ] [MAIN ] Update Progress: 1945/2370 symbols completed. SMWB took 25.0s. Estimated remaining: 59m 48s. Rate: 7.1 symbols/min [2025-10-03T21:33:46.395935] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-03T21:33:46.538017] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:46.568671] [DEBUG] [LOCAL ] SNA: Loaded 26059 existing records from primary storage. [2025-10-03T21:33:46.569044] [INFO ] [MAIN ] SNA: Loaded 26059 existing records. [2025-10-03T21:33:46.756210] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:46.756485] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-03T21:33:46.756537] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-03T21:33:46.756852] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-03T21:33:46.756913] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-03T21:33:47.160547] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:47.191573] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:33:47.191675] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-03T21:33:47.990752] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-03T21:33:48.470631] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:33:48.790729] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-03T21:33:49.297219] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-03T21:33:49.600026] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-03T21:33:49.628932] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T21:33:50.390831] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-03T21:33:50.544634] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:33:51.190744] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-03T21:33:51.944441] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:33:51.990682] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-03T21:33:52.057397] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-03T21:33:52.790714] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-03T21:33:52.958526] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T21:33:53.194397] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:33:53.197204] [INFO ] [REMOTE ] SMRT: Full fetch complete (62098 records). [2025-10-03T21:33:53.197312] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-03T21:33:53.595873] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-03T21:33:53.597793] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-03T21:33:53.597902] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-03T21:33:53.599331] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-03T21:33:53.599545] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-03T21:33:53.601402] [DEBUG] [LOCAL ] SMRT: Trimmed 62098 records to 44495 (keeping 200 days of data) [2025-10-03T21:33:53.883332] [DEBUG] [LOCAL ] SMRT: Primary data saved (44495 records). [2025-10-03T21:33:53.883505] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-03T21:33:53.883627] [INFO ] [MAIN ] Update Progress: 1946/2370 symbols completed. SMRT took 34.4s. Estimated remaining: 59m 40s. Rate: 7.1 symbols/min [2025-10-03T21:33:54.070183] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:33:54.123668] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-03T21:33:54.124026] [INFO ] [MAIN ] SNAP: Loaded 54186 existing records. [2025-10-03T21:33:54.312489] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:33:54.312844] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-03T21:33:54.319631] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-03T21:33:54.331108] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-03T21:33:54.331177] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-03T21:33:54.331872] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T21:33:54.395750] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-03T21:33:54.714759] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:33:55.190764] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-03T21:33:55.990760] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-03T21:33:56.207264] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:33:56.338456] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-03T21:33:56.790680] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-03T21:33:57.431676] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T21:33:57.499896] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-03T21:33:57.590781] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-03T21:33:58.390730] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-03T21:33:59.190675] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-03T21:33:59.323289] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:33:59.358997] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-03T21:33:59.362010] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-03T21:33:59.362182] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-03T21:33:59.825939] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-03T21:33:59.826027] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-03T21:33:59.827322] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-03T21:33:59.827388] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-03T21:33:59.829215] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54577 (keeping 200 days of data) [2025-10-03T21:34:00.007018] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-03T21:34:00.192087] [DEBUG] [LOCAL ] SMR: Primary data saved (54577 records). [2025-10-03T21:34:00.192334] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-03T21:34:00.193732] [INFO ] [MAIN ] Update Progress: 1947/2370 symbols completed. SMR took 44.0s. Estimated remaining: 59m 31s. Rate: 7.1 symbols/min [2025-10-03T21:34:00.403880] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:00.415588] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T21:34:00.439336] [DEBUG] [LOCAL ] SNDA: Loaded 4544 existing records from primary storage. [2025-10-03T21:34:00.439593] [INFO ] [MAIN ] SNDA: Loaded 4544 existing records. [2025-10-03T21:34:00.637878] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:00.638251] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-03T21:34:00.638440] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-03T21:34:00.638853] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-03T21:34:00.639069] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-03T21:34:00.800965] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-03T21:34:00.909817] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-03T21:34:01.087240] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:01.351311] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T21:34:01.354093] [INFO ] [REMOTE ] SN: Full fetch complete (71073 records). [2025-10-03T21:34:01.354245] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-03T21:34:01.595876] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-03T21:34:01.815568] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-03T21:34:01.815693] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-03T21:34:01.816926] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-03T21:34:01.816996] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-03T21:34:01.818618] [DEBUG] [LOCAL ] SN: Trimmed 71073 records to 50488 (keeping 200 days of data) [2025-10-03T21:34:02.141372] [DEBUG] [LOCAL ] SN: Primary data saved (50488 records). [2025-10-03T21:34:02.141531] [INFO ] [MAIN ] SN: Full history saved. [2025-10-03T21:34:02.141630] [INFO ] [MAIN ] Update Progress: 1948/2370 symbols completed. SN took 38.5s. Estimated remaining: 59m 21s. Rate: 7.1 symbols/min [2025-10-03T21:34:02.332045] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:02.376718] [DEBUG] [LOCAL ] SNDR: Loaded 41042 existing records from primary storage. [2025-10-03T21:34:02.377605] [INFO ] [MAIN ] SNDR: Loaded 41042 existing records. [2025-10-03T21:34:02.402796] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-03T21:34:02.483008] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T21:34:02.500210] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T21:34:02.686855] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:02.687114] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-03T21:34:02.687168] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-03T21:34:02.687478] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-03T21:34:02.687539] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-03T21:34:03.069842] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:03.190697] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-03T21:34:03.990766] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-03T21:34:04.675184] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T21:34:04.739198] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T21:34:04.790743] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-03T21:34:04.901887] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T21:34:05.311091] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T21:34:05.590772] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-03T21:34:06.221510] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T21:34:06.390740] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-03T21:34:07.190697] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-03T21:34:07.843360] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T21:34:07.990685] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-03T21:34:08.790742] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-03T21:34:09.471556] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T21:34:09.473526] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T21:34:09.590689] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-03T21:34:10.013876] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:34:10.390708] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-03T21:34:11.099423] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T21:34:11.190692] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-03T21:34:11.990687] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-03T21:34:12.097961] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-03T21:34:12.645106] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T21:34:12.790681] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-03T21:34:12.845583] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T21:34:13.420454] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T21:34:13.590716] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-03T21:34:14.228547] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T21:34:14.390753] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-03T21:34:15.190685] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-03T21:34:15.693534] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T21:34:15.990694] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-03T21:34:16.790713] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-03T21:34:17.407969] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T21:34:17.413076] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T21:34:17.590693] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-03T21:34:17.689940] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-03T21:34:18.390713] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-03T21:34:18.946022] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T21:34:19.094426] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-03T21:34:19.190602] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-03T21:34:19.990699] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-03T21:34:20.190911] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T21:34:20.790742] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-03T21:34:21.364309] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-03T21:34:21.416813] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T21:34:21.590720] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-03T21:34:22.390705] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-03T21:34:22.965639] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T21:34:23.190718] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-03T21:34:23.764758] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T21:34:23.990721] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-03T21:34:24.710825] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T21:34:24.790740] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-03T21:34:25.260765] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T21:34:25.261672] [INFO ] [REMOTE ] SNDA: Full fetch complete (7974 records). [2025-10-03T21:34:25.261762] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-03T21:34:25.595764] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-03T21:34:25.664854] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-03T21:34:25.664976] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-03T21:34:25.665321] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-03T21:34:25.665397] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-03T21:34:25.665917] [DEBUG] [LOCAL ] SNDA: Trimmed 7974 records to 4571 (keeping 200 days of data) [2025-10-03T21:34:25.694623] [DEBUG] [LOCAL ] SNDA: Primary data saved (4571 records). [2025-10-03T21:34:25.694825] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-03T21:34:25.694974] [INFO ] [MAIN ] Update Progress: 1949/2370 symbols completed. SNDA took 25.5s. Estimated remaining: 59m 16s. Rate: 7.1 symbols/min [2025-10-03T21:34:25.876093] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:25.927967] [DEBUG] [LOCAL ] SNN: Loaded 44528 existing records from primary storage. [2025-10-03T21:34:25.928320] [INFO ] [MAIN ] SNN: Loaded 44528 existing records. [2025-10-03T21:34:26.129040] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:26.129349] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-03T21:34:26.129467] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-03T21:34:26.129900] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-03T21:34:26.129985] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-03T21:34:26.392173] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-03T21:34:26.533373] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:26.568110] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-03T21:34:27.190725] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-03T21:34:27.242531] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T21:34:27.242787] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T21:34:27.254327] [INFO ] [REMOTE ] SNA: Full fetch complete (38845 records). [2025-10-03T21:34:27.254891] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-03T21:34:27.649962] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-03T21:34:27.650044] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-03T21:34:27.650861] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-03T21:34:27.650924] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-03T21:34:27.651871] [DEBUG] [LOCAL ] SNA: Trimmed 38845 records to 26187 (keeping 200 days of data) [2025-10-03T21:34:27.827548] [DEBUG] [LOCAL ] SNA: Primary data saved (26187 records). [2025-10-03T21:34:27.827761] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-03T21:34:27.827876] [INFO ] [MAIN ] Update Progress: 1950/2370 symbols completed. SNA took 41.5s. Estimated remaining: 59m 6s. Rate: 7.1 symbols/min [2025-10-03T21:34:28.002092] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-03T21:34:28.006627] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:28.067519] [DEBUG] [LOCAL ] SNOW: Loaded 53981 existing records from primary storage. [2025-10-03T21:34:28.067923] [INFO ] [MAIN ] SNOW: Loaded 53981 existing records. [2025-10-03T21:34:28.262939] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:28.263264] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-03T21:34:28.263513] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-03T21:34:28.264074] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-03T21:34:28.264138] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-03T21:34:28.613631] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T21:34:28.710550] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:28.790708] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-03T21:34:29.590756] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-03T21:34:30.390732] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-03T21:34:30.467445] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T21:34:30.762832] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T21:34:31.173776] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T21:34:31.190605] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-03T21:34:31.978077] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T21:34:31.992220] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-03T21:34:32.331219] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T21:34:32.790956] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-03T21:34:33.590740] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-03T21:34:34.356633] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T21:34:34.395797] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-03T21:34:34.415725] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-03T21:34:35.190632] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-03T21:34:35.961498] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-03T21:34:35.990688] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-03T21:34:36.172388] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T21:34:36.790742] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-03T21:34:37.330188] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-03T21:34:37.332957] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-03T21:34:37.333070] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-03T21:34:37.601261] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-03T21:34:37.763384] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-03T21:34:37.763526] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-03T21:34:37.764992] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-03T21:34:37.765066] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-03T21:34:37.766825] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 54576 (keeping 200 days of data) [2025-10-03T21:34:38.109569] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-10-03T21:34:38.109778] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-03T21:34:38.109937] [INFO ] [MAIN ] Update Progress: 1951/2370 symbols completed. SNAP took 44.2s. Estimated remaining: 58m 58s. Rate: 7.1 symbols/min [2025-10-03T21:34:38.296697] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:38.297499] [DEBUG] [LOCAL ] SNV: No existing data file found in primary storage. [2025-10-03T21:34:38.297563] [WARN ] [MAIN ] SNV: No existing data found, performing full refresh instead. [2025-10-03T21:34:38.297741] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-03T21:34:38.297796] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-03T21:34:38.297842] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-03T21:34:38.297875] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-03T21:34:38.578832] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-03T21:34:38.696368] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-03T21:34:38.773908] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T21:34:38.775111] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T21:34:38.823940] [INFO ] [REMOTE ] SNDR: Full fetch complete (59284 records). [2025-10-03T21:34:38.843691] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-03T21:34:38.864601] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:39.195835] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-03T21:34:39.285487] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-03T21:34:39.285750] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-03T21:34:39.286914] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-03T21:34:39.286983] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-03T21:34:39.288424] [DEBUG] [LOCAL ] SNDR: Trimmed 59284 records to 41416 (keeping 200 days of data) [2025-10-03T21:34:39.548740] [DEBUG] [LOCAL ] SNDR: Primary data saved (41416 records). [2025-10-03T21:34:39.548904] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-03T21:34:39.549000] [INFO ] [MAIN ] Update Progress: 1952/2370 symbols completed. SNDR took 37.4s. Estimated remaining: 58m 48s. Rate: 7.1 symbols/min [2025-10-03T21:34:39.736028] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:39.778558] [DEBUG] [LOCAL ] SNX: Loaded 40326 existing records from primary storage. [2025-10-03T21:34:39.778905] [INFO ] [MAIN ] SNX: Loaded 40326 existing records. [2025-10-03T21:34:39.972473] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:39.972785] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-03T21:34:39.972839] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-03T21:34:39.973445] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-03T21:34:39.973505] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-03T21:34:40.006562] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-03T21:34:40.367698] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:40.790889] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-03T21:34:40.927798] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T21:34:41.079923] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-03T21:34:41.295319] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T21:34:41.590724] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-03T21:34:42.275451] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T21:34:42.390695] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-03T21:34:43.190774] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-03T21:34:43.956147] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T21:34:43.995864] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-03T21:34:44.012234] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-03T21:34:44.534068] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T21:34:44.790745] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-03T21:34:45.590668] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-03T21:34:45.793015] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:34:46.273007] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T21:34:46.390707] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-03T21:34:47.190778] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-03T21:34:47.990674] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-03T21:34:48.121169] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-03T21:34:48.188866] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T21:34:48.798754] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-03T21:34:48.805880] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:34:49.553884] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T21:34:49.590627] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-03T21:34:50.280740] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:34:50.390687] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-03T21:34:51.168869] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T21:34:51.190681] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-03T21:34:51.977536] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T21:34:51.990608] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-03T21:34:52.379880] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T21:34:52.382958] [INFO ] [REMOTE ] SNN: Full fetch complete (63106 records). [2025-10-03T21:34:52.383135] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-03T21:34:52.798578] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-03T21:34:52.816538] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-03T21:34:52.816723] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-03T21:34:52.818930] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-03T21:34:52.819129] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-03T21:34:52.821067] [DEBUG] [LOCAL ] SNN: Trimmed 63106 records to 44843 (keeping 200 days of data) [2025-10-03T21:34:53.145405] [DEBUG] [LOCAL ] SNN: Primary data saved (44843 records). [2025-10-03T21:34:53.145572] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-03T21:34:53.147230] [INFO ] [MAIN ] Update Progress: 1953/2370 symbols completed. SNN took 27.5s. Estimated remaining: 58m 41s. Rate: 7.1 symbols/min [2025-10-03T21:34:53.337884] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:34:53.398125] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T21:34:53.426377] [DEBUG] [LOCAL ] SO: Loaded 53996 existing records from primary storage. [2025-10-03T21:34:53.426793] [INFO ] [MAIN ] SO: Loaded 53996 existing records. [2025-10-03T21:34:53.594323] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-03T21:34:53.618320] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:34:53.618851] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-03T21:34:53.619765] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-03T21:34:53.620129] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-03T21:34:53.620191] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-03T21:34:54.006859] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:34:54.390713] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-03T21:34:54.650178] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T21:34:55.190622] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-03T21:34:55.287148] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T21:34:55.990723] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-03T21:34:56.624927] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-03T21:34:56.790664] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-03T21:34:57.043913] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T21:34:57.441833] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T21:34:57.590705] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-03T21:34:58.266270] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:34:58.390675] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-03T21:34:59.063882] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T21:34:59.190708] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-03T21:34:59.990678] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-03T21:35:00.796008] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-03T21:35:00.814032] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-03T21:35:01.011510] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T21:35:01.345159] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T21:35:01.590739] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-03T21:35:02.390682] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-03T21:35:02.527055] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:35:03.190691] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-03T21:35:03.553312] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T21:35:03.990734] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-03T21:35:04.510057] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T21:35:04.513066] [INFO ] [REMOTE ] SNX: Full fetch complete (57250 records). [2025-10-03T21:35:04.513165] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-03T21:35:04.793865] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-03T21:35:04.949082] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-03T21:35:04.949273] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-03T21:35:04.950554] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-03T21:35:04.950756] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-03T21:35:04.952964] [DEBUG] [LOCAL ] SNX: Trimmed 57250 records to 40653 (keeping 200 days of data) [2025-10-03T21:35:05.090059] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-03T21:35:05.270987] [DEBUG] [LOCAL ] SNX: Primary data saved (40653 records). [2025-10-03T21:35:05.271121] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-03T21:35:05.271245] [INFO ] [MAIN ] Update Progress: 1954/2370 symbols completed. SNX took 25.7s. Estimated remaining: 58m 33s. Rate: 7.1 symbols/min [2025-10-03T21:35:05.458527] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:05.495139] [DEBUG] [LOCAL ] SOBO: Loaded 39774 existing records from primary storage. [2025-10-03T21:35:05.495444] [INFO ] [MAIN ] SOBO: Loaded 39774 existing records. [2025-10-03T21:35:05.603464] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-03T21:35:05.696152] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:05.696586] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-03T21:35:05.696842] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-03T21:35:05.697171] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-03T21:35:05.697337] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-03T21:35:05.817460] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T21:35:06.144438] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:06.390703] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-03T21:35:06.730588] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T21:35:07.190693] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-03T21:35:07.990676] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-03T21:35:08.102064] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-03T21:35:08.296200] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T21:35:08.790765] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-03T21:35:09.109527] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T21:35:09.528824] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T21:35:09.590735] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-03T21:35:10.390707] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-03T21:35:10.519200] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T21:35:11.190729] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-03T21:35:11.446034] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T21:35:11.990726] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-03T21:35:12.071448] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T21:35:12.790710] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-03T21:35:13.216398] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-03T21:35:13.219304] [INFO ] [REMOTE ] SNOW: Full fetch complete (77651 records). [2025-10-03T21:35:13.219428] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-03T21:35:13.598632] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-03T21:35:13.645420] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-03T21:35:13.645719] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-03T21:35:13.647268] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-03T21:35:13.647371] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-03T21:35:13.649341] [DEBUG] [LOCAL ] SNOW: Trimmed 77651 records to 54371 (keeping 200 days of data) [2025-10-03T21:35:13.919269] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T21:35:14.057248] [DEBUG] [LOCAL ] SNOW: Primary data saved (54371 records). [2025-10-03T21:35:14.057404] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-03T21:35:14.057575] [INFO ] [MAIN ] Update Progress: 1955/2370 symbols completed. SNOW took 46.2s. Estimated remaining: 58m 25s. Rate: 7.1 symbols/min [2025-10-03T21:35:14.242611] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:14.295240] [DEBUG] [LOCAL ] SOC: Loaded 50819 existing records from primary storage. [2025-10-03T21:35:14.295582] [INFO ] [MAIN ] SOC: Loaded 50819 existing records. [2025-10-03T21:35:14.395733] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-03T21:35:14.496774] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:14.497214] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-03T21:35:14.497300] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-03T21:35:14.497616] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-03T21:35:14.497733] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-03T21:35:14.695106] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T21:35:14.942845] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:15.133682] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T21:35:15.190683] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-03T21:35:15.990629] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-03T21:35:16.297483] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T21:35:16.505365] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T21:35:16.508211] [INFO ] [REMOTE ] SNV: Full fetch complete (71231 records). [2025-10-03T21:35:16.508325] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-03T21:35:16.799576] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-03T21:35:16.934169] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-03T21:35:16.934256] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-03T21:35:16.935570] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-03T21:35:16.935639] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-03T21:35:16.937214] [DEBUG] [LOCAL ] SNV: Trimmed 71231 records to 49620 (keeping 200 days of data) [2025-10-03T21:35:17.279131] [DEBUG] [LOCAL ] SNV: Primary data saved (49620 records). [2025-10-03T21:35:17.279311] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-03T21:35:17.279426] [INFO ] [MAIN ] Update Progress: 1956/2370 symbols completed. SNV took 39.2s. Estimated remaining: 58m 15s. Rate: 7.1 symbols/min [2025-10-03T21:35:17.483715] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:17.492339] [DEBUG] [LOCAL ] SOJC: Loaded 5063 existing records from primary storage. [2025-10-03T21:35:17.492574] [INFO ] [MAIN ] SOJC: Loaded 5063 existing records. [2025-10-03T21:35:17.595148] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-03T21:35:17.704610] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:17.705109] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-03T21:35:17.705186] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-03T21:35:17.725071] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-03T21:35:17.741679] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-03T21:35:17.813338] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T21:35:18.144800] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:18.390721] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-03T21:35:18.795996] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T21:35:18.933795] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T21:35:19.155309] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T21:35:19.190617] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-03T21:35:19.810818] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T21:35:19.990706] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-03T21:35:20.553961] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T21:35:20.790745] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-03T21:35:21.590757] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-03T21:35:22.390698] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-03T21:35:22.437240] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T21:35:22.832121] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T21:35:22.858865] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T21:35:22.861838] [INFO ] [REMOTE ] SO: Full fetch complete (77595 records). [2025-10-03T21:35:22.861974] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-03T21:35:23.195875] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-03T21:35:23.299256] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-03T21:35:23.299466] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-03T21:35:23.301312] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-03T21:35:23.301384] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-03T21:35:23.303761] [DEBUG] [LOCAL ] SO: Trimmed 77595 records to 54386 (keeping 200 days of data) [2025-10-03T21:35:23.659434] [DEBUG] [LOCAL ] SO: Primary data saved (54386 records). [2025-10-03T21:35:23.659683] [INFO ] [MAIN ] SO: Full history saved. [2025-10-03T21:35:23.660464] [INFO ] [MAIN ] Update Progress: 1957/2370 symbols completed. SO took 30.5s. Estimated remaining: 58m 6s. Rate: 7.1 symbols/min [2025-10-03T21:35:23.954692] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T21:35:23.990747] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-03T21:35:24.639055] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T21:35:24.790738] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-03T21:35:25.590762] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-03T21:35:26.385868] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T21:35:26.394978] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-03T21:35:26.989435] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T21:35:27.190681] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-03T21:35:27.275964] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:35:27.784162] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T21:35:27.990718] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-03T21:35:28.790764] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-03T21:35:29.398479] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T21:35:29.590699] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-03T21:35:29.729758] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T21:35:30.390769] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-03T21:35:31.071754] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T21:35:31.190751] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-03T21:35:31.990762] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-03T21:35:32.141196] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T21:35:32.790794] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-03T21:35:33.360909] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T21:35:33.590737] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-03T21:35:34.595720] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T21:35:34.607811] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-03T21:35:34.706025] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:35:35.190741] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-03T21:35:35.978818] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (4.79 seconds). [2025-10-03T21:35:35.990720] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-03T21:35:36.107448] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T21:35:36.596621] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T21:35:36.663296] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T21:35:36.790733] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-03T21:35:37.590738] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-03T21:35:37.925923] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T21:35:37.928458] [INFO ] [REMOTE ] SOBO: Full fetch complete (58433 records). [2025-10-03T21:35:37.928672] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-03T21:35:38.367984] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-03T21:35:38.368072] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-03T21:35:38.369282] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-03T21:35:38.369352] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-03T21:35:38.370591] [DEBUG] [LOCAL ] SOBO: Trimmed 58433 records to 40076 (keeping 200 days of data) [2025-10-03T21:35:38.428346] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-03T21:35:38.640869] [DEBUG] [LOCAL ] SOBO: Primary data saved (40076 records). [2025-10-03T21:35:38.641025] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-03T21:35:38.641158] [INFO ] [MAIN ] Update Progress: 1958/2370 symbols completed. SOBO took 33.4s. Estimated remaining: 57m 59s. Rate: 7.1 symbols/min [2025-10-03T21:35:39.453271] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T21:35:39.466260] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-03T21:35:40.825805] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-03T21:35:40.826620] [INFO ] [REMOTE ] SOJC: Full fetch complete (7743 records). [2025-10-03T21:35:40.826721] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-03T21:35:41.273354] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-03T21:35:41.284308] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-03T21:35:41.303389] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-03T21:35:41.306499] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-03T21:35:41.309939] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:35:41.310451] [DEBUG] [LOCAL ] SOJC: Trimmed 7743 records to 5079 (keeping 200 days of data) [2025-10-03T21:35:41.322382] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-03T21:35:41.358269] [DEBUG] [LOCAL ] SOJC: Primary data saved (5079 records). [2025-10-03T21:35:41.358421] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-03T21:35:41.358534] [INFO ] [MAIN ] Update Progress: 1959/2370 symbols completed. SOJC took 24.1s. Estimated remaining: 57m 49s. Rate: 7.1 symbols/min [2025-10-03T21:35:43.218867] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T21:35:43.231877] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-03T21:35:44.863125] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T21:35:44.865892] [INFO ] [REMOTE ] SOC: Full fetch complete (71661 records). [2025-10-03T21:35:44.866045] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-03T21:35:45.284808] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-03T21:35:45.284900] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-03T21:35:45.286151] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-03T21:35:45.286220] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-03T21:35:45.287753] [DEBUG] [LOCAL ] SOC: Trimmed 71661 records to 51206 (keeping 200 days of data) [2025-10-03T21:35:45.608147] [DEBUG] [LOCAL ] SOC: Primary data saved (51206 records). [2025-10-03T21:35:45.608309] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-03T21:35:45.608437] [INFO ] [MAIN ] Update Progress: 1960/2370 symbols completed. SOC took 31.6s. Estimated remaining: 57m 40s. Rate: 7.1 symbols/min [2025-10-03T21:35:46.239155] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:46.310888] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:46.393351] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:46.424823] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-03T21:35:46.447759] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:46.448065] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-03T21:35:46.453179] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-03T21:35:46.453305] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-03T21:35:46.453560] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-03T21:35:46.453606] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-03T21:35:46.512858] [DEBUG] [LOCAL ] SOL: Loaded 13400 existing records from primary storage. [2025-10-03T21:35:46.526738] [INFO ] [MAIN ] SOL: Loaded 13400 existing records. [2025-10-03T21:35:46.577256] [DEBUG] [LOCAL ] SOJE: Loaded 9416 existing records from primary storage. [2025-10-03T21:35:46.598051] [INFO ] [MAIN ] SOJE: Loaded 9416 existing records. [2025-10-03T21:35:46.587261] [DEBUG] [LOCAL ] SOJD: Loaded 13201 existing records from primary storage. [2025-10-03T21:35:46.698170] [INFO ] [MAIN ] SOJD: Loaded 13201 existing records. [2025-10-03T21:35:47.411006] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:47.444863] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-03T21:35:47.474689] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-03T21:35:47.474531] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:47.498796] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:47.509573] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-03T21:35:47.520230] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-03T21:35:47.520128] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-03T21:35:47.548375] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-03T21:35:47.541770] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-03T21:35:47.548238] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-03T21:35:47.559020] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-03T21:35:47.561702] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-03T21:35:47.577721] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-03T21:35:47.589736] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:47.649198] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-03T21:35:47.648788] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-03T21:35:47.937477] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:35:47.969082] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-03T21:35:48.048582] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:35:48.141175] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-03T21:35:48.217006] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:35:48.283241] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-03T21:35:48.380885] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-03T21:35:48.440387] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-03T21:35:48.570920] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-03T21:35:48.679516] [INFO ] [MAIN ] Update Progress: 1961/2370 symbols completed. SOJF took 3.1s. Estimated remaining: 57m 31s. Rate: 7.1 symbols/min [2025-10-03T21:35:48.748230] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:48.764414] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-03T21:35:48.827074] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:48.874965] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-03T21:35:49.107192] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:35:49.111581] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:49.112027] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-03T21:35:49.160720] [DEBUG] [LOCAL ] SOLV: Loaded 44279 existing records from primary storage. [2025-10-03T21:35:49.161059] [INFO ] [MAIN ] SOLV: Loaded 44279 existing records. [2025-10-03T21:35:49.352111] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:35:49.352336] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-03T21:35:49.352386] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-03T21:35:49.352676] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-03T21:35:49.352741] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-03T21:35:49.739622] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:35:49.739981] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-03T21:35:49.994455] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T21:35:49.999128] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-03T21:35:50.015509] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T21:35:50.021763] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-03T21:35:50.190785] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T21:35:50.197853] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-03T21:35:50.567427] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T21:35:50.570368] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-03T21:35:50.786298] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T21:35:50.791271] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-03T21:35:51.048328] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T21:35:51.053314] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-03T21:35:51.324502] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T21:35:51.333953] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-03T21:35:51.357148] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T21:35:51.359945] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-03T21:35:51.574678] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T21:35:51.948202] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T21:35:51.964170] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T21:35:51.990696] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-03T21:35:52.790713] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-03T21:35:52.904124] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T21:35:53.058675] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T21:35:53.590708] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-03T21:35:53.769883] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T21:35:54.390740] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-03T21:35:54.444637] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T21:35:54.922127] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T21:35:55.190730] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-03T21:35:55.990683] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-03T21:35:56.026010] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:35:56.742895] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T21:35:56.790636] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-03T21:35:57.524371] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T21:35:57.590722] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-03T21:35:58.390698] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-03T21:35:59.106447] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:35:59.136990] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T21:35:59.190693] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-03T21:35:59.990699] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-03T21:36:00.313170] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T21:36:00.640445] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T21:36:00.790699] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-03T21:36:01.590729] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-03T21:36:02.390671] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-03T21:36:02.479053] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:36:02.537860] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T21:36:02.811445] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T21:36:03.190706] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-03T21:36:03.990692] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-03T21:36:04.524903] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T21:36:04.526112] [INFO ] [REMOTE ] SOJE: Full fetch complete (14270 records). [2025-10-03T21:36:04.526203] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-03T21:36:04.792106] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-03T21:36:04.928718] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-03T21:36:04.928856] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-03T21:36:04.929205] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-03T21:36:04.929309] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-03T21:36:04.930152] [DEBUG] [LOCAL ] SOJE: Trimmed 14270 records to 9451 (keeping 200 days of data) [2025-10-03T21:36:05.010706] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T21:36:05.036598] [DEBUG] [LOCAL ] SOJE: Primary data saved (9451 records). [2025-10-03T21:36:05.036787] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-03T21:36:05.036951] [INFO ] [MAIN ] Update Progress: 1962/2370 symbols completed. SOJE took 19.4s. Estimated remaining: 57m 24s. Rate: 7.1 symbols/min [2025-10-03T21:36:05.217389] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:05.264531] [DEBUG] [LOCAL ] SON: Loaded 43387 existing records from primary storage. [2025-10-03T21:36:05.264925] [INFO ] [MAIN ] SON: Loaded 43387 existing records. [2025-10-03T21:36:05.453131] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:05.453446] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-03T21:36:05.453502] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-03T21:36:05.453825] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-03T21:36:05.453884] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-03T21:36:05.602786] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-03T21:36:05.774010] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T21:36:05.866770] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:06.390722] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-03T21:36:06.597816] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T21:36:07.190704] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-03T21:36:07.995872] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-03T21:36:08.018953] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T21:36:08.082066] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T21:36:08.790703] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-03T21:36:08.911897] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T21:36:09.590665] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-03T21:36:09.624669] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T21:36:10.243890] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T21:36:10.245106] [INFO ] [REMOTE ] SOL: Full fetch complete (21444 records). [2025-10-03T21:36:10.245177] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-03T21:36:10.395827] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-03T21:36:10.639575] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-03T21:36:10.639679] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-03T21:36:10.640195] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-03T21:36:10.640243] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-03T21:36:10.640953] [DEBUG] [LOCAL ] SOL: Trimmed 21444 records to 13504 (keeping 200 days of data) [2025-10-03T21:36:10.721699] [DEBUG] [LOCAL ] SOL: Primary data saved (13504 records). [2025-10-03T21:36:10.721861] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-03T21:36:10.721991] [INFO ] [MAIN ] Update Progress: 1963/2370 symbols completed. SOL took 25.1s. Estimated remaining: 57m 15s. Rate: 7.1 symbols/min [2025-10-03T21:36:10.912170] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:10.968768] [DEBUG] [LOCAL ] SONY: Loaded 53748 existing records from primary storage. [2025-10-03T21:36:10.969189] [INFO ] [MAIN ] SONY: Loaded 53748 existing records. [2025-10-03T21:36:11.160963] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:11.161221] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-03T21:36:11.161270] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-03T21:36:11.161537] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-03T21:36:11.161603] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-03T21:36:11.195747] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-03T21:36:11.461602] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T21:36:11.605138] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:11.990685] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-03T21:36:12.767820] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T21:36:12.790638] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-03T21:36:13.507124] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T21:36:13.590691] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-03T21:36:14.390691] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-03T21:36:14.548414] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T21:36:15.190637] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-03T21:36:15.255396] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:36:15.975701] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:36:15.990623] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-03T21:36:16.790750] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-03T21:36:16.968373] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:36:17.585130] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T21:36:17.598417] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-03T21:36:18.390673] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-03T21:36:18.502690] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T21:36:19.153069] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T21:36:19.190713] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-03T21:36:19.493343] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T21:36:19.990639] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-03T21:36:20.001188] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T21:36:20.779634] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T21:36:20.790723] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-03T21:36:21.590702] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-03T21:36:22.084692] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T21:36:22.087009] [INFO ] [REMOTE ] SOLV: Full fetch complete (63331 records). [2025-10-03T21:36:22.087185] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-03T21:36:22.395875] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-03T21:36:22.509137] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-03T21:36:22.509228] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-03T21:36:22.510432] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-03T21:36:22.510500] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-03T21:36:22.511932] [DEBUG] [LOCAL ] SOLV: Trimmed 63331 records to 44593 (keeping 200 days of data) [2025-10-03T21:36:22.794421] [DEBUG] [LOCAL ] SOLV: Primary data saved (44593 records). [2025-10-03T21:36:22.794583] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-03T21:36:22.794727] [INFO ] [MAIN ] Update Progress: 1964/2370 symbols completed. SOLV took 34.1s. Estimated remaining: 57m 7s. Rate: 7.1 symbols/min [2025-10-03T21:36:22.989610] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:22.995398] [DEBUG] [LOCAL ] SOR: Loaded 2885 existing records from primary storage. [2025-10-03T21:36:22.995629] [INFO ] [MAIN ] SOR: Loaded 2885 existing records. [2025-10-03T21:36:23.192673] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-03T21:36:23.199270] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:23.200617] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-03T21:36:23.200815] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-03T21:36:23.201087] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-03T21:36:23.201168] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-03T21:36:23.376281] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T21:36:23.704113] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:23.844484] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T21:36:23.845872] [INFO ] [REMOTE ] SOJD: Full fetch complete (19848 records). [2025-10-03T21:36:23.845997] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-03T21:36:24.003811] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-03T21:36:24.261879] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-03T21:36:24.261978] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-03T21:36:24.262538] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-03T21:36:24.262583] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-03T21:36:24.263288] [DEBUG] [LOCAL ] SOJD: Trimmed 19848 records to 13256 (keeping 200 days of data) [2025-10-03T21:36:24.359045] [DEBUG] [LOCAL ] SOJD: Primary data saved (13256 records). [2025-10-03T21:36:24.359231] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-03T21:36:24.359392] [INFO ] [MAIN ] Update Progress: 1965/2370 symbols completed. SOJD took 38.7s. Estimated remaining: 56m 57s. Rate: 7.1 symbols/min [2025-10-03T21:36:24.562048] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:24.605991] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T21:36:24.623731] [DEBUG] [LOCAL ] SOS: Loaded 8803 existing records from primary storage. [2025-10-03T21:36:24.624891] [INFO ] [MAIN ] SOS: Loaded 8803 existing records. [2025-10-03T21:36:24.795967] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-03T21:36:24.839900] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:24.840112] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-03T21:36:24.840198] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-03T21:36:24.840410] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-03T21:36:24.840478] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-03T21:36:25.234335] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:25.335098] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-03T21:36:25.590706] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-03T21:36:25.852429] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T21:36:26.390741] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-03T21:36:27.190680] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-03T21:36:27.390065] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:36:27.413452] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T21:36:27.990744] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-03T21:36:28.703920] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T21:36:28.777302] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T21:36:28.790613] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-03T21:36:29.590714] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-03T21:36:30.270139] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T21:36:30.390705] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-03T21:36:30.494636] [DEBUG] [REMOTE ] SON: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T21:36:30.495076] [WARN ] [REMOTE ] SON: No data returned for month 2025-07 [2025-10-03T21:36:30.495192] [FATAL] [REMOTE ] SON: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:36:30.495296] [FATAL] [MAIN ] SON: Failed to fetch primary data. [2025-10-03T21:36:30.495376] [WARN ] [MAIN ] SON: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:36:30.495464] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-03T21:36:30.495563] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-03T21:36:30.495623] [INFO ] [LOCAL ] SON: Starting deletion of derivative data. [2025-10-03T21:36:30.496032] [DEBUG] [LOCAL ] SON: Deleted derivative data file. [2025-10-03T21:36:30.496140] [INFO ] [MAIN ] Update Progress: 1966/2370 symbols completed. SON took 25.5s. Estimated remaining: 56m 48s. Rate: 7.1 symbols/min [2025-10-03T21:36:30.686606] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:30.724147] [DEBUG] [LOCAL ] SPB: Loaded 34265 existing records from primary storage. [2025-10-03T21:36:30.724500] [INFO ] [MAIN ] SPB: Loaded 34265 existing records. [2025-10-03T21:36:30.920732] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:30.920976] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-03T21:36:30.921027] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-03T21:36:30.921385] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-03T21:36:30.921446] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-03T21:36:31.195781] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-03T21:36:31.307814] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:31.694849] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T21:36:31.840101] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T21:36:31.990736] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-03T21:36:32.790713] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-03T21:36:33.438338] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T21:36:33.590630] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-03T21:36:33.687164] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T21:36:33.997327] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T21:36:34.390689] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-03T21:36:34.922799] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T21:36:35.190684] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-03T21:36:35.673301] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T21:36:35.990702] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-03T21:36:36.790695] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-03T21:36:37.334800] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T21:36:37.590719] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-03T21:36:37.741014] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T21:36:37.946229] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T21:36:38.390767] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-03T21:36:39.190635] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-03T21:36:39.990674] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-03T21:36:40.393713] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T21:36:40.509672] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T21:36:40.570294] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T21:36:40.790666] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-03T21:36:41.377098] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T21:36:41.590708] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-03T21:36:42.390629] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-03T21:36:42.856240] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T21:36:43.190692] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-03T21:36:43.990635] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-03T21:36:44.383871] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T21:36:44.467588] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T21:36:44.496971] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T21:36:44.790699] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-03T21:36:45.590722] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-03T21:36:45.984683] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-03T21:36:46.390676] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-03T21:36:46.443844] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T21:36:46.447024] [INFO ] [REMOTE ] SONY: Full fetch complete (77231 records). [2025-10-03T21:36:46.447206] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-03T21:36:46.892285] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-03T21:36:46.892372] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-03T21:36:46.893552] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-03T21:36:46.893619] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-03T21:36:46.895160] [DEBUG] [LOCAL ] SONY: Trimmed 77231 records to 54137 (keeping 200 days of data) [2025-10-03T21:36:47.209288] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-03T21:36:47.240115] [DEBUG] [LOCAL ] SONY: Primary data saved (54137 records). [2025-10-03T21:36:47.240273] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-03T21:36:47.240380] [INFO ] [MAIN ] Update Progress: 1967/2370 symbols completed. SONY took 36.5s. Estimated remaining: 56m 42s. Rate: 7.1 symbols/min [2025-10-03T21:36:47.432383] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:47.480919] [DEBUG] [LOCAL ] SPCE: Loaded 50307 existing records from primary storage. [2025-10-03T21:36:47.481435] [INFO ] [MAIN ] SPCE: Loaded 50307 existing records. [2025-10-03T21:36:47.689280] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:47.689704] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-03T21:36:47.689816] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-03T21:36:47.696375] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-03T21:36:47.706952] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-03T21:36:47.708375] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T21:36:47.995950] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-03T21:36:48.102096] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:48.360248] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T21:36:48.565390] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T21:36:48.790728] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-03T21:36:49.590710] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-03T21:36:49.774076] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T21:36:50.390696] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-03T21:36:50.676687] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T21:36:51.190688] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-03T21:36:51.296679] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T21:36:51.990732] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-03T21:36:52.782821] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T21:36:52.790879] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-03T21:36:52.900416] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T21:36:52.901684] [INFO ] [REMOTE ] SOS: Full fetch complete (11150 records). [2025-10-03T21:36:52.901769] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-03T21:36:53.292705] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T21:36:53.292856] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-03T21:36:53.292963] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-03T21:36:53.294761] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-03T21:36:53.294827] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-03T21:36:53.295383] [DEBUG] [LOCAL ] SOS: Trimmed 11150 records to 8947 (keeping 200 days of data) [2025-10-03T21:36:53.353113] [DEBUG] [LOCAL ] SOS: Primary data saved (8947 records). [2025-10-03T21:36:53.353290] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-03T21:36:53.353429] [INFO ] [MAIN ] Update Progress: 1968/2370 symbols completed. SOS took 29.0s. Estimated remaining: 56m 33s. Rate: 7.1 symbols/min [2025-10-03T21:36:53.538076] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:53.548155] [DEBUG] [LOCAL ] SPE: Loaded 6374 existing records from primary storage. [2025-10-03T21:36:53.548380] [INFO ] [MAIN ] SPE: Loaded 6374 existing records. [2025-10-03T21:36:53.595791] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-03T21:36:53.741071] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:53.741340] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-03T21:36:53.741422] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-03T21:36:53.741697] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-03T21:36:53.741776] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-03T21:36:54.124164] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:54.390691] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-03T21:36:55.190737] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-03T21:36:55.730364] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T21:36:55.788022] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T21:36:55.789303] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T21:36:55.990709] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-03T21:36:56.790722] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-03T21:36:57.111715] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-03T21:36:57.112543] [INFO ] [REMOTE ] SOR: Full fetch complete (4368 records). [2025-10-03T21:36:57.112618] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-03T21:36:57.507100] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-03T21:36:57.507214] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-03T21:36:57.507455] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-03T21:36:57.507563] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-03T21:36:57.508235] [DEBUG] [LOCAL ] SOR: Trimmed 4368 records to 2899 (keeping 200 days of data) [2025-10-03T21:36:57.531051] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T21:36:57.558223] [DEBUG] [LOCAL ] SOR: Primary data saved (2899 records). [2025-10-03T21:36:57.558333] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-03T21:36:57.558478] [INFO ] [MAIN ] Update Progress: 1969/2370 symbols completed. SOR took 34.8s. Estimated remaining: 56m 23s. Rate: 7.1 symbols/min [2025-10-03T21:36:57.595762] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-03T21:36:57.786787] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:36:57.849037] [DEBUG] [LOCAL ] SPG: Loaded 50648 existing records from primary storage. [2025-10-03T21:36:57.849493] [INFO ] [MAIN ] SPG: Loaded 50648 existing records. [2025-10-03T21:36:58.031699] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:36:58.032028] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-03T21:36:58.032133] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-03T21:36:58.032833] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-03T21:36:58.032894] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-03T21:36:58.402510] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-03T21:36:58.414829] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:36:58.417554] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T21:36:59.190716] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-03T21:36:59.990672] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-03T21:37:00.391835] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-03T21:37:00.462059] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T21:37:00.486148] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T21:37:00.790694] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-03T21:37:01.590703] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-03T21:37:02.390724] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-03T21:37:02.403243] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T21:37:02.536750] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T21:37:03.190687] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-03T21:37:03.798882] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T21:37:03.990693] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-03T21:37:04.790697] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-03T21:37:05.076222] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T21:37:05.590637] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-03T21:37:05.991750] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T21:37:06.009909] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T21:37:06.012273] [INFO ] [REMOTE ] SPB: Full fetch complete (47515 records). [2025-10-03T21:37:06.012366] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-03T21:37:06.405973] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-03T21:37:06.432955] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-03T21:37:06.432564] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:37:06.433115] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-03T21:37:06.436826] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-03T21:37:06.436896] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-03T21:37:06.438520] [DEBUG] [LOCAL ] SPB: Trimmed 47515 records to 34451 (keeping 200 days of data) [2025-10-03T21:37:06.654406] [DEBUG] [LOCAL ] SPB: Primary data saved (34451 records). [2025-10-03T21:37:06.654560] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-03T21:37:06.654719] [INFO ] [MAIN ] Update Progress: 1970/2370 symbols completed. SPB took 36.2s. Estimated remaining: 56m 15s. Rate: 7.1 symbols/min [2025-10-03T21:37:06.834400] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:37:06.882009] [DEBUG] [LOCAL ] SPGI: Loaded 46117 existing records from primary storage. [2025-10-03T21:37:06.882327] [INFO ] [MAIN ] SPGI: Loaded 46117 existing records. [2025-10-03T21:37:07.073973] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:37:07.074243] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-03T21:37:07.074312] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-03T21:37:07.074600] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-03T21:37:07.074700] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-03T21:37:07.195771] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-03T21:37:07.446758] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:37:07.990626] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-03T21:37:08.140551] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T21:37:08.450669] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T21:37:08.790598] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-03T21:37:09.297343] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T21:37:09.590736] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-03T21:37:10.200919] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T21:37:10.390621] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-03T21:37:10.504138] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T21:37:10.987495] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T21:37:11.190712] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-03T21:37:11.686236] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T21:37:11.990687] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-03T21:37:12.790697] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-03T21:37:13.426121] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T21:37:13.590754] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-03T21:37:13.668114] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T21:37:14.390718] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-03T21:37:15.190682] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-03T21:37:15.253324] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T21:37:15.832319] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T21:37:15.990713] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-03T21:37:16.790675] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-03T21:37:16.865380] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:37:17.121900] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T21:37:17.590707] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-03T21:37:18.390715] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-03T21:37:18.603433] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T21:37:19.190685] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-03T21:37:19.399982] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T21:37:19.990726] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-03T21:37:20.460000] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T21:37:20.790707] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-03T21:37:21.188075] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T21:37:21.199305] [INFO ] [REMOTE ] SPE: Full fetch complete (10076 records). [2025-10-03T21:37:21.217505] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-03T21:37:21.256841] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T21:37:21.591753] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-03T21:37:21.609192] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-03T21:37:21.610824] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-03T21:37:21.611345] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-03T21:37:21.611395] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-03T21:37:21.612211] [DEBUG] [LOCAL ] SPE: Trimmed 10076 records to 6406 (keeping 200 days of data) [2025-10-03T21:37:21.659901] [DEBUG] [LOCAL ] SPE: Primary data saved (6406 records). [2025-10-03T21:37:21.660079] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-03T21:37:21.660176] [INFO ] [MAIN ] Update Progress: 1971/2370 symbols completed. SPE took 28.3s. Estimated remaining: 56m 8s. Rate: 7.1 symbols/min [2025-10-03T21:37:21.849018] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:37:21.886098] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T21:37:21.913804] [DEBUG] [LOCAL ] SPH: Loaded 17585 existing records from primary storage. [2025-10-03T21:37:21.914106] [INFO ] [MAIN ] SPH: Loaded 17585 existing records. [2025-10-03T21:37:22.117775] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:37:22.118063] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-03T21:37:22.118121] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-03T21:37:22.118382] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-03T21:37:22.118440] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-03T21:37:22.395850] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-03T21:37:22.500093] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:37:23.190692] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-03T21:37:23.531488] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T21:37:23.990622] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-03T21:37:24.178749] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T21:37:24.208416] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T21:37:24.790718] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-03T21:37:25.590734] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-03T21:37:25.719826] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T21:37:25.871753] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T21:37:26.390729] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-03T21:37:27.093938] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T21:37:27.190750] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-03T21:37:27.758982] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T21:37:27.990713] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-03T21:37:28.790682] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-03T21:37:28.970135] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:37:29.115132] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T21:37:29.590712] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-03T21:37:30.390630] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-03T21:37:30.572791] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:37:30.786511] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T21:37:31.190751] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-03T21:37:31.990769] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-03T21:37:32.527718] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T21:37:32.790725] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-03T21:37:33.012219] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T21:37:33.442732] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T21:37:33.590711] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-03T21:37:33.753825] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T21:37:34.390732] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-03T21:37:35.190677] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-03T21:37:35.539568] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T21:37:35.851198] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T21:37:35.990709] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-03T21:37:36.186555] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T21:37:36.435428] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T21:37:36.442615] [INFO ] [REMOTE ] SPG: Full fetch complete (72009 records). [2025-10-03T21:37:36.442845] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-03T21:37:36.795853] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-03T21:37:36.874748] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-03T21:37:36.874872] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-03T21:37:36.876676] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-03T21:37:36.876777] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-03T21:37:36.879132] [DEBUG] [LOCAL ] SPG: Trimmed 72009 records to 51014 (keeping 200 days of data) [2025-10-03T21:37:37.239434] [DEBUG] [LOCAL ] SPG: Primary data saved (51014 records). [2025-10-03T21:37:37.239637] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-03T21:37:37.239798] [INFO ] [MAIN ] Update Progress: 1972/2370 symbols completed. SPG took 39.7s. Estimated remaining: 56m 1s. Rate: 7.1 symbols/min [2025-10-03T21:37:37.412396] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:37:37.456489] [DEBUG] [LOCAL ] SPHR: Loaded 40384 existing records from primary storage. [2025-10-03T21:37:37.456939] [INFO ] [MAIN ] SPHR: Loaded 40384 existing records. [2025-10-03T21:37:37.598261] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-03T21:37:37.639687] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:37:37.641276] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-03T21:37:37.641335] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-03T21:37:37.641812] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-03T21:37:37.641874] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-03T21:37:38.012825] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:37:38.031737] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:37:38.390757] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-03T21:37:39.190705] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-03T21:37:39.345604] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T21:37:39.640815] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:37:39.643371] [INFO ] [REMOTE ] SPGI: Full fetch complete (66941 records). [2025-10-03T21:37:39.643736] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-03T21:37:39.923987] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T21:37:39.995868] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-03T21:37:40.118638] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-03T21:37:40.118787] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-03T21:37:40.122899] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-03T21:37:40.122992] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-03T21:37:40.125061] [DEBUG] [LOCAL ] SPGI: Trimmed 66941 records to 46480 (keeping 200 days of data) [2025-10-03T21:37:40.436379] [DEBUG] [LOCAL ] SPGI: Primary data saved (46480 records). [2025-10-03T21:37:40.436572] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-03T21:37:40.436707] [INFO ] [MAIN ] Update Progress: 1973/2370 symbols completed. SPGI took 33.8s. Estimated remaining: 55m 51s. Rate: 7.1 symbols/min [2025-10-03T21:37:40.633061] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:37:40.673102] [DEBUG] [LOCAL ] SPIR: Loaded 37398 existing records from primary storage. [2025-10-03T21:37:40.673526] [INFO ] [MAIN ] SPIR: Loaded 37398 existing records. [2025-10-03T21:37:40.795821] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-03T21:37:40.873173] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:37:40.873509] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-03T21:37:40.873559] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-03T21:37:40.873881] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-03T21:37:40.873957] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-03T21:37:41.285584] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:37:41.595981] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-03T21:37:41.603339] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:37:41.879743] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T21:37:42.390750] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-03T21:37:43.190639] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-03T21:37:43.339068] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T21:37:43.341609] [INFO ] [REMOTE ] SPCE: Full fetch complete (72396 records). [2025-10-03T21:37:43.341761] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-03T21:37:43.769995] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-03T21:37:43.770255] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-03T21:37:43.771696] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-03T21:37:43.771773] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-03T21:37:43.773386] [DEBUG] [LOCAL ] SPCE: Trimmed 72396 records to 50695 (keeping 200 days of data) [2025-10-03T21:37:43.897359] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:37:43.924013] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T21:37:43.993126] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-03T21:37:44.137560] [DEBUG] [LOCAL ] SPCE: Primary data saved (50695 records). [2025-10-03T21:37:44.137795] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-03T21:37:44.137960] [INFO ] [MAIN ] Update Progress: 1974/2370 symbols completed. SPCE took 56.9s. Estimated remaining: 55m 42s. Rate: 7.1 symbols/min [2025-10-03T21:37:44.321759] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:37:44.330304] [DEBUG] [LOCAL ] SPMC: Loaded 5419 existing records from primary storage. [2025-10-03T21:37:44.330575] [INFO ] [MAIN ] SPMC: Loaded 5419 existing records. [2025-10-03T21:37:44.533763] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:37:44.534070] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-03T21:37:44.534154] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-03T21:37:44.534451] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-03T21:37:44.534511] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-03T21:37:44.798056] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-03T21:37:44.928785] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:37:45.269035] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:37:45.590700] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-03T21:37:46.188894] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T21:37:46.217818] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T21:37:46.390712] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-03T21:37:46.960854] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T21:37:47.190701] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-03T21:37:47.990736] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-03T21:37:48.621853] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T21:37:48.790706] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-03T21:37:49.227715] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T21:37:49.590721] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-03T21:37:50.041808] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T21:37:50.390780] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-03T21:37:51.115087] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T21:37:51.146495] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T21:37:51.190709] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-03T21:37:51.990732] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-03T21:37:52.680072] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T21:37:52.790691] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-03T21:37:53.479550] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T21:37:53.590766] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-03T21:37:54.225889] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T21:37:54.392594] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-03T21:37:54.396282] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T21:37:55.190716] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-03T21:37:55.812881] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T21:37:55.899183] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T21:37:55.990629] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-03T21:37:56.790733] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-03T21:37:57.423962] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T21:37:57.524077] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T21:37:57.590627] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-03T21:37:58.390809] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-03T21:37:59.033962] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T21:37:59.190783] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-03T21:37:59.302161] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T21:37:59.788438] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T21:37:59.990718] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-03T21:38:00.625733] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T21:38:00.790688] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-03T21:38:01.456407] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T21:38:01.460917] [INFO ] [REMOTE ] SPH: Full fetch complete (28253 records). [2025-10-03T21:38:01.461116] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-03T21:38:01.595896] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-03T21:38:01.885872] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-03T21:38:01.885983] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-03T21:38:01.886741] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-03T21:38:01.886811] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-03T21:38:01.888002] [DEBUG] [LOCAL ] SPH: Trimmed 28253 records to 17666 (keeping 200 days of data) [2025-10-03T21:38:02.015106] [DEBUG] [LOCAL ] SPH: Primary data saved (17666 records). [2025-10-03T21:38:02.015331] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-03T21:38:02.015700] [INFO ] [MAIN ] Update Progress: 1975/2370 symbols completed. SPH took 40.4s. Estimated remaining: 55m 35s. Rate: 7.1 symbols/min [2025-10-03T21:38:02.192109] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:02.192348] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-03T21:38:02.192389] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-03T21:38:02.192541] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-03T21:38:02.192585] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-03T21:38:02.192629] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-03T21:38:02.192701] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-03T21:38:02.395946] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-03T21:38:02.566019] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:03.190721] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-03T21:38:03.351977] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T21:38:03.415422] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:38:03.415984] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-03T21:38:03.416087] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:38:03.416138] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-03T21:38:03.416173] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:38:03.416215] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-03T21:38:03.416280] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-03T21:38:03.416317] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-03T21:38:03.416404] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-03T21:38:03.416516] [INFO ] [MAIN ] Update Progress: 1976/2370 symbols completed. SPME took 1.4s. Estimated remaining: 55m 26s. Rate: 7.1 symbols/min [2025-10-03T21:38:03.596191] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:03.647001] [DEBUG] [LOCAL ] SPNT: Loaded 35084 existing records from primary storage. [2025-10-03T21:38:03.647426] [INFO ] [MAIN ] SPNT: Loaded 35084 existing records. [2025-10-03T21:38:03.845918] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:03.846209] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-03T21:38:03.846264] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-03T21:38:03.846799] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-03T21:38:03.846861] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-03T21:38:03.963937] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T21:38:03.988017] [INFO ] [REMOTE ] SPHR: Full fetch complete (57864 records). [2025-10-03T21:38:04.004427] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-03T21:38:04.024949] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-03T21:38:04.478597] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:04.722436] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-03T21:38:04.722547] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-03T21:38:04.724659] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-03T21:38:04.724730] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-03T21:38:04.726476] [DEBUG] [LOCAL ] SPHR: Trimmed 57864 records to 40745 (keeping 200 days of data) [2025-10-03T21:38:04.814290] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-03T21:38:04.988379] [DEBUG] [LOCAL ] SPHR: Primary data saved (40745 records). [2025-10-03T21:38:04.988570] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-03T21:38:04.988719] [INFO ] [MAIN ] Update Progress: 1977/2370 symbols completed. SPHR took 27.7s. Estimated remaining: 55m 16s. Rate: 7.1 symbols/min [2025-10-03T21:38:05.166791] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:05.224223] [DEBUG] [LOCAL ] SPOT: Loaded 50918 existing records from primary storage. [2025-10-03T21:38:05.224716] [INFO ] [MAIN ] SPOT: Loaded 50918 existing records. [2025-10-03T21:38:05.407177] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:05.407457] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-03T21:38:05.407511] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-03T21:38:05.407867] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-03T21:38:05.407928] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-03T21:38:05.619203] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-03T21:38:05.732771] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T21:38:05.825410] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:06.216488] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T21:38:06.333328] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T21:38:06.390707] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-03T21:38:07.190804] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-03T21:38:07.314813] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T21:38:07.990756] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-03T21:38:08.790696] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-03T21:38:09.212915] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T21:38:09.594396] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-03T21:38:09.601670] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T21:38:10.029454] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T21:38:10.030430] [INFO ] [REMOTE ] SPMC: Full fetch complete (8134 records). [2025-10-03T21:38:10.030528] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-03T21:38:10.279155] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T21:38:10.400769] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-03T21:38:10.446225] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-03T21:38:10.446298] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-03T21:38:10.446688] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-03T21:38:10.446755] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-03T21:38:10.447231] [DEBUG] [LOCAL ] SPMC: Trimmed 8134 records to 5451 (keeping 200 days of data) [2025-10-03T21:38:10.483054] [DEBUG] [LOCAL ] SPMC: Primary data saved (5451 records). [2025-10-03T21:38:10.483199] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-03T21:38:10.483331] [INFO ] [MAIN ] Update Progress: 1978/2370 symbols completed. SPMC took 26.3s. Estimated remaining: 55m 7s. Rate: 7.1 symbols/min [2025-10-03T21:38:10.655760] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:10.707168] [DEBUG] [LOCAL ] SPR: Loaded 41503 existing records from primary storage. [2025-10-03T21:38:10.707631] [INFO ] [MAIN ] SPR: Loaded 41503 existing records. [2025-10-03T21:38:10.893027] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:10.893318] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-03T21:38:10.893369] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-03T21:38:10.893681] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-03T21:38:10.893742] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-03T21:38:11.195840] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-03T21:38:11.252055] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:11.990741] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-03T21:38:12.056002] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T21:38:12.790669] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-03T21:38:12.862979] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T21:38:13.471333] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T21:38:13.590625] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-03T21:38:13.759696] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T21:38:14.390747] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-03T21:38:15.169274] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T21:38:15.190617] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-03T21:38:15.990732] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-03T21:38:16.129797] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T21:38:16.692030] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T21:38:16.790730] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-03T21:38:17.395684] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T21:38:17.590752] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-03T21:38:18.390765] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-03T21:38:18.951697] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-03T21:38:19.015415] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T21:38:19.190766] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-03T21:38:19.351785] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T21:38:19.358859] [INFO ] [REMOTE ] SPIR: Full fetch complete (52966 records). [2025-10-03T21:38:19.359092] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-03T21:38:19.876358] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-03T21:38:19.876522] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-03T21:38:19.877639] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-03T21:38:19.877758] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-03T21:38:19.879129] [DEBUG] [LOCAL ] SPIR: Trimmed 52966 records to 37723 (keeping 200 days of data) [2025-10-03T21:38:19.991545] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-03T21:38:20.123029] [DEBUG] [LOCAL ] SPIR: Primary data saved (37723 records). [2025-10-03T21:38:20.123191] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-03T21:38:20.123323] [INFO ] [MAIN ] Update Progress: 1979/2370 symbols completed. SPIR took 39.7s. Estimated remaining: 54m 59s. Rate: 7.1 symbols/min [2025-10-03T21:38:20.315798] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:20.347152] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T21:38:20.367263] [DEBUG] [LOCAL ] SPRU: Loaded 9208 existing records from primary storage. [2025-10-03T21:38:20.367501] [INFO ] [MAIN ] SPRU: Loaded 9208 existing records. [2025-10-03T21:38:20.588387] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:20.588626] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-03T21:38:20.588719] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-03T21:38:20.588969] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-03T21:38:20.589070] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-03T21:38:20.805596] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-03T21:38:21.011762] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:21.545330] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T21:38:21.590741] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-03T21:38:22.390724] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-03T21:38:23.036910] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T21:38:23.148530] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-03T21:38:23.190681] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-03T21:38:23.202419] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T21:38:23.990740] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-03T21:38:24.617046] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T21:38:24.790679] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-03T21:38:25.364927] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T21:38:25.590711] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-03T21:38:25.673548] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-03T21:38:26.390726] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-03T21:38:26.855828] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:38:26.956178] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T21:38:27.190779] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-03T21:38:27.990761] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-03T21:38:28.790723] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-03T21:38:29.361217] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-03T21:38:29.484679] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T21:38:29.590692] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-03T21:38:29.854377] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T21:38:29.856569] [INFO ] [REMOTE ] SPNT: Full fetch complete (49064 records). [2025-10-03T21:38:29.856755] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-03T21:38:30.295071] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-03T21:38:30.295185] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-03T21:38:30.296285] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-03T21:38:30.296353] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-03T21:38:30.297540] [DEBUG] [LOCAL ] SPNT: Trimmed 49064 records to 35308 (keeping 200 days of data) [2025-10-03T21:38:30.391333] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-03T21:38:30.521855] [DEBUG] [LOCAL ] SPNT: Primary data saved (35308 records). [2025-10-03T21:38:30.522044] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-03T21:38:30.523051] [INFO ] [MAIN ] Update Progress: 1980/2370 symbols completed. SPNT took 27.1s. Estimated remaining: 54m 51s. Rate: 7.1 symbols/min [2025-10-03T21:38:30.699531] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:30.726254] [DEBUG] [LOCAL ] SPXC: Loaded 23572 existing records from primary storage. [2025-10-03T21:38:30.726564] [INFO ] [MAIN ] SPXC: Loaded 23572 existing records. [2025-10-03T21:38:30.921567] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:30.921867] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-03T21:38:30.921923] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-03T21:38:30.922152] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-03T21:38:30.922211] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-03T21:38:31.045462] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T21:38:31.191606] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-03T21:38:31.335468] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:31.368506] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T21:38:31.985239] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T21:38:31.990628] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-03T21:38:32.098555] [DEBUG] [REMOTE ] SPRU: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-03T21:38:32.099014] [WARN ] [REMOTE ] SPRU: No data returned for month 2025-06 [2025-10-03T21:38:32.099130] [FATAL] [REMOTE ] SPRU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:38:32.099312] [FATAL] [MAIN ] SPRU: Failed to fetch primary data. [2025-10-03T21:38:32.099401] [WARN ] [MAIN ] SPRU: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:38:32.099500] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-03T21:38:32.099597] [DEBUG] [LOCAL ] SPRU: No primary data file found to delete. [2025-10-03T21:38:32.099682] [INFO ] [LOCAL ] SPRU: Starting deletion of derivative data. [2025-10-03T21:38:32.100272] [DEBUG] [LOCAL ] SPRU: Deleted derivative data file. [2025-10-03T21:38:32.100436] [INFO ] [MAIN ] Update Progress: 1981/2370 symbols completed. SPRU took 12.0s. Estimated remaining: 54m 41s. Rate: 7.1 symbols/min [2025-10-03T21:38:32.309557] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:32.322043] [DEBUG] [LOCAL ] SPXX: Loaded 9234 existing records from primary storage. [2025-10-03T21:38:32.322364] [INFO ] [MAIN ] SPXX: Loaded 9234 existing records. [2025-10-03T21:38:32.518460] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:32.518711] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-03T21:38:32.518781] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-03T21:38:32.519059] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-03T21:38:32.519139] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-03T21:38:32.795874] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-03T21:38:32.920085] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:33.590704] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-03T21:38:34.390693] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-03T21:38:34.717631] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T21:38:34.801751] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-03T21:38:35.190695] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-03T21:38:35.464043] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T21:38:35.990736] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-03T21:38:36.675963] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T21:38:36.694968] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T21:38:36.790682] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-03T21:38:37.590718] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-03T21:38:38.399404] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-03T21:38:38.400630] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T21:38:39.171695] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-03T21:38:39.190628] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-03T21:38:39.247968] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T21:38:39.990677] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-03T21:38:40.790677] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-03T21:38:41.136944] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T21:38:41.421608] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T21:38:41.590740] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-03T21:38:42.384619] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:38:42.392761] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-03T21:38:42.666419] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T21:38:43.190717] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-03T21:38:43.990689] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-03T21:38:44.384766] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T21:38:44.765517] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T21:38:44.790617] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-03T21:38:44.835546] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:38:45.590730] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-03T21:38:46.225046] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T21:38:46.397367] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-03T21:38:46.401473] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T21:38:47.190736] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-03T21:38:47.519075] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T21:38:47.990705] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-03T21:38:48.790627] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-03T21:38:48.951410] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T21:38:48.953939] [INFO ] [REMOTE ] SPOT: Full fetch complete (73744 records). [2025-10-03T21:38:48.954081] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-03T21:38:49.423494] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-03T21:38:49.423936] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-03T21:38:49.425830] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-03T21:38:49.426911] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T21:38:49.427058] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-03T21:38:49.434950] [DEBUG] [LOCAL ] SPOT: Trimmed 73744 records to 51295 (keeping 200 days of data) [2025-10-03T21:38:49.625991] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-03T21:38:49.777850] [DEBUG] [LOCAL ] SPOT: Primary data saved (51295 records). [2025-10-03T21:38:49.778057] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-03T21:38:49.778204] [INFO ] [MAIN ] Update Progress: 1982/2370 symbols completed. SPOT took 44.8s. Estimated remaining: 54m 34s. Rate: 7.1 symbols/min [2025-10-03T21:38:49.974908] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:50.020881] [DEBUG] [LOCAL ] SQM: Loaded 48970 existing records from primary storage. [2025-10-03T21:38:50.021228] [INFO ] [MAIN ] SQM: Loaded 48970 existing records. [2025-10-03T21:38:50.247536] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:50.248068] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-03T21:38:50.248172] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-03T21:38:50.248557] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-03T21:38:50.248618] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-03T21:38:50.437889] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-03T21:38:50.481539] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T21:38:50.520886] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:38:50.689380] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:51.190698] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-03T21:38:51.595155] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T21:38:51.937815] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T21:38:51.990684] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-03T21:38:52.790700] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-03T21:38:53.234704] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T21:38:53.237294] [INFO ] [REMOTE ] SPR: Full fetch complete (60152 records). [2025-10-03T21:38:53.237477] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-03T21:38:53.584103] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T21:38:53.594711] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-03T21:38:53.688034] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-03T21:38:53.688162] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-03T21:38:53.689414] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-03T21:38:53.689482] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-03T21:38:53.690870] [DEBUG] [LOCAL ] SPR: Trimmed 60152 records to 41819 (keeping 200 days of data) [2025-10-03T21:38:53.944095] [DEBUG] [LOCAL ] SPR: Primary data saved (41819 records). [2025-10-03T21:38:53.944224] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-03T21:38:53.944361] [INFO ] [MAIN ] Update Progress: 1983/2370 symbols completed. SPR took 43.5s. Estimated remaining: 54m 25s. Rate: 7.1 symbols/min [2025-10-03T21:38:54.120429] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:54.149819] [DEBUG] [LOCAL ] SQNS: Loaded 26511 existing records from primary storage. [2025-10-03T21:38:54.150090] [INFO ] [MAIN ] SQNS: Loaded 26511 existing records. [2025-10-03T21:38:54.336981] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:54.337219] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-03T21:38:54.337267] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-03T21:38:54.337468] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-03T21:38:54.337552] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-03T21:38:54.403840] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-03T21:38:54.730932] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:55.105328] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-03T21:38:55.190678] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-03T21:38:55.372864] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T21:38:55.768425] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T21:38:55.990686] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-03T21:38:56.700958] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T21:38:56.702362] [INFO ] [REMOTE ] SPXX: Full fetch complete (13061 records). [2025-10-03T21:38:56.702445] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-03T21:38:56.795762] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-03T21:38:57.109110] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-03T21:38:57.109191] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-03T21:38:57.109485] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-03T21:38:57.109524] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-03T21:38:57.110031] [DEBUG] [LOCAL ] SPXX: Trimmed 13061 records to 9387 (keeping 200 days of data) [2025-10-03T21:38:57.173056] [DEBUG] [LOCAL ] SPXX: Primary data saved (9387 records). [2025-10-03T21:38:57.173296] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-03T21:38:57.173475] [INFO ] [MAIN ] Update Progress: 1984/2370 symbols completed. SPXX took 25.1s. Estimated remaining: 54m 15s. Rate: 7.1 symbols/min [2025-10-03T21:38:57.352551] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:38:57.388999] [DEBUG] [LOCAL ] SR: Loaded 33043 existing records from primary storage. [2025-10-03T21:38:57.389292] [INFO ] [MAIN ] SR: Loaded 33043 existing records. [2025-10-03T21:38:57.582338] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:38:57.582546] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-03T21:38:57.582594] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-03T21:38:57.583084] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-03T21:38:57.583143] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-03T21:38:57.596469] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-03T21:38:58.021971] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:38:58.390703] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-03T21:38:58.468336] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T21:38:58.856102] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T21:38:59.190680] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-03T21:38:59.324832] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T21:38:59.990725] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-03T21:39:00.790720] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-03T21:39:00.997949] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T21:39:01.222615] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T21:39:01.590741] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-03T21:39:02.178322] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T21:39:02.220740] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T21:39:02.390734] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-03T21:39:03.190688] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-03T21:39:03.290476] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T21:39:03.990731] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-03T21:39:04.464526] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T21:39:04.790737] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-03T21:39:05.590723] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-03T21:39:05.685334] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:39:05.713898] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T21:39:06.390698] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-03T21:39:06.769689] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T21:39:07.190702] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-03T21:39:07.983743] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T21:39:07.990620] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-03T21:39:08.140169] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T21:39:08.790700] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-03T21:39:08.800996] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T21:39:09.590706] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-03T21:39:10.390634] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-03T21:39:10.449279] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T21:39:10.898778] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T21:39:11.190689] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-03T21:39:11.433020] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T21:39:11.990768] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-03T21:39:12.510352] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:39:12.790734] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-03T21:39:12.899941] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T21:39:12.901962] [INFO ] [REMOTE ] SPXC: Full fetch complete (34205 records). [2025-10-03T21:39:12.902158] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-03T21:39:13.312154] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-03T21:39:13.312262] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-03T21:39:13.313129] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-03T21:39:13.313196] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-03T21:39:13.314259] [DEBUG] [LOCAL ] SPXC: Trimmed 34205 records to 23726 (keeping 200 days of data) [2025-10-03T21:39:13.462741] [DEBUG] [LOCAL ] SPXC: Primary data saved (23726 records). [2025-10-03T21:39:13.462886] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-03T21:39:13.462996] [INFO ] [MAIN ] Update Progress: 1985/2370 symbols completed. SPXC took 42.9s. Estimated remaining: 54m 9s. Rate: 7.1 symbols/min [2025-10-03T21:39:13.595915] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-03T21:39:13.652798] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:39:13.707315] [DEBUG] [LOCAL ] SRE: Loaded 53812 existing records from primary storage. [2025-10-03T21:39:13.707709] [INFO ] [MAIN ] SRE: Loaded 53812 existing records. [2025-10-03T21:39:13.906049] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:39:13.906297] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-03T21:39:13.906346] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-03T21:39:13.906711] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-03T21:39:13.906770] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-03T21:39:14.274982] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:39:14.390749] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-03T21:39:15.131988] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T21:39:15.181889] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T21:39:15.192577] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-03T21:39:15.990720] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-03T21:39:16.335908] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T21:39:16.608002] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T21:39:16.790683] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-03T21:39:17.590757] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-03T21:39:17.975697] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T21:39:18.390735] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-03T21:39:18.435387] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T21:39:18.891743] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T21:39:19.190706] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-03T21:39:19.799342] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T21:39:19.990726] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-03T21:39:20.790638] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-03T21:39:20.904215] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T21:39:21.554808] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:39:21.590613] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-03T21:39:22.390678] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-03T21:39:22.492553] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T21:39:22.494094] [INFO ] [REMOTE ] SQNS: Full fetch complete (32233 records). [2025-10-03T21:39:22.494182] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-03T21:39:22.946730] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T21:39:23.021398] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-03T21:39:23.021542] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-03T21:39:23.023531] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-03T21:39:23.023622] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-03T21:39:23.025006] [DEBUG] [LOCAL ] SQNS: Trimmed 32233 records to 26708 (keeping 200 days of data) [2025-10-03T21:39:23.182786] [DEBUG] [LOCAL ] SQNS: Primary data saved (26708 records). [2025-10-03T21:39:23.182935] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-03T21:39:23.183083] [INFO ] [MAIN ] Update Progress: 1986/2370 symbols completed. SQNS took 29.2s. Estimated remaining: 54m 0s. Rate: 7.1 symbols/min [2025-10-03T21:39:23.195889] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-03T21:39:23.383128] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:39:23.395625] [DEBUG] [LOCAL ] SREA: Loaded 10481 existing records from primary storage. [2025-10-03T21:39:23.395880] [INFO ] [MAIN ] SREA: Loaded 10481 existing records. [2025-10-03T21:39:23.587004] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:39:23.587246] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-03T21:39:23.587298] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-03T21:39:23.587505] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-03T21:39:23.587571] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-03T21:39:23.984994] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:39:23.990621] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-03T21:39:24.285693] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:39:24.550969] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T21:39:24.654831] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T21:39:24.790703] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-03T21:39:25.596225] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-03T21:39:25.597318] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T21:39:26.390683] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-03T21:39:27.190698] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-03T21:39:27.323661] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:39:27.990715] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-03T21:39:28.105809] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T21:39:28.270348] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T21:39:28.790685] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-03T21:39:29.107667] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:39:29.111467] [INFO ] [REMOTE ] SQM: Full fetch complete (69009 records). [2025-10-03T21:39:29.111624] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-03T21:39:29.533136] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-03T21:39:29.533257] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-03T21:39:29.535239] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-03T21:39:29.535312] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-03T21:39:29.537451] [DEBUG] [LOCAL ] SQM: Trimmed 69009 records to 49334 (keeping 200 days of data) [2025-10-03T21:39:29.612165] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-03T21:39:29.870047] [DEBUG] [LOCAL ] SQM: Primary data saved (49334 records). [2025-10-03T21:39:29.870258] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-03T21:39:29.870395] [INFO ] [MAIN ] Update Progress: 1987/2370 symbols completed. SQM took 40.1s. Estimated remaining: 53m 52s. Rate: 7.1 symbols/min [2025-10-03T21:39:30.044521] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:39:30.085798] [DEBUG] [LOCAL ] SRFM: Loaded 37139 existing records from primary storage. [2025-10-03T21:39:30.086282] [INFO ] [MAIN ] SRFM: Loaded 37139 existing records. [2025-10-03T21:39:30.284749] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:39:30.285348] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-03T21:39:30.285415] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-03T21:39:30.285895] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-03T21:39:30.285957] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-03T21:39:30.393999] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-03T21:39:30.432587] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T21:39:30.515491] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T21:39:30.724902] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:39:31.190749] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-03T21:39:31.990638] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-03T21:39:32.270581] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T21:39:32.790679] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-03T21:39:32.882386] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:39:33.510899] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T21:39:33.590680] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-03T21:39:34.359259] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T21:39:34.390616] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-03T21:39:34.943408] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T21:39:35.190743] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-03T21:39:35.934724] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T21:39:35.990690] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-03T21:39:36.179342] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T21:39:36.181182] [INFO ] [REMOTE ] SR: Full fetch complete (46276 records). [2025-10-03T21:39:36.181276] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-03T21:39:36.619625] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-03T21:39:36.619743] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-03T21:39:36.620690] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-03T21:39:36.620768] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-03T21:39:36.621980] [DEBUG] [LOCAL ] SR: Trimmed 46276 records to 33250 (keeping 200 days of data) [2025-10-03T21:39:36.807341] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-03T21:39:36.833564] [DEBUG] [LOCAL ] SR: Primary data saved (33250 records). [2025-10-03T21:39:36.833753] [INFO ] [MAIN ] SR: Full history saved. [2025-10-03T21:39:36.833880] [INFO ] [MAIN ] Update Progress: 1988/2370 symbols completed. SR took 39.7s. Estimated remaining: 53m 43s. Rate: 7.1 symbols/min [2025-10-03T21:39:37.024408] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:39:37.042248] [DEBUG] [LOCAL ] SRG: Loaded 15591 existing records from primary storage. [2025-10-03T21:39:37.042523] [INFO ] [MAIN ] SRG: Loaded 15591 existing records. [2025-10-03T21:39:37.262216] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:39:37.262507] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-03T21:39:37.262713] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-03T21:39:37.262983] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-03T21:39:37.263045] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-03T21:39:37.593622] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-03T21:39:37.748894] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:39:37.761690] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T21:39:37.805972] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T21:39:38.390693] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-03T21:39:38.933374] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T21:39:39.190700] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-03T21:39:39.287212] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-03T21:39:39.990710] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-03T21:39:40.376834] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T21:39:40.790733] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-03T21:39:41.266293] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:39:41.590691] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-03T21:39:41.632865] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T21:39:42.390738] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-03T21:39:42.583346] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T21:39:43.075908] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T21:39:43.190688] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-03T21:39:43.990714] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-03T21:39:44.790744] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-03T21:39:44.944931] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T21:39:45.142720] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T21:39:45.590767] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-03T21:39:46.013877] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T21:39:46.390676] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-03T21:39:46.648832] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T21:39:47.190685] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-03T21:39:47.551680] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T21:39:47.646635] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:39:47.650032] [INFO ] [REMOTE ] SRE: Full fetch complete (77295 records). [2025-10-03T21:39:47.650200] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-03T21:39:47.995915] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-03T21:39:48.105777] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-03T21:39:48.105904] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-03T21:39:48.108874] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-03T21:39:48.108952] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-03T21:39:48.111270] [DEBUG] [LOCAL ] SRE: Trimmed 77295 records to 54200 (keeping 200 days of data) [2025-10-03T21:39:48.476911] [DEBUG] [LOCAL ] SRE: Primary data saved (54200 records). [2025-10-03T21:39:48.477175] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-03T21:39:48.478147] [INFO ] [MAIN ] Update Progress: 1989/2370 symbols completed. SRE took 35.0s. Estimated remaining: 53m 35s. Rate: 7.1 symbols/min [2025-10-03T21:39:48.653995] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:39:48.687019] [DEBUG] [LOCAL ] SRI: Loaded 27284 existing records from primary storage. [2025-10-03T21:39:48.687372] [INFO ] [MAIN ] SRI: Loaded 27284 existing records. [2025-10-03T21:39:48.792452] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-03T21:39:48.878496] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:39:48.878872] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-03T21:39:48.878928] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-03T21:39:48.879262] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-03T21:39:48.879337] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-03T21:39:49.266192] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:39:49.283949] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T21:39:49.590703] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-03T21:39:49.889863] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T21:39:50.390712] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-03T21:39:50.911610] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T21:39:51.190752] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-03T21:39:51.330313] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T21:39:51.990698] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-03T21:39:52.790732] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-03T21:39:52.815325] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:39:52.941418] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:39:53.590721] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-03T21:39:53.913612] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T21:39:54.392083] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-03T21:39:54.394471] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T21:39:55.190722] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-03T21:39:55.990755] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-03T21:39:56.507797] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:39:56.525683] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-03T21:39:56.790690] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-03T21:39:56.898054] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-03T21:39:57.590761] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-03T21:39:57.734042] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T21:39:58.390731] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-03T21:39:59.190736] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-03T21:39:59.213437] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T21:39:59.470746] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T21:39:59.990705] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-03T21:40:00.177638] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T21:40:00.790731] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-03T21:40:01.496162] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T21:40:01.498140] [INFO ] [REMOTE ] SRG: Full fetch complete (24472 records). [2025-10-03T21:40:01.498428] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-03T21:40:01.595885] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-03T21:40:01.963895] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-03T21:40:01.964875] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-03T21:40:01.965783] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-03T21:40:01.965851] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-03T21:40:01.967753] [DEBUG] [LOCAL ] SRG: Trimmed 24472 records to 15721 (keeping 200 days of data) [2025-10-03T21:40:02.091310] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T21:40:02.123101] [DEBUG] [LOCAL ] SRG: Primary data saved (15721 records). [2025-10-03T21:40:02.123278] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-03T21:40:02.123465] [INFO ] [MAIN ] Update Progress: 1990/2370 symbols completed. SRG took 25.3s. Estimated remaining: 53m 28s. Rate: 7.1 symbols/min [2025-10-03T21:40:02.306605] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:02.306884] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-03T21:40:02.306945] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-03T21:40:02.307117] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-03T21:40:02.307192] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-03T21:40:02.307263] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-03T21:40:02.307301] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-03T21:40:02.392949] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-03T21:40:02.581270] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T21:40:02.722155] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:03.190742] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-03T21:40:03.990749] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-03T21:40:04.234517] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-03T21:40:04.237303] [INFO ] [REMOTE ] SRFM: Full fetch complete (49658 records). [2025-10-03T21:40:04.237712] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-03T21:40:04.592081] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T21:40:04.606338] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T21:40:04.796097] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-03T21:40:04.923589] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-03T21:40:04.923759] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-03T21:40:04.926056] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-03T21:40:04.926222] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-03T21:40:04.928429] [DEBUG] [LOCAL ] SRFM: Trimmed 49658 records to 37523 (keeping 200 days of data) [2025-10-03T21:40:05.255874] [DEBUG] [LOCAL ] SRFM: Primary data saved (37523 records). [2025-10-03T21:40:05.256068] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-03T21:40:05.256201] [INFO ] [MAIN ] Update Progress: 1991/2370 symbols completed. SRFM took 35.4s. Estimated remaining: 53m 18s. Rate: 7.1 symbols/min [2025-10-03T21:40:05.485594] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T21:40:05.509673] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:05.511579] [INFO ] [REMOTE ] SREA: Full fetch complete (15687 records). [2025-10-03T21:40:05.512242] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-03T21:40:05.594535] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-03T21:40:05.646673] [DEBUG] [LOCAL ] SRV: Loaded 7423 existing records from primary storage. [2025-10-03T21:40:05.662304] [INFO ] [MAIN ] SRV: Loaded 7423 existing records. [2025-10-03T21:40:06.155419] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:06.221918] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T21:40:06.185121] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-03T21:40:06.234701] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-03T21:40:06.234464] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-03T21:40:06.234926] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-03T21:40:06.235677] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-03T21:40:06.235754] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-03T21:40:06.235875] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-03T21:40:06.235977] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-03T21:40:06.316912] [DEBUG] [LOCAL ] SREA: Trimmed 15687 records to 10524 (keeping 200 days of data) [2025-10-03T21:40:06.398760] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-03T21:40:06.676392] [DEBUG] [LOCAL ] SREA: Primary data saved (10524 records). [2025-10-03T21:40:06.696907] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-03T21:40:06.700941] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:06.701327] [INFO ] [MAIN ] Update Progress: 1992/2370 symbols completed. SREA took 43.5s. Estimated remaining: 53m 8s. Rate: 7.1 symbols/min [2025-10-03T21:40:06.876760] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T21:40:06.898162] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:06.948858] [DEBUG] [LOCAL ] SSB: Loaded 42929 existing records from primary storage. [2025-10-03T21:40:06.949285] [INFO ] [MAIN ] SSB: Loaded 42929 existing records. [2025-10-03T21:40:07.168169] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:07.168443] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-03T21:40:07.168492] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-03T21:40:07.168866] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-03T21:40:07.168927] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-03T21:40:07.200133] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-03T21:40:07.575864] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:07.990747] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-03T21:40:08.379914] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-03T21:40:08.496352] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T21:40:08.790773] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-03T21:40:09.590749] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-03T21:40:09.701256] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T21:40:10.390745] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-03T21:40:11.165795] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T21:40:11.190706] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-03T21:40:11.193248] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T21:40:11.990756] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-03T21:40:12.391274] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-03T21:40:12.415390] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T21:40:12.790751] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-03T21:40:13.313386] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T21:40:13.590707] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-03T21:40:13.956680] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T21:40:14.390730] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-03T21:40:15.190723] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-03T21:40:15.748222] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:40:15.990776] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-03T21:40:16.790686] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-03T21:40:16.922708] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T21:40:17.155984] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T21:40:17.425999] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T21:40:17.590736] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-03T21:40:18.390697] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-03T21:40:18.661879] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-03T21:40:18.711191] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T21:40:19.190755] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-03T21:40:19.990723] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-03T21:40:20.251633] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T21:40:20.635746] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T21:40:20.790717] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-03T21:40:21.590740] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-03T21:40:21.702058] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T21:40:22.390705] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-03T21:40:23.053901] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T21:40:23.190673] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-03T21:40:23.220133] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T21:40:23.221528] [INFO ] [REMOTE ] SRI: Full fetch complete (41100 records). [2025-10-03T21:40:23.221605] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-03T21:40:23.641639] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-03T21:40:23.641770] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-03T21:40:23.642808] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-03T21:40:23.642904] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-03T21:40:23.644121] [DEBUG] [LOCAL ] SRI: Trimmed 41100 records to 27468 (keeping 200 days of data) [2025-10-03T21:40:23.853487] [DEBUG] [LOCAL ] SRI: Primary data saved (27468 records). [2025-10-03T21:40:23.853769] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-03T21:40:23.853885] [INFO ] [MAIN ] Update Progress: 1993/2370 symbols completed. SRI took 35.4s. Estimated remaining: 53m 2s. Rate: 7.1 symbols/min [2025-10-03T21:40:23.995912] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-03T21:40:24.048251] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:24.078022] [DEBUG] [LOCAL ] SSD: Loaded 22599 existing records from primary storage. [2025-10-03T21:40:24.078339] [INFO ] [MAIN ] SSD: Loaded 22599 existing records. [2025-10-03T21:40:24.272047] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:24.272305] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-03T21:40:24.272369] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-03T21:40:24.272614] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-03T21:40:24.272714] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-03T21:40:24.478572] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T21:40:24.668184] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:24.790630] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-03T21:40:24.898252] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T21:40:25.589844] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T21:40:25.592276] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-03T21:40:25.870877] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-03T21:40:25.871697] [INFO ] [REMOTE ] SRL: Full fetch complete (1961 records). [2025-10-03T21:40:25.871860] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-03T21:40:26.065864] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T21:40:26.066101] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:40:26.066174] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:40:26.066278] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-03T21:40:26.066345] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-03T21:40:26.066383] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-03T21:40:26.066441] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-03T21:40:26.066525] [INFO ] [MAIN ] Update Progress: 1994/2370 symbols completed. SRL took 23.9s. Estimated remaining: 52m 52s. Rate: 7.1 symbols/min [2025-10-03T21:40:26.255974] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:26.305871] [DEBUG] [LOCAL ] SSL: Loaded 41452 existing records from primary storage. [2025-10-03T21:40:26.306247] [INFO ] [MAIN ] SSL: Loaded 41452 existing records. [2025-10-03T21:40:26.395764] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-03T21:40:26.501612] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:26.501885] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-03T21:40:26.501935] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-03T21:40:26.502279] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-03T21:40:26.502343] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-03T21:40:26.892082] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:27.190708] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-03T21:40:27.925428] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T21:40:27.990744] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-03T21:40:28.058812] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T21:40:28.790709] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-03T21:40:29.590703] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-03T21:40:29.652084] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:40:30.390719] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-03T21:40:30.493682] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T21:40:30.744875] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T21:40:31.190713] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-03T21:40:32.003398] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-03T21:40:32.005211] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T21:40:32.799865] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-03T21:40:32.818113] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:40:33.198060] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T21:40:33.549455] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T21:40:33.590719] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-03T21:40:34.335931] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T21:40:34.390747] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-03T21:40:35.190722] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-03T21:40:35.948727] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T21:40:35.961905] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T21:40:35.990700] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-03T21:40:36.790740] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-03T21:40:37.532892] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T21:40:37.590625] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-03T21:40:37.619443] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T21:40:38.390739] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-03T21:40:39.190723] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-03T21:40:39.410441] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T21:40:39.668158] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T21:40:39.912232] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T21:40:39.990671] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-03T21:40:40.457141] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T21:40:40.458346] [INFO ] [REMOTE ] SRV: Full fetch complete (11514 records). [2025-10-03T21:40:40.458456] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-03T21:40:40.795760] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-03T21:40:40.859739] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-03T21:40:40.859851] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-03T21:40:40.860240] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-03T21:40:40.860306] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-03T21:40:40.860846] [DEBUG] [LOCAL ] SRV: Trimmed 11514 records to 7463 (keeping 200 days of data) [2025-10-03T21:40:40.908621] [DEBUG] [LOCAL ] SRV: Primary data saved (7463 records). [2025-10-03T21:40:40.908819] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-03T21:40:40.908921] [INFO ] [MAIN ] Update Progress: 1995/2370 symbols completed. SRV took 35.7s. Estimated remaining: 52m 45s. Rate: 7.1 symbols/min [2025-10-03T21:40:41.093360] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:41.107468] [DEBUG] [LOCAL ] SST: Loaded 11918 existing records from primary storage. [2025-10-03T21:40:41.107778] [INFO ] [MAIN ] SST: Loaded 11918 existing records. [2025-10-03T21:40:41.301849] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:41.302156] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-03T21:40:41.302212] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-03T21:40:41.302438] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-03T21:40:41.302499] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-03T21:40:41.595764] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-03T21:40:41.695067] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:42.357311] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T21:40:42.390693] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-03T21:40:42.863236] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T21:40:43.190705] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-03T21:40:43.966982] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T21:40:43.985916] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T21:40:43.990609] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-03T21:40:44.790688] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-03T21:40:45.070895] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T21:40:45.590721] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-03T21:40:46.390637] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-03T21:40:46.499718] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T21:40:46.834418] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T21:40:46.836790] [INFO ] [REMOTE ] SSB: Full fetch complete (61311 records). [2025-10-03T21:40:46.836950] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-03T21:40:47.195793] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-03T21:40:47.284920] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-03T21:40:47.285031] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-03T21:40:47.286183] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-03T21:40:47.286255] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-03T21:40:47.287745] [DEBUG] [LOCAL ] SSB: Trimmed 61311 records to 43234 (keeping 200 days of data) [2025-10-03T21:40:47.529181] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T21:40:47.590245] [DEBUG] [LOCAL ] SSB: Primary data saved (43234 records). [2025-10-03T21:40:47.590417] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-03T21:40:47.590508] [INFO ] [MAIN ] Update Progress: 1996/2370 symbols completed. SSB took 40.9s. Estimated remaining: 52m 36s. Rate: 7.1 symbols/min [2025-10-03T21:40:47.790438] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:40:47.826483] [DEBUG] [LOCAL ] SSTK: Loaded 26120 existing records from primary storage. [2025-10-03T21:40:47.826951] [INFO ] [MAIN ] SSTK: Loaded 26120 existing records. [2025-10-03T21:40:47.997757] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-03T21:40:48.037236] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:40:48.037492] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-03T21:40:48.037543] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-03T21:40:48.037972] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-03T21:40:48.038067] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-03T21:40:48.445962] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:40:48.790736] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-03T21:40:48.830985] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T21:40:49.258065] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T21:40:49.590692] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-03T21:40:50.228588] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T21:40:50.390724] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-03T21:40:51.141684] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T21:40:51.190744] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-03T21:40:51.231215] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T21:40:51.990690] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-03T21:40:52.796113] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-03T21:40:52.809166] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T21:40:52.863711] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T21:40:53.590716] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-03T21:40:54.383752] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T21:40:54.392751] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-03T21:40:54.745766] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T21:40:54.902321] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T21:40:55.190732] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-03T21:40:55.990759] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-03T21:40:56.537237] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T21:40:56.790727] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-03T21:40:57.595871] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-03T21:40:57.611896] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:40:58.290205] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T21:40:58.390744] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-03T21:40:58.454791] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T21:40:59.190724] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-03T21:40:59.937458] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:40:59.990637] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-03T21:41:00.471838] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T21:41:00.790748] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-03T21:41:01.243125] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T21:41:01.249025] [INFO ] [REMOTE ] SSL: Full fetch complete (60057 records). [2025-10-03T21:41:01.249290] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-03T21:41:01.595805] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-03T21:41:01.717451] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-03T21:41:01.717713] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-03T21:41:01.719380] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-03T21:41:01.719568] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-03T21:41:01.729880] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T21:41:01.733909] [DEBUG] [LOCAL ] SSL: Trimmed 60057 records to 41734 (keeping 200 days of data) [2025-10-03T21:41:01.985793] [DEBUG] [LOCAL ] SSL: Primary data saved (41734 records). [2025-10-03T21:41:01.985978] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-03T21:41:01.986102] [INFO ] [MAIN ] Update Progress: 1997/2370 symbols completed. SSL took 35.9s. Estimated remaining: 52m 29s. Rate: 7.1 symbols/min [2025-10-03T21:41:02.390721] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-03T21:41:03.090257] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T21:41:03.190726] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-03T21:41:03.233526] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T21:41:03.949797] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T21:41:03.990618] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-03T21:41:04.677959] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T21:41:04.790719] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-03T21:41:05.244157] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:41:05.245347] [INFO ] [REMOTE ] SST: Full fetch complete (18872 records). [2025-10-03T21:41:05.245426] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-03T21:41:05.605569] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-03T21:41:05.655964] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-03T21:41:05.656054] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-03T21:41:05.656630] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-03T21:41:05.656733] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-03T21:41:05.657364] [DEBUG] [LOCAL ] SST: Trimmed 18872 records to 12007 (keeping 200 days of data) [2025-10-03T21:41:05.732196] [DEBUG] [LOCAL ] SST: Primary data saved (12007 records). [2025-10-03T21:41:05.732378] [INFO ] [MAIN ] SST: Full history saved. [2025-10-03T21:41:05.732482] [INFO ] [MAIN ] Update Progress: 1998/2370 symbols completed. SST took 24.8s. Estimated remaining: 52m 19s. Rate: 7.1 symbols/min [2025-10-03T21:41:06.390748] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-03T21:41:06.799308] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T21:41:07.190757] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-03T21:41:07.592773] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T21:41:07.990701] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-03T21:41:08.135780] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:41:08.137325] [INFO ] [REMOTE ] SSD: Full fetch complete (32449 records). [2025-10-03T21:41:08.137408] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-03T21:41:08.537418] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-03T21:41:08.537511] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-03T21:41:08.538483] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-03T21:41:08.538551] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-03T21:41:08.539588] [DEBUG] [LOCAL ] SSD: Trimmed 32449 records to 22774 (keeping 200 days of data) [2025-10-03T21:41:08.690257] [DEBUG] [LOCAL ] SSD: Primary data saved (22774 records). [2025-10-03T21:41:08.690415] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-03T21:41:08.690524] [INFO ] [MAIN ] Update Progress: 1999/2370 symbols completed. SSD took 44.8s. Estimated remaining: 52m 10s. Rate: 7.1 symbols/min [2025-10-03T21:41:09.099128] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T21:41:09.105092] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-03T21:41:10.381960] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T21:41:10.388679] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-03T21:41:11.651294] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T21:41:11.657568] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-03T21:41:12.762174] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T21:41:12.767944] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-03T21:41:13.691278] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:41:13.694086] [INFO ] [REMOTE ] SSTK: Full fetch complete (41869 records). [2025-10-03T21:41:13.694275] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-03T21:41:14.263420] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-03T21:41:14.263533] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-03T21:41:14.264766] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-03T21:41:14.264845] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-03T21:41:14.266510] [DEBUG] [LOCAL ] SSTK: Trimmed 41869 records to 26287 (keeping 200 days of data) [2025-10-03T21:41:14.520976] [DEBUG] [LOCAL ] SSTK: Primary data saved (26287 records). [2025-10-03T21:41:14.521205] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-03T21:41:14.521325] [INFO ] [MAIN ] Update Progress: 2000/2370 symbols completed. SSTK took 26.9s. Estimated remaining: 52m 1s. Rate: 7.1 symbols/min [2025-10-03T21:41:15.266453] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:15.354389] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:15.378927] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:15.445013] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:15.466219] [DEBUG] [LOCAL ] STC: Loaded 17550 existing records from primary storage. [2025-10-03T21:41:15.466841] [INFO ] [MAIN ] STC: Loaded 17550 existing records. [2025-10-03T21:41:15.676682] [DEBUG] [LOCAL ] STE: Loaded 35569 existing records from primary storage. [2025-10-03T21:41:15.728923] [INFO ] [MAIN ] STE: Loaded 35569 existing records. [2025-10-03T21:41:15.776053] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:15.749847] [DEBUG] [LOCAL ] ST: Loaded 50112 existing records from primary storage. [2025-10-03T21:41:15.793630] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-03T21:41:15.807586] [DEBUG] [LOCAL ] STAG: Loaded 50438 existing records from primary storage. [2025-10-03T21:41:15.824098] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-03T21:41:15.855848] [INFO ] [MAIN ] STAG: Loaded 50438 existing records. [2025-10-03T21:41:15.856049] [INFO ] [MAIN ] ST: Loaded 50112 existing records. [2025-10-03T21:41:15.878438] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-03T21:41:15.916108] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-03T21:41:16.313540] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:16.477435] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-03T21:41:16.538279] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:16.532509] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-03T21:41:16.568863] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-03T21:41:16.611987] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-03T21:41:16.585836] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:16.621491] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-03T21:41:16.660837] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-03T21:41:16.661026] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-03T21:41:16.661103] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-03T21:41:16.661274] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-03T21:41:16.737734] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-03T21:41:16.864417] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-03T21:41:16.953986] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-03T21:41:17.344073] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:17.430047] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-03T21:41:17.981952] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:18.039581] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-03T21:41:18.119947] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:18.153073] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:18.153518] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-03T21:41:18.153831] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-03T21:41:18.459063] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T21:41:18.463823] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-03T21:41:19.538941] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T21:41:19.543785] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-03T21:41:19.585827] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T21:41:19.593378] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-03T21:41:19.854912] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:41:19.865873] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-03T21:41:19.939832] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T21:41:19.950636] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-03T21:41:20.737904] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T21:41:20.744107] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-03T21:41:21.103381] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:41:21.111295] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-03T21:41:21.264638] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T21:41:21.276445] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-03T21:41:21.492773] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T21:41:21.590737] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-03T21:41:21.767734] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T21:41:22.390630] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-03T21:41:22.517785] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T21:41:22.629245] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T21:41:23.190624] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-03T21:41:23.256274] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T21:41:23.428178] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T21:41:23.990718] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-03T21:41:24.736604] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T21:41:24.790626] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-03T21:41:25.590737] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-03T21:41:25.722006] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:41:26.339687] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T21:41:26.394883] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-03T21:41:26.396840] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T21:41:27.190714] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-03T21:41:27.990687] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-03T21:41:28.197851] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:41:28.204877] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T21:41:28.790709] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-03T21:41:29.437345] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T21:41:29.551408] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T21:41:29.590630] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-03T21:41:30.390681] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-03T21:41:31.190748] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-03T21:41:31.348740] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T21:41:31.990707] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-03T21:41:32.202046] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T21:41:32.330489] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T21:41:32.790693] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-03T21:41:33.590706] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-03T21:41:33.730009] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T21:41:34.390673] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-03T21:41:34.574355] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T21:41:34.575334] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T21:41:35.190705] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-03T21:41:35.990767] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-03T21:41:36.220748] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T21:41:36.576347] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T21:41:36.628543] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T21:41:36.790712] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-03T21:41:37.590748] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-03T21:41:38.154409] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:41:38.390716] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-03T21:41:39.084139] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T21:41:39.085518] [INFO ] [REMOTE ] STC: Full fetch complete (25816 records). [2025-10-03T21:41:39.085595] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-03T21:41:39.195739] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-03T21:41:39.527460] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-03T21:41:39.527677] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-03T21:41:39.528441] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-03T21:41:39.528592] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-03T21:41:39.560788] [DEBUG] [LOCAL ] STC: Trimmed 25816 records to 17664 (keeping 200 days of data) [2025-10-03T21:41:39.563370] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T21:41:39.690262] [DEBUG] [LOCAL ] STC: Primary data saved (17664 records). [2025-10-03T21:41:39.690434] [INFO ] [MAIN ] STC: Full history saved. [2025-10-03T21:41:39.690537] [INFO ] [MAIN ] Update Progress: 2001/2370 symbols completed. STC took 25.2s. Estimated remaining: 51m 56s. Rate: 7.1 symbols/min [2025-10-03T21:41:39.880750] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:39.904531] [DEBUG] [LOCAL ] STEL: Loaded 23316 existing records from primary storage. [2025-10-03T21:41:39.904896] [INFO ] [MAIN ] STEL: Loaded 23316 existing records. [2025-10-03T21:41:39.995822] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-03T21:41:40.102250] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:40.102500] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-03T21:41:40.102550] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-03T21:41:40.103317] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-03T21:41:40.103384] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-03T21:41:40.491915] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:40.790670] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-03T21:41:40.882914] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:41:41.590667] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-03T21:41:41.653597] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:41:42.390697] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-03T21:41:42.569188] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:41:43.155220] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:41:43.190623] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-03T21:41:43.822383] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T21:41:43.990734] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-03T21:41:44.661255] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T21:41:44.664730] [INFO ] [REMOTE ] ST: Full fetch complete (71952 records). [2025-10-03T21:41:44.664890] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-03T21:41:44.795877] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-03T21:41:45.109972] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-03T21:41:45.110072] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-03T21:41:45.111250] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-03T21:41:45.111326] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-03T21:41:45.112884] [DEBUG] [LOCAL ] ST: Trimmed 71952 records to 50469 (keeping 200 days of data) [2025-10-03T21:41:45.428928] [DEBUG] [LOCAL ] ST: Primary data saved (50469 records). [2025-10-03T21:41:45.429120] [INFO ] [MAIN ] ST: Full history saved. [2025-10-03T21:41:45.429244] [INFO ] [MAIN ] Update Progress: 2002/2370 symbols completed. ST took 30.9s. Estimated remaining: 51m 47s. Rate: 7.1 symbols/min [2025-10-03T21:41:45.593309] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-03T21:41:45.616022] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:45.661377] [DEBUG] [LOCAL ] STEM: Loaded 39628 existing records from primary storage. [2025-10-03T21:41:45.661829] [INFO ] [MAIN ] STEM: Loaded 39628 existing records. [2025-10-03T21:41:45.863453] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:45.863906] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-03T21:41:45.864048] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-03T21:41:45.864987] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-03T21:41:45.865151] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-03T21:41:46.043314] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T21:41:46.327416] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:46.356111] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:41:46.390755] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-03T21:41:46.645583] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T21:41:47.190728] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-03T21:41:47.462060] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T21:41:47.464322] [INFO ] [REMOTE ] STE: Full fetch complete (50624 records). [2025-10-03T21:41:47.464424] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-03T21:41:47.884343] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-03T21:41:47.884443] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-03T21:41:47.885486] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-03T21:41:47.885552] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-03T21:41:47.886788] [DEBUG] [LOCAL ] STE: Trimmed 50624 records to 35887 (keeping 200 days of data) [2025-10-03T21:41:47.991214] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-03T21:41:48.124513] [DEBUG] [LOCAL ] STE: Primary data saved (35887 records). [2025-10-03T21:41:48.124726] [INFO ] [MAIN ] STE: Full history saved. [2025-10-03T21:41:48.124826] [INFO ] [MAIN ] Update Progress: 2003/2370 symbols completed. STE took 33.6s. Estimated remaining: 51m 37s. Rate: 7.1 symbols/min [2025-10-03T21:41:48.236521] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T21:41:48.330534] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:48.351792] [DEBUG] [LOCAL ] STEW: Loaded 16227 existing records from primary storage. [2025-10-03T21:41:48.352070] [INFO ] [MAIN ] STEW: Loaded 16227 existing records. [2025-10-03T21:41:48.543269] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:41:48.543534] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-03T21:41:48.543582] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-03T21:41:48.543899] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-03T21:41:48.543960] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-03T21:41:48.802091] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-03T21:41:48.930119] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:49.590632] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-03T21:41:49.824687] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T21:41:49.881454] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T21:41:50.390706] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-03T21:41:50.694784] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:41:50.698171] [INFO ] [REMOTE ] STAG: Full fetch complete (72162 records). [2025-10-03T21:41:50.698317] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-03T21:41:51.138525] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-03T21:41:51.138627] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-03T21:41:51.139948] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-03T21:41:51.140017] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-03T21:41:51.143009] [DEBUG] [LOCAL ] STAG: Trimmed 72162 records to 50828 (keeping 200 days of data) [2025-10-03T21:41:51.204920] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-03T21:41:51.495604] [DEBUG] [LOCAL ] STAG: Primary data saved (50828 records). [2025-10-03T21:41:51.495821] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-03T21:41:51.495942] [INFO ] [MAIN ] Update Progress: 2004/2370 symbols completed. STAG took 37.0s. Estimated remaining: 51m 28s. Rate: 7.1 symbols/min [2025-10-03T21:41:51.685798] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:41:51.686020] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-03T21:41:51.686116] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-03T21:41:51.686207] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-03T21:41:51.686248] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-03T21:41:51.686292] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-03T21:41:51.686401] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-03T21:41:51.996740] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-03T21:41:52.106607] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:41:52.489832] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T21:41:52.749562] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-03T21:41:52.780000] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T21:41:52.790601] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-03T21:41:53.309292] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T21:41:53.590743] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-03T21:41:54.390685] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-03T21:41:54.773963] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T21:41:55.190680] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-03T21:41:55.516555] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T21:41:55.946869] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T21:41:55.990710] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-03T21:41:56.791465] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-03T21:41:56.795807] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T21:41:57.229483] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T21:41:57.590693] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-03T21:41:58.390744] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-03T21:41:59.190695] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-03T21:41:59.472114] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T21:41:59.519431] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T21:41:59.990703] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-03T21:42:00.011344] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T21:42:00.790741] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-03T21:42:01.127195] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T21:42:01.590609] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-03T21:42:02.084673] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T21:42:02.390686] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-03T21:42:02.700083] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:42:03.190730] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-03T21:42:03.990628] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-03T21:42:04.284140] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T21:42:04.297506] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:42:04.790751] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-03T21:42:04.994019] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T21:42:05.590721] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-03T21:42:06.390747] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-03T21:42:06.529629] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T21:42:06.636512] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T21:42:07.190746] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-03T21:42:07.442225] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T21:42:07.990702] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-03T21:42:08.783682] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T21:42:08.790621] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-03T21:42:08.823315] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:42:09.590703] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-03T21:42:09.605065] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T21:42:10.390689] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-03T21:42:10.750280] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T21:42:10.855323] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T21:42:11.190739] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-03T21:42:11.990858] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-03T21:42:12.665370] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T21:42:12.790706] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-03T21:42:13.128865] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T21:42:13.137541] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T21:42:13.590780] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-03T21:42:14.125606] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T21:42:14.126989] [INFO ] [REMOTE ] STEW: Full fetch complete (21872 records). [2025-10-03T21:42:14.127069] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-03T21:42:14.395771] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-03T21:42:14.516661] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-03T21:42:14.516782] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-03T21:42:14.517905] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-03T21:42:14.517976] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-03T21:42:14.518946] [DEBUG] [LOCAL ] STEW: Trimmed 21872 records to 16303 (keeping 200 days of data) [2025-10-03T21:42:14.636366] [DEBUG] [LOCAL ] STEW: Primary data saved (16303 records). [2025-10-03T21:42:14.636596] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-03T21:42:14.636790] [INFO ] [MAIN ] Update Progress: 2005/2370 symbols completed. STEW took 26.5s. Estimated remaining: 51m 22s. Rate: 7.1 symbols/min [2025-10-03T21:42:14.831437] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:14.846517] [DEBUG] [LOCAL ] STK: Loaded 9467 existing records from primary storage. [2025-10-03T21:42:14.846833] [INFO ] [MAIN ] STK: Loaded 9467 existing records. [2025-10-03T21:42:15.058238] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:15.058536] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-03T21:42:15.058589] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-03T21:42:15.058864] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-03T21:42:15.058924] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-03T21:42:15.200798] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-03T21:42:15.451595] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:15.870463] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T21:42:15.990714] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-03T21:42:16.298703] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T21:42:16.356598] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T21:42:16.790717] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-03T21:42:17.145633] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T21:42:17.590739] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-03T21:42:18.381930] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T21:42:18.390615] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-03T21:42:19.190982] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-03T21:42:19.252896] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T21:42:19.949368] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T21:42:19.950991] [INFO ] [REMOTE ] STEL: Full fetch complete (32140 records). [2025-10-03T21:42:19.951121] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-03T21:42:19.995937] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-03T21:42:20.382361] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-03T21:42:20.382478] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-03T21:42:20.383302] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-03T21:42:20.383368] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-03T21:42:20.387798] [DEBUG] [LOCAL ] STEL: Trimmed 32140 records to 23455 (keeping 200 days of data) [2025-10-03T21:42:20.547313] [DEBUG] [LOCAL ] STEL: Primary data saved (23455 records). [2025-10-03T21:42:20.547472] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-03T21:42:20.547635] [INFO ] [MAIN ] Update Progress: 2006/2370 symbols completed. STEL took 40.9s. Estimated remaining: 51m 13s. Rate: 7.1 symbols/min [2025-10-03T21:42:20.737863] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:20.794973] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-03T21:42:20.797557] [DEBUG] [LOCAL ] STLA: Loaded 53933 existing records from primary storage. [2025-10-03T21:42:20.798128] [INFO ] [MAIN ] STLA: Loaded 53933 existing records. [2025-10-03T21:42:21.003566] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T21:42:21.010639] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:21.014808] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-03T21:42:21.014980] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-03T21:42:21.015319] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-03T21:42:21.015383] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-03T21:42:21.382326] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:21.590753] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-03T21:42:21.799918] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T21:42:21.802222] [INFO ] [REMOTE ] STEM: Full fetch complete (62048 records). [2025-10-03T21:42:21.802365] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-03T21:42:22.233023] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-03T21:42:22.233615] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-03T21:42:22.234904] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-03T21:42:22.234987] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-03T21:42:22.238077] [DEBUG] [LOCAL ] STEM: Trimmed 62048 records to 39914 (keeping 200 days of data) [2025-10-03T21:42:22.407872] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-03T21:42:22.451570] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T21:42:22.494574] [DEBUG] [LOCAL ] STEM: Primary data saved (39914 records). [2025-10-03T21:42:22.494810] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-03T21:42:22.494953] [INFO ] [MAIN ] Update Progress: 2007/2370 symbols completed. STEM took 37.1s. Estimated remaining: 51m 4s. Rate: 7.1 symbols/min [2025-10-03T21:42:22.674196] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:22.732463] [DEBUG] [LOCAL ] STM: Loaded 53968 existing records from primary storage. [2025-10-03T21:42:22.732874] [INFO ] [MAIN ] STM: Loaded 53968 existing records. [2025-10-03T21:42:22.930468] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:22.930809] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-03T21:42:22.930885] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-03T21:42:22.931424] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-03T21:42:22.931483] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-03T21:42:23.196473] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-03T21:42:23.328380] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T21:42:23.391479] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:23.990712] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-03T21:42:24.442667] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:42:24.790752] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-03T21:42:25.479826] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-03T21:42:25.500895] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T21:42:25.590691] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-03T21:42:26.390708] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-03T21:42:26.844942] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T21:42:27.190687] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-03T21:42:27.480215] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-03T21:42:27.481038] [INFO ] [REMOTE ] STG: Full fetch complete (2483 records). [2025-10-03T21:42:27.481117] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-03T21:42:27.720181] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-03T21:42:27.720487] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:42:27.720820] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:42:27.720959] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-03T21:42:27.721188] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-03T21:42:27.721268] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-03T21:42:27.721466] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-03T21:42:27.721716] [INFO ] [MAIN ] Update Progress: 2008/2370 symbols completed. STG took 36.2s. Estimated remaining: 50m 54s. Rate: 7.1 symbols/min [2025-10-03T21:42:27.943886] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-03T21:42:27.941594] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:27.983325] [DEBUG] [LOCAL ] STN: Loaded 22995 existing records from primary storage. [2025-10-03T21:42:27.983637] [INFO ] [MAIN ] STN: Loaded 22995 existing records. [2025-10-03T21:42:27.995981] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-03T21:42:28.180101] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:28.180351] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-03T21:42:28.180435] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-03T21:42:28.180804] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-03T21:42:28.180865] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-03T21:42:28.571582] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:28.790702] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-03T21:42:29.590690] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-03T21:42:29.800362] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T21:42:30.089141] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T21:42:30.359928] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T21:42:30.390729] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-03T21:42:31.190725] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-03T21:42:31.838386] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T21:42:31.990680] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-03T21:42:32.502788] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-03T21:42:32.790708] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-03T21:42:33.054479] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T21:42:33.590710] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-03T21:42:34.390779] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-03T21:42:34.581180] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T21:42:34.755607] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T21:42:34.835015] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T21:42:35.190705] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-03T21:42:35.990680] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-03T21:42:36.394553] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T21:42:36.790706] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-03T21:42:36.814938] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T21:42:37.590702] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-03T21:42:38.390754] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-03T21:42:38.820741] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-03T21:42:39.190673] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-03T21:42:39.235077] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T21:42:39.724078] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T21:42:39.990745] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-03T21:42:40.790737] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-03T21:42:41.236583] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T21:42:41.484999] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T21:42:41.590719] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-03T21:42:42.390686] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-03T21:42:42.628920] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T21:42:42.879882] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T21:42:43.190736] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-03T21:42:43.990742] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-03T21:42:44.279013] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T21:42:44.592375] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T21:42:44.593714] [INFO ] [REMOTE ] STK: Full fetch complete (14135 records). [2025-10-03T21:42:44.593820] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-03T21:42:44.793279] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-03T21:42:45.025506] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-03T21:42:45.025626] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-03T21:42:45.026125] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-03T21:42:45.026234] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-03T21:42:45.027238] [DEBUG] [LOCAL ] STK: Trimmed 14135 records to 9573 (keeping 200 days of data) [2025-10-03T21:42:45.108401] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-03T21:42:45.143273] [DEBUG] [LOCAL ] STK: Primary data saved (9573 records). [2025-10-03T21:42:45.143389] [INFO ] [MAIN ] STK: Full history saved. [2025-10-03T21:42:45.143509] [INFO ] [MAIN ] Update Progress: 2009/2370 symbols completed. STK took 30.5s. Estimated remaining: 50m 48s. Rate: 7.1 symbols/min [2025-10-03T21:42:45.334388] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:45.387529] [DEBUG] [LOCAL ] STNG: Loaded 44086 existing records from primary storage. [2025-10-03T21:42:45.387935] [INFO ] [MAIN ] STNG: Loaded 44086 existing records. [2025-10-03T21:42:45.572676] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:45.573318] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-03T21:42:45.573371] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-03T21:42:45.573578] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-03T21:42:45.573636] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-03T21:42:45.595720] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-03T21:42:45.961244] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:45.979197] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T21:42:46.390697] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-03T21:42:47.190727] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-03T21:42:47.754564] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T21:42:47.990695] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-03T21:42:48.065867] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T21:42:48.791144] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-03T21:42:48.796846] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T21:42:49.590685] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-03T21:42:49.932002] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T21:42:49.989105] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T21:42:50.390724] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-03T21:42:51.190639] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-03T21:42:51.573296] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-03T21:42:51.992255] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-03T21:42:51.995534] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T21:42:52.300074] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T21:42:52.790751] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-03T21:42:53.546203] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T21:42:53.547738] [INFO ] [REMOTE ] STN: Full fetch complete (32409 records). [2025-10-03T21:42:53.547825] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-03T21:42:53.595922] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-03T21:42:53.962900] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-03T21:42:53.963036] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-03T21:42:53.963949] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-03T21:42:53.964020] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-03T21:42:53.965042] [DEBUG] [LOCAL ] STN: Trimmed 32409 records to 23107 (keeping 200 days of data) [2025-10-03T21:42:54.117895] [DEBUG] [LOCAL ] STN: Primary data saved (23107 records). [2025-10-03T21:42:54.118046] [INFO ] [MAIN ] STN: Full history saved. [2025-10-03T21:42:54.118135] [INFO ] [MAIN ] Update Progress: 2010/2370 symbols completed. STN took 26.4s. Estimated remaining: 50m 39s. Rate: 7.1 symbols/min [2025-10-03T21:42:54.302884] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:42:54.317006] [DEBUG] [LOCAL ] STRV: Loaded 11451 existing records from primary storage. [2025-10-03T21:42:54.317413] [INFO ] [MAIN ] STRV: Loaded 11451 existing records. [2025-10-03T21:42:54.404777] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-03T21:42:54.463337] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-03T21:42:54.564337] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:42:54.564732] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-03T21:42:54.564795] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-03T21:42:54.565085] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-03T21:42:54.565147] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-03T21:42:54.960677] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:42:55.173510] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T21:42:55.190622] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-03T21:42:55.990741] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-03T21:42:56.631231] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T21:42:56.790728] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-03T21:42:56.935715] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:42:56.993152] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T21:42:57.590747] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-03T21:42:58.390694] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-03T21:42:58.599943] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T21:42:58.917928] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-03T21:42:59.190761] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-03T21:42:59.990729] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-03T21:43:00.093785] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T21:43:00.123298] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T21:43:00.790711] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-03T21:43:01.590739] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-03T21:43:02.010379] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T21:43:02.345008] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T21:43:02.390201] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T21:43:02.391526] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-03T21:43:03.190698] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-03T21:43:03.990693] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-03T21:43:04.055493] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T21:43:04.058454] [INFO ] [REMOTE ] STM: Full fetch complete (77527 records). [2025-10-03T21:43:04.058680] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-03T21:43:04.533474] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-03T21:43:04.533606] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-03T21:43:04.534982] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-03T21:43:04.535070] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-03T21:43:04.536875] [DEBUG] [LOCAL ] STM: Trimmed 77527 records to 54355 (keeping 200 days of data) [2025-10-03T21:43:04.678341] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T21:43:04.804596] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-03T21:43:04.938611] [DEBUG] [LOCAL ] STM: Primary data saved (54355 records). [2025-10-03T21:43:04.938820] [INFO ] [MAIN ] STM: Full history saved. [2025-10-03T21:43:04.938939] [INFO ] [MAIN ] Update Progress: 2011/2370 symbols completed. STM took 42.4s. Estimated remaining: 50m 31s. Rate: 7.1 symbols/min [2025-10-03T21:43:05.124392] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:05.179318] [DEBUG] [LOCAL ] STT: Loaded 51328 existing records from primary storage. [2025-10-03T21:43:05.179716] [INFO ] [MAIN ] STT: Loaded 51328 existing records. [2025-10-03T21:43:05.374821] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:05.375094] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-03T21:43:05.375152] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-03T21:43:05.375434] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-03T21:43:05.375494] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-03T21:43:05.600264] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-03T21:43:05.769387] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:05.824275] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T21:43:06.390631] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-03T21:43:06.556909] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T21:43:06.724733] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T21:43:07.190725] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-03T21:43:07.990733] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-03T21:43:08.194833] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:43:08.746835] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T21:43:08.790706] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-03T21:43:09.590755] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-03T21:43:09.808707] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T21:43:10.390736] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-03T21:43:10.498154] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T21:43:10.567963] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T21:43:10.571110] [INFO ] [REMOTE ] STLA: Full fetch complete (77534 records). [2025-10-03T21:43:10.571279] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-03T21:43:10.994802] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-03T21:43:10.994908] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-03T21:43:10.996288] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-03T21:43:10.996373] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-03T21:43:10.998259] [DEBUG] [LOCAL ] STLA: Trimmed 77534 records to 54321 (keeping 200 days of data) [2025-10-03T21:43:11.209308] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-03T21:43:11.334816] [DEBUG] [LOCAL ] STLA: Primary data saved (54321 records). [2025-10-03T21:43:11.334980] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-03T21:43:11.336199] [INFO ] [MAIN ] Update Progress: 2012/2370 symbols completed. STLA took 50.8s. Estimated remaining: 50m 22s. Rate: 7.1 symbols/min [2025-10-03T21:43:11.515052] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:11.515258] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-03T21:43:11.515307] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-03T21:43:11.515438] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-03T21:43:11.515484] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-03T21:43:11.515530] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-03T21:43:11.515576] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-03T21:43:11.905663] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:11.990745] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-03T21:43:12.026999] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:43:12.250688] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T21:43:12.790737] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-03T21:43:13.018860] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:43:13.019239] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-03T21:43:13.019332] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:43:13.019386] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-03T21:43:13.019445] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:43:13.019509] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-03T21:43:13.019592] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-03T21:43:13.019632] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-03T21:43:13.019719] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-03T21:43:13.019779] [INFO ] [MAIN ] Update Progress: 2013/2370 symbols completed. STUB took 1.7s. Estimated remaining: 50m 13s. Rate: 7.1 symbols/min [2025-10-03T21:43:13.208787] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:13.240672] [DEBUG] [LOCAL ] STVN: Loaded 26391 existing records from primary storage. [2025-10-03T21:43:13.240970] [INFO ] [MAIN ] STVN: Loaded 26391 existing records. [2025-10-03T21:43:13.434636] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:13.435116] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-03T21:43:13.435183] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-03T21:43:13.435434] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-03T21:43:13.435494] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-03T21:43:13.607945] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-03T21:43:13.860846] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T21:43:13.926216] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:14.390716] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-03T21:43:14.491238] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T21:43:15.190707] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-03T21:43:15.990696] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-03T21:43:16.020584] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T21:43:16.087576] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:43:16.790713] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-03T21:43:17.140084] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T21:43:17.254748] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T21:43:17.590703] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-03T21:43:18.390685] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-03T21:43:19.190700] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-03T21:43:19.385370] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T21:43:19.606631] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T21:43:19.607916] [INFO ] [REMOTE ] STRV: Full fetch complete (18099 records). [2025-10-03T21:43:19.608049] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-03T21:43:19.764623] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T21:43:19.994912] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-03T21:43:20.038287] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-03T21:43:20.038381] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-03T21:43:20.038891] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-03T21:43:20.038956] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-03T21:43:20.039573] [DEBUG] [LOCAL ] STRV: Trimmed 18099 records to 11517 (keeping 200 days of data) [2025-10-03T21:43:20.121907] [DEBUG] [LOCAL ] STRV: Primary data saved (11517 records). [2025-10-03T21:43:20.122080] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-03T21:43:20.122177] [INFO ] [MAIN ] Update Progress: 2014/2370 symbols completed. STRV took 26.0s. Estimated remaining: 50m 4s. Rate: 7.1 symbols/min [2025-10-03T21:43:20.320587] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:20.372919] [DEBUG] [LOCAL ] STWD: Loaded 52264 existing records from primary storage. [2025-10-03T21:43:20.373306] [INFO ] [MAIN ] STWD: Loaded 52264 existing records. [2025-10-03T21:43:20.570972] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:20.571257] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-03T21:43:20.571317] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-03T21:43:20.571619] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-03T21:43:20.571709] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-03T21:43:20.795854] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-03T21:43:20.956453] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:21.590675] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-03T21:43:21.857319] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:43:21.880165] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T21:43:21.882573] [INFO ] [REMOTE ] STNG: Full fetch complete (64419 records). [2025-10-03T21:43:21.882718] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-03T21:43:22.332073] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-03T21:43:22.332164] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-03T21:43:22.333347] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-03T21:43:22.333415] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-03T21:43:22.334966] [DEBUG] [LOCAL ] STNG: Trimmed 64419 records to 44344 (keeping 200 days of data) [2025-10-03T21:43:22.394223] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-03T21:43:22.620247] [DEBUG] [LOCAL ] STNG: Primary data saved (44344 records). [2025-10-03T21:43:22.620387] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-03T21:43:22.620496] [INFO ] [MAIN ] Update Progress: 2015/2370 symbols completed. STNG took 37.5s. Estimated remaining: 49m 55s. Rate: 7.1 symbols/min [2025-10-03T21:43:22.809430] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:22.825615] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T21:43:22.827381] [DEBUG] [LOCAL ] STXD: Loaded 1294 existing records from primary storage. [2025-10-03T21:43:22.833278] [INFO ] [MAIN ] STXD: Loaded 1294 existing records. [2025-10-03T21:43:23.020578] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:23.020865] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-03T21:43:23.020916] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-03T21:43:23.021132] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-03T21:43:23.021190] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-03T21:43:23.204464] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-03T21:43:23.402863] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:23.990696] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-03T21:43:24.219109] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T21:43:24.416588] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-03T21:43:24.513932] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T21:43:24.790705] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-03T21:43:25.223528] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T21:43:25.590717] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-03T21:43:26.390684] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-03T21:43:27.190678] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-03T21:43:27.305888] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T21:43:27.618330] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T21:43:27.990738] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-03T21:43:28.169085] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T21:43:28.795812] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-03T21:43:28.804134] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T21:43:29.590699] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-03T21:43:30.390711] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-03T21:43:30.552450] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T21:43:31.186736] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T21:43:31.190616] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-03T21:43:31.548207] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T21:43:31.990705] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-03T21:43:32.288449] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-03T21:43:32.729913] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T21:43:32.790749] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-03T21:43:33.590747] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-03T21:43:34.061488] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-03T21:43:34.390681] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-03T21:43:34.540408] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:43:35.190683] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-03T21:43:35.470172] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-03T21:43:35.904195] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T21:43:35.990696] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-03T21:43:36.790699] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-03T21:43:37.147209] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-03T21:43:37.567005] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T21:43:37.590623] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-03T21:43:38.045114] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:43:38.048603] [INFO ] [REMOTE ] STT: Full fetch complete (74371 records). [2025-10-03T21:43:38.048871] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-03T21:43:38.395950] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-03T21:43:38.515888] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-03T21:43:38.516006] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-03T21:43:38.517352] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-03T21:43:38.517424] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-03T21:43:38.519038] [DEBUG] [LOCAL ] STT: Trimmed 74371 records to 51691 (keeping 200 days of data) [2025-10-03T21:43:38.853194] [DEBUG] [LOCAL ] STT: Primary data saved (51691 records). [2025-10-03T21:43:38.853363] [INFO ] [MAIN ] STT: Full history saved. [2025-10-03T21:43:38.853474] [INFO ] [MAIN ] Update Progress: 2016/2370 symbols completed. STT took 33.9s. Estimated remaining: 49m 48s. Rate: 7.1 symbols/min [2025-10-03T21:43:39.036002] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:39.042095] [DEBUG] [LOCAL ] STXE: Loaded 2199 existing records from primary storage. [2025-10-03T21:43:39.042310] [INFO ] [MAIN ] STXE: Loaded 2199 existing records. [2025-10-03T21:43:39.199458] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-03T21:43:39.232766] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:39.233387] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-03T21:43:39.233452] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-03T21:43:39.233737] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-03T21:43:39.233797] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-03T21:43:39.609585] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:39.990668] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-03T21:43:40.248526] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T21:43:40.367816] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-03T21:43:40.451189] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T21:43:40.790728] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-03T21:43:41.146694] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-03T21:43:41.590693] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-03T21:43:42.390731] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-03T21:43:42.968080] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T21:43:43.190697] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-03T21:43:43.430310] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T21:43:43.659060] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T21:43:43.990707] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-03T21:43:44.790751] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-03T21:43:45.276709] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T21:43:45.590686] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-03T21:43:45.635995] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T21:43:46.139346] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T21:43:46.390691] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-03T21:43:46.753066] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T21:43:47.190743] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-03T21:43:47.675179] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T21:43:47.990706] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-03T21:43:48.290853] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-03T21:43:48.291541] [INFO ] [REMOTE ] STXD: Full fetch complete (2042 records). [2025-10-03T21:43:48.291682] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-03T21:43:48.674315] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-03T21:43:48.674401] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-03T21:43:48.674492] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-03T21:43:48.674531] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-03T21:43:48.674896] [DEBUG] [LOCAL ] STXD: Trimmed 2042 records to 1298 (keeping 200 days of data) [2025-10-03T21:43:48.683403] [DEBUG] [LOCAL ] STXD: Primary data saved (1298 records). [2025-10-03T21:43:48.683477] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-03T21:43:48.683557] [INFO ] [MAIN ] Update Progress: 2017/2370 symbols completed. STXD took 26.1s. Estimated remaining: 49m 39s. Rate: 7.1 symbols/min [2025-10-03T21:43:48.795754] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-03T21:43:48.872195] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:48.878693] [DEBUG] [LOCAL ] STXG: Loaded 2521 existing records from primary storage. [2025-10-03T21:43:48.878931] [INFO ] [MAIN ] STXG: Loaded 2521 existing records. [2025-10-03T21:43:49.070177] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:49.070452] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-03T21:43:49.070503] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-03T21:43:49.070843] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-03T21:43:49.070903] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-03T21:43:49.455892] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:49.590708] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-03T21:43:50.390639] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-03T21:43:50.796193] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T21:43:50.804891] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T21:43:50.828783] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-03T21:43:51.190694] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-03T21:43:51.758427] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T21:43:51.990728] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-03T21:43:52.790740] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-03T21:43:53.270859] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T21:43:53.590719] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-03T21:43:54.390668] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T21:43:54.390787] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-03T21:43:54.818553] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T21:43:54.970555] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T21:43:55.190735] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-03T21:43:55.644356] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T21:43:55.990725] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-03T21:43:56.790636] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-03T21:43:56.858723] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T21:43:56.860310] [INFO ] [REMOTE ] STVN: Full fetch complete (39254 records). [2025-10-03T21:43:56.860389] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-03T21:43:57.270634] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-03T21:43:57.270754] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-03T21:43:57.271672] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-03T21:43:57.271739] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-03T21:43:57.272618] [DEBUG] [LOCAL ] STVN: Trimmed 39254 records to 26608 (keeping 200 days of data) [2025-10-03T21:43:57.372267] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T21:43:57.451793] [DEBUG] [LOCAL ] STVN: Primary data saved (26608 records). [2025-10-03T21:43:57.451988] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-03T21:43:57.452147] [INFO ] [MAIN ] Update Progress: 2018/2370 symbols completed. STVN took 44.4s. Estimated remaining: 49m 31s. Rate: 7.1 symbols/min [2025-10-03T21:43:57.595840] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-03T21:43:57.646188] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:43:57.650587] [DEBUG] [LOCAL ] STXK: Loaded 1497 existing records from primary storage. [2025-10-03T21:43:57.650811] [INFO ] [MAIN ] STXK: Loaded 1497 existing records. [2025-10-03T21:43:57.846714] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:43:57.846976] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-03T21:43:57.847032] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-03T21:43:57.847244] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-03T21:43:57.847307] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-03T21:43:58.223847] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:43:58.390700] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-03T21:43:58.833862] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-03T21:43:59.190639] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-03T21:43:59.543733] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T21:43:59.815193] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T21:43:59.990722] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-03T21:44:00.514404] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T21:44:00.790693] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-03T21:44:01.247417] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T21:44:01.590704] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-03T21:44:02.050293] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T21:44:02.390698] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-03T21:44:02.846708] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T21:44:03.190744] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-03T21:44:03.637391] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:44:03.990747] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-03T21:44:04.628591] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T21:44:04.790696] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-03T21:44:05.275261] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T21:44:05.590699] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-03T21:44:06.107738] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T21:44:06.390697] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-03T21:44:06.839167] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T21:44:07.190693] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-03T21:44:07.990748] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-03T21:44:08.291319] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:44:08.294401] [INFO ] [REMOTE ] STWD: Full fetch complete (75153 records). [2025-10-03T21:44:08.294552] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-03T21:44:08.626812] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T21:44:08.754913] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-03T21:44:08.755009] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-03T21:44:08.756327] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-03T21:44:08.756400] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-03T21:44:08.758274] [DEBUG] [LOCAL ] STWD: Trimmed 75153 records to 52646 (keeping 200 days of data) [2025-10-03T21:44:08.822959] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-03T21:44:09.121107] [DEBUG] [LOCAL ] STWD: Primary data saved (52646 records). [2025-10-03T21:44:09.121267] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-03T21:44:09.121391] [INFO ] [MAIN ] Update Progress: 2019/2370 symbols completed. STWD took 49.0s. Estimated remaining: 49m 23s. Rate: 7.1 symbols/min [2025-10-03T21:44:09.243235] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T21:44:09.261129] [INFO ] [REMOTE ] STXE: Full fetch complete (3640 records). [2025-10-03T21:44:09.294245] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-03T21:44:09.392748] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:09.422163] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-03T21:44:09.443801] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-03T21:44:09.447422] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-03T21:44:09.447933] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-03T21:44:09.463753] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-03T21:44:09.479334] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-03T21:44:09.602089] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-03T21:44:10.096844] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-03T21:44:10.097004] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-03T21:44:10.097204] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-03T21:44:10.097586] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-03T21:44:10.108806] [DEBUG] [LOCAL ] STXE: Trimmed 3640 records to 2216 (keeping 200 days of data) [2025-10-03T21:44:10.128500] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T21:44:10.203017] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:10.206814] [DEBUG] [LOCAL ] STXE: Primary data saved (2216 records). [2025-10-03T21:44:10.206886] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-03T21:44:10.206976] [INFO ] [MAIN ] Update Progress: 2020/2370 symbols completed. STXE took 31.4s. Estimated remaining: 49m 13s. Rate: 7.1 symbols/min [2025-10-03T21:44:10.378856] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:10.386943] [DEBUG] [LOCAL ] STXT: Loaded 2554 existing records from primary storage. [2025-10-03T21:44:10.387113] [INFO ] [MAIN ] STXT: Loaded 2554 existing records. [2025-10-03T21:44:10.397956] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-03T21:44:10.574624] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:10.574867] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-03T21:44:10.574915] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-03T21:44:10.575099] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-03T21:44:10.575156] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-03T21:44:10.874412] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T21:44:10.953266] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:11.190715] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-03T21:44:11.554244] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T21:44:11.990710] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-03T21:44:12.429746] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T21:44:12.790700] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-03T21:44:13.237625] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T21:44:13.590716] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-03T21:44:14.035916] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:44:14.390691] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-03T21:44:14.756515] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T21:44:15.190707] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-03T21:44:15.744014] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T21:44:15.990716] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-03T21:44:16.273720] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-03T21:44:16.274453] [INFO ] [REMOTE ] STXG: Full fetch complete (4160 records). [2025-10-03T21:44:16.274524] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-03T21:44:16.664851] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-03T21:44:16.664945] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-03T21:44:16.665181] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-03T21:44:16.665244] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-03T21:44:16.665670] [DEBUG] [LOCAL ] STXG: Trimmed 4160 records to 2533 (keeping 200 days of data) [2025-10-03T21:44:16.682308] [DEBUG] [LOCAL ] STXG: Primary data saved (2533 records). [2025-10-03T21:44:16.682455] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-03T21:44:16.682569] [INFO ] [MAIN ] Update Progress: 2021/2370 symbols completed. STXG took 28.0s. Estimated remaining: 49m 5s. Rate: 7.1 symbols/min [2025-10-03T21:44:16.795727] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-03T21:44:16.863836] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:16.868423] [DEBUG] [LOCAL ] STXV: Loaded 1577 existing records from primary storage. [2025-10-03T21:44:16.868611] [INFO ] [MAIN ] STXV: Loaded 1577 existing records. [2025-10-03T21:44:17.064387] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:17.064663] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-03T21:44:17.064725] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-03T21:44:17.064931] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-03T21:44:17.064993] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-03T21:44:17.382409] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T21:44:17.486263] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:17.590687] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-03T21:44:18.143980] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T21:44:18.390698] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-03T21:44:19.007509] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T21:44:19.190704] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-03T21:44:19.626610] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-03T21:44:19.990704] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-03T21:44:20.452251] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T21:44:20.790733] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-03T21:44:21.233195] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T21:44:21.590722] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-03T21:44:22.212573] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T21:44:22.390703] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-03T21:44:22.696457] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-03T21:44:23.190710] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-03T21:44:23.631423] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T21:44:23.990713] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-03T21:44:24.410989] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T21:44:24.790689] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-03T21:44:25.126960] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T21:44:25.590683] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-03T21:44:25.929479] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T21:44:26.390677] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-03T21:44:26.875069] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T21:44:27.190695] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-03T21:44:27.664777] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-03T21:44:27.990746] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-03T21:44:28.342361] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T21:44:28.343120] [INFO ] [REMOTE ] STXK: Full fetch complete (2391 records). [2025-10-03T21:44:28.343229] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-03T21:44:28.762309] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-03T21:44:28.762399] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-03T21:44:28.762603] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-03T21:44:28.762691] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-03T21:44:28.763153] [DEBUG] [LOCAL ] STXK: Trimmed 2391 records to 1503 (keeping 200 days of data) [2025-10-03T21:44:28.773722] [DEBUG] [LOCAL ] STXK: Primary data saved (1503 records). [2025-10-03T21:44:28.773857] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-03T21:44:28.773958] [INFO ] [MAIN ] Update Progress: 2022/2370 symbols completed. STXK took 31.3s. Estimated remaining: 48m 57s. Rate: 7.1 symbols/min [2025-10-03T21:44:28.798096] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-03T21:44:28.973762] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:29.034921] [DEBUG] [LOCAL ] STZ: Loaded 52676 existing records from primary storage. [2025-10-03T21:44:29.035363] [INFO ] [MAIN ] STZ: Loaded 52676 existing records. [2025-10-03T21:44:29.246874] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:29.247476] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-03T21:44:29.247536] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-03T21:44:29.248087] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-03T21:44:29.248158] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-03T21:44:29.370913] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T21:44:29.595802] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-03T21:44:29.661708] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:30.126189] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T21:44:30.390748] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-03T21:44:30.864975] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T21:44:31.190747] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-03T21:44:31.990728] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-03T21:44:32.325017] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-03T21:44:32.790729] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-03T21:44:32.952440] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T21:44:33.353998] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T21:44:33.590713] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-03T21:44:34.041818] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T21:44:34.390717] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-03T21:44:34.725676] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-03T21:44:35.190733] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-03T21:44:35.550506] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-03T21:44:35.990749] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-03T21:44:36.095239] [DEBUG] [REMOTE ] STXV: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T21:44:36.095617] [WARN ] [REMOTE ] STXV: No data returned for month 2025-05 [2025-10-03T21:44:36.095791] [FATAL] [REMOTE ] STXV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:44:36.095954] [FATAL] [MAIN ] STXV: Failed to fetch primary data. [2025-10-03T21:44:36.096041] [WARN ] [MAIN ] STXV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:44:36.096133] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-03T21:44:36.096213] [DEBUG] [LOCAL ] STXV: No primary data file found to delete. [2025-10-03T21:44:36.096252] [INFO ] [LOCAL ] STXV: Starting deletion of derivative data. [2025-10-03T21:44:36.096692] [DEBUG] [LOCAL ] STXV: Deleted derivative data file. [2025-10-03T21:44:36.096805] [INFO ] [MAIN ] Update Progress: 2023/2370 symbols completed. STXV took 19.4s. Estimated remaining: 48m 48s. Rate: 7.1 symbols/min [2025-10-03T21:44:36.293861] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:36.359714] [DEBUG] [LOCAL ] SU: Loaded 53836 existing records from primary storage. [2025-10-03T21:44:36.360215] [INFO ] [MAIN ] SU: Loaded 53836 existing records. [2025-10-03T21:44:36.544263] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:36.544613] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-03T21:44:36.544707] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-03T21:44:36.545062] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-03T21:44:36.545119] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-03T21:44:36.798703] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-03T21:44:36.933044] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:37.590715] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-03T21:44:37.935121] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-03T21:44:38.390630] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-03T21:44:38.749381] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T21:44:39.190725] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-03T21:44:39.671724] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T21:44:39.990668] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-03T21:44:40.220186] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:44:40.790753] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-03T21:44:41.134354] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T21:44:41.590703] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-03T21:44:42.026939] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T21:44:42.027852] [INFO ] [REMOTE ] STXT: Full fetch complete (3959 records). [2025-10-03T21:44:42.031421] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-03T21:44:42.375752] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-03T21:44:42.396920] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-03T21:44:42.475103] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-03T21:44:42.475198] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-03T21:44:42.475351] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-03T21:44:42.475453] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-03T21:44:42.475937] [DEBUG] [LOCAL ] STXT: Trimmed 3959 records to 2568 (keeping 200 days of data) [2025-10-03T21:44:42.493952] [DEBUG] [LOCAL ] STXT: Primary data saved (2568 records). [2025-10-03T21:44:42.494117] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-03T21:44:42.494244] [INFO ] [MAIN ] Update Progress: 2024/2370 symbols completed. STXT took 32.3s. Estimated remaining: 48m 39s. Rate: 7.1 symbols/min [2025-10-03T21:44:42.675528] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:42.725496] [DEBUG] [LOCAL ] SUI: Loaded 42015 existing records from primary storage. [2025-10-03T21:44:42.725861] [INFO ] [MAIN ] SUI: Loaded 42015 existing records. [2025-10-03T21:44:42.809128] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T21:44:42.835843] [INFO ] [REMOTE ] STXM: Full fetch complete (1435 records). [2025-10-03T21:44:42.838980] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-03T21:44:43.088025] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:43.099841] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-03T21:44:43.110174] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-03T21:44:43.120725] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-03T21:44:43.120818] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-03T21:44:43.198772] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-03T21:44:43.297144] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T21:44:43.304139] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:44:43.310145] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:44:43.331050] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-03T21:44:43.354040] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-03T21:44:43.387373] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-03T21:44:43.438329] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-03T21:44:43.471485] [INFO ] [MAIN ] Update Progress: 2025/2370 symbols completed. STXM took 34.3s. Estimated remaining: 48m 30s. Rate: 7.1 symbols/min [2025-10-03T21:44:43.719738] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:43.791047] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:44:43.837911] [DEBUG] [LOCAL ] SUN: Loaded 37823 existing records from primary storage. [2025-10-03T21:44:43.838293] [INFO ] [MAIN ] SUN: Loaded 37823 existing records. [2025-10-03T21:44:43.995868] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-03T21:44:44.044831] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:44:44.045319] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-03T21:44:44.045410] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-03T21:44:44.046253] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-03T21:44:44.046313] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-03T21:44:44.472001] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:44:44.790731] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-03T21:44:45.162586] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T21:44:45.590700] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-03T21:44:45.765402] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T21:44:46.390635] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-03T21:44:46.808563] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T21:44:46.866787] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:44:47.190707] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-03T21:44:47.990704] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-03T21:44:48.065063] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T21:44:48.790667] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-03T21:44:48.849940] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T21:44:49.463696] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T21:44:49.590694] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-03T21:44:50.396411] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-03T21:44:50.412005] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T21:44:51.190622] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-03T21:44:51.536101] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T21:44:51.872808] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T21:44:51.990715] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-03T21:44:52.790636] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-03T21:44:52.817796] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T21:44:53.374003] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T21:44:53.590694] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-03T21:44:54.390700] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-03T21:44:54.910803] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T21:44:55.064323] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T21:44:55.190764] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-03T21:44:56.000533] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-03T21:44:56.005293] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T21:44:56.790689] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-03T21:44:57.455312] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-03T21:44:57.590678] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-03T21:44:57.710621] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T21:44:58.291434] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T21:44:58.390746] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-03T21:44:58.766607] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T21:44:59.190694] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-03T21:45:00.000064] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-03T21:45:00.008203] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T21:45:00.756272] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T21:45:00.790727] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-03T21:45:01.590946] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-03T21:45:01.594185] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:45:02.179353] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T21:45:02.390748] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-03T21:45:03.190717] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-03T21:45:03.783060] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-03T21:45:03.990714] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-03T21:45:04.273255] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T21:45:04.789921] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T21:45:04.791905] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-03T21:45:05.590673] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-03T21:45:05.937595] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T21:45:06.390670] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-03T21:45:06.478532] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:45:07.190724] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-03T21:45:07.650078] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-03T21:45:07.990708] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-03T21:45:08.448802] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T21:45:08.790705] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-03T21:45:08.885803] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T21:45:09.435341] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T21:45:09.590729] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-03T21:45:10.324282] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T21:45:10.390728] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-03T21:45:10.793167] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:45:10.796307] [INFO ] [REMOTE ] SUN: Full fetch complete (55062 records). [2025-10-03T21:45:10.796478] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-03T21:45:11.203158] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-03T21:45:11.225581] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-03T21:45:11.225688] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-03T21:45:11.226932] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-03T21:45:11.227096] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-03T21:45:11.228818] [DEBUG] [LOCAL ] SUN: Trimmed 55062 records to 38153 (keeping 200 days of data) [2025-10-03T21:45:11.474050] [DEBUG] [LOCAL ] SUN: Primary data saved (38153 records). [2025-10-03T21:45:11.474223] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-03T21:45:11.474327] [INFO ] [MAIN ] Update Progress: 2026/2370 symbols completed. SUN took 28.0s. Estimated remaining: 48m 25s. Rate: 7.1 symbols/min [2025-10-03T21:45:11.667079] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:11.716112] [DEBUG] [LOCAL ] SUPV: Loaded 47694 existing records from primary storage. [2025-10-03T21:45:11.716463] [INFO ] [MAIN ] SUPV: Loaded 47694 existing records. [2025-10-03T21:45:11.908376] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:11.908689] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-03T21:45:11.908815] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-03T21:45:11.909129] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-03T21:45:11.909219] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-03T21:45:11.995760] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-03T21:45:12.318275] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:12.410535] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:45:12.417747] [INFO ] [REMOTE ] SUI: Full fetch complete (60878 records). [2025-10-03T21:45:12.418024] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-03T21:45:12.793876] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-03T21:45:12.858311] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-03T21:45:12.858523] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-03T21:45:12.859792] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-03T21:45:12.859924] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-03T21:45:12.897758] [DEBUG] [LOCAL ] SUI: Trimmed 60878 records to 42248 (keeping 200 days of data) [2025-10-03T21:45:12.897512] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-03T21:45:13.195241] [DEBUG] [LOCAL ] SUI: Primary data saved (42248 records). [2025-10-03T21:45:13.195380] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-03T21:45:13.195485] [INFO ] [MAIN ] Update Progress: 2027/2370 symbols completed. SUI took 30.7s. Estimated remaining: 48m 15s. Rate: 7.1 symbols/min [2025-10-03T21:45:13.376292] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:13.419237] [DEBUG] [LOCAL ] SUZ: Loaded 45964 existing records from primary storage. [2025-10-03T21:45:13.419693] [INFO ] [MAIN ] SUZ: Loaded 45964 existing records. [2025-10-03T21:45:13.593881] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-03T21:45:13.625123] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:13.625404] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-03T21:45:13.625454] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-03T21:45:13.625757] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-03T21:45:13.625816] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-03T21:45:14.031782] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:14.070917] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T21:45:14.390689] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-03T21:45:14.568914] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T21:45:14.839290] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:45:14.841893] [INFO ] [REMOTE ] STZ: Full fetch complete (75882 records). [2025-10-03T21:45:14.842110] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-03T21:45:15.195810] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-03T21:45:15.275675] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-03T21:45:15.275793] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-03T21:45:15.277140] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-03T21:45:15.277230] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-03T21:45:15.279310] [DEBUG] [LOCAL ] STZ: Trimmed 75882 records to 53064 (keeping 200 days of data) [2025-10-03T21:45:15.646312] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T21:45:15.679184] [DEBUG] [LOCAL ] STZ: Primary data saved (53064 records). [2025-10-03T21:45:15.679354] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-03T21:45:15.680339] [INFO ] [MAIN ] Update Progress: 2028/2370 symbols completed. STZ took 46.9s. Estimated remaining: 48m 6s. Rate: 7.1 symbols/min [2025-10-03T21:45:15.867674] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:15.920357] [DEBUG] [LOCAL ] SVV: Loaded 40036 existing records from primary storage. [2025-10-03T21:45:15.920743] [INFO ] [MAIN ] SVV: Loaded 40036 existing records. [2025-10-03T21:45:15.998435] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-03T21:45:16.113951] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:16.114235] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-03T21:45:16.114297] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-03T21:45:16.114554] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-03T21:45:16.114611] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-03T21:45:16.528475] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:16.790724] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-03T21:45:16.841587] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T21:45:17.482044] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T21:45:17.484930] [INFO ] [REMOTE ] SU: Full fetch complete (77395 records). [2025-10-03T21:45:17.485057] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-03T21:45:17.597027] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-03T21:45:17.918273] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-03T21:45:17.918367] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-03T21:45:17.919568] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-03T21:45:17.919635] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-03T21:45:17.921209] [DEBUG] [LOCAL ] SU: Trimmed 77395 records to 54223 (keeping 200 days of data) [2025-10-03T21:45:18.276575] [DEBUG] [LOCAL ] SU: Primary data saved (54223 records). [2025-10-03T21:45:18.276919] [INFO ] [MAIN ] SU: Full history saved. [2025-10-03T21:45:18.277102] [INFO ] [MAIN ] Update Progress: 2029/2370 symbols completed. SU took 42.2s. Estimated remaining: 47m 56s. Rate: 7.1 symbols/min [2025-10-03T21:45:18.392721] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-03T21:45:18.487366] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:18.489753] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:45:18.548709] [DEBUG] [LOCAL ] SW: Loaded 53552 existing records from primary storage. [2025-10-03T21:45:18.549109] [INFO ] [MAIN ] SW: Loaded 53552 existing records. [2025-10-03T21:45:18.735854] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:18.736150] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-03T21:45:18.736211] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-03T21:45:18.736486] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-03T21:45:18.736561] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-03T21:45:19.131187] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:19.190623] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-03T21:45:19.407375] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:45:19.974762] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T21:45:19.990605] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-03T21:45:20.699401] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T21:45:20.790688] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-03T21:45:21.547531] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T21:45:21.590700] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-03T21:45:22.252908] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T21:45:22.390707] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-03T21:45:22.697253] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T21:45:23.190692] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-03T21:45:23.996675] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-03T21:45:24.010076] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T21:45:24.608851] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T21:45:24.790720] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-03T21:45:25.595224] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-03T21:45:25.601871] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:45:26.398736] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-03T21:45:26.405099] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:45:27.190738] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-03T21:45:27.369260] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T21:45:27.717612] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:45:27.990722] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-03T21:45:28.790723] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-03T21:45:29.138401] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T21:45:29.590737] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-03T21:45:29.664793] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T21:45:30.265514] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T21:45:30.390691] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-03T21:45:31.190687] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-03T21:45:31.470871] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T21:45:32.003597] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-03T21:45:32.010204] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T21:45:32.790963] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-03T21:45:32.790870] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T21:45:33.590733] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-03T21:45:33.659381] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:45:34.026791] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T21:45:34.390731] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-03T21:45:35.198138] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-03T21:45:35.204921] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T21:45:35.990700] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-03T21:45:36.057795] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T21:45:36.790671] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-03T21:45:37.117117] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T21:45:37.597762] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-03T21:45:37.628045] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T21:45:38.383227] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T21:45:38.392549] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-03T21:45:39.190738] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-03T21:45:39.396162] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T21:45:39.990786] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-03T21:45:40.081402] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T21:45:40.116448] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T21:45:40.790730] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-03T21:45:41.566278] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T21:45:41.590636] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-03T21:45:42.048543] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:45:42.051824] [INFO ] [REMOTE ] SW: Full fetch complete (76810 records). [2025-10-03T21:45:42.051964] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-03T21:45:42.429393] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-03T21:45:42.532428] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-03T21:45:42.532693] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-03T21:45:42.534350] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-03T21:45:42.534514] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-03T21:45:42.569422] [DEBUG] [LOCAL ] SW: Trimmed 76810 records to 53942 (keeping 200 days of data) [2025-10-03T21:45:42.571499] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:45:42.944685] [DEBUG] [LOCAL ] SW: Primary data saved (53942 records). [2025-10-03T21:45:42.944879] [INFO ] [MAIN ] SW: Full history saved. [2025-10-03T21:45:42.945075] [INFO ] [MAIN ] Update Progress: 2030/2370 symbols completed. SW took 24.7s. Estimated remaining: 47m 50s. Rate: 7.1 symbols/min [2025-10-03T21:45:43.131661] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:43.186147] [DEBUG] [LOCAL ] SWK: Loaded 52774 existing records from primary storage. [2025-10-03T21:45:43.186561] [INFO ] [MAIN ] SWK: Loaded 52774 existing records. [2025-10-03T21:45:43.199712] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-03T21:45:43.386595] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:43.386897] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-03T21:45:43.386949] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-03T21:45:43.387278] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-03T21:45:43.387338] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-03T21:45:43.803433] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:43.990725] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-03T21:45:44.241539] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:45:44.615960] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T21:45:44.790706] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-03T21:45:45.556728] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T21:45:45.590746] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-03T21:45:46.390706] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-03T21:45:46.522973] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T21:45:47.190683] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-03T21:45:47.361327] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T21:45:48.003342] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-03T21:45:48.006825] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:45:48.339511] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T21:45:48.790704] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-03T21:45:49.500368] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T21:45:49.503356] [INFO ] [REMOTE ] SUPV: Full fetch complete (68463 records). [2025-10-03T21:45:49.503497] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-03T21:45:49.595929] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-03T21:45:49.955543] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-03T21:45:49.955705] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-03T21:45:49.957346] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-03T21:45:49.957437] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-03T21:45:49.959155] [DEBUG] [LOCAL ] SUPV: Trimmed 68463 records to 48056 (keeping 200 days of data) [2025-10-03T21:45:50.280030] [DEBUG] [LOCAL ] SUPV: Primary data saved (48056 records). [2025-10-03T21:45:50.280174] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-03T21:45:50.280273] [INFO ] [MAIN ] Update Progress: 2031/2370 symbols completed. SUPV took 38.8s. Estimated remaining: 47m 42s. Rate: 7.1 symbols/min [2025-10-03T21:45:50.395362] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-03T21:45:50.481051] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:50.512797] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T21:45:50.548920] [DEBUG] [LOCAL ] SWX: Loaded 31244 existing records from primary storage. [2025-10-03T21:45:50.549293] [INFO ] [MAIN ] SWX: Loaded 31244 existing records. [2025-10-03T21:45:50.746982] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:50.747270] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-03T21:45:50.747319] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-03T21:45:50.747792] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-03T21:45:50.747859] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-03T21:45:51.134802] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:51.163876] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:45:51.190634] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-03T21:45:51.990714] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-03T21:45:52.173479] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T21:45:52.328497] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T21:45:52.331317] [INFO ] [REMOTE ] SUZ: Full fetch complete (66673 records). [2025-10-03T21:45:52.331475] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-03T21:45:52.753121] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-03T21:45:52.753220] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-03T21:45:52.754439] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-03T21:45:52.754509] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-03T21:45:52.755999] [DEBUG] [LOCAL ] SUZ: Trimmed 66673 records to 46242 (keeping 200 days of data) [2025-10-03T21:45:52.804274] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-03T21:45:53.035255] [DEBUG] [LOCAL ] SUZ: Primary data saved (46242 records). [2025-10-03T21:45:53.035413] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-03T21:45:53.035507] [INFO ] [MAIN ] Update Progress: 2032/2370 symbols completed. SUZ took 39.8s. Estimated remaining: 47m 32s. Rate: 7.1 symbols/min [2025-10-03T21:45:53.224617] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:53.233504] [DEBUG] [LOCAL ] SWZ: Loaded 6065 existing records from primary storage. [2025-10-03T21:45:53.233768] [INFO ] [MAIN ] SWZ: Loaded 6065 existing records. [2025-10-03T21:45:53.456053] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:53.456546] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-03T21:45:53.456730] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-03T21:45:53.457088] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-03T21:45:53.457260] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-03T21:45:53.591067] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-03T21:45:53.848525] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T21:45:53.936092] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:54.080427] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:45:54.390737] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-03T21:45:54.891077] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T21:45:54.894534] [INFO ] [REMOTE ] SVV: Full fetch complete (56400 records). [2025-10-03T21:45:54.894792] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-03T21:45:55.008894] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T21:45:55.199497] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-03T21:45:55.487111] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-03T21:45:55.487242] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-03T21:45:55.489095] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-03T21:45:55.489196] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-03T21:45:55.490974] [DEBUG] [LOCAL ] SVV: Trimmed 56400 records to 40338 (keeping 200 days of data) [2025-10-03T21:45:55.806196] [DEBUG] [LOCAL ] SVV: Primary data saved (40338 records). [2025-10-03T21:45:55.806349] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-03T21:45:55.808071] [INFO ] [MAIN ] Update Progress: 2033/2370 symbols completed. SVV took 40.1s. Estimated remaining: 47m 23s. Rate: 7.1 symbols/min [2025-10-03T21:45:55.993718] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-03T21:45:55.994591] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:45:56.041109] [DEBUG] [LOCAL ] SXC: Loaded 41758 existing records from primary storage. [2025-10-03T21:45:56.041449] [INFO ] [MAIN ] SXC: Loaded 41758 existing records. [2025-10-03T21:45:56.234788] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:45:56.235036] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-03T21:45:56.235087] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-03T21:45:56.235479] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-03T21:45:56.235541] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-03T21:45:56.616321] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:45:56.790708] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-03T21:45:57.365833] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T21:45:57.394359] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-03T21:45:57.395380] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T21:45:57.590729] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-03T21:45:58.390742] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-03T21:45:58.804519] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T21:45:58.966374] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T21:45:59.190690] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-03T21:45:59.990738] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-03T21:46:00.643221] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T21:46:00.790713] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-03T21:46:01.503616] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T21:46:01.590708] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-03T21:46:01.681584] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:46:02.390716] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-03T21:46:03.190662] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-03T21:46:03.473151] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T21:46:03.538146] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T21:46:03.758727] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T21:46:03.990736] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-03T21:46:04.790736] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-03T21:46:05.590621] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-03T21:46:05.784837] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T21:46:06.198555] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T21:46:06.330230] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T21:46:06.390688] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-03T21:46:07.190689] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-03T21:46:07.749232] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:46:07.822307] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T21:46:07.990716] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-03T21:46:08.790709] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-03T21:46:09.480100] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:46:09.590708] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-03T21:46:10.390734] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-03T21:46:10.849105] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T21:46:11.008500] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T21:46:11.190695] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-03T21:46:11.831623] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T21:46:11.990750] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-03T21:46:12.790701] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-03T21:46:13.096517] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T21:46:13.233117] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T21:46:13.590724] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-03T21:46:14.152422] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T21:46:14.370718] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T21:46:14.390728] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-03T21:46:15.190689] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-03T21:46:15.679508] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T21:46:15.990740] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-03T21:46:16.617124] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T21:46:16.621286] [INFO ] [REMOTE ] SWK: Full fetch complete (75347 records). [2025-10-03T21:46:16.621535] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-03T21:46:16.799938] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-03T21:46:16.972106] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T21:46:17.015373] [INFO ] [REMOTE ] SWX: Full fetch complete (43969 records). [2025-10-03T21:46:17.031774] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-03T21:46:17.155317] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-03T21:46:17.176943] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-03T21:46:17.204436] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-03T21:46:17.207814] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-03T21:46:17.270461] [DEBUG] [LOCAL ] SWK: Trimmed 75347 records to 53135 (keeping 200 days of data) [2025-10-03T21:46:17.555141] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T21:46:17.609745] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-03T21:46:17.664093] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-03T21:46:17.664539] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-03T21:46:17.665936] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-03T21:46:17.666316] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-03T21:46:17.671687] [DEBUG] [LOCAL ] SWX: Trimmed 43969 records to 31444 (keeping 200 days of data) [2025-10-03T21:46:18.037946] [DEBUG] [LOCAL ] SWX: Primary data saved (31444 records). [2025-10-03T21:46:18.040829] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-03T21:46:18.041000] [INFO ] [MAIN ] Update Progress: 2034/2370 symbols completed. SWX took 27.8s. Estimated remaining: 47m 17s. Rate: 7.1 symbols/min [2025-10-03T21:46:18.296798] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:18.317661] [DEBUG] [LOCAL ] SXI: Loaded 11652 existing records from primary storage. [2025-10-03T21:46:18.320354] [INFO ] [MAIN ] SXI: Loaded 11652 existing records. [2025-10-03T21:46:18.393459] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-03T21:46:18.442417] [DEBUG] [LOCAL ] SWK: Primary data saved (53135 records). [2025-10-03T21:46:18.463516] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-03T21:46:18.468975] [INFO ] [MAIN ] Update Progress: 2035/2370 symbols completed. SWK took 35.5s. Estimated remaining: 47m 7s. Rate: 7.1 symbols/min [2025-10-03T21:46:18.547766] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:18.604372] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T21:46:18.619508] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-03T21:46:18.640952] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-03T21:46:18.661801] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-03T21:46:18.667296] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-03T21:46:18.853231] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:19.140887] [DEBUG] [LOCAL ] SXT: Loaded 29691 existing records from primary storage. [2025-10-03T21:46:19.164625] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:19.165197] [INFO ] [MAIN ] SXT: Loaded 29691 existing records. [2025-10-03T21:46:19.199589] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-03T21:46:19.363234] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:19.363511] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-03T21:46:19.363564] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-03T21:46:19.363861] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-03T21:46:19.363958] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-03T21:46:19.788097] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:19.995782] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T21:46:19.994767] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-03T21:46:20.027191] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T21:46:20.600979] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T21:46:20.790754] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-03T21:46:21.590730] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-03T21:46:22.249620] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T21:46:22.340290] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T21:46:22.390737] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-03T21:46:23.190742] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-03T21:46:23.202598] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T21:46:23.639242] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:46:23.640478] [INFO ] [REMOTE ] SWZ: Full fetch complete (8139 records). [2025-10-03T21:46:23.640572] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-03T21:46:23.995930] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-03T21:46:24.063693] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-03T21:46:24.063829] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-03T21:46:24.064065] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-03T21:46:24.064109] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-03T21:46:24.064540] [DEBUG] [LOCAL ] SWZ: Trimmed 8139 records to 6092 (keeping 200 days of data) [2025-10-03T21:46:24.103941] [DEBUG] [LOCAL ] SWZ: Primary data saved (6092 records). [2025-10-03T21:46:24.104102] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-03T21:46:24.104217] [INFO ] [MAIN ] Update Progress: 2036/2370 symbols completed. SWZ took 31.1s. Estimated remaining: 46m 58s. Rate: 7.1 symbols/min [2025-10-03T21:46:24.286756] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:24.343198] [DEBUG] [LOCAL ] SYF: Loaded 53832 existing records from primary storage. [2025-10-03T21:46:24.343624] [INFO ] [MAIN ] SYF: Loaded 53832 existing records. [2025-10-03T21:46:24.556476] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:24.556772] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-03T21:46:24.556827] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-03T21:46:24.557091] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-03T21:46:24.557153] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-03T21:46:24.796221] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-03T21:46:24.956761] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:25.169851] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T21:46:25.590749] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-03T21:46:26.160079] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:46:26.273607] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T21:46:26.390705] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-03T21:46:27.190720] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-03T21:46:27.214585] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T21:46:27.990719] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-03T21:46:28.790697] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-03T21:46:28.919523] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T21:46:29.575348] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T21:46:29.590625] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-03T21:46:29.616790] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T21:46:30.390748] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-03T21:46:31.190729] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-03T21:46:31.493777] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T21:46:31.576304] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T21:46:31.990628] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-03T21:46:32.068720] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T21:46:32.790750] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-03T21:46:33.385184] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T21:46:33.590740] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-03T21:46:34.248341] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T21:46:34.390746] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-03T21:46:34.825296] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T21:46:35.190704] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-03T21:46:35.624515] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T21:46:35.627166] [INFO ] [REMOTE ] SXC: Full fetch complete (61175 records). [2025-10-03T21:46:35.627328] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-03T21:46:35.998388] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-03T21:46:36.062150] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-03T21:46:36.062275] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-03T21:46:36.063970] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-03T21:46:36.064632] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-03T21:46:36.066521] [DEBUG] [LOCAL ] SXC: Trimmed 61175 records to 42071 (keeping 200 days of data) [2025-10-03T21:46:36.344602] [DEBUG] [LOCAL ] SXC: Primary data saved (42071 records). [2025-10-03T21:46:36.344794] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-03T21:46:36.345617] [INFO ] [MAIN ] Update Progress: 2037/2370 symbols completed. SXC took 40.5s. Estimated remaining: 46m 50s. Rate: 7.1 symbols/min [2025-10-03T21:46:36.745978] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T21:46:36.762930] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T21:46:36.790627] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-03T21:46:37.596830] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-03T21:46:37.600181] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T21:46:38.390702] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-03T21:46:39.190698] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-03T21:46:39.494021] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:46:39.527493] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T21:46:39.990725] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-03T21:46:40.040394] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T21:46:40.790675] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-03T21:46:41.145106] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T21:46:41.590757] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-03T21:46:42.390682] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-03T21:46:42.459504] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T21:46:42.538776] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T21:46:43.190706] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-03T21:46:43.733753] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T21:46:43.990721] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-03T21:46:44.151209] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T21:46:44.790737] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-03T21:46:45.590735] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-03T21:46:45.764674] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T21:46:46.039166] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T21:46:46.224611] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T21:46:46.226172] [INFO ] [REMOTE ] SXI: Full fetch complete (14989 records). [2025-10-03T21:46:46.226253] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-03T21:46:46.392155] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-03T21:46:46.631172] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-03T21:46:46.631285] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-03T21:46:46.632345] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-03T21:46:46.632417] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-03T21:46:46.633071] [DEBUG] [LOCAL ] SXI: Trimmed 14989 records to 11760 (keeping 200 days of data) [2025-10-03T21:46:46.730672] [DEBUG] [LOCAL ] SXI: Primary data saved (11760 records). [2025-10-03T21:46:46.730920] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-03T21:46:46.731086] [INFO ] [MAIN ] Update Progress: 2038/2370 symbols completed. SXI took 28.7s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-03T21:46:47.190757] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-03T21:46:48.405510] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T21:46:48.418607] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-03T21:46:48.560340] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T21:46:48.790715] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-03T21:46:49.910758] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:46:49.912835] [INFO ] [REMOTE ] SXT: Full fetch complete (38746 records). [2025-10-03T21:46:49.912957] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-03T21:46:50.338045] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-03T21:46:50.354745] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-03T21:46:50.369247] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-03T21:46:50.372924] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-03T21:46:50.376683] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T21:46:50.389823] [DEBUG] [LOCAL ] SXT: Trimmed 38746 records to 29985 (keeping 200 days of data) [2025-10-03T21:46:50.391905] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-03T21:46:50.586380] [DEBUG] [LOCAL ] SXT: Primary data saved (29985 records). [2025-10-03T21:46:50.586531] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-03T21:46:50.586616] [INFO ] [MAIN ] Update Progress: 2039/2370 symbols completed. SXT took 32.1s. Estimated remaining: 46m 33s. Rate: 7.1 symbols/min [2025-10-03T21:46:52.311948] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T21:46:52.324487] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-03T21:46:54.045606] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T21:46:54.058714] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-03T21:46:54.503625] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T21:46:54.506581] [INFO ] [REMOTE ] SYF: Full fetch complete (77329 records). [2025-10-03T21:46:54.506787] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-03T21:46:54.938465] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-03T21:46:54.938570] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-03T21:46:54.939887] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-03T21:46:54.939960] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-03T21:46:54.941607] [DEBUG] [LOCAL ] SYF: Trimmed 77329 records to 54222 (keeping 200 days of data) [2025-10-03T21:46:55.317907] [DEBUG] [LOCAL ] SYF: Primary data saved (54222 records). [2025-10-03T21:46:55.318257] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-03T21:46:55.318376] [INFO ] [MAIN ] Update Progress: 2040/2370 symbols completed. SYF took 31.2s. Estimated remaining: 46m 24s. Rate: 7.1 symbols/min [2025-10-03T21:46:55.987071] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:56.081168] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:56.167964] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:56.170140] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:46:56.246311] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-03T21:46:56.247151] [INFO ] [MAIN ] T: Loaded 54188 existing records. [2025-10-03T21:46:56.464309] [DEBUG] [LOCAL ] SYY: Loaded 53608 existing records from primary storage. [2025-10-03T21:46:56.471526] [DEBUG] [LOCAL ] SYK: Loaded 47253 existing records from primary storage. [2025-10-03T21:46:56.472553] [DEBUG] [LOCAL ] TAC: Loaded 42891 existing records from primary storage. [2025-10-03T21:46:56.473626] [INFO ] [MAIN ] SYK: Loaded 47253 existing records. [2025-10-03T21:46:56.479332] [INFO ] [MAIN ] TAC: Loaded 42891 existing records. [2025-10-03T21:46:56.479565] [INFO ] [MAIN ] SYY: Loaded 53608 existing records. [2025-10-03T21:46:56.840305] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:56.952454] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-03T21:46:56.978934] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-03T21:46:57.081821] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-03T21:46:57.146039] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-03T21:46:57.145888] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:57.253250] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:57.270682] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-03T21:46:57.299713] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-03T21:46:57.277052] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:46:57.310410] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-03T21:46:57.310537] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-03T21:46:57.326271] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-03T21:46:57.315778] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-03T21:46:57.331737] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-03T21:46:57.337104] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-03T21:46:57.340533] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-03T21:46:57.340600] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-03T21:46:57.358016] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-03T21:46:57.345882] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-03T21:46:58.675419] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:58.703073] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-03T21:46:58.861083] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:58.949732] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:58.924725] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:46:58.942875] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-03T21:46:58.951307] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-03T21:46:58.952557] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-03T21:47:00.776505] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:47:00.787206] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-03T21:47:00.822301] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T21:47:00.835892] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-03T21:47:00.868379] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T21:47:00.879212] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-03T21:47:01.202915] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-03T21:47:01.214624] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-03T21:47:02.350803] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T21:47:02.361966] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-03T21:47:02.592424] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T21:47:02.603048] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-03T21:47:02.675702] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T21:47:02.687550] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-03T21:47:03.683764] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-03T21:47:03.695101] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-03T21:47:04.091611] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T21:47:04.102031] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-03T21:47:04.176225] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T21:47:04.187563] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-03T21:47:04.378034] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T21:47:04.389021] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-03T21:47:05.828860] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T21:47:05.839853] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-03T21:47:05.932256] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-03T21:47:05.943444] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-03T21:47:05.978413] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T21:47:05.991199] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-03T21:47:06.184639] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T21:47:06.390700] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-03T21:47:07.435244] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T21:47:07.445574] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-03T21:47:07.562890] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T21:47:07.990698] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-03T21:47:08.329151] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-03T21:47:08.391919] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T21:47:08.790638] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-03T21:47:09.027423] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:47:09.563772] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T21:47:09.590629] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-03T21:47:10.390674] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-03T21:47:10.576401] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:47:11.190677] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-03T21:47:11.312378] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T21:47:11.969219] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T21:47:11.990614] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-03T21:47:12.790714] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-03T21:47:13.590632] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-03T21:47:13.622638] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:47:13.799861] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T21:47:14.390672] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-03T21:47:14.571686] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T21:47:15.190725] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-03T21:47:15.372158] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T21:47:15.977230] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T21:47:15.990612] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-03T21:47:16.790750] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-03T21:47:17.540778] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:47:17.590687] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-03T21:47:17.648264] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-03T21:47:18.390684] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-03T21:47:18.458075] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T21:47:19.190735] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-03T21:47:19.488444] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T21:47:19.990737] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-03T21:47:20.314901] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T21:47:20.790709] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-03T21:47:20.833532] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T21:47:21.240105] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T21:47:21.242551] [INFO ] [REMOTE ] TAC: Full fetch complete (63967 records). [2025-10-03T21:47:21.242684] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-03T21:47:21.595936] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-03T21:47:21.684539] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-03T21:47:21.684661] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-03T21:47:21.685813] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-03T21:47:21.685883] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-03T21:47:21.687304] [DEBUG] [LOCAL ] TAC: Trimmed 63967 records to 43221 (keeping 200 days of data) [2025-10-03T21:47:21.961339] [DEBUG] [LOCAL ] TAC: Primary data saved (43221 records). [2025-10-03T21:47:21.961485] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-03T21:47:21.961591] [INFO ] [MAIN ] Update Progress: 2041/2370 symbols completed. TAC took 26.6s. Estimated remaining: 46m 19s. Rate: 7.1 symbols/min [2025-10-03T21:47:22.145944] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:47:22.203779] [DEBUG] [LOCAL ] TAK: Loaded 50184 existing records from primary storage. [2025-10-03T21:47:22.204233] [INFO ] [MAIN ] TAK: Loaded 50184 existing records. [2025-10-03T21:47:22.391833] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:47:22.391973] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-03T21:47:22.393264] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-03T21:47:22.393325] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-03T21:47:22.393607] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-03T21:47:22.393693] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-03T21:47:22.768585] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:47:22.904253] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T21:47:22.907218] [INFO ] [REMOTE ] SYK: Full fetch complete (68912 records). [2025-10-03T21:47:22.907356] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-03T21:47:23.190601] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-03T21:47:23.354870] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-03T21:47:23.355209] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-03T21:47:23.356979] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-03T21:47:23.357230] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-03T21:47:23.394174] [DEBUG] [LOCAL ] SYK: Trimmed 68912 records to 47617 (keeping 200 days of data) [2025-10-03T21:47:23.395839] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-03T21:47:23.543312] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T21:47:23.774371] [DEBUG] [LOCAL ] SYK: Primary data saved (47617 records). [2025-10-03T21:47:23.774524] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-03T21:47:23.774637] [INFO ] [MAIN ] Update Progress: 2042/2370 symbols completed. SYK took 28.5s. Estimated remaining: 46m 9s. Rate: 7.1 symbols/min [2025-10-03T21:47:23.951271] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:47:23.990718] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-03T21:47:24.014469] [DEBUG] [LOCAL ] TAL: Loaded 52324 existing records from primary storage. [2025-10-03T21:47:24.014938] [INFO ] [MAIN ] TAL: Loaded 52324 existing records. [2025-10-03T21:47:24.215363] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:47:24.215610] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-03T21:47:24.215697] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-03T21:47:24.215918] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-03T21:47:24.215979] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-03T21:47:24.616977] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:47:24.790674] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-03T21:47:24.881118] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T21:47:25.590696] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-03T21:47:25.747720] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T21:47:26.379013] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T21:47:26.390607] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-03T21:47:27.190724] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-03T21:47:27.936862] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-03T21:47:27.990635] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-03T21:47:28.219580] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T21:47:28.795735] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-03T21:47:28.814795] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T21:47:29.590715] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-03T21:47:30.388391] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-03T21:47:30.399926] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-03T21:47:30.509374] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T21:47:30.733013] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T21:47:30.850813] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:47:30.854868] [INFO ] [REMOTE ] SYY: Full fetch complete (76977 records). [2025-10-03T21:47:30.855080] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-03T21:47:31.195848] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-03T21:47:31.285454] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-03T21:47:31.285545] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-03T21:47:31.287104] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-03T21:47:31.287177] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-03T21:47:31.288920] [DEBUG] [LOCAL ] SYY: Trimmed 76977 records to 53996 (keeping 200 days of data) [2025-10-03T21:47:31.646006] [DEBUG] [LOCAL ] SYY: Primary data saved (53996 records). [2025-10-03T21:47:31.646198] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-03T21:47:31.646299] [INFO ] [MAIN ] Update Progress: 2043/2370 symbols completed. SYY took 36.3s. Estimated remaining: 46m 1s. Rate: 7.1 symbols/min [2025-10-03T21:47:31.828677] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:47:31.878830] [DEBUG] [LOCAL ] TALO: Loaded 51156 existing records from primary storage. [2025-10-03T21:47:31.879216] [INFO ] [MAIN ] TALO: Loaded 51156 existing records. [2025-10-03T21:47:31.995930] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-03T21:47:32.079183] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:47:32.079411] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-03T21:47:32.079460] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-03T21:47:32.079735] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-03T21:47:32.079795] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-03T21:47:32.461411] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:47:32.510382] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T21:47:32.514761] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-03T21:47:32.515009] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-03T21:47:32.795792] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-03T21:47:32.977104] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-03T21:47:32.977219] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-03T21:47:32.979079] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-03T21:47:32.979182] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-03T21:47:33.001364] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54578 (keeping 200 days of data) [2025-10-03T21:47:33.018690] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T21:47:33.381834] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-10-03T21:47:33.382026] [INFO ] [MAIN ] T: Full history saved. [2025-10-03T21:47:33.382152] [INFO ] [MAIN ] Update Progress: 2044/2370 symbols completed. T took 38.1s. Estimated remaining: 45m 51s. Rate: 7.1 symbols/min [2025-10-03T21:47:33.561323] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:47:33.590949] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-03T21:47:33.614476] [DEBUG] [LOCAL ] TAP: Loaded 53281 existing records from primary storage. [2025-10-03T21:47:33.614902] [INFO ] [MAIN ] TAP: Loaded 53281 existing records. [2025-10-03T21:47:33.821509] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:47:33.821801] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-03T21:47:33.821860] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-03T21:47:33.822092] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-03T21:47:33.822151] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-03T21:47:34.205842] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:47:34.390727] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-03T21:47:34.605528] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:47:35.190753] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-03T21:47:35.336189] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T21:47:35.990718] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-03T21:47:36.162507] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T21:47:36.790728] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-03T21:47:37.122356] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T21:47:37.590638] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-03T21:47:37.653401] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T21:47:38.390711] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-03T21:47:38.535075] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:47:39.096604] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T21:47:39.190727] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-03T21:47:39.990747] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-03T21:47:40.133056] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T21:47:40.744307] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T21:47:40.790709] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-03T21:47:41.590637] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-03T21:47:41.740527] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:47:42.398757] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-03T21:47:42.417813] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T21:47:43.190735] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-03T21:47:43.242937] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T21:47:43.990717] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-03T21:47:44.205863] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T21:47:44.790739] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-03T21:47:44.839942] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T21:47:45.416103] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T21:47:45.590749] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-03T21:47:46.390748] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-03T21:47:46.472433] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T21:47:47.192096] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-03T21:47:47.195045] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T21:47:47.990709] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-03T21:47:48.107214] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T21:47:48.555368] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T21:47:48.790739] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-03T21:47:49.590700] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-03T21:47:49.808713] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T21:47:50.390637] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-03T21:47:50.520491] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T21:47:51.198061] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-03T21:47:51.218856] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T21:47:51.990739] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-03T21:47:52.261555] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T21:47:52.575933] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:47:52.579830] [INFO ] [REMOTE ] TAL: Full fetch complete (75550 records). [2025-10-03T21:47:52.579987] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-03T21:47:52.795825] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-03T21:47:53.055059] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-03T21:47:53.055149] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-03T21:47:53.056305] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-03T21:47:53.056372] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-03T21:47:53.058081] [DEBUG] [LOCAL ] TAL: Trimmed 75550 records to 52687 (keeping 200 days of data) [2025-10-03T21:47:53.404053] [DEBUG] [LOCAL ] TAL: Primary data saved (52687 records). [2025-10-03T21:47:53.404376] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-03T21:47:53.404590] [INFO ] [MAIN ] Update Progress: 2045/2370 symbols completed. TAL took 29.6s. Estimated remaining: 45m 44s. Rate: 7.1 symbols/min [2025-10-03T21:47:53.595272] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-03T21:47:53.641775] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T21:47:53.676116] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:47:53.702703] [DEBUG] [LOCAL ] TBB: Loaded 11768 existing records from primary storage. [2025-10-03T21:47:53.702932] [INFO ] [MAIN ] TBB: Loaded 11768 existing records. [2025-10-03T21:47:53.897095] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:47:53.897356] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-03T21:47:53.897406] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-03T21:47:53.897605] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-03T21:47:53.897736] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-03T21:47:54.290829] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:47:54.390725] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-03T21:47:54.808433] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T21:47:55.190690] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-03T21:47:55.302881] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T21:47:55.990639] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-03T21:47:56.078666] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T21:47:56.782540] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T21:47:56.790606] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-03T21:47:57.150052] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T21:47:57.590623] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-03T21:47:57.744959] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T21:47:58.390709] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-03T21:47:59.164493] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T21:47:59.190638] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-03T21:47:59.344006] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:47:59.990826] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-03T21:48:00.590007] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T21:48:00.790757] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-03T21:48:00.927333] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T21:48:01.590744] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-03T21:48:02.390729] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-03T21:48:02.764986] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T21:48:02.904584] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T21:48:02.907786] [INFO ] [REMOTE ] TAK: Full fetch complete (71636 records). [2025-10-03T21:48:02.907926] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-03T21:48:03.196033] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-03T21:48:03.359866] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-03T21:48:03.365429] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-03T21:48:03.371566] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-03T21:48:03.371751] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-03T21:48:03.373060] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T21:48:03.378433] [DEBUG] [LOCAL ] TAK: Trimmed 71636 records to 50548 (keeping 200 days of data) [2025-10-03T21:48:03.697109] [DEBUG] [LOCAL ] TAK: Primary data saved (50548 records). [2025-10-03T21:48:03.697281] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-03T21:48:03.697391] [INFO ] [MAIN ] Update Progress: 2046/2370 symbols completed. TAK took 41.7s. Estimated remaining: 45m 36s. Rate: 7.1 symbols/min [2025-10-03T21:48:03.875917] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:03.910891] [DEBUG] [LOCAL ] TBBB: Loaded 35961 existing records from primary storage. [2025-10-03T21:48:03.911203] [INFO ] [MAIN ] TBBB: Loaded 35961 existing records. [2025-10-03T21:48:03.995730] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-03T21:48:04.109156] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:04.109512] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-03T21:48:04.109573] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-03T21:48:04.109852] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-03T21:48:04.109912] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-03T21:48:04.496035] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:04.790746] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-03T21:48:05.032313] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:48:05.375874] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:48:05.380870] [INFO ] [REMOTE ] TALO: Full fetch complete (73309 records). [2025-10-03T21:48:05.380986] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-03T21:48:05.595798] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-03T21:48:05.759458] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T21:48:05.826574] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-03T21:48:05.826721] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-03T21:48:05.828455] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-03T21:48:05.828527] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-03T21:48:05.830662] [DEBUG] [LOCAL ] TALO: Trimmed 73309 records to 51515 (keeping 200 days of data) [2025-10-03T21:48:06.162996] [DEBUG] [LOCAL ] TALO: Primary data saved (51515 records). [2025-10-03T21:48:06.163264] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-03T21:48:06.163497] [INFO ] [MAIN ] Update Progress: 2047/2370 symbols completed. TALO took 34.5s. Estimated remaining: 45m 27s. Rate: 7.1 symbols/min [2025-10-03T21:48:06.337988] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:06.362422] [DEBUG] [LOCAL ] TBI: Loaded 22726 existing records from primary storage. [2025-10-03T21:48:06.362789] [INFO ] [MAIN ] TBI: Loaded 22726 existing records. [2025-10-03T21:48:06.395844] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-03T21:48:06.547226] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:06.547529] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-03T21:48:06.547585] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-03T21:48:06.547920] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-03T21:48:06.547983] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-03T21:48:06.933234] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:07.041060] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T21:48:07.190766] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-03T21:48:07.249534] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T21:48:07.990708] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-03T21:48:08.412843] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T21:48:08.790624] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-03T21:48:08.802238] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T21:48:09.590726] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-03T21:48:10.245599] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T21:48:10.248684] [INFO ] [REMOTE ] TAP: Full fetch complete (76155 records). [2025-10-03T21:48:10.248837] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-03T21:48:10.395193] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-03T21:48:10.621414] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T21:48:10.713604] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-03T21:48:10.713749] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-03T21:48:10.715566] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-03T21:48:10.715664] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-03T21:48:10.717988] [DEBUG] [LOCAL ] TAP: Trimmed 76155 records to 53666 (keeping 200 days of data) [2025-10-03T21:48:11.078905] [DEBUG] [LOCAL ] TAP: Primary data saved (53666 records). [2025-10-03T21:48:11.079138] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-03T21:48:11.079300] [INFO ] [MAIN ] Update Progress: 2048/2370 symbols completed. TAP took 37.7s. Estimated remaining: 45m 18s. Rate: 7.1 symbols/min [2025-10-03T21:48:11.195821] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-03T21:48:11.327328] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:11.327819] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-03T21:48:11.327978] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-03T21:48:11.328113] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-03T21:48:11.328159] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-03T21:48:11.328205] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-03T21:48:11.328239] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-03T21:48:11.459142] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T21:48:11.711950] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:11.990689] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-03T21:48:12.196810] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T21:48:12.790731] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-03T21:48:13.590685] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-03T21:48:13.915749] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T21:48:14.047123] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T21:48:14.390754] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-03T21:48:14.595378] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T21:48:15.190680] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-03T21:48:15.203211] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T21:48:15.566831] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T21:48:15.990743] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-03T21:48:16.790728] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-03T21:48:17.360579] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T21:48:17.361787] [INFO ] [REMOTE ] TBB: Full fetch complete (17563 records). [2025-10-03T21:48:17.361859] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-03T21:48:17.551716] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T21:48:17.594900] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-03T21:48:17.807819] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-03T21:48:17.807915] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-03T21:48:17.808429] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-03T21:48:17.808497] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-03T21:48:17.809300] [DEBUG] [LOCAL ] TBB: Trimmed 17563 records to 11836 (keeping 200 days of data) [2025-10-03T21:48:17.892573] [DEBUG] [LOCAL ] TBB: Primary data saved (11836 records). [2025-10-03T21:48:17.892781] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-03T21:48:17.892935] [INFO ] [MAIN ] Update Progress: 2049/2370 symbols completed. TBB took 24.5s. Estimated remaining: 45m 9s. Rate: 7.1 symbols/min [2025-10-03T21:48:18.072097] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:18.078637] [DEBUG] [LOCAL ] TBN: Loaded 3627 existing records from primary storage. [2025-10-03T21:48:18.078851] [INFO ] [MAIN ] TBN: Loaded 3627 existing records. [2025-10-03T21:48:18.271021] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:18.271308] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-03T21:48:18.271361] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-03T21:48:18.271584] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-03T21:48:18.271684] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-03T21:48:18.395784] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-03T21:48:18.679507] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:18.819840] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T21:48:18.851298] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T21:48:19.190726] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-03T21:48:19.990691] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-03T21:48:20.311525] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T21:48:20.466921] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T21:48:20.790734] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-03T21:48:21.140422] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T21:48:21.590742] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-03T21:48:22.390674] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-03T21:48:22.834898] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T21:48:22.991440] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T21:48:23.190768] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-03T21:48:23.553865] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T21:48:23.990733] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-03T21:48:24.790706] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-03T21:48:25.071776] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T21:48:25.590730] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-03T21:48:25.942672] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T21:48:26.265903] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:48:26.390744] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-03T21:48:26.728617] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T21:48:27.190730] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-03T21:48:27.820396] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T21:48:27.990739] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-03T21:48:28.790709] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-03T21:48:29.118435] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T21:48:29.590704] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-03T21:48:29.876598] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T21:48:29.926998] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-03T21:48:30.390759] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-03T21:48:30.969426] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T21:48:31.190714] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-03T21:48:31.990709] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-03T21:48:32.226220] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T21:48:32.414840] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T21:48:32.790758] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-03T21:48:33.590741] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-03T21:48:34.321875] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:48:34.390617] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-03T21:48:34.913404] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T21:48:35.190701] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-03T21:48:35.546231] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-03T21:48:35.885492] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T21:48:35.990697] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-03T21:48:36.790709] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-03T21:48:37.059636] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-03T21:48:37.061051] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T21:48:37.590705] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-03T21:48:38.390714] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-03T21:48:38.911501] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T21:48:39.014520] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T21:48:39.190730] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-03T21:48:39.289533] [DEBUG] [REMOTE ] TBI: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-03T21:48:39.289974] [WARN ] [REMOTE ] TBI: No data returned for month 2025-10 [2025-10-03T21:48:39.290166] [FATAL] [REMOTE ] TBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:48:39.290297] [FATAL] [MAIN ] TBI: Failed to fetch primary data. [2025-10-03T21:48:39.290368] [WARN ] [MAIN ] TBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:48:39.290442] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-03T21:48:39.290517] [DEBUG] [LOCAL ] TBI: No primary data file found to delete. [2025-10-03T21:48:39.290556] [INFO ] [LOCAL ] TBI: Starting deletion of derivative data. [2025-10-03T21:48:39.291023] [DEBUG] [LOCAL ] TBI: Deleted derivative data file. [2025-10-03T21:48:39.291169] [INFO ] [MAIN ] Update Progress: 2050/2370 symbols completed. TBI took 33.1s. Estimated remaining: 45m 3s. Rate: 7.1 symbols/min [2025-10-03T21:48:39.478961] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:39.479203] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-03T21:48:39.479262] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-03T21:48:39.479381] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-03T21:48:39.479425] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-03T21:48:39.479468] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-03T21:48:39.479502] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-03T21:48:39.875234] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:39.990728] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-03T21:48:40.190168] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:48:40.190526] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-03T21:48:40.190623] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:48:40.190724] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-03T21:48:40.190775] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:48:40.190818] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-03T21:48:40.190878] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-03T21:48:40.190915] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-03T21:48:40.190956] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-03T21:48:40.191017] [INFO ] [MAIN ] Update Progress: 2051/2370 symbols completed. TCAI took 0.9s. Estimated remaining: 44m 53s. Rate: 7.1 symbols/min [2025-10-03T21:48:40.371195] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:40.430610] [DEBUG] [LOCAL ] TD: Loaded 52664 existing records from primary storage. [2025-10-03T21:48:40.430973] [INFO ] [MAIN ] TD: Loaded 52664 existing records. [2025-10-03T21:48:40.618129] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:40.618369] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-03T21:48:40.618419] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-03T21:48:40.618723] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-03T21:48:40.618785] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-03T21:48:40.790788] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-03T21:48:41.003536] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:41.590701] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-03T21:48:42.390680] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-03T21:48:42.459907] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T21:48:42.716595] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T21:48:43.190718] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-03T21:48:43.396386] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T21:48:43.739178] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T21:48:43.990691] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-03T21:48:44.790719] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-03T21:48:45.024523] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T21:48:45.026505] [INFO ] [REMOTE ] TBBB: Full fetch complete (51410 records). [2025-10-03T21:48:45.026595] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-03T21:48:45.433472] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-03T21:48:45.433557] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-03T21:48:45.434680] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-03T21:48:45.434816] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-03T21:48:45.435979] [DEBUG] [LOCAL ] TBBB: Trimmed 51410 records to 36157 (keeping 200 days of data) [2025-10-03T21:48:45.593455] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-03T21:48:45.652546] [DEBUG] [LOCAL ] TBBB: Primary data saved (36157 records). [2025-10-03T21:48:45.652737] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-03T21:48:45.652896] [INFO ] [MAIN ] Update Progress: 2052/2370 symbols completed. TBBB took 42.0s. Estimated remaining: 44m 44s. Rate: 7.1 symbols/min [2025-10-03T21:48:45.828696] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:45.872202] [DEBUG] [LOCAL ] TDC: Loaded 46959 existing records from primary storage. [2025-10-03T21:48:45.872521] [INFO ] [MAIN ] TDC: Loaded 46959 existing records. [2025-10-03T21:48:46.059470] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:46.059729] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-03T21:48:46.059816] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-03T21:48:46.060084] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-03T21:48:46.060143] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-03T21:48:46.401122] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-03T21:48:46.445745] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:46.453553] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T21:48:46.568899] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:48:46.795314] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-03T21:48:47.190735] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-03T21:48:47.990696] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-03T21:48:48.287559] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-03T21:48:48.288354] [INFO ] [REMOTE ] TBLU: Full fetch complete (1170 records). [2025-10-03T21:48:48.288425] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-03T21:48:48.492352] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T21:48:48.492609] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T21:48:48.492709] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T21:48:48.492789] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-03T21:48:48.492878] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-03T21:48:48.492936] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-03T21:48:48.492989] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-03T21:48:48.493055] [INFO ] [MAIN ] Update Progress: 2053/2370 symbols completed. TBLU took 37.4s. Estimated remaining: 44m 35s. Rate: 7.1 symbols/min [2025-10-03T21:48:48.693275] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:48.725311] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T21:48:48.741967] [DEBUG] [LOCAL ] TDF: Loaded 6445 existing records from primary storage. [2025-10-03T21:48:48.742219] [INFO ] [MAIN ] TDF: Loaded 6445 existing records. [2025-10-03T21:48:48.797061] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-03T21:48:48.930105] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:48.930351] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-03T21:48:48.930401] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-03T21:48:48.930584] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-03T21:48:48.930675] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-03T21:48:49.312307] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:49.590703] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-03T21:48:50.267800] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T21:48:50.269217] [INFO ] [REMOTE ] TBN: Full fetch complete (5564 records). [2025-10-03T21:48:50.269294] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-03T21:48:50.391958] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-03T21:48:50.664432] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T21:48:50.847250] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-03T21:48:50.847340] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-03T21:48:50.847566] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-03T21:48:50.847610] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-03T21:48:50.848266] [DEBUG] [LOCAL ] TBN: Trimmed 5564 records to 3742 (keeping 200 days of data) [2025-10-03T21:48:50.881400] [DEBUG] [LOCAL ] TBN: Primary data saved (3742 records). [2025-10-03T21:48:50.881588] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-03T21:48:50.881741] [INFO ] [MAIN ] Update Progress: 2054/2370 symbols completed. TBN took 33.0s. Estimated remaining: 44m 26s. Rate: 7.1 symbols/min [2025-10-03T21:48:51.112355] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:48:51.140282] [DEBUG] [LOCAL ] TDG: Loaded 22151 existing records from primary storage. [2025-10-03T21:48:51.140589] [INFO ] [MAIN ] TDG: Loaded 22151 existing records. [2025-10-03T21:48:51.195888] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-03T21:48:51.310517] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T21:48:51.390074] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:48:51.390666] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-03T21:48:51.390753] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-03T21:48:51.391125] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-03T21:48:51.391186] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-03T21:48:51.800107] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:48:51.990701] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-03T21:48:52.790671] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-03T21:48:53.008011] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T21:48:53.261563] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T21:48:53.501697] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T21:48:53.590676] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-03T21:48:54.390638] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-03T21:48:54.439404] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T21:48:55.190713] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-03T21:48:55.990676] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-03T21:48:56.280778] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T21:48:56.340861] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T21:48:56.790702] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-03T21:48:57.506108] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T21:48:57.590667] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-03T21:48:57.897400] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T21:48:58.390693] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-03T21:48:59.194555] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-03T21:48:59.196368] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T21:48:59.229299] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T21:48:59.990693] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-03T21:49:00.397132] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T21:49:00.790693] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-03T21:49:01.590491] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T21:49:01.592857] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-03T21:49:01.736822] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:49:02.390744] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-03T21:49:03.190633] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-03T21:49:03.453432] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T21:49:03.990626] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-03T21:49:04.163771] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T21:49:04.528922] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T21:49:04.790677] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-03T21:49:04.847040] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T21:49:05.590683] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-03T21:49:06.390740] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-03T21:49:06.541757] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:49:06.758718] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T21:49:07.012793] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T21:49:07.190707] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-03T21:49:07.940834] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T21:49:07.990718] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-03T21:49:08.790738] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-03T21:49:09.043853] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T21:49:09.590737] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-03T21:49:10.261277] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T21:49:10.390717] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-03T21:49:10.545634] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:49:11.190692] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-03T21:49:11.990675] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-03T21:49:12.214894] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T21:49:12.257866] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T21:49:12.790687] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-03T21:49:13.548992] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T21:49:13.590683] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-03T21:49:14.099946] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T21:49:14.390704] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-03T21:49:15.190738] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-03T21:49:15.251687] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:49:15.770218] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T21:49:15.990737] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-03T21:49:16.514299] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T21:49:16.790797] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-03T21:49:17.531969] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T21:49:17.590720] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-03T21:49:17.828198] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:49:18.390699] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-03T21:49:19.170870] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T21:49:19.190617] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-03T21:49:19.777260] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T21:49:19.781974] [INFO ] [REMOTE ] TD: Full fetch complete (75800 records). [2025-10-03T21:49:19.782185] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-03T21:49:19.996865] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-03T21:49:20.232469] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-03T21:49:20.232562] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-03T21:49:20.233854] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-03T21:49:20.233930] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-03T21:49:20.235893] [DEBUG] [LOCAL ] TD: Trimmed 75800 records to 53053 (keeping 200 days of data) [2025-10-03T21:49:20.474061] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T21:49:20.476832] [INFO ] [REMOTE ] TDG: Full fetch complete (32045 records). [2025-10-03T21:49:20.476948] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-03T21:49:20.798049] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-03T21:49:20.914898] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-03T21:49:20.915430] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-03T21:49:20.917013] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-03T21:49:20.917792] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-03T21:49:20.925525] [DEBUG] [LOCAL ] TDG: Trimmed 32045 records to 22334 (keeping 200 days of data) [2025-10-03T21:49:21.168380] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T21:49:21.188132] [DEBUG] [LOCAL ] TD: Primary data saved (53053 records). [2025-10-03T21:49:21.188515] [INFO ] [MAIN ] TD: Full history saved. [2025-10-03T21:49:21.188924] [INFO ] [MAIN ] Update Progress: 2055/2370 symbols completed. TD took 41.0s. Estimated remaining: 44m 21s. Rate: 7.1 symbols/min [2025-10-03T21:49:21.403431] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:21.432535] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T21:49:21.436232] [INFO ] [REMOTE ] TDF: Full fetch complete (10452 records). [2025-10-03T21:49:21.437106] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-03T21:49:21.542559] [DEBUG] [LOCAL ] TDG: Primary data saved (22334 records). [2025-10-03T21:49:21.593724] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-03T21:49:21.586210] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-03T21:49:21.607580] [INFO ] [MAIN ] Update Progress: 2056/2370 symbols completed. TDG took 30.7s. Estimated remaining: 44m 11s. Rate: 7.1 symbols/min [2025-10-03T21:49:21.771251] [DEBUG] [LOCAL ] TDOC: Loaded 53735 existing records from primary storage. [2025-10-03T21:49:21.868679] [INFO ] [MAIN ] TDOC: Loaded 53735 existing records. [2025-10-03T21:49:22.111582] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:22.244110] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-03T21:49:22.266234] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-03T21:49:22.267018] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-03T21:49:22.267128] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-03T21:49:22.311283] [DEBUG] [LOCAL ] TDF: Trimmed 10452 records to 6491 (keeping 200 days of data) [2025-10-03T21:49:22.357564] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:22.358970] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-03T21:49:22.359507] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-03T21:49:22.376116] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-03T21:49:22.376294] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-03T21:49:22.440963] [DEBUG] [LOCAL ] TDF: Primary data saved (6491 records). [2025-10-03T21:49:22.489723] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-03T21:49:22.503069] [INFO ] [MAIN ] Update Progress: 2057/2370 symbols completed. TDF took 34.0s. Estimated remaining: 44m 1s. Rate: 7.1 symbols/min [2025-10-03T21:49:22.726973] [DEBUG] [LOCAL ] TDS: Loaded 43121 existing records from primary storage. [2025-10-03T21:49:22.778326] [INFO ] [MAIN ] TDS: Loaded 43121 existing records. [2025-10-03T21:49:23.097624] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:23.078904] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T21:49:23.125087] [INFO ] [REMOTE ] TDC: Full fetch complete (67051 records). [2025-10-03T21:49:23.160951] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-03T21:49:23.248463] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:23.280054] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-03T21:49:23.405105] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:23.409972] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-03T21:49:23.410279] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-03T21:49:23.410781] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-03T21:49:23.416309] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-03T21:49:23.652618] [DEBUG] [LOCAL ] TDW: Loaded 45600 existing records from primary storage. [2025-10-03T21:49:23.748811] [INFO ] [MAIN ] TDW: Loaded 45600 existing records. [2025-10-03T21:49:24.365232] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:24.371185] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-03T21:49:24.375633] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-03T21:49:24.383967] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-03T21:49:24.411661] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:24.407878] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-03T21:49:24.412157] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-03T21:49:24.412256] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-03T21:49:24.412323] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-03T21:49:24.412767] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-03T21:49:24.413031] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-03T21:49:24.490123] [DEBUG] [LOCAL ] TDC: Trimmed 67051 records to 47312 (keeping 200 days of data) [2025-10-03T21:49:24.921154] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:24.922868] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-03T21:49:25.103836] [DEBUG] [LOCAL ] TDC: Primary data saved (47312 records). [2025-10-03T21:49:25.104025] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-03T21:49:25.104164] [INFO ] [MAIN ] Update Progress: 2058/2370 symbols completed. TDC took 39.5s. Estimated remaining: 43m 52s. Rate: 7.1 symbols/min [2025-10-03T21:49:25.292471] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:25.316678] [DEBUG] [LOCAL ] TDY: Loaded 22700 existing records from primary storage. [2025-10-03T21:49:25.316993] [INFO ] [MAIN ] TDY: Loaded 22700 existing records. [2025-10-03T21:49:25.556633] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:25.557229] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-03T21:49:25.557379] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-03T21:49:25.558180] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-03T21:49:25.558244] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-03T21:49:25.716005] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-03T21:49:25.739117] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-03T21:49:26.040036] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:26.041114] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-03T21:49:26.068236] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:49:26.200216] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:49:26.390759] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-03T21:49:27.190705] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-03T21:49:27.256408] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T21:49:27.472850] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T21:49:27.874148] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T21:49:27.990712] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-03T21:49:28.790706] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-03T21:49:28.885038] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T21:49:29.076324] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T21:49:29.590717] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-03T21:49:30.390754] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-03T21:49:30.724549] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T21:49:30.914489] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T21:49:31.190747] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-03T21:49:31.990721] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-03T21:49:32.378990] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T21:49:32.790669] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-03T21:49:33.371187] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T21:49:33.590711] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-03T21:49:33.747997] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T21:49:34.376130] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T21:49:34.390603] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-03T21:49:35.190716] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-03T21:49:35.613070] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T21:49:35.990672] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-03T21:49:36.075702] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T21:49:36.790703] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-03T21:49:37.059905] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T21:49:37.590694] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-03T21:49:37.905257] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T21:49:38.003813] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T21:49:38.390718] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-03T21:49:38.662331] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T21:49:39.190729] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-03T21:49:39.990720] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-03T21:49:40.354556] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T21:49:40.454220] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T21:49:40.790713] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-03T21:49:41.592705] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-03T21:49:41.595690] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T21:49:42.390779] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-03T21:49:42.530767] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:49:43.190742] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-03T21:49:43.671205] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T21:49:43.759307] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-03T21:49:43.990686] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-03T21:49:44.743103] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T21:49:44.790691] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-03T21:49:45.276409] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T21:49:45.590697] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-03T21:49:46.390628] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-03T21:49:46.900623] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T21:49:47.171561] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T21:49:47.190604] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-03T21:49:47.508782] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T21:49:47.990700] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-03T21:49:48.780693] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T21:49:48.790713] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-03T21:49:49.590731] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-03T21:49:49.957264] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T21:49:50.390711] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-03T21:49:50.465474] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T21:49:50.767230] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T21:49:51.190734] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-03T21:49:51.858027] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T21:49:51.860762] [INFO ] [REMOTE ] TDOC: Full fetch complete (77290 records). [2025-10-03T21:49:51.861044] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-03T21:49:51.995849] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-03T21:49:52.301265] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-03T21:49:52.301426] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-03T21:49:52.302747] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-03T21:49:52.302815] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-03T21:49:52.304445] [DEBUG] [LOCAL ] TDOC: Trimmed 77290 records to 54125 (keeping 200 days of data) [2025-10-03T21:49:52.634734] [DEBUG] [LOCAL ] TDOC: Primary data saved (54125 records). [2025-10-03T21:49:52.634892] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-03T21:49:52.634993] [INFO ] [MAIN ] Update Progress: 2059/2370 symbols completed. TDOC took 31.4s. Estimated remaining: 43m 46s. Rate: 7.1 symbols/min [2025-10-03T21:49:52.798904] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-03T21:49:52.829786] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:52.830967] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-03T21:49:52.831981] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-03T21:49:52.832281] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-03T21:49:52.832332] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-03T21:49:52.847173] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-03T21:49:52.847382] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-03T21:49:52.937246] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T21:49:53.249744] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:53.448916] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T21:49:53.590742] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-03T21:49:53.803015] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:49:53.803354] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-03T21:49:53.803451] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:49:53.803506] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-03T21:49:53.803542] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:49:53.803583] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-03T21:49:53.803666] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-03T21:49:53.803732] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-03T21:49:53.803807] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-03T21:49:53.803894] [INFO ] [MAIN ] Update Progress: 2060/2370 symbols completed. TE took 1.2s. Estimated remaining: 43m 37s. Rate: 7.1 symbols/min [2025-10-03T21:49:53.988706] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:54.005751] [DEBUG] [LOCAL ] TEAF: Loaded 7674 existing records from primary storage. [2025-10-03T21:49:54.006300] [INFO ] [MAIN ] TEAF: Loaded 7674 existing records. [2025-10-03T21:49:54.201618] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:54.201899] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-03T21:49:54.201991] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-03T21:49:54.202211] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-03T21:49:54.202270] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-03T21:49:54.396884] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-03T21:49:54.648152] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:54.650020] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T21:49:55.190693] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-03T21:49:55.443397] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T21:49:55.445790] [INFO ] [REMOTE ] TDW: Full fetch complete (67104 records). [2025-10-03T21:49:55.445928] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-03T21:49:55.878818] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T21:49:55.881466] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-03T21:49:55.881596] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-03T21:49:55.882871] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-03T21:49:55.882939] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-03T21:49:55.884361] [DEBUG] [LOCAL ] TDW: Trimmed 67104 records to 45933 (keeping 200 days of data) [2025-10-03T21:49:55.990828] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-03T21:49:56.173744] [DEBUG] [LOCAL ] TDW: Primary data saved (45933 records). [2025-10-03T21:49:56.173932] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-03T21:49:56.174112] [INFO ] [MAIN ] Update Progress: 2061/2370 symbols completed. TDW took 33.6s. Estimated remaining: 43m 27s. Rate: 7.1 symbols/min [2025-10-03T21:49:56.357292] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:56.412625] [DEBUG] [LOCAL ] TECK: Loaded 53822 existing records from primary storage. [2025-10-03T21:49:56.413006] [INFO ] [MAIN ] TECK: Loaded 53822 existing records. [2025-10-03T21:49:56.603089] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:49:56.608515] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-03T21:49:56.609266] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-03T21:49:56.609516] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T21:49:56.611162] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-03T21:49:56.611457] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-03T21:49:56.794830] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-03T21:49:57.000798] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:49:57.487666] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T21:49:57.590705] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-03T21:49:58.390714] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-03T21:49:58.804826] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:49:58.807151] [INFO ] [REMOTE ] TDS: Full fetch complete (61744 records). [2025-10-03T21:49:58.807283] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-03T21:49:59.197331] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-03T21:49:59.220507] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-03T21:49:59.220735] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-03T21:49:59.222293] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-03T21:49:59.227824] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-03T21:49:59.235856] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T21:49:59.241589] [DEBUG] [LOCAL ] TDS: Trimmed 61744 records to 43412 (keeping 200 days of data) [2025-10-03T21:49:59.529718] [DEBUG] [LOCAL ] TDS: Primary data saved (43412 records). [2025-10-03T21:49:59.529951] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-03T21:49:59.530078] [INFO ] [MAIN ] Update Progress: 2062/2370 symbols completed. TDS took 37.9s. Estimated remaining: 43m 18s. Rate: 7.1 symbols/min [2025-10-03T21:49:59.720516] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:49:59.770893] [DEBUG] [LOCAL ] TEF: Loaded 37607 existing records from primary storage. [2025-10-03T21:49:59.771220] [INFO ] [MAIN ] TEF: Loaded 37607 existing records. [2025-10-03T21:49:59.964674] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T21:49:59.996347] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-03T21:49:59.999596] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:00.000868] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-03T21:50:00.000922] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-03T21:50:00.001151] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-03T21:50:00.001211] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-03T21:50:00.383940] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:00.790694] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-03T21:50:01.590722] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-03T21:50:01.934393] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T21:50:02.251862] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T21:50:02.390670] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-03T21:50:02.427217] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T21:50:03.190708] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-03T21:50:03.990722] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-03T21:50:04.626072] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T21:50:04.684724] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-03T21:50:04.697838] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T21:50:04.790699] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-03T21:50:05.590725] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-03T21:50:05.860247] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T21:50:06.390693] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-03T21:50:07.039790] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T21:50:07.190712] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-03T21:50:07.474878] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-03T21:50:07.476151] [INFO ] [REMOTE ] TDY: Full fetch complete (32096 records). [2025-10-03T21:50:07.476307] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-03T21:50:07.909731] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-03T21:50:07.909974] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-03T21:50:07.910862] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-03T21:50:07.910928] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-03T21:50:07.911905] [DEBUG] [LOCAL ] TDY: Trimmed 32096 records to 22797 (keeping 200 days of data) [2025-10-03T21:50:08.000881] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-03T21:50:08.060309] [DEBUG] [LOCAL ] TDY: Primary data saved (22797 records). [2025-10-03T21:50:08.060542] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-03T21:50:08.060709] [INFO ] [MAIN ] Update Progress: 2063/2370 symbols completed. TDY took 43.0s. Estimated remaining: 43m 10s. Rate: 7.1 symbols/min [2025-10-03T21:50:08.227768] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T21:50:08.288015] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:50:08.309807] [DEBUG] [LOCAL ] TEI: Loaded 21330 existing records from primary storage. [2025-10-03T21:50:08.310125] [INFO ] [MAIN ] TEI: Loaded 21330 existing records. [2025-10-03T21:50:08.493992] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:08.495338] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-03T21:50:08.495596] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-03T21:50:08.496168] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-03T21:50:08.496373] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-03T21:50:08.586895] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T21:50:08.795827] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-03T21:50:08.905770] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:09.590697] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-03T21:50:10.390688] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-03T21:50:10.804006] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T21:50:11.049218] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T21:50:11.182571] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T21:50:11.192686] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-03T21:50:11.975763] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:50:11.990617] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-03T21:50:12.769004] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T21:50:12.790700] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-03T21:50:13.590720] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-03T21:50:14.036041] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T21:50:14.308346] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T21:50:14.390693] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-03T21:50:15.190719] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-03T21:50:15.966172] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:50:15.990680] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-03T21:50:16.265195] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T21:50:16.790705] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-03T21:50:17.428513] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T21:50:17.590762] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-03T21:50:18.390757] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-03T21:50:18.759510] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T21:50:18.775864] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T21:50:18.849110] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:50:18.850881] [INFO ] [REMOTE ] TEAF: Full fetch complete (10084 records). [2025-10-03T21:50:18.851020] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-03T21:50:19.197223] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-03T21:50:19.234877] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-03T21:50:19.234977] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-03T21:50:19.235278] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-03T21:50:19.235375] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-03T21:50:19.235957] [DEBUG] [LOCAL ] TEAF: Trimmed 10084 records to 7714 (keeping 200 days of data) [2025-10-03T21:50:19.288955] [DEBUG] [LOCAL ] TEAF: Primary data saved (7714 records). [2025-10-03T21:50:19.289131] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-03T21:50:19.289888] [INFO ] [MAIN ] Update Progress: 2064/2370 symbols completed. TEAF took 25.5s. Estimated remaining: 43m 2s. Rate: 7.1 symbols/min [2025-10-03T21:50:19.470216] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:50:19.523214] [DEBUG] [LOCAL ] TEL: Loaded 51470 existing records from primary storage. [2025-10-03T21:50:19.523698] [INFO ] [MAIN ] TEL: Loaded 51470 existing records. [2025-10-03T21:50:19.717351] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:19.717698] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-03T21:50:19.717791] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-03T21:50:19.718120] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-03T21:50:19.718191] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-03T21:50:20.000828] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-03T21:50:20.094055] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:20.734832] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T21:50:20.790699] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-03T21:50:21.061686] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T21:50:21.590738] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-03T21:50:22.390736] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-03T21:50:22.469219] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T21:50:23.026290] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T21:50:23.190714] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-03T21:50:23.210393] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T21:50:23.990754] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-03T21:50:24.790727] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-03T21:50:24.944375] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:50:25.031378] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T21:50:25.590726] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-03T21:50:26.273242] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T21:50:26.390702] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-03T21:50:27.190724] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-03T21:50:27.415855] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T21:50:27.555251] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:50:27.990729] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-03T21:50:28.302919] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T21:50:28.305132] [INFO ] [REMOTE ] TEF: Full fetch complete (54829 records). [2025-10-03T21:50:28.305223] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-03T21:50:28.742821] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-03T21:50:28.742920] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-03T21:50:28.744024] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-03T21:50:28.744091] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-03T21:50:28.745529] [DEBUG] [LOCAL ] TEF: Trimmed 54829 records to 37912 (keeping 200 days of data) [2025-10-03T21:50:28.793025] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-03T21:50:28.974101] [DEBUG] [LOCAL ] TEF: Primary data saved (37912 records). [2025-10-03T21:50:28.974271] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-03T21:50:28.975134] [INFO ] [MAIN ] Update Progress: 2065/2370 symbols completed. TEF took 29.4s. Estimated remaining: 42m 54s. Rate: 7.1 symbols/min [2025-10-03T21:50:29.156300] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:50:29.200326] [DEBUG] [LOCAL ] TEN: Loaded 30835 existing records from primary storage. [2025-10-03T21:50:29.200618] [INFO ] [MAIN ] TEN: Loaded 30835 existing records. [2025-10-03T21:50:29.398971] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:29.399242] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-03T21:50:29.399300] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-03T21:50:29.400065] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-03T21:50:29.400127] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-03T21:50:29.595933] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-03T21:50:29.797326] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:29.963238] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T21:50:30.036517] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T21:50:30.390724] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-03T21:50:31.190700] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-03T21:50:31.456230] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T21:50:31.756932] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T21:50:31.990676] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-03T21:50:32.304962] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T21:50:32.790725] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-03T21:50:33.590715] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-03T21:50:33.807453] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T21:50:34.113812] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T21:50:34.390776] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-03T21:50:35.196020] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-03T21:50:35.229905] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T21:50:35.511446] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T21:50:35.990750] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-03T21:50:36.227720] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T21:50:36.790765] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-03T21:50:36.989401] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T21:50:36.991162] [INFO ] [REMOTE ] TEI: Full fetch complete (30600 records). [2025-10-03T21:50:36.991280] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-03T21:50:37.399493] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-03T21:50:37.399630] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-03T21:50:37.400469] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-03T21:50:37.400518] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-03T21:50:37.401448] [DEBUG] [LOCAL ] TEI: Trimmed 30600 records to 21500 (keeping 200 days of data) [2025-10-03T21:50:37.530762] [DEBUG] [LOCAL ] TEI: Primary data saved (21500 records). [2025-10-03T21:50:37.530916] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-03T21:50:37.531030] [INFO ] [MAIN ] Update Progress: 2066/2370 symbols completed. TEI took 29.5s. Estimated remaining: 42m 45s. Rate: 7.1 symbols/min [2025-10-03T21:50:37.598806] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-03T21:50:37.716574] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:50:37.744939] [DEBUG] [LOCAL ] TEO: Loaded 22243 existing records from primary storage. [2025-10-03T21:50:37.745218] [INFO ] [MAIN ] TEO: Loaded 22243 existing records. [2025-10-03T21:50:37.949980] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:37.950246] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-03T21:50:37.950304] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-03T21:50:37.950742] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-03T21:50:37.950802] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-03T21:50:38.339170] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:38.390719] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-03T21:50:38.746879] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T21:50:39.062060] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T21:50:39.190767] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-03T21:50:39.530543] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T21:50:39.990731] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-03T21:50:40.795859] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-03T21:50:40.812870] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T21:50:41.386831] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T21:50:41.590756] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-03T21:50:42.280929] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T21:50:42.283860] [INFO ] [REMOTE ] TECK: Full fetch complete (77310 records). [2025-10-03T21:50:42.284012] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-03T21:50:42.392555] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-03T21:50:42.725493] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-03T21:50:42.725600] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-03T21:50:42.726967] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-03T21:50:42.727063] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-03T21:50:42.728961] [DEBUG] [LOCAL ] TECK: Trimmed 77310 records to 54210 (keeping 200 days of data) [2025-10-03T21:50:43.094539] [DEBUG] [LOCAL ] TECK: Primary data saved (54210 records). [2025-10-03T21:50:43.094753] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-03T21:50:43.094860] [INFO ] [MAIN ] Update Progress: 2067/2370 symbols completed. TECK took 46.9s. Estimated remaining: 42m 36s. Rate: 7.1 symbols/min [2025-10-03T21:50:43.192843] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-03T21:50:43.286769] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:50:43.343715] [DEBUG] [LOCAL ] TEVA: Loaded 54022 existing records from primary storage. [2025-10-03T21:50:43.344278] [INFO ] [MAIN ] TEVA: Loaded 54022 existing records. [2025-10-03T21:50:43.558185] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:50:43.559096] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-03T21:50:43.559441] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-03T21:50:43.559999] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-03T21:50:43.560069] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-03T21:50:43.795827] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T21:50:43.913620] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-03T21:50:43.995854] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-03T21:50:44.078547] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:50:44.169972] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T21:50:44.790719] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-03T21:50:45.523820] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:50:45.590700] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-03T21:50:46.390692] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-03T21:50:46.701515] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T21:50:46.758376] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T21:50:47.190718] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-03T21:50:47.990714] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-03T21:50:48.123873] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T21:50:48.470838] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T21:50:48.790729] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-03T21:50:49.590682] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-03T21:50:49.932225] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T21:50:50.127920] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T21:50:50.390693] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-03T21:50:50.671347] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T21:50:51.190698] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-03T21:50:51.990632] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-03T21:50:52.312347] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T21:50:52.790721] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-03T21:50:53.035989] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T21:50:53.157212] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T21:50:53.590703] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-03T21:50:54.390635] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-03T21:50:54.618289] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T21:50:54.694862] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T21:50:55.190713] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-03T21:50:55.782926] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T21:50:55.990708] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-03T21:50:56.328526] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T21:50:56.790702] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-03T21:50:57.590674] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-03T21:50:57.830007] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T21:50:58.043562] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T21:50:58.390721] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-03T21:50:59.190768] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-03T21:50:59.539626] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T21:50:59.990710] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-03T21:51:00.187129] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T21:51:00.188827] [INFO ] [REMOTE ] TEN: Full fetch complete (44140 records). [2025-10-03T21:51:00.188932] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-03T21:51:00.427354] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T21:51:00.668196] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-03T21:51:00.668285] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-03T21:51:00.669234] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-03T21:51:00.669300] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-03T21:51:00.670520] [DEBUG] [LOCAL ] TEN: Trimmed 44140 records to 31002 (keeping 200 days of data) [2025-10-03T21:51:00.768710] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T21:51:00.772906] [INFO ] [REMOTE ] TEL: Full fetch complete (73446 records). [2025-10-03T21:51:00.773908] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-03T21:51:00.798625] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-03T21:51:01.293495] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-03T21:51:01.308911] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-03T21:51:01.311149] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-03T21:51:01.311237] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-03T21:51:01.319532] [DEBUG] [LOCAL ] TEL: Trimmed 73446 records to 51844 (keeping 200 days of data) [2025-10-03T21:51:01.334563] [DEBUG] [LOCAL ] TEN: Primary data saved (31002 records). [2025-10-03T21:51:01.334791] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-03T21:51:01.334948] [INFO ] [MAIN ] Update Progress: 2068/2370 symbols completed. TEN took 32.4s. Estimated remaining: 42m 29s. Rate: 7.1 symbols/min [2025-10-03T21:51:01.595788] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-03T21:51:01.663546] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:01.844377] [DEBUG] [LOCAL ] TEX: Loaded 44483 existing records from primary storage. [2025-10-03T21:51:01.844785] [INFO ] [MAIN ] TEX: Loaded 44483 existing records. [2025-10-03T21:51:02.051249] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:02.052296] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-03T21:51:02.052803] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-03T21:51:02.053354] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-03T21:51:02.053439] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-03T21:51:02.478980] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:02.482845] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-03T21:51:02.562408] [DEBUG] [LOCAL ] TEL: Primary data saved (51844 records). [2025-10-03T21:51:02.562574] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-03T21:51:02.562717] [INFO ] [MAIN ] Update Progress: 2069/2370 symbols completed. TEL took 43.3s. Estimated remaining: 42m 20s. Rate: 7.1 symbols/min [2025-10-03T21:51:02.750313] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:02.796049] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T21:51:02.820552] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-03T21:51:02.821016] [INFO ] [MAIN ] TFC: Loaded 54057 existing records. [2025-10-03T21:51:03.031066] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:03.031345] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-03T21:51:03.031425] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-03T21:51:03.042763] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-03T21:51:03.042862] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-03T21:51:03.178317] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-03T21:51:03.200977] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-03T21:51:03.473703] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:03.990722] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-03T21:51:04.226082] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T21:51:04.286006] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T21:51:04.790761] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-03T21:51:05.590683] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-03T21:51:05.764541] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T21:51:06.062895] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:51:06.390711] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-03T21:51:07.196162] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T21:51:07.195387] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-03T21:51:07.216035] [INFO ] [REMOTE ] TEO: Full fetch complete (32655 records). [2025-10-03T21:51:07.231504] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-03T21:51:07.283360] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T21:51:07.674387] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-03T21:51:07.674486] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-03T21:51:07.675296] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-03T21:51:07.675367] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-03T21:51:07.676585] [DEBUG] [LOCAL ] TEO: Trimmed 32655 records to 22391 (keeping 200 days of data) [2025-10-03T21:51:07.807246] [DEBUG] [LOCAL ] TEO: Primary data saved (22391 records). [2025-10-03T21:51:07.807400] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-03T21:51:07.807512] [INFO ] [MAIN ] Update Progress: 2070/2370 symbols completed. TEO took 30.3s. Estimated remaining: 42m 11s. Rate: 7.1 symbols/min [2025-10-03T21:51:07.990828] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:07.990975] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-03T21:51:08.031894] [DEBUG] [LOCAL ] TFII: Loaded 33919 existing records from primary storage. [2025-10-03T21:51:08.032257] [INFO ] [MAIN ] TFII: Loaded 33919 existing records. [2025-10-03T21:51:08.226043] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:08.226276] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-03T21:51:08.226327] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-03T21:51:08.226805] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-03T21:51:08.226868] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-03T21:51:08.608447] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:08.790748] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-03T21:51:09.184868] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T21:51:09.590738] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-03T21:51:10.128965] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T21:51:10.138987] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T21:51:10.390747] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-03T21:51:11.190722] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-03T21:51:11.218940] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:51:11.990673] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-03T21:51:12.173547] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:51:12.790737] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-03T21:51:13.297354] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T21:51:13.590751] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-03T21:51:13.737152] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T21:51:14.390685] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-03T21:51:14.472960] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T21:51:15.190759] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-03T21:51:15.868091] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T21:51:15.954579] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T21:51:15.990618] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-03T21:51:16.790780] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-03T21:51:17.052204] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T21:51:17.590708] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-03T21:51:17.622166] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T21:51:18.235280] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T21:51:18.238310] [INFO ] [REMOTE ] TEVA: Full fetch complete (77704 records). [2025-10-03T21:51:18.238442] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-03T21:51:18.397411] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-03T21:51:18.651958] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-03T21:51:18.652147] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-03T21:51:18.654291] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-03T21:51:18.654470] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-03T21:51:18.656750] [DEBUG] [LOCAL ] TEVA: Trimmed 77704 records to 54412 (keeping 200 days of data) [2025-10-03T21:51:19.017255] [DEBUG] [LOCAL ] TEVA: Primary data saved (54412 records). [2025-10-03T21:51:19.017457] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-03T21:51:19.017564] [INFO ] [MAIN ] Update Progress: 2071/2370 symbols completed. TEVA took 35.9s. Estimated remaining: 42m 3s. Rate: 7.1 symbols/min [2025-10-03T21:51:19.193293] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-03T21:51:19.193145] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:19.223362] [DEBUG] [LOCAL ] TFIN: Loaded 23641 existing records from primary storage. [2025-10-03T21:51:19.223752] [INFO ] [MAIN ] TFIN: Loaded 23641 existing records. [2025-10-03T21:51:19.412109] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:19.412572] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-03T21:51:19.412631] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-03T21:51:19.412977] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-03T21:51:19.413038] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-03T21:51:19.851304] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:19.854966] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-03T21:51:19.901978] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T21:51:19.990675] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-03T21:51:20.088350] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T21:51:20.790744] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-03T21:51:21.590784] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-03T21:51:21.621528] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:51:22.390678] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-03T21:51:22.703859] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T21:51:23.063740] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T21:51:23.190705] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-03T21:51:24.003952] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-03T21:51:24.023957] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T21:51:24.790713] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-03T21:51:25.131526] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T21:51:25.590673] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-03T21:51:25.640596] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T21:51:25.729277] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:51:26.390712] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-03T21:51:27.013719] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T21:51:27.190767] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-03T21:51:27.990771] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-03T21:51:28.449129] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T21:51:28.790718] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-03T21:51:28.839409] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T21:51:28.879031] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T21:51:29.590750] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-03T21:51:30.390708] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-03T21:51:30.558608] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T21:51:30.652459] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:51:31.190732] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-03T21:51:31.556960] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T21:51:31.563088] [INFO ] [REMOTE ] TEX: Full fetch complete (64636 records). [2025-10-03T21:51:31.563271] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-03T21:51:31.965543] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-03T21:51:31.965753] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-03T21:51:31.967872] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-03T21:51:31.967955] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-03T21:51:31.969864] [DEBUG] [LOCAL ] TEX: Trimmed 64636 records to 44788 (keeping 200 days of data) [2025-10-03T21:51:32.030197] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-03T21:51:32.263698] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T21:51:32.298100] [DEBUG] [LOCAL ] TEX: Primary data saved (44788 records). [2025-10-03T21:51:32.298224] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-03T21:51:32.299474] [INFO ] [MAIN ] Update Progress: 2072/2370 symbols completed. TEX took 31.0s. Estimated remaining: 41m 55s. Rate: 7.1 symbols/min [2025-10-03T21:51:32.476102] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:32.525370] [DEBUG] [LOCAL ] TFPM: Loaded 38300 existing records from primary storage. [2025-10-03T21:51:32.525802] [INFO ] [MAIN ] TFPM: Loaded 38300 existing records. [2025-10-03T21:51:32.715000] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:32.715383] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-03T21:51:32.715449] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-03T21:51:32.715938] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-03T21:51:32.716000] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-03T21:51:32.795955] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-03T21:51:33.099394] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:33.590770] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-03T21:51:33.992408] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T21:51:34.170603] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T21:51:34.390727] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-03T21:51:34.838133] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T21:51:34.846033] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-10-03T21:51:34.846248] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-03T21:51:34.998445] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T21:51:35.195785] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-03T21:51:35.324370] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-03T21:51:35.324505] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-03T21:51:35.326106] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-03T21:51:35.326177] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-03T21:51:35.328253] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 54447 (keeping 200 days of data) [2025-10-03T21:51:35.682030] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-10-03T21:51:35.682195] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-03T21:51:35.682334] [INFO ] [MAIN ] Update Progress: 2073/2370 symbols completed. TFC took 33.1s. Estimated remaining: 41m 46s. Rate: 7.1 symbols/min [2025-10-03T21:51:35.866609] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:35.908584] [DEBUG] [LOCAL ] TFX: Loaded 37363 existing records from primary storage. [2025-10-03T21:51:35.908927] [INFO ] [MAIN ] TFX: Loaded 37363 existing records. [2025-10-03T21:51:35.995947] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-03T21:51:36.113341] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:36.113893] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-03T21:51:36.113971] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-03T21:51:36.114277] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-03T21:51:36.114346] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-03T21:51:36.521784] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T21:51:36.526712] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:36.790734] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-03T21:51:37.305412] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T21:51:37.590677] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-03T21:51:37.720291] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T21:51:38.390722] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-03T21:51:38.775326] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T21:51:39.190720] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-03T21:51:39.560355] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T21:51:39.990714] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-03T21:51:40.467843] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T21:51:40.790732] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-03T21:51:41.277320] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T21:51:41.590690] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-03T21:51:42.019681] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T21:51:42.390709] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-03T21:51:42.588427] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T21:51:43.190765] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-03T21:51:43.799075] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T21:51:43.990694] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-03T21:51:44.299377] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T21:51:44.790742] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-03T21:51:45.503029] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T21:51:45.590709] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-03T21:51:46.037917] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T21:51:46.390638] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-03T21:51:46.562970] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T21:51:46.568858] [INFO ] [REMOTE ] TFII: Full fetch complete (47876 records). [2025-10-03T21:51:46.569037] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-03T21:51:46.961425] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-03T21:51:46.961545] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-03T21:51:46.962771] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-03T21:51:46.962843] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-03T21:51:46.964395] [DEBUG] [LOCAL ] TFII: Trimmed 47876 records to 34124 (keeping 200 days of data) [2025-10-03T21:51:47.190762] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-03T21:51:47.219334] [DEBUG] [LOCAL ] TFII: Primary data saved (34124 records). [2025-10-03T21:51:47.219560] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-03T21:51:47.219726] [INFO ] [MAIN ] Update Progress: 2074/2370 symbols completed. TFII took 39.4s. Estimated remaining: 41m 38s. Rate: 7.1 symbols/min [2025-10-03T21:51:47.406371] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:47.436901] [DEBUG] [LOCAL ] TG: Loaded 10488 existing records from primary storage. [2025-10-03T21:51:47.437259] [INFO ] [MAIN ] TG: Loaded 10488 existing records. [2025-10-03T21:51:47.484431] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T21:51:47.629686] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:47.629968] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-03T21:51:47.630021] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-03T21:51:47.630263] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-03T21:51:47.630323] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-03T21:51:47.994146] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-03T21:51:47.998442] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:48.744061] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T21:51:48.790713] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-03T21:51:49.493748] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T21:51:49.590701] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-03T21:51:50.337107] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T21:51:50.390724] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-03T21:51:50.814662] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T21:51:51.190723] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-03T21:51:51.922623] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T21:51:51.990669] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-03T21:51:52.070994] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T21:51:52.790715] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-03T21:51:53.544675] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T21:51:53.590682] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-03T21:51:53.891362] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T21:51:54.390754] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-03T21:51:55.195787] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-03T21:51:55.217528] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T21:51:55.476508] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T21:51:55.478300] [INFO ] [REMOTE ] TFIN: Full fetch complete (31382 records). [2025-10-03T21:51:55.478474] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-03T21:51:55.910583] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-03T21:51:55.910853] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-03T21:51:55.911793] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-03T21:51:55.911916] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-03T21:51:55.913568] [DEBUG] [LOCAL ] TFIN: Trimmed 31382 records to 23791 (keeping 200 days of data) [2025-10-03T21:51:56.004411] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-03T21:51:56.029202] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T21:51:56.083612] [DEBUG] [LOCAL ] TFIN: Primary data saved (23791 records). [2025-10-03T21:51:56.083793] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-03T21:51:56.083933] [INFO ] [MAIN ] Update Progress: 2075/2370 symbols completed. TFIN took 37.1s. Estimated remaining: 41m 30s. Rate: 7.1 symbols/min [2025-10-03T21:51:56.269343] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:56.269520] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-03T21:51:56.269563] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-03T21:51:56.269748] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-03T21:51:56.269795] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-03T21:51:56.269840] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-03T21:51:56.269881] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-03T21:51:56.648032] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:56.790686] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-03T21:51:57.040348] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:51:57.040864] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-03T21:51:57.040978] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:51:57.041028] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-03T21:51:57.041062] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:51:57.041103] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-03T21:51:57.041166] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-03T21:51:57.041203] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-03T21:51:57.041269] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-03T21:51:57.041346] [INFO ] [MAIN ] Update Progress: 2076/2370 symbols completed. TGE took 1.0s. Estimated remaining: 41m 20s. Rate: 7.1 symbols/min [2025-10-03T21:51:57.212860] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:51:57.242042] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:51:57.244965] [INFO ] [REMOTE ] TFPM: Full fetch complete (51462 records). [2025-10-03T21:51:57.245069] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-03T21:51:57.532986] [DEBUG] [LOCAL ] TGLS: Loaded 28157 existing records from primary storage. [2025-10-03T21:51:57.557964] [INFO ] [MAIN ] TGLS: Loaded 28157 existing records. [2025-10-03T21:51:57.599215] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-03T21:51:57.883149] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-03T21:51:57.882934] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:51:57.883421] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-03T21:51:57.885480] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-03T21:51:57.885574] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-03T21:51:57.885805] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-03T21:51:57.885925] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-03T21:51:57.886303] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-03T21:51:57.886445] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-03T21:51:57.964780] [DEBUG] [LOCAL ] TFPM: Trimmed 51462 records to 38599 (keeping 200 days of data) [2025-10-03T21:51:58.391477] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-03T21:51:58.435170] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:51:58.466214] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T21:51:58.589086] [DEBUG] [LOCAL ] TFPM: Primary data saved (38599 records). [2025-10-03T21:51:58.589272] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-03T21:51:58.590171] [INFO ] [MAIN ] Update Progress: 2077/2370 symbols completed. TFPM took 26.3s. Estimated remaining: 41m 11s. Rate: 7.1 symbols/min [2025-10-03T21:51:59.190722] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-03T21:51:59.990829] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-03T21:52:00.212350] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T21:52:00.368726] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T21:52:00.790725] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-03T21:52:00.806042] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T21:52:01.590761] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-03T21:52:02.390756] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-03T21:52:02.511326] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T21:52:02.555855] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T21:52:03.190753] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-03T21:52:03.618527] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T21:52:03.990729] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-03T21:52:04.042903] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T21:52:04.790842] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-03T21:52:05.505065] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T21:52:05.590747] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-03T21:52:05.608143] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T21:52:06.390709] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-03T21:52:06.937179] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T21:52:07.173502] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:52:07.190696] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-03T21:52:07.990673] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-03T21:52:08.098364] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T21:52:08.790763] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-03T21:52:09.199619] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T21:52:09.590715] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-03T21:52:09.951286] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T21:52:10.390758] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-03T21:52:10.434168] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T21:52:11.190715] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-03T21:52:11.672763] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T21:52:11.801526] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T21:52:11.802729] [INFO ] [REMOTE ] TG: Full fetch complete (15047 records). [2025-10-03T21:52:11.802805] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-03T21:52:12.004108] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-03T21:52:12.214096] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-03T21:52:12.214250] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-03T21:52:12.215046] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-03T21:52:12.215118] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-03T21:52:12.215813] [DEBUG] [LOCAL ] TG: Trimmed 15047 records to 10546 (keeping 200 days of data) [2025-10-03T21:52:12.283997] [DEBUG] [LOCAL ] TG: Primary data saved (10546 records). [2025-10-03T21:52:12.284192] [INFO ] [MAIN ] TG: Full history saved. [2025-10-03T21:52:12.284322] [INFO ] [MAIN ] Update Progress: 2078/2370 symbols completed. TG took 25.1s. Estimated remaining: 41m 3s. Rate: 7.1 symbols/min [2025-10-03T21:52:12.790778] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-03T21:52:13.663539] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T21:52:13.674159] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-03T21:52:14.179179] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T21:52:14.390765] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-03T21:52:14.832836] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T21:52:14.836313] [INFO ] [REMOTE ] TFX: Full fetch complete (54622 records). [2025-10-03T21:52:14.836493] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-03T21:52:15.283140] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-03T21:52:15.283281] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-03T21:52:15.285373] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-03T21:52:15.285456] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-03T21:52:15.287854] [DEBUG] [LOCAL ] TFX: Trimmed 54622 records to 37698 (keeping 200 days of data) [2025-10-03T21:52:15.573959] [DEBUG] [LOCAL ] TFX: Primary data saved (37698 records). [2025-10-03T21:52:15.574189] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-03T21:52:15.574324] [INFO ] [MAIN ] Update Progress: 2079/2370 symbols completed. TFX took 39.9s. Estimated remaining: 40m 54s. Rate: 7.1 symbols/min [2025-10-03T21:52:15.917242] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T21:52:15.924503] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-03T21:52:17.292393] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T21:52:17.299957] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-03T21:52:18.456112] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:52:18.462140] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-03T21:52:19.636315] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T21:52:19.642875] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-03T21:52:20.942147] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T21:52:20.950187] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-03T21:52:22.218102] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:52:22.225940] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-03T21:52:23.243321] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T21:52:23.245425] [INFO ] [REMOTE ] TGLS: Full fetch complete (40539 records). [2025-10-03T21:52:23.245569] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-03T21:52:23.630826] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-03T21:52:23.630953] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-03T21:52:23.632336] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-03T21:52:23.632408] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-03T21:52:23.633874] [DEBUG] [LOCAL ] TGLS: Trimmed 40539 records to 28366 (keeping 200 days of data) [2025-10-03T21:52:23.826955] [DEBUG] [LOCAL ] TGLS: Primary data saved (28366 records). [2025-10-03T21:52:23.827162] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-03T21:52:23.827298] [INFO ] [MAIN ] Update Progress: 2080/2370 symbols completed. TGLS took 26.8s. Estimated remaining: 40m 45s. Rate: 7.1 symbols/min [2025-10-03T21:52:24.493971] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:24.579126] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:24.642583] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:24.666027] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:24.716886] [DEBUG] [LOCAL ] TGS: Loaded 33155 existing records from primary storage. [2025-10-03T21:52:24.717522] [INFO ] [MAIN ] TGS: Loaded 33155 existing records. [2025-10-03T21:52:24.869434] [DEBUG] [LOCAL ] THC: Loaded 47953 existing records from primary storage. [2025-10-03T21:52:24.891319] [INFO ] [MAIN ] THC: Loaded 47953 existing records. [2025-10-03T21:52:24.970559] [DEBUG] [LOCAL ] TGNA: Loaded 49036 existing records from primary storage. [2025-10-03T21:52:25.022755] [INFO ] [MAIN ] TGNA: Loaded 49036 existing records. [2025-10-03T21:52:25.146803] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-03T21:52:25.182172] [INFO ] [MAIN ] TGT: Loaded 54168 existing records. [2025-10-03T21:52:25.181770] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:25.308411] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-03T21:52:25.418464] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-03T21:52:25.471744] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-03T21:52:25.471634] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:25.487731] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-03T21:52:25.525274] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-03T21:52:25.582554] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-03T21:52:25.655035] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:25.704522] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-03T21:52:25.704445] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-03T21:52:25.710310] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-03T21:52:25.704778] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-03T21:52:25.749312] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:25.765810] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-03T21:52:25.766032] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-03T21:52:25.776456] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-03T21:52:25.809825] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-03T21:52:25.928099] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-03T21:52:26.005078] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-03T21:52:26.846024] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:26.917101] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-03T21:52:27.183411] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:27.208397] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-03T21:52:27.212322] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:27.212685] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-03T21:52:27.304346] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:27.304765] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-03T21:52:28.318782] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T21:52:28.325604] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-03T21:52:28.923678] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T21:52:28.934110] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-03T21:52:29.008079] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T21:52:29.018916] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-03T21:52:29.126338] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T21:52:29.139034] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-03T21:52:29.723171] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T21:52:29.731892] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-03T21:52:30.618995] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T21:52:30.629833] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-03T21:52:30.697014] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T21:52:30.707238] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-03T21:52:31.051879] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T21:52:31.059397] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-03T21:52:31.184436] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T21:52:31.195746] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-03T21:52:31.933333] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T21:52:31.944842] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-03T21:52:32.291466] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T21:52:32.303553] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-03T21:52:32.438249] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T21:52:32.445610] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-03T21:52:33.211993] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T21:52:33.224738] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-03T21:52:33.400200] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T21:52:33.590744] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-03T21:52:33.706446] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T21:52:34.007249] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T21:52:34.390744] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-03T21:52:35.030312] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T21:52:35.190802] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-03T21:52:35.370378] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T21:52:35.990719] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-03T21:52:36.118602] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T21:52:36.790706] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-03T21:52:37.061745] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T21:52:37.590747] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-03T21:52:38.166115] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T21:52:38.224211] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T21:52:38.390732] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-03T21:52:39.190754] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-03T21:52:39.242278] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T21:52:39.990739] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-03T21:52:40.634770] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-03T21:52:40.725385] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T21:52:40.790636] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-03T21:52:41.590965] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-03T21:52:41.590868] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T21:52:42.390709] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-03T21:52:43.004813] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-03T21:52:43.048715] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T21:52:43.190688] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-03T21:52:43.990628] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-03T21:52:44.033917] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T21:52:44.790739] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-03T21:52:44.951383] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T21:52:45.590767] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-03T21:52:46.155031] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T21:52:46.305476] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-03T21:52:46.390692] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-03T21:52:47.190716] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-03T21:52:47.474038] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T21:52:47.990689] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-03T21:52:48.579139] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-03T21:52:48.713543] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T21:52:48.790755] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-03T21:52:49.590709] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-03T21:52:49.632175] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T21:52:50.390758] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-03T21:52:50.927449] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T21:52:51.141822] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-03T21:52:51.190623] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-03T21:52:51.475438] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T21:52:51.479507] [INFO ] [REMOTE ] TGNA: Full fetch complete (69995 records). [2025-10-03T21:52:51.479748] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-03T21:52:51.671249] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T21:52:51.709571] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-03T21:52:51.767852] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-03T21:52:51.994400] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-03T21:52:52.111936] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-03T21:52:52.113622] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-03T21:52:52.134216] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-03T21:52:52.138377] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-03T21:52:52.245773] [DEBUG] [LOCAL ] TGNA: Trimmed 69995 records to 49393 (keeping 200 days of data) [2025-10-03T21:52:52.471732] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-03T21:52:52.472123] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-03T21:52:52.473847] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-03T21:52:52.475330] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-03T21:52:52.482818] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 54558 (keeping 200 days of data) [2025-10-03T21:52:52.815152] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-03T21:52:52.949959] [DEBUG] [LOCAL ] TGNA: Primary data saved (49393 records). [2025-10-03T21:52:52.951305] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-03T21:52:52.951717] [INFO ] [MAIN ] Update Progress: 2081/2370 symbols completed. TGNA took 29.1s. Estimated remaining: 40m 40s. Rate: 7.1 symbols/min [2025-10-03T21:52:53.156381] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:53.256925] [DEBUG] [LOCAL ] THG: Loaded 21842 existing records from primary storage. [2025-10-03T21:52:53.257623] [INFO ] [MAIN ] THG: Loaded 21842 existing records. [2025-10-03T21:52:53.492699] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:53.493433] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-03T21:52:53.493897] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-03T21:52:53.494794] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-03T21:52:53.495454] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-03T21:52:53.617912] [DEBUG] [LOCAL ] TGT: Primary data saved (54558 records). [2025-10-03T21:52:53.623927] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-03T21:52:53.624131] [INFO ] [MAIN ] Update Progress: 2082/2370 symbols completed. TGT took 29.8s. Estimated remaining: 40m 30s. Rate: 7.1 symbols/min [2025-10-03T21:52:54.070172] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T21:52:54.134593] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:54.140946] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:54.142542] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-03T21:52:54.148788] [DEBUG] [LOCAL ] THIR: Loaded 2221 existing records from primary storage. [2025-10-03T21:52:54.149267] [INFO ] [MAIN ] THIR: Loaded 2221 existing records. [2025-10-03T21:52:54.372240] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:54.373452] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-03T21:52:54.375461] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-03T21:52:54.375350] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T21:52:54.384962] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-03T21:52:54.385086] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-03T21:52:54.397955] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-03T21:52:54.785104] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:55.190687] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-03T21:52:55.205089] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T21:52:55.705464] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T21:52:55.710148] [INFO ] [REMOTE ] THC: Full fetch complete (69128 records). [2025-10-03T21:52:55.710282] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-03T21:52:55.995767] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-03T21:52:56.136565] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-03T21:52:56.136707] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-03T21:52:56.138690] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-03T21:52:56.138761] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-03T21:52:56.140449] [DEBUG] [LOCAL ] THC: Trimmed 69128 records to 48248 (keeping 200 days of data) [2025-10-03T21:52:56.236712] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T21:52:56.246109] [INFO ] [REMOTE ] TGS: Full fetch complete (48009 records). [2025-10-03T21:52:56.246784] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-03T21:52:56.695858] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-03T21:52:56.703472] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-03T21:52:56.705159] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-03T21:52:56.766366] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-03T21:52:56.796153] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-03T21:52:56.811484] [DEBUG] [LOCAL ] TGS: Trimmed 48009 records to 33439 (keeping 200 days of data) [2025-10-03T21:52:57.086149] [DEBUG] [LOCAL ] THC: Primary data saved (48248 records). [2025-10-03T21:52:57.086893] [INFO ] [MAIN ] THC: Full history saved. [2025-10-03T21:52:57.087354] [INFO ] [MAIN ] Update Progress: 2083/2370 symbols completed. THC took 33.3s. Estimated remaining: 40m 21s. Rate: 7.1 symbols/min [2025-10-03T21:52:57.158285] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-03T21:52:57.219383] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T21:52:57.302495] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:57.310227] [DEBUG] [LOCAL ] THLV: Loaded 1553 existing records from primary storage. [2025-10-03T21:52:57.310775] [INFO ] [MAIN ] THLV: Loaded 1553 existing records. [2025-10-03T21:52:57.445093] [DEBUG] [LOCAL ] TGS: Primary data saved (33439 records). [2025-10-03T21:52:57.475519] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-03T21:52:57.508161] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:57.508443] [INFO ] [MAIN ] Update Progress: 2084/2370 symbols completed. TGS took 33.7s. Estimated remaining: 40m 12s. Rate: 7.1 symbols/min [2025-10-03T21:52:57.514305] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-03T21:52:57.571525] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-03T21:52:57.594019] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-03T21:52:57.599383] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-03T21:52:57.622775] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-03T21:52:57.814251] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:52:57.986274] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T21:52:58.112876] [DEBUG] [LOCAL ] THO: Loaded 42163 existing records from primary storage. [2025-10-03T21:52:58.128776] [INFO ] [MAIN ] THO: Loaded 42163 existing records. [2025-10-03T21:52:58.242335] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:58.361617] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:52:58.361962] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-03T21:52:58.362014] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-03T21:52:58.362318] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-03T21:52:58.362377] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-03T21:52:58.395895] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-03T21:52:58.760340] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:52:58.816628] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T21:52:59.190710] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-03T21:52:59.633359] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T21:52:59.990696] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-03T21:53:00.462098] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-03T21:53:00.790744] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-03T21:53:01.590706] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-03T21:53:02.002766] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T21:53:02.023941] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T21:53:02.390694] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-03T21:53:03.190636] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-03T21:53:03.563763] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T21:53:03.990709] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-03T21:53:04.465073] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T21:53:04.694869] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T21:53:04.790693] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-03T21:53:05.590698] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-03T21:53:06.028311] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T21:53:06.399235] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-03T21:53:06.401562] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T21:53:07.190752] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-03T21:53:07.920905] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T21:53:07.950784] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T21:53:07.990619] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-03T21:53:08.790742] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-03T21:53:09.477705] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T21:53:09.506849] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:53:09.590774] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-03T21:53:10.040417] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T21:53:10.390704] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-03T21:53:10.860154] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T21:53:11.190749] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-03T21:53:11.748801] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T21:53:11.990695] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-03T21:53:12.528607] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T21:53:12.790726] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-03T21:53:13.590719] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-03T21:53:13.879894] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T21:53:14.030752] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T21:53:14.390707] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-03T21:53:15.190744] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-03T21:53:15.753753] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T21:53:15.990680] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-03T21:53:16.035448] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T21:53:16.790706] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-03T21:53:17.059735] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T21:53:17.089261] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-03T21:53:17.090481] [INFO ] [REMOTE ] THIR: Full fetch complete (2769 records). [2025-10-03T21:53:17.090577] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-03T21:53:17.477740] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-03T21:53:17.477857] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-03T21:53:17.477979] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-03T21:53:17.478019] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-03T21:53:17.478357] [DEBUG] [LOCAL ] THIR: Trimmed 2769 records to 2246 (keeping 200 days of data) [2025-10-03T21:53:17.492038] [DEBUG] [LOCAL ] THIR: Primary data saved (2246 records). [2025-10-03T21:53:17.492109] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-03T21:53:17.492199] [INFO ] [MAIN ] Update Progress: 2085/2370 symbols completed. THIR took 23.9s. Estimated remaining: 40m 5s. Rate: 7.1 symbols/min [2025-10-03T21:53:17.590748] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-03T21:53:17.671556] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:17.699825] [DEBUG] [LOCAL ] THQ: Loaded 25177 existing records from primary storage. [2025-10-03T21:53:17.700107] [INFO ] [MAIN ] THQ: Loaded 25177 existing records. [2025-10-03T21:53:17.893830] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:53:17.894079] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-03T21:53:17.894139] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-03T21:53:17.894416] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-03T21:53:17.894474] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-03T21:53:18.285495] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:18.390703] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-03T21:53:19.190684] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-03T21:53:19.266603] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T21:53:19.553783] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T21:53:19.976803] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T21:53:19.990628] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-03T21:53:20.790734] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-03T21:53:21.147707] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T21:53:21.147919] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-03T21:53:21.590721] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-03T21:53:21.934129] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T21:53:22.390717] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-03T21:53:23.190632] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-03T21:53:23.362093] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T21:53:23.990712] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-03T21:53:24.608638] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T21:53:24.641401] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T21:53:24.790739] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-03T21:53:25.590752] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-03T21:53:26.314495] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:53:26.360878] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T21:53:26.390735] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-03T21:53:27.190693] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-03T21:53:27.410733] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T21:53:27.991284] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-03T21:53:27.993342] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T21:53:28.385240] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-03T21:53:28.790709] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-03T21:53:29.590769] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-03T21:53:30.307417] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T21:53:30.329380] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T21:53:30.332055] [INFO ] [REMOTE ] THG: Full fetch complete (31178 records). [2025-10-03T21:53:30.332288] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-03T21:53:30.395942] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-03T21:53:30.856399] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-03T21:53:30.856483] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-03T21:53:30.857297] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-03T21:53:30.857367] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-03T21:53:30.858309] [DEBUG] [LOCAL ] THG: Trimmed 31178 records to 21946 (keeping 200 days of data) [2025-10-03T21:53:31.006890] [DEBUG] [LOCAL ] THG: Primary data saved (21946 records). [2025-10-03T21:53:31.007037] [INFO ] [MAIN ] THG: Full history saved. [2025-10-03T21:53:31.007140] [INFO ] [MAIN ] Update Progress: 2086/2370 symbols completed. THG took 38.1s. Estimated remaining: 39m 57s. Rate: 7.1 symbols/min [2025-10-03T21:53:31.188178] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:31.190638] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-03T21:53:31.210772] [DEBUG] [LOCAL ] THR: Loaded 19967 existing records from primary storage. [2025-10-03T21:53:31.211027] [INFO ] [MAIN ] THR: Loaded 19967 existing records. [2025-10-03T21:53:31.396156] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:53:31.396487] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-03T21:53:31.396554] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-03T21:53:31.396794] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-03T21:53:31.396859] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-03T21:53:31.507116] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-03T21:53:31.510977] [INFO ] [REMOTE ] THLV: Full fetch complete (2632 records). [2025-10-03T21:53:31.511132] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-03T21:53:32.005942] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-03T21:53:32.081066] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:32.212192] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-03T21:53:32.212407] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-03T21:53:32.212729] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-03T21:53:32.221167] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-03T21:53:32.235956] [DEBUG] [LOCAL ] THLV: Trimmed 2632 records to 1560 (keeping 200 days of data) [2025-10-03T21:53:32.237804] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:53:32.256674] [DEBUG] [LOCAL ] THLV: Primary data saved (1560 records). [2025-10-03T21:53:32.256807] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-03T21:53:32.256891] [INFO ] [MAIN ] Update Progress: 2087/2370 symbols completed. THLV took 35.2s. Estimated remaining: 39m 48s. Rate: 7.1 symbols/min [2025-10-03T21:53:32.448500] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:32.492926] [DEBUG] [LOCAL ] THS: Loaded 38521 existing records from primary storage. [2025-10-03T21:53:32.493295] [INFO ] [MAIN ] THS: Loaded 38521 existing records. [2025-10-03T21:53:32.697716] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:53:32.698018] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-03T21:53:32.698072] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-03T21:53:32.698375] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-03T21:53:32.698436] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-03T21:53:32.796693] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-03T21:53:33.077034] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:33.170903] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T21:53:33.571551] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T21:53:33.590618] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-03T21:53:34.390673] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-03T21:53:34.552915] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T21:53:35.190703] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-03T21:53:35.584184] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T21:53:35.990709] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-03T21:53:36.526443] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T21:53:36.790761] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-03T21:53:37.211870] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T21:53:37.590723] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-03T21:53:37.848685] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:53:38.390724] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-03T21:53:39.018260] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T21:53:39.190735] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-03T21:53:39.939041] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:53:39.990639] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-03T21:53:40.392010] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T21:53:40.790750] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-03T21:53:41.154556] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T21:53:41.157720] [INFO ] [REMOTE ] THO: Full fetch complete (60192 records). [2025-10-03T21:53:41.157909] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-03T21:53:41.595130] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-03T21:53:41.596806] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-03T21:53:41.597094] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-03T21:53:41.599289] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-03T21:53:41.599499] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-03T21:53:41.601715] [DEBUG] [LOCAL ] THO: Trimmed 60192 records to 42481 (keeping 200 days of data) [2025-10-03T21:53:41.896476] [DEBUG] [LOCAL ] THO: Primary data saved (42481 records). [2025-10-03T21:53:41.897114] [INFO ] [MAIN ] THO: Full history saved. [2025-10-03T21:53:41.897753] [INFO ] [MAIN ] Update Progress: 2088/2370 symbols completed. THO took 44.4s. Estimated remaining: 39m 39s. Rate: 7.1 symbols/min [2025-10-03T21:53:42.108505] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:42.132767] [DEBUG] [LOCAL ] THW: Loaded 19556 existing records from primary storage. [2025-10-03T21:53:42.133207] [INFO ] [MAIN ] THW: Loaded 19556 existing records. [2025-10-03T21:53:42.311255] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T21:53:42.369800] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:53:42.370947] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-03T21:53:42.371107] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-03T21:53:42.371570] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-03T21:53:42.371698] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-03T21:53:42.393275] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-03T21:53:42.440898] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T21:53:42.791681] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:43.190725] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-03T21:53:43.385363] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T21:53:43.990703] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-03T21:53:44.250367] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T21:53:44.790687] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-03T21:53:44.867606] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T21:53:44.869845] [INFO ] [REMOTE ] THQ: Full fetch complete (35201 records). [2025-10-03T21:53:44.870000] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-03T21:53:45.297369] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-03T21:53:45.297466] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-03T21:53:45.298663] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-03T21:53:45.298729] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-03T21:53:45.300508] [DEBUG] [LOCAL ] THQ: Trimmed 35201 records to 25426 (keeping 200 days of data) [2025-10-03T21:53:45.479455] [DEBUG] [LOCAL ] THQ: Primary data saved (25426 records). [2025-10-03T21:53:45.479627] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-03T21:53:45.479761] [INFO ] [MAIN ] Update Progress: 2089/2370 symbols completed. THQ took 28.0s. Estimated remaining: 39m 30s. Rate: 7.1 symbols/min [2025-10-03T21:53:45.595401] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-03T21:53:45.679740] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:45.680168] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-03T21:53:45.680219] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-03T21:53:45.680841] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-03T21:53:45.681178] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-03T21:53:45.681260] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-03T21:53:45.681320] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-03T21:53:45.974922] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T21:53:46.098453] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:46.390710] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-03T21:53:46.613257] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:53:46.613714] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-03T21:53:46.613817] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:53:46.613865] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-03T21:53:46.613900] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:53:46.613938] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-03T21:53:46.614002] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-03T21:53:46.614042] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-03T21:53:46.614138] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-03T21:53:46.614217] [INFO ] [MAIN ] Update Progress: 2090/2370 symbols completed. TIC took 1.1s. Estimated remaining: 39m 21s. Rate: 7.1 symbols/min [2025-10-03T21:53:46.788101] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:53:46.837319] [DEBUG] [LOCAL ] TIMB: Loaded 36298 existing records from primary storage. [2025-10-03T21:53:46.837721] [INFO ] [MAIN ] TIMB: Loaded 36298 existing records. [2025-10-03T21:53:47.031023] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:53:47.031537] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-03T21:53:47.031666] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-03T21:53:47.040632] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-03T21:53:47.053339] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-03T21:53:47.060280] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T21:53:47.195729] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-03T21:53:47.434486] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:53:47.990704] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-03T21:53:48.795907] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-03T21:53:48.806708] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:53:49.170801] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T21:53:49.590691] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-03T21:53:49.846846] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T21:53:50.390681] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-03T21:53:50.771537] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T21:53:51.190741] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-03T21:53:51.743519] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T21:53:51.990733] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-03T21:53:52.705085] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T21:53:52.790744] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-03T21:53:53.425197] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T21:53:53.590745] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-03T21:53:53.848220] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:53:54.390710] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-03T21:53:54.559771] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T21:53:55.190720] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-03T21:53:55.898615] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T21:53:55.990746] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-03T21:53:56.299410] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T21:53:56.790692] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-03T21:53:57.026724] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T21:53:57.590727] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-03T21:53:58.320070] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T21:53:58.390670] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-03T21:53:58.678347] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T21:53:59.190732] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-03T21:53:59.694915] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T21:53:59.990742] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-03T21:54:00.743548] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T21:54:00.790752] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-03T21:54:01.462941] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T21:54:01.590743] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-03T21:54:01.871954] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T21:54:02.390745] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-03T21:54:03.062632] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T21:54:03.190732] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-03T21:54:03.867744] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T21:54:03.990682] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-03T21:54:04.031075] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T21:54:04.034203] [INFO ] [REMOTE ] THR: Full fetch complete (28693 records). [2025-10-03T21:54:04.034339] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-03T21:54:04.460171] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-03T21:54:04.460267] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-03T21:54:04.460995] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-03T21:54:04.461064] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-03T21:54:04.462033] [DEBUG] [LOCAL ] THR: Trimmed 28693 records to 20079 (keeping 200 days of data) [2025-10-03T21:54:04.592860] [DEBUG] [LOCAL ] THR: Primary data saved (20079 records). [2025-10-03T21:54:04.593018] [INFO ] [MAIN ] THR: Full history saved. [2025-10-03T21:54:04.593129] [INFO ] [MAIN ] Update Progress: 2091/2370 symbols completed. THR took 33.6s. Estimated remaining: 39m 14s. Rate: 7.1 symbols/min [2025-10-03T21:54:04.773260] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:04.780105] [DEBUG] [LOCAL ] TISI: Loaded 3764 existing records from primary storage. [2025-10-03T21:54:04.780316] [INFO ] [MAIN ] TISI: Loaded 3764 existing records. [2025-10-03T21:54:04.795778] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-03T21:54:04.978980] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:04.979272] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-03T21:54:04.979323] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-03T21:54:04.979517] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-03T21:54:04.979576] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-03T21:54:05.355280] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:05.590669] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-03T21:54:05.740235] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:54:06.205578] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T21:54:06.390676] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-03T21:54:06.594680] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:54:07.190718] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-03T21:54:07.670248] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T21:54:07.839865] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T21:54:07.990691] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-03T21:54:08.790685] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-03T21:54:09.035318] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T21:54:09.590708] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-03T21:54:10.095211] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T21:54:10.314729] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T21:54:10.390707] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-03T21:54:11.190705] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-03T21:54:11.641982] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T21:54:11.646043] [INFO ] [REMOTE ] THS: Full fetch complete (54221 records). [2025-10-03T21:54:11.646245] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-03T21:54:11.995839] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-03T21:54:12.081507] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-03T21:54:12.081614] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-03T21:54:12.082731] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-03T21:54:12.082802] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-03T21:54:12.084204] [DEBUG] [LOCAL ] THS: Trimmed 54221 records to 38862 (keeping 200 days of data) [2025-10-03T21:54:12.308449] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T21:54:12.349294] [DEBUG] [LOCAL ] THS: Primary data saved (38862 records). [2025-10-03T21:54:12.349492] [INFO ] [MAIN ] THS: Full history saved. [2025-10-03T21:54:12.349607] [INFO ] [MAIN ] Update Progress: 2092/2370 symbols completed. THS took 40.1s. Estimated remaining: 39m 5s. Rate: 7.1 symbols/min [2025-10-03T21:54:12.544859] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:12.577932] [DEBUG] [LOCAL ] TIXT: Loaded 31892 existing records from primary storage. [2025-10-03T21:54:12.578296] [INFO ] [MAIN ] TIXT: Loaded 31892 existing records. [2025-10-03T21:54:12.765141] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:12.765421] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-03T21:54:12.765475] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-03T21:54:12.765763] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-03T21:54:12.765826] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-03T21:54:12.797442] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-03T21:54:13.159559] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:13.530931] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T21:54:13.560247] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T21:54:13.590716] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-03T21:54:14.390744] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-03T21:54:14.883234] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T21:54:15.190628] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-03T21:54:15.586245] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T21:54:15.990720] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-03T21:54:16.431113] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T21:54:16.457424] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-03T21:54:16.790725] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-03T21:54:17.590744] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-03T21:54:17.711519] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T21:54:17.714522] [INFO ] [REMOTE ] TIMB: Full fetch complete (54093 records). [2025-10-03T21:54:17.714729] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-03T21:54:18.155392] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-03T21:54:18.155553] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-03T21:54:18.156627] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-03T21:54:18.156714] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-03T21:54:18.158102] [DEBUG] [LOCAL ] TIMB: Trimmed 54093 records to 36490 (keeping 200 days of data) [2025-10-03T21:54:18.392411] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-03T21:54:18.401208] [DEBUG] [LOCAL ] TIMB: Primary data saved (36490 records). [2025-10-03T21:54:18.401347] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-03T21:54:18.401457] [INFO ] [MAIN ] Update Progress: 2093/2370 symbols completed. TIMB took 31.8s. Estimated remaining: 38m 56s. Rate: 7.1 symbols/min [2025-10-03T21:54:18.586037] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:18.646779] [DEBUG] [LOCAL ] TJX: Loaded 54058 existing records from primary storage. [2025-10-03T21:54:18.647163] [INFO ] [MAIN ] TJX: Loaded 54058 existing records. [2025-10-03T21:54:18.849575] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:18.850027] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-03T21:54:18.850357] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-03T21:54:18.857404] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-03T21:54:18.869741] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-03T21:54:18.876622] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T21:54:19.195757] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-03T21:54:19.265826] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:19.376174] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T21:54:19.990686] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-03T21:54:20.400676] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T21:54:20.790710] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-03T21:54:21.590725] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-03T21:54:21.922797] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T21:54:22.093355] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T21:54:22.390762] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-03T21:54:22.605410] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T21:54:23.066187] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T21:54:23.190766] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-03T21:54:23.990693] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-03T21:54:24.580587] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T21:54:24.790694] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-03T21:54:25.030333] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T21:54:25.590748] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-03T21:54:25.953484] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T21:54:26.390730] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-03T21:54:26.829783] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T21:54:27.194136] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-03T21:54:27.200946] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T21:54:27.804910] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T21:54:27.990683] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-03T21:54:28.504411] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T21:54:28.790705] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-03T21:54:29.569951] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T21:54:29.571612] [INFO ] [REMOTE ] THW: Full fetch complete (29419 records). [2025-10-03T21:54:29.571796] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-03T21:54:29.596976] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-03T21:54:30.002230] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-03T21:54:30.002330] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-03T21:54:30.003069] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-03T21:54:30.003165] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-03T21:54:30.004238] [DEBUG] [LOCAL ] THW: Trimmed 29419 records to 19744 (keeping 200 days of data) [2025-10-03T21:54:30.133047] [DEBUG] [LOCAL ] THW: Primary data saved (19744 records). [2025-10-03T21:54:30.133244] [INFO ] [MAIN ] THW: Full history saved. [2025-10-03T21:54:30.133359] [INFO ] [MAIN ] Update Progress: 2094/2370 symbols completed. THW took 48.2s. Estimated remaining: 38m 48s. Rate: 7.1 symbols/min [2025-10-03T21:54:30.328110] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:30.370404] [DEBUG] [LOCAL ] TK: Loaded 39741 existing records from primary storage. [2025-10-03T21:54:30.370791] [INFO ] [MAIN ] TK: Loaded 39741 existing records. [2025-10-03T21:54:30.395838] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-03T21:54:30.609205] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:30.609536] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-03T21:54:30.609598] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-03T21:54:30.609956] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-03T21:54:30.610035] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-03T21:54:30.877974] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T21:54:30.887635] [INFO ] [REMOTE ] TISI: Full fetch complete (4937 records). [2025-10-03T21:54:30.946295] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-03T21:54:30.993722] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T21:54:31.167614] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:31.191915] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-03T21:54:31.482894] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-03T21:54:31.482987] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-03T21:54:31.483157] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-03T21:54:31.483212] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-03T21:54:31.483723] [DEBUG] [LOCAL ] TISI: Trimmed 4937 records to 3792 (keeping 200 days of data) [2025-10-03T21:54:31.507668] [DEBUG] [LOCAL ] TISI: Primary data saved (3792 records). [2025-10-03T21:54:31.507872] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-03T21:54:31.507999] [INFO ] [MAIN ] Update Progress: 2095/2370 symbols completed. TISI took 26.9s. Estimated remaining: 38m 39s. Rate: 7.1 symbols/min [2025-10-03T21:54:31.702587] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:31.752078] [DEBUG] [LOCAL ] TKC: Loaded 39332 existing records from primary storage. [2025-10-03T21:54:31.752436] [INFO ] [MAIN ] TKC: Loaded 39332 existing records. [2025-10-03T21:54:31.942908] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:31.943174] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-03T21:54:31.943225] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-03T21:54:31.943504] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-03T21:54:31.943565] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-03T21:54:32.000729] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-03T21:54:32.324923] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:32.606821] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T21:54:32.790698] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-03T21:54:33.590694] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-03T21:54:34.134505] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T21:54:34.177473] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T21:54:34.390707] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-03T21:54:35.084968] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T21:54:35.190696] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-03T21:54:35.990723] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-03T21:54:36.201207] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T21:54:36.541183] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-03T21:54:36.790715] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-03T21:54:37.592490] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-03T21:54:37.595007] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T21:54:37.665435] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T21:54:38.390698] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-03T21:54:38.964906] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T21:54:39.190632] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-03T21:54:39.566253] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T21:54:39.990703] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-03T21:54:40.736696] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T21:54:40.790628] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-03T21:54:41.498913] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T21:54:41.590737] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-03T21:54:41.913206] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:54:41.915502] [INFO ] [REMOTE ] TIXT: Full fetch complete (46096 records). [2025-10-03T21:54:41.915626] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-03T21:54:42.383826] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-03T21:54:42.383914] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-03T21:54:42.384945] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-03T21:54:42.385011] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-03T21:54:42.386136] [DEBUG] [LOCAL ] TIXT: Trimmed 46096 records to 32057 (keeping 200 days of data) [2025-10-03T21:54:42.430435] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-03T21:54:42.574869] [DEBUG] [LOCAL ] TIXT: Primary data saved (32057 records). [2025-10-03T21:54:42.575057] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-03T21:54:42.575163] [INFO ] [MAIN ] Update Progress: 2096/2370 symbols completed. TIXT took 30.2s. Estimated remaining: 38m 31s. Rate: 7.1 symbols/min [2025-10-03T21:54:42.762893] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:42.819036] [DEBUG] [LOCAL ] TKO: Loaded 44401 existing records from primary storage. [2025-10-03T21:54:42.819487] [INFO ] [MAIN ] TKO: Loaded 44401 existing records. [2025-10-03T21:54:43.001207] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T21:54:43.051040] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:54:43.051348] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-03T21:54:43.051405] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-03T21:54:43.051700] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-03T21:54:43.051797] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-03T21:54:43.195884] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-03T21:54:43.463830] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:43.990692] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-03T21:54:44.539057] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-03T21:54:44.783190] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T21:54:44.792960] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-03T21:54:45.590758] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-03T21:54:45.645930] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:54:46.316036] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T21:54:46.390716] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-03T21:54:46.851275] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T21:54:47.190701] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-03T21:54:47.990696] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-03T21:54:48.387875] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T21:54:48.733683] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T21:54:48.790736] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-03T21:54:49.502837] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T21:54:49.590715] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-03T21:54:50.390689] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-03T21:54:50.814396] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T21:54:51.043014] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T21:54:51.190721] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-03T21:54:51.990692] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-03T21:54:52.056002] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T21:54:52.675090] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T21:54:52.790760] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-03T21:54:53.591543] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-03T21:54:53.591452] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T21:54:54.323763] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:54:54.390748] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-03T21:54:54.859410] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T21:54:55.190738] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-03T21:54:55.990690] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-03T21:54:56.116590] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T21:54:56.468130] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T21:54:56.470772] [INFO ] [REMOTE ] TKC: Full fetch complete (52469 records). [2025-10-03T21:54:56.470904] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-03T21:54:56.795920] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-03T21:54:56.896798] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-03T21:54:56.896906] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-03T21:54:56.898262] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-03T21:54:56.898329] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-03T21:54:56.899636] [DEBUG] [LOCAL ] TKC: Trimmed 52469 records to 39672 (keeping 200 days of data) [2025-10-03T21:54:57.135486] [DEBUG] [LOCAL ] TKC: Primary data saved (39672 records). [2025-10-03T21:54:57.135697] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-03T21:54:57.136300] [INFO ] [MAIN ] Update Progress: 2097/2370 symbols completed. TKC took 25.6s. Estimated remaining: 38m 23s. Rate: 7.1 symbols/min [2025-10-03T21:54:57.312824] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:54:57.313065] [DEBUG] [LOCAL ] TKR: No existing data file found in primary storage. [2025-10-03T21:54:57.313120] [WARN ] [MAIN ] TKR: No existing data found, performing full refresh instead. [2025-10-03T21:54:57.313245] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-03T21:54:57.313287] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-03T21:54:57.313329] [DEBUG] [LOCAL ] TKR: No primary data file found to delete. [2025-10-03T21:54:57.313373] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-03T21:54:57.595738] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-03T21:54:57.727849] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:54:58.096147] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T21:54:58.390755] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-03T21:54:58.529838] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T21:54:58.713732] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T21:54:59.190749] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-03T21:54:59.810973] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T21:54:59.990749] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-03T21:55:00.605332] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T21:55:00.790752] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-03T21:55:01.560765] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T21:55:01.590760] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-03T21:55:02.390750] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-03T21:55:02.821189] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T21:55:03.190720] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-03T21:55:03.371123] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T21:55:03.453982] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T21:55:03.990750] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-03T21:55:04.790731] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-03T21:55:05.013004] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T21:55:05.116516] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T21:55:05.251822] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:55:05.255069] [INFO ] [REMOTE ] TJX: Full fetch complete (77680 records). [2025-10-03T21:55:05.255278] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-03T21:55:05.592558] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-03T21:55:05.701635] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-03T21:55:05.701790] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-03T21:55:05.703685] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-03T21:55:05.703783] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-03T21:55:05.706136] [DEBUG] [LOCAL ] TJX: Trimmed 77680 records to 54448 (keeping 200 days of data) [2025-10-03T21:55:06.081464] [DEBUG] [LOCAL ] TJX: Primary data saved (54448 records). [2025-10-03T21:55:06.081636] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-03T21:55:06.081784] [INFO ] [MAIN ] Update Progress: 2098/2370 symbols completed. TJX took 47.7s. Estimated remaining: 38m 15s. Rate: 7.1 symbols/min [2025-10-03T21:55:06.273538] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:06.324905] [DEBUG] [LOCAL ] TLK: Loaded 39485 existing records from primary storage. [2025-10-03T21:55:06.325307] [INFO ] [MAIN ] TLK: Loaded 39485 existing records. [2025-10-03T21:55:06.395733] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-03T21:55:06.531258] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:06.531576] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-03T21:55:06.531629] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-03T21:55:06.531956] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-03T21:55:06.532017] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-03T21:55:06.924213] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:07.190724] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-03T21:55:07.335721] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T21:55:07.999740] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-03T21:55:08.006839] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T21:55:08.708292] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T21:55:08.790775] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-03T21:55:09.111911] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T21:55:09.115842] [INFO ] [REMOTE ] TK: Full fetch complete (56495 records). [2025-10-03T21:55:09.116020] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-03T21:55:09.550630] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-03T21:55:09.550775] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-03T21:55:09.552013] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-03T21:55:09.552082] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-03T21:55:09.554319] [DEBUG] [LOCAL ] TK: Trimmed 56495 records to 39948 (keeping 200 days of data) [2025-10-03T21:55:09.603037] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-03T21:55:09.799813] [DEBUG] [LOCAL ] TK: Primary data saved (39948 records). [2025-10-03T21:55:09.799997] [INFO ] [MAIN ] TK: Full history saved. [2025-10-03T21:55:09.800197] [INFO ] [MAIN ] Update Progress: 2099/2370 symbols completed. TK took 39.7s. Estimated remaining: 38m 6s. Rate: 7.1 symbols/min [2025-10-03T21:55:09.989323] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:10.015330] [DEBUG] [LOCAL ] TLYS: Loaded 16614 existing records from primary storage. [2025-10-03T21:55:10.015619] [INFO ] [MAIN ] TLYS: Loaded 16614 existing records. [2025-10-03T21:55:10.199112] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:10.199403] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-03T21:55:10.199510] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-03T21:55:10.200297] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-03T21:55:10.200360] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-03T21:55:10.395853] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-03T21:55:10.578788] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:10.610183] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T21:55:11.190638] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-03T21:55:11.339982] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T21:55:11.507242] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T21:55:11.990702] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-03T21:55:12.799471] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-03T21:55:12.802681] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T21:55:13.516413] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T21:55:13.590680] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-03T21:55:13.781079] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T21:55:14.390724] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-03T21:55:15.176609] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T21:55:15.190618] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-03T21:55:15.993228] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-03T21:55:16.017318] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T21:55:16.105441] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T21:55:16.790735] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-03T21:55:17.230144] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T21:55:17.232839] [INFO ] [REMOTE ] TKO: Full fetch complete (64899 records). [2025-10-03T21:55:17.233143] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-03T21:55:17.602512] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-03T21:55:17.662912] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-03T21:55:17.663106] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-03T21:55:17.664349] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-03T21:55:17.664466] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-03T21:55:17.666540] [DEBUG] [LOCAL ] TKO: Trimmed 64899 records to 44733 (keeping 200 days of data) [2025-10-03T21:55:17.690141] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T21:55:17.992126] [DEBUG] [LOCAL ] TKO: Primary data saved (44733 records). [2025-10-03T21:55:17.992301] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-03T21:55:17.992418] [INFO ] [MAIN ] Update Progress: 2100/2370 symbols completed. TKO took 35.4s. Estimated remaining: 37m 57s. Rate: 7.1 symbols/min [2025-10-03T21:55:18.173984] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:18.216431] [DEBUG] [LOCAL ] TM: Loaded 36607 existing records from primary storage. [2025-10-03T21:55:18.216802] [INFO ] [MAIN ] TM: Loaded 36607 existing records. [2025-10-03T21:55:18.395807] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-03T21:55:18.432026] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:18.432677] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-03T21:55:18.432754] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-03T21:55:18.433384] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-03T21:55:18.433449] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-03T21:55:18.564522] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T21:55:18.831183] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:19.190754] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-03T21:55:19.990671] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-03T21:55:20.020808] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:55:20.790747] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-03T21:55:20.927332] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T21:55:21.019005] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T21:55:21.590702] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-03T21:55:22.199116] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T21:55:22.390744] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-03T21:55:23.058009] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T21:55:23.190638] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-03T21:55:23.282792] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T21:55:23.990735] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-03T21:55:24.790725] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-03T21:55:24.861696] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T21:55:25.586903] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:55:25.596099] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-03T21:55:25.608350] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T21:55:26.390741] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-03T21:55:27.178302] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T21:55:27.190605] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-03T21:55:27.596949] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:55:27.599453] [INFO ] [REMOTE ] TKR: Full fetch complete (57850 records). [2025-10-03T21:55:27.599679] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-03T21:55:27.995804] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-03T21:55:28.047123] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-03T21:55:28.047222] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-03T21:55:28.048633] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-03T21:55:28.048732] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-03T21:55:28.050247] [DEBUG] [LOCAL ] TKR: Trimmed 57850 records to 40606 (keeping 200 days of data) [2025-10-03T21:55:28.339410] [DEBUG] [LOCAL ] TKR: Primary data saved (40606 records). [2025-10-03T21:55:28.339569] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-03T21:55:28.339739] [INFO ] [MAIN ] Update Progress: 2101/2370 symbols completed. TKR took 31.2s. Estimated remaining: 37m 49s. Rate: 7.1 symbols/min [2025-10-03T21:55:28.534226] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:28.592749] [DEBUG] [LOCAL ] TME: Loaded 53582 existing records from primary storage. [2025-10-03T21:55:28.593254] [INFO ] [MAIN ] TME: Loaded 53582 existing records. [2025-10-03T21:55:28.846337] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:28.841612] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-03T21:55:28.847315] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-03T21:55:28.849197] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-03T21:55:28.849116] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:55:28.859466] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-03T21:55:28.859759] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-03T21:55:29.217185] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T21:55:29.312460] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:29.590779] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-03T21:55:30.376085] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T21:55:30.390615] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-03T21:55:31.078010] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T21:55:31.190722] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-03T21:55:31.987041] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T21:55:31.994518] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-03T21:55:32.790677] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-03T21:55:33.069543] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T21:55:33.468461] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T21:55:33.590710] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-03T21:55:34.311441] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T21:55:34.390695] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-03T21:55:35.190730] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-03T21:55:35.405419] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:55:35.428605] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T21:55:35.990762] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-03T21:55:36.444278] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T21:55:36.583904] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T21:55:36.790705] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-03T21:55:37.590754] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-03T21:55:38.242530] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T21:55:38.390734] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-03T21:55:38.779441] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T21:55:39.190736] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-03T21:55:39.967320] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T21:55:39.990623] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-03T21:55:40.174984] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T21:55:40.790738] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-03T21:55:41.590707] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-03T21:55:41.874347] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T21:55:42.064844] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T21:55:42.190572] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T21:55:42.191533] [INFO ] [REMOTE ] TLYS: Full fetch complete (21753 records). [2025-10-03T21:55:42.191609] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-03T21:55:42.400523] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-03T21:55:42.597680] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-03T21:55:42.597813] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-03T21:55:42.598417] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-03T21:55:42.598467] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-03T21:55:42.599187] [DEBUG] [LOCAL ] TLYS: Trimmed 21753 records to 16659 (keeping 200 days of data) [2025-10-03T21:55:42.702541] [DEBUG] [LOCAL ] TLYS: Primary data saved (16659 records). [2025-10-03T21:55:42.702725] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-03T21:55:42.702846] [INFO ] [MAIN ] Update Progress: 2102/2370 symbols completed. TLYS took 32.9s. Estimated remaining: 37m 42s. Rate: 7.1 symbols/min [2025-10-03T21:55:42.894626] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:42.940915] [DEBUG] [LOCAL ] TMHC: Loaded 45663 existing records from primary storage. [2025-10-03T21:55:42.941287] [INFO ] [MAIN ] TMHC: Loaded 45663 existing records. [2025-10-03T21:55:43.141116] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:43.141389] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-03T21:55:43.141441] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-03T21:55:43.141838] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-03T21:55:43.141904] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-03T21:55:43.201540] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-03T21:55:43.563541] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:43.990735] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-03T21:55:44.361059] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T21:55:44.790669] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-03T21:55:45.080596] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T21:55:45.504583] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T21:55:45.590736] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-03T21:55:45.900875] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T21:55:45.904398] [INFO ] [REMOTE ] TLK: Full fetch complete (57302 records). [2025-10-03T21:55:45.904513] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-03T21:55:46.301774] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-03T21:55:46.301866] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-03T21:55:46.303066] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-03T21:55:46.303133] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-03T21:55:46.304555] [DEBUG] [LOCAL ] TLK: Trimmed 57302 records to 39755 (keeping 200 days of data) [2025-10-03T21:55:46.404279] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-03T21:55:46.562488] [DEBUG] [LOCAL ] TLK: Primary data saved (39755 records). [2025-10-03T21:55:46.562745] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-03T21:55:46.563044] [INFO ] [MAIN ] Update Progress: 2103/2370 symbols completed. TLK took 40.5s. Estimated remaining: 37m 33s. Rate: 7.1 symbols/min [2025-10-03T21:55:46.781575] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:46.844608] [DEBUG] [LOCAL ] TMO: Loaded 52734 existing records from primary storage. [2025-10-03T21:55:46.845064] [INFO ] [MAIN ] TMO: Loaded 52734 existing records. [2025-10-03T21:55:47.037244] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:47.037717] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-03T21:55:47.037812] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-03T21:55:47.038391] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-03T21:55:47.038454] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-03T21:55:47.191470] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-03T21:55:47.448375] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:47.474193] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T21:55:47.990733] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-03T21:55:48.320098] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T21:55:48.770477] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T21:55:48.790667] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-03T21:55:49.590751] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-03T21:55:49.632903] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T21:55:50.259840] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T21:55:50.390755] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-03T21:55:51.190757] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-03T21:55:51.415364] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T21:55:51.990680] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-03T21:55:52.122674] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T21:55:52.759117] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T21:55:52.790728] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-03T21:55:53.106805] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T21:55:53.108869] [INFO ] [REMOTE ] TM: Full fetch complete (52809 records). [2025-10-03T21:55:53.109005] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-03T21:55:53.558815] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-03T21:55:53.558920] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-03T21:55:53.560019] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-03T21:55:53.560088] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-03T21:55:53.561770] [DEBUG] [LOCAL ] TM: Trimmed 52809 records to 36801 (keeping 200 days of data) [2025-10-03T21:55:53.620277] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-03T21:55:53.808833] [DEBUG] [LOCAL ] TM: Primary data saved (36801 records). [2025-10-03T21:55:53.809016] [INFO ] [MAIN ] TM: Full history saved. [2025-10-03T21:55:53.809188] [INFO ] [MAIN ] Update Progress: 2104/2370 symbols completed. TM took 35.8s. Estimated remaining: 37m 24s. Rate: 7.1 symbols/min [2025-10-03T21:55:53.999614] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:55:54.019099] [DEBUG] [LOCAL ] TNC: Loaded 14932 existing records from primary storage. [2025-10-03T21:55:54.019405] [INFO ] [MAIN ] TNC: Loaded 14932 existing records. [2025-10-03T21:55:54.233053] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:55:54.233291] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-03T21:55:54.233342] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-03T21:55:54.233700] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-03T21:55:54.233761] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-03T21:55:54.407753] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-03T21:55:54.693337] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:55:54.695243] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T21:55:55.190680] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-03T21:55:55.466862] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T21:55:55.990680] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-03T21:55:56.066780] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T21:55:56.297374] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T21:55:56.790721] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-03T21:55:57.590732] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-03T21:55:57.761096] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T21:55:57.885320] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T21:55:58.390719] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-03T21:55:59.190747] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-03T21:55:59.659444] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T21:55:59.990736] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-03T21:56:00.246122] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T21:56:00.441109] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T21:56:00.790687] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-03T21:56:01.590731] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-03T21:56:02.016156] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T21:56:02.043048] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T21:56:02.390749] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-03T21:56:03.190747] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-03T21:56:03.351113] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T21:56:03.990716] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-03T21:56:04.075270] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T21:56:04.263721] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T21:56:04.790699] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-03T21:56:05.590677] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-03T21:56:05.833391] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T21:56:06.380857] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T21:56:06.383963] [INFO ] [REMOTE ] TME: Full fetch complete (76932 records). [2025-10-03T21:56:06.384181] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-03T21:56:06.396985] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-03T21:56:06.825672] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-03T21:56:06.825980] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-03T21:56:06.827356] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-03T21:56:06.827450] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-03T21:56:06.833451] [DEBUG] [LOCAL ] TME: Trimmed 76932 records to 53971 (keeping 200 days of data) [2025-10-03T21:56:06.980665] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T21:56:07.196455] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-03T21:56:07.247151] [DEBUG] [LOCAL ] TME: Primary data saved (53971 records). [2025-10-03T21:56:07.247344] [INFO ] [MAIN ] TME: Full history saved. [2025-10-03T21:56:07.248608] [INFO ] [MAIN ] Update Progress: 2105/2370 symbols completed. TME took 38.9s. Estimated remaining: 37m 16s. Rate: 7.1 symbols/min [2025-10-03T21:56:07.430177] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:07.468226] [DEBUG] [LOCAL ] TNET: Loaded 28712 existing records from primary storage. [2025-10-03T21:56:07.468568] [INFO ] [MAIN ] TNET: Loaded 28712 existing records. [2025-10-03T21:56:07.598248] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T21:56:07.695375] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:07.695785] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-03T21:56:07.695858] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-03T21:56:07.696319] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-03T21:56:07.696382] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-03T21:56:07.998018] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-03T21:56:08.127417] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:08.689820] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T21:56:08.790712] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-03T21:56:09.590737] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-03T21:56:09.953634] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T21:56:10.104439] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T21:56:10.390745] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-03T21:56:10.944549] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T21:56:11.190726] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-03T21:56:11.583234] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T21:56:11.990720] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-03T21:56:12.203405] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T21:56:12.790701] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-03T21:56:13.590721] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-03T21:56:13.832242] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T21:56:14.245927] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T21:56:14.390745] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-03T21:56:14.581397] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T21:56:15.190737] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-03T21:56:15.896611] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T21:56:15.990725] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-03T21:56:16.801502] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-03T21:56:16.823406] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T21:56:17.423134] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T21:56:17.590729] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-03T21:56:17.711504] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T21:56:18.054718] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:56:18.057834] [INFO ] [REMOTE ] TMO: Full fetch complete (75508 records). [2025-10-03T21:56:18.058010] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-03T21:56:18.395777] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-03T21:56:18.483270] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-03T21:56:18.483363] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-03T21:56:18.484687] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-03T21:56:18.484768] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-03T21:56:18.486725] [DEBUG] [LOCAL ] TMO: Trimmed 75508 records to 53122 (keeping 200 days of data) [2025-10-03T21:56:18.849533] [DEBUG] [LOCAL ] TMO: Primary data saved (53122 records). [2025-10-03T21:56:18.849740] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-03T21:56:18.849869] [INFO ] [MAIN ] Update Progress: 2106/2370 symbols completed. TMO took 32.3s. Estimated remaining: 37m 8s. Rate: 7.1 symbols/min [2025-10-03T21:56:19.031541] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:19.031819] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-03T21:56:19.031877] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-03T21:56:19.032005] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-03T21:56:19.032051] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-03T21:56:19.032095] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-03T21:56:19.032130] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-03T21:56:19.200963] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-03T21:56:19.474217] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:19.661887] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T21:56:19.990709] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-03T21:56:20.210011] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T21:56:20.790732] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-03T21:56:20.998054] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T21:56:20.998453] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-03T21:56:20.998576] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:56:20.998626] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-03T21:56:20.998703] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:56:20.998781] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-03T21:56:20.998898] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-03T21:56:20.998953] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-03T21:56:20.999013] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-03T21:56:20.999091] [INFO ] [MAIN ] Update Progress: 2107/2370 symbols completed. TNGY took 2.1s. Estimated remaining: 36m 59s. Rate: 7.1 symbols/min [2025-10-03T21:56:21.185160] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:21.220751] [DEBUG] [LOCAL ] TNK: Loaded 35408 existing records from primary storage. [2025-10-03T21:56:21.221099] [INFO ] [MAIN ] TNK: Loaded 35408 existing records. [2025-10-03T21:56:21.427436] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:21.427765] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-03T21:56:21.427853] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-03T21:56:21.428113] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-03T21:56:21.428196] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-03T21:56:21.600357] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-03T21:56:21.870480] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:21.874667] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T21:56:22.386064] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T21:56:22.387343] [INFO ] [REMOTE ] TNC: Full fetch complete (22862 records). [2025-10-03T21:56:22.387508] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-03T21:56:22.399732] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-03T21:56:22.795989] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-03T21:56:22.796127] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-03T21:56:22.796893] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-03T21:56:22.796975] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-03T21:56:22.798234] [DEBUG] [LOCAL ] TNC: Trimmed 22862 records to 15048 (keeping 200 days of data) [2025-10-03T21:56:22.919084] [DEBUG] [LOCAL ] TNC: Primary data saved (15048 records). [2025-10-03T21:56:22.919272] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-03T21:56:22.919386] [INFO ] [MAIN ] Update Progress: 2108/2370 symbols completed. TNC took 29.1s. Estimated remaining: 36m 50s. Rate: 7.1 symbols/min [2025-10-03T21:56:23.103122] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:23.147222] [DEBUG] [LOCAL ] TNL: Loaded 41980 existing records from primary storage. [2025-10-03T21:56:23.147567] [INFO ] [MAIN ] TNL: Loaded 41980 existing records. [2025-10-03T21:56:23.195834] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-03T21:56:23.363034] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:23.363426] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-03T21:56:23.363493] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-03T21:56:23.363811] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-03T21:56:23.363873] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-03T21:56:23.793352] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T21:56:23.797615] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:23.990722] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-03T21:56:24.670016] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T21:56:24.790718] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-03T21:56:25.382120] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T21:56:25.590722] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-03T21:56:25.902145] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T21:56:26.390709] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-03T21:56:26.943454] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T21:56:27.190714] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-03T21:56:27.990733] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-03T21:56:28.051380] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T21:56:28.374215] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T21:56:28.376892] [INFO ] [REMOTE ] TMHC: Full fetch complete (65949 records). [2025-10-03T21:56:28.377160] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-03T21:56:28.792495] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-03T21:56:28.811590] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-03T21:56:28.811717] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-03T21:56:28.813094] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-03T21:56:28.813244] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-03T21:56:28.815001] [DEBUG] [LOCAL ] TMHC: Trimmed 65949 records to 45995 (keeping 200 days of data) [2025-10-03T21:56:29.107628] [DEBUG] [LOCAL ] TMHC: Primary data saved (45995 records). [2025-10-03T21:56:29.107875] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-03T21:56:29.108064] [INFO ] [MAIN ] Update Progress: 2109/2370 symbols completed. TMHC took 46.4s. Estimated remaining: 36m 41s. Rate: 7.1 symbols/min [2025-10-03T21:56:29.318636] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:29.320828] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T21:56:29.393594] [DEBUG] [LOCAL ] TOL: Loaded 51170 existing records from primary storage. [2025-10-03T21:56:29.394153] [INFO ] [MAIN ] TOL: Loaded 51170 existing records. [2025-10-03T21:56:29.596143] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-03T21:56:29.602073] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:29.602801] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-03T21:56:29.602886] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-03T21:56:29.604329] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-03T21:56:29.604419] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-03T21:56:29.991301] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:30.255835] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T21:56:30.390697] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-03T21:56:30.913946] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T21:56:31.190713] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-03T21:56:31.822910] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T21:56:31.990743] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-03T21:56:32.137571] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:56:32.140514] [INFO ] [REMOTE ] TNET: Full fetch complete (41696 records). [2025-10-03T21:56:32.140730] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-03T21:56:32.566364] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-03T21:56:32.566490] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-03T21:56:32.567915] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-03T21:56:32.567991] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-03T21:56:32.569270] [DEBUG] [LOCAL ] TNET: Trimmed 41696 records to 28898 (keeping 200 days of data) [2025-10-03T21:56:32.769471] [DEBUG] [LOCAL ] TNET: Primary data saved (28898 records). [2025-10-03T21:56:32.769662] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-03T21:56:32.770812] [INFO ] [MAIN ] Update Progress: 2110/2370 symbols completed. TNET took 25.5s. Estimated remaining: 36m 32s. Rate: 7.1 symbols/min [2025-10-03T21:56:32.800616] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-03T21:56:32.967253] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:33.035323] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-10-03T21:56:33.035813] [INFO ] [MAIN ] TOST: Loaded 54071 existing records. [2025-10-03T21:56:33.225074] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:33.225419] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-03T21:56:33.225477] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-03T21:56:33.225824] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-03T21:56:33.225883] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-03T21:56:33.599890] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-03T21:56:33.606284] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:33.853604] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T21:56:34.381946] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T21:56:34.390736] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-03T21:56:34.996496] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T21:56:35.190717] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-03T21:56:35.972244] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T21:56:35.990613] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-03T21:56:36.790696] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-03T21:56:37.076157] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T21:56:37.513363] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:56:37.590733] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-03T21:56:37.868141] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T21:56:38.390760] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-03T21:56:39.190679] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-03T21:56:39.520859] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T21:56:39.860694] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T21:56:39.990765] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-03T21:56:40.790741] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-03T21:56:41.084156] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T21:56:41.347408] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T21:56:41.590772] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-03T21:56:42.305966] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:56:42.390711] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-03T21:56:43.190670] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-03T21:56:43.368042] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T21:56:43.995176] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-03T21:56:44.008306] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T21:56:44.790678] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-03T21:56:45.103444] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T21:56:45.179086] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T21:56:45.590755] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-03T21:56:46.390741] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-03T21:56:46.439571] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T21:56:46.982358] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T21:56:47.190743] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-03T21:56:47.990690] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-03T21:56:48.262435] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T21:56:48.264604] [INFO ] [REMOTE ] TNK: Full fetch complete (51836 records). [2025-10-03T21:56:48.264762] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-03T21:56:48.621143] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-03T21:56:48.726847] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-03T21:56:48.726945] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-03T21:56:48.728604] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-03T21:56:48.728698] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-03T21:56:48.730352] [DEBUG] [LOCAL ] TNK: Trimmed 51836 records to 35616 (keeping 200 days of data) [2025-10-03T21:56:48.793505] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-03T21:56:48.967379] [DEBUG] [LOCAL ] TNK: Primary data saved (35616 records). [2025-10-03T21:56:48.967557] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-03T21:56:48.967677] [INFO ] [MAIN ] Update Progress: 2111/2370 symbols completed. TNK took 28.0s. Estimated remaining: 36m 24s. Rate: 7.1 symbols/min [2025-10-03T21:56:49.136506] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:56:49.165681] [DEBUG] [LOCAL ] TPB: Loaded 25252 existing records from primary storage. [2025-10-03T21:56:49.166013] [INFO ] [MAIN ] TPB: Loaded 25252 existing records. [2025-10-03T21:56:49.353429] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:56:49.353730] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-03T21:56:49.353788] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-03T21:56:49.354061] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-03T21:56:49.354121] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-03T21:56:49.616011] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-03T21:56:49.722244] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:56:49.756929] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T21:56:50.390734] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-03T21:56:50.673086] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T21:56:50.797940] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T21:56:51.190638] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-03T21:56:51.540263] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T21:56:51.990737] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-03T21:56:52.706397] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T21:56:52.790621] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-03T21:56:53.182502] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T21:56:53.590730] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-03T21:56:54.382553] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T21:56:54.391917] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-03T21:56:55.190738] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-03T21:56:55.234436] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T21:56:55.990745] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-03T21:56:56.257504] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T21:56:56.282284] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T21:56:56.790731] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-03T21:56:57.344339] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T21:56:57.590723] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-03T21:56:57.958639] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T21:56:58.390750] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-03T21:56:59.163084] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T21:56:59.190615] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-03T21:56:59.990731] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-03T21:57:00.255254] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T21:57:00.294010] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T21:57:00.297114] [INFO ] [REMOTE ] TNL: Full fetch complete (59038 records). [2025-10-03T21:57:00.297244] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-03T21:57:00.702471] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-03T21:57:00.702571] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-03T21:57:00.704144] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-03T21:57:00.704211] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-03T21:57:00.706167] [DEBUG] [LOCAL ] TNL: Trimmed 59038 records to 42274 (keeping 200 days of data) [2025-10-03T21:57:00.797367] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-03T21:57:00.997617] [DEBUG] [LOCAL ] TNL: Primary data saved (42274 records). [2025-10-03T21:57:00.997829] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-03T21:57:00.997983] [INFO ] [MAIN ] Update Progress: 2112/2370 symbols completed. TNL took 38.1s. Estimated remaining: 36m 16s. Rate: 7.1 symbols/min [2025-10-03T21:57:01.177994] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:01.221184] [DEBUG] [LOCAL ] TPC: Loaded 39075 existing records from primary storage. [2025-10-03T21:57:01.221548] [INFO ] [MAIN ] TPC: Loaded 39075 existing records. [2025-10-03T21:57:01.446095] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:01.449567] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T21:57:01.449798] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-03T21:57:01.454930] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-03T21:57:01.455805] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-03T21:57:01.455871] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-03T21:57:01.591616] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-03T21:57:01.912131] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:02.390771] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-03T21:57:02.547348] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T21:57:03.190728] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-03T21:57:03.365080] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T21:57:03.742526] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T21:57:03.990708] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-03T21:57:04.790674] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-03T21:57:04.944151] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T21:57:05.590745] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-03T21:57:05.903609] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T21:57:06.096355] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T21:57:06.390726] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-03T21:57:07.070457] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T21:57:07.190697] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-03T21:57:07.990675] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-03T21:57:08.468410] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T21:57:08.654859] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T21:57:08.657907] [INFO ] [REMOTE ] TOL: Full fetch complete (73714 records). [2025-10-03T21:57:08.658058] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-03T21:57:08.795757] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-03T21:57:09.085442] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-03T21:57:09.085703] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-03T21:57:09.088300] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-03T21:57:09.088443] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-03T21:57:09.090562] [DEBUG] [LOCAL ] TOL: Trimmed 73714 records to 51534 (keeping 200 days of data) [2025-10-03T21:57:09.356504] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T21:57:09.491073] [DEBUG] [LOCAL ] TOL: Primary data saved (51534 records). [2025-10-03T21:57:09.491275] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-03T21:57:09.491402] [INFO ] [MAIN ] Update Progress: 2113/2370 symbols completed. TOL took 40.4s. Estimated remaining: 36m 8s. Rate: 7.1 symbols/min [2025-10-03T21:57:09.596108] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-03T21:57:09.689443] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:09.744737] [DEBUG] [LOCAL ] TPH: Loaded 45247 existing records from primary storage. [2025-10-03T21:57:09.745155] [INFO ] [MAIN ] TPH: Loaded 45247 existing records. [2025-10-03T21:57:09.939263] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:09.939557] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-03T21:57:09.939611] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-03T21:57:09.940093] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-03T21:57:09.940154] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-03T21:57:10.381706] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:10.390676] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-03T21:57:10.937738] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T21:57:11.014783] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T21:57:11.190716] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-03T21:57:11.990688] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-03T21:57:12.056377] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T21:57:12.790721] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-03T21:57:12.850260] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T21:57:12.853958] [INFO ] [REMOTE ] TOST: Full fetch complete (77699 records). [2025-10-03T21:57:12.854240] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-03T21:57:13.353081] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-03T21:57:13.354844] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T21:57:13.360828] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-03T21:57:13.362858] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-03T21:57:13.363412] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-03T21:57:13.365389] [DEBUG] [LOCAL ] TOST: Trimmed 77699 records to 54461 (keeping 200 days of data) [2025-10-03T21:57:13.609635] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-03T21:57:13.742978] [DEBUG] [LOCAL ] TOST: Primary data saved (54461 records). [2025-10-03T21:57:13.743169] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-03T21:57:13.745021] [INFO ] [MAIN ] Update Progress: 2114/2370 symbols completed. TOST took 41.0s. Estimated remaining: 35m 59s. Rate: 7.1 symbols/min [2025-10-03T21:57:13.938408] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:13.955283] [DEBUG] [LOCAL ] TPL: Loaded 12395 existing records from primary storage. [2025-10-03T21:57:13.955584] [INFO ] [MAIN ] TPL: Loaded 12395 existing records. [2025-10-03T21:57:14.161914] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:14.162412] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-03T21:57:14.162527] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-03T21:57:14.187693] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-03T21:57:14.188567] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-03T21:57:14.195035] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T21:57:14.395636] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-03T21:57:14.603201] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:14.929501] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T21:57:15.190710] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-03T21:57:15.934934] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T21:57:15.990693] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-03T21:57:16.424121] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T21:57:16.790723] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-03T21:57:17.332928] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T21:57:17.590762] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-03T21:57:18.376927] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T21:57:18.390618] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-03T21:57:19.050990] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T21:57:19.190674] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-03T21:57:19.894201] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T21:57:19.990701] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-03T21:57:20.790694] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-03T21:57:20.882841] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T21:57:21.541384] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T21:57:21.590671] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-03T21:57:21.776464] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T21:57:22.390701] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-03T21:57:22.911092] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T21:57:23.190703] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-03T21:57:23.265355] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T21:57:23.990737] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-03T21:57:24.763254] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T21:57:24.790670] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-03T21:57:25.050858] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T21:57:25.052848] [INFO ] [REMOTE ] TPB: Full fetch complete (35247 records). [2025-10-03T21:57:25.052938] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-03T21:57:25.458794] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-03T21:57:25.458899] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-03T21:57:25.459809] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-03T21:57:25.459875] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-03T21:57:25.460865] [DEBUG] [LOCAL ] TPB: Trimmed 35247 records to 25596 (keeping 200 days of data) [2025-10-03T21:57:25.590978] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-03T21:57:25.643363] [DEBUG] [LOCAL ] TPB: Primary data saved (25596 records). [2025-10-03T21:57:25.643536] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-03T21:57:25.643674] [INFO ] [MAIN ] Update Progress: 2115/2370 symbols completed. TPB took 36.7s. Estimated remaining: 35m 51s. Rate: 7.1 symbols/min [2025-10-03T21:57:25.820158] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:25.892619] [DEBUG] [LOCAL ] TPR: Loaded 53851 existing records from primary storage. [2025-10-03T21:57:25.893155] [INFO ] [MAIN ] TPR: Loaded 53851 existing records. [2025-10-03T21:57:26.087424] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:26.087878] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-03T21:57:26.087940] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-03T21:57:26.091798] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-03T21:57:26.091884] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-03T21:57:26.396798] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-03T21:57:26.519088] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:26.538267] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T21:57:27.077001] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T21:57:27.190708] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-03T21:57:27.328299] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T21:57:27.990704] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-03T21:57:28.790680] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-03T21:57:28.957362] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T21:57:29.071358] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T21:57:29.590749] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-03T21:57:29.826355] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T21:57:29.828812] [INFO ] [REMOTE ] TPC: Full fetch complete (55306 records). [2025-10-03T21:57:29.828932] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-03T21:57:30.276854] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-03T21:57:30.276973] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-03T21:57:30.278356] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-03T21:57:30.278626] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-03T21:57:30.280199] [DEBUG] [LOCAL ] TPC: Trimmed 55306 records to 39333 (keeping 200 days of data) [2025-10-03T21:57:30.390723] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-03T21:57:30.523795] [DEBUG] [LOCAL ] TPC: Primary data saved (39333 records). [2025-10-03T21:57:30.523985] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-03T21:57:30.524093] [INFO ] [MAIN ] Update Progress: 2116/2370 symbols completed. TPC took 29.5s. Estimated remaining: 35m 42s. Rate: 7.1 symbols/min [2025-10-03T21:57:30.714459] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:30.743702] [DEBUG] [LOCAL ] TPVG: Loaded 27131 existing records from primary storage. [2025-10-03T21:57:30.744034] [INFO ] [MAIN ] TPVG: Loaded 27131 existing records. [2025-10-03T21:57:30.940432] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:30.940696] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-03T21:57:30.940758] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-03T21:57:30.940993] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-03T21:57:30.941054] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-03T21:57:31.195931] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-03T21:57:31.320344] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:31.402881] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T21:57:31.545154] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T21:57:31.990729] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-03T21:57:32.359918] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T21:57:32.790758] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-03T21:57:33.485933] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T21:57:33.590742] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-03T21:57:34.310017] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T21:57:34.390626] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-03T21:57:34.785332] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T21:57:35.190744] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-03T21:57:35.990667] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-03T21:57:36.344816] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T21:57:36.792754] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-03T21:57:36.811120] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T21:57:36.848191] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T21:57:37.590639] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-03T21:57:38.390669] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-03T21:57:38.702519] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T21:57:39.116712] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T21:57:39.137638] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T21:57:39.190633] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-03T21:57:39.990694] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-03T21:57:40.137454] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T21:57:40.790723] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-03T21:57:41.454005] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T21:57:41.590715] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-03T21:57:41.694004] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T21:57:42.390713] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-03T21:57:43.190718] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-03T21:57:43.292107] [DEBUG] [REMOTE ] TPL: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T21:57:43.292540] [WARN ] [REMOTE ] TPL: No data returned for month 2025-09 [2025-10-03T21:57:43.292768] [FATAL] [REMOTE ] TPL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T21:57:43.292865] [FATAL] [MAIN ] TPL: Failed to fetch primary data. [2025-10-03T21:57:43.292902] [WARN ] [MAIN ] TPL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T21:57:43.292952] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-03T21:57:43.293012] [DEBUG] [LOCAL ] TPL: No primary data file found to delete. [2025-10-03T21:57:43.293049] [INFO ] [LOCAL ] TPL: Starting deletion of derivative data. [2025-10-03T21:57:43.293541] [DEBUG] [LOCAL ] TPL: Deleted derivative data file. [2025-10-03T21:57:43.293692] [INFO ] [MAIN ] Update Progress: 2117/2370 symbols completed. TPL took 29.5s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-03T21:57:43.483510] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T21:57:43.510977] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T21:57:43.990691] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-03T21:57:44.790764] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-03T21:57:45.312113] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T21:57:45.590698] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-03T21:57:46.335908] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T21:57:46.390706] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-03T21:57:46.438042] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T21:57:47.190750] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-03T21:57:47.632019] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T21:57:47.634333] [INFO ] [REMOTE ] TPH: Full fetch complete (64999 records). [2025-10-03T21:57:47.634441] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-03T21:57:47.995846] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-03T21:57:48.055015] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-03T21:57:48.055121] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-03T21:57:48.056345] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-03T21:57:48.056415] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-03T21:57:48.058573] [DEBUG] [LOCAL ] TPH: Trimmed 64999 records to 45572 (keeping 200 days of data) [2025-10-03T21:57:48.345749] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T21:57:48.358061] [DEBUG] [LOCAL ] TPH: Primary data saved (45572 records). [2025-10-03T21:57:48.358196] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-03T21:57:48.358324] [INFO ] [MAIN ] Update Progress: 2118/2370 symbols completed. TPH took 38.9s. Estimated remaining: 35m 25s. Rate: 7.1 symbols/min [2025-10-03T21:57:48.790704] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-03T21:57:49.798282] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T21:57:49.811091] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-03T21:57:50.020442] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T21:57:50.390735] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-03T21:57:51.578890] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T21:57:51.587945] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-03T21:57:51.839754] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T21:57:51.990738] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-03T21:57:52.810493] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T21:57:52.820467] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-03T21:57:53.819242] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T21:57:53.836380] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-03T21:57:54.119183] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T21:57:54.132854] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-03T21:57:54.147992] [INFO ] [REMOTE ] TPR: Full fetch complete (77414 records). [2025-10-03T21:57:54.148206] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-03T21:57:54.396238] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-03T21:57:54.618081] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-03T21:57:54.618436] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-03T21:57:54.619763] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-03T21:57:54.619831] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-03T21:57:54.621925] [DEBUG] [LOCAL ] TPR: Trimmed 77414 records to 54234 (keeping 200 days of data) [2025-10-03T21:57:54.990937] [DEBUG] [LOCAL ] TPR: Primary data saved (54234 records). [2025-10-03T21:57:54.991117] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-03T21:57:54.991264] [INFO ] [MAIN ] Update Progress: 2119/2370 symbols completed. TPR took 29.3s. Estimated remaining: 35m 17s. Rate: 7.1 symbols/min [2025-10-03T21:57:55.598120] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T21:57:55.600127] [INFO ] [REMOTE ] TPVG: Full fetch complete (40256 records). [2025-10-03T21:57:55.600227] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-03T21:57:56.010559] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-03T21:57:56.010686] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-03T21:57:56.011682] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-03T21:57:56.011750] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-03T21:57:56.012976] [DEBUG] [LOCAL ] TPVG: Trimmed 40256 records to 27322 (keeping 200 days of data) [2025-10-03T21:57:56.195533] [DEBUG] [LOCAL ] TPVG: Primary data saved (27322 records). [2025-10-03T21:57:56.195764] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-03T21:57:56.195907] [INFO ] [MAIN ] Update Progress: 2120/2370 symbols completed. TPVG took 25.7s. Estimated remaining: 35m 8s. Rate: 7.1 symbols/min [2025-10-03T21:57:56.955427] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:56.999263] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:57.027066] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:57.029927] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:57:57.043388] [DEBUG] [LOCAL ] TPZ: Loaded 4967 existing records from primary storage. [2025-10-03T21:57:57.047684] [DEBUG] [LOCAL ] TRAK: Loaded 9469 existing records from primary storage. [2025-10-03T21:57:57.047962] [INFO ] [MAIN ] TPZ: Loaded 4967 existing records. [2025-10-03T21:57:57.065961] [INFO ] [MAIN ] TRAK: Loaded 9469 existing records. [2025-10-03T21:57:57.218121] [DEBUG] [LOCAL ] TR: Loaded 18638 existing records from primary storage. [2025-10-03T21:57:57.202771] [DEBUG] [LOCAL ] TPYP: Loaded 7958 existing records from primary storage. [2025-10-03T21:57:57.263888] [INFO ] [MAIN ] TR: Loaded 18638 existing records. [2025-10-03T21:57:57.269274] [INFO ] [MAIN ] TPYP: Loaded 7958 existing records. [2025-10-03T21:57:57.504807] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:57.619310] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-03T21:57:57.691820] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:57.721407] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-03T21:57:57.733063] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-03T21:57:57.721533] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-03T21:57:57.738412] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-03T21:57:57.749045] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-03T21:57:57.748942] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-03T21:57:57.802542] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-03T21:57:57.808838] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:57.922344] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:57:57.932857] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-03T21:57:57.984696] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-03T21:57:58.040634] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-03T21:57:58.046226] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-03T21:57:58.083844] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-03T21:57:58.099428] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-03T21:57:58.099854] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-03T21:57:58.099723] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-03T21:57:59.151012] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:59.241383] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-03T21:57:59.305450] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:59.327988] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-03T21:57:59.496198] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:59.512181] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-03T21:57:59.536634] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:57:59.537040] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-03T21:58:00.180772] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T21:58:00.189752] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-03T21:58:00.190533] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T21:58:00.193075] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-03T21:58:00.280588] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T21:58:00.283102] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-03T21:58:00.404037] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T21:58:00.768577] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T21:58:00.790630] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-03T21:58:00.894771] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T21:58:01.048407] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T21:58:01.521216] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T21:58:01.590778] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-03T21:58:02.329345] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T21:58:02.390678] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-03T21:58:03.190675] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-03T21:58:03.333384] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T21:58:03.966772] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T21:58:03.990600] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-03T21:58:04.760255] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T21:58:04.790694] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-03T21:58:05.590718] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-03T21:58:05.631891] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T21:58:06.390709] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-03T21:58:06.428332] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T21:58:07.153860] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T21:58:07.190618] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-03T21:58:07.990713] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-03T21:58:08.111050] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T21:58:08.623018] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T21:58:08.790704] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-03T21:58:09.590638] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-03T21:58:09.825671] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T21:58:10.333182] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T21:58:10.390751] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-03T21:58:11.190742] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-03T21:58:11.259439] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T21:58:11.990733] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-03T21:58:12.248996] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T21:58:12.790706] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-03T21:58:12.823878] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T21:58:13.524674] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T21:58:13.590733] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-03T21:58:14.173189] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T21:58:14.390719] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-03T21:58:15.143442] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T21:58:15.190619] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-03T21:58:15.990700] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-03T21:58:16.022076] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T21:58:16.790750] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-03T21:58:17.122057] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T21:58:17.590743] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-03T21:58:17.631943] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T21:58:18.314407] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T21:58:18.390624] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-03T21:58:19.166337] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T21:58:19.190629] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-03T21:58:19.942943] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T21:58:19.990632] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-03T21:58:20.509908] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T21:58:20.510952] [INFO ] [REMOTE ] TPYP: Full fetch complete (12559 records). [2025-10-03T21:58:20.511038] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-03T21:58:20.795833] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-03T21:58:20.949687] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-03T21:58:20.949841] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-03T21:58:20.950309] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-03T21:58:20.950356] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-03T21:58:20.951074] [DEBUG] [LOCAL ] TPYP: Trimmed 12559 records to 8005 (keeping 200 days of data) [2025-10-03T21:58:21.010010] [DEBUG] [LOCAL ] TPYP: Primary data saved (8005 records). [2025-10-03T21:58:21.010150] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-03T21:58:21.010246] [INFO ] [MAIN ] Update Progress: 2121/2370 symbols completed. TPYP took 24.8s. Estimated remaining: 35m 1s. Rate: 7.1 symbols/min [2025-10-03T21:58:21.182318] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:58:21.590708] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-03T21:58:21.625708] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T21:58:22.390727] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-03T21:58:22.779928] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T21:58:22.845659] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T21:58:23.190746] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-03T21:58:23.990736] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-03T21:58:24.053268] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T21:58:24.240237] [DEBUG] [LOCAL ] TRC: Loaded 15837 existing records from primary storage. [2025-10-03T21:58:24.240685] [INFO ] [MAIN ] TRC: Loaded 15837 existing records. [2025-10-03T21:58:24.437530] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:58:24.437827] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-03T21:58:24.437905] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-03T21:58:24.438207] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-03T21:58:24.438268] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-03T21:58:24.734609] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T21:58:24.802513] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-03T21:58:24.849791] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:58:25.409890] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T21:58:25.590719] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-03T21:58:26.188996] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T21:58:26.390769] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-03T21:58:27.190676] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-03T21:58:27.427589] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T21:58:27.788384] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T21:58:27.789699] [INFO ] [REMOTE ] TRAK: Full fetch complete (13511 records). [2025-10-03T21:58:27.789781] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-03T21:58:27.995783] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-03T21:58:28.175894] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-03T21:58:28.175987] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-03T21:58:28.176472] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-03T21:58:28.176515] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-03T21:58:28.177123] [DEBUG] [LOCAL ] TRAK: Trimmed 13511 records to 9541 (keeping 200 days of data) [2025-10-03T21:58:28.247077] [DEBUG] [LOCAL ] TRAK: Primary data saved (9541 records). [2025-10-03T21:58:28.247253] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-03T21:58:28.247382] [INFO ] [MAIN ] Update Progress: 2122/2370 symbols completed. TRAK took 32.0s. Estimated remaining: 34m 52s. Rate: 7.1 symbols/min [2025-10-03T21:58:28.424340] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:58:28.459300] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T21:58:28.460383] [INFO ] [REMOTE ] TPZ: Full fetch complete (9214 records). [2025-10-03T21:58:28.460483] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-03T21:58:28.592923] [DEBUG] [LOCAL ] TREX: Loaded 50298 existing records from primary storage. [2025-10-03T21:58:28.627145] [INFO ] [MAIN ] TREX: Loaded 50298 existing records. [2025-10-03T21:58:28.796748] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-03T21:58:29.025941] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:58:29.064906] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-03T21:58:29.072026] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-03T21:58:29.072242] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-03T21:58:29.072432] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-03T21:58:29.073024] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-03T21:58:29.073200] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-03T21:58:29.073124] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-03T21:58:29.073481] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-03T21:58:29.120847] [DEBUG] [LOCAL ] TPZ: Trimmed 9214 records to 4989 (keeping 200 days of data) [2025-10-03T21:58:29.432078] [DEBUG] [LOCAL ] TPZ: Primary data saved (4989 records). [2025-10-03T21:58:29.447796] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-03T21:58:29.448032] [INFO ] [MAIN ] Update Progress: 2123/2370 symbols completed. TPZ took 33.3s. Estimated remaining: 34m 43s. Rate: 7.1 symbols/min [2025-10-03T21:58:29.563075] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:58:29.591881] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-03T21:58:29.708341] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:58:29.773663] [DEBUG] [LOCAL ] TRGP: Loaded 51077 existing records from primary storage. [2025-10-03T21:58:29.774091] [INFO ] [MAIN ] TRGP: Loaded 51077 existing records. [2025-10-03T21:58:29.969981] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:58:29.975614] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-03T21:58:29.982607] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-03T21:58:29.983945] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T21:58:29.983991] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-03T21:58:29.984129] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-03T21:58:30.395968] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-03T21:58:30.431923] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:58:30.679292] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T21:58:31.190766] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-03T21:58:31.990772] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-03T21:58:32.058088] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T21:58:32.099115] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T21:58:32.790692] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-03T21:58:32.823883] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T21:58:32.825524] [INFO ] [REMOTE ] TR: Full fetch complete (25271 records). [2025-10-03T21:58:32.825606] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-03T21:58:33.215789] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-03T21:58:33.215880] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-03T21:58:33.216608] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-03T21:58:33.216701] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-03T21:58:33.217553] [DEBUG] [LOCAL ] TR: Trimmed 25271 records to 18821 (keeping 200 days of data) [2025-10-03T21:58:33.339501] [DEBUG] [LOCAL ] TR: Primary data saved (18821 records). [2025-10-03T21:58:33.339729] [INFO ] [MAIN ] TR: Full history saved. [2025-10-03T21:58:33.339871] [INFO ] [MAIN ] Update Progress: 2124/2370 symbols completed. TR took 37.1s. Estimated remaining: 34m 34s. Rate: 7.1 symbols/min [2025-10-03T21:58:33.517713] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:58:33.554593] [DEBUG] [LOCAL ] TRN: Loaded 37268 existing records from primary storage. [2025-10-03T21:58:33.555001] [INFO ] [MAIN ] TRN: Loaded 37268 existing records. [2025-10-03T21:58:33.598600] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-03T21:58:33.675880] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T21:58:33.762040] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:58:33.762359] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-03T21:58:33.762421] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-03T21:58:33.762746] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-03T21:58:33.762817] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-03T21:58:34.168432] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:58:34.390725] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-03T21:58:35.190735] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-03T21:58:35.236508] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T21:58:35.345518] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T21:58:35.990681] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-03T21:58:36.289685] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T21:58:36.790717] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-03T21:58:37.438843] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T21:58:37.590682] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-03T21:58:37.970944] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T21:58:38.390715] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-03T21:58:39.190718] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-03T21:58:39.343683] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T21:58:39.773970] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T21:58:39.832734] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T21:58:39.990761] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-03T21:58:40.790717] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-03T21:58:41.014156] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T21:58:41.590768] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-03T21:58:42.390753] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-03T21:58:42.615380] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T21:58:42.624210] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T21:58:43.190700] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-03T21:58:43.684790] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T21:58:43.990724] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-03T21:58:44.790728] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-03T21:58:44.889510] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T21:58:45.348424] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T21:58:45.590743] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-03T21:58:46.249607] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T21:58:46.390700] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-03T21:58:47.190765] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-03T21:58:47.393401] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T21:58:47.887497] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T21:58:47.955258] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T21:58:47.990630] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-03T21:58:48.790721] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-03T21:58:49.437206] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T21:58:49.590665] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-03T21:58:49.723602] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T21:58:50.390721] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-03T21:58:50.911943] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T21:58:51.127104] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T21:58:51.128430] [INFO ] [REMOTE ] TRC: Full fetch complete (22067 records). [2025-10-03T21:58:51.128509] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-03T21:58:51.195754] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-03T21:58:51.533304] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-03T21:58:51.533527] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-03T21:58:51.534546] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-03T21:58:51.534686] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-03T21:58:51.537123] [DEBUG] [LOCAL ] TRC: Trimmed 22067 records to 15954 (keeping 200 days of data) [2025-10-03T21:58:51.644458] [DEBUG] [LOCAL ] TRC: Primary data saved (15954 records). [2025-10-03T21:58:51.644635] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-03T21:58:51.644832] [INFO ] [MAIN ] Update Progress: 2125/2370 symbols completed. TRC took 30.6s. Estimated remaining: 34m 27s. Rate: 7.1 symbols/min [2025-10-03T21:58:51.831409] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:58:51.878325] [DEBUG] [LOCAL ] TRNO: Loaded 44244 existing records from primary storage. [2025-10-03T21:58:51.878718] [INFO ] [MAIN ] TRNO: Loaded 44244 existing records. [2025-10-03T21:58:51.995925] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-03T21:58:52.073318] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:58:52.073982] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-03T21:58:52.074039] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-03T21:58:52.074347] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-03T21:58:52.074417] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-03T21:58:52.476445] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:58:52.790686] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-03T21:58:52.955269] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T21:58:53.590674] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-03T21:58:53.624591] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T21:58:54.070740] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T21:58:54.390741] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-03T21:58:55.190730] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-03T21:58:55.332834] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T21:58:55.995729] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-03T21:58:56.009181] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T21:58:56.786589] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T21:58:56.795124] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-03T21:58:57.251685] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T21:58:57.590755] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-03T21:58:58.267482] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T21:58:58.390724] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-03T21:58:58.535629] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T21:58:59.190734] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-03T21:58:59.990632] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-03T21:59:00.094385] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T21:59:00.769331] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T21:59:00.790628] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-03T21:59:01.590768] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-03T21:59:01.845942] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T21:59:02.390667] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-03T21:59:02.467855] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T21:59:03.190734] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-03T21:59:03.315869] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T21:59:03.336321] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T21:59:03.339951] [INFO ] [REMOTE ] TRN: Full fetch complete (52820 records). [2025-10-03T21:59:03.340224] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-03T21:59:03.835713] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-03T21:59:03.835844] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-03T21:59:03.837335] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-03T21:59:03.837428] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-03T21:59:03.839347] [DEBUG] [LOCAL ] TRN: Trimmed 52820 records to 37474 (keeping 200 days of data) [2025-10-03T21:59:04.029060] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-03T21:59:04.109784] [DEBUG] [LOCAL ] TRN: Primary data saved (37474 records). [2025-10-03T21:59:04.109998] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-03T21:59:04.110143] [INFO ] [MAIN ] Update Progress: 2126/2370 symbols completed. TRN took 30.8s. Estimated remaining: 34m 19s. Rate: 7.1 symbols/min [2025-10-03T21:59:04.319128] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:04.373935] [DEBUG] [LOCAL ] TROX: Loaded 52262 existing records from primary storage. [2025-10-03T21:59:04.374350] [INFO ] [MAIN ] TROX: Loaded 52262 existing records. [2025-10-03T21:59:04.578765] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:04.579243] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-03T21:59:04.579452] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-03T21:59:04.579974] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-03T21:59:04.580237] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-03T21:59:04.751355] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T21:59:04.819105] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-03T21:59:05.039013] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:05.590738] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-03T21:59:05.894615] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T21:59:06.390743] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-03T21:59:06.623219] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T21:59:07.186132] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T21:59:07.195182] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-03T21:59:07.931375] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T21:59:07.990778] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-03T21:59:08.511460] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T21:59:08.514796] [INFO ] [REMOTE ] TREX: Full fetch complete (71082 records). [2025-10-03T21:59:08.514943] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-03T21:59:08.795922] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-03T21:59:08.954877] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-03T21:59:08.955068] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-03T21:59:08.956506] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-03T21:59:08.956584] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-03T21:59:08.958562] [DEBUG] [LOCAL ] TREX: Trimmed 71082 records to 50660 (keeping 200 days of data) [2025-10-03T21:59:09.273028] [DEBUG] [LOCAL ] TREX: Primary data saved (50660 records). [2025-10-03T21:59:09.273209] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-03T21:59:09.273370] [INFO ] [MAIN ] Update Progress: 2127/2370 symbols completed. TREX took 41.0s. Estimated remaining: 34m 10s. Rate: 7.1 symbols/min [2025-10-03T21:59:09.458928] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:09.513781] [DEBUG] [LOCAL ] TRP: Loaded 52487 existing records from primary storage. [2025-10-03T21:59:09.514182] [INFO ] [MAIN ] TRP: Loaded 52487 existing records. [2025-10-03T21:59:09.598578] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-03T21:59:09.739854] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:09.742216] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T21:59:09.752187] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-03T21:59:09.752611] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-03T21:59:09.753302] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-03T21:59:09.753365] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-03T21:59:10.169331] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:10.390634] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-03T21:59:10.420760] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T21:59:11.190715] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-03T21:59:11.414523] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T21:59:11.990704] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-03T21:59:12.027079] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T21:59:12.747379] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T21:59:12.790689] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-03T21:59:13.590717] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-03T21:59:13.675042] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T21:59:14.395818] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-03T21:59:14.408674] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T21:59:15.190639] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-03T21:59:15.453538] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T21:59:15.990699] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-03T21:59:16.170516] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T21:59:16.773130] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T21:59:16.790615] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-03T21:59:17.416210] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T21:59:17.590694] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-03T21:59:18.004018] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T21:59:18.006743] [INFO ] [REMOTE ] TRNO: Full fetch complete (63682 records). [2025-10-03T21:59:18.006886] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-03T21:59:18.131796] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T21:59:18.156009] [INFO ] [REMOTE ] TRGP: Full fetch complete (73530 records). [2025-10-03T21:59:18.181164] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-03T21:59:18.403939] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-03T21:59:18.833354] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-03T21:59:18.844509] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-03T21:59:18.861742] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-03T21:59:18.899345] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-03T21:59:18.941862] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-03T21:59:18.941983] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-03T21:59:18.942809] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-03T21:59:18.943072] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-03T21:59:18.943416] [DEBUG] [LOCAL ] TRNO: Trimmed 63682 records to 44565 (keeping 200 days of data) [2025-10-03T21:59:18.945688] [DEBUG] [LOCAL ] TRGP: Trimmed 73530 records to 51445 (keeping 200 days of data) [2025-10-03T21:59:19.190972] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-03T21:59:19.538551] [DEBUG] [LOCAL ] TRGP: Primary data saved (51445 records). [2025-10-03T21:59:19.539632] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-03T21:59:19.539807] [INFO ] [MAIN ] Update Progress: 2128/2370 symbols completed. TRGP took 50.1s. Estimated remaining: 34m 2s. Rate: 7.1 symbols/min [2025-10-03T21:59:19.743226] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:19.744954] [DEBUG] [LOCAL ] TRTX: No existing data file found in primary storage. [2025-10-03T21:59:19.745565] [WARN ] [MAIN ] TRTX: No existing data found, performing full refresh instead. [2025-10-03T21:59:19.746094] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-03T21:59:19.746748] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-03T21:59:19.747368] [DEBUG] [LOCAL ] TRTX: No primary data file found to delete. [2025-10-03T21:59:19.748089] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-03T21:59:20.050504] [DEBUG] [LOCAL ] TRNO: Primary data saved (44565 records). [2025-10-03T21:59:20.075140] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-03T21:59:20.118542] [INFO ] [MAIN ] Update Progress: 2129/2370 symbols completed. TRNO took 28.5s. Estimated remaining: 33m 53s. Rate: 7.1 symbols/min [2025-10-03T21:59:20.301542] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:20.328298] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-03T21:59:20.443105] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:20.482929] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T21:59:20.544620] [DEBUG] [LOCAL ] TRU: Loaded 51628 existing records from primary storage. [2025-10-03T21:59:20.545086] [INFO ] [MAIN ] TRU: Loaded 51628 existing records. [2025-10-03T21:59:20.753545] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:20.753964] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-03T21:59:20.754094] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-03T21:59:20.754357] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-03T21:59:20.754418] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-03T21:59:20.808265] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-03T21:59:21.174911] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:21.169443] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T21:59:21.529830] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T21:59:21.590668] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-03T21:59:22.390770] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-03T21:59:22.568965] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T21:59:22.941514] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T21:59:23.190729] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-03T21:59:23.981103] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T21:59:23.991227] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-03T21:59:24.790701] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-03T21:59:24.825445] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T21:59:24.933934] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T21:59:25.590729] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-03T21:59:26.281764] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T21:59:26.390726] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-03T21:59:27.190754] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-03T21:59:27.363298] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T21:59:27.544544] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T21:59:27.990713] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-03T21:59:28.795802] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-03T21:59:28.813075] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T21:59:29.590683] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-03T21:59:29.649611] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T21:59:30.023685] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T21:59:30.390724] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-03T21:59:31.122389] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T21:59:31.190693] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-03T21:59:31.990755] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-03T21:59:32.272978] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T21:59:32.502565] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T21:59:32.790739] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-03T21:59:32.900233] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T21:59:33.590757] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-03T21:59:34.390722] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-03T21:59:34.572792] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T21:59:35.122250] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T21:59:35.190749] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-03T21:59:35.990671] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-03T21:59:36.185586] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T21:59:36.790769] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-03T21:59:36.937692] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T21:59:37.475845] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T21:59:37.590737] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-03T21:59:38.390669] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-03T21:59:38.540627] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T21:59:38.979286] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T21:59:39.190770] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-03T21:59:39.990783] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-03T21:59:40.186544] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T21:59:40.531542] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T21:59:40.534719] [INFO ] [REMOTE ] TROX: Full fetch complete (73206 records). [2025-10-03T21:59:40.535035] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-03T21:59:40.799835] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-03T21:59:40.936917] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-03T21:59:40.937017] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-03T21:59:40.938566] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-03T21:59:40.938634] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-03T21:59:40.940637] [DEBUG] [LOCAL ] TROX: Trimmed 73206 records to 52644 (keeping 200 days of data) [2025-10-03T21:59:41.269448] [DEBUG] [LOCAL ] TROX: Primary data saved (52644 records). [2025-10-03T21:59:41.269634] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-03T21:59:41.269869] [INFO ] [MAIN ] Update Progress: 2130/2370 symbols completed. TROX took 37.2s. Estimated remaining: 33m 46s. Rate: 7.1 symbols/min [2025-10-03T21:59:41.446487] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:41.501848] [DEBUG] [LOCAL ] TRV: Loaded 48094 existing records from primary storage. [2025-10-03T21:59:41.502227] [INFO ] [MAIN ] TRV: Loaded 48094 existing records. [2025-10-03T21:59:41.599545] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-03T21:59:41.696797] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:41.697223] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-03T21:59:41.697309] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-03T21:59:41.698387] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-03T21:59:41.698455] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-03T21:59:41.830322] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T21:59:42.100948] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:42.390667] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-03T21:59:42.605581] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T21:59:43.190787] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-03T21:59:43.492943] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T21:59:43.516164] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T21:59:43.518748] [INFO ] [REMOTE ] TRTX: Full fetch complete (53476 records). [2025-10-03T21:59:43.518840] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-03T21:59:43.906633] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-03T21:59:43.906850] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-03T21:59:43.908106] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-03T21:59:43.908170] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-03T21:59:43.909631] [DEBUG] [LOCAL ] TRTX: Trimmed 53476 records to 38021 (keeping 200 days of data) [2025-10-03T21:59:43.994427] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-03T21:59:44.148979] [DEBUG] [LOCAL ] TRTX: Primary data saved (38021 records). [2025-10-03T21:59:44.149169] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-03T21:59:44.149260] [INFO ] [MAIN ] Update Progress: 2131/2370 symbols completed. TRTX took 24.6s. Estimated remaining: 33m 36s. Rate: 7.1 symbols/min [2025-10-03T21:59:44.345066] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:44.406932] [DEBUG] [LOCAL ] TS: Loaded 52072 existing records from primary storage. [2025-10-03T21:59:44.407374] [INFO ] [MAIN ] TS: Loaded 52072 existing records. [2025-10-03T21:59:44.592705] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:44.592982] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-03T21:59:44.593034] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-03T21:59:44.593345] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-03T21:59:44.593412] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-03T21:59:44.800815] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-03T21:59:44.969322] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:44.999165] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T21:59:45.590712] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-03T21:59:45.809295] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T21:59:46.245589] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T21:59:46.390711] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-03T21:59:47.138266] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T21:59:47.190698] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-03T21:59:47.990718] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-03T21:59:48.100060] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T21:59:48.790739] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-03T21:59:48.839898] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T21:59:49.590720] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-03T21:59:49.696129] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T21:59:50.127058] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T21:59:50.130133] [INFO ] [REMOTE ] TRP: Full fetch complete (75564 records). [2025-10-03T21:59:50.130265] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-03T21:59:50.396345] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-03T21:59:50.560055] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-03T21:59:50.560173] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-03T21:59:50.562083] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-03T21:59:50.562158] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-03T21:59:50.564106] [DEBUG] [LOCAL ] TRP: Trimmed 75564 records to 52867 (keeping 200 days of data) [2025-10-03T21:59:50.938258] [DEBUG] [LOCAL ] TRP: Primary data saved (52867 records). [2025-10-03T21:59:50.938615] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-03T21:59:50.939013] [INFO ] [MAIN ] Update Progress: 2132/2370 symbols completed. TRP took 41.7s. Estimated remaining: 33m 28s. Rate: 7.1 symbols/min [2025-10-03T21:59:51.147943] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:51.191361] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T21:59:51.191832] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-03T21:59:51.229793] [DEBUG] [LOCAL ] TSE: Loaded 28404 existing records from primary storage. [2025-10-03T21:59:51.230144] [INFO ] [MAIN ] TSE: Loaded 28404 existing records. [2025-10-03T21:59:51.414020] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:51.414362] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-03T21:59:51.414425] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-03T21:59:51.414851] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-03T21:59:51.414926] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-03T21:59:51.783738] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:51.990669] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-03T21:59:52.240522] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T21:59:52.790780] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-03T21:59:53.017716] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T21:59:53.372688] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T21:59:53.590759] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-03T21:59:54.169435] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T21:59:54.172547] [INFO ] [REMOTE ] TRU: Full fetch complete (73478 records). [2025-10-03T21:59:54.172736] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-03T21:59:54.398676] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-03T21:59:54.629377] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-03T21:59:54.629490] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-03T21:59:54.631097] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-03T21:59:54.631184] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-03T21:59:54.633197] [DEBUG] [LOCAL ] TRU: Trimmed 73478 records to 52018 (keeping 200 days of data) [2025-10-03T21:59:54.883786] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T21:59:55.008831] [DEBUG] [LOCAL ] TRU: Primary data saved (52018 records). [2025-10-03T21:59:55.009027] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-03T21:59:55.010017] [INFO ] [MAIN ] Update Progress: 2133/2370 symbols completed. TRU took 34.9s. Estimated remaining: 33m 19s. Rate: 7.1 symbols/min [2025-10-03T21:59:55.196368] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-03T21:59:55.200740] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T21:59:55.219144] [DEBUG] [LOCAL ] TSI: Loaded 7378 existing records from primary storage. [2025-10-03T21:59:55.219421] [INFO ] [MAIN ] TSI: Loaded 7378 existing records. [2025-10-03T21:59:55.416685] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T21:59:55.416959] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-03T21:59:55.417042] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-03T21:59:55.417467] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-03T21:59:55.417528] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-03T21:59:55.787148] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T21:59:55.990745] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-03T21:59:56.369723] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T21:59:56.557314] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T21:59:56.790702] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-03T21:59:57.477215] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T21:59:57.590639] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-03T21:59:57.761485] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T21:59:58.390715] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-03T21:59:59.190670] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-03T21:59:59.615735] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T21:59:59.669226] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T21:59:59.799432] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T21:59:59.990763] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-03T22:00:00.790753] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-03T22:00:01.590775] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-03T22:00:01.690498] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T22:00:02.069928] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T22:00:02.390752] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-03T22:00:03.190667] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-03T22:00:03.379595] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T22:00:03.813739] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T22:00:03.990738] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-03T22:00:04.345611] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T22:00:04.790726] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-03T22:00:05.590670] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-03T22:00:05.683271] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:00:06.113722] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T22:00:06.390728] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-03T22:00:06.567083] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T22:00:07.190751] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-03T22:00:07.782169] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T22:00:07.990753] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-03T22:00:08.790680] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-03T22:00:08.815142] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T22:00:09.038480] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T22:00:09.590717] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-03T22:00:10.176104] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T22:00:10.390737] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-03T22:00:10.477258] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T22:00:11.167446] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T22:00:11.190620] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-03T22:00:11.990696] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-03T22:00:12.790717] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-03T22:00:13.049424] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T22:00:13.359629] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T22:00:13.546308] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T22:00:13.590722] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-03T22:00:14.375028] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T22:00:14.390691] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-03T22:00:15.051403] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T22:00:15.190747] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-03T22:00:15.990741] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-03T22:00:16.432626] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T22:00:16.790698] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-03T22:00:17.549056] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T22:00:17.550421] [INFO ] [REMOTE ] TSE: Full fetch complete (40938 records). [2025-10-03T22:00:17.550513] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-03T22:00:17.595779] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-03T22:00:17.975775] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-03T22:00:17.975909] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-03T22:00:17.977077] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-03T22:00:17.977166] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-03T22:00:18.010366] [DEBUG] [LOCAL ] TSE: Trimmed 40938 records to 28482 (keeping 200 days of data) [2025-10-03T22:00:18.012194] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T22:00:18.202394] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T22:00:18.205543] [INFO ] [REMOTE ] TSI: Full fetch complete (13269 records). [2025-10-03T22:00:18.206304] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-03T22:00:18.396757] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-03T22:00:18.401779] [DEBUG] [LOCAL ] TSE: Primary data saved (28482 records). [2025-10-03T22:00:18.420233] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-03T22:00:18.439816] [INFO ] [MAIN ] Update Progress: 2134/2370 symbols completed. TSE took 27.5s. Estimated remaining: 33m 12s. Rate: 7.1 symbols/min [2025-10-03T22:00:18.846586] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-03T22:00:18.846463] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:18.847150] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-03T22:00:18.847571] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-03T22:00:18.847633] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-03T22:00:18.848363] [DEBUG] [LOCAL ] TSI: Trimmed 13269 records to 7412 (keeping 200 days of data) [2025-10-03T22:00:18.909189] [DEBUG] [LOCAL ] TSI: Primary data saved (7412 records). [2025-10-03T22:00:18.920528] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-03T22:00:18.920864] [INFO ] [MAIN ] Update Progress: 2135/2370 symbols completed. TSI took 23.9s. Estimated remaining: 33m 3s. Rate: 7.1 symbols/min [2025-10-03T22:00:18.921929] [DEBUG] [LOCAL ] TSLX: Loaded 35503 existing records from primary storage. [2025-10-03T22:00:18.955812] [INFO ] [MAIN ] TSLX: Loaded 35503 existing records. [2025-10-03T22:00:19.212697] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-03T22:00:19.261400] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:19.309540] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:19.310176] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-03T22:00:19.310360] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-03T22:00:19.310614] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-03T22:00:19.310701] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-03T22:00:19.725700] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-03T22:00:19.760529] [INFO ] [MAIN ] TSM: Loaded 54209 existing records. [2025-10-03T22:00:19.760281] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:19.963266] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:19.963622] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-03T22:00:19.963717] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-03T22:00:19.963991] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-03T22:00:19.964050] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-03T22:00:19.998220] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-03T22:00:20.370874] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:20.401890] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T22:00:20.790633] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-03T22:00:20.983249] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T22:00:21.326400] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T22:00:21.590752] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-03T22:00:22.245980] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T22:00:22.390746] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-03T22:00:22.763541] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T22:00:23.190739] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-03T22:00:23.990745] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-03T22:00:24.190147] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T22:00:24.282868] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T22:00:24.790721] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-03T22:00:24.933201] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-03T22:00:24.936328] [INFO ] [REMOTE ] TRV: Full fetch complete (69732 records). [2025-10-03T22:00:24.936595] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-03T22:00:25.374059] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-03T22:00:25.374160] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-03T22:00:25.375535] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-03T22:00:25.375677] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-03T22:00:25.377371] [DEBUG] [LOCAL ] TRV: Trimmed 69732 records to 48438 (keeping 200 days of data) [2025-10-03T22:00:25.610786] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-03T22:00:25.705522] [DEBUG] [LOCAL ] TRV: Primary data saved (48438 records). [2025-10-03T22:00:25.705710] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-03T22:00:25.705841] [INFO ] [MAIN ] Update Progress: 2136/2370 symbols completed. TRV took 44.4s. Estimated remaining: 32m 54s. Rate: 7.1 symbols/min [2025-10-03T22:00:25.887580] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:25.945093] [DEBUG] [LOCAL ] TSN: Loaded 53293 existing records from primary storage. [2025-10-03T22:00:25.945541] [INFO ] [MAIN ] TSN: Loaded 53293 existing records. [2025-10-03T22:00:26.150733] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:26.151033] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-03T22:00:26.151086] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-03T22:00:26.151319] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-03T22:00:26.151382] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-03T22:00:26.399211] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-03T22:00:26.567752] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:26.787926] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-03T22:00:27.121449] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T22:00:27.190754] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-03T22:00:27.990671] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-03T22:00:28.103961] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T22:00:28.790715] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-03T22:00:29.547471] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T22:00:29.590680] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-03T22:00:30.069905] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-03T22:00:30.390717] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-03T22:00:30.562037] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T22:00:30.631878] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T22:00:31.190741] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-03T22:00:31.990753] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-03T22:00:32.615438] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T22:00:32.618291] [INFO ] [REMOTE ] TS: Full fetch complete (74544 records). [2025-10-03T22:00:32.618423] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-03T22:00:32.794108] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-03T22:00:33.076100] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-03T22:00:33.076316] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-03T22:00:33.078194] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-03T22:00:33.078304] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-03T22:00:33.080423] [DEBUG] [LOCAL ] TS: Trimmed 74544 records to 52451 (keeping 200 days of data) [2025-10-03T22:00:33.205725] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-10-03T22:00:33.456523] [DEBUG] [LOCAL ] TS: Primary data saved (52451 records). [2025-10-03T22:00:33.456760] [INFO ] [MAIN ] TS: Full history saved. [2025-10-03T22:00:33.457061] [INFO ] [MAIN ] Update Progress: 2137/2370 symbols completed. TS took 49.3s. Estimated remaining: 32m 46s. Rate: 7.1 symbols/min [2025-10-03T22:00:33.611060] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-03T22:00:33.687133] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:33.720675] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T22:00:33.743118] [DEBUG] [LOCAL ] TSQ: Loaded 12068 existing records from primary storage. [2025-10-03T22:00:33.743433] [INFO ] [MAIN ] TSQ: Loaded 12068 existing records. [2025-10-03T22:00:33.939036] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:33.939359] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-03T22:00:33.939426] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-03T22:00:33.939700] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-03T22:00:33.939762] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-03T22:00:34.337873] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:34.360161] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T22:00:34.390694] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-03T22:00:35.190714] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-03T22:00:35.872515] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T22:00:35.968929] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T22:00:35.990678] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-03T22:00:36.489329] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-03T22:00:36.790744] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-03T22:00:37.588532] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T22:00:37.591502] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-03T22:00:37.863062] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T22:00:38.390754] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-03T22:00:39.169131] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T22:00:39.190674] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-03T22:00:39.990667] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-03T22:00:40.008570] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T22:00:40.369288] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-03T22:00:40.790739] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-03T22:00:41.343018] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T22:00:41.590735] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-03T22:00:42.391007] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-03T22:00:43.103175] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T22:00:43.190828] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-03T22:00:43.630854] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-03T22:00:43.980808] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T22:00:43.990613] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-03T22:00:44.164314] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T22:00:44.753806] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T22:00:44.790624] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-03T22:00:45.590685] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-03T22:00:45.802428] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T22:00:46.390754] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-03T22:00:46.653753] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T22:00:46.656384] [INFO ] [REMOTE ] TSLX: Full fetch complete (49591 records). [2025-10-03T22:00:46.656529] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-03T22:00:47.112412] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-03T22:00:47.112527] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-03T22:00:47.113766] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-03T22:00:47.113838] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-03T22:00:47.115350] [DEBUG] [LOCAL ] TSLX: Trimmed 49591 records to 35786 (keeping 200 days of data) [2025-10-03T22:00:47.205143] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-03T22:00:47.344888] [DEBUG] [LOCAL ] TSLX: Primary data saved (35786 records). [2025-10-03T22:00:47.345057] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-03T22:00:47.345186] [INFO ] [MAIN ] Update Progress: 2138/2370 symbols completed. TSLX took 28.9s. Estimated remaining: 32m 38s. Rate: 7.1 symbols/min [2025-10-03T22:00:47.549348] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:47.602183] [DEBUG] [LOCAL ] TT: Loaded 48026 existing records from primary storage. [2025-10-03T22:00:47.602570] [INFO ] [MAIN ] TT: Loaded 48026 existing records. [2025-10-03T22:00:47.805785] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:47.806028] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-03T22:00:47.806085] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-03T22:00:47.806353] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-03T22:00:47.806426] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-03T22:00:48.009364] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-03T22:00:48.237254] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:48.280113] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T22:00:48.790692] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-03T22:00:48.923858] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T22:00:49.590680] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-03T22:00:49.807817] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-03T22:00:50.390902] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-03T22:00:50.391343] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T22:00:50.634201] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T22:00:51.190687] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-03T22:00:51.991459] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-03T22:00:51.992560] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T22:00:52.790735] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-03T22:00:53.464347] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-10-03T22:00:53.590701] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-03T22:00:53.929790] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T22:00:54.141396] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T22:00:54.142520] [INFO ] [REMOTE ] TSQ: Full fetch complete (16497 records). [2025-10-03T22:00:54.142626] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-03T22:00:54.395948] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-03T22:00:54.548748] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-03T22:00:54.548872] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-03T22:00:54.549281] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-03T22:00:54.549423] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-03T22:00:54.550711] [DEBUG] [LOCAL ] TSQ: Trimmed 16497 records to 12138 (keeping 200 days of data) [2025-10-03T22:00:54.635114] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:00:54.664288] [DEBUG] [LOCAL ] TSQ: Primary data saved (12138 records). [2025-10-03T22:00:54.664480] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-03T22:00:54.664584] [INFO ] [MAIN ] Update Progress: 2139/2370 symbols completed. TSQ took 21.2s. Estimated remaining: 32m 29s. Rate: 7.1 symbols/min [2025-10-03T22:00:54.858029] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:54.858278] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-03T22:00:54.858367] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-03T22:00:54.858495] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-03T22:00:54.858538] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-03T22:00:54.858614] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-03T22:00:54.858694] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-03T22:00:55.198255] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-03T22:00:55.243883] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:55.990694] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-03T22:00:56.292606] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T22:00:56.790730] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-03T22:00:57.590674] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-03T22:00:57.793859] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:00:57.794221] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-03T22:00:57.794319] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:00:57.794369] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-03T22:00:57.794434] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:00:57.794513] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-03T22:00:57.794585] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-03T22:00:57.794625] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-03T22:00:57.794730] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-03T22:00:57.794808] [INFO ] [MAIN ] Update Progress: 2140/2370 symbols completed. TTAM took 3.1s. Estimated remaining: 32m 20s. Rate: 7.1 symbols/min [2025-10-03T22:00:57.995149] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:00:58.062032] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T22:00:58.075290] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-03T22:00:58.126512] [DEBUG] [LOCAL ] TTC: Loaded 42360 existing records from primary storage. [2025-10-03T22:00:58.126933] [INFO ] [MAIN ] TTC: Loaded 42360 existing records. [2025-10-03T22:00:58.325004] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:00:58.325264] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-03T22:00:58.325336] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-03T22:00:58.325600] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-03T22:00:58.325697] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-03T22:00:58.395832] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-03T22:00:58.743893] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:00:58.784905] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T22:00:59.190708] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-03T22:00:59.990727] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-03T22:01:00.790720] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-03T22:01:01.269033] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T22:01:01.455317] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-03T22:01:01.590708] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-03T22:01:01.700421] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T22:01:02.300945] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T22:01:02.390667] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-03T22:01:03.190695] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-03T22:01:03.908717] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-03T22:01:03.911879] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-03T22:01:03.912016] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-03T22:01:03.996440] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-03T22:01:04.374793] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T22:01:04.454128] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-03T22:01:04.454233] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-03T22:01:04.456020] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-03T22:01:04.456097] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-03T22:01:04.458008] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54599 (keeping 200 days of data) [2025-10-03T22:01:04.801057] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-03T22:01:04.834433] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-10-03T22:01:04.834618] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-03T22:01:04.834798] [INFO ] [MAIN ] Update Progress: 2141/2370 symbols completed. TSM took 45.9s. Estimated remaining: 32m 12s. Rate: 7.1 symbols/min [2025-10-03T22:01:05.022607] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:05.073755] [DEBUG] [LOCAL ] TTE: Loaded 52003 existing records from primary storage. [2025-10-03T22:01:05.074157] [INFO ] [MAIN ] TTE: Loaded 52003 existing records. [2025-10-03T22:01:05.350417] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T22:01:05.358219] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:05.374433] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-03T22:01:05.374772] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-03T22:01:05.376056] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-03T22:01:05.376149] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-03T22:01:05.595999] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-03T22:01:06.025806] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:06.074790] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T22:01:06.147440] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T22:01:06.151296] [INFO ] [REMOTE ] TSN: Full fetch complete (76341 records). [2025-10-03T22:01:06.151543] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-03T22:01:06.397255] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-03T22:01:06.672476] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-03T22:01:06.673240] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-03T22:01:06.675085] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-03T22:01:06.675690] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-03T22:01:06.679820] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-03T22:01:06.692023] [DEBUG] [LOCAL ] TSN: Trimmed 76341 records to 53681 (keeping 200 days of data) [2025-10-03T22:01:07.065513] [DEBUG] [LOCAL ] TSN: Primary data saved (53681 records). [2025-10-03T22:01:07.065794] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-03T22:01:07.065973] [INFO ] [MAIN ] Update Progress: 2142/2370 symbols completed. TSN took 41.4s. Estimated remaining: 32m 3s. Rate: 7.1 symbols/min [2025-10-03T22:01:07.195803] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-03T22:01:07.272877] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:07.349000] [DEBUG] [LOCAL ] TTI: Loaded 45989 existing records from primary storage. [2025-10-03T22:01:07.349525] [INFO ] [MAIN ] TTI: Loaded 45989 existing records. [2025-10-03T22:01:07.572557] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:07.572829] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-03T22:01:07.572882] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-03T22:01:07.573197] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-03T22:01:07.573267] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-03T22:01:07.959734] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:07.990703] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-03T22:01:08.342198] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T22:01:08.790710] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-03T22:01:09.183894] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T22:01:09.590637] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-03T22:01:09.703800] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T22:01:10.390714] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-03T22:01:10.568563] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T22:01:11.193941] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-03T22:01:11.199870] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T22:01:11.900407] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T22:01:11.990712] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-03T22:01:12.606183] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T22:01:12.790708] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-03T22:01:13.408039] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T22:01:13.590761] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-03T22:01:14.379845] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T22:01:14.390622] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-03T22:01:15.190744] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-03T22:01:15.323513] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T22:01:15.901995] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T22:01:15.990730] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-03T22:01:16.620617] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T22:01:16.790731] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-03T22:01:17.225827] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T22:01:17.590716] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-03T22:01:18.390686] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-03T22:01:18.748892] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T22:01:19.190725] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-03T22:01:19.353320] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T22:01:19.749459] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T22:01:19.990770] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-03T22:01:20.756760] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T22:01:20.790741] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-03T22:01:21.227580] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T22:01:21.590736] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-03T22:01:22.353480] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T22:01:22.390711] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-03T22:01:23.190684] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-03T22:01:23.303034] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T22:01:23.860483] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T22:01:23.990677] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-03T22:01:24.790711] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-03T22:01:25.020958] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T22:01:25.590738] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-03T22:01:25.798733] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T22:01:26.187751] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T22:01:26.390729] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-03T22:01:27.190745] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-03T22:01:27.389681] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T22:01:27.493380] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T22:01:27.658128] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T22:01:27.661111] [INFO ] [REMOTE ] TT: Full fetch complete (69845 records). [2025-10-03T22:01:27.661290] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-03T22:01:27.995853] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-03T22:01:28.100373] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-03T22:01:28.100480] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-03T22:01:28.101978] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-03T22:01:28.102054] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-03T22:01:28.103984] [DEBUG] [LOCAL ] TT: Trimmed 69845 records to 48324 (keeping 200 days of data) [2025-10-03T22:01:28.440126] [DEBUG] [LOCAL ] TT: Primary data saved (48324 records). [2025-10-03T22:01:28.440295] [INFO ] [MAIN ] TT: Full history saved. [2025-10-03T22:01:28.440428] [INFO ] [MAIN ] Update Progress: 2143/2370 symbols completed. TT took 41.1s. Estimated remaining: 31m 56s. Rate: 7.1 symbols/min [2025-10-03T22:01:28.623415] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:28.678343] [DEBUG] [LOCAL ] TU: Loaded 50205 existing records from primary storage. [2025-10-03T22:01:28.678743] [INFO ] [MAIN ] TU: Loaded 50205 existing records. [2025-10-03T22:01:28.793009] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-03T22:01:28.885013] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:28.885254] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-03T22:01:28.885307] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-03T22:01:28.885572] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-03T22:01:28.885635] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-03T22:01:29.258865] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T22:01:29.302504] [INFO ] [REMOTE ] TTC: Full fetch complete (62219 records). [2025-10-03T22:01:29.312470] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-03T22:01:29.334864] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:29.595850] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-03T22:01:29.801255] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-03T22:01:29.801352] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-03T22:01:29.802535] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-03T22:01:29.802614] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-03T22:01:29.804104] [DEBUG] [LOCAL ] TTC: Trimmed 62219 records to 42669 (keeping 200 days of data) [2025-10-03T22:01:30.076167] [DEBUG] [LOCAL ] TTC: Primary data saved (42669 records). [2025-10-03T22:01:30.076326] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-03T22:01:30.076443] [INFO ] [MAIN ] Update Progress: 2144/2370 symbols completed. TTC took 32.3s. Estimated remaining: 31m 46s. Rate: 7.1 symbols/min [2025-10-03T22:01:30.257831] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:30.306234] [DEBUG] [LOCAL ] TUYA: Loaded 46550 existing records from primary storage. [2025-10-03T22:01:30.306765] [INFO ] [MAIN ] TUYA: Loaded 46550 existing records. [2025-10-03T22:01:30.390757] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-03T22:01:30.517800] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:30.518261] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-03T22:01:30.518336] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-03T22:01:30.518734] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-03T22:01:30.518803] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-03T22:01:30.915859] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:30.938151] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T22:01:31.190714] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-03T22:01:31.462246] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:01:31.990720] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-03T22:01:32.263989] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T22:01:32.648483] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T22:01:32.790711] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-03T22:01:33.590866] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-03T22:01:33.881340] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T22:01:34.230638] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T22:01:34.390718] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-03T22:01:35.195864] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-03T22:01:35.215093] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T22:01:35.990725] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-03T22:01:36.133126] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T22:01:36.790698] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-03T22:01:37.155933] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T22:01:37.590764] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-03T22:01:37.669630] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T22:01:38.394170] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-03T22:01:38.400561] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T22:01:39.190759] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-03T22:01:39.470798] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T22:01:39.785095] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T22:01:39.787895] [INFO ] [REMOTE ] TTI: Full fetch complete (65413 records). [2025-10-03T22:01:39.788024] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-03T22:01:40.001038] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-03T22:01:40.217152] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-03T22:01:40.217252] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-03T22:01:40.218608] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-03T22:01:40.218700] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-03T22:01:40.220253] [DEBUG] [LOCAL ] TTI: Trimmed 65413 records to 46351 (keeping 200 days of data) [2025-10-03T22:01:40.503890] [DEBUG] [LOCAL ] TTI: Primary data saved (46351 records). [2025-10-03T22:01:40.504108] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-03T22:01:40.504221] [INFO ] [MAIN ] Update Progress: 2145/2370 symbols completed. TTI took 33.4s. Estimated remaining: 31m 38s. Rate: 7.1 symbols/min [2025-10-03T22:01:40.686262] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:40.729028] [DEBUG] [LOCAL ] TV: Loaded 42891 existing records from primary storage. [2025-10-03T22:01:40.729430] [INFO ] [MAIN ] TV: Loaded 42891 existing records. [2025-10-03T22:01:40.798480] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-03T22:01:40.932639] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:40.933067] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-03T22:01:40.933285] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-03T22:01:40.933722] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-03T22:01:40.933855] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-03T22:01:41.283920] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T22:01:41.377936] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:41.590703] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-03T22:01:41.850189] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T22:01:42.390729] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-03T22:01:43.080698] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T22:01:43.190732] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-03T22:01:43.328439] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T22:01:43.990698] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-03T22:01:44.075569] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:01:44.790704] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-03T22:01:44.881732] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T22:01:45.572544] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T22:01:45.590628] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-03T22:01:46.390712] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-03T22:01:46.474713] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T22:01:47.167349] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T22:01:47.190621] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-03T22:01:47.769833] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T22:01:47.990717] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-03T22:01:48.790700] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-03T22:01:48.881064] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:01:49.513038] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T22:01:49.590746] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-03T22:01:50.390742] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-03T22:01:50.471143] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T22:01:51.195877] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-03T22:01:51.213944] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:01:51.845388] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T22:01:51.848423] [INFO ] [REMOTE ] TTE: Full fetch complete (74998 records). [2025-10-03T22:01:51.848565] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-03T22:01:52.000716] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-03T22:01:52.278476] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-03T22:01:52.278580] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-03T22:01:52.280011] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-03T22:01:52.280087] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-03T22:01:52.281888] [DEBUG] [LOCAL ] TTE: Trimmed 74998 records to 52372 (keeping 200 days of data) [2025-10-03T22:01:52.621541] [DEBUG] [LOCAL ] TTE: Primary data saved (52372 records). [2025-10-03T22:01:52.621726] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-03T22:01:52.622981] [INFO ] [MAIN ] Update Progress: 2146/2370 symbols completed. TTE took 47.8s. Estimated remaining: 31m 30s. Rate: 7.1 symbols/min [2025-10-03T22:01:52.796757] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-03T22:01:52.800095] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:01:52.832329] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T22:01:52.835179] [DEBUG] [LOCAL ] TVC: Loaded 3349 existing records from primary storage. [2025-10-03T22:01:52.847550] [INFO ] [MAIN ] TVC: Loaded 3349 existing records. [2025-10-03T22:01:53.034784] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:01:53.035031] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-03T22:01:53.035084] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-03T22:01:53.035320] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-03T22:01:53.035381] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-03T22:01:53.419308] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:01:53.590698] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-03T22:01:53.697409] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T22:01:54.390702] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-03T22:01:54.439161] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T22:01:55.190678] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-03T22:01:55.296528] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T22:01:55.990709] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-03T22:01:56.043022] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T22:01:56.790736] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-03T22:01:56.855056] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T22:01:57.588375] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T22:01:57.598017] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-03T22:01:58.311564] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T22:01:58.347144] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T22:01:58.390766] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-03T22:01:59.190749] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-03T22:01:59.932619] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T22:01:59.990713] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-03T22:02:00.584438] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T22:02:00.587100] [INFO ] [REMOTE ] TUYA: Full fetch complete (65960 records). [2025-10-03T22:02:00.587238] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-03T22:02:00.799983] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-03T22:02:01.020138] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-03T22:02:01.020244] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-03T22:02:01.021691] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-03T22:02:01.021763] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-03T22:02:01.023448] [DEBUG] [LOCAL ] TUYA: Trimmed 65960 records to 46846 (keeping 200 days of data) [2025-10-03T22:02:01.327049] [DEBUG] [LOCAL ] TUYA: Primary data saved (46846 records). [2025-10-03T22:02:01.327217] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-03T22:02:01.327312] [INFO ] [MAIN ] Update Progress: 2147/2370 symbols completed. TUYA took 31.3s. Estimated remaining: 31m 22s. Rate: 7.1 symbols/min [2025-10-03T22:02:01.422688] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T22:02:01.454291] [INFO ] [REMOTE ] TU: Full fetch complete (72820 records). [2025-10-03T22:02:01.457625] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-03T22:02:01.595916] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-03T22:02:01.614978] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:01.692314] [DEBUG] [LOCAL ] TVE: Loaded 2788 existing records from primary storage. [2025-10-03T22:02:01.723623] [INFO ] [MAIN ] TVE: Loaded 2788 existing records. [2025-10-03T22:02:02.163753] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:02.179520] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-03T22:02:02.184748] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-03T22:02:02.195339] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-03T22:02:02.241632] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-03T22:02:02.354239] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-03T22:02:02.353928] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T22:02:02.382859] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-03T22:02:02.391303] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-03T22:02:02.396900] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-03T22:02:02.398897] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-03T22:02:02.490832] [DEBUG] [LOCAL ] TU: Trimmed 72820 records to 50545 (keeping 200 days of data) [2025-10-03T22:02:02.777116] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T22:02:02.821460] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:03.040627] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T22:02:03.065724] [DEBUG] [LOCAL ] TU: Primary data saved (50545 records). [2025-10-03T22:02:03.065921] [INFO ] [MAIN ] TU: Full history saved. [2025-10-03T22:02:03.066044] [INFO ] [MAIN ] Update Progress: 2148/2370 symbols completed. TU took 34.6s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-03T22:02:03.195781] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-03T22:02:03.264099] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:03.304245] [DEBUG] [LOCAL ] TWI: Loaded 34440 existing records from primary storage. [2025-10-03T22:02:03.304855] [INFO ] [MAIN ] TWI: Loaded 34440 existing records. [2025-10-03T22:02:03.497115] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:03.497459] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-03T22:02:03.497523] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-03T22:02:03.498034] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-03T22:02:03.498107] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-03T22:02:03.889608] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:03.927660] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T22:02:03.990723] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-03T22:02:04.790745] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-03T22:02:05.590744] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-03T22:02:05.674780] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:02:06.218999] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T22:02:06.324591] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T22:02:06.390703] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-03T22:02:07.191028] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-03T22:02:07.485968] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T22:02:07.489981] [INFO ] [REMOTE ] TV: Full fetch complete (61813 records). [2025-10-03T22:02:07.490242] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-03T22:02:07.872413] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T22:02:07.988055] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-03T22:02:07.988170] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-03T22:02:07.989723] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-03T22:02:07.989819] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-03T22:02:07.990890] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-03T22:02:07.995587] [DEBUG] [LOCAL ] TV: Trimmed 61813 records to 43081 (keeping 200 days of data) [2025-10-03T22:02:08.269842] [DEBUG] [LOCAL ] TV: Primary data saved (43081 records). [2025-10-03T22:02:08.270010] [INFO ] [MAIN ] TV: Full history saved. [2025-10-03T22:02:08.270168] [INFO ] [MAIN ] Update Progress: 2149/2370 symbols completed. TV took 27.8s. Estimated remaining: 31m 4s. Rate: 7.1 symbols/min [2025-10-03T22:02:08.472981] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:08.535817] [DEBUG] [LOCAL ] TWLO: Loaded 53100 existing records from primary storage. [2025-10-03T22:02:08.536215] [INFO ] [MAIN ] TWLO: Loaded 53100 existing records. [2025-10-03T22:02:08.769122] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:08.769445] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-03T22:02:08.769511] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-03T22:02:08.769811] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-03T22:02:08.769882] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-03T22:02:08.795877] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-03T22:02:09.179236] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:09.465845] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T22:02:09.467572] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T22:02:09.590739] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-03T22:02:10.195784] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T22:02:10.390739] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-03T22:02:11.190709] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-03T22:02:11.770262] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T22:02:11.990693] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-03T22:02:12.279713] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T22:02:12.483311] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T22:02:12.790670] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-03T22:02:13.590756] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-03T22:02:14.191704] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T22:02:14.390704] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-03T22:02:14.846056] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T22:02:14.997105] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T22:02:15.190751] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-03T22:02:15.790997] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T22:02:15.990723] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-03T22:02:16.443723] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T22:02:16.790727] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-03T22:02:17.372365] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T22:02:17.590741] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-03T22:02:18.390741] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-03T22:02:18.861982] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T22:02:19.190696] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-03T22:02:19.667812] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T22:02:19.705711] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T22:02:19.990782] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-03T22:02:20.316477] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-03T22:02:20.317363] [INFO ] [REMOTE ] TVC: Full fetch complete (5524 records). [2025-10-03T22:02:20.317446] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-03T22:02:20.702356] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-03T22:02:20.702446] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-03T22:02:20.702623] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-03T22:02:20.702731] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-03T22:02:20.703245] [DEBUG] [LOCAL ] TVC: Trimmed 5524 records to 3363 (keeping 200 days of data) [2025-10-03T22:02:20.727898] [DEBUG] [LOCAL ] TVC: Primary data saved (3363 records). [2025-10-03T22:02:20.728068] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-03T22:02:20.728196] [INFO ] [MAIN ] Update Progress: 2150/2370 symbols completed. TVC took 28.1s. Estimated remaining: 30m 56s. Rate: 7.1 symbols/min [2025-10-03T22:02:20.795897] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-03T22:02:20.917481] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:20.924825] [DEBUG] [LOCAL ] TWN: Loaded 3245 existing records from primary storage. [2025-10-03T22:02:20.925096] [INFO ] [MAIN ] TWN: Loaded 3245 existing records. [2025-10-03T22:02:21.115150] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:21.115397] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-03T22:02:21.115451] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-03T22:02:21.115768] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-03T22:02:21.115830] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-03T22:02:21.505768] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:21.590729] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-03T22:02:22.390758] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-03T22:02:22.845292] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T22:02:23.102786] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T22:02:23.130496] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T22:02:23.190720] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-03T22:02:23.990768] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-03T22:02:24.766072] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T22:02:24.790691] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-03T22:02:25.511961] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T22:02:25.590738] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-03T22:02:25.943481] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T22:02:26.300487] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T22:02:26.390714] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-03T22:02:26.872432] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T22:02:27.190766] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-03T22:02:27.860289] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T22:02:27.990743] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-03T22:02:28.458194] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T22:02:28.790735] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-03T22:02:29.590702] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-03T22:02:30.134143] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T22:02:30.390721] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-03T22:02:30.726962] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T22:02:31.061878] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T22:02:31.190736] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-03T22:02:31.516114] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-03T22:02:31.516960] [INFO ] [REMOTE ] TVE: Full fetch complete (4415 records). [2025-10-03T22:02:31.517037] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-03T22:02:31.939828] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-03T22:02:31.939928] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-03T22:02:31.940157] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-03T22:02:31.940224] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-03T22:02:31.940700] [DEBUG] [LOCAL ] TVE: Trimmed 4415 records to 2809 (keeping 200 days of data) [2025-10-03T22:02:31.959161] [DEBUG] [LOCAL ] TVE: Primary data saved (2809 records). [2025-10-03T22:02:31.959308] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-03T22:02:31.959457] [INFO ] [MAIN ] Update Progress: 2151/2370 symbols completed. TVE took 30.6s. Estimated remaining: 30m 48s. Rate: 7.1 symbols/min [2025-10-03T22:02:31.995829] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-03T22:02:32.150214] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:32.205393] [DEBUG] [LOCAL ] TWO: Loaded 48729 existing records from primary storage. [2025-10-03T22:02:32.205833] [INFO ] [MAIN ] TWO: Loaded 48729 existing records. [2025-10-03T22:02:32.404015] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:32.404273] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-03T22:02:32.404324] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-03T22:02:32.404603] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-03T22:02:32.404699] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-03T22:02:32.710234] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T22:02:32.800792] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-03T22:02:32.807961] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:33.590739] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-03T22:02:34.201587] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T22:02:34.390741] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-03T22:02:35.200547] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-03T22:02:35.208920] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T22:02:35.810505] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T22:02:35.990720] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-03T22:02:36.211220] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T22:02:36.790740] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-03T22:02:37.488621] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T22:02:37.590743] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-03T22:02:37.902092] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-03T22:02:38.145308] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T22:02:38.390744] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-03T22:02:39.190733] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-03T22:02:39.771333] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T22:02:39.990637] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-03T22:02:40.369997] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T22:02:40.790716] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-03T22:02:41.419799] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T22:02:41.590751] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-03T22:02:42.348509] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T22:02:42.390626] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-03T22:02:42.881594] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T22:02:43.190694] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-03T22:02:43.990744] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-03T22:02:44.286912] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T22:02:44.499951] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T22:02:44.790685] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-03T22:02:44.966891] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T22:02:45.590695] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-03T22:02:46.223180] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T22:02:46.390699] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-03T22:02:46.670262] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T22:02:47.190707] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-03T22:02:47.583810] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T22:02:47.584753] [INFO ] [REMOTE ] TWN: Full fetch complete (5432 records). [2025-10-03T22:02:47.584825] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-03T22:02:47.972840] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-03T22:02:47.972926] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-03T22:02:47.973128] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-03T22:02:47.973172] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-03T22:02:47.973623] [DEBUG] [LOCAL ] TWN: Trimmed 5432 records to 3275 (keeping 200 days of data) [2025-10-03T22:02:47.990915] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-03T22:02:47.995973] [DEBUG] [LOCAL ] TWN: Primary data saved (3275 records). [2025-10-03T22:02:47.996116] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-03T22:02:47.996227] [INFO ] [MAIN ] Update Progress: 2152/2370 symbols completed. TWN took 27.3s. Estimated remaining: 30m 40s. Rate: 7.1 symbols/min [2025-10-03T22:02:48.192776] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:48.193089] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-03T22:02:48.193231] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-03T22:02:48.193395] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-03T22:02:48.193475] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-03T22:02:48.193621] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-03T22:02:48.193753] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-03T22:02:48.428494] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T22:02:48.649779] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:48.790714] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-03T22:02:49.562729] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T22:02:49.565953] [INFO ] [REMOTE ] TWLO: Full fetch complete (76457 records). [2025-10-03T22:02:49.566139] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-03T22:02:49.595773] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-03T22:02:50.054307] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-03T22:02:50.054442] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-03T22:02:50.055882] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-03T22:02:50.055959] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-03T22:02:50.057569] [DEBUG] [LOCAL ] TWLO: Trimmed 76457 records to 53490 (keeping 200 days of data) [2025-10-03T22:02:50.393035] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-03T22:02:50.400480] [DEBUG] [LOCAL ] TWLO: Primary data saved (53490 records). [2025-10-03T22:02:50.400812] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-03T22:02:50.401007] [INFO ] [MAIN ] Update Progress: 2153/2370 symbols completed. TWLO took 42.1s. Estimated remaining: 30m 31s. Rate: 7.1 symbols/min [2025-10-03T22:02:50.600751] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:50.630628] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T22:02:50.659296] [DEBUG] [LOCAL ] TX: Loaded 23557 existing records from primary storage. [2025-10-03T22:02:50.659631] [INFO ] [MAIN ] TX: Loaded 23557 existing records. [2025-10-03T22:02:50.922286] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:50.922800] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-03T22:02:50.922901] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-03T22:02:50.923354] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-03T22:02:50.923534] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-03T22:02:51.009712] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:02:51.049734] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-03T22:02:51.055683] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:02:51.069890] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-03T22:02:51.086384] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:02:51.138177] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-03T22:02:51.166290] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-03T22:02:51.182998] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-03T22:02:51.186127] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T22:02:51.186919] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-03T22:02:51.199154] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-03T22:02:51.198920] [INFO ] [MAIN ] Update Progress: 2154/2370 symbols completed. TWOD took 3.2s. Estimated remaining: 30m 22s. Rate: 7.1 symbols/min [2025-10-03T22:02:51.789232] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:51.800577] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:51.888560] [DEBUG] [LOCAL ] TXNM: Loaded 43718 existing records from primary storage. [2025-10-03T22:02:51.888988] [INFO ] [MAIN ] TXNM: Loaded 43718 existing records. [2025-10-03T22:02:51.995878] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-03T22:02:52.119051] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:52.119380] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-03T22:02:52.119452] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-03T22:02:52.119819] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-03T22:02:52.119971] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-03T22:02:52.522303] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:52.790777] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-03T22:02:52.938782] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T22:02:53.062057] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T22:02:53.065492] [INFO ] [REMOTE ] TWI: Full fetch complete (52740 records). [2025-10-03T22:02:53.065818] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-03T22:02:53.497195] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-03T22:02:53.497309] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-03T22:02:53.498765] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-03T22:02:53.498912] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-03T22:02:53.500481] [DEBUG] [LOCAL ] TWI: Trimmed 52740 records to 34741 (keeping 200 days of data) [2025-10-03T22:02:53.592014] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-03T22:02:53.716720] [DEBUG] [LOCAL ] TWI: Primary data saved (34741 records). [2025-10-03T22:02:53.716910] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-03T22:02:53.717012] [INFO ] [MAIN ] Update Progress: 2155/2370 symbols completed. TWI took 50.7s. Estimated remaining: 30m 13s. Rate: 7.1 symbols/min [2025-10-03T22:02:53.915900] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:02:53.945212] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T22:02:53.959606] [DEBUG] [LOCAL ] TXO: Loaded 19055 existing records from primary storage. [2025-10-03T22:02:53.959949] [INFO ] [MAIN ] TXO: Loaded 19055 existing records. [2025-10-03T22:02:54.148661] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:02:54.148957] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-03T22:02:54.149012] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-03T22:02:54.149247] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-03T22:02:54.149315] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-03T22:02:54.401500] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-03T22:02:54.546433] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:02:55.190755] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-03T22:02:55.589862] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T22:02:55.982385] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T22:02:55.990610] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-03T22:02:56.018900] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T22:02:56.790691] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-03T22:02:57.298129] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T22:02:57.337561] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T22:02:57.590734] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-03T22:02:58.390711] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-03T22:02:58.491923] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T22:02:59.190719] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-03T22:02:59.990783] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-03T22:03:00.032457] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T22:03:00.790632] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-03T22:03:01.063197] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T22:03:01.145513] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T22:03:01.590755] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-03T22:03:02.314351] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T22:03:02.390728] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-03T22:03:02.992418] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T22:03:03.190764] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-03T22:03:03.990741] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-03T22:03:04.142177] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T22:03:04.430777] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T22:03:04.790747] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-03T22:03:05.590685] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-03T22:03:05.616740] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T22:03:05.767599] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T22:03:06.390670] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-03T22:03:06.729725] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T22:03:07.190706] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-03T22:03:07.230011] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T22:03:07.990702] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-03T22:03:08.745547] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T22:03:08.790669] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-03T22:03:09.161745] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T22:03:09.590743] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-03T22:03:10.015076] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T22:03:10.390757] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-03T22:03:11.054738] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T22:03:11.057341] [INFO ] [REMOTE ] TWO: Full fetch complete (69104 records). [2025-10-03T22:03:11.057487] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-03T22:03:11.195858] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-03T22:03:11.513049] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T22:03:11.519308] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-03T22:03:11.519791] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-03T22:03:11.521550] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-03T22:03:11.521636] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-03T22:03:11.523087] [DEBUG] [LOCAL ] TWO: Trimmed 69104 records to 49084 (keeping 200 days of data) [2025-10-03T22:03:11.844352] [DEBUG] [LOCAL ] TWO: Primary data saved (49084 records). [2025-10-03T22:03:11.844518] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-03T22:03:11.844663] [INFO ] [MAIN ] Update Progress: 2156/2370 symbols completed. TWO took 39.9s. Estimated remaining: 30m 5s. Rate: 7.1 symbols/min [2025-10-03T22:03:11.995861] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-03T22:03:12.055750] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:12.103921] [DEBUG] [LOCAL ] TXT: Loaded 50073 existing records from primary storage. [2025-10-03T22:03:12.104288] [INFO ] [MAIN ] TXT: Loaded 50073 existing records. [2025-10-03T22:03:12.303087] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:12.303400] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-03T22:03:12.303471] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-03T22:03:12.303800] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-03T22:03:12.303882] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-03T22:03:12.727446] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:12.790630] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-03T22:03:13.147458] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T22:03:13.201279] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T22:03:13.590739] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-03T22:03:14.390716] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-03T22:03:14.581992] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T22:03:14.754638] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T22:03:15.190707] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-03T22:03:15.905544] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T22:03:15.990716] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-03T22:03:16.790726] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-03T22:03:16.957715] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T22:03:17.118747] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T22:03:17.590741] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-03T22:03:18.104433] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T22:03:18.390705] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-03T22:03:19.190635] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-03T22:03:19.251190] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T22:03:19.320446] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T22:03:19.322408] [INFO ] [REMOTE ] TX: Full fetch complete (35933 records). [2025-10-03T22:03:19.322493] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-03T22:03:19.731845] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-03T22:03:19.731934] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-03T22:03:19.732861] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-03T22:03:19.732931] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-03T22:03:19.734184] [DEBUG] [LOCAL ] TX: Trimmed 35933 records to 23810 (keeping 200 days of data) [2025-10-03T22:03:19.881589] [DEBUG] [LOCAL ] TX: Primary data saved (23810 records). [2025-10-03T22:03:19.881763] [INFO ] [MAIN ] TX: Full history saved. [2025-10-03T22:03:19.881876] [INFO ] [MAIN ] Update Progress: 2157/2370 symbols completed. TX took 29.5s. Estimated remaining: 29m 57s. Rate: 7.1 symbols/min [2025-10-03T22:03:19.990693] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-03T22:03:20.059756] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T22:03:20.790710] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-03T22:03:21.584403] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T22:03:21.593870] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-03T22:03:21.785196] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T22:03:22.390739] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-03T22:03:23.190743] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-03T22:03:23.267387] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T22:03:23.900733] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T22:03:23.962082] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T22:03:23.990677] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-03T22:03:24.790748] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-03T22:03:25.170847] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T22:03:25.173357] [INFO ] [REMOTE ] TXNM: Full fetch complete (62755 records). [2025-10-03T22:03:25.173557] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-03T22:03:25.601210] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-03T22:03:25.624507] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-03T22:03:25.624579] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-03T22:03:25.625960] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-03T22:03:25.626127] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-03T22:03:25.627923] [DEBUG] [LOCAL ] TXNM: Trimmed 62755 records to 44016 (keeping 200 days of data) [2025-10-03T22:03:25.920718] [DEBUG] [LOCAL ] TXNM: Primary data saved (44016 records). [2025-10-03T22:03:25.920910] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-03T22:03:25.921029] [INFO ] [MAIN ] Update Progress: 2158/2370 symbols completed. TXNM took 34.7s. Estimated remaining: 29m 48s. Rate: 7.1 symbols/min [2025-10-03T22:03:26.352546] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T22:03:26.354045] [INFO ] [REMOTE ] TXO: Full fetch complete (26348 records). [2025-10-03T22:03:26.354138] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-03T22:03:26.758066] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-03T22:03:26.758184] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-03T22:03:26.758839] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-03T22:03:26.758982] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-03T22:03:26.760343] [DEBUG] [LOCAL ] TXO: Trimmed 26348 records to 19183 (keeping 200 days of data) [2025-10-03T22:03:26.795873] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T22:03:26.897162] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-03T22:03:26.942424] [DEBUG] [LOCAL ] TXO: Primary data saved (19183 records). [2025-10-03T22:03:26.942687] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-03T22:03:26.942920] [INFO ] [MAIN ] Update Progress: 2159/2370 symbols completed. TXO took 33.2s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-03T22:03:28.700820] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T22:03:28.711947] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-03T22:03:30.448748] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T22:03:30.459998] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-03T22:03:31.928068] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T22:03:31.943636] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-03T22:03:33.689931] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T22:03:33.701465] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-03T22:03:35.246686] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T22:03:35.258064] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-03T22:03:35.481401] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-03T22:03:35.484060] [INFO ] [REMOTE ] TXT: Full fetch complete (72291 records). [2025-10-03T22:03:35.484175] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-03T22:03:35.904451] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-03T22:03:35.904697] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-03T22:03:35.906142] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-03T22:03:35.906220] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-03T22:03:35.907912] [DEBUG] [LOCAL ] TXT: Trimmed 72291 records to 50433 (keeping 200 days of data) [2025-10-03T22:03:36.233395] [DEBUG] [LOCAL ] TXT: Primary data saved (50433 records). [2025-10-03T22:03:36.233553] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-03T22:03:36.233709] [INFO ] [MAIN ] Update Progress: 2160/2370 symbols completed. TXT took 24.4s. Estimated remaining: 29m 31s. Rate: 7.1 symbols/min [2025-10-03T22:03:36.832469] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:37.015214] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:37.051143] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:37.053685] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:37.075001] [DEBUG] [LOCAL ] TY: Loaded 7578 existing records from primary storage. [2025-10-03T22:03:37.074900] [DEBUG] [LOCAL ] TYG: Loaded 14224 existing records from primary storage. [2025-10-03T22:03:37.075524] [INFO ] [MAIN ] TYG: Loaded 14224 existing records. [2025-10-03T22:03:37.097264] [INFO ] [MAIN ] TY: Loaded 7578 existing records. [2025-10-03T22:03:37.257840] [DEBUG] [LOCAL ] TYL: Loaded 22325 existing records from primary storage. [2025-10-03T22:03:37.275410] [INFO ] [MAIN ] TYL: Loaded 22325 existing records. [2025-10-03T22:03:37.601242] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:37.629224] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-03T22:03:37.629346] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-03T22:03:37.641992] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-03T22:03:37.635314] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-03T22:03:37.699994] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:37.676228] [INFO ] [MAIN ] U: Loaded 54189 existing records. [2025-10-03T22:03:37.717008] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-03T22:03:37.716903] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-03T22:03:37.784998] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-03T22:03:37.838374] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:37.921708] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-03T22:03:37.956293] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-03T22:03:37.950998] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-03T22:03:38.027788] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-03T22:03:38.190199] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-03T22:03:38.242395] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:38.245847] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-03T22:03:38.246041] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-03T22:03:38.276497] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-03T22:03:38.283699] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-03T22:03:38.296442] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-03T22:03:39.246138] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:39.325925] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-03T22:03:39.412804] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:39.477014] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-03T22:03:39.494829] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:39.526762] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-03T22:03:39.649814] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:39.650185] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-03T22:03:40.361108] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T22:03:40.363804] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-03T22:03:40.391793] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T22:03:40.395708] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-03T22:03:40.744732] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T22:03:40.749615] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-03T22:03:41.123581] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T22:03:41.126810] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-03T22:03:41.282830] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T22:03:41.288399] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-03T22:03:41.915759] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T22:03:41.918622] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-03T22:03:42.034430] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-03T22:03:42.045997] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-03T22:03:42.070427] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T22:03:42.075327] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-03T22:03:42.338320] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T22:03:42.342356] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-03T22:03:42.638441] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T22:03:42.640929] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-03T22:03:43.069061] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T22:03:43.074055] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-03T22:03:43.378614] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T22:03:43.382918] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-03T22:03:43.424863] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T22:03:43.990715] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-03T22:03:44.319067] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T22:03:44.436630] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T22:03:44.476687] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-03T22:03:44.790688] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-03T22:03:44.812955] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T22:03:45.590727] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-03T22:03:46.124334] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T22:03:46.390732] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-03T22:03:47.190776] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-03T22:03:47.297039] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T22:03:47.873010] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-03T22:03:47.990677] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-03T22:03:48.351203] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T22:03:48.554365] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T22:03:48.790733] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-03T22:03:49.590702] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-03T22:03:49.826614] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T22:03:50.350796] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T22:03:50.390695] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-03T22:03:51.190706] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-03T22:03:51.213246] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T22:03:51.990631] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-03T22:03:52.199363] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T22:03:52.790674] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-03T22:03:52.846057] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T22:03:53.579537] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T22:03:53.590637] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-03T22:03:54.322305] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T22:03:54.390710] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-03T22:03:55.190718] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-03T22:03:55.990731] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-03T22:03:56.352089] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T22:03:56.445579] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:03:56.447685] [INFO ] [REMOTE ] TY: Full fetch complete (11598 records). [2025-10-03T22:03:56.447803] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-03T22:03:56.797546] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-03T22:03:56.795515] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-03T22:03:56.910247] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-03T22:03:56.910373] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-03T22:03:56.910696] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-03T22:03:56.910759] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-03T22:03:56.911219] [DEBUG] [LOCAL ] TY: Trimmed 11598 records to 7611 (keeping 200 days of data) [2025-10-03T22:03:56.962799] [DEBUG] [LOCAL ] TY: Primary data saved (7611 records). [2025-10-03T22:03:56.962956] [INFO ] [MAIN ] TY: Full history saved. [2025-10-03T22:03:56.963081] [INFO ] [MAIN ] Update Progress: 2161/2370 symbols completed. TY took 20.7s. Estimated remaining: 29m 23s. Rate: 7.1 symbols/min [2025-10-03T22:03:57.138616] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:03:57.202298] [DEBUG] [LOCAL ] UA: Loaded 50841 existing records from primary storage. [2025-10-03T22:03:57.202715] [INFO ] [MAIN ] UA: Loaded 50841 existing records. [2025-10-03T22:03:57.390055] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:03:57.390337] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-03T22:03:57.390389] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-03T22:03:57.390708] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-03T22:03:57.390783] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-03T22:03:57.599230] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-03T22:03:57.768573] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T22:03:57.797225] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:03:58.390729] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-03T22:03:58.829169] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T22:03:59.190719] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-03T22:03:59.990632] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-03T22:04:00.314859] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T22:04:00.397785] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T22:04:00.650893] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T22:04:00.652633] [INFO ] [REMOTE ] TYG: Full fetch complete (22537 records). [2025-10-03T22:04:00.652767] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-03T22:04:00.798411] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-03T22:04:01.253063] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:04:01.255343] [INFO ] [REMOTE ] TYL: Full fetch complete (31387 records). [2025-10-03T22:04:01.255504] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-03T22:04:01.387087] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-03T22:04:01.409856] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-03T22:04:01.436302] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-03T22:04:01.447397] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-03T22:04:01.476917] [DEBUG] [LOCAL ] TYG: Trimmed 22537 records to 14306 (keeping 200 days of data) [2025-10-03T22:04:01.626255] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-03T22:04:01.876666] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-03T22:04:01.877674] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-03T22:04:01.879774] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-03T22:04:01.879860] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-03T22:04:01.883145] [DEBUG] [LOCAL ] TYL: Trimmed 31387 records to 22473 (keeping 200 days of data) [2025-10-03T22:04:02.010340] [DEBUG] [LOCAL ] TYG: Primary data saved (14306 records). [2025-10-03T22:04:02.011174] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-03T22:04:02.011588] [INFO ] [MAIN ] Update Progress: 2162/2370 symbols completed. TYG took 25.8s. Estimated remaining: 29m 15s. Rate: 7.1 symbols/min [2025-10-03T22:04:02.224158] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:02.308245] [DEBUG] [LOCAL ] UAA: Loaded 53897 existing records from primary storage. [2025-10-03T22:04:02.309851] [INFO ] [MAIN ] UAA: Loaded 53897 existing records. [2025-10-03T22:04:02.393964] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-03T22:04:02.404995] [DEBUG] [LOCAL ] TYL: Primary data saved (22473 records). [2025-10-03T22:04:02.420171] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-03T22:04:02.425732] [INFO ] [MAIN ] Update Progress: 2163/2370 symbols completed. TYL took 26.2s. Estimated remaining: 29m 5s. Rate: 7.1 symbols/min [2025-10-03T22:04:02.623825] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:02.640214] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-03T22:04:02.645700] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-03T22:04:02.666566] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-03T22:04:02.696054] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-03T22:04:02.715545] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:02.875176] [DEBUG] [LOCAL ] UAN: Loaded 5425 existing records from primary storage. [2025-10-03T22:04:02.892869] [INFO ] [MAIN ] UAN: Loaded 5425 existing records. [2025-10-03T22:04:03.340737] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:03.347414] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:03.347762] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-03T22:04:03.348104] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-03T22:04:03.348222] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-03T22:04:03.349162] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-03T22:04:03.349235] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-03T22:04:03.731291] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:03.990691] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-03T22:04:04.177381] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-03T22:04:04.255237] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T22:04:04.749499] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T22:04:04.790707] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-03T22:04:05.028279] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:04:05.590740] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-03T22:04:06.163811] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T22:04:06.390717] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-03T22:04:07.190747] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-03T22:04:07.818714] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-03T22:04:07.990746] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-03T22:04:08.194937] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T22:04:08.634219] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T22:04:08.795835] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-03T22:04:08.815810] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T22:04:09.426875] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T22:04:09.590719] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-03T22:04:10.390757] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-03T22:04:11.014310] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T22:04:11.190675] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-03T22:04:11.336706] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T22:04:11.990728] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-03T22:04:12.746496] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T22:04:12.790670] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-03T22:04:13.008002] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T22:04:13.590735] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-03T22:04:14.345474] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T22:04:14.390774] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-03T22:04:14.611473] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T22:04:15.156706] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T22:04:15.190763] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-03T22:04:15.990754] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-03T22:04:16.591194] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T22:04:16.790674] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-03T22:04:17.056814] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T22:04:17.590693] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-03T22:04:18.390710] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-03T22:04:18.610668] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T22:04:19.190705] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-03T22:04:19.555724] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T22:04:19.990692] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-03T22:04:20.490811] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T22:04:20.789318] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T22:04:20.798364] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-03T22:04:21.590632] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-03T22:04:21.862875] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T22:04:22.390752] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-03T22:04:23.190716] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-03T22:04:23.247635] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T22:04:23.252068] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-03T22:04:23.312489] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:04:23.990703] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-03T22:04:24.575480] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T22:04:24.790745] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-03T22:04:24.903333] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T22:04:25.590713] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-03T22:04:26.390697] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-03T22:04:26.631209] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T22:04:27.190715] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-03T22:04:27.607674] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T22:04:27.608638] [INFO ] [REMOTE ] UAN: Full fetch complete (8134 records). [2025-10-03T22:04:27.608805] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-03T22:04:28.000790] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-03T22:04:28.000670] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-03T22:04:28.001059] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-03T22:04:28.002873] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-03T22:04:28.003159] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-03T22:04:28.004957] [DEBUG] [LOCAL ] UAN: Trimmed 8134 records to 5475 (keeping 200 days of data) [2025-10-03T22:04:28.041427] [DEBUG] [LOCAL ] UAN: Primary data saved (5475 records). [2025-10-03T22:04:28.041567] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-03T22:04:28.041701] [INFO ] [MAIN ] Update Progress: 2164/2370 symbols completed. UAN took 25.6s. Estimated remaining: 28m 59s. Rate: 7.1 symbols/min [2025-10-03T22:04:28.236117] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:28.274813] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-03T22:04:28.319928] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T22:04:28.384072] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-03T22:04:28.384518] [INFO ] [MAIN ] UBER: Loaded 54196 existing records. [2025-10-03T22:04:28.579809] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:28.580478] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-03T22:04:28.580541] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-03T22:04:28.580982] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-03T22:04:28.581055] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-03T22:04:28.798601] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-03T22:04:28.975864] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:29.590734] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-03T22:04:29.926373] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T22:04:30.390735] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-03T22:04:30.910298] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T22:04:30.914229] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-03T22:04:30.914404] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-03T22:04:31.195749] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-03T22:04:31.437032] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-03T22:04:31.437326] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-03T22:04:31.439106] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-03T22:04:31.439312] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-03T22:04:31.441244] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54579 (keeping 200 days of data) [2025-10-03T22:04:31.569601] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T22:04:31.836360] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-10-03T22:04:31.843146] [INFO ] [MAIN ] U: Full history saved. [2025-10-03T22:04:31.843326] [INFO ] [MAIN ] Update Progress: 2165/2370 symbols completed. U took 55.6s. Estimated remaining: 28m 50s. Rate: 7.1 symbols/min [2025-10-03T22:04:31.843684] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T22:04:31.907496] [INFO ] [REMOTE ] UA: Full fetch complete (73005 records). [2025-10-03T22:04:31.923263] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-03T22:04:31.995316] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-03T22:04:32.169223] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:32.530773] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-03T22:04:32.531900] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-03T22:04:32.533489] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-03T22:04:32.533634] [DEBUG] [LOCAL ] UBS: Loaded 52778 existing records from primary storage. [2025-10-03T22:04:32.533777] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-03T22:04:32.534328] [INFO ] [MAIN ] UBS: Loaded 52778 existing records. [2025-10-03T22:04:32.652910] [DEBUG] [LOCAL ] UA: Trimmed 73005 records to 51215 (keeping 200 days of data) [2025-10-03T22:04:32.827758] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:32.829192] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-03T22:04:32.830240] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-03T22:04:32.831775] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-03T22:04:32.833095] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-03T22:04:33.260102] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:33.261672] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-03T22:04:33.455435] [DEBUG] [LOCAL ] UA: Primary data saved (51215 records). [2025-10-03T22:04:33.455601] [INFO ] [MAIN ] UA: Full history saved. [2025-10-03T22:04:33.455745] [INFO ] [MAIN ] Update Progress: 2166/2370 symbols completed. UA took 36.5s. Estimated remaining: 28m 41s. Rate: 7.1 symbols/min [2025-10-03T22:04:33.643814] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:33.683334] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T22:04:33.695460] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-03T22:04:33.731210] [DEBUG] [LOCAL ] UCB: Loaded 38118 existing records from primary storage. [2025-10-03T22:04:33.731549] [INFO ] [MAIN ] UCB: Loaded 38118 existing records. [2025-10-03T22:04:33.921823] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:33.922404] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-03T22:04:33.922482] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-03T22:04:33.922813] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-03T22:04:33.922877] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-03T22:04:34.274271] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T22:04:34.372750] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:34.390727] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-03T22:04:34.988929] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T22:04:35.190705] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-03T22:04:35.878965] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T22:04:35.990638] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-03T22:04:36.193251] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-03T22:04:36.743253] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T22:04:36.747383] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-03T22:04:36.747604] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-03T22:04:36.795866] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-03T22:04:37.172679] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-03T22:04:37.172812] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-03T22:04:37.174152] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-03T22:04:37.174220] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-03T22:04:37.176863] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 54287 (keeping 200 days of data) [2025-10-03T22:04:37.520777] [DEBUG] [LOCAL ] UAA: Primary data saved (54287 records). [2025-10-03T22:04:37.520984] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-03T22:04:37.521965] [INFO ] [MAIN ] Update Progress: 2167/2370 symbols completed. UAA took 35.5s. Estimated remaining: 28m 32s. Rate: 7.1 symbols/min [2025-10-03T22:04:37.591457] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-03T22:04:37.721019] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:04:37.787376] [DEBUG] [LOCAL ] UDR: Loaded 52218 existing records from primary storage. [2025-10-03T22:04:37.787796] [INFO ] [MAIN ] UDR: Loaded 52218 existing records. [2025-10-03T22:04:38.023289] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:04:38.024724] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-03T22:04:38.026892] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-03T22:04:38.027080] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-03T22:04:38.038222] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-03T22:04:38.038360] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-03T22:04:38.395817] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-03T22:04:38.440721] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:04:39.171807] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T22:04:39.190613] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-03T22:04:39.285680] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-03T22:04:39.990703] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-03T22:04:40.158782] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T22:04:40.416442] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T22:04:40.790738] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-03T22:04:41.380120] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T22:04:41.590714] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-03T22:04:42.390765] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-03T22:04:42.431352] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T22:04:43.190698] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-03T22:04:43.646801] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T22:04:43.990738] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-03T22:04:44.773418] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T22:04:44.790673] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-03T22:04:44.840715] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-03T22:04:45.590694] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-03T22:04:45.934996] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T22:04:46.390680] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-03T22:04:46.419489] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T22:04:47.190700] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-03T22:04:47.990679] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-03T22:04:48.043108] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-03T22:04:48.083779] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T22:04:48.638369] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T22:04:48.790692] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-03T22:04:49.353515] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T22:04:49.590714] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-03T22:04:50.390685] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-03T22:04:51.190740] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-03T22:04:51.394450] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T22:04:51.412937] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-03T22:04:51.560607] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T22:04:51.990702] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-03T22:04:52.711819] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T22:04:52.790740] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-03T22:04:53.325227] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T22:04:53.590752] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-03T22:04:54.390760] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-03T22:04:55.190687] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-03T22:04:55.227442] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-03T22:04:55.482350] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T22:04:55.799333] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T22:04:55.990735] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-03T22:04:56.790698] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-03T22:04:56.871460] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T22:04:57.590753] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-03T22:04:58.195197] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T22:04:58.390681] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-03T22:04:58.628579] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-03T22:04:59.058286] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T22:04:59.190713] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-03T22:04:59.835955] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T22:04:59.990691] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-03T22:05:00.790632] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-03T22:05:01.041613] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T22:05:01.068347] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T22:05:01.071727] [INFO ] [REMOTE ] UCB: Full fetch complete (54770 records). [2025-10-03T22:05:01.071946] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-03T22:05:01.511628] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-03T22:05:01.511750] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-03T22:05:01.513122] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-03T22:05:01.513219] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-03T22:05:01.514604] [DEBUG] [LOCAL ] UCB: Trimmed 54770 records to 38420 (keeping 200 days of data) [2025-10-03T22:05:01.606193] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-03T22:05:01.767802] [DEBUG] [LOCAL ] UCB: Primary data saved (38420 records). [2025-10-03T22:05:01.768056] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-03T22:05:01.768186] [INFO ] [MAIN ] Update Progress: 2168/2370 symbols completed. UCB took 28.3s. Estimated remaining: 28m 25s. Rate: 7.1 symbols/min [2025-10-03T22:05:01.972751] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:02.022103] [DEBUG] [LOCAL ] UE: Loaded 43024 existing records from primary storage. [2025-10-03T22:05:02.022425] [INFO ] [MAIN ] UE: Loaded 43024 existing records. [2025-10-03T22:05:02.239484] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:02.239790] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-03T22:05:02.239867] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-03T22:05:02.240387] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-03T22:05:02.240470] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-03T22:05:02.395787] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-03T22:05:02.630593] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:03.140838] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T22:05:03.143952] [INFO ] [REMOTE ] UBS: Full fetch complete (75703 records). [2025-10-03T22:05:03.144112] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-03T22:05:03.197777] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-03T22:05:03.609322] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-03T22:05:03.676293] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-03T22:05:03.676408] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-03T22:05:03.678009] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-03T22:05:03.678098] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-03T22:05:03.679909] [DEBUG] [LOCAL ] UBS: Trimmed 75703 records to 53142 (keeping 200 days of data) [2025-10-03T22:05:03.985296] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T22:05:03.997486] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-03T22:05:04.101098] [DEBUG] [LOCAL ] UBS: Primary data saved (53142 records). [2025-10-03T22:05:04.101303] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-03T22:05:04.101429] [INFO ] [MAIN ] Update Progress: 2169/2370 symbols completed. UBS took 32.3s. Estimated remaining: 28m 16s. Rate: 7.1 symbols/min [2025-10-03T22:05:04.272190] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:04.283552] [DEBUG] [LOCAL ] UFI: Loaded 8157 existing records from primary storage. [2025-10-03T22:05:04.283836] [INFO ] [MAIN ] UFI: Loaded 8157 existing records. [2025-10-03T22:05:04.465105] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:04.465408] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-03T22:05:04.465459] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-03T22:05:04.465698] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-03T22:05:04.465757] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-03T22:05:04.795549] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-03T22:05:04.841821] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:04.875120] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:05:05.590743] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-03T22:05:06.371833] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-03T22:05:06.390610] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-03T22:05:06.440422] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T22:05:06.836591] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:05:06.839465] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-03T22:05:06.839616] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-03T22:05:07.199235] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-03T22:05:07.299986] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T22:05:07.336508] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-03T22:05:07.336628] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-03T22:05:07.338360] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-03T22:05:07.338546] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-03T22:05:07.341908] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54586 (keeping 200 days of data) [2025-10-03T22:05:07.700451] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-10-03T22:05:07.700624] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-03T22:05:07.700774] [INFO ] [MAIN ] Update Progress: 2170/2370 symbols completed. UBER took 39.7s. Estimated remaining: 28m 7s. Rate: 7.1 symbols/min [2025-10-03T22:05:07.891623] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:07.948092] [DEBUG] [LOCAL ] UGI: Loaded 50869 existing records from primary storage. [2025-10-03T22:05:07.948477] [INFO ] [MAIN ] UGI: Loaded 50869 existing records. [2025-10-03T22:05:07.995872] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-03T22:05:08.153157] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:08.153401] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-03T22:05:08.153568] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-03T22:05:08.153838] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-03T22:05:08.153908] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-03T22:05:08.536017] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:08.790634] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-03T22:05:08.932010] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T22:05:08.952638] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T22:05:09.590717] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-03T22:05:10.391979] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-03T22:05:10.394988] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T22:05:11.190673] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-03T22:05:11.397477] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T22:05:11.601727] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T22:05:11.990727] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-03T22:05:12.409369] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T22:05:12.790738] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-03T22:05:13.248393] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T22:05:13.251222] [INFO ] [REMOTE ] UDR: Full fetch complete (74648 records). [2025-10-03T22:05:13.251357] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-03T22:05:13.594294] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-03T22:05:13.741211] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-03T22:05:13.741369] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-03T22:05:13.742985] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-03T22:05:13.743075] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-03T22:05:13.772789] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T22:05:13.782767] [DEBUG] [LOCAL ] UDR: Trimmed 74648 records to 52605 (keeping 200 days of data) [2025-10-03T22:05:14.122663] [DEBUG] [LOCAL ] UDR: Primary data saved (52605 records). [2025-10-03T22:05:14.122833] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-03T22:05:14.123624] [INFO ] [MAIN ] Update Progress: 2171/2370 symbols completed. UDR took 36.6s. Estimated remaining: 27m 58s. Rate: 7.1 symbols/min [2025-10-03T22:05:14.311461] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:14.364375] [DEBUG] [LOCAL ] UGP: Loaded 43266 existing records from primary storage. [2025-10-03T22:05:14.364799] [INFO ] [MAIN ] UGP: Loaded 43266 existing records. [2025-10-03T22:05:14.395767] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-03T22:05:14.580394] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:14.580637] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-03T22:05:14.580741] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-03T22:05:14.581104] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-03T22:05:14.581168] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-03T22:05:14.987518] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:15.190682] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-03T22:05:15.312246] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T22:05:15.990675] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-03T22:05:16.119513] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T22:05:16.790741] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-03T22:05:16.875856] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T22:05:17.238982] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T22:05:17.590676] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-03T22:05:18.317990] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T22:05:18.390731] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-03T22:05:18.606515] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T22:05:19.190738] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-03T22:05:19.234749] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T22:05:19.990724] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-03T22:05:20.699800] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T22:05:20.790744] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-03T22:05:21.590698] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-03T22:05:21.675246] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T22:05:21.937345] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T22:05:22.390746] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-03T22:05:22.681855] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T22:05:23.190694] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-03T22:05:23.922845] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T22:05:23.990736] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-03T22:05:24.704181] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T22:05:24.790714] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-03T22:05:25.590698] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-03T22:05:25.731344] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T22:05:25.773621] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T22:05:26.390733] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-03T22:05:27.156774] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T22:05:27.175091] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T22:05:27.190605] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-03T22:05:27.911217] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T22:05:27.990700] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-03T22:05:28.725908] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T22:05:28.790683] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-03T22:05:29.515777] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T22:05:29.590698] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-03T22:05:30.390709] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-03T22:05:31.190711] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-03T22:05:31.473055] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T22:05:31.891883] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T22:05:31.997051] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-03T22:05:32.017328] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T22:05:32.790729] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-03T22:05:33.391143] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T22:05:33.392301] [INFO ] [REMOTE ] UFI: Full fetch complete (12462 records). [2025-10-03T22:05:33.392455] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-03T22:05:33.599716] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-03T22:05:33.802442] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T22:05:33.862293] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-03T22:05:33.862377] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-03T22:05:33.862742] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-03T22:05:33.862809] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-03T22:05:33.863333] [DEBUG] [LOCAL ] UFI: Trimmed 12462 records to 8258 (keeping 200 days of data) [2025-10-03T22:05:33.913253] [DEBUG] [LOCAL ] UFI: Primary data saved (8258 records). [2025-10-03T22:05:33.913417] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-03T22:05:33.913520] [INFO ] [MAIN ] Update Progress: 2172/2370 symbols completed. UFI took 29.8s. Estimated remaining: 27m 51s. Rate: 7.1 symbols/min [2025-10-03T22:05:34.102349] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:34.122504] [DEBUG] [LOCAL ] UHAL: Loaded 16684 existing records from primary storage. [2025-10-03T22:05:34.122843] [INFO ] [MAIN ] UHAL: Loaded 16684 existing records. [2025-10-03T22:05:34.322107] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:34.322377] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-03T22:05:34.322430] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-03T22:05:34.322699] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-03T22:05:34.322760] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-03T22:05:34.395891] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-03T22:05:34.737396] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:35.190703] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-03T22:05:35.253895] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T22:05:35.990715] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-03T22:05:36.118986] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T22:05:36.656684] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T22:05:36.790697] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-03T22:05:36.968362] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T22:05:37.590705] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-03T22:05:37.880697] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T22:05:37.882970] [INFO ] [REMOTE ] UE: Full fetch complete (61340 records). [2025-10-03T22:05:37.883084] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-03T22:05:38.299085] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-03T22:05:38.299208] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-03T22:05:38.300511] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-03T22:05:38.300630] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-03T22:05:38.305069] [DEBUG] [LOCAL ] UE: Trimmed 61340 records to 43284 (keeping 200 days of data) [2025-10-03T22:05:38.394362] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-03T22:05:38.582958] [DEBUG] [LOCAL ] UE: Primary data saved (43284 records). [2025-10-03T22:05:38.583098] [INFO ] [MAIN ] UE: Full history saved. [2025-10-03T22:05:38.583211] [INFO ] [MAIN ] Update Progress: 2173/2370 symbols completed. UE took 36.8s. Estimated remaining: 27m 42s. Rate: 7.1 symbols/min [2025-10-03T22:05:38.769460] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:38.811784] [DEBUG] [LOCAL ] UHS: Loaded 41142 existing records from primary storage. [2025-10-03T22:05:38.812107] [INFO ] [MAIN ] UHS: Loaded 41142 existing records. [2025-10-03T22:05:38.999442] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:38.999713] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-03T22:05:38.999773] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-03T22:05:39.000167] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-03T22:05:39.000227] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-03T22:05:39.196265] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-03T22:05:39.391436] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:39.884723] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T22:05:39.932400] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T22:05:39.990630] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-03T22:05:40.251802] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T22:05:40.790716] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-03T22:05:40.815161] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T22:05:41.590703] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-03T22:05:42.390671] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-03T22:05:42.565701] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T22:05:43.189786] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T22:05:43.193100] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-03T22:05:43.357244] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T22:05:43.990709] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-03T22:05:44.751479] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T22:05:44.790691] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-03T22:05:45.561520] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T22:05:45.590738] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-03T22:05:46.395846] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-03T22:05:46.414583] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T22:05:46.844617] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T22:05:46.847085] [INFO ] [REMOTE ] UGP: Full fetch complete (62246 records). [2025-10-03T22:05:46.847214] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-03T22:05:47.190995] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-03T22:05:47.290114] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T22:05:47.316767] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-03T22:05:47.317238] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-03T22:05:47.318526] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-03T22:05:47.318593] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-03T22:05:47.319797] [DEBUG] [LOCAL ] UGP: Trimmed 62246 records to 43607 (keeping 200 days of data) [2025-10-03T22:05:47.588630] [DEBUG] [LOCAL ] UGP: Primary data saved (43607 records). [2025-10-03T22:05:47.588829] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-03T22:05:47.590277] [INFO ] [MAIN ] Update Progress: 2174/2370 symbols completed. UGP took 33.5s. Estimated remaining: 27m 34s. Rate: 7.1 symbols/min [2025-10-03T22:05:47.776338] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:47.791190] [DEBUG] [LOCAL ] UHT: Loaded 9993 existing records from primary storage. [2025-10-03T22:05:47.791457] [INFO ] [MAIN ] UHT: Loaded 9993 existing records. [2025-10-03T22:05:47.995846] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-03T22:05:48.000129] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:48.000585] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-03T22:05:48.000700] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-03T22:05:48.001973] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-03T22:05:48.002045] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-03T22:05:48.413530] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:48.790743] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-03T22:05:48.928185] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T22:05:49.590710] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-03T22:05:49.738070] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T22:05:49.758453] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T22:05:50.390685] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-03T22:05:50.532995] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T22:05:51.190713] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-03T22:05:51.990626] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-03T22:05:52.103875] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T22:05:52.156807] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T22:05:52.790697] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-03T22:05:52.957755] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T22:05:53.590745] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-03T22:05:53.637459] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T22:05:54.390732] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-03T22:05:55.190700] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-03T22:05:55.260453] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T22:05:55.767618] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T22:05:55.770375] [INFO ] [REMOTE ] UGI: Full fetch complete (73346 records). [2025-10-03T22:05:55.770493] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-03T22:05:56.003984] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-03T22:05:56.003840] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T22:05:56.273986] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-03T22:05:56.274082] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-03T22:05:56.275375] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-03T22:05:56.275447] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-03T22:05:56.277190] [DEBUG] [LOCAL ] UGI: Trimmed 73346 records to 51249 (keeping 200 days of data) [2025-10-03T22:05:56.621391] [DEBUG] [LOCAL ] UGI: Primary data saved (51249 records). [2025-10-03T22:05:56.621594] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-03T22:05:56.621730] [INFO ] [MAIN ] Update Progress: 2175/2370 symbols completed. UGI took 48.9s. Estimated remaining: 27m 25s. Rate: 7.1 symbols/min [2025-10-03T22:05:56.799077] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-03T22:05:56.808333] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:05:56.828337] [DEBUG] [LOCAL ] UI: Loaded 13213 existing records from primary storage. [2025-10-03T22:05:56.828628] [INFO ] [MAIN ] UI: Loaded 13213 existing records. [2025-10-03T22:05:57.018987] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:05:57.019230] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-03T22:05:57.019284] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-03T22:05:57.019516] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-03T22:05:57.019577] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-03T22:05:57.423224] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:05:57.590752] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-03T22:05:57.756622] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T22:05:57.805445] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T22:05:58.390739] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-03T22:05:58.499683] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T22:05:59.190712] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-03T22:05:59.737919] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T22:05:59.768244] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T22:05:59.990724] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-03T22:06:00.790739] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-03T22:06:00.895676] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T22:06:01.590742] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-03T22:06:02.306537] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T22:06:02.390739] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-03T22:06:02.435164] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T22:06:03.190679] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-03T22:06:03.846345] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T22:06:03.990732] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-03T22:06:04.111827] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T22:06:04.790704] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-03T22:06:04.917534] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T22:06:05.541368] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T22:06:05.590732] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-03T22:06:06.018123] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T22:06:06.020371] [INFO ] [REMOTE ] UHS: Full fetch complete (58312 records). [2025-10-03T22:06:06.020713] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-03T22:06:06.395873] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-03T22:06:06.455824] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-03T22:06:06.455922] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-03T22:06:06.457264] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-03T22:06:06.457335] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-03T22:06:06.458941] [DEBUG] [LOCAL ] UHS: Trimmed 58312 records to 41412 (keeping 200 days of data) [2025-10-03T22:06:06.734245] [DEBUG] [LOCAL ] UHS: Primary data saved (41412 records). [2025-10-03T22:06:06.734384] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-03T22:06:06.734516] [INFO ] [MAIN ] Update Progress: 2176/2370 symbols completed. UHS took 28.2s. Estimated remaining: 27m 17s. Rate: 7.1 symbols/min [2025-10-03T22:06:06.909857] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:06.945812] [DEBUG] [LOCAL ] UIS: Loaded 37283 existing records from primary storage. [2025-10-03T22:06:06.946135] [INFO ] [MAIN ] UIS: Loaded 37283 existing records. [2025-10-03T22:06:07.139461] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:07.139752] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-03T22:06:07.139809] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-03T22:06:07.140093] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-03T22:06:07.140154] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-03T22:06:07.196156] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-03T22:06:07.520455] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T22:06:07.557288] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:07.990713] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-03T22:06:08.320177] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T22:06:08.790736] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-03T22:06:09.139268] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T22:06:09.590753] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-03T22:06:09.716929] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T22:06:10.390688] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-03T22:06:10.475113] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T22:06:11.190736] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-03T22:06:11.615092] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T22:06:11.990633] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-03T22:06:12.256610] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T22:06:12.790758] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-03T22:06:13.385084] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T22:06:13.589560] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T22:06:13.590688] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-03T22:06:13.591761] [INFO ] [REMOTE ] UHAL: Full fetch complete (23204 records). [2025-10-03T22:06:13.591840] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-03T22:06:14.006335] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-03T22:06:14.006453] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-03T22:06:14.007190] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-03T22:06:14.007264] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-03T22:06:14.008157] [DEBUG] [LOCAL ] UHAL: Trimmed 23204 records to 16799 (keeping 200 days of data) [2025-10-03T22:06:14.113486] [DEBUG] [LOCAL ] UHAL: Primary data saved (16799 records). [2025-10-03T22:06:14.113684] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-03T22:06:14.113869] [INFO ] [MAIN ] Update Progress: 2177/2370 symbols completed. UHAL took 40.2s. Estimated remaining: 27m 9s. Rate: 7.1 symbols/min [2025-10-03T22:06:14.304603] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:14.367616] [DEBUG] [LOCAL ] UL: Loaded 53457 existing records from primary storage. [2025-10-03T22:06:14.368079] [INFO ] [MAIN ] UL: Loaded 53457 existing records. [2025-10-03T22:06:14.401374] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-03T22:06:14.574460] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:14.574757] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-03T22:06:14.574855] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-03T22:06:14.575137] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-03T22:06:14.575202] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-03T22:06:14.988359] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:15.088463] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T22:06:15.190729] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-03T22:06:15.292377] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T22:06:15.990695] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-03T22:06:16.582802] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T22:06:16.584078] [INFO ] [REMOTE ] UHT: Full fetch complete (14984 records). [2025-10-03T22:06:16.584175] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-03T22:06:16.803476] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-03T22:06:16.954009] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T22:06:17.049994] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-03T22:06:17.050092] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-03T22:06:17.050548] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-03T22:06:17.050604] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-03T22:06:17.051404] [DEBUG] [LOCAL ] UHT: Trimmed 14984 records to 10056 (keeping 200 days of data) [2025-10-03T22:06:17.120206] [DEBUG] [LOCAL ] UHT: Primary data saved (10056 records). [2025-10-03T22:06:17.120363] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-03T22:06:17.120474] [INFO ] [MAIN ] Update Progress: 2178/2370 symbols completed. UHT took 29.5s. Estimated remaining: 26m 60s. Rate: 7.1 symbols/min [2025-10-03T22:06:17.303936] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:17.354347] [DEBUG] [LOCAL ] ULS: Loaded 39708 existing records from primary storage. [2025-10-03T22:06:17.354817] [INFO ] [MAIN ] ULS: Loaded 39708 existing records. [2025-10-03T22:06:17.547215] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:17.547470] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-03T22:06:17.547527] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-03T22:06:17.547854] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-03T22:06:17.547938] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-03T22:06:17.596497] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-03T22:06:17.948462] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T22:06:17.979926] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:18.390706] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-03T22:06:19.190691] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-03T22:06:19.463935] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T22:06:19.768626] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T22:06:19.990635] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-03T22:06:20.151001] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T22:06:20.790715] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-03T22:06:21.336798] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T22:06:21.590737] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-03T22:06:22.270895] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T22:06:22.390713] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-03T22:06:22.927099] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T22:06:23.025787] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T22:06:23.190724] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-03T22:06:23.863550] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T22:06:23.990707] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-03T22:06:24.790742] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-03T22:06:25.033685] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T22:06:25.590706] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-03T22:06:26.390671] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-03T22:06:26.615018] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T22:06:26.640545] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T22:06:27.190759] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-03T22:06:27.790382] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T22:06:27.990722] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-03T22:06:28.790635] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-03T22:06:28.972055] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T22:06:29.111611] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T22:06:29.590759] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-03T22:06:30.218019] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T22:06:30.390683] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-03T22:06:30.466995] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T22:06:30.468699] [INFO ] [REMOTE ] UI: Full fetch complete (18578 records). [2025-10-03T22:06:30.468821] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-03T22:06:30.855261] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-03T22:06:30.855405] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-03T22:06:30.856083] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-03T22:06:30.856149] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-03T22:06:30.857150] [DEBUG] [LOCAL ] UI: Trimmed 18578 records to 13318 (keeping 200 days of data) [2025-10-03T22:06:30.960053] [DEBUG] [LOCAL ] UI: Primary data saved (13318 records). [2025-10-03T22:06:30.960272] [INFO ] [MAIN ] UI: Full history saved. [2025-10-03T22:06:30.960428] [INFO ] [MAIN ] Update Progress: 2179/2370 symbols completed. UI took 34.3s. Estimated remaining: 26m 52s. Rate: 7.1 symbols/min [2025-10-03T22:06:31.170392] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:31.203380] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-03T22:06:31.228379] [DEBUG] [LOCAL ] UMC: Loaded 53092 existing records from primary storage. [2025-10-03T22:06:31.228930] [INFO ] [MAIN ] UMC: Loaded 53092 existing records. [2025-10-03T22:06:31.405326] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:31.405631] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-03T22:06:31.405716] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-03T22:06:31.406034] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-03T22:06:31.406093] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-03T22:06:31.766155] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:31.973317] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:06:31.990598] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-03T22:06:32.790733] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-03T22:06:33.149035] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T22:06:33.369108] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T22:06:33.590684] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-03T22:06:34.345379] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T22:06:34.390624] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-03T22:06:34.642801] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T22:06:34.645138] [INFO ] [REMOTE ] UIS: Full fetch complete (51894 records). [2025-10-03T22:06:34.645240] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-03T22:06:35.037714] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-03T22:06:35.037842] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-03T22:06:35.040395] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-03T22:06:35.040465] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-03T22:06:35.042317] [DEBUG] [LOCAL ] UIS: Trimmed 51894 records to 37532 (keeping 200 days of data) [2025-10-03T22:06:35.208196] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-03T22:06:35.282747] [DEBUG] [LOCAL ] UIS: Primary data saved (37532 records). [2025-10-03T22:06:35.282963] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-03T22:06:35.283073] [INFO ] [MAIN ] Update Progress: 2180/2370 symbols completed. UIS took 28.5s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-03T22:06:35.456457] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:35.500278] [DEBUG] [LOCAL ] UMH: Loaded 33870 existing records from primary storage. [2025-10-03T22:06:35.500797] [INFO ] [MAIN ] UMH: Loaded 33870 existing records. [2025-10-03T22:06:35.680354] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:35.680717] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-03T22:06:35.680779] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-03T22:06:35.681055] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-03T22:06:35.681114] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-03T22:06:36.009518] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-03T22:06:36.061290] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:36.088599] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T22:06:36.790741] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-03T22:06:36.891893] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T22:06:37.590745] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-03T22:06:37.854460] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:06:38.200691] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T22:06:38.390733] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-03T22:06:39.190682] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-03T22:06:39.320074] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T22:06:39.990694] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-03T22:06:40.303793] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T22:06:40.378483] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T22:06:40.790688] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-03T22:06:41.590713] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-03T22:06:41.814613] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T22:06:42.217348] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T22:06:42.390699] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-03T22:06:43.062823] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T22:06:43.190739] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-03T22:06:43.681492] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T22:06:43.990753] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-03T22:06:44.790707] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-03T22:06:44.950114] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T22:06:45.590638] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-03T22:06:45.937038] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T22:06:46.053921] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T22:06:46.390683] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-03T22:06:47.190691] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-03T22:06:47.483787] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T22:06:47.990707] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-03T22:06:48.187976] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T22:06:48.546297] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T22:06:48.790730] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-03T22:06:49.472465] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T22:06:49.590705] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-03T22:06:50.391838] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-03T22:06:50.391592] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T22:06:50.557815] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T22:06:51.190747] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-03T22:06:51.990699] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-03T22:06:52.308611] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T22:06:52.378276] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T22:06:52.790701] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-03T22:06:53.590709] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-03T22:06:53.876851] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T22:06:54.242701] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T22:06:54.390718] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-03T22:06:54.530329] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T22:06:55.190703] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-03T22:06:55.420854] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T22:06:55.423080] [INFO ] [REMOTE ] ULS: Full fetch complete (54343 records). [2025-10-03T22:06:55.423249] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-03T22:06:55.824334] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-03T22:06:55.824457] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-03T22:06:55.825704] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-03T22:06:55.825771] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-03T22:06:55.829157] [DEBUG] [LOCAL ] ULS: Trimmed 54343 records to 39966 (keeping 200 days of data) [2025-10-03T22:06:56.018258] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-03T22:06:56.111531] [DEBUG] [LOCAL ] ULS: Primary data saved (39966 records). [2025-10-03T22:06:56.111728] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-03T22:06:56.112467] [INFO ] [MAIN ] Update Progress: 2181/2370 symbols completed. ULS took 39.0s. Estimated remaining: 26m 36s. Rate: 7.1 symbols/min [2025-10-03T22:06:56.327097] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:56.344074] [DEBUG] [LOCAL ] UNF: Loaded 12130 existing records from primary storage. [2025-10-03T22:06:56.344355] [INFO ] [MAIN ] UNF: Loaded 12130 existing records. [2025-10-03T22:06:56.528133] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:56.528401] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-03T22:06:56.528462] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-03T22:06:56.528746] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-03T22:06:56.528805] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-03T22:06:56.794105] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-03T22:06:56.819321] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T22:06:56.868280] [INFO ] [REMOTE ] UL: Full fetch complete (76895 records). [2025-10-03T22:06:56.898296] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-03T22:06:56.937778] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:57.360298] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-03T22:06:57.360399] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-03T22:06:57.361716] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-03T22:06:57.361786] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-03T22:06:57.363379] [DEBUG] [LOCAL ] UL: Trimmed 76895 records to 53843 (keeping 200 days of data) [2025-10-03T22:06:57.483101] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T22:06:57.615828] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-03T22:06:57.745814] [DEBUG] [LOCAL ] UL: Primary data saved (53843 records). [2025-10-03T22:06:57.745990] [INFO ] [MAIN ] UL: Full history saved. [2025-10-03T22:06:57.746142] [INFO ] [MAIN ] Update Progress: 2182/2370 symbols completed. UL took 43.6s. Estimated remaining: 26m 26s. Rate: 7.1 symbols/min [2025-10-03T22:06:57.931006] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:06:57.980162] [DEBUG] [LOCAL ] UNFI: Loaded 42348 existing records from primary storage. [2025-10-03T22:06:57.980486] [INFO ] [MAIN ] UNFI: Loaded 42348 existing records. [2025-10-03T22:06:58.172269] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:06:58.172529] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-03T22:06:58.172583] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-03T22:06:58.172923] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-03T22:06:58.172984] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-03T22:06:58.407059] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-03T22:06:58.493100] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T22:06:58.583030] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:06:58.699270] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T22:06:59.190737] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-03T22:06:59.931145] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T22:06:59.990627] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-03T22:07:00.293231] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T22:07:00.790768] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-03T22:07:01.590693] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-03T22:07:01.622548] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T22:07:01.929078] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T22:07:02.382511] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T22:07:02.390609] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-03T22:07:03.190625] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-03T22:07:03.278560] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T22:07:03.990717] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-03T22:07:04.377199] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T22:07:04.379276] [INFO ] [REMOTE ] UMH: Full fetch complete (46729 records). [2025-10-03T22:07:04.379437] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-03T22:07:04.792810] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-03T22:07:04.805354] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-03T22:07:04.805432] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-03T22:07:04.806475] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-03T22:07:04.806677] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-03T22:07:04.808008] [DEBUG] [LOCAL ] UMH: Trimmed 46729 records to 34124 (keeping 200 days of data) [2025-10-03T22:07:05.025808] [DEBUG] [LOCAL ] UMH: Primary data saved (34124 records). [2025-10-03T22:07:05.026008] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-03T22:07:05.026133] [INFO ] [MAIN ] Update Progress: 2183/2370 symbols completed. UMH took 29.7s. Estimated remaining: 26m 18s. Rate: 7.1 symbols/min [2025-10-03T22:07:05.203665] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:05.266273] [DEBUG] [LOCAL ] UNH: Loaded 54185 existing records from primary storage. [2025-10-03T22:07:05.266635] [INFO ] [MAIN ] UNH: Loaded 54185 existing records. [2025-10-03T22:07:05.464135] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:05.464580] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-03T22:07:05.464702] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-03T22:07:05.465142] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-03T22:07:05.465254] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-03T22:07:05.578018] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T22:07:05.598804] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-03T22:07:05.907126] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:05.976327] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T22:07:06.390724] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-03T22:07:07.190670] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-03T22:07:07.360948] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T22:07:07.739548] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T22:07:07.900284] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T22:07:07.990712] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-03T22:07:08.790712] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-03T22:07:09.595875] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-03T22:07:09.612304] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:07:10.390725] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-03T22:07:10.605225] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T22:07:11.190662] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-03T22:07:11.215517] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T22:07:11.811030] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-03T22:07:11.990710] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-03T22:07:12.500785] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T22:07:12.504811] [INFO ] [REMOTE ] UMC: Full fetch complete (76586 records). [2025-10-03T22:07:12.505035] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-03T22:07:12.795708] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-03T22:07:12.968935] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-03T22:07:12.969024] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-03T22:07:12.970285] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-03T22:07:12.970355] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-03T22:07:12.972439] [DEBUG] [LOCAL ] UMC: Trimmed 76586 records to 53480 (keeping 200 days of data) [2025-10-03T22:07:13.294844] [DEBUG] [LOCAL ] UMC: Primary data saved (53480 records). [2025-10-03T22:07:13.295015] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-03T22:07:13.295124] [INFO ] [MAIN ] Update Progress: 2184/2370 symbols completed. UMC took 42.3s. Estimated remaining: 26m 9s. Rate: 7.1 symbols/min [2025-10-03T22:07:13.469992] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:13.523053] [DEBUG] [LOCAL ] UNM: Loaded 48812 existing records from primary storage. [2025-10-03T22:07:13.523389] [INFO ] [MAIN ] UNM: Loaded 48812 existing records. [2025-10-03T22:07:13.595902] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-03T22:07:13.719317] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:13.719573] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-03T22:07:13.719627] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-03T22:07:13.719912] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-03T22:07:13.719975] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-03T22:07:14.027260] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T22:07:14.139758] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:14.334756] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-03T22:07:14.390720] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-03T22:07:14.886682] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T22:07:15.190719] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-03T22:07:15.990716] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-03T22:07:16.537761] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T22:07:16.603102] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T22:07:16.790671] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-03T22:07:16.849957] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T22:07:17.590720] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-03T22:07:18.208165] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T22:07:18.390718] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-03T22:07:18.762481] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T22:07:19.190717] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-03T22:07:19.990723] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-03T22:07:20.063455] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T22:07:20.790709] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-03T22:07:21.330424] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-03T22:07:21.590675] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-03T22:07:21.706636] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T22:07:22.129046] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T22:07:22.390739] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-03T22:07:23.139028] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T22:07:23.140278] [INFO ] [REMOTE ] UNF: Full fetch complete (17350 records). [2025-10-03T22:07:23.140376] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-03T22:07:23.202331] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-03T22:07:23.561797] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-03T22:07:23.561899] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-03T22:07:23.562372] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-03T22:07:23.562419] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-03T22:07:23.563366] [DEBUG] [LOCAL ] UNF: Trimmed 17350 records to 12204 (keeping 200 days of data) [2025-10-03T22:07:23.650272] [DEBUG] [LOCAL ] UNF: Primary data saved (12204 records). [2025-10-03T22:07:23.650438] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-03T22:07:23.650536] [INFO ] [MAIN ] Update Progress: 2185/2370 symbols completed. UNF took 27.5s. Estimated remaining: 26m 1s. Rate: 7.1 symbols/min [2025-10-03T22:07:23.829352] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:23.836036] [DEBUG] [LOCAL ] UNMA: Loaded 3533 existing records from primary storage. [2025-10-03T22:07:23.836218] [INFO ] [MAIN ] UNMA: Loaded 3533 existing records. [2025-10-03T22:07:23.998733] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-03T22:07:24.025318] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:24.027212] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-03T22:07:24.027336] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-03T22:07:24.027632] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-03T22:07:24.027723] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-03T22:07:24.442414] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:24.477164] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-10-03T22:07:24.790713] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-03T22:07:24.841466] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T22:07:25.502208] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T22:07:25.590707] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-03T22:07:25.871551] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:07:26.094804] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T22:07:26.390719] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-03T22:07:27.190705] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-03T22:07:27.990713] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-03T22:07:28.115480] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T22:07:28.554760] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T22:07:28.646347] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T22:07:28.790712] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-03T22:07:29.590745] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-03T22:07:30.390700] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-03T22:07:30.577814] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T22:07:30.763781] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T22:07:31.190694] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-03T22:07:31.990698] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-03T22:07:32.791729] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-03T22:07:32.795673] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T22:07:33.016753] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-03T22:07:33.266424] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T22:07:33.269107] [INFO ] [REMOTE ] UNFI: Full fetch complete (59326 records). [2025-10-03T22:07:33.269240] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-03T22:07:33.554440] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T22:07:33.595810] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-03T22:07:33.695938] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-03T22:07:33.696040] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-03T22:07:33.697195] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-03T22:07:33.697266] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-03T22:07:33.698749] [DEBUG] [LOCAL ] UNFI: Trimmed 59326 records to 42709 (keeping 200 days of data) [2025-10-03T22:07:33.963582] [DEBUG] [LOCAL ] UNFI: Primary data saved (42709 records). [2025-10-03T22:07:33.963757] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-03T22:07:33.963861] [INFO ] [MAIN ] Update Progress: 2186/2370 symbols completed. UNFI took 36.2s. Estimated remaining: 25m 53s. Rate: 7.1 symbols/min [2025-10-03T22:07:34.087725] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T22:07:34.160128] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:34.215968] [DEBUG] [LOCAL ] UNP: Loaded 53658 existing records from primary storage. [2025-10-03T22:07:34.216448] [INFO ] [MAIN ] UNP: Loaded 53658 existing records. [2025-10-03T22:07:34.401580] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-03T22:07:34.408078] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:34.409362] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-03T22:07:34.409426] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-03T22:07:34.410222] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-03T22:07:34.410288] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-03T22:07:34.777871] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:34.994139] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T22:07:35.190690] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-03T22:07:35.854728] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T22:07:35.990668] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-03T22:07:36.790689] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-03T22:07:37.590702] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-03T22:07:37.834815] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:07:38.196982] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T22:07:38.390681] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-03T22:07:38.422499] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T22:07:38.866473] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T22:07:39.190692] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-03T22:07:39.990635] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-03T22:07:40.525754] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T22:07:40.790723] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-03T22:07:41.590722] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-03T22:07:41.700815] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-03T22:07:42.390736] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-03T22:07:42.653100] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T22:07:42.783782] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T22:07:42.784683] [INFO ] [REMOTE ] UNMA: Full fetch complete (5774 records). [2025-10-03T22:07:42.784803] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-03T22:07:43.195625] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-03T22:07:43.197212] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-03T22:07:43.197309] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-03T22:07:43.197544] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-03T22:07:43.197589] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-03T22:07:43.198171] [DEBUG] [LOCAL ] UNMA: Trimmed 5774 records to 3553 (keeping 200 days of data) [2025-10-03T22:07:43.221569] [DEBUG] [LOCAL ] UNMA: Primary data saved (3553 records). [2025-10-03T22:07:43.221703] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-03T22:07:43.221825] [INFO ] [MAIN ] Update Progress: 2187/2370 symbols completed. UNMA took 19.6s. Estimated remaining: 25m 45s. Rate: 7.1 symbols/min [2025-10-03T22:07:43.414456] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:43.451630] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T22:07:43.500980] [DEBUG] [LOCAL ] UP: Loaded 43529 existing records from primary storage. [2025-10-03T22:07:43.501332] [INFO ] [MAIN ] UP: Loaded 43529 existing records. [2025-10-03T22:07:43.709989] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:43.710408] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-03T22:07:43.710471] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-03T22:07:43.710780] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-03T22:07:43.710856] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-03T22:07:43.998064] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-03T22:07:44.089484] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:44.790733] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-03T22:07:45.590738] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-03T22:07:45.734875] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T22:07:46.047389] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-03T22:07:46.398699] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-03T22:07:46.419200] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T22:07:47.190729] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-03T22:07:47.366596] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T22:07:47.990774] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-03T22:07:48.677525] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T22:07:48.790689] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-03T22:07:49.299964] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-03T22:07:49.590740] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-03T22:07:49.811039] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T22:07:49.907852] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T22:07:50.054549] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T22:07:50.059799] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-03T22:07:50.060093] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-03T22:07:50.396065] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-03T22:07:50.557804] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-03T22:07:50.557944] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-03T22:07:50.559636] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-03T22:07:50.559749] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-03T22:07:50.561533] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 54575 (keeping 200 days of data) [2025-10-03T22:07:50.930744] [DEBUG] [LOCAL ] UNH: Primary data saved (54575 records). [2025-10-03T22:07:50.930918] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-03T22:07:50.931026] [INFO ] [MAIN ] Update Progress: 2188/2370 symbols completed. UNH took 45.9s. Estimated remaining: 25m 36s. Rate: 7.1 symbols/min [2025-10-03T22:07:51.129232] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:51.190985] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-03T22:07:51.190840] [DEBUG] [LOCAL ] UPS: Loaded 54102 existing records from primary storage. [2025-10-03T22:07:51.192993] [INFO ] [MAIN ] UPS: Loaded 54102 existing records. [2025-10-03T22:07:51.410151] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:51.410463] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-03T22:07:51.410518] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-03T22:07:51.410837] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-03T22:07:51.410897] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-03T22:07:51.787750] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:51.990451] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T22:07:51.999465] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-03T22:07:52.790742] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-03T22:07:53.379734] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-03T22:07:53.590745] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-03T22:07:54.135085] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T22:07:54.269986] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T22:07:54.390743] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-03T22:07:54.997433] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T22:07:55.190730] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-03T22:07:55.917573] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T22:07:55.990618] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-03T22:07:56.790750] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-03T22:07:57.377940] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-03T22:07:57.554097] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T22:07:57.590628] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-03T22:07:58.121226] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T22:07:58.123862] [INFO ] [REMOTE ] UNM: Full fetch complete (69985 records). [2025-10-03T22:07:58.123970] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-03T22:07:58.401235] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-03T22:07:58.547875] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-03T22:07:58.548016] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-03T22:07:58.549477] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-03T22:07:58.549547] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-03T22:07:58.551369] [DEBUG] [LOCAL ] UNM: Trimmed 69985 records to 49114 (keeping 200 days of data) [2025-10-03T22:07:58.871470] [DEBUG] [LOCAL ] UNM: Primary data saved (49114 records). [2025-10-03T22:07:58.871674] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-03T22:07:58.871803] [INFO ] [MAIN ] Update Progress: 2189/2370 symbols completed. UNM took 45.6s. Estimated remaining: 25m 28s. Rate: 7.1 symbols/min [2025-10-03T22:07:59.069199] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:07:59.115438] [DEBUG] [LOCAL ] URI: Loaded 35864 existing records from primary storage. [2025-10-03T22:07:59.115851] [INFO ] [MAIN ] URI: Loaded 35864 existing records. [2025-10-03T22:07:59.210443] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-03T22:07:59.314357] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:07:59.361779] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:07:59.362997] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-03T22:07:59.363064] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-03T22:07:59.363781] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-03T22:07:59.363851] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-03T22:07:59.731396] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:07:59.990723] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-03T22:08:00.378608] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-03T22:08:00.790675] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-03T22:08:01.307700] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T22:08:01.509030] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T22:08:01.590690] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-03T22:08:02.261810] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T22:08:02.390735] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-03T22:08:03.190749] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-03T22:08:03.760560] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T22:08:03.990686] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-03T22:08:04.494982] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T22:08:04.705254] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T22:08:04.790632] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-03T22:08:05.585265] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T22:08:05.593499] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-03T22:08:06.390737] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-03T22:08:06.829548] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T22:08:07.190750] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-03T22:08:07.951694] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T22:08:07.990634] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-03T22:08:08.038586] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T22:08:08.790758] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-03T22:08:09.145992] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T22:08:09.590752] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-03T22:08:10.167083] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-03T22:08:10.390737] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-03T22:08:10.561206] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T22:08:10.564191] [INFO ] [REMOTE ] UP: Full fetch complete (62454 records). [2025-10-03T22:08:10.564343] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-03T22:08:10.958895] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-03T22:08:10.959017] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-03T22:08:10.960882] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-03T22:08:10.960951] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-03T22:08:10.962683] [DEBUG] [LOCAL ] UP: Trimmed 62454 records to 43915 (keeping 200 days of data) [2025-10-03T22:08:11.190909] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-03T22:08:11.283678] [DEBUG] [LOCAL ] UP: Primary data saved (43915 records). [2025-10-03T22:08:11.302883] [INFO ] [MAIN ] UP: Full history saved. [2025-10-03T22:08:11.304804] [INFO ] [MAIN ] Update Progress: 2190/2370 symbols completed. UP took 28.1s. Estimated remaining: 25m 19s. Rate: 7.1 symbols/min [2025-10-03T22:08:11.354520] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T22:08:11.494639] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:11.542537] [DEBUG] [LOCAL ] USA: Loaded 36257 existing records from primary storage. [2025-10-03T22:08:11.543006] [INFO ] [MAIN ] USA: Loaded 36257 existing records. [2025-10-03T22:08:11.723789] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:11.724095] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-03T22:08:11.724167] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-03T22:08:11.724520] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-03T22:08:11.724588] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-03T22:08:12.000204] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-03T22:08:12.135611] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:12.447352] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T22:08:12.790693] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-03T22:08:13.394711] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-03T22:08:13.590728] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-03T22:08:13.766510] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.18 seconds). [2025-10-03T22:08:13.769421] [INFO ] [REMOTE ] UNP: Full fetch complete (76917 records). [2025-10-03T22:08:13.769561] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-03T22:08:14.054847] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T22:08:14.265861] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-03T22:08:14.273896] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-03T22:08:14.275561] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-03T22:08:14.275776] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-03T22:08:14.277522] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T22:08:14.286666] [DEBUG] [LOCAL ] UNP: Trimmed 76917 records to 54045 (keeping 200 days of data) [2025-10-03T22:08:14.391180] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-03T22:08:14.665340] [DEBUG] [LOCAL ] UNP: Primary data saved (54045 records). [2025-10-03T22:08:14.665540] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-03T22:08:14.665674] [INFO ] [MAIN ] Update Progress: 2191/2370 symbols completed. UNP took 40.7s. Estimated remaining: 25m 11s. Rate: 7.1 symbols/min [2025-10-03T22:08:14.863695] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:14.893940] [DEBUG] [LOCAL ] USAC: Loaded 22352 existing records from primary storage. [2025-10-03T22:08:14.894258] [INFO ] [MAIN ] USAC: Loaded 22352 existing records. [2025-10-03T22:08:15.103255] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:15.103536] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-03T22:08:15.103589] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-03T22:08:15.103841] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-03T22:08:15.103900] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-03T22:08:15.195776] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-03T22:08:15.542210] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:15.990697] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-03T22:08:16.676308] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T22:08:16.716382] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T22:08:16.790736] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-03T22:08:17.590687] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-03T22:08:17.819349] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T22:08:18.080290] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T22:08:18.390692] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-03T22:08:19.190698] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-03T22:08:19.990632] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-03T22:08:19.993513] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T22:08:20.089165] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-03T22:08:20.276411] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T22:08:20.790725] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-03T22:08:21.471567] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T22:08:21.590734] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-03T22:08:22.390736] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-03T22:08:22.736722] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T22:08:23.180590] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-03T22:08:23.191551] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-03T22:08:23.475324] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T22:08:23.990711] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-03T22:08:24.545343] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T22:08:24.790712] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-03T22:08:25.021356] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-03T22:08:25.024364] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-10-03T22:08:25.024551] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-03T22:08:25.457354] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-03T22:08:25.457638] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-03T22:08:25.459410] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-03T22:08:25.459670] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-03T22:08:25.487211] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T22:08:25.498562] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 54492 (keeping 200 days of data) [2025-10-03T22:08:25.599505] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-03T22:08:25.869508] [DEBUG] [LOCAL ] UPS: Primary data saved (54492 records). [2025-10-03T22:08:25.869717] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-03T22:08:25.869870] [INFO ] [MAIN ] Update Progress: 2192/2370 symbols completed. UPS took 34.9s. Estimated remaining: 25m 2s. Rate: 7.1 symbols/min [2025-10-03T22:08:26.051755] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:26.112958] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-03T22:08:26.113389] [INFO ] [MAIN ] USB: Loaded 54078 existing records. [2025-10-03T22:08:26.300530] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:26.300809] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-03T22:08:26.300862] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-03T22:08:26.301483] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-03T22:08:26.301543] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-03T22:08:26.395755] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-03T22:08:26.693286] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:26.910601] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T22:08:27.190687] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-03T22:08:27.995995] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-03T22:08:28.008568] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T22:08:28.790701] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-03T22:08:29.034111] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:08:29.298044] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T22:08:29.590702] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-03T22:08:30.236638] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T22:08:30.390736] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-03T22:08:31.190626] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-03T22:08:31.467491] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T22:08:31.538812] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T22:08:31.990708] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-03T22:08:32.617788] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T22:08:32.790700] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-03T22:08:33.590744] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-03T22:08:33.760764] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T22:08:33.876508] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T22:08:34.390711] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-03T22:08:35.056556] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T22:08:35.167815] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T22:08:35.190623] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-03T22:08:35.990631] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-03T22:08:36.302745] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T22:08:36.790687] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-03T22:08:37.099283] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T22:08:37.101392] [INFO ] [REMOTE ] USA: Full fetch complete (52161 records). [2025-10-03T22:08:37.101601] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-03T22:08:37.215284] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T22:08:37.231154] [INFO ] [REMOTE ] URI: Full fetch complete (53340 records). [2025-10-03T22:08:37.241542] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-03T22:08:37.591688] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-03T22:08:37.747458] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-03T22:08:37.750536] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-03T22:08:37.751901] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-03T22:08:37.767396] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-03T22:08:37.873060] [DEBUG] [LOCAL ] USA: Trimmed 52161 records to 36520 (keeping 200 days of data) [2025-10-03T22:08:38.075601] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-03T22:08:38.076924] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-03T22:08:38.078431] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-03T22:08:38.078517] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-03T22:08:38.082772] [DEBUG] [LOCAL ] URI: Trimmed 53340 records to 36051 (keeping 200 days of data) [2025-10-03T22:08:38.395443] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-03T22:08:38.455001] [DEBUG] [LOCAL ] USA: Primary data saved (36520 records). [2025-10-03T22:08:38.456001] [INFO ] [MAIN ] USA: Full history saved. [2025-10-03T22:08:38.457533] [INFO ] [MAIN ] Update Progress: 2193/2370 symbols completed. USA took 27.2s. Estimated remaining: 24m 54s. Rate: 7.1 symbols/min [2025-10-03T22:08:38.652999] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:38.661060] [DEBUG] [LOCAL ] URI: Primary data saved (36051 records). [2025-10-03T22:08:38.661236] [INFO ] [MAIN ] URI: Full history saved. [2025-10-03T22:08:38.661337] [INFO ] [MAIN ] Update Progress: 2194/2370 symbols completed. URI took 39.8s. Estimated remaining: 24m 45s. Rate: 7.1 symbols/min [2025-10-03T22:08:38.876100] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:38.895383] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T22:08:38.918610] [DEBUG] [LOCAL ] USFD: Loaded 51579 existing records from primary storage. [2025-10-03T22:08:38.922613] [INFO ] [MAIN ] USFD: Loaded 51579 existing records. [2025-10-03T22:08:39.042099] [DEBUG] [LOCAL ] USNA: Loaded 17937 existing records from primary storage. [2025-10-03T22:08:39.053255] [INFO ] [MAIN ] USNA: Loaded 17937 existing records. [2025-10-03T22:08:39.208076] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-03T22:08:39.219824] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:39.238900] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-03T22:08:39.239022] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-03T22:08:39.245184] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-03T22:08:39.245347] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-03T22:08:39.437287] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:39.440976] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-03T22:08:39.441061] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-03T22:08:39.446910] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-03T22:08:39.452216] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-03T22:08:40.012732] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:40.033898] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-03T22:08:40.143870] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:40.352210] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T22:08:40.392712] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T22:08:40.790743] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-03T22:08:41.590728] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-03T22:08:41.817272] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T22:08:41.839495] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T22:08:42.390737] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-03T22:08:43.190706] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-03T22:08:43.367466] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T22:08:43.606178] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T22:08:43.990636] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-03T22:08:44.309266] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T22:08:44.790716] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-03T22:08:45.012184] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T22:08:45.590715] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-03T22:08:46.401521] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-03T22:08:46.407357] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T22:08:46.503783] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T22:08:46.505197] [INFO ] [REMOTE ] USAC: Full fetch complete (35312 records). [2025-10-03T22:08:46.505279] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-03T22:08:46.904019] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-03T22:08:46.904109] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-03T22:08:46.904893] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-03T22:08:46.904958] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-03T22:08:46.905921] [DEBUG] [LOCAL ] USAC: Trimmed 35312 records to 22441 (keeping 200 days of data) [2025-10-03T22:08:47.046912] [DEBUG] [LOCAL ] USAC: Primary data saved (22441 records). [2025-10-03T22:08:47.047064] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-03T22:08:47.047171] [INFO ] [MAIN ] Update Progress: 2195/2370 symbols completed. USAC took 32.4s. Estimated remaining: 24m 37s. Rate: 7.1 symbols/min [2025-10-03T22:08:47.201075] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-03T22:08:47.228206] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:08:47.249317] [DEBUG] [LOCAL ] USPH: Loaded 16902 existing records from primary storage. [2025-10-03T22:08:47.249605] [INFO ] [MAIN ] USPH: Loaded 16902 existing records. [2025-10-03T22:08:47.455340] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:08:47.456015] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-03T22:08:47.456080] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-03T22:08:47.456496] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-03T22:08:47.456558] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-03T22:08:47.597818] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T22:08:47.873703] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:08:47.990722] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-03T22:08:48.790731] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-03T22:08:49.260133] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T22:08:49.590936] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-03T22:08:49.594017] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T22:08:49.932622] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T22:08:50.390720] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-03T22:08:50.982740] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T22:08:51.190709] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-03T22:08:51.239686] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T22:08:51.990686] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-03T22:08:52.261045] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T22:08:52.790718] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-03T22:08:53.443950] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T22:08:53.590697] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-03T22:08:53.981316] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T22:08:54.390713] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-03T22:08:54.433831] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T22:08:55.190738] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-03T22:08:55.990711] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-03T22:08:56.193863] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T22:08:56.387268] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T22:08:56.790690] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-03T22:08:57.027882] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T22:08:57.590729] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-03T22:08:57.885296] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T22:08:58.390724] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-03T22:08:58.644222] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T22:08:59.190746] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-03T22:08:59.990698] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-03T22:09:00.121660] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T22:09:00.168564] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T22:09:00.790750] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-03T22:09:01.035365] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T22:09:01.590741] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-03T22:09:01.711119] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T22:09:02.390702] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-03T22:09:03.190706] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-03T22:09:03.392326] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T22:09:03.573134] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T22:09:03.990743] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-03T22:09:04.790722] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-03T22:09:04.936855] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T22:09:04.969751] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T22:09:05.590746] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-03T22:09:06.309689] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T22:09:06.311094] [INFO ] [REMOTE ] USNA: Full fetch complete (26611 records). [2025-10-03T22:09:06.311315] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-03T22:09:06.396268] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-03T22:09:06.731403] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-03T22:09:06.731552] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-03T22:09:06.732389] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-03T22:09:06.732476] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-03T22:09:06.733956] [DEBUG] [LOCAL ] USNA: Trimmed 26611 records to 18037 (keeping 200 days of data) [2025-10-03T22:09:06.847147] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T22:09:06.892285] [DEBUG] [LOCAL ] USNA: Primary data saved (18037 records). [2025-10-03T22:09:06.892490] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-03T22:09:06.892688] [INFO ] [MAIN ] Update Progress: 2196/2370 symbols completed. USNA took 28.2s. Estimated remaining: 24m 29s. Rate: 7.1 symbols/min [2025-10-03T22:09:07.077059] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:07.110210] [DEBUG] [LOCAL ] UTF: Loaded 29608 existing records from primary storage. [2025-10-03T22:09:07.110509] [INFO ] [MAIN ] UTF: Loaded 29608 existing records. [2025-10-03T22:09:07.198989] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-03T22:09:07.320267] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:07.321216] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-03T22:09:07.321294] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-03T22:09:07.322225] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-03T22:09:07.322288] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-03T22:09:07.762104] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:07.763612] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T22:09:07.770211] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T22:09:07.773635] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-03T22:09:07.773820] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-03T22:09:07.995830] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-03T22:09:08.208622] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-03T22:09:08.208760] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-03T22:09:08.210086] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-03T22:09:08.210163] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-03T22:09:08.212625] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54468 (keeping 200 days of data) [2025-10-03T22:09:08.571701] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-10-03T22:09:08.571876] [INFO ] [MAIN ] USB: Full history saved. [2025-10-03T22:09:08.572024] [INFO ] [MAIN ] Update Progress: 2197/2370 symbols completed. USB took 42.7s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-03T22:09:08.790707] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-03T22:09:09.080256] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T22:09:09.590741] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-03T22:09:10.390666] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-03T22:09:10.600376] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T22:09:10.678953] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T22:09:11.190677] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-03T22:09:11.752967] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T22:09:11.987425] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T22:09:11.989104] [INFO ] [REMOTE ] USPH: Full fetch complete (22841 records). [2025-10-03T22:09:11.989192] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-03T22:09:12.002154] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-03T22:09:12.403149] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-03T22:09:12.403244] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-03T22:09:12.403821] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-03T22:09:12.403926] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-03T22:09:12.404847] [DEBUG] [LOCAL ] USPH: Trimmed 22841 records to 17051 (keeping 200 days of data) [2025-10-03T22:09:12.514580] [DEBUG] [LOCAL ] USPH: Primary data saved (17051 records). [2025-10-03T22:09:12.514781] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-03T22:09:12.514885] [INFO ] [MAIN ] Update Progress: 2198/2370 symbols completed. USPH took 25.5s. Estimated remaining: 24m 11s. Rate: 7.1 symbols/min [2025-10-03T22:09:12.790693] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-03T22:09:13.873260] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:09:13.885011] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-03T22:09:13.998573] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T22:09:14.390729] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-03T22:09:15.647753] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T22:09:15.654322] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-03T22:09:15.757499] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T22:09:15.990726] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-03T22:09:16.971873] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T22:09:16.979142] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-03T22:09:17.346072] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T22:09:17.590722] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-03T22:09:18.364688] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T22:09:18.390692] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-03T22:09:18.972933] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T22:09:18.975623] [INFO ] [REMOTE ] USFD: Full fetch complete (74021 records). [2025-10-03T22:09:18.975789] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-03T22:09:19.417239] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-03T22:09:19.417434] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-03T22:09:19.419228] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-03T22:09:19.419360] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-03T22:09:19.421858] [DEBUG] [LOCAL ] USFD: Trimmed 74021 records to 51948 (keeping 200 days of data) [2025-10-03T22:09:19.567386] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T22:09:19.579407] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-03T22:09:19.780441] [DEBUG] [LOCAL ] USFD: Primary data saved (51948 records). [2025-10-03T22:09:19.780670] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-03T22:09:19.781358] [INFO ] [MAIN ] Update Progress: 2199/2370 symbols completed. USFD took 41.3s. Estimated remaining: 24m 3s. Rate: 7.1 symbols/min [2025-10-03T22:09:20.890294] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T22:09:20.896874] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-03T22:09:22.226253] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T22:09:22.232820] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-03T22:09:23.388281] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T22:09:23.394344] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-03T22:09:24.953816] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T22:09:24.963820] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-03T22:09:26.159220] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T22:09:26.161631] [INFO ] [REMOTE ] UTF: Full fetch complete (42352 records). [2025-10-03T22:09:26.161756] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-03T22:09:26.543930] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-03T22:09:26.544033] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-03T22:09:26.545350] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-03T22:09:26.545417] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-03T22:09:26.546549] [DEBUG] [LOCAL ] UTF: Trimmed 42352 records to 29987 (keeping 200 days of data) [2025-10-03T22:09:26.750112] [DEBUG] [LOCAL ] UTF: Primary data saved (29987 records). [2025-10-03T22:09:26.750331] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-03T22:09:26.750601] [INFO ] [MAIN ] Update Progress: 2200/2370 symbols completed. UTF took 19.9s. Estimated remaining: 23m 54s. Rate: 7.1 symbols/min [2025-10-03T22:09:27.451258] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:27.487796] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:27.466934] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:27.524610] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:27.547935] [DEBUG] [LOCAL ] UTL: Loaded 11437 existing records from primary storage. [2025-10-03T22:09:27.548509] [INFO ] [MAIN ] UTL: Loaded 11437 existing records. [2025-10-03T22:09:27.692383] [DEBUG] [LOCAL ] UVE: Loaded 21949 existing records from primary storage. [2025-10-03T22:09:27.743955] [INFO ] [MAIN ] UVE: Loaded 21949 existing records. [2025-10-03T22:09:27.773469] [DEBUG] [LOCAL ] UTZ: Loaded 45037 existing records from primary storage. [2025-10-03T22:09:27.791710] [INFO ] [MAIN ] UTZ: Loaded 45037 existing records. [2025-10-03T22:09:27.832214] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:27.880448] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-03T22:09:27.900737] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-03T22:09:27.944248] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-03T22:09:27.957819] [DEBUG] [LOCAL ] UTI: Loaded 40755 existing records from primary storage. [2025-10-03T22:09:27.980134] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-03T22:09:28.056937] [INFO ] [MAIN ] UTI: Loaded 40755 existing records. [2025-10-03T22:09:28.344136] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:28.427992] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-03T22:09:28.461174] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:28.466594] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-03T22:09:28.477457] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-03T22:09:28.488612] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-03T22:09:28.523522] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-03T22:09:28.488539] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-03T22:09:28.671628] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-03T22:09:28.661731] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:28.710592] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-03T22:09:28.718576] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-03T22:09:28.689906] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-03T22:09:28.733355] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-03T22:09:28.813975] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-03T22:09:29.614632] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:29.695031] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-03T22:09:29.962429] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:29.974579] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-03T22:09:29.968841] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:29.985404] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-03T22:09:30.054695] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:30.055129] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-03T22:09:30.664447] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T22:09:30.667471] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-03T22:09:31.045971] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T22:09:31.050024] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-03T22:09:31.444948] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T22:09:31.448018] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-03T22:09:31.514774] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T22:09:31.523124] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-03T22:09:31.549167] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T22:09:31.557835] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-03T22:09:32.117636] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T22:09:32.122498] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-03T22:09:32.292969] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T22:09:32.295814] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-03T22:09:32.656079] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T22:09:32.664142] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-03T22:09:33.137885] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T22:09:33.138569] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T22:09:33.152232] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-03T22:09:33.175459] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T22:09:33.590690] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-03T22:09:33.684680] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T22:09:34.358999] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T22:09:34.390623] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-03T22:09:34.624295] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T22:09:35.190690] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-03T22:09:35.888048] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T22:09:35.990720] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-03T22:09:36.790685] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-03T22:09:36.812676] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T22:09:36.844117] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T22:09:37.590772] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-03T22:09:38.361250] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T22:09:38.390616] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-03T22:09:39.091022] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T22:09:39.190695] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-03T22:09:39.990713] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-03T22:09:40.121820] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T22:09:40.790625] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-03T22:09:40.832562] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T22:09:40.872156] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T22:09:41.590699] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-03T22:09:42.364577] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T22:09:42.390682] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-03T22:09:42.484738] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T22:09:43.190743] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-03T22:09:43.898088] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T22:09:43.990739] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-03T22:09:44.147999] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T22:09:44.790668] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-03T22:09:45.150423] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T22:09:45.590638] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-03T22:09:45.721029] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T22:09:46.390685] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-03T22:09:47.137564] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T22:09:47.156529] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T22:09:47.158229] [INFO ] [REMOTE ] UTL: Full fetch complete (15524 records). [2025-10-03T22:09:47.158361] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-03T22:09:47.195786] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-03T22:09:47.546208] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-03T22:09:47.546297] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-03T22:09:47.546701] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-03T22:09:47.546766] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-03T22:09:47.547313] [DEBUG] [LOCAL ] UTL: Trimmed 15524 records to 11543 (keeping 200 days of data) [2025-10-03T22:09:47.620576] [DEBUG] [LOCAL ] UTL: Primary data saved (11543 records). [2025-10-03T22:09:47.620752] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-03T22:09:47.620911] [INFO ] [MAIN ] Update Progress: 2201/2370 symbols completed. UTL took 20.9s. Estimated remaining: 23m 47s. Rate: 7.1 symbols/min [2025-10-03T22:09:47.795494] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:47.820734] [DEBUG] [LOCAL ] UVV: Loaded 22653 existing records from primary storage. [2025-10-03T22:09:47.821115] [INFO ] [MAIN ] UVV: Loaded 22653 existing records. [2025-10-03T22:09:47.993856] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-03T22:09:48.009009] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:48.009390] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-03T22:09:48.009444] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-03T22:09:48.009690] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-03T22:09:48.009750] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-03T22:09:48.387237] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:48.736246] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T22:09:48.790730] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-03T22:09:49.197582] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T22:09:49.590724] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-03T22:09:49.851154] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T22:09:50.390689] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-03T22:09:50.684996] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T22:09:51.190736] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-03T22:09:51.990674] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-03T22:09:52.074942] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T22:09:52.317676] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T22:09:52.790745] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-03T22:09:53.334359] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T22:09:53.590747] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-03T22:09:54.395929] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-03T22:09:54.408223] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T22:09:54.491205] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T22:09:55.190732] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-03T22:09:55.721404] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T22:09:55.990699] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-03T22:09:56.253250] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T22:09:56.790709] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-03T22:09:57.187842] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T22:09:57.190397] [INFO ] [REMOTE ] UTI: Full fetch complete (58415 records). [2025-10-03T22:09:57.190556] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-03T22:09:57.594991] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-03T22:09:57.615292] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-03T22:09:57.615405] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-03T22:09:57.617383] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-03T22:09:57.617478] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-03T22:09:57.619944] [DEBUG] [LOCAL ] UTI: Trimmed 58415 records to 41039 (keeping 200 days of data) [2025-10-03T22:09:57.876457] [DEBUG] [LOCAL ] UTI: Primary data saved (41039 records). [2025-10-03T22:09:57.876687] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-03T22:09:57.876808] [INFO ] [MAIN ] Update Progress: 2202/2370 symbols completed. UTI took 31.1s. Estimated remaining: 23m 39s. Rate: 7.1 symbols/min [2025-10-03T22:09:58.058866] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:09:58.118787] [DEBUG] [LOCAL ] UWMC: Loaded 53165 existing records from primary storage. [2025-10-03T22:09:58.119283] [INFO ] [MAIN ] UWMC: Loaded 53165 existing records. [2025-10-03T22:09:58.319324] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:09:58.319818] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-03T22:09:58.320062] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-03T22:09:58.320492] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-03T22:09:58.320571] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-03T22:09:58.408106] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-03T22:09:58.443966] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T22:09:58.757506] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:09:58.935790] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T22:09:59.190686] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-03T22:09:59.622498] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T22:09:59.990768] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-03T22:10:00.452026] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T22:10:00.454639] [INFO ] [REMOTE ] UTZ: Full fetch complete (64396 records). [2025-10-03T22:10:00.454780] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-03T22:10:00.795898] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-03T22:10:00.887960] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-03T22:10:00.888110] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-03T22:10:00.889592] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-03T22:10:00.889699] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-03T22:10:00.891409] [DEBUG] [LOCAL ] UTZ: Trimmed 64396 records to 45390 (keeping 200 days of data) [2025-10-03T22:10:01.188196] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T22:10:01.218909] [DEBUG] [LOCAL ] UTZ: Primary data saved (45390 records). [2025-10-03T22:10:01.219155] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-03T22:10:01.220209] [INFO ] [MAIN ] Update Progress: 2203/2370 symbols completed. UTZ took 34.5s. Estimated remaining: 23m 30s. Rate: 7.1 symbols/min [2025-10-03T22:10:01.410859] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:01.423586] [DEBUG] [LOCAL ] UZD: Loaded 6468 existing records from primary storage. [2025-10-03T22:10:01.423914] [INFO ] [MAIN ] UZD: Loaded 6468 existing records. [2025-10-03T22:10:01.590839] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-03T22:10:01.619944] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:01.622242] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-03T22:10:01.622417] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-03T22:10:01.622902] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-03T22:10:01.623096] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-03T22:10:01.740965] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T22:10:02.104207] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:02.390750] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-03T22:10:03.190733] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-03T22:10:03.458669] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T22:10:03.497957] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T22:10:03.990636] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-03T22:10:04.260520] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T22:10:04.751256] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T22:10:04.790730] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-03T22:10:05.590721] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-03T22:10:05.643019] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T22:10:05.644700] [INFO ] [REMOTE ] UVE: Full fetch complete (29943 records). [2025-10-03T22:10:05.644793] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-03T22:10:06.042535] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-03T22:10:06.042667] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-03T22:10:06.043972] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-03T22:10:06.044039] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-03T22:10:06.045324] [DEBUG] [LOCAL ] UVE: Trimmed 29943 records to 22153 (keeping 200 days of data) [2025-10-03T22:10:06.188864] [DEBUG] [LOCAL ] UVE: Primary data saved (22153 records). [2025-10-03T22:10:06.189044] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-03T22:10:06.189159] [INFO ] [MAIN ] Update Progress: 2204/2370 symbols completed. UVE took 39.4s. Estimated remaining: 23m 21s. Rate: 7.1 symbols/min [2025-10-03T22:10:06.358038] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T22:10:06.385046] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:06.390618] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-03T22:10:06.401046] [DEBUG] [LOCAL ] UZE: Loaded 7475 existing records from primary storage. [2025-10-03T22:10:06.401390] [INFO ] [MAIN ] UZE: Loaded 7475 existing records. [2025-10-03T22:10:06.636677] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:06.636956] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-03T22:10:06.637006] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-03T22:10:06.637234] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-03T22:10:06.637294] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-03T22:10:07.057600] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:07.064422] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T22:10:07.190708] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-03T22:10:07.990740] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-03T22:10:08.576241] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T22:10:08.790761] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-03T22:10:09.506849] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T22:10:09.590676] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-03T22:10:09.769460] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T22:10:10.315258] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T22:10:10.390741] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-03T22:10:11.025885] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T22:10:11.190691] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-03T22:10:11.990712] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-03T22:10:12.744701] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T22:10:12.790617] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-03T22:10:12.871951] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T22:10:13.525454] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T22:10:13.590621] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-03T22:10:14.171917] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T22:10:14.390750] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-03T22:10:15.190676] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-03T22:10:15.555753] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T22:10:15.990775] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-03T22:10:16.745932] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T22:10:16.790722] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-03T22:10:17.112260] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T22:10:17.426802] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T22:10:17.590736] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-03T22:10:18.390737] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-03T22:10:19.190670] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-03T22:10:19.462264] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T22:10:19.709232] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T22:10:19.750886] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T22:10:19.990717] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-03T22:10:20.790735] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-03T22:10:21.363195] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T22:10:21.590693] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-03T22:10:21.833021] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T22:10:22.390686] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-03T22:10:22.416901] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T22:10:23.190723] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-03T22:10:23.321514] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T22:10:23.323116] [INFO ] [REMOTE ] UVV: Full fetch complete (30053 records). [2025-10-03T22:10:23.323207] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-03T22:10:23.652272] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T22:10:23.738379] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-03T22:10:23.738572] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-03T22:10:23.739698] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-03T22:10:23.739763] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-03T22:10:23.740794] [DEBUG] [LOCAL ] UVV: Trimmed 30053 records to 22830 (keeping 200 days of data) [2025-10-03T22:10:23.912284] [DEBUG] [LOCAL ] UVV: Primary data saved (22830 records). [2025-10-03T22:10:23.912484] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-03T22:10:23.912683] [INFO ] [MAIN ] Update Progress: 2205/2370 symbols completed. UVV took 36.3s. Estimated remaining: 23m 13s. Rate: 7.1 symbols/min [2025-10-03T22:10:23.995879] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-03T22:10:24.132089] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:24.144027] [DEBUG] [LOCAL ] UZF: Loaded 6493 existing records from primary storage. [2025-10-03T22:10:24.144309] [INFO ] [MAIN ] UZF: Loaded 6493 existing records. [2025-10-03T22:10:24.321309] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:24.321620] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-03T22:10:24.321709] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-03T22:10:24.321959] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-03T22:10:24.322025] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-03T22:10:24.678450] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:24.723979] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T22:10:24.790626] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-03T22:10:25.517418] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T22:10:25.590681] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-03T22:10:26.187117] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T22:10:26.391197] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-03T22:10:27.064753] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T22:10:27.190692] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-03T22:10:27.774495] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T22:10:27.990743] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-03T22:10:28.553833] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T22:10:28.790700] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-03T22:10:29.505936] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T22:10:29.590713] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-03T22:10:30.307828] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T22:10:30.390726] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-03T22:10:31.190702] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-03T22:10:31.304186] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T22:10:31.855198] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T22:10:31.990733] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-03T22:10:32.579559] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T22:10:32.790636] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-03T22:10:33.195734] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T22:10:33.197055] [INFO ] [REMOTE ] UZE: Full fetch complete (10065 records). [2025-10-03T22:10:33.197157] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-03T22:10:33.593225] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-03T22:10:33.592888] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-03T22:10:33.594169] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-03T22:10:33.594460] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-03T22:10:33.594505] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-03T22:10:33.595328] [DEBUG] [LOCAL ] UZE: Trimmed 10065 records to 7503 (keeping 200 days of data) [2025-10-03T22:10:33.668027] [DEBUG] [LOCAL ] UZE: Primary data saved (7503 records). [2025-10-03T22:10:33.668476] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-03T22:10:33.668710] [INFO ] [MAIN ] Update Progress: 2206/2370 symbols completed. UZE took 27.5s. Estimated remaining: 23m 5s. Rate: 7.1 symbols/min [2025-10-03T22:10:33.875259] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:33.935665] [DEBUG] [LOCAL ] V: Loaded 54145 existing records from primary storage. [2025-10-03T22:10:33.936114] [INFO ] [MAIN ] V: Loaded 54145 existing records. [2025-10-03T22:10:34.126664] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:34.126986] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-03T22:10:34.127063] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-03T22:10:34.127443] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-03T22:10:34.127525] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-03T22:10:34.405446] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-03T22:10:34.549463] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:34.976393] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T22:10:35.190682] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-03T22:10:35.484840] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T22:10:35.674300] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T22:10:35.990702] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-03T22:10:36.790735] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-03T22:10:37.590715] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-03T22:10:38.230428] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T22:10:38.390691] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-03T22:10:38.471182] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T22:10:38.661886] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:10:38.724005] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-03T22:10:38.725175] [INFO ] [REMOTE ] UZD: Full fetch complete (9487 records). [2025-10-03T22:10:38.725254] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-03T22:10:39.122175] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-03T22:10:39.122313] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-03T22:10:39.122634] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-03T22:10:39.122734] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-03T22:10:39.123264] [DEBUG] [LOCAL ] UZD: Trimmed 9487 records to 6490 (keeping 200 days of data) [2025-10-03T22:10:39.166558] [DEBUG] [LOCAL ] UZD: Primary data saved (6490 records). [2025-10-03T22:10:39.166774] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-03T22:10:39.166926] [INFO ] [MAIN ] Update Progress: 2207/2370 symbols completed. UZD took 37.9s. Estimated remaining: 22m 56s. Rate: 7.1 symbols/min [2025-10-03T22:10:39.198969] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-03T22:10:39.353763] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:39.397991] [DEBUG] [LOCAL ] VAC: Loaded 34605 existing records from primary storage. [2025-10-03T22:10:39.398308] [INFO ] [MAIN ] VAC: Loaded 34605 existing records. [2025-10-03T22:10:39.595793] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:39.596085] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-03T22:10:39.596151] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-03T22:10:39.596433] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-03T22:10:39.596494] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-03T22:10:39.979520] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:39.990721] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-03T22:10:40.581053] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T22:10:40.790745] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-03T22:10:41.135086] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-03T22:10:41.136522] [INFO ] [REMOTE ] UZF: Full fetch complete (8870 records). [2025-10-03T22:10:41.136631] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-03T22:10:41.574243] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-03T22:10:41.574477] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-03T22:10:41.574832] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-03T22:10:41.574930] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-03T22:10:41.575910] [DEBUG] [LOCAL ] UZF: Trimmed 8870 records to 6524 (keeping 200 days of data) [2025-10-03T22:10:41.590631] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-03T22:10:41.648060] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-03T22:10:41.672072] [DEBUG] [LOCAL ] UZF: Primary data saved (6524 records). [2025-10-03T22:10:41.672219] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-03T22:10:41.672344] [INFO ] [MAIN ] Update Progress: 2208/2370 symbols completed. UZF took 17.8s. Estimated remaining: 22m 47s. Rate: 7.1 symbols/min [2025-10-03T22:10:41.858629] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:41.914591] [DEBUG] [LOCAL ] VAL: Loaded 50658 existing records from primary storage. [2025-10-03T22:10:41.915014] [INFO ] [MAIN ] VAL: Loaded 50658 existing records. [2025-10-03T22:10:42.109584] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:42.109858] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-03T22:10:42.109956] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-03T22:10:42.110258] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-03T22:10:42.110319] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-03T22:10:42.395746] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-03T22:10:42.490749] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:43.190695] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-03T22:10:43.632563] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T22:10:43.990708] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-03T22:10:44.503238] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T22:10:44.703756] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T22:10:44.790702] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-03T22:10:45.590696] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-03T22:10:45.880181] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T22:10:46.390770] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-03T22:10:46.548618] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T22:10:46.770863] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T22:10:47.190757] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-03T22:10:47.847531] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T22:10:47.851471] [INFO ] [REMOTE ] UWMC: Full fetch complete (75620 records). [2025-10-03T22:10:47.851584] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-03T22:10:48.004083] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-03T22:10:48.278750] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-03T22:10:48.278863] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-03T22:10:48.280177] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-03T22:10:48.280248] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-03T22:10:48.282604] [DEBUG] [LOCAL ] UWMC: Trimmed 75620 records to 53552 (keeping 200 days of data) [2025-10-03T22:10:48.640916] [DEBUG] [LOCAL ] UWMC: Primary data saved (53552 records). [2025-10-03T22:10:48.641199] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-03T22:10:48.641371] [INFO ] [MAIN ] Update Progress: 2209/2370 symbols completed. UWMC took 50.8s. Estimated remaining: 22m 39s. Rate: 7.1 symbols/min [2025-10-03T22:10:48.799618] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-03T22:10:48.835383] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:10:48.870898] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T22:10:48.924914] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-03T22:10:48.925301] [INFO ] [MAIN ] VALE: Loaded 54083 existing records. [2025-10-03T22:10:49.123564] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:10:49.123890] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-03T22:10:49.123948] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-03T22:10:49.124234] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-03T22:10:49.124295] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-03T22:10:49.538082] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:10:49.555508] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T22:10:49.590738] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-03T22:10:50.390736] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-03T22:10:50.902052] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T22:10:50.989533] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T22:10:51.190741] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-03T22:10:51.990746] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-03T22:10:52.554731] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T22:10:52.790736] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-03T22:10:53.590678] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-03T22:10:53.665266] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-03T22:10:53.707746] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T22:10:54.390710] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-03T22:10:54.810115] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T22:10:55.109595] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T22:10:55.190733] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-03T22:10:55.990735] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-03T22:10:56.217917] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T22:10:56.790699] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-03T22:10:57.194005] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-03T22:10:57.505921] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T22:10:57.590728] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-03T22:10:58.390737] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-03T22:10:58.672585] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T22:10:59.085937] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T22:10:59.190756] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-03T22:10:59.990752] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-03T22:11:00.228543] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T22:11:00.790753] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-03T22:11:01.590764] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-03T22:11:01.676020] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-03T22:11:01.790461] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T22:11:01.864267] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T22:11:02.390731] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-03T22:11:03.190705] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-03T22:11:03.625550] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T22:11:03.990716] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-03T22:11:04.687453] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-03T22:11:04.773815] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T22:11:04.790622] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-03T22:11:05.590637] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-03T22:11:06.142396] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-03T22:11:06.174488] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T22:11:06.390717] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-03T22:11:07.190709] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-03T22:11:07.342207] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T22:11:07.990713] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-03T22:11:08.507251] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T22:11:08.790689] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-03T22:11:09.107270] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T22:11:09.366799] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T22:11:09.590736] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-03T22:11:10.390722] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-03T22:11:11.154822] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T22:11:11.197416] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-03T22:11:11.203724] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T22:11:11.990689] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-03T22:11:12.228391] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T22:11:12.230339] [INFO ] [REMOTE ] VAC: Full fetch complete (48346 records). [2025-10-03T22:11:12.230433] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-03T22:11:12.648969] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-03T22:11:12.649084] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-03T22:11:12.650333] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-03T22:11:12.650477] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-03T22:11:12.652256] [DEBUG] [LOCAL ] VAC: Trimmed 48346 records to 34838 (keeping 200 days of data) [2025-10-03T22:11:12.752949] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T22:11:12.791622] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-03T22:11:12.932149] [DEBUG] [LOCAL ] VAC: Primary data saved (34838 records). [2025-10-03T22:11:12.932319] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-03T22:11:12.933453] [INFO ] [MAIN ] Update Progress: 2210/2370 symbols completed. VAC took 33.8s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-03T22:11:13.116875] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:13.126328] [DEBUG] [LOCAL ] VATE: Loaded 5350 existing records from primary storage. [2025-10-03T22:11:13.126588] [INFO ] [MAIN ] VATE: Loaded 5350 existing records. [2025-10-03T22:11:13.323196] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:13.323459] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-03T22:11:13.323512] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-03T22:11:13.323727] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-03T22:11:13.323790] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-03T22:11:13.595940] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-03T22:11:13.711936] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:13.941530] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T22:11:14.390639] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-03T22:11:14.568179] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T22:11:14.837762] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:11:14.840554] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-10-03T22:11:14.840699] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-03T22:11:15.195823] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-03T22:11:15.303872] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-03T22:11:15.303967] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-03T22:11:15.305285] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-03T22:11:15.305356] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-03T22:11:15.307117] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 54535 (keeping 200 days of data) [2025-10-03T22:11:15.696463] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T22:11:15.738100] [DEBUG] [LOCAL ] V: Primary data saved (54535 records). [2025-10-03T22:11:15.738412] [INFO ] [MAIN ] V: Full history saved. [2025-10-03T22:11:15.739600] [INFO ] [MAIN ] Update Progress: 2211/2370 symbols completed. V took 42.1s. Estimated remaining: 22m 23s. Rate: 7.1 symbols/min [2025-10-03T22:11:15.930663] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:15.944559] [DEBUG] [LOCAL ] VBF: Loaded 6990 existing records from primary storage. [2025-10-03T22:11:15.944853] [INFO ] [MAIN ] VBF: Loaded 6990 existing records. [2025-10-03T22:11:15.998256] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-03T22:11:16.158208] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:16.158572] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-03T22:11:16.158635] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-03T22:11:16.158944] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-03T22:11:16.159005] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-03T22:11:16.565897] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:16.575440] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T22:11:16.580285] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T22:11:16.582191] [INFO ] [REMOTE ] VAL: Full fetch complete (73234 records). [2025-10-03T22:11:16.582278] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-03T22:11:16.798538] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-03T22:11:17.063396] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-03T22:11:17.063496] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-03T22:11:17.064939] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-03T22:11:17.065041] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-03T22:11:17.066692] [DEBUG] [LOCAL ] VAL: Trimmed 73234 records to 51032 (keeping 200 days of data) [2025-10-03T22:11:17.396500] [DEBUG] [LOCAL ] VAL: Primary data saved (51032 records). [2025-10-03T22:11:17.396698] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-03T22:11:17.396810] [INFO ] [MAIN ] Update Progress: 2212/2370 symbols completed. VAL took 35.7s. Estimated remaining: 22m 14s. Rate: 7.1 symbols/min [2025-10-03T22:11:17.594179] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-03T22:11:17.594054] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:17.611799] [DEBUG] [LOCAL ] VCV: Loaded 13773 existing records from primary storage. [2025-10-03T22:11:17.612221] [INFO ] [MAIN ] VCV: Loaded 13773 existing records. [2025-10-03T22:11:17.814209] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:17.814699] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-03T22:11:17.814788] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-03T22:11:17.815204] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-03T22:11:17.815269] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-03T22:11:18.109011] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T22:11:18.238488] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:18.390765] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-03T22:11:19.190630] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-03T22:11:19.484047] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T22:11:19.740496] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-03T22:11:19.990694] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-03T22:11:20.112353] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T22:11:20.764428] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T22:11:20.790693] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-03T22:11:21.569290] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T22:11:21.590691] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-03T22:11:22.355959] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T22:11:22.390633] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-03T22:11:22.984399] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T22:11:23.190689] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-03T22:11:23.976638] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T22:11:23.990613] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-03T22:11:24.775485] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T22:11:24.790630] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-03T22:11:25.402913] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T22:11:25.590692] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-03T22:11:26.134114] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T22:11:26.390719] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-03T22:11:27.190744] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-03T22:11:27.768723] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T22:11:27.990702] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-03T22:11:28.056539] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T22:11:28.062669] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-03T22:11:28.062975] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-03T22:11:28.496065] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-03T22:11:28.496183] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-03T22:11:28.498178] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-03T22:11:28.498281] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-03T22:11:28.502697] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 54473 (keeping 200 days of data) [2025-10-03T22:11:28.802873] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-03T22:11:28.860120] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T22:11:28.883205] [DEBUG] [LOCAL ] VALE: Primary data saved (54473 records). [2025-10-03T22:11:28.883408] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-03T22:11:28.883571] [INFO ] [MAIN ] Update Progress: 2213/2370 symbols completed. VALE took 40.2s. Estimated remaining: 22m 6s. Rate: 7.1 symbols/min [2025-10-03T22:11:29.053919] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:29.110602] [DEBUG] [LOCAL ] VEEV: Loaded 47405 existing records from primary storage. [2025-10-03T22:11:29.111088] [INFO ] [MAIN ] VEEV: Loaded 47405 existing records. [2025-10-03T22:11:29.299215] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:29.299531] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-03T22:11:29.299593] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-03T22:11:29.300043] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-03T22:11:29.300106] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-03T22:11:29.595932] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-03T22:11:29.619791] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T22:11:29.739962] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:30.390697] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-03T22:11:30.625974] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T22:11:31.190740] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-03T22:11:31.987738] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T22:11:31.991443] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-03T22:11:32.175696] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T22:11:32.655375] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T22:11:32.790749] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-03T22:11:33.590702] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-03T22:11:33.807780] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T22:11:34.390723] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-03T22:11:35.019099] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T22:11:35.190733] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-03T22:11:35.364333] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T22:11:35.654815] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T22:11:35.990703] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-03T22:11:36.706902] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T22:11:36.790749] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-03T22:11:37.573787] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T22:11:37.590741] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-03T22:11:38.390732] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-03T22:11:39.177826] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T22:11:39.190607] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-03T22:11:39.422873] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T22:11:39.990747] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-03T22:11:40.650550] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T22:11:40.763521] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T22:11:40.790639] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-03T22:11:41.590768] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-03T22:11:42.390680] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-03T22:11:42.549576] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T22:11:42.656300] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T22:11:42.895911] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-03T22:11:43.190743] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-03T22:11:43.920814] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T22:11:43.990705] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-03T22:11:44.533337] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T22:11:44.534484] [INFO ] [REMOTE ] VBF: Full fetch complete (10502 records). [2025-10-03T22:11:44.534569] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-03T22:11:44.795901] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-03T22:11:44.987718] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-03T22:11:44.988087] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-03T22:11:44.988435] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-03T22:11:44.988500] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-03T22:11:44.989054] [DEBUG] [LOCAL ] VBF: Trimmed 10502 records to 7065 (keeping 200 days of data) [2025-10-03T22:11:45.037212] [DEBUG] [LOCAL ] VBF: Primary data saved (7065 records). [2025-10-03T22:11:45.037367] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-03T22:11:45.037491] [INFO ] [MAIN ] Update Progress: 2214/2370 symbols completed. VBF took 29.3s. Estimated remaining: 21m 58s. Rate: 7.1 symbols/min [2025-10-03T22:11:45.227972] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:45.247035] [DEBUG] [LOCAL ] VEL: Loaded 12854 existing records from primary storage. [2025-10-03T22:11:45.247357] [INFO ] [MAIN ] VEL: Loaded 12854 existing records. [2025-10-03T22:11:45.449027] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:45.449349] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-03T22:11:45.449407] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-03T22:11:45.449778] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-03T22:11:45.449840] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-03T22:11:45.565826] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T22:11:45.595117] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-03T22:11:45.855226] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:46.358259] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T22:11:46.359463] [INFO ] [REMOTE ] VCV: Full fetch complete (19366 records). [2025-10-03T22:11:46.359581] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-03T22:11:46.395792] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-03T22:11:46.773112] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-03T22:11:46.773223] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-03T22:11:46.773777] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-03T22:11:46.773845] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-03T22:11:46.774676] [DEBUG] [LOCAL ] VCV: Trimmed 19366 records to 13836 (keeping 200 days of data) [2025-10-03T22:11:46.865957] [DEBUG] [LOCAL ] VCV: Primary data saved (13836 records). [2025-10-03T22:11:46.866132] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-03T22:11:46.866317] [INFO ] [MAIN ] Update Progress: 2215/2370 symbols completed. VCV took 29.5s. Estimated remaining: 21m 49s. Rate: 7.1 symbols/min [2025-10-03T22:11:47.057831] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:47.103388] [DEBUG] [LOCAL ] VET: Loaded 44247 existing records from primary storage. [2025-10-03T22:11:47.103830] [INFO ] [MAIN ] VET: Loaded 44247 existing records. [2025-10-03T22:11:47.172696] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T22:11:47.195922] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-03T22:11:47.312225] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:47.312483] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-03T22:11:47.312537] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-03T22:11:47.312868] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-03T22:11:47.312978] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-03T22:11:47.736442] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:47.990688] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-03T22:11:48.053173] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T22:11:48.790741] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-03T22:11:49.590672] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-03T22:11:49.707223] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T22:11:50.333271] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T22:11:50.390680] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-03T22:11:50.476737] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T22:11:51.180685] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T22:11:51.190635] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-03T22:11:51.990726] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-03T22:11:52.185106] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T22:11:52.445836] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T22:11:52.447060] [INFO ] [REMOTE ] VATE: Full fetch complete (10500 records). [2025-10-03T22:11:52.447137] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-03T22:11:52.804228] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-03T22:11:52.814184] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-03T22:11:52.814307] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-03T22:11:52.816390] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-03T22:11:52.816492] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-03T22:11:52.817055] [DEBUG] [LOCAL ] VATE: Trimmed 10500 records to 5385 (keeping 200 days of data) [2025-10-03T22:11:52.853010] [DEBUG] [LOCAL ] VATE: Primary data saved (5385 records). [2025-10-03T22:11:52.853196] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-03T22:11:52.853344] [INFO ] [MAIN ] Update Progress: 2216/2370 symbols completed. VATE took 39.9s. Estimated remaining: 21m 40s. Rate: 7.1 symbols/min [2025-10-03T22:11:53.022824] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:11:53.096433] [DEBUG] [LOCAL ] VFC: Loaded 54000 existing records from primary storage. [2025-10-03T22:11:53.097133] [INFO ] [MAIN ] VFC: Loaded 54000 existing records. [2025-10-03T22:11:53.278245] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:11:53.278542] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-03T22:11:53.278592] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-03T22:11:53.278913] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-03T22:11:53.278972] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-03T22:11:53.598181] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-03T22:11:53.640905] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:11:54.390717] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-03T22:11:54.430555] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T22:11:55.190706] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-03T22:11:55.203742] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T22:11:55.441953] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T22:11:55.990750] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-03T22:11:56.790729] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-03T22:11:57.123350] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T22:11:57.492382] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T22:11:57.590694] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-03T22:11:58.353723] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T22:11:58.390625] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-03T22:11:59.195781] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-03T22:11:59.212785] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:11:59.964360] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T22:11:59.990611] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-03T22:12:00.144065] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T22:12:00.790750] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-03T22:12:01.590704] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-03T22:12:01.678391] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T22:12:02.390636] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-03T22:12:02.503424] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T22:12:02.630549] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T22:12:03.190751] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-03T22:12:03.690723] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T22:12:03.693291] [INFO ] [REMOTE ] VEEV: Full fetch complete (68229 records). [2025-10-03T22:12:03.693395] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-03T22:12:03.995920] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-03T22:12:04.114941] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-03T22:12:04.115039] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-03T22:12:04.116466] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-03T22:12:04.116586] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-03T22:12:04.119394] [DEBUG] [LOCAL ] VEEV: Trimmed 68229 records to 47751 (keeping 200 days of data) [2025-10-03T22:12:04.418230] [DEBUG] [LOCAL ] VEEV: Primary data saved (47751 records). [2025-10-03T22:12:04.418402] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-03T22:12:04.418514] [INFO ] [MAIN ] Update Progress: 2217/2370 symbols completed. VEEV took 35.5s. Estimated remaining: 21m 32s. Rate: 7.1 symbols/min [2025-10-03T22:12:04.602202] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:04.602604] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-03T22:12:04.602688] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-03T22:12:04.602821] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-03T22:12:04.602868] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-03T22:12:04.602909] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-03T22:12:04.602944] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-03T22:12:04.795485] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-03T22:12:04.865576] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T22:12:05.054743] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:05.057302] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T22:12:05.590738] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-03T22:12:05.802606] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:12:05.803004] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-03T22:12:05.803088] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:12:05.803149] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-03T22:12:05.803218] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:12:05.803294] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-03T22:12:05.803363] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-03T22:12:05.803400] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-03T22:12:05.803456] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-03T22:12:05.803528] [INFO ] [MAIN ] Update Progress: 2218/2370 symbols completed. VG took 1.4s. Estimated remaining: 21m 23s. Rate: 7.1 symbols/min [2025-10-03T22:12:05.976790] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:05.986380] [DEBUG] [LOCAL ] VGI: Loaded 5169 existing records from primary storage. [2025-10-03T22:12:05.986662] [INFO ] [MAIN ] VGI: Loaded 5169 existing records. [2025-10-03T22:12:06.175821] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:06.176076] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-03T22:12:06.176128] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-03T22:12:06.176323] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-03T22:12:06.176383] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-03T22:12:06.390811] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-03T22:12:06.577995] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:06.740584] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T22:12:07.190712] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-03T22:12:07.794891] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T22:12:07.990698] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-03T22:12:08.112901] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T22:12:08.790677] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-03T22:12:08.845629] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T22:12:09.590707] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-03T22:12:10.348596] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T22:12:10.390622] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-03T22:12:11.190746] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-03T22:12:11.330532] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T22:12:11.969561] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T22:12:11.971584] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:12:11.990609] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-03T22:12:12.790728] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-03T22:12:13.373054] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T22:12:13.579146] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T22:12:13.590631] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-03T22:12:14.200383] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T22:12:14.201531] [INFO ] [REMOTE ] VEL: Full fetch complete (17105 records). [2025-10-03T22:12:14.201606] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-03T22:12:14.400324] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-03T22:12:14.583468] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-03T22:12:14.583579] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-03T22:12:14.584155] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-03T22:12:14.584224] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-03T22:12:14.585115] [DEBUG] [LOCAL ] VEL: Trimmed 17105 records to 12926 (keeping 200 days of data) [2025-10-03T22:12:14.673264] [DEBUG] [LOCAL ] VEL: Primary data saved (12926 records). [2025-10-03T22:12:14.673443] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-03T22:12:14.673577] [INFO ] [MAIN ] Update Progress: 2219/2370 symbols completed. VEL took 29.6s. Estimated remaining: 21m 15s. Rate: 7.1 symbols/min [2025-10-03T22:12:14.869319] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:14.892172] [DEBUG] [LOCAL ] VGM: Loaded 18428 existing records from primary storage. [2025-10-03T22:12:14.892511] [INFO ] [MAIN ] VGM: Loaded 18428 existing records. [2025-10-03T22:12:15.078911] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:15.085173] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-03T22:12:15.085431] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T22:12:15.085724] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-03T22:12:15.088262] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-03T22:12:15.088344] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-03T22:12:15.194272] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-03T22:12:15.477144] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:15.819374] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T22:12:15.990704] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-03T22:12:16.790706] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-03T22:12:17.057434] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T22:12:17.590732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-03T22:12:17.717547] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T22:12:17.720255] [INFO ] [REMOTE ] VET: Full fetch complete (64632 records). [2025-10-03T22:12:17.720401] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-03T22:12:18.147010] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-03T22:12:18.147107] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-03T22:12:18.148581] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-03T22:12:18.148949] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-03T22:12:18.150635] [DEBUG] [LOCAL ] VET: Trimmed 64632 records to 44583 (keeping 200 days of data) [2025-10-03T22:12:18.391196] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-03T22:12:18.405019] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T22:12:18.469939] [DEBUG] [LOCAL ] VET: Primary data saved (44583 records). [2025-10-03T22:12:18.470139] [INFO ] [MAIN ] VET: Full history saved. [2025-10-03T22:12:18.470289] [INFO ] [MAIN ] Update Progress: 2220/2370 symbols completed. VET took 31.6s. Estimated remaining: 21m 6s. Rate: 7.1 symbols/min [2025-10-03T22:12:18.642302] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:18.648139] [DEBUG] [LOCAL ] VHI: Loaded 2787 existing records from primary storage. [2025-10-03T22:12:18.648301] [INFO ] [MAIN ] VHI: Loaded 2787 existing records. [2025-10-03T22:12:18.882503] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:18.882914] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-03T22:12:18.882968] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-03T22:12:18.883239] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-03T22:12:18.883300] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-03T22:12:19.014692] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T22:12:19.196834] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-03T22:12:19.282322] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:19.990724] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-03T22:12:20.240574] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T22:12:20.790763] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-03T22:12:21.382870] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T22:12:21.590727] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-03T22:12:22.100740] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T22:12:22.101727] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T22:12:22.390723] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-03T22:12:22.965066] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T22:12:23.190727] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-03T22:12:23.868946] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-03T22:12:23.990778] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-03T22:12:24.592105] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T22:12:24.790725] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-03T22:12:25.590677] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-03T22:12:25.825397] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T22:12:26.390730] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-03T22:12:27.190721] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-03T22:12:27.363425] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T22:12:27.553909] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T22:12:27.918042] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T22:12:27.990695] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-03T22:12:28.442468] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:12:28.443679] [INFO ] [REMOTE ] VGI: Full fetch complete (7722 records). [2025-10-03T22:12:28.443772] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-03T22:12:28.796994] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-03T22:12:28.821277] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-03T22:12:28.821404] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-03T22:12:28.821757] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-03T22:12:28.821822] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-03T22:12:28.822481] [DEBUG] [LOCAL ] VGI: Trimmed 7722 records to 5198 (keeping 200 days of data) [2025-10-03T22:12:28.855397] [DEBUG] [LOCAL ] VGI: Primary data saved (5198 records). [2025-10-03T22:12:28.855552] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-03T22:12:28.855720] [INFO ] [MAIN ] Update Progress: 2221/2370 symbols completed. VGI took 23.1s. Estimated remaining: 20m 57s. Rate: 7.1 symbols/min [2025-10-03T22:12:29.032092] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:29.032535] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-03T22:12:29.032592] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-03T22:12:29.032790] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-03T22:12:29.032850] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-03T22:12:29.032894] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-03T22:12:29.032957] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-03T22:12:29.410429] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:29.590748] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-03T22:12:30.230112] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T22:12:30.390732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-03T22:12:30.859728] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T22:12:31.190688] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-03T22:12:31.419146] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:12:31.419539] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-03T22:12:31.419613] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:12:31.419746] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-03T22:12:31.419825] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:12:31.419912] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-03T22:12:31.419998] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-03T22:12:31.420040] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-03T22:12:31.420083] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-03T22:12:31.420147] [INFO ] [MAIN ] Update Progress: 2222/2370 symbols completed. VIA took 2.6s. Estimated remaining: 20m 49s. Rate: 7.1 symbols/min [2025-10-03T22:12:31.585822] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T22:12:31.642748] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:31.700044] [DEBUG] [LOCAL ] VICI: Loaded 54037 existing records from primary storage. [2025-10-03T22:12:31.700420] [INFO ] [MAIN ] VICI: Loaded 54037 existing records. [2025-10-03T22:12:31.898532] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:31.898802] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-03T22:12:31.898855] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-03T22:12:31.899293] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-03T22:12:31.899353] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-03T22:12:31.995886] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-03T22:12:32.276840] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:32.516215] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T22:12:32.790701] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-03T22:12:33.590733] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-03T22:12:34.390693] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-03T22:12:34.792129] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T22:12:34.991742] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T22:12:35.190693] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-03T22:12:35.666962] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T22:12:35.990713] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-03T22:12:36.790684] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-03T22:12:37.152760] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T22:12:37.373003] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T22:12:37.590716] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-03T22:12:37.932984] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T22:12:38.390753] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-03T22:12:38.885621] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T22:12:39.200334] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-03T22:12:39.207029] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T22:12:39.808592] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T22:12:39.990742] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-03T22:12:40.591934] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T22:12:40.790727] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-03T22:12:41.279172] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T22:12:41.590728] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-03T22:12:42.390681] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-03T22:12:42.671548] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T22:12:43.190707] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-03T22:12:43.990689] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-03T22:12:44.282888] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T22:12:44.354107] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T22:12:44.790732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-03T22:12:45.590747] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-03T22:12:45.829486] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T22:12:45.906782] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T22:12:46.390715] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-03T22:12:46.859307] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T22:12:47.143671] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T22:12:47.146619] [INFO ] [REMOTE ] VFC: Full fetch complete (77591 records). [2025-10-03T22:12:47.146847] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-03T22:12:47.195854] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-03T22:12:47.602181] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-03T22:12:47.602278] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-03T22:12:47.603871] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-03T22:12:47.603962] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-03T22:12:47.605838] [DEBUG] [LOCAL ] VFC: Trimmed 77591 records to 54390 (keeping 200 days of data) [2025-10-03T22:12:47.991536] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-03T22:12:47.991757] [DEBUG] [LOCAL ] VFC: Primary data saved (54390 records). [2025-10-03T22:12:47.992330] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-03T22:12:47.993940] [INFO ] [MAIN ] Update Progress: 2223/2370 symbols completed. VFC took 55.1s. Estimated remaining: 20m 41s. Rate: 7.1 symbols/min [2025-10-03T22:12:48.178742] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:48.241048] [DEBUG] [LOCAL ] VIK: Loaded 52883 existing records from primary storage. [2025-10-03T22:12:48.241465] [INFO ] [MAIN ] VIK: Loaded 52883 existing records. [2025-10-03T22:12:48.432970] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T22:12:48.439129] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:48.441546] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-03T22:12:48.441638] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-03T22:12:48.441360] [INFO ] [REMOTE ] VHI: Full fetch complete (4454 records). [2025-10-03T22:12:48.441889] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-03T22:12:48.447931] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-03T22:12:48.453178] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-03T22:12:48.816093] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-03T22:12:49.305432] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:49.314184] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-03T22:12:49.314821] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-03T22:12:49.315131] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-03T22:12:49.315250] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-03T22:12:49.315994] [DEBUG] [LOCAL ] VHI: Trimmed 4454 records to 2805 (keeping 200 days of data) [2025-10-03T22:12:49.335269] [DEBUG] [LOCAL ] VHI: Primary data saved (2805 records). [2025-10-03T22:12:49.335455] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-03T22:12:49.335604] [INFO ] [MAIN ] Update Progress: 2224/2370 symbols completed. VHI took 30.9s. Estimated remaining: 20m 32s. Rate: 7.1 symbols/min [2025-10-03T22:12:49.497345] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-03T22:12:49.577337] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:49.590623] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-03T22:12:49.637809] [DEBUG] [LOCAL ] VIPS: Loaded 51710 existing records from primary storage. [2025-10-03T22:12:49.638357] [INFO ] [MAIN ] VIPS: Loaded 51710 existing records. [2025-10-03T22:12:49.832492] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:49.832761] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-03T22:12:49.832818] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-03T22:12:49.833095] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-03T22:12:49.833154] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-03T22:12:49.990282] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T22:12:50.270827] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:50.390720] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-03T22:12:51.190741] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-03T22:12:51.762222] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T22:12:51.990680] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-03T22:12:52.130510] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T22:12:52.790679] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-03T22:12:52.846661] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T22:12:53.590694] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-03T22:12:53.956371] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T22:12:54.390720] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-03T22:12:54.463984] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T22:12:55.190692] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-03T22:12:55.275901] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T22:12:55.864479] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:12:55.990693] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-03T22:12:56.790704] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-03T22:12:56.916035] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T22:12:57.513472] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T22:12:57.515542] [INFO ] [REMOTE ] VGM: Full fetch complete (26234 records). [2025-10-03T22:12:57.515704] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-03T22:12:57.592495] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-03T22:12:57.928598] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-03T22:12:57.928764] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-03T22:12:57.929535] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-03T22:12:57.929624] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-03T22:12:57.930977] [DEBUG] [LOCAL ] VGM: Trimmed 26234 records to 18537 (keeping 200 days of data) [2025-10-03T22:12:58.053866] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T22:12:58.098171] [DEBUG] [LOCAL ] VGM: Primary data saved (18537 records). [2025-10-03T22:12:58.098398] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-03T22:12:58.098561] [INFO ] [MAIN ] Update Progress: 2225/2370 symbols completed. VGM took 43.4s. Estimated remaining: 20m 23s. Rate: 7.1 symbols/min [2025-10-03T22:12:58.279890] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:12:58.325416] [DEBUG] [LOCAL ] VIRT: Loaded 46992 existing records from primary storage. [2025-10-03T22:12:58.325794] [INFO ] [MAIN ] VIRT: Loaded 46992 existing records. [2025-10-03T22:12:58.395829] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-03T22:12:58.517875] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:12:58.518164] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-03T22:12:58.518222] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-03T22:12:58.518669] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-03T22:12:58.518732] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-03T22:12:58.893538] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:12:59.190635] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-03T22:12:59.458473] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T22:12:59.973258] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:12:59.990632] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-03T22:13:00.790709] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-03T22:13:00.831149] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T22:13:01.590674] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-03T22:13:01.790628] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T22:13:02.390718] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-03T22:13:02.443609] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T22:13:03.190613] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-03T22:13:03.818528] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T22:13:03.990672] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-03T22:13:04.180974] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T22:13:04.428524] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T22:13:04.431311] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-03T22:13:04.431448] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-03T22:13:04.808622] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-03T22:13:04.869949] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-03T22:13:04.870106] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-03T22:13:04.871601] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-03T22:13:04.871850] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-03T22:13:04.873984] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 54427 (keeping 200 days of data) [2025-10-03T22:13:05.005981] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T22:13:05.287089] [DEBUG] [LOCAL ] VICI: Primary data saved (54427 records). [2025-10-03T22:13:05.287304] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-03T22:13:05.287673] [INFO ] [MAIN ] Update Progress: 2226/2370 symbols completed. VICI took 33.9s. Estimated remaining: 20m 15s. Rate: 7.1 symbols/min [2025-10-03T22:13:05.467157] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:05.519675] [DEBUG] [LOCAL ] VIST: Loaded 46326 existing records from primary storage. [2025-10-03T22:13:05.520018] [INFO ] [MAIN ] VIST: Loaded 46326 existing records. [2025-10-03T22:13:05.599546] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-03T22:13:05.710735] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:13:05.711005] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-03T22:13:05.711060] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-03T22:13:05.711327] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-03T22:13:05.711390] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-03T22:13:06.086350] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:06.390740] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-03T22:13:06.447823] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T22:13:07.190749] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-03T22:13:07.237091] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T22:13:07.990696] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-03T22:13:08.296176] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T22:13:08.790681] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-03T22:13:08.940726] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T22:13:09.590766] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-03T22:13:09.649661] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T22:13:10.390714] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-03T22:13:10.453477] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T22:13:11.190702] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-03T22:13:11.323849] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T22:13:11.990706] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-03T22:13:12.152370] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T22:13:12.802123] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-03T22:13:12.809485] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T22:13:13.590697] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-03T22:13:13.647299] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T22:13:14.390629] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-03T22:13:14.653474] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T22:13:15.190719] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-03T22:13:15.362471] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T22:13:15.990733] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-03T22:13:16.079331] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:13:16.790634] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-03T22:13:16.899904] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T22:13:17.232086] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T22:13:17.590741] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-03T22:13:18.390728] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-03T22:13:18.609526] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T22:13:18.833809] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T22:13:19.190734] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-03T22:13:19.990738] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-03T22:13:20.184147] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T22:13:20.294909] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T22:13:20.298383] [INFO ] [REMOTE ] VIPS: Full fetch complete (74603 records). [2025-10-03T22:13:20.298541] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-03T22:13:20.721972] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-03T22:13:20.722057] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-03T22:13:20.723376] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-03T22:13:20.723443] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-03T22:13:20.724989] [DEBUG] [LOCAL ] VIPS: Trimmed 74603 records to 52064 (keeping 200 days of data) [2025-10-03T22:13:20.816624] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-03T22:13:21.051623] [DEBUG] [LOCAL ] VIPS: Primary data saved (52064 records). [2025-10-03T22:13:21.051846] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-03T22:13:21.052001] [INFO ] [MAIN ] Update Progress: 2227/2370 symbols completed. VIPS took 31.7s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-03T22:13:21.233876] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:21.279063] [DEBUG] [LOCAL ] VIV: Loaded 45321 existing records from primary storage. [2025-10-03T22:13:21.279390] [INFO ] [MAIN ] VIV: Loaded 45321 existing records. [2025-10-03T22:13:21.468070] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:13:21.468314] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-03T22:13:21.468365] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-03T22:13:21.468619] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-03T22:13:21.468715] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-03T22:13:21.594046] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-03T22:13:21.921520] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:21.951502] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T22:13:22.395568] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-03T22:13:22.401462] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:13:23.207030] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-03T22:13:23.252758] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T22:13:23.990635] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-03T22:13:24.028445] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T22:13:24.790715] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-03T22:13:24.952968] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T22:13:25.590732] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-03T22:13:25.724355] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T22:13:26.262401] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:13:26.390736] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-03T22:13:27.190671] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-03T22:13:27.259087] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T22:13:27.990621] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-03T22:13:28.186607] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T22:13:28.699490] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T22:13:28.790718] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-03T22:13:29.360477] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T22:13:29.363506] [INFO ] [REMOTE ] VIRT: Full fetch complete (67157 records). [2025-10-03T22:13:29.363734] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-03T22:13:29.595906] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-03T22:13:29.786579] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-03T22:13:29.786732] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-03T22:13:29.788529] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-03T22:13:29.788595] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-03T22:13:29.791331] [DEBUG] [LOCAL ] VIRT: Trimmed 67157 records to 47345 (keeping 200 days of data) [2025-10-03T22:13:30.115020] [DEBUG] [LOCAL ] VIRT: Primary data saved (47345 records). [2025-10-03T22:13:30.115179] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-03T22:13:30.115277] [INFO ] [MAIN ] Update Progress: 2228/2370 symbols completed. VIRT took 32.0s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-03T22:13:30.295349] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:30.295719] [DEBUG] [LOCAL ] VKQ: No existing data file found in primary storage. [2025-10-03T22:13:30.295853] [WARN ] [MAIN ] VKQ: No existing data found, performing full refresh instead. [2025-10-03T22:13:30.296055] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-03T22:13:30.296110] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-03T22:13:30.296256] [DEBUG] [LOCAL ] VKQ: No primary data file found to delete. [2025-10-03T22:13:30.296311] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-03T22:13:30.392247] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-03T22:13:30.477607] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T22:13:30.731916] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:31.031210] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T22:13:31.034071] [INFO ] [REMOTE ] VIK: Full fetch complete (75886 records). [2025-10-03T22:13:31.034295] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-03T22:13:31.195871] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-03T22:13:31.497510] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-03T22:13:31.497662] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-03T22:13:31.499245] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-03T22:13:31.499320] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-03T22:13:31.500984] [DEBUG] [LOCAL ] VIK: Trimmed 75886 records to 53248 (keeping 200 days of data) [2025-10-03T22:13:31.853265] [DEBUG] [LOCAL ] VIK: Primary data saved (53248 records). [2025-10-03T22:13:31.853433] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-03T22:13:31.855128] [INFO ] [MAIN ] Update Progress: 2229/2370 symbols completed. VIK took 43.9s. Estimated remaining: 19m 50s. Rate: 7.1 symbols/min [2025-10-03T22:13:32.004953] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-03T22:13:32.072921] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T22:13:32.071013] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:32.117210] [DEBUG] [LOCAL ] VLN: Loaded 29371 existing records from primary storage. [2025-10-03T22:13:32.117523] [INFO ] [MAIN ] VLN: Loaded 29371 existing records. [2025-10-03T22:13:32.318852] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:13:32.324503] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-03T22:13:32.324605] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-03T22:13:32.331877] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-03T22:13:32.332337] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T22:13:32.332582] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-03T22:13:32.746795] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:32.790749] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-03T22:13:33.529002] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T22:13:33.590789] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-03T22:13:34.390633] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-03T22:13:34.504400] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T22:13:35.190709] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-03T22:13:35.321480] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T22:13:36.000133] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-03T22:13:36.006262] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:13:36.053415] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T22:13:36.790729] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-03T22:13:37.449483] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T22:13:37.452150] [INFO ] [REMOTE ] VIST: Full fetch complete (66827 records). [2025-10-03T22:13:37.452286] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-03T22:13:37.606469] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-03T22:13:37.885687] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-03T22:13:37.885832] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-03T22:13:37.887098] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-03T22:13:37.887167] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-03T22:13:37.890099] [DEBUG] [LOCAL ] VIST: Trimmed 66827 records to 46677 (keeping 200 days of data) [2025-10-03T22:13:38.178881] [DEBUG] [LOCAL ] VIST: Primary data saved (46677 records). [2025-10-03T22:13:38.179043] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-03T22:13:38.179154] [INFO ] [MAIN ] Update Progress: 2230/2370 symbols completed. VIST took 32.9s. Estimated remaining: 19m 41s. Rate: 7.1 symbols/min [2025-10-03T22:13:38.364530] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:38.395823] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-03T22:13:38.422746] [DEBUG] [LOCAL ] VLO: Loaded 53462 existing records from primary storage. [2025-10-03T22:13:38.423133] [INFO ] [MAIN ] VLO: Loaded 53462 existing records. [2025-10-03T22:13:38.656236] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T22:13:38.654196] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:13:38.660088] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-03T22:13:38.666587] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-03T22:13:38.667639] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-03T22:13:38.667743] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-03T22:13:39.062881] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:39.165243] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T22:13:39.190617] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-03T22:13:39.283029] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T22:13:39.990686] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-03T22:13:40.332230] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T22:13:40.790703] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-03T22:13:41.590741] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-03T22:13:41.848463] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T22:13:41.875752] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T22:13:42.390634] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-03T22:13:42.517875] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T22:13:43.190700] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-03T22:13:43.711070] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T22:13:43.990735] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-03T22:13:44.790679] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-03T22:13:45.065757] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T22:13:45.136670] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T22:13:45.590738] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-03T22:13:45.893910] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T22:13:46.390739] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-03T22:13:47.144840] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T22:13:47.190886] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-03T22:13:47.590879] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T22:13:47.990693] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-03T22:13:48.609157] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T22:13:48.790717] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-03T22:13:49.590636] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-03T22:13:49.790115] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T22:13:50.192063] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T22:13:50.390678] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-03T22:13:51.190714] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-03T22:13:51.252882] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T22:13:51.990638] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-03T22:13:52.244714] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T22:13:52.771042] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:13:52.790677] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-03T22:13:52.925801] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T22:13:53.590738] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-03T22:13:54.080309] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T22:13:54.390752] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-03T22:13:54.640345] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T22:13:55.190699] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-03T22:13:55.990634] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-03T22:13:56.318712] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T22:13:56.340885] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T22:13:56.342975] [INFO ] [REMOTE ] VLN: Full fetch complete (43180 records). [2025-10-03T22:13:56.343081] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-03T22:13:56.734111] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-03T22:13:56.734194] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-03T22:13:56.735376] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-03T22:13:56.735449] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-03T22:13:56.736752] [DEBUG] [LOCAL ] VLN: Trimmed 43180 records to 29562 (keeping 200 days of data) [2025-10-03T22:13:56.792534] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-03T22:13:56.923131] [DEBUG] [LOCAL ] VLN: Primary data saved (29562 records). [2025-10-03T22:13:56.923280] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-03T22:13:56.923434] [INFO ] [MAIN ] Update Progress: 2231/2370 symbols completed. VLN took 25.1s. Estimated remaining: 19m 33s. Rate: 7.1 symbols/min [2025-10-03T22:13:57.120143] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:13:57.121536] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T22:13:57.166335] [DEBUG] [LOCAL ] VLRS: Loaded 40672 existing records from primary storage. [2025-10-03T22:13:57.166689] [INFO ] [MAIN ] VLRS: Loaded 40672 existing records. [2025-10-03T22:13:57.359187] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:13:57.359447] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-03T22:13:57.359499] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-03T22:13:57.359875] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-03T22:13:57.359936] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-03T22:13:57.599418] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-03T22:13:57.730802] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:13:58.395786] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-03T22:13:58.401578] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T22:13:59.196182] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-03T22:13:59.211304] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T22:13:59.846198] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T22:13:59.990702] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-03T22:14:00.240489] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T22:14:00.790719] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-03T22:14:01.590728] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-03T22:14:01.890326] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T22:14:01.932949] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T22:14:02.390709] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-03T22:14:02.775400] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T22:14:03.190726] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-03T22:14:03.921728] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T22:14:03.990744] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-03T22:14:04.790701] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-03T22:14:05.106223] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T22:14:05.126777] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T22:14:05.129237] [INFO ] [REMOTE ] VIV: Full fetch complete (64648 records). [2025-10-03T22:14:05.129395] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-03T22:14:05.558469] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-03T22:14:05.558557] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-03T22:14:05.559828] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-03T22:14:05.559894] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-03T22:14:05.561321] [DEBUG] [LOCAL ] VIV: Trimmed 64648 records to 45605 (keeping 200 days of data) [2025-10-03T22:14:05.615059] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-03T22:14:05.854867] [DEBUG] [LOCAL ] VIV: Primary data saved (45605 records). [2025-10-03T22:14:05.855029] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-03T22:14:05.855180] [INFO ] [MAIN ] Update Progress: 2232/2370 symbols completed. VIV took 44.8s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-03T22:14:06.036886] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:14:06.045952] [DEBUG] [LOCAL ] VLT: Loaded 4564 existing records from primary storage. [2025-10-03T22:14:06.046235] [INFO ] [MAIN ] VLT: Loaded 4564 existing records. [2025-10-03T22:14:06.232140] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:14:06.232437] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-03T22:14:06.232489] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-03T22:14:06.232797] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-03T22:14:06.232856] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-03T22:14:06.399984] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-03T22:14:06.610288] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:14:07.104847] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T22:14:07.190676] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-03T22:14:07.990793] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-03T22:14:08.300631] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T22:14:08.627874] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T22:14:08.767914] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T22:14:08.790669] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-03T22:14:09.066333] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (4.28 seconds). [2025-10-03T22:14:09.068596] [INFO ] [REMOTE ] VKQ: Full fetch complete (24773 records). [2025-10-03T22:14:09.068717] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-03T22:14:09.466772] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-03T22:14:09.466861] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-03T22:14:09.467458] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-03T22:14:09.467503] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-03T22:14:09.468600] [DEBUG] [LOCAL ] VKQ: Trimmed 24773 records to 17986 (keeping 200 days of data) [2025-10-03T22:14:09.587713] [DEBUG] [LOCAL ] VKQ: Primary data saved (17986 records). [2025-10-03T22:14:09.587880] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-03T22:14:09.587987] [INFO ] [MAIN ] Update Progress: 2233/2370 symbols completed. VKQ took 39.5s. Estimated remaining: 19m 16s. Rate: 7.1 symbols/min [2025-10-03T22:14:09.600787] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-03T22:14:09.783826] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:14:09.834523] [DEBUG] [LOCAL ] VLTO: Loaded 46347 existing records from primary storage. [2025-10-03T22:14:09.834951] [INFO ] [MAIN ] VLTO: Loaded 46347 existing records. [2025-10-03T22:14:10.029186] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:14:10.029433] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-03T22:14:10.029486] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-03T22:14:10.029813] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-03T22:14:10.029877] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-03T22:14:10.402033] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-03T22:14:10.404987] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T22:14:10.473291] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:14:10.506208] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T22:14:11.190694] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-03T22:14:11.825240] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T22:14:11.990690] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-03T22:14:12.486785] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T22:14:12.790731] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-03T22:14:13.121999] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T22:14:13.245082] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:14:13.247856] [INFO ] [REMOTE ] VLO: Full fetch complete (76924 records). [2025-10-03T22:14:13.248033] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-03T22:14:13.604207] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-03T22:14:13.666296] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-03T22:14:13.666390] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-03T22:14:13.667761] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-03T22:14:13.667886] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-03T22:14:13.669624] [DEBUG] [LOCAL ] VLO: Trimmed 76924 records to 53849 (keeping 200 days of data) [2025-10-03T22:14:14.055739] [DEBUG] [LOCAL ] VLO: Primary data saved (53849 records). [2025-10-03T22:14:14.055895] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-03T22:14:14.056021] [INFO ] [MAIN ] Update Progress: 2234/2370 symbols completed. VLO took 35.9s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-03T22:14:14.274778] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:14:14.322141] [DEBUG] [LOCAL ] VMC: Loaded 43571 existing records from primary storage. [2025-10-03T22:14:14.322582] [INFO ] [MAIN ] VMC: Loaded 43571 existing records. [2025-10-03T22:14:14.402493] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-03T22:14:14.438866] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T22:14:14.531694] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:14:14.532025] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-03T22:14:14.532079] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-03T22:14:14.532370] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-03T22:14:14.532431] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-03T22:14:14.920422] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:14:15.190733] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-03T22:14:15.990740] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-03T22:14:16.212939] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T22:14:16.791378] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-03T22:14:16.794969] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T22:14:17.078998] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T22:14:17.504859] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T22:14:17.590745] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-03T22:14:18.390755] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-03T22:14:19.103754] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T22:14:19.190628] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-03T22:14:19.990682] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-03T22:14:20.036393] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T22:14:20.697126] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T22:14:20.790747] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-03T22:14:21.582099] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T22:14:21.590859] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-03T22:14:22.390770] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-03T22:14:22.641677] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T22:14:22.932387] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T22:14:22.964045] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T22:14:23.190732] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-03T22:14:23.764358] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T22:14:23.990735] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-03T22:14:24.790701] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-03T22:14:25.590681] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-03T22:14:25.673734] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T22:14:26.383247] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T22:14:26.395513] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-03T22:14:26.682039] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T22:14:26.684504] [INFO ] [REMOTE ] VLRS: Full fetch complete (58564 records). [2025-10-03T22:14:26.684629] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-03T22:14:27.112800] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-03T22:14:27.112912] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-03T22:14:27.114122] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-03T22:14:27.114191] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-03T22:14:27.115609] [DEBUG] [LOCAL ] VLRS: Trimmed 58564 records to 40965 (keeping 200 days of data) [2025-10-03T22:14:27.202296] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-03T22:14:27.364793] [DEBUG] [LOCAL ] VLRS: Primary data saved (40965 records). [2025-10-03T22:14:27.364930] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-03T22:14:27.365533] [INFO ] [MAIN ] Update Progress: 2235/2370 symbols completed. VLRS took 30.4s. Estimated remaining: 18m 59s. Rate: 7.1 symbols/min [2025-10-03T22:14:27.551184] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:14:27.574474] [DEBUG] [LOCAL ] VMI: Loaded 15488 existing records from primary storage. [2025-10-03T22:14:27.574778] [INFO ] [MAIN ] VMI: Loaded 15488 existing records. [2025-10-03T22:14:27.772026] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:14:27.772242] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-03T22:14:27.772294] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-03T22:14:27.772487] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-03T22:14:27.772556] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-03T22:14:28.003031] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-03T22:14:28.178449] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:14:28.213389] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T22:14:28.474892] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T22:14:28.790709] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-03T22:14:29.022249] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T22:14:29.383234] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T22:14:29.590710] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-03T22:14:30.191909] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T22:14:30.390732] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-03T22:14:31.190698] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-03T22:14:31.990716] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-03T22:14:32.072080] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T22:14:32.695184] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T22:14:32.790617] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-03T22:14:32.970986] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T22:14:33.590723] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-03T22:14:33.768348] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T22:14:34.390682] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-03T22:14:35.130464] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T22:14:35.190717] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-03T22:14:35.855794] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:14:35.990714] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-03T22:14:36.560775] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T22:14:36.790724] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-03T22:14:36.896023] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T22:14:37.137245] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T22:14:37.138163] [INFO ] [REMOTE ] VLT: Full fetch complete (7496 records). [2025-10-03T22:14:37.138238] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-03T22:14:37.564710] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-03T22:14:37.564801] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-03T22:14:37.565036] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-03T22:14:37.565079] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-03T22:14:37.565513] [DEBUG] [LOCAL ] VLT: Trimmed 7496 records to 4577 (keeping 200 days of data) [2025-10-03T22:14:37.590798] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-03T22:14:37.595613] [DEBUG] [LOCAL ] VLT: Primary data saved (4577 records). [2025-10-03T22:14:37.595709] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-03T22:14:37.595826] [INFO ] [MAIN ] Update Progress: 2236/2370 symbols completed. VLT took 31.7s. Estimated remaining: 18m 51s. Rate: 7.1 symbols/min [2025-10-03T22:14:37.787301] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:14:37.810204] [DEBUG] [LOCAL ] VMO: Loaded 21243 existing records from primary storage. [2025-10-03T22:14:37.810552] [INFO ] [MAIN ] VMO: Loaded 21243 existing records. [2025-10-03T22:14:38.008056] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:14:38.008364] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-03T22:14:38.008444] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-03T22:14:38.008811] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-03T22:14:38.008890] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-03T22:14:38.392533] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-03T22:14:38.395994] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:14:39.190664] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-03T22:14:39.410528] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T22:14:39.443262] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T22:14:39.990737] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-03T22:14:40.697369] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T22:14:40.790693] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-03T22:14:41.085777] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T22:14:41.590726] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-03T22:14:42.390675] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-03T22:14:42.507568] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T22:14:42.685954] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T22:14:43.036708] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T22:14:43.190716] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-03T22:14:43.990739] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-03T22:14:44.790700] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-03T22:14:44.918750] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T22:14:45.019114] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T22:14:45.590690] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-03T22:14:46.390637] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-03T22:14:46.419326] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T22:14:46.642524] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T22:14:47.190687] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-03T22:14:47.491487] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T22:14:47.990662] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-03T22:14:48.143771] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T22:14:48.790705] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-03T22:14:49.093835] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T22:14:49.590705] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-03T22:14:50.031260] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T22:14:50.033959] [INFO ] [REMOTE ] VLTO: Full fetch complete (66965 records). [2025-10-03T22:14:50.034100] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-03T22:14:50.392138] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-03T22:14:50.516923] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-03T22:14:50.526622] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-03T22:14:50.529242] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-03T22:14:50.531002] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T22:14:50.531310] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-03T22:14:50.543339] [DEBUG] [LOCAL ] VLTO: Trimmed 66965 records to 46686 (keeping 200 days of data) [2025-10-03T22:14:50.862634] [DEBUG] [LOCAL ] VLTO: Primary data saved (46686 records). [2025-10-03T22:14:50.862810] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-03T22:14:50.862918] [INFO ] [MAIN ] Update Progress: 2237/2370 symbols completed. VLTO took 41.3s. Estimated remaining: 18m 43s. Rate: 7.1 symbols/min [2025-10-03T22:14:51.190694] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-03T22:14:51.438567] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T22:14:51.990749] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-03T22:14:52.031763] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T22:14:52.130015] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-03T22:14:52.132393] [INFO ] [REMOTE ] VMC: Full fetch complete (62526 records). [2025-10-03T22:14:52.132510] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-03T22:14:52.555960] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-03T22:14:52.556052] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-03T22:14:52.557452] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-03T22:14:52.557520] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-03T22:14:52.559273] [DEBUG] [LOCAL ] VMC: Trimmed 62526 records to 43854 (keeping 200 days of data) [2025-10-03T22:14:52.790898] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-03T22:14:52.847291] [DEBUG] [LOCAL ] VMC: Primary data saved (43854 records). [2025-10-03T22:14:52.847433] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-03T22:14:52.847523] [INFO ] [MAIN ] Update Progress: 2238/2370 symbols completed. VMC took 38.8s. Estimated remaining: 18m 34s. Rate: 7.1 symbols/min [2025-10-03T22:14:53.590750] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-03T22:14:53.829401] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T22:14:54.390734] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-03T22:14:54.580677] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T22:14:55.069090] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T22:14:55.070288] [INFO ] [REMOTE ] VMI: Full fetch complete (21190 records). [2025-10-03T22:14:55.070362] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-03T22:14:55.195778] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-03T22:14:55.461435] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-03T22:14:55.461521] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-03T22:14:55.462087] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-03T22:14:55.462152] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-03T22:14:55.462945] [DEBUG] [LOCAL ] VMI: Trimmed 21190 records to 15568 (keeping 200 days of data) [2025-10-03T22:14:55.575104] [DEBUG] [LOCAL ] VMI: Primary data saved (15568 records). [2025-10-03T22:14:55.575290] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-03T22:14:55.575423] [INFO ] [MAIN ] Update Progress: 2239/2370 symbols completed. VMI took 28.2s. Estimated remaining: 18m 25s. Rate: 7.1 symbols/min [2025-10-03T22:14:56.308618] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T22:14:56.314478] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-03T22:14:57.445603] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T22:14:57.451791] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-03T22:14:58.493922] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T22:14:58.498555] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-03T22:14:59.564221] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T22:14:59.570574] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-03T22:15:00.483544] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T22:15:00.485218] [INFO ] [REMOTE ] VMO: Full fetch complete (31407 records). [2025-10-03T22:15:00.485386] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-03T22:15:00.876065] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-03T22:15:00.876183] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-03T22:15:00.877061] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-03T22:15:00.877131] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-03T22:15:00.878036] [DEBUG] [LOCAL ] VMO: Trimmed 31407 records to 21385 (keeping 200 days of data) [2025-10-03T22:15:01.014265] [DEBUG] [LOCAL ] VMO: Primary data saved (21385 records). [2025-10-03T22:15:01.014454] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-03T22:15:01.014659] [INFO ] [MAIN ] Update Progress: 2240/2370 symbols completed. VMO took 23.4s. Estimated remaining: 18m 17s. Rate: 7.1 symbols/min [2025-10-03T22:15:01.734518] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:01.768019] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:01.792696] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:01.819471] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:01.841747] [DEBUG] [LOCAL ] VOC: Loaded 8949 existing records from primary storage. [2025-10-03T22:15:01.841213] [DEBUG] [LOCAL ] VNCE: Loaded 8168 existing records from primary storage. [2025-10-03T22:15:01.842189] [INFO ] [MAIN ] VNCE: Loaded 8168 existing records. [2025-10-03T22:15:01.842364] [INFO ] [MAIN ] VOC: Loaded 8949 existing records. [2025-10-03T22:15:02.308534] [DEBUG] [LOCAL ] VNT: Loaded 43857 existing records from primary storage. [2025-10-03T22:15:02.307756] [DEBUG] [LOCAL ] VNO: Loaded 49196 existing records from primary storage. [2025-10-03T22:15:02.353851] [INFO ] [MAIN ] VNT: Loaded 43857 existing records. [2025-10-03T22:15:02.369721] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:02.385288] [INFO ] [MAIN ] VNO: Loaded 49196 existing records. [2025-10-03T22:15:02.424425] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:02.415237] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-03T22:15:02.488516] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-03T22:15:02.508161] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-03T22:15:02.575798] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-03T22:15:02.565238] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-03T22:15:02.605877] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-03T22:15:02.619177] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-03T22:15:02.630030] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-03T22:15:02.942417] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:03.020706] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-03T22:15:03.011083] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:03.031280] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-03T22:15:03.031537] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-03T22:15:03.036447] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-03T22:15:03.079030] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-03T22:15:03.105448] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-03T22:15:03.115943] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-03T22:15:03.143095] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-03T22:15:03.840093] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:03.930773] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-03T22:15:03.981154] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:04.021038] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-03T22:15:04.453051] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:04.478174] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-03T22:15:04.477480] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:04.479731] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-03T22:15:04.884110] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T22:15:04.886828] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-03T22:15:05.284386] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T22:15:05.289048] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-03T22:15:05.708254] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T22:15:05.711406] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-03T22:15:05.893079] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T22:15:05.903334] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-03T22:15:06.054978] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T22:15:06.063380] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-03T22:15:06.490918] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T22:15:06.494418] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-03T22:15:06.595493] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T22:15:07.190769] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-03T22:15:07.271513] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T22:15:07.594538] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T22:15:07.638226] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T22:15:07.699330] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T22:15:07.990709] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-03T22:15:08.682817] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T22:15:08.790634] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-03T22:15:09.479417] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T22:15:09.590715] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-03T22:15:10.390853] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-03T22:15:11.190750] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-03T22:15:11.210409] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T22:15:11.252001] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T22:15:11.990750] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-03T22:15:12.799687] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-03T22:15:12.810549] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T22:15:12.808576] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T22:15:13.590741] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-03T22:15:14.390708] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-03T22:15:14.453256] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T22:15:14.533998] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T22:15:15.190729] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-03T22:15:15.990773] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-03T22:15:16.131927] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T22:15:16.552000] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T22:15:16.569099] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T22:15:16.790727] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-03T22:15:17.590700] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-03T22:15:18.361832] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T22:15:18.390681] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-03T22:15:18.450431] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T22:15:18.761608] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T22:15:19.190699] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-03T22:15:19.990742] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-03T22:15:20.038925] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T22:15:20.790735] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-03T22:15:21.590769] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-03T22:15:21.680384] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T22:15:22.149718] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T22:15:22.390776] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-03T22:15:22.500142] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T22:15:23.190714] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-03T22:15:23.690323] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T22:15:23.990739] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-03T22:15:24.781780] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T22:15:24.790778] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-03T22:15:25.108048] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T22:15:25.109616] [INFO ] [REMOTE ] VNCE: Full fetch complete (16222 records). [2025-10-03T22:15:25.109719] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-03T22:15:25.540495] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-03T22:15:25.540607] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-03T22:15:25.541257] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-03T22:15:25.541327] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-03T22:15:25.542206] [DEBUG] [LOCAL ] VNCE: Trimmed 16222 records to 8345 (keeping 200 days of data) [2025-10-03T22:15:25.590969] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-03T22:15:25.609166] [DEBUG] [LOCAL ] VNCE: Primary data saved (8345 records). [2025-10-03T22:15:25.609378] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-03T22:15:25.609563] [INFO ] [MAIN ] Update Progress: 2241/2370 symbols completed. VNCE took 24.6s. Estimated remaining: 18m 9s. Rate: 7.1 symbols/min [2025-10-03T22:15:25.750611] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T22:15:25.841189] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:25.905042] [DEBUG] [LOCAL ] VOYA: Loaded 42817 existing records from primary storage. [2025-10-03T22:15:25.905548] [INFO ] [MAIN ] VOYA: Loaded 42817 existing records. [2025-10-03T22:15:26.258048] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:26.258336] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-03T22:15:26.258390] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-03T22:15:26.258911] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-03T22:15:26.258975] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-03T22:15:26.395856] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-03T22:15:26.717897] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:27.147172] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T22:15:27.190628] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-03T22:15:27.312613] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:15:27.990732] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-03T22:15:28.459294] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T22:15:28.790690] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-03T22:15:29.491680] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T22:15:29.590751] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-03T22:15:30.278801] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T22:15:30.279872] [INFO ] [REMOTE ] VOC: Full fetch complete (13115 records). [2025-10-03T22:15:30.279969] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-03T22:15:30.394206] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-03T22:15:30.787839] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T22:15:30.786171] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-03T22:15:30.798233] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-03T22:15:30.799029] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-03T22:15:30.799100] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-03T22:15:30.799928] [DEBUG] [LOCAL ] VOC: Trimmed 13115 records to 9030 (keeping 200 days of data) [2025-10-03T22:15:30.858557] [DEBUG] [LOCAL ] VOC: Primary data saved (9030 records). [2025-10-03T22:15:30.858741] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-03T22:15:30.858892] [INFO ] [MAIN ] Update Progress: 2242/2370 symbols completed. VOC took 29.8s. Estimated remaining: 18m 1s. Rate: 7.1 symbols/min [2025-10-03T22:15:31.043681] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:31.043920] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-03T22:15:31.044042] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-03T22:15:31.044172] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-03T22:15:31.044217] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-03T22:15:31.044304] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-03T22:15:31.044355] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-03T22:15:31.195937] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-03T22:15:31.428433] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:31.990711] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-03T22:15:32.021931] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T22:15:32.790693] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-03T22:15:32.996718] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T22:15:33.590716] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-03T22:15:33.717904] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T22:15:34.275709] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T22:15:34.390734] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-03T22:15:34.914500] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T22:15:34.917088] [INFO ] [REMOTE ] VNO: Full fetch complete (70458 records). [2025-10-03T22:15:34.917248] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-03T22:15:35.201092] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-03T22:15:35.362901] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-03T22:15:35.362991] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-03T22:15:35.364268] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-03T22:15:35.364336] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-03T22:15:35.366951] [DEBUG] [LOCAL ] VNO: Trimmed 70458 records to 49511 (keeping 200 days of data) [2025-10-03T22:15:35.678660] [DEBUG] [LOCAL ] VNO: Primary data saved (49511 records). [2025-10-03T22:15:35.678821] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-03T22:15:35.678940] [INFO ] [MAIN ] Update Progress: 2243/2370 symbols completed. VNO took 34.7s. Estimated remaining: 17m 52s. Rate: 7.1 symbols/min [2025-10-03T22:15:35.909311] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:35.930930] [DEBUG] [LOCAL ] VPG: Loaded 17197 existing records from primary storage. [2025-10-03T22:15:35.931317] [INFO ] [MAIN ] VPG: Loaded 17197 existing records. [2025-10-03T22:15:35.995906] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-03T22:15:36.158943] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:36.159332] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-03T22:15:36.159421] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-03T22:15:36.161002] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-03T22:15:36.161067] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-03T22:15:36.297492] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:15:36.346220] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-03T22:15:36.361109] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:15:36.361320] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-03T22:15:36.391457] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:15:36.405041] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T22:15:36.392369] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-03T22:15:36.482166] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-03T22:15:36.498566] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-03T22:15:36.537218] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-03T22:15:36.537840] [INFO ] [MAIN ] Update Progress: 2244/2370 symbols completed. VOYG took 5.7s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-03T22:15:36.701900] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:36.803337] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-03T22:15:36.844943] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:36.882355] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T22:15:36.896438] [DEBUG] [LOCAL ] VPV: Loaded 5432 existing records from primary storage. [2025-10-03T22:15:36.896932] [INFO ] [MAIN ] VPV: Loaded 5432 existing records. [2025-10-03T22:15:37.126272] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:37.126525] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-03T22:15:37.126579] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-03T22:15:37.126824] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-03T22:15:37.126898] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-03T22:15:37.527224] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:37.590749] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-03T22:15:38.393907] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-03T22:15:38.397717] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T22:15:38.437596] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T22:15:39.190732] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-03T22:15:39.961543] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T22:15:39.990663] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-03T22:15:40.791419] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-03T22:15:40.797388] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T22:15:41.157182] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:15:41.159585] [INFO ] [REMOTE ] VNT: Full fetch complete (63409 records). [2025-10-03T22:15:41.159734] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-03T22:15:41.598702] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-03T22:15:41.651349] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-03T22:15:41.651505] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-03T22:15:41.653023] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-03T22:15:41.653250] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-03T22:15:41.654991] [DEBUG] [LOCAL ] VNT: Trimmed 63409 records to 44165 (keeping 200 days of data) [2025-10-03T22:15:41.770178] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T22:15:42.004262] [DEBUG] [LOCAL ] VNT: Primary data saved (44165 records). [2025-10-03T22:15:42.004566] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-03T22:15:42.004708] [INFO ] [MAIN ] Update Progress: 2245/2370 symbols completed. VNT took 41.0s. Estimated remaining: 17m 34s. Rate: 7.1 symbols/min [2025-10-03T22:15:42.200328] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:15:42.237498] [DEBUG] [LOCAL ] VRE: Loaded 35252 existing records from primary storage. [2025-10-03T22:15:42.237854] [INFO ] [MAIN ] VRE: Loaded 35252 existing records. [2025-10-03T22:15:42.400312] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-03T22:15:42.435873] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:15:42.436369] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-03T22:15:42.436426] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-03T22:15:42.436981] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-03T22:15:42.437043] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-03T22:15:42.826081] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:15:43.175255] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T22:15:43.190620] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-03T22:15:43.274886] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T22:15:43.990727] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-03T22:15:44.683901] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T22:15:44.790747] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-03T22:15:44.855835] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T22:15:45.590710] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-03T22:15:46.344067] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T22:15:46.390746] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-03T22:15:46.924632] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T22:15:46.941084] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T22:15:47.190740] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-03T22:15:47.990737] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-03T22:15:48.427319] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T22:15:48.614904] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T22:15:48.790705] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-03T22:15:49.547511] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T22:15:49.590730] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-03T22:15:50.273747] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T22:15:50.390697] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-03T22:15:51.190730] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-03T22:15:51.483871] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T22:15:51.990629] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-03T22:15:52.380797] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T22:15:52.731451] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T22:15:52.790720] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-03T22:15:53.417472] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T22:15:53.590705] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-03T22:15:54.191179] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T22:15:54.390722] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-03T22:15:55.190737] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-03T22:15:55.573767] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T22:15:55.990700] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-03T22:15:56.582396] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T22:15:56.604528] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T22:15:56.790708] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-03T22:15:57.590716] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-03T22:15:57.764869] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T22:15:58.390728] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-03T22:15:59.175493] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T22:15:59.190622] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-03T22:15:59.634421] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T22:15:59.990700] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-03T22:16:00.355787] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:16:00.358189] [INFO ] [REMOTE ] VOYA: Full fetch complete (61834 records). [2025-10-03T22:16:00.358296] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-03T22:16:00.768410] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-03T22:16:00.768681] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-03T22:16:00.770329] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-03T22:16:00.770410] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-03T22:16:00.775064] [DEBUG] [LOCAL ] VOYA: Trimmed 61834 records to 43096 (keeping 200 days of data) [2025-10-03T22:16:00.835236] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-03T22:16:01.061166] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T22:16:01.089664] [DEBUG] [LOCAL ] VOYA: Primary data saved (43096 records). [2025-10-03T22:16:01.089826] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-03T22:16:01.089984] [INFO ] [MAIN ] Update Progress: 2246/2370 symbols completed. VOYA took 35.5s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-03T22:16:01.272537] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:01.349239] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-03T22:16:01.349612] [INFO ] [MAIN ] VRT: Loaded 54143 existing records. [2025-10-03T22:16:01.563536] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T22:16:01.571237] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:01.573907] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-03T22:16:01.574399] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-03T22:16:01.575587] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-03T22:16:01.575682] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-03T22:16:01.599489] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-03T22:16:02.022985] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:02.390716] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-03T22:16:02.999698] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T22:16:03.190714] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-03T22:16:03.950597] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T22:16:03.990678] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-03T22:16:04.620414] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T22:16:04.621620] [INFO ] [REMOTE ] VPV: Full fetch complete (9282 records). [2025-10-03T22:16:04.621842] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-03T22:16:04.758455] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-03T22:16:04.793178] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-03T22:16:05.077912] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-03T22:16:05.078047] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-03T22:16:05.078354] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-03T22:16:05.078418] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-03T22:16:05.078984] [DEBUG] [LOCAL ] VPV: Trimmed 9282 records to 5487 (keeping 200 days of data) [2025-10-03T22:16:05.114229] [DEBUG] [LOCAL ] VPV: Primary data saved (5487 records). [2025-10-03T22:16:05.114498] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-03T22:16:05.114697] [INFO ] [MAIN ] Update Progress: 2247/2370 symbols completed. VPV took 28.6s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-03T22:16:05.305444] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:05.320450] [DEBUG] [LOCAL ] VRTS: Loaded 9342 existing records from primary storage. [2025-10-03T22:16:05.320734] [INFO ] [MAIN ] VRTS: Loaded 9342 existing records. [2025-10-03T22:16:05.523898] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:05.524170] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-03T22:16:05.524232] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-03T22:16:05.524500] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-03T22:16:05.524559] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-03T22:16:05.590675] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-03T22:16:05.852522] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T22:16:05.940011] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:06.390682] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-03T22:16:06.957543] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T22:16:07.190681] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-03T22:16:07.246821] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-03T22:16:07.914127] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T22:16:07.990705] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-03T22:16:08.790721] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-03T22:16:09.550196] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T22:16:09.551501] [INFO ] [REMOTE ] VPG: Full fetch complete (22832 records). [2025-10-03T22:16:09.551582] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-03T22:16:09.595922] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-03T22:16:09.999633] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-03T22:16:09.999765] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-03T22:16:10.000358] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-03T22:16:10.000425] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-03T22:16:10.001240] [DEBUG] [LOCAL ] VPG: Trimmed 22832 records to 17266 (keeping 200 days of data) [2025-10-03T22:16:10.118911] [DEBUG] [LOCAL ] VPG: Primary data saved (17266 records). [2025-10-03T22:16:10.119080] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-03T22:16:10.119176] [INFO ] [MAIN ] Update Progress: 2248/2370 symbols completed. VPG took 34.4s. Estimated remaining: 17m 9s. Rate: 7.1 symbols/min [2025-10-03T22:16:10.327512] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:10.373938] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T22:16:10.391587] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-03T22:16:10.398140] [DEBUG] [LOCAL ] VSCO: Loaded 53154 existing records from primary storage. [2025-10-03T22:16:10.398474] [INFO ] [MAIN ] VSCO: Loaded 53154 existing records. [2025-10-03T22:16:10.611943] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:10.612359] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-03T22:16:10.612425] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-03T22:16:10.639694] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-03T22:16:10.644968] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-03T22:16:10.732387] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-03T22:16:11.040856] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:11.190713] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-03T22:16:11.999702] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-03T22:16:12.003432] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T22:16:12.664157] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T22:16:12.790634] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-03T22:16:12.897965] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T22:16:13.590738] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-03T22:16:13.989152] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T22:16:14.331206] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T22:16:14.390702] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-03T22:16:15.190746] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-03T22:16:15.235318] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T22:16:15.990752] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-03T22:16:16.790673] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-03T22:16:16.877335] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T22:16:16.915025] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T22:16:17.590730] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-03T22:16:18.390789] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-03T22:16:19.153542] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-03T22:16:19.190740] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-03T22:16:19.317888] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T22:16:19.366044] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T22:16:19.990729] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-03T22:16:20.755296] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T22:16:20.790628] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-03T22:16:20.823086] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-03T22:16:21.590774] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-03T22:16:21.919754] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T22:16:21.922043] [INFO ] [REMOTE ] VRE: Full fetch complete (48357 records). [2025-10-03T22:16:21.922172] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-03T22:16:22.365329] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-03T22:16:22.365429] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-03T22:16:22.366668] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-03T22:16:22.366787] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-03T22:16:22.368302] [DEBUG] [LOCAL ] VRE: Trimmed 48357 records to 35517 (keeping 200 days of data) [2025-10-03T22:16:22.431247] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-03T22:16:22.630168] [DEBUG] [LOCAL ] VRE: Primary data saved (35517 records). [2025-10-03T22:16:22.630336] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-03T22:16:22.631536] [INFO ] [MAIN ] Update Progress: 2249/2370 symbols completed. VRE took 40.6s. Estimated remaining: 17m 1s. Rate: 7.1 symbols/min [2025-10-03T22:16:22.825690] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:22.893501] [DEBUG] [LOCAL ] VSH: Loaded 48691 existing records from primary storage. [2025-10-03T22:16:22.893876] [INFO ] [MAIN ] VSH: Loaded 48691 existing records. [2025-10-03T22:16:23.096477] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:23.096983] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-03T22:16:23.097047] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-03T22:16:23.097576] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-03T22:16:23.097671] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-03T22:16:23.202186] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-03T22:16:23.517290] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:23.555525] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T22:16:23.990723] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-03T22:16:24.006352] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T22:16:24.542967] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T22:16:24.790742] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-03T22:16:25.581150] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T22:16:25.590631] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-03T22:16:25.773136] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T22:16:25.999350] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T22:16:26.000420] [INFO ] [REMOTE ] VRTS: Full fetch complete (11443 records). [2025-10-03T22:16:26.000513] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-03T22:16:26.396197] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-03T22:16:26.407014] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-03T22:16:26.407094] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-03T22:16:26.407474] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-03T22:16:26.407561] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-03T22:16:26.408478] [DEBUG] [LOCAL ] VRTS: Trimmed 11443 records to 9386 (keeping 200 days of data) [2025-10-03T22:16:26.483248] [DEBUG] [LOCAL ] VRTS: Primary data saved (9386 records). [2025-10-03T22:16:26.483409] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-03T22:16:26.483543] [INFO ] [MAIN ] Update Progress: 2250/2370 symbols completed. VRTS took 21.4s. Estimated remaining: 16m 52s. Rate: 7.1 symbols/min [2025-10-03T22:16:26.718893] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:26.788786] [DEBUG] [LOCAL ] VST: Loaded 54108 existing records from primary storage. [2025-10-03T22:16:26.789201] [INFO ] [MAIN ] VST: Loaded 54108 existing records. [2025-10-03T22:16:26.979894] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:26.980148] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-03T22:16:26.980204] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-03T22:16:26.980688] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-03T22:16:26.980753] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-03T22:16:27.198985] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-03T22:16:27.381993] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:27.990665] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-03T22:16:28.250687] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T22:16:28.790738] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-03T22:16:29.391943] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T22:16:29.590726] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-03T22:16:29.811743] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T22:16:30.390724] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-03T22:16:30.694895] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T22:16:31.190708] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-03T22:16:31.927700] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T22:16:31.977871] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T22:16:31.990607] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-03T22:16:32.790739] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-03T22:16:33.049549] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T22:16:33.590723] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-03T22:16:33.671144] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T22:16:34.390707] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-03T22:16:35.190730] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-03T22:16:35.244905] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-03T22:16:35.326369] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T22:16:35.990727] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-03T22:16:36.595476] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T22:16:36.675175] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T22:16:36.790749] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-03T22:16:37.590720] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-03T22:16:37.895111] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T22:16:38.390815] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-03T22:16:39.190779] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-03T22:16:39.303708] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-03T22:16:39.889720] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-03T22:16:39.990739] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-03T22:16:40.144845] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T22:16:40.790727] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-03T22:16:40.839235] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T22:16:41.590754] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-03T22:16:42.390719] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-03T22:16:42.467120] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T22:16:42.609078] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-03T22:16:42.689780] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T22:16:42.692479] [INFO ] [REMOTE ] VSCO: Full fetch complete (76185 records). [2025-10-03T22:16:42.692604] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-03T22:16:43.120364] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-03T22:16:43.120461] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-03T22:16:43.121772] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-03T22:16:43.121840] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-03T22:16:43.123493] [DEBUG] [LOCAL ] VSCO: Trimmed 76185 records to 53540 (keeping 200 days of data) [2025-10-03T22:16:43.209849] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-03T22:16:43.460412] [DEBUG] [LOCAL ] VSCO: Primary data saved (53540 records). [2025-10-03T22:16:43.460574] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-03T22:16:43.460687] [INFO ] [MAIN ] Update Progress: 2251/2370 symbols completed. VSCO took 33.3s. Estimated remaining: 16m 44s. Rate: 7.1 symbols/min [2025-10-03T22:16:43.646749] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:43.692160] [DEBUG] [LOCAL ] VSTS: Loaded 49392 existing records from primary storage. [2025-10-03T22:16:43.692496] [INFO ] [MAIN ] VSTS: Loaded 49392 existing records. [2025-10-03T22:16:43.895801] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:43.896083] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-03T22:16:43.896143] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-03T22:16:43.896527] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-03T22:16:43.896588] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-03T22:16:43.995802] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-03T22:16:44.291473] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:44.790694] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-03T22:16:44.927854] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:16:45.159361] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-03T22:16:45.590750] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-03T22:16:46.395796] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-03T22:16:46.415506] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T22:16:46.632696] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-03T22:16:47.190701] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-03T22:16:47.760840] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T22:16:47.976854] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T22:16:47.990620] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-03T22:16:48.489571] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T22:16:48.790737] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-03T22:16:49.165600] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T22:16:49.590738] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-03T22:16:50.390733] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-03T22:16:51.190731] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-03T22:16:51.256507] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T22:16:51.622220] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T22:16:51.626085] [INFO ] [REMOTE ] VSH: Full fetch complete (70969 records). [2025-10-03T22:16:51.626320] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-03T22:16:52.013520] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-03T22:16:52.070104] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-03T22:16:52.070264] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-03T22:16:52.071852] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-03T22:16:52.072183] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-03T22:16:52.074608] [DEBUG] [LOCAL ] VSH: Trimmed 70969 records to 49064 (keeping 200 days of data) [2025-10-03T22:16:52.214326] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-03T22:16:52.452616] [DEBUG] [LOCAL ] VSH: Primary data saved (49064 records). [2025-10-03T22:16:52.452935] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-03T22:16:52.453669] [INFO ] [MAIN ] Update Progress: 2252/2370 symbols completed. VSH took 29.8s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-03T22:16:52.650739] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:52.677282] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T22:16:52.727108] [DEBUG] [LOCAL ] VTEX: Loaded 43470 existing records from primary storage. [2025-10-03T22:16:52.727527] [INFO ] [MAIN ] VTEX: Loaded 43470 existing records. [2025-10-03T22:16:52.795739] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-03T22:16:52.922792] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:52.923039] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-03T22:16:52.923094] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-03T22:16:52.923340] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-03T22:16:52.923413] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-03T22:16:53.309817] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:53.590690] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-03T22:16:54.050810] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-03T22:16:54.058871] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-03T22:16:54.059042] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-03T22:16:54.395876] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-03T22:16:54.481213] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-03T22:16:54.481312] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-03T22:16:54.482999] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-03T22:16:54.483079] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-03T22:16:54.485181] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54533 (keeping 200 days of data) [2025-10-03T22:16:54.858879] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T22:16:54.898043] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-10-03T22:16:54.898430] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-03T22:16:54.899538] [INFO ] [MAIN ] Update Progress: 2253/2370 symbols completed. VRT took 53.8s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-03T22:16:55.090043] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:16:55.141628] [DEBUG] [LOCAL ] VTLE: Loaded 48776 existing records from primary storage. [2025-10-03T22:16:55.142229] [INFO ] [MAIN ] VTLE: Loaded 48776 existing records. [2025-10-03T22:16:55.199108] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-03T22:16:55.339788] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:16:55.340092] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-03T22:16:55.340189] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-03T22:16:55.340722] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-03T22:16:55.340819] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-03T22:16:55.489667] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-03T22:16:55.832317] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:16:55.990679] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-03T22:16:56.040340] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T22:16:56.621226] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T22:16:56.790705] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-03T22:16:57.590704] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-03T22:16:58.354434] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T22:16:58.390615] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-03T22:16:58.463012] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-03T22:16:58.623813] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T22:16:59.190700] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-03T22:16:59.990730] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-03T22:17:00.043306] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T22:17:00.796786] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-03T22:17:00.819092] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T22:17:01.595771] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-03T22:17:01.615331] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T22:17:02.390730] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-03T22:17:03.193523] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-03T22:17:03.221440] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T22:17:03.431301] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-03T22:17:03.818498] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T22:17:03.990723] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-03T22:17:04.790636] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-03T22:17:04.865771] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T22:17:05.590687] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-03T22:17:05.658306] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T22:17:06.339310] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T22:17:06.390727] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-03T22:17:07.190720] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-03T22:17:07.990682] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-03T22:17:08.037061] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T22:17:08.070086] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-03T22:17:08.664675] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:17:08.790707] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-03T22:17:09.590719] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-03T22:17:09.632146] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T22:17:10.390673] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-03T22:17:10.483406] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T22:17:11.180999] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T22:17:11.190839] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-03T22:17:11.640636] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:17:11.643976] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-10-03T22:17:11.644206] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-03T22:17:11.995967] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-03T22:17:12.268995] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-03T22:17:12.269219] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-03T22:17:12.271143] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-03T22:17:12.271239] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-03T22:17:12.291064] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 54498 (keeping 200 days of data) [2025-10-03T22:17:12.330814] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T22:17:12.761705] [DEBUG] [LOCAL ] VST: Primary data saved (54498 records). [2025-10-03T22:17:12.762454] [INFO ] [MAIN ] VST: Full history saved. [2025-10-03T22:17:12.762786] [INFO ] [MAIN ] Update Progress: 2254/2370 symbols completed. VST took 46.3s. Estimated remaining: 16m 19s. Rate: 7.1 symbols/min [2025-10-03T22:17:12.797215] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-03T22:17:12.958453] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:12.979710] [DEBUG] [LOCAL ] VTMX: Loaded 17619 existing records from primary storage. [2025-10-03T22:17:12.980027] [INFO ] [MAIN ] VTMX: Loaded 17619 existing records. [2025-10-03T22:17:13.161814] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:13.162084] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-03T22:17:13.162186] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-03T22:17:13.162454] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-03T22:17:13.162514] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-03T22:17:13.535754] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:13.536912] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T22:17:13.540264] [INFO ] [REMOTE ] VSTS: Full fetch complete (69786 records). [2025-10-03T22:17:13.540393] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-03T22:17:13.601460] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-03T22:17:13.954103] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-03T22:17:13.954296] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-03T22:17:13.955795] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-03T22:17:13.955869] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-03T22:17:13.957510] [DEBUG] [LOCAL ] VSTS: Trimmed 69786 records to 49740 (keeping 200 days of data) [2025-10-03T22:17:14.249832] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T22:17:14.297734] [DEBUG] [LOCAL ] VSTS: Primary data saved (49740 records). [2025-10-03T22:17:14.297983] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-03T22:17:14.298108] [INFO ] [MAIN ] Update Progress: 2255/2370 symbols completed. VSTS took 30.8s. Estimated remaining: 16m 10s. Rate: 7.1 symbols/min [2025-10-03T22:17:14.399379] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-03T22:17:14.491238] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:14.501671] [DEBUG] [LOCAL ] VTN: Loaded 7084 existing records from primary storage. [2025-10-03T22:17:14.501923] [INFO ] [MAIN ] VTN: Loaded 7084 existing records. [2025-10-03T22:17:14.692864] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:14.693086] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-03T22:17:14.693137] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-03T22:17:14.693333] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-03T22:17:14.693392] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-03T22:17:14.904885] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T22:17:15.115512] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:15.190673] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-03T22:17:15.891712] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T22:17:15.990679] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-03T22:17:16.073300] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T22:17:16.790668] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-03T22:17:17.019885] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T22:17:17.590698] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-03T22:17:18.390721] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-03T22:17:18.530316] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T22:17:18.737322] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T22:17:19.190709] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-03T22:17:19.972528] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T22:17:19.990605] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-03T22:17:20.178514] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T22:17:20.790732] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-03T22:17:21.232486] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T22:17:21.234699] [INFO ] [REMOTE ] VTEX: Full fetch complete (60652 records). [2025-10-03T22:17:21.234953] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-03T22:17:21.610869] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-03T22:17:21.632437] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-03T22:17:21.632627] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-03T22:17:21.633854] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-03T22:17:21.633921] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-03T22:17:21.635308] [DEBUG] [LOCAL ] VTEX: Trimmed 60652 records to 43788 (keeping 200 days of data) [2025-10-03T22:17:21.899678] [DEBUG] [LOCAL ] VTEX: Primary data saved (43788 records). [2025-10-03T22:17:21.899823] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-03T22:17:21.901218] [INFO ] [MAIN ] Update Progress: 2256/2370 symbols completed. VTEX took 29.4s. Estimated remaining: 16m 2s. Rate: 7.1 symbols/min [2025-10-03T22:17:22.027842] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T22:17:22.109376] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:22.132140] [DEBUG] [LOCAL ] VTOL: Loaded 19682 existing records from primary storage. [2025-10-03T22:17:22.132414] [INFO ] [MAIN ] VTOL: Loaded 19682 existing records. [2025-10-03T22:17:22.317102] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:22.317375] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-03T22:17:22.317431] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-03T22:17:22.317671] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-03T22:17:22.317734] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-03T22:17:22.395836] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-03T22:17:22.704439] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:23.194818] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-03T22:17:23.199436] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T22:17:23.404253] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T22:17:23.990696] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-03T22:17:24.321088] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T22:17:24.712830] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T22:17:24.790742] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-03T22:17:25.590640] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-03T22:17:25.807510] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T22:17:26.390728] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-03T22:17:27.190635] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-03T22:17:27.302293] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T22:17:27.340482] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T22:17:27.929825] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T22:17:27.990737] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-03T22:17:28.790703] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-03T22:17:28.844533] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T22:17:29.560437] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T22:17:29.590692] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-03T22:17:30.390637] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-03T22:17:30.530211] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T22:17:30.905255] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T22:17:31.190741] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-03T22:17:31.902964] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T22:17:31.990686] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-03T22:17:32.790703] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-03T22:17:33.523529] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T22:17:33.524892] [INFO ] [REMOTE ] VTMX: Full fetch complete (25819 records). [2025-10-03T22:17:33.524973] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-03T22:17:33.596708] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-03T22:17:33.974168] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-03T22:17:33.974306] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-03T22:17:33.975000] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-03T22:17:33.975096] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-03T22:17:33.986926] [DEBUG] [LOCAL ] VTMX: Trimmed 25819 records to 17716 (keeping 200 days of data) [2025-10-03T22:17:34.008612] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T22:17:34.136113] [DEBUG] [LOCAL ] VTMX: Primary data saved (17716 records). [2025-10-03T22:17:34.136300] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-03T22:17:34.136469] [INFO ] [MAIN ] Update Progress: 2257/2370 symbols completed. VTMX took 21.4s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-03T22:17:34.328287] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:34.390173] [DEBUG] [LOCAL ] VTR: Loaded 53197 existing records from primary storage. [2025-10-03T22:17:34.390521] [INFO ] [MAIN ] VTR: Loaded 53197 existing records. [2025-10-03T22:17:34.395830] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-03T22:17:34.589317] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:34.589726] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-03T22:17:34.589800] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-03T22:17:34.590159] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-03T22:17:34.590219] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-03T22:17:34.707208] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T22:17:35.038265] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:35.140967] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T22:17:35.190723] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-03T22:17:35.906856] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T22:17:35.990746] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-03T22:17:36.790708] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-03T22:17:37.590669] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-03T22:17:37.682222] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T22:17:38.401274] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-03T22:17:38.423367] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T22:17:38.678155] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T22:17:39.160673] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T22:17:39.190737] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-03T22:17:39.990708] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-03T22:17:40.552294] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T22:17:40.555555] [INFO ] [REMOTE ] VTLE: Full fetch complete (68958 records). [2025-10-03T22:17:40.555754] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-03T22:17:40.795858] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-03T22:17:41.010089] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-03T22:17:41.010193] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-03T22:17:41.011450] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-03T22:17:41.011525] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-03T22:17:41.013236] [DEBUG] [LOCAL ] VTLE: Trimmed 68958 records to 49133 (keeping 200 days of data) [2025-10-03T22:17:41.327667] [DEBUG] [LOCAL ] VTLE: Primary data saved (49133 records). [2025-10-03T22:17:41.327859] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-03T22:17:41.328034] [INFO ] [MAIN ] Update Progress: 2258/2370 symbols completed. VTLE took 46.4s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-03T22:17:41.521473] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:41.556437] [DEBUG] [LOCAL ] VTS: Loaded 30733 existing records from primary storage. [2025-10-03T22:17:41.556802] [INFO ] [MAIN ] VTS: Loaded 30733 existing records. [2025-10-03T22:17:41.591926] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-03T22:17:41.769498] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:41.770046] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-03T22:17:41.770216] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-03T22:17:41.780953] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-03T22:17:41.797557] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-03T22:17:41.879898] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T22:17:42.228188] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T22:17:42.246409] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T22:17:42.282026] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:42.390718] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-03T22:17:43.190674] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-03T22:17:43.568636] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T22:17:43.962260] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T22:17:43.990706] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-03T22:17:44.493732] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T22:17:44.495288] [INFO ] [REMOTE ] VTN: Full fetch complete (11285 records). [2025-10-03T22:17:44.495364] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-03T22:17:44.795946] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-03T22:17:44.895115] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-03T22:17:44.895197] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-03T22:17:44.895512] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-03T22:17:44.895575] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-03T22:17:44.896104] [DEBUG] [LOCAL ] VTN: Trimmed 11285 records to 7110 (keeping 200 days of data) [2025-10-03T22:17:44.940665] [DEBUG] [LOCAL ] VTN: Primary data saved (7110 records). [2025-10-03T22:17:44.940814] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-03T22:17:44.940917] [INFO ] [MAIN ] Update Progress: 2259/2370 symbols completed. VTN took 30.6s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-03T22:17:45.132572] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:45.177188] [DEBUG] [LOCAL ] VVR: Loaded 31541 existing records from primary storage. [2025-10-03T22:17:45.177478] [INFO ] [MAIN ] VVR: Loaded 31541 existing records. [2025-10-03T22:17:45.360797] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:45.361055] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-03T22:17:45.361107] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-03T22:17:45.361329] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-03T22:17:45.361389] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-03T22:17:45.600793] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-03T22:17:45.752444] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:46.045097] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T22:17:46.390700] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-03T22:17:46.739402] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T22:17:47.190723] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-03T22:17:47.616917] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T22:17:47.990697] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-03T22:17:48.790724] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-03T22:17:48.957013] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T22:17:49.024984] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T22:17:49.590681] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-03T22:17:49.826011] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T22:17:50.324627] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T22:17:50.390703] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-03T22:17:51.190769] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-03T22:17:51.812706] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T22:17:51.990707] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-03T22:17:52.198087] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T22:17:52.790692] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-03T22:17:53.221825] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T22:17:53.590721] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-03T22:17:53.824765] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T22:17:54.390702] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-03T22:17:55.190707] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-03T22:17:55.260110] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T22:17:55.418157] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T22:17:55.990762] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-03T22:17:56.575014] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T22:17:56.790751] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-03T22:17:57.002145] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T22:17:57.590727] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-03T22:17:58.130990] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T22:17:58.283939] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T22:17:58.285183] [INFO ] [REMOTE ] VTOL: Full fetch complete (26025 records). [2025-10-03T22:17:58.285259] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-03T22:17:58.395453] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-03T22:17:58.701434] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-03T22:17:58.701545] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-03T22:17:58.702233] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-03T22:17:58.702319] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-03T22:17:58.703580] [DEBUG] [LOCAL ] VTOL: Trimmed 26025 records to 19778 (keeping 200 days of data) [2025-10-03T22:17:58.825473] [DEBUG] [LOCAL ] VTOL: Primary data saved (19778 records). [2025-10-03T22:17:58.825662] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-03T22:17:58.825780] [INFO ] [MAIN ] Update Progress: 2260/2370 symbols completed. VTOL took 36.9s. Estimated remaining: 15m 28s. Rate: 7.1 symbols/min [2025-10-03T22:17:59.024032] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:17:59.190741] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-03T22:17:59.248509] [DEBUG] [LOCAL ] VVV: Loaded 50522 existing records from primary storage. [2025-10-03T22:17:59.248959] [INFO ] [MAIN ] VVV: Loaded 50522 existing records. [2025-10-03T22:17:59.449521] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:17:59.449818] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-03T22:17:59.449878] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-03T22:17:59.450175] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-03T22:17:59.450280] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-03T22:17:59.820229] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:17:59.990765] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-03T22:18:00.259145] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T22:18:00.592396] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T22:18:00.790773] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-03T22:18:01.401526] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T22:18:01.590750] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-03T22:18:02.087245] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T22:18:02.390738] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-03T22:18:03.190681] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-03T22:18:03.318534] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T22:18:03.866860] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T22:18:03.990725] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-03T22:18:04.548599] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T22:18:04.790825] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-03T22:18:04.803709] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T22:18:05.590699] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-03T22:18:06.390625] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-03T22:18:06.708881] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T22:18:06.963595] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T22:18:07.190736] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-03T22:18:07.674742] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T22:18:07.990732] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-03T22:18:08.560799] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T22:18:08.790734] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-03T22:18:09.590740] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-03T22:18:09.825103] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T22:18:10.390624] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-03T22:18:10.425843] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T22:18:10.593381] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T22:18:10.595421] [INFO ] [REMOTE ] VTS: Full fetch complete (41524 records). [2025-10-03T22:18:10.595590] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-03T22:18:10.993530] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-03T22:18:10.993617] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-03T22:18:10.994659] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-03T22:18:10.994729] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-03T22:18:10.995776] [DEBUG] [LOCAL ] VTS: Trimmed 41524 records to 30893 (keeping 200 days of data) [2025-10-03T22:18:11.190896] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-03T22:18:11.196829] [DEBUG] [LOCAL ] VTS: Primary data saved (30893 records). [2025-10-03T22:18:11.196984] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-03T22:18:11.197182] [INFO ] [MAIN ] Update Progress: 2261/2370 symbols completed. VTS took 29.9s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-03T22:18:11.383330] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:11.407190] [DEBUG] [LOCAL ] VVX: Loaded 23279 existing records from primary storage. [2025-10-03T22:18:11.407595] [INFO ] [MAIN ] VVX: Loaded 23279 existing records. [2025-10-03T22:18:11.609077] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:11.609542] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-03T22:18:11.609637] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-03T22:18:11.609953] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-03T22:18:11.610014] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-03T22:18:11.990675] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-03T22:18:12.012732] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:12.054432] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T22:18:12.084787] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T22:18:12.790752] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-03T22:18:13.590711] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-03T22:18:13.759634] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T22:18:13.812930] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T22:18:14.390730] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-03T22:18:15.190706] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-03T22:18:15.286408] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T22:18:15.864303] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T22:18:15.990698] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-03T22:18:16.379711] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T22:18:16.790730] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-03T22:18:17.162420] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:18:17.164824] [INFO ] [REMOTE ] VVR: Full fetch complete (46551 records). [2025-10-03T22:18:17.164956] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-03T22:18:17.584461] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-03T22:18:17.584556] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-03T22:18:17.585577] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-03T22:18:17.585668] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-03T22:18:17.586984] [DEBUG] [LOCAL ] VVR: Trimmed 46551 records to 31896 (keeping 200 days of data) [2025-10-03T22:18:17.590757] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-03T22:18:17.802144] [DEBUG] [LOCAL ] VVR: Primary data saved (31896 records). [2025-10-03T22:18:17.802312] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-03T22:18:17.802439] [INFO ] [MAIN ] Update Progress: 2262/2370 symbols completed. VVR took 32.9s. Estimated remaining: 15m 12s. Rate: 7.1 symbols/min [2025-10-03T22:18:17.994861] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:18.045844] [DEBUG] [LOCAL ] VYX: Loaded 49071 existing records from primary storage. [2025-10-03T22:18:18.046215] [INFO ] [MAIN ] VYX: Loaded 49071 existing records. [2025-10-03T22:18:18.247492] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:18.247739] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-03T22:18:18.247796] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-03T22:18:18.248439] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-03T22:18:18.248515] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-03T22:18:18.407496] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-03T22:18:18.651675] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:18.686084] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T22:18:19.147015] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T22:18:19.190705] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-03T22:18:19.548386] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T22:18:19.990716] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-03T22:18:20.790690] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-03T22:18:20.860236] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T22:18:20.918997] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T22:18:21.590687] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-03T22:18:22.386921] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T22:18:22.396470] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-03T22:18:22.736927] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T22:18:23.190709] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-03T22:18:23.598916] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T22:18:23.642108] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:18:23.644904] [INFO ] [REMOTE ] VTR: Full fetch complete (76360 records). [2025-10-03T22:18:23.645040] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-03T22:18:23.995837] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-03T22:18:24.084434] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-03T22:18:24.084539] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-03T22:18:24.086064] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-03T22:18:24.086139] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-03T22:18:24.087857] [DEBUG] [LOCAL ] VTR: Trimmed 76360 records to 53582 (keeping 200 days of data) [2025-10-03T22:18:24.437994] [DEBUG] [LOCAL ] VTR: Primary data saved (53582 records). [2025-10-03T22:18:24.438184] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-03T22:18:24.438337] [INFO ] [MAIN ] Update Progress: 2263/2370 symbols completed. VTR took 50.3s. Estimated remaining: 15m 3s. Rate: 7.1 symbols/min [2025-10-03T22:18:24.629995] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:24.691889] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-03T22:18:24.692272] [INFO ] [MAIN ] VZ: Loaded 54181 existing records. [2025-10-03T22:18:24.795813] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-03T22:18:24.905169] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:24.905444] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-03T22:18:24.905528] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-03T22:18:24.905889] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-03T22:18:24.905969] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-03T22:18:25.301115] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:25.590676] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-03T22:18:25.702217] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T22:18:25.941341] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T22:18:26.390758] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-03T22:18:26.999095] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T22:18:27.190703] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-03T22:18:27.990678] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-03T22:18:28.063879] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T22:18:28.064847] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T22:18:28.790722] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-03T22:18:29.590713] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-03T22:18:29.627071] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T22:18:30.390675] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-03T22:18:30.688513] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T22:18:30.764098] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T22:18:31.190703] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-03T22:18:31.711478] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T22:18:31.990756] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-03T22:18:32.790704] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-03T22:18:32.879378] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T22:18:33.279585] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T22:18:33.282306] [INFO ] [REMOTE ] VVV: Full fetch complete (72352 records). [2025-10-03T22:18:33.282426] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-03T22:18:33.595759] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-03T22:18:33.766324] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T22:18:33.770431] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-03T22:18:33.775527] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-03T22:18:33.777794] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-03T22:18:33.777885] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-03T22:18:33.779730] [DEBUG] [LOCAL ] VVV: Trimmed 72352 records to 50880 (keeping 200 days of data) [2025-10-03T22:18:34.089743] [DEBUG] [LOCAL ] VVV: Primary data saved (50880 records). [2025-10-03T22:18:34.089914] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-03T22:18:34.091177] [INFO ] [MAIN ] Update Progress: 2264/2370 symbols completed. VVV took 35.3s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-03T22:18:34.269696] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:34.331472] [DEBUG] [LOCAL ] W: Loaded 53851 existing records from primary storage. [2025-10-03T22:18:34.331851] [INFO ] [MAIN ] W: Loaded 53851 existing records. [2025-10-03T22:18:34.399316] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-03T22:18:34.532841] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:34.533162] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-03T22:18:34.533241] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-03T22:18:34.533559] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-03T22:18:34.533620] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-03T22:18:34.926414] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:35.190696] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-03T22:18:35.329922] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T22:18:35.490988] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T22:18:35.990686] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-03T22:18:36.790708] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-03T22:18:37.258183] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T22:18:37.323092] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T22:18:37.590710] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-03T22:18:38.390710] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-03T22:18:38.426223] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T22:18:38.427763] [INFO ] [REMOTE ] VVX: Full fetch complete (33505 records). [2025-10-03T22:18:38.427851] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-03T22:18:38.888304] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-03T22:18:38.888474] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-03T22:18:38.889349] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-03T22:18:38.889446] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-03T22:18:38.892994] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T22:18:38.906464] [DEBUG] [LOCAL ] VVX: Trimmed 33505 records to 23447 (keeping 200 days of data) [2025-10-03T22:18:39.046929] [DEBUG] [LOCAL ] VVX: Primary data saved (23447 records). [2025-10-03T22:18:39.047068] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-03T22:18:39.047192] [INFO ] [MAIN ] Update Progress: 2265/2370 symbols completed. VVX took 27.8s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-03T22:18:39.197686] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-03T22:18:39.236024] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:39.285441] [DEBUG] [LOCAL ] WAB: Loaded 44385 existing records from primary storage. [2025-10-03T22:18:39.285820] [INFO ] [MAIN ] WAB: Loaded 44385 existing records. [2025-10-03T22:18:39.477870] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:39.482103] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-03T22:18:39.482162] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-03T22:18:39.482395] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-03T22:18:39.482455] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-03T22:18:39.856797] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:39.992178] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-03T22:18:39.996884] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T22:18:40.790684] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-03T22:18:41.412841] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-03T22:18:41.590632] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-03T22:18:41.855439] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T22:18:42.180255] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T22:18:42.390687] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-03T22:18:43.190716] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-03T22:18:43.990738] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-03T22:18:44.069353] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T22:18:44.102764] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T22:18:44.525028] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T22:18:44.790682] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-03T22:18:45.590682] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-03T22:18:45.754220] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T22:18:46.390716] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-03T22:18:46.468727] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T22:18:47.190696] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-03T22:18:47.990672] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-03T22:18:48.071710] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-03T22:18:48.142142] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T22:18:48.209458] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T22:18:48.213076] [INFO ] [REMOTE ] VYX: Full fetch complete (70214 records). [2025-10-03T22:18:48.213199] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-03T22:18:48.634874] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-03T22:18:48.635000] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-03T22:18:48.636445] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-03T22:18:48.636513] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-03T22:18:48.638471] [DEBUG] [LOCAL ] VYX: Trimmed 70214 records to 49397 (keeping 200 days of data) [2025-10-03T22:18:48.811136] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-03T22:18:48.949691] [DEBUG] [LOCAL ] VYX: Primary data saved (49397 records). [2025-10-03T22:18:48.949858] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-03T22:18:48.949979] [INFO ] [MAIN ] Update Progress: 2266/2370 symbols completed. VYX took 31.1s. Estimated remaining: 14m 38s. Rate: 7.1 symbols/min [2025-10-03T22:18:49.189462] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:18:49.232912] [DEBUG] [LOCAL ] WAL: Loaded 45569 existing records from primary storage. [2025-10-03T22:18:49.233375] [INFO ] [MAIN ] WAL: Loaded 45569 existing records. [2025-10-03T22:18:49.434973] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:18:49.435305] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-03T22:18:49.435375] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-03T22:18:49.435586] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-03T22:18:49.435704] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-03T22:18:49.593371] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-03T22:18:49.820161] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:18:49.850216] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T22:18:50.390687] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-03T22:18:51.190722] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-03T22:18:51.360723] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-03T22:18:51.440619] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T22:18:51.990671] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-03T22:18:52.026152] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T22:18:52.791020] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-03T22:18:52.790894] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T22:18:53.590706] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-03T22:18:54.077094] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T22:18:54.390638] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-03T22:18:54.485374] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T22:18:55.190676] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-03T22:18:55.290459] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T22:18:55.990717] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-03T22:18:56.452387] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T22:18:56.790741] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-03T22:18:57.270321] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T22:18:57.590668] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-03T22:18:57.636154] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T22:18:58.390639] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-03T22:18:58.517068] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T22:18:59.190682] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-03T22:18:59.423996] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T22:18:59.990721] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-03T22:19:00.637485] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-03T22:19:00.790687] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-03T22:19:01.030888] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T22:19:01.590699] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-03T22:19:01.906708] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T22:19:02.390733] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-03T22:19:02.966813] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T22:19:03.118775] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T22:19:03.190636] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-03T22:19:03.632157] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T22:19:03.634728] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-03T22:19:03.634858] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-03T22:19:04.004337] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-03T22:19:04.068792] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-03T22:19:04.068921] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-03T22:19:04.070346] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-03T22:19:04.070783] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-03T22:19:04.072852] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54571 (keeping 200 days of data) [2025-10-03T22:19:04.192414] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T22:19:04.457927] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-10-03T22:19:04.458109] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-03T22:19:04.458246] [INFO ] [MAIN ] Update Progress: 2267/2370 symbols completed. VZ took 40.0s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-03T22:19:04.636219] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:04.676060] [DEBUG] [LOCAL ] WAT: Loaded 35539 existing records from primary storage. [2025-10-03T22:19:04.676421] [INFO ] [MAIN ] WAT: Loaded 35539 existing records. [2025-10-03T22:19:04.795821] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-03T22:19:04.871701] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:04.871974] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-03T22:19:04.872043] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-03T22:19:04.872321] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-03T22:19:04.872381] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-03T22:19:05.243045] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:05.590684] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-03T22:19:06.120698] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T22:19:06.390702] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-03T22:19:06.663480] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T22:19:07.190710] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-03T22:19:07.239754] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T22:19:07.953417] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T22:19:07.990696] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-03T22:19:08.497724] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T22:19:08.790739] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-03T22:19:09.590714] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-03T22:19:09.798177] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T22:19:10.371974] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T22:19:10.390638] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-03T22:19:11.046450] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T22:19:11.190694] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-03T22:19:11.990637] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-03T22:19:12.248430] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T22:19:12.708835] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T22:19:12.711397] [INFO ] [REMOTE ] W: Full fetch complete (77393 records). [2025-10-03T22:19:12.711517] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-03T22:19:12.797913] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-03T22:19:13.159506] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-03T22:19:13.159614] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-03T22:19:13.161334] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-03T22:19:13.161470] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-03T22:19:13.163353] [DEBUG] [LOCAL ] W: Trimmed 77393 records to 54229 (keeping 200 days of data) [2025-10-03T22:19:13.508416] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T22:19:13.545292] [DEBUG] [LOCAL ] W: Primary data saved (54229 records). [2025-10-03T22:19:13.545530] [INFO ] [MAIN ] W: Full history saved. [2025-10-03T22:19:13.546396] [INFO ] [MAIN ] Update Progress: 2268/2370 symbols completed. W took 39.5s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-03T22:19:13.601390] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-03T22:19:13.721785] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:13.722077] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-03T22:19:13.722134] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-03T22:19:13.722258] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-03T22:19:13.722301] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-03T22:19:13.722342] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-03T22:19:13.722375] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-03T22:19:14.087078] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:14.390797] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-03T22:19:14.599875] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T22:19:14.625247] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:19:14.625848] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-03T22:19:14.626029] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:19:14.626139] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-03T22:19:14.627279] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:19:14.627420] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-03T22:19:14.627521] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-03T22:19:14.627611] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-03T22:19:14.627907] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-03T22:19:14.628056] [INFO ] [MAIN ] Update Progress: 2269/2370 symbols completed. WBI took 1.1s. Estimated remaining: 14m 12s. Rate: 7.1 symbols/min [2025-10-03T22:19:14.920744] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:14.987746] [DEBUG] [LOCAL ] WBS: Loaded 49050 existing records from primary storage. [2025-10-03T22:19:14.988377] [INFO ] [MAIN ] WBS: Loaded 49050 existing records. [2025-10-03T22:19:15.195233] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-03T22:19:15.288503] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:15.289134] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-03T22:19:15.289248] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-03T22:19:15.290274] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-03T22:19:15.290402] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-03T22:19:15.579781] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T22:19:15.845765] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:15.990713] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-03T22:19:16.360396] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T22:19:16.790698] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-03T22:19:17.159830] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T22:19:17.162523] [INFO ] [REMOTE ] WAB: Full fetch complete (64330 records). [2025-10-03T22:19:17.162751] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-03T22:19:17.606636] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-03T22:19:17.632033] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-03T22:19:17.632272] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-03T22:19:17.633735] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-03T22:19:17.634151] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-03T22:19:17.636123] [DEBUG] [LOCAL ] WAB: Trimmed 64330 records to 44708 (keeping 200 days of data) [2025-10-03T22:19:17.761348] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T22:19:17.977857] [DEBUG] [LOCAL ] WAB: Primary data saved (44708 records). [2025-10-03T22:19:17.978040] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-03T22:19:17.978175] [INFO ] [MAIN ] Update Progress: 2270/2370 symbols completed. WAB took 38.9s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-03T22:19:18.168953] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:18.183915] [DEBUG] [LOCAL ] WBX: Loaded 11609 existing records from primary storage. [2025-10-03T22:19:18.184188] [INFO ] [MAIN ] WBX: Loaded 11609 existing records. [2025-10-03T22:19:18.374169] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:18.374539] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-03T22:19:18.374595] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-03T22:19:18.374813] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-03T22:19:18.374874] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-03T22:19:18.402792] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-03T22:19:18.768137] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:19.190717] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-03T22:19:19.366703] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T22:19:19.825562] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T22:19:19.990746] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-03T22:19:20.708368] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T22:19:20.790694] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-03T22:19:21.590743] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-03T22:19:21.629045] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T22:19:22.266622] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T22:19:22.390755] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-03T22:19:23.108478] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T22:19:23.190697] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-03T22:19:23.646443] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T22:19:23.990687] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-03T22:19:24.412443] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T22:19:24.790631] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-03T22:19:25.490696] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T22:19:25.590733] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-03T22:19:26.133770] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T22:19:26.136203] [INFO ] [REMOTE ] WAL: Full fetch complete (66639 records). [2025-10-03T22:19:26.136334] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-03T22:19:26.403080] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-03T22:19:26.550971] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-03T22:19:26.551057] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-03T22:19:26.552305] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-03T22:19:26.552380] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-03T22:19:26.553842] [DEBUG] [LOCAL ] WAL: Trimmed 66639 records to 45880 (keeping 200 days of data) [2025-10-03T22:19:26.863568] [DEBUG] [LOCAL ] WAL: Primary data saved (45880 records). [2025-10-03T22:19:26.863746] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-03T22:19:26.863911] [INFO ] [MAIN ] Update Progress: 2271/2370 symbols completed. WAL took 37.9s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-03T22:19:27.049639] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:27.089342] [DEBUG] [LOCAL ] WCC: Loaded 39818 existing records from primary storage. [2025-10-03T22:19:27.089676] [INFO ] [MAIN ] WCC: Loaded 39818 existing records. [2025-10-03T22:19:27.197949] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-03T22:19:27.291074] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:27.291529] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-03T22:19:27.291811] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-03T22:19:27.292106] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-03T22:19:27.292187] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-03T22:19:27.447037] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T22:19:27.509137] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T22:19:27.748002] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:27.990690] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-03T22:19:28.790692] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-03T22:19:29.077892] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T22:19:29.225080] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T22:19:29.590728] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-03T22:19:30.107825] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T22:19:30.390725] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-03T22:19:31.100857] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T22:19:31.190693] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-03T22:19:31.401079] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T22:19:31.990718] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-03T22:19:32.726804] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T22:19:32.790752] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-03T22:19:33.590749] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-03T22:19:33.668617] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T22:19:34.008323] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T22:19:34.390719] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-03T22:19:34.941328] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T22:19:35.190704] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-03T22:19:35.842910] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T22:19:35.996767] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-03T22:19:36.011533] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T22:19:36.790705] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-03T22:19:37.521093] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T22:19:37.590623] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-03T22:19:37.731967] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-03T22:19:37.734599] [INFO ] [REMOTE ] WAT: Full fetch complete (50286 records). [2025-10-03T22:19:37.734717] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-03T22:19:38.140038] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-03T22:19:38.140219] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-03T22:19:38.141920] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-03T22:19:38.142054] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-03T22:19:38.143428] [DEBUG] [LOCAL ] WAT: Trimmed 50286 records to 35845 (keeping 200 days of data) [2025-10-03T22:19:38.270993] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T22:19:38.390905] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-03T22:19:38.420444] [DEBUG] [LOCAL ] WAT: Primary data saved (35845 records). [2025-10-03T22:19:38.420704] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-03T22:19:38.420853] [INFO ] [MAIN ] Update Progress: 2272/2370 symbols completed. WAT took 34.0s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-03T22:19:38.603821] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:38.660887] [DEBUG] [LOCAL ] WCN: Loaded 48313 existing records from primary storage. [2025-10-03T22:19:38.661332] [INFO ] [MAIN ] WCN: Loaded 48313 existing records. [2025-10-03T22:19:38.850722] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:38.850953] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-03T22:19:38.851007] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-03T22:19:38.851278] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-03T22:19:38.851340] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-03T22:19:39.195758] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-03T22:19:39.225662] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:39.476460] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T22:19:39.990710] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-03T22:19:40.790733] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-03T22:19:41.060440] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T22:19:41.590769] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-03T22:19:41.714518] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T22:19:42.231965] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T22:19:42.390732] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-03T22:19:42.505401] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T22:19:43.190708] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-03T22:19:43.990730] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-03T22:19:44.031031] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T22:19:44.569903] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T22:19:44.790706] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-03T22:19:44.884614] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T22:19:45.590740] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-03T22:19:46.145403] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T22:19:46.390732] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-03T22:19:47.190690] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-03T22:19:47.229442] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T22:19:47.790674] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T22:19:47.990737] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-03T22:19:48.790743] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-03T22:19:48.829602] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T22:19:49.515792] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T22:19:49.590684] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-03T22:19:50.236749] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T22:19:50.390702] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-03T22:19:51.094077] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T22:19:51.190721] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-03T22:19:51.990674] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-03T22:19:52.189056] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T22:19:52.801932] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-03T22:19:52.808727] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T22:19:53.175626] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T22:19:53.177779] [INFO ] [REMOTE ] WCC: Full fetch complete (57737 records). [2025-10-03T22:19:53.177885] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-03T22:19:53.562847] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-03T22:19:53.562956] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-03T22:19:53.564631] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-03T22:19:53.564718] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-03T22:19:53.566264] [DEBUG] [LOCAL ] WCC: Trimmed 57737 records to 40042 (keeping 200 days of data) [2025-10-03T22:19:53.625283] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-03T22:19:53.843327] [DEBUG] [LOCAL ] WCC: Primary data saved (40042 records). [2025-10-03T22:19:53.843510] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-03T22:19:53.843626] [INFO ] [MAIN ] Update Progress: 2273/2370 symbols completed. WCC took 27.0s. Estimated remaining: 13m 39s. Rate: 7.1 symbols/min [2025-10-03T22:19:54.035989] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:54.060083] [DEBUG] [LOCAL ] WD: Loaded 23350 existing records from primary storage. [2025-10-03T22:19:54.060440] [INFO ] [MAIN ] WD: Loaded 23350 existing records. [2025-10-03T22:19:54.258198] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:54.258744] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-03T22:19:54.258864] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-03T22:19:54.259217] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-03T22:19:54.259284] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-03T22:19:54.395806] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-03T22:19:54.699459] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:54.732015] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T22:19:55.066270] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T22:19:55.069166] [INFO ] [REMOTE ] WBS: Full fetch complete (69710 records). [2025-10-03T22:19:55.069270] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-03T22:19:55.195889] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-03T22:19:55.237318] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T22:19:55.494756] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-03T22:19:55.494870] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-03T22:19:55.497092] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-03T22:19:55.497195] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-03T22:19:55.499206] [DEBUG] [LOCAL ] WBS: Trimmed 69710 records to 49413 (keeping 200 days of data) [2025-10-03T22:19:55.828942] [DEBUG] [LOCAL ] WBS: Primary data saved (49413 records). [2025-10-03T22:19:55.829278] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-03T22:19:55.830462] [INFO ] [MAIN ] Update Progress: 2274/2370 symbols completed. WBS took 41.2s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-03T22:19:55.999776] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-03T22:19:56.002344] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:56.025915] [DEBUG] [LOCAL ] WDH: Loaded 17649 existing records from primary storage. [2025-10-03T22:19:56.026232] [INFO ] [MAIN ] WDH: Loaded 17649 existing records. [2025-10-03T22:19:56.225172] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:56.225470] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-03T22:19:56.225542] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-03T22:19:56.225870] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-03T22:19:56.225934] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-03T22:19:56.348831] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T22:19:56.528805] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T22:19:56.567099] [INFO ] [REMOTE ] WBX: Full fetch complete (24510 records). [2025-10-03T22:19:56.569937] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-03T22:19:56.772882] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:56.795759] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-03T22:19:57.071905] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-03T22:19:57.072093] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-03T22:19:57.073459] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-03T22:19:57.073541] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-03T22:19:57.074383] [DEBUG] [LOCAL ] WBX: Trimmed 24510 records to 11679 (keeping 200 days of data) [2025-10-03T22:19:57.146561] [DEBUG] [LOCAL ] WBX: Primary data saved (11679 records). [2025-10-03T22:19:57.146760] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-03T22:19:57.146996] [INFO ] [MAIN ] Update Progress: 2275/2370 symbols completed. WBX took 39.2s. Estimated remaining: 13m 21s. Rate: 7.1 symbols/min [2025-10-03T22:19:57.327786] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:19:57.354135] [DEBUG] [LOCAL ] WDI: Loaded 21232 existing records from primary storage. [2025-10-03T22:19:57.354440] [INFO ] [MAIN ] WDI: Loaded 21232 existing records. [2025-10-03T22:19:57.530118] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:19:57.530423] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-03T22:19:57.530484] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-03T22:19:57.530840] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-03T22:19:57.530900] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-03T22:19:57.594368] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-03T22:19:57.954428] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:19:57.968276] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T22:19:58.390674] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-03T22:19:58.620407] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T22:19:59.190701] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-03T22:19:59.993804] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-03T22:19:59.997711] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T22:20:00.388350] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T22:20:00.778194] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T22:20:00.790638] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-03T22:20:01.590770] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-03T22:20:01.956076] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T22:20:02.390754] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-03T22:20:02.452163] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T22:20:03.190803] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-03T22:20:03.337538] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T22:20:03.990737] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-03T22:20:04.339284] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T22:20:04.790697] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-03T22:20:04.820301] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T22:20:05.590732] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-03T22:20:06.390698] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-03T22:20:06.554333] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T22:20:06.848802] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T22:20:07.067069] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T22:20:07.190728] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-03T22:20:07.990742] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-03T22:20:08.256438] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T22:20:08.790673] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-03T22:20:08.876286] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T22:20:09.590741] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-03T22:20:09.779854] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T22:20:10.390702] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-03T22:20:10.552782] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T22:20:11.190749] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-03T22:20:11.995919] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-03T22:20:12.001763] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T22:20:12.250164] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T22:20:12.790858] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-03T22:20:12.983916] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T22:20:13.590732] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-03T22:20:13.656710] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T22:20:14.390841] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-03T22:20:14.666494] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T22:20:15.166877] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T22:20:15.190619] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-03T22:20:15.990673] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-03T22:20:16.062910] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T22:20:16.790745] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-03T22:20:16.804192] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T22:20:16.806551] [INFO ] [REMOTE ] WD: Full fetch complete (33286 records). [2025-10-03T22:20:16.806733] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-03T22:20:17.203056] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-03T22:20:17.203143] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-03T22:20:17.203968] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-03T22:20:17.204035] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-03T22:20:17.204902] [DEBUG] [LOCAL ] WD: Trimmed 33286 records to 23496 (keeping 200 days of data) [2025-10-03T22:20:17.356046] [DEBUG] [LOCAL ] WD: Primary data saved (23496 records). [2025-10-03T22:20:17.356221] [INFO ] [MAIN ] WD: Full history saved. [2025-10-03T22:20:17.356318] [INFO ] [MAIN ] Update Progress: 2276/2370 symbols completed. WD took 23.5s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-03T22:20:17.537917] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:17.590634] [DEBUG] [LOCAL ] WDS: Loaded 43591 existing records from primary storage. [2025-10-03T22:20:17.590795] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-03T22:20:17.592559] [INFO ] [MAIN ] WDS: Loaded 43591 existing records. [2025-10-03T22:20:17.792269] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:17.792551] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-03T22:20:17.792605] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-03T22:20:17.792920] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-03T22:20:17.793192] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-03T22:20:18.073074] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T22:20:18.209542] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:18.390736] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-03T22:20:19.190639] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-03T22:20:19.416558] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T22:20:19.442381] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T22:20:19.927419] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T22:20:19.990734] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-03T22:20:20.790724] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-03T22:20:21.590721] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-03T22:20:21.680850] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T22:20:21.861337] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T22:20:22.390744] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-03T22:20:22.659385] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T22:20:23.190707] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-03T22:20:23.768260] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T22:20:23.773722] [INFO ] [REMOTE ] WCN: Full fetch complete (69392 records). [2025-10-03T22:20:23.773895] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-03T22:20:23.995810] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-03T22:20:24.218409] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-03T22:20:24.218672] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-03T22:20:24.220006] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-03T22:20:24.220122] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-03T22:20:24.221625] [DEBUG] [LOCAL ] WCN: Trimmed 69392 records to 48606 (keeping 200 days of data) [2025-10-03T22:20:24.370821] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T22:20:24.573442] [DEBUG] [LOCAL ] WCN: Primary data saved (48606 records). [2025-10-03T22:20:24.573602] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-03T22:20:24.573795] [INFO ] [MAIN ] Update Progress: 2277/2370 symbols completed. WCN took 46.2s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-03T22:20:24.790731] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-03T22:20:25.590710] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-03T22:20:25.763970] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T22:20:25.931811] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T22:20:25.933448] [INFO ] [REMOTE ] WDH: Full fetch complete (23537 records). [2025-10-03T22:20:25.933527] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-03T22:20:26.335079] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-03T22:20:26.335168] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-03T22:20:26.335853] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-03T22:20:26.335921] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-03T22:20:26.336725] [DEBUG] [LOCAL ] WDH: Trimmed 23537 records to 17937 (keeping 200 days of data) [2025-10-03T22:20:26.393285] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-03T22:20:26.451995] [DEBUG] [LOCAL ] WDH: Primary data saved (17937 records). [2025-10-03T22:20:26.452153] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-03T22:20:26.452262] [INFO ] [MAIN ] Update Progress: 2278/2370 symbols completed. WDH took 30.6s. Estimated remaining: 12m 56s. Rate: 7.1 symbols/min [2025-10-03T22:20:26.501135] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T22:20:27.190723] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-03T22:20:27.871188] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T22:20:27.990699] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-03T22:20:28.248733] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T22:20:28.790721] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-03T22:20:29.696504] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T22:20:29.698049] [INFO ] [REMOTE ] WDI: Full fetch complete (30872 records). [2025-10-03T22:20:29.698168] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-03T22:20:30.062530] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T22:20:30.142503] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-03T22:20:30.175809] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-03T22:20:30.175887] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-03T22:20:30.176626] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-03T22:20:30.176729] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-03T22:20:30.178302] [DEBUG] [LOCAL ] WDI: Trimmed 30872 records to 21410 (keeping 200 days of data) [2025-10-03T22:20:30.319170] [DEBUG] [LOCAL ] WDI: Primary data saved (21410 records). [2025-10-03T22:20:30.319312] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-03T22:20:30.319424] [INFO ] [MAIN ] Update Progress: 2279/2370 symbols completed. WDI took 33.2s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-03T22:20:32.035993] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T22:20:32.046366] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-03T22:20:33.689725] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T22:20:33.699973] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-03T22:20:35.335178] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T22:20:35.345458] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-03T22:20:36.980050] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T22:20:36.990035] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-03T22:20:38.539746] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T22:20:38.549224] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-03T22:20:40.240544] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T22:20:40.250467] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-03T22:20:41.408551] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T22:20:41.410846] [INFO ] [REMOTE ] WDS: Full fetch complete (64459 records). [2025-10-03T22:20:41.410966] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-03T22:20:41.857266] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-03T22:20:41.857385] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-03T22:20:41.858729] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-03T22:20:41.858804] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-03T22:20:41.863478] [DEBUG] [LOCAL ] WDS: Trimmed 64459 records to 43883 (keeping 200 days of data) [2025-10-03T22:20:42.158011] [DEBUG] [LOCAL ] WDS: Primary data saved (43883 records). [2025-10-03T22:20:42.158187] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-03T22:20:42.158298] [INFO ] [MAIN ] Update Progress: 2280/2370 symbols completed. WDS took 24.8s. Estimated remaining: 12m 39s. Rate: 7.1 symbols/min [2025-10-03T22:20:42.878330] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:42.843322] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:42.921755] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:42.943537] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:42.957422] [DEBUG] [LOCAL ] WEA: Loaded 7309 existing records from primary storage. [2025-10-03T22:20:42.957928] [INFO ] [MAIN ] WEA: Loaded 7309 existing records. [2025-10-03T22:20:43.235797] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:43.252771] [DEBUG] [LOCAL ] WEAV: Loaded 42221 existing records from primary storage. [2025-10-03T22:20:43.253092] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-03T22:20:43.253317] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-03T22:20:43.254582] [INFO ] [MAIN ] WEAV: Loaded 42221 existing records. [2025-10-03T22:20:43.254302] [DEBUG] [LOCAL ] WELL: Loaded 52752 existing records from primary storage. [2025-10-03T22:20:43.260781] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-03T22:20:43.267228] [INFO ] [MAIN ] WELL: Loaded 52752 existing records. [2025-10-03T22:20:43.322989] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-03T22:20:43.323931] [DEBUG] [LOCAL ] WEC: Loaded 52569 existing records from primary storage. [2025-10-03T22:20:43.407269] [INFO ] [MAIN ] WEC: Loaded 52569 existing records. [2025-10-03T22:20:44.039082] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:44.055864] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-03T22:20:44.115104] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-03T22:20:44.114988] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:44.225963] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:44.226170] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-03T22:20:44.222430] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-03T22:20:44.231813] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-03T22:20:44.237123] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-03T22:20:44.254227] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-03T22:20:44.254144] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-03T22:20:44.281386] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-03T22:20:44.276085] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-03T22:20:44.432341] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-03T22:20:44.513470] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-03T22:20:44.650117] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:44.717975] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-03T22:20:45.352086] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:45.369901] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-03T22:20:45.531868] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:45.554943] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-03T22:20:45.604097] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:45.604486] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-03T22:20:45.692415] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T22:20:45.694707] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-03T22:20:46.304017] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T22:20:46.306027] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-03T22:20:46.900320] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T22:20:46.902770] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-03T22:20:46.931001] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T22:20:46.941290] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-03T22:20:47.313524] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-03T22:20:47.315514] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-03T22:20:47.395398] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:20:47.406949] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-03T22:20:47.442036] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T22:20:47.453183] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-03T22:20:47.988249] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T22:20:47.990382] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-03T22:20:48.422242] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T22:20:48.431452] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-03T22:20:48.761631] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T22:20:48.765012] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-03T22:20:48.900856] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T22:20:48.912304] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-03T22:20:49.205792] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T22:20:49.218019] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-03T22:20:49.491940] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T22:20:49.494884] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-03T22:20:49.878578] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T22:20:49.887612] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-03T22:20:50.280518] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T22:20:50.283851] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-03T22:20:50.577403] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T22:20:50.589112] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-03T22:20:50.664394] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T22:20:50.760728] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T22:20:51.034954] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T22:20:51.190723] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-03T22:20:51.990727] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-03T22:20:52.575728] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T22:20:52.713595] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T22:20:52.790744] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-03T22:20:53.508005] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T22:20:53.590768] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-03T22:20:53.813409] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T22:20:54.390752] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-03T22:20:55.190723] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-03T22:20:55.296254] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T22:20:55.658304] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T22:20:55.659210] [INFO ] [REMOTE ] WEA: Full fetch complete (9722 records). [2025-10-03T22:20:55.659285] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-03T22:20:55.998129] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-03T22:20:56.109542] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-03T22:20:56.109695] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-03T22:20:56.110096] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-03T22:20:56.110277] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-03T22:20:56.111297] [DEBUG] [LOCAL ] WEA: Trimmed 9722 records to 7325 (keeping 200 days of data) [2025-10-03T22:20:56.159257] [DEBUG] [LOCAL ] WEA: Primary data saved (7325 records). [2025-10-03T22:20:56.159403] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-03T22:20:56.159493] [INFO ] [MAIN ] Update Progress: 2281/2370 symbols completed. WEA took 14.0s. Estimated remaining: 12m 31s. Rate: 7.1 symbols/min [2025-10-03T22:20:56.348091] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:20:56.393988] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T22:20:56.441050] [DEBUG] [LOCAL ] WES: Loaded 48472 existing records from primary storage. [2025-10-03T22:20:56.441425] [INFO ] [MAIN ] WES: Loaded 48472 existing records. [2025-10-03T22:20:56.649586] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:20:56.649868] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-03T22:20:56.649919] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-03T22:20:56.650159] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-03T22:20:56.650220] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-03T22:20:56.806096] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-03T22:20:57.047567] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:20:57.297185] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T22:20:57.590704] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-03T22:20:58.390671] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-03T22:20:58.865821] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T22:20:59.058342] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:20:59.190724] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-03T22:20:59.990720] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-03T22:21:00.304843] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T22:21:00.790736] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-03T22:21:00.872249] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:21:01.547595] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T22:21:01.590740] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-03T22:21:02.304772] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T22:21:02.390742] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-03T22:21:03.190715] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-03T22:21:03.401490] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T22:21:03.919072] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T22:21:03.990718] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-03T22:21:04.790703] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-03T22:21:05.009907] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T22:21:05.590700] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-03T22:21:05.776080] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T22:21:06.046021] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T22:21:06.390728] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-03T22:21:07.190700] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-03T22:21:07.394610] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T22:21:07.831970] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T22:21:07.990727] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-03T22:21:08.790734] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-03T22:21:09.013887] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T22:21:09.590754] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-03T22:21:09.621293] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T22:21:10.085889] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T22:21:10.088718] [INFO ] [REMOTE ] WEAV: Full fetch complete (61589 records). [2025-10-03T22:21:10.088935] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-03T22:21:10.395889] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-03T22:21:10.521817] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-03T22:21:10.521911] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-03T22:21:10.523306] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-03T22:21:10.523388] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-03T22:21:10.525197] [DEBUG] [LOCAL ] WEAV: Trimmed 61589 records to 42548 (keeping 200 days of data) [2025-10-03T22:21:10.792177] [DEBUG] [LOCAL ] WEAV: Primary data saved (42548 records). [2025-10-03T22:21:10.792327] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-03T22:21:10.792428] [INFO ] [MAIN ] Update Progress: 2282/2370 symbols completed. WEAV took 28.6s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-03T22:21:10.984262] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:11.027171] [DEBUG] [LOCAL ] WEX: Loaded 34737 existing records from primary storage. [2025-10-03T22:21:11.027542] [INFO ] [MAIN ] WEX: Loaded 34737 existing records. [2025-10-03T22:21:11.192532] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-03T22:21:11.242104] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:11.242858] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-03T22:21:11.243017] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-03T22:21:11.243297] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-03T22:21:11.243356] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-03T22:21:11.633175] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:11.669442] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T22:21:11.990662] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-03T22:21:12.257365] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T22:21:12.592111] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T22:21:12.790719] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-03T22:21:13.027315] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T22:21:13.237588] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:21:13.240628] [INFO ] [REMOTE ] WELL: Full fetch complete (75750 records). [2025-10-03T22:21:13.240811] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-03T22:21:13.595873] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-03T22:21:13.676228] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-03T22:21:13.676343] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-03T22:21:13.677861] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-03T22:21:13.677958] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-03T22:21:13.679706] [DEBUG] [LOCAL ] WELL: Trimmed 75750 records to 53120 (keeping 200 days of data) [2025-10-03T22:21:14.024308] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T22:21:14.029989] [INFO ] [REMOTE ] WEC: Full fetch complete (75539 records). [2025-10-03T22:21:14.030750] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-03T22:21:14.396394] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-03T22:21:14.548396] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-03T22:21:14.551189] [DEBUG] [LOCAL ] WELL: Primary data saved (53120 records). [2025-10-03T22:21:14.551389] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-03T22:21:14.551525] [INFO ] [MAIN ] Update Progress: 2283/2370 symbols completed. WELL took 32.4s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-03T22:21:14.551628] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-03T22:21:14.553295] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-03T22:21:14.558662] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-03T22:21:14.670528] [DEBUG] [LOCAL ] WEC: Trimmed 75539 records to 52957 (keeping 200 days of data) [2025-10-03T22:21:14.841286] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:14.860684] [DEBUG] [LOCAL ] WF: Loaded 10768 existing records from primary storage. [2025-10-03T22:21:14.862061] [INFO ] [MAIN ] WF: Loaded 10768 existing records. [2025-10-03T22:21:15.066842] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:15.067835] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-03T22:21:15.068517] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-03T22:21:15.071132] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-03T22:21:15.071446] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-03T22:21:15.194026] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-03T22:21:15.507564] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:15.725416] [DEBUG] [LOCAL ] WEC: Primary data saved (52957 records). [2025-10-03T22:21:15.725583] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-03T22:21:15.725725] [INFO ] [MAIN ] Update Progress: 2284/2370 symbols completed. WEC took 33.6s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-03T22:21:15.913276] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:15.932805] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T22:21:15.991432] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-03T22:21:15.991347] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-03T22:21:15.992742] [INFO ] [MAIN ] WFC: Loaded 54138 existing records. [2025-10-03T22:21:16.185969] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:16.186228] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-03T22:21:16.186291] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-03T22:21:16.186557] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-03T22:21:16.186618] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-03T22:21:16.576569] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:16.790751] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-03T22:21:17.005354] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T22:21:17.034664] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T22:21:17.590716] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-03T22:21:18.390679] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-03T22:21:18.815021] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T22:21:19.104718] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T22:21:19.123507] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T22:21:19.190766] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-03T22:21:19.990736] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-03T22:21:20.790702] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-03T22:21:20.898301] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T22:21:20.929368] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T22:21:21.590707] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-03T22:21:22.390669] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-03T22:21:22.404176] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T22:21:22.484996] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T22:21:23.190764] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-03T22:21:23.700331] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T22:21:23.990692] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-03T22:21:24.790690] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-03T22:21:25.218204] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-03T22:21:25.298485] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T22:21:25.590712] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-03T22:21:25.758056] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T22:21:26.390762] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-03T22:21:26.650769] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T22:21:27.190722] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-03T22:21:27.990627] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-03T22:21:28.443626] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T22:21:28.761741] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T22:21:28.790625] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-03T22:21:28.891963] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T22:21:29.590708] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-03T22:21:30.390719] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-03T22:21:30.810573] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T22:21:31.190721] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-03T22:21:31.352684] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T22:21:31.819705] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T22:21:31.991816] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-03T22:21:31.994855] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T22:21:32.790712] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-03T22:21:33.376008] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T22:21:33.590709] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-03T22:21:33.840078] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T22:21:34.390705] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-03T22:21:34.733228] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T22:21:35.135131] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T22:21:35.190704] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-03T22:21:35.990710] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-03T22:21:36.790637] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-03T22:21:36.798902] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T22:21:36.855875] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T22:21:37.590688] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-03T22:21:37.722343] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T22:21:38.126876] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T22:21:38.127923] [INFO ] [REMOTE ] WF: Full fetch complete (16249 records). [2025-10-03T22:21:38.128083] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-03T22:21:38.395868] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-03T22:21:38.525464] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-03T22:21:38.525564] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-03T22:21:38.526029] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-03T22:21:38.526097] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-03T22:21:38.526774] [DEBUG] [LOCAL ] WF: Trimmed 16249 records to 10827 (keeping 200 days of data) [2025-10-03T22:21:38.596630] [DEBUG] [LOCAL ] WF: Primary data saved (10827 records). [2025-10-03T22:21:38.596802] [INFO ] [MAIN ] WF: Full history saved. [2025-10-03T22:21:38.596914] [INFO ] [MAIN ] Update Progress: 2285/2370 symbols completed. WF took 24.0s. Estimated remaining: 11m 58s. Rate: 7.1 symbols/min [2025-10-03T22:21:38.776624] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:38.802873] [DEBUG] [LOCAL ] WFG: Loaded 24878 existing records from primary storage. [2025-10-03T22:21:38.803259] [INFO ] [MAIN ] WFG: Loaded 24878 existing records. [2025-10-03T22:21:38.999245] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:38.999580] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-03T22:21:38.999639] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-03T22:21:38.999956] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-03T22:21:39.000017] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-03T22:21:39.191817] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-03T22:21:39.414231] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:39.421638] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T22:21:39.424599] [INFO ] [REMOTE ] WEX: Full fetch complete (50525 records). [2025-10-03T22:21:39.424829] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-03T22:21:39.883010] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-03T22:21:39.883099] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-03T22:21:39.884203] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-03T22:21:39.884273] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-03T22:21:39.885480] [DEBUG] [LOCAL ] WEX: Trimmed 50525 records to 34924 (keeping 200 days of data) [2025-10-03T22:21:39.990908] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-03T22:21:40.117273] [DEBUG] [LOCAL ] WEX: Primary data saved (34924 records). [2025-10-03T22:21:40.117498] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-03T22:21:40.120280] [INFO ] [MAIN ] Update Progress: 2286/2370 symbols completed. WEX took 29.3s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-03T22:21:40.315405] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:40.361730] [DEBUG] [LOCAL ] WGO: Loaded 39165 existing records from primary storage. [2025-10-03T22:21:40.362478] [INFO ] [MAIN ] WGO: Loaded 39165 existing records. [2025-10-03T22:21:40.582847] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:40.584738] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T22:21:40.585114] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-03T22:21:40.588161] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-03T22:21:40.588458] [INFO ] [REMOTE ] WES: Full fetch complete (70010 records). [2025-10-03T22:21:40.588865] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-03T22:21:40.588782] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-03T22:21:40.589197] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-03T22:21:40.795769] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-03T22:21:41.507282] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T22:21:41.486847] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:41.507773] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-03T22:21:41.513603] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-03T22:21:41.515120] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-03T22:21:41.515193] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-03T22:21:41.517839] [DEBUG] [LOCAL ] WES: Trimmed 70010 records to 48847 (keeping 200 days of data) [2025-10-03T22:21:41.606964] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-03T22:21:41.865748] [DEBUG] [LOCAL ] WES: Primary data saved (48847 records). [2025-10-03T22:21:41.865941] [INFO ] [MAIN ] WES: Full history saved. [2025-10-03T22:21:41.866069] [INFO ] [MAIN ] Update Progress: 2287/2370 symbols completed. WES took 45.7s. Estimated remaining: 11m 40s. Rate: 7.1 symbols/min [2025-10-03T22:21:42.041498] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:21:42.097769] [DEBUG] [LOCAL ] WH: Loaded 45765 existing records from primary storage. [2025-10-03T22:21:42.098207] [INFO ] [MAIN ] WH: Loaded 45765 existing records. [2025-10-03T22:21:42.279609] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:21:42.279934] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-03T22:21:42.279983] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-03T22:21:42.280267] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-03T22:21:42.280326] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-03T22:21:42.395909] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-03T22:21:42.653127] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:21:43.080453] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T22:21:43.200769] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-03T22:21:43.226774] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T22:21:43.617504] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T22:21:43.990682] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-03T22:21:44.740909] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T22:21:44.790737] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-03T22:21:45.591954] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-03T22:21:45.596021] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T22:21:46.275816] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T22:21:46.390735] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-03T22:21:46.865438] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T22:21:47.190752] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-03T22:21:47.845923] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T22:21:47.990685] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-03T22:21:48.470375] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T22:21:48.790717] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-03T22:21:49.590635] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-03T22:21:49.722580] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T22:21:50.053764] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T22:21:50.390723] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-03T22:21:50.885693] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T22:21:51.190685] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-03T22:21:51.503002] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T22:21:51.990726] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-03T22:21:52.790746] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-03T22:21:53.358499] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-03T22:21:53.590674] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-03T22:21:53.630808] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T22:21:53.949119] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T22:21:54.390784] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-03T22:21:55.190752] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-03T22:21:55.540547] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T22:21:55.812679] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T22:21:55.990664] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-03T22:21:56.205714] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T22:21:56.790713] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-03T22:21:57.590738] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-03T22:21:58.243130] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T22:21:58.390677] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-03T22:21:58.440379] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T22:21:58.469179] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T22:21:59.190697] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-03T22:21:59.990734] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-03T22:22:00.070957] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T22:22:00.452392] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T22:22:00.790726] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-03T22:22:01.590709] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-03T22:22:01.656302] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T22:22:02.390733] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-03T22:22:02.998252] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T22:22:03.110901] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T22:22:03.190730] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-03T22:22:03.990678] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-03T22:22:04.021231] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T22:22:04.358482] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T22:22:04.790706] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-03T22:22:05.472209] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T22:22:05.560162] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T22:22:05.561873] [INFO ] [REMOTE ] WFG: Full fetch complete (35816 records). [2025-10-03T22:22:05.561964] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-03T22:22:05.599071] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-03T22:22:05.990536] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-03T22:22:05.990636] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-03T22:22:05.991544] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-03T22:22:05.991599] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-03T22:22:05.992723] [DEBUG] [LOCAL ] WFG: Trimmed 35816 records to 25021 (keeping 200 days of data) [2025-10-03T22:22:06.163184] [DEBUG] [LOCAL ] WFG: Primary data saved (25021 records). [2025-10-03T22:22:06.163349] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-03T22:22:06.163470] [INFO ] [MAIN ] Update Progress: 2288/2370 symbols completed. WFG took 27.6s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-03T22:22:06.362376] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:06.390729] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-03T22:22:06.412359] [DEBUG] [LOCAL ] WHD: Loaded 40598 existing records from primary storage. [2025-10-03T22:22:06.412849] [INFO ] [MAIN ] WHD: Loaded 40598 existing records. [2025-10-03T22:22:06.618066] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:06.618327] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-03T22:22:06.618380] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-03T22:22:06.618621] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-03T22:22:06.618724] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-03T22:22:07.014570] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:07.190696] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-03T22:22:07.262584] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T22:22:07.990747] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-03T22:22:08.074621] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T22:22:08.790669] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-03T22:22:09.136070] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T22:22:09.138080] [INFO ] [REMOTE ] WGO: Full fetch complete (57566 records). [2025-10-03T22:22:09.138309] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-03T22:22:09.576214] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-03T22:22:09.593387] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-03T22:22:09.603966] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-03T22:22:09.606175] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-03T22:22:09.621153] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-03T22:22:09.630124] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-03T22:22:09.644475] [DEBUG] [LOCAL ] WGO: Trimmed 57566 records to 39397 (keeping 200 days of data) [2025-10-03T22:22:09.930155] [DEBUG] [LOCAL ] WGO: Primary data saved (39397 records). [2025-10-03T22:22:09.930444] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-03T22:22:09.931177] [INFO ] [MAIN ] Update Progress: 2289/2370 symbols completed. WGO took 29.8s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-03T22:22:10.124864] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:10.132823] [DEBUG] [LOCAL ] WHG: Loaded 3320 existing records from primary storage. [2025-10-03T22:22:10.133137] [INFO ] [MAIN ] WHG: Loaded 3320 existing records. [2025-10-03T22:22:10.354553] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:10.357078] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-03T22:22:10.356991] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T22:22:10.357252] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-03T22:22:10.365869] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-03T22:22:10.365948] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-03T22:22:10.401709] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-03T22:22:10.784463] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:10.976980] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T22:22:10.980040] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-10-03T22:22:10.980187] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-03T22:22:11.204189] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-03T22:22:11.441589] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T22:22:11.475942] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-03T22:22:11.476485] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-03T22:22:11.477857] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-03T22:22:11.478414] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-03T22:22:11.479986] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 54528 (keeping 200 days of data) [2025-10-03T22:22:11.842557] [DEBUG] [LOCAL ] WFC: Primary data saved (54528 records). [2025-10-03T22:22:11.842745] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-03T22:22:11.842861] [INFO ] [MAIN ] Update Progress: 2290/2370 symbols completed. WFC took 56.1s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-03T22:22:11.995866] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-03T22:22:12.031783] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:12.078178] [DEBUG] [LOCAL ] WHR: Loaded 48506 existing records from primary storage. [2025-10-03T22:22:12.078555] [INFO ] [MAIN ] WHR: Loaded 48506 existing records. [2025-10-03T22:22:12.276259] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:12.276541] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-03T22:22:12.276595] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-03T22:22:12.276934] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-03T22:22:12.276998] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-03T22:22:12.611968] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T22:22:12.721858] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:12.783185] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T22:22:12.791446] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-03T22:22:13.590703] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-03T22:22:14.106517] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T22:22:14.340338] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T22:22:14.390681] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-03T22:22:15.190700] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-03T22:22:15.990633] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-03T22:22:16.031781] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T22:22:16.575917] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T22:22:16.651663] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T22:22:16.790704] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-03T22:22:17.391474] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T22:22:17.590735] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-03T22:22:18.390706] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-03T22:22:19.091529] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T22:22:19.190731] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-03T22:22:19.687421] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T22:22:19.820333] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T22:22:19.990691] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-03T22:22:20.790735] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-03T22:22:21.517444] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T22:22:21.551801] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T22:22:21.590698] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-03T22:22:22.390690] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-03T22:22:22.758255] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:22:22.761608] [INFO ] [REMOTE ] WH: Full fetch complete (64992 records). [2025-10-03T22:22:22.761807] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-03T22:22:23.198601] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-03T22:22:23.224150] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-03T22:22:23.224277] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-03T22:22:23.225870] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-03T22:22:23.226067] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-03T22:22:23.229784] [DEBUG] [LOCAL ] WH: Trimmed 64992 records to 46091 (keeping 200 days of data) [2025-10-03T22:22:23.550688] [DEBUG] [LOCAL ] WH: Primary data saved (46091 records). [2025-10-03T22:22:23.550858] [INFO ] [MAIN ] WH: Full history saved. [2025-10-03T22:22:23.551039] [INFO ] [MAIN ] Update Progress: 2291/2370 symbols completed. WH took 41.7s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-03T22:22:23.768837] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:23.777147] [DEBUG] [LOCAL ] WIA: Loaded 4835 existing records from primary storage. [2025-10-03T22:22:23.777372] [INFO ] [MAIN ] WIA: Loaded 4835 existing records. [2025-10-03T22:22:23.968919] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:23.969230] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-03T22:22:23.969364] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-03T22:22:23.969549] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-03T22:22:23.969609] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-03T22:22:23.991764] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-03T22:22:24.407761] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:24.412205] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T22:22:24.790676] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-03T22:22:24.806799] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T22:22:25.070639] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T22:22:25.414458] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T22:22:25.590708] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-03T22:22:26.198111] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T22:22:26.390721] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-03T22:22:27.190730] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-03T22:22:27.836801] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T22:22:27.990714] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-03T22:22:28.604287] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T22:22:28.790688] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-03T22:22:29.234003] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T22:22:29.590722] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-03T22:22:30.172264] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T22:22:30.247731] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T22:22:30.390728] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-03T22:22:30.976034] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T22:22:31.190701] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-03T22:22:31.667433] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T22:22:31.990719] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-03T22:22:32.790694] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-03T22:22:33.563848] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T22:22:33.590679] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-03T22:22:34.390723] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-03T22:22:34.494353] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T22:22:34.691938] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-03T22:22:35.045757] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T22:22:35.190683] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-03T22:22:35.990681] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-03T22:22:36.629322] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T22:22:36.677021] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T22:22:36.790737] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-03T22:22:37.437023] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T22:22:37.590697] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-03T22:22:38.390673] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-03T22:22:39.034036] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T22:22:39.190679] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-03T22:22:39.318513] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T22:22:39.489107] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-03T22:22:39.489910] [INFO ] [REMOTE ] WHG: Full fetch complete (4614 records). [2025-10-03T22:22:39.490014] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-03T22:22:39.907719] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-03T22:22:39.907853] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-03T22:22:39.908094] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-03T22:22:39.908161] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-03T22:22:39.908582] [DEBUG] [LOCAL ] WHG: Trimmed 4614 records to 3327 (keeping 200 days of data) [2025-10-03T22:22:39.933372] [DEBUG] [LOCAL ] WHG: Primary data saved (3327 records). [2025-10-03T22:22:39.933494] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-03T22:22:39.933606] [INFO ] [MAIN ] Update Progress: 2292/2370 symbols completed. WHG took 30.0s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-03T22:22:39.995779] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-03T22:22:40.123633] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:40.141537] [DEBUG] [LOCAL ] WINN: Loaded 11698 existing records from primary storage. [2025-10-03T22:22:40.141824] [INFO ] [MAIN ] WINN: Loaded 11698 existing records. [2025-10-03T22:22:40.330438] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:40.330849] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-03T22:22:40.330937] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-03T22:22:40.331159] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-03T22:22:40.331222] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-03T22:22:40.745391] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:40.790749] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-03T22:22:41.387371] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T22:22:41.590721] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-03T22:22:41.939557] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T22:22:42.227207] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T22:22:42.390732] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-03T22:22:43.190699] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-03T22:22:43.289432] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T22:22:43.990734] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-03T22:22:44.385309] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T22:22:44.390518] [INFO ] [REMOTE ] WHD: Full fetch complete (57596 records). [2025-10-03T22:22:44.390727] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-03T22:22:44.796625] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-03T22:22:44.821053] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-03T22:22:44.821226] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-03T22:22:44.822611] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-03T22:22:44.822704] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-03T22:22:44.824397] [DEBUG] [LOCAL ] WHD: Trimmed 57596 records to 40900 (keeping 200 days of data) [2025-10-03T22:22:45.090067] [DEBUG] [LOCAL ] WHD: Primary data saved (40900 records). [2025-10-03T22:22:45.090205] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-03T22:22:45.090320] [INFO ] [MAIN ] Update Progress: 2293/2370 symbols completed. WHD took 38.9s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-03T22:22:45.277067] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:45.332110] [DEBUG] [LOCAL ] WIT: Loaded 52740 existing records from primary storage. [2025-10-03T22:22:45.332497] [INFO ] [MAIN ] WIT: Loaded 52740 existing records. [2025-10-03T22:22:45.542160] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:45.543916] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T22:22:45.547175] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-03T22:22:45.547565] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-03T22:22:45.548131] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-03T22:22:45.548297] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-03T22:22:45.595829] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-03T22:22:45.772806] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T22:22:46.007137] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:46.167242] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T22:22:46.168291] [INFO ] [REMOTE ] WIA: Full fetch complete (7246 records). [2025-10-03T22:22:46.168366] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-03T22:22:46.395862] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-03T22:22:46.547126] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-03T22:22:46.547215] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-03T22:22:46.547456] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-03T22:22:46.547500] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-03T22:22:46.548024] [DEBUG] [LOCAL ] WIA: Trimmed 7246 records to 4897 (keeping 200 days of data) [2025-10-03T22:22:46.578409] [DEBUG] [LOCAL ] WIA: Primary data saved (4897 records). [2025-10-03T22:22:46.578550] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-03T22:22:46.578667] [INFO ] [MAIN ] Update Progress: 2294/2370 symbols completed. WIA took 23.0s. Estimated remaining: 10m 41s. Rate: 7.1 symbols/min [2025-10-03T22:22:46.766043] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:22:46.789034] [DEBUG] [LOCAL ] WIW: Loaded 20534 existing records from primary storage. [2025-10-03T22:22:46.789308] [INFO ] [MAIN ] WIW: Loaded 20534 existing records. [2025-10-03T22:22:46.980004] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:22:46.980254] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-03T22:22:46.980317] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-03T22:22:46.980589] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-03T22:22:46.980677] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-03T22:22:47.201476] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-03T22:22:47.370267] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:22:47.380773] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T22:22:47.990714] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-03T22:22:48.797186] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-03T22:22:48.800760] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T22:22:49.221042] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T22:22:49.590749] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-03T22:22:49.915920] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T22:22:50.390699] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-03T22:22:51.190696] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-03T22:22:51.523789] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T22:22:51.990718] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-03T22:22:52.061968] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T22:22:52.790728] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-03T22:22:53.590721] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-03T22:23:04.839787] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (12.05 seconds). [2025-10-03T22:23:04.846340] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-03T22:23:05.663909] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (13.67 seconds). [2025-10-03T22:23:05.671326] [INFO ] [REMOTE ] WHR: Full fetch complete (68632 records). [2025-10-03T22:23:05.671539] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-03T22:23:05.848790] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (14.66 seconds). [2025-10-03T22:23:05.959887] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-03T22:23:06.130820] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-03T22:23:06.130981] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-03T22:23:06.132500] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-03T22:23:06.132699] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-03T22:23:06.154316] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T22:23:06.161883] [DEBUG] [LOCAL ] WHR: Trimmed 68632 records to 48838 (keeping 200 days of data) [2025-10-03T22:23:06.162424] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-03T22:23:06.514219] [DEBUG] [LOCAL ] WHR: Primary data saved (48838 records). [2025-10-03T22:23:06.514380] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-03T22:23:06.514505] [INFO ] [MAIN ] Update Progress: 2295/2370 symbols completed. WHR took 54.7s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-03T22:23:06.699399] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:06.740364] [DEBUG] [LOCAL ] WK: Loaded 37436 existing records from primary storage. [2025-10-03T22:23:06.740888] [INFO ] [MAIN ] WK: Loaded 37436 existing records. [2025-10-03T22:23:06.948217] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:06.948509] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-03T22:23:06.948676] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-03T22:23:06.948997] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-03T22:23:06.949059] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-03T22:23:07.122791] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (13.53 seconds). [2025-10-03T22:23:07.182752] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T22:23:07.234922] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-03T22:23:07.250630] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-03T22:23:07.443677] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:07.444062] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-03T22:23:08.956361] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T22:23:08.963732] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-03T22:23:09.047952] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-03T22:23:09.055042] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-03T22:23:09.452510] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T22:23:09.456499] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-03T22:23:10.280989] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T22:23:10.284455] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-03T22:23:10.381307] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-10-03T22:23:10.393937] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-03T22:23:10.491769] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T22:23:10.499969] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-03T22:23:10.673712] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T22:23:10.679353] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-03T22:23:11.085701] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T22:23:11.089011] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-03T22:23:11.601977] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T22:23:11.610967] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-03T22:23:11.795773] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T22:23:11.801416] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-03T22:23:11.851358] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T22:23:11.869037] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-03T22:23:11.876210] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T22:23:11.881550] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-03T22:23:12.377200] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T22:23:12.381045] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-03T22:23:12.478858] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T22:23:12.483528] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-03T22:23:12.681550] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T22:23:12.691155] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-03T22:23:12.983075] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T22:23:12.984458] [INFO ] [REMOTE ] WINN: Full fetch complete (17575 records). [2025-10-03T22:23:12.984540] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-03T22:23:13.413080] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-03T22:23:13.413569] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-03T22:23:13.414125] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-03T22:23:13.414358] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-03T22:23:13.415581] [DEBUG] [LOCAL ] WINN: Trimmed 17575 records to 11777 (keeping 200 days of data) [2025-10-03T22:23:13.507673] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T22:23:13.521778] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-03T22:23:13.547796] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T22:23:13.556427] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-03T22:23:13.568720] [DEBUG] [LOCAL ] WINN: Primary data saved (11777 records). [2025-10-03T22:23:13.568996] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-03T22:23:13.569102] [INFO ] [MAIN ] Update Progress: 2296/2370 symbols completed. WINN took 33.6s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-03T22:23:13.759207] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:13.801486] [DEBUG] [LOCAL ] WKC: Loaded 35105 existing records from primary storage. [2025-10-03T22:23:13.801880] [INFO ] [MAIN ] WKC: Loaded 35105 existing records. [2025-10-03T22:23:14.004331] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:14.004550] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-03T22:23:14.004601] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-03T22:23:14.004867] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-03T22:23:14.004928] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-03T22:23:14.416903] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:14.417407] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-03T22:23:14.446566] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T22:23:14.456378] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-03T22:23:14.681751] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T22:23:14.688571] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-03T22:23:15.006743] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T22:23:15.190727] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-03T22:23:15.628704] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T22:23:15.657998] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T22:23:15.995739] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-03T22:23:16.014959] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T22:23:16.790723] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-03T22:23:17.068171] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T22:23:17.383218] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T22:23:17.590693] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-03T22:23:18.094081] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T22:23:18.390700] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-03T22:23:19.064348] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T22:23:19.190726] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-03T22:23:19.990734] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-03T22:23:20.155699] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T22:23:20.590200] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T22:23:20.790714] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-03T22:23:21.552075] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T22:23:21.590717] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-03T22:23:22.390618] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-03T22:23:22.455338] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T22:23:23.021488] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T22:23:23.190713] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-03T22:23:23.280039] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T22:23:23.281922] [INFO ] [REMOTE ] WIW: Full fetch complete (29876 records). [2025-10-03T22:23:23.282061] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-03T22:23:23.806165] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-03T22:23:23.806255] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-03T22:23:23.807168] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-03T22:23:23.807238] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-03T22:23:23.808755] [DEBUG] [LOCAL ] WIW: Trimmed 29876 records to 20635 (keeping 200 days of data) [2025-10-03T22:23:23.964934] [DEBUG] [LOCAL ] WIW: Primary data saved (20635 records). [2025-10-03T22:23:23.965094] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-03T22:23:23.965255] [INFO ] [MAIN ] Update Progress: 2297/2370 symbols completed. WIW took 37.4s. Estimated remaining: 10m 17s. Rate: 7.1 symbols/min [2025-10-03T22:23:23.995905] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-03T22:23:24.205256] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:24.261534] [DEBUG] [LOCAL ] WLK: Loaded 45898 existing records from primary storage. [2025-10-03T22:23:24.261961] [INFO ] [MAIN ] WLK: Loaded 45898 existing records. [2025-10-03T22:23:24.515902] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:24.516541] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-03T22:23:24.516730] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-03T22:23:24.517164] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-03T22:23:24.517228] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-03T22:23:24.693565] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T22:23:24.734798] [INFO ] [REMOTE ] WIT: Full fetch complete (75674 records). [2025-10-03T22:23:24.772730] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-03T22:23:24.796740] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-03T22:23:25.288759] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:25.504506] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-03T22:23:25.504813] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-03T22:23:25.506332] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-03T22:23:25.506435] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-03T22:23:25.508509] [DEBUG] [LOCAL ] WIT: Trimmed 75674 records to 53128 (keeping 200 days of data) [2025-10-03T22:23:25.597604] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-03T22:23:25.634261] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T22:23:25.902440] [DEBUG] [LOCAL ] WIT: Primary data saved (53128 records). [2025-10-03T22:23:25.902687] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-03T22:23:25.902869] [INFO ] [MAIN ] Update Progress: 2298/2370 symbols completed. WIT took 40.8s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-03T22:23:26.136298] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:26.146699] [DEBUG] [LOCAL ] WLKP: Loaded 6891 existing records from primary storage. [2025-10-03T22:23:26.146996] [INFO ] [MAIN ] WLKP: Loaded 6891 existing records. [2025-10-03T22:23:26.361940] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:26.362762] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-03T22:23:26.362977] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-03T22:23:26.363311] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-03T22:23:26.363383] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-03T22:23:26.395876] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-03T22:23:26.737688] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T22:23:26.863791] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:27.188232] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T22:23:27.196258] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-03T22:23:27.851601] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T22:23:27.990702] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-03T22:23:28.151538] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T22:23:28.154090] [INFO ] [REMOTE ] WK: Full fetch complete (52807 records). [2025-10-03T22:23:28.154218] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-03T22:23:28.577271] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-03T22:23:28.577416] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-03T22:23:28.578768] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-03T22:23:28.578837] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-03T22:23:28.580202] [DEBUG] [LOCAL ] WK: Trimmed 52807 records to 37723 (keeping 200 days of data) [2025-10-03T22:23:28.793818] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T22:23:28.792121] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-03T22:23:28.833503] [DEBUG] [LOCAL ] WK: Primary data saved (37723 records). [2025-10-03T22:23:28.833749] [INFO ] [MAIN ] WK: Full history saved. [2025-10-03T22:23:28.833901] [INFO ] [MAIN ] Update Progress: 2299/2370 symbols completed. WK took 22.3s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-03T22:23:29.030342] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:29.030620] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-03T22:23:29.030709] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-03T22:23:29.030846] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-03T22:23:29.030914] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-03T22:23:29.030996] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-03T22:23:29.031046] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-03T22:23:29.415086] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:29.590702] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-03T22:23:30.295899] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T22:23:30.324275] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T22:23:30.390677] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-03T22:23:31.189490] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T22:23:31.191349] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-03T22:23:31.990773] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-03T22:23:32.344561] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-03T22:23:32.773585] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T22:23:32.790611] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-03T22:23:33.590723] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-03T22:23:34.390713] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-03T22:23:34.477932] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T22:23:34.778926] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-03T22:23:35.020301] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T22:23:35.190712] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-03T22:23:35.599712] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-03T22:23:35.990719] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-03T22:23:36.790705] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-03T22:23:37.170214] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T22:23:37.358167] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T22:23:37.590742] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-03T22:23:38.372667] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T22:23:38.390616] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-03T22:23:39.140727] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T22:23:39.190630] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-03T22:23:39.990712] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-03T22:23:40.104005] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T22:23:40.790689] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-03T22:23:41.342328] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T22:23:41.363537] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T22:23:41.590708] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-03T22:23:42.025339] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T22:23:42.390678] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-03T22:23:42.742846] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T22:23:43.190704] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-03T22:23:43.555089] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-03T22:23:43.990696] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-03T22:23:44.790704] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-03T22:23:45.431705] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T22:23:45.590713] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-03T22:23:46.215403] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T22:23:46.392965] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-03T22:23:46.395999] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T22:23:47.132044] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T22:23:47.190699] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-03T22:23:47.954862] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T22:23:47.990718] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-03T22:23:48.500463] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T22:23:48.501545] [INFO ] [REMOTE ] WLKP: Full fetch complete (10354 records). [2025-10-03T22:23:48.501618] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-03T22:23:48.795857] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-03T22:23:48.889710] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-03T22:23:48.889809] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-03T22:23:48.890140] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-03T22:23:48.890184] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-03T22:23:48.890679] [DEBUG] [LOCAL ] WLKP: Trimmed 10354 records to 6948 (keeping 200 days of data) [2025-10-03T22:23:48.935209] [DEBUG] [LOCAL ] WLKP: Primary data saved (6948 records). [2025-10-03T22:23:48.935361] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-03T22:23:48.935456] [INFO ] [MAIN ] Update Progress: 2300/2370 symbols completed. WLKP took 23.0s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-03T22:23:49.114379] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:49.145988] [DEBUG] [LOCAL ] WLY: Loaded 29858 existing records from primary storage. [2025-10-03T22:23:49.146306] [INFO ] [MAIN ] WLY: Loaded 29858 existing records. [2025-10-03T22:23:49.319477] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T22:23:49.348189] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:49.348416] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-03T22:23:49.348468] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-03T22:23:49.348790] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-03T22:23:49.348850] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-03T22:23:49.595951] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-03T22:23:49.729473] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:50.148439] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T22:23:50.390690] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-03T22:23:50.753677] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T22:23:51.190682] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-03T22:23:51.990724] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-03T22:23:52.468916] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T22:23:52.790683] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-03T22:23:53.076927] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T22:23:53.079011] [INFO ] [REMOTE ] WKC: Full fetch complete (50894 records). [2025-10-03T22:23:53.079107] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-03T22:23:53.485685] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-03T22:23:53.485826] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-03T22:23:53.487035] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-03T22:23:53.487102] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-03T22:23:53.488558] [DEBUG] [LOCAL ] WKC: Trimmed 50894 records to 35318 (keeping 200 days of data) [2025-10-03T22:23:53.590993] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-03T22:23:53.723845] [DEBUG] [LOCAL ] WKC: Primary data saved (35318 records). [2025-10-03T22:23:53.723994] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-03T22:23:53.724631] [INFO ] [MAIN ] Update Progress: 2301/2370 symbols completed. WKC took 40.2s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-03T22:23:53.912946] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:53.967826] [DEBUG] [LOCAL ] WM: Loaded 51286 existing records from primary storage. [2025-10-03T22:23:53.968239] [INFO ] [MAIN ] WM: Loaded 51286 existing records. [2025-10-03T22:23:54.024754] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T22:23:54.026418] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-10-03T22:23:54.026591] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-03T22:23:54.411085] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:54.427447] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-03T22:23:54.406071] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T22:23:54.427120] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T22:23:54.433448] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-03T22:23:54.395047] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-03T22:23:54.433738] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T22:23:54.434129] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-03T22:23:54.435305] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-03T22:23:54.435156] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T22:23:54.435772] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-03T22:23:54.474965] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-03T22:23:54.483371] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-03T22:23:54.505562] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-03T22:23:54.520935] [INFO ] [MAIN ] Update Progress: 2302/2370 symbols completed. WLTG took 25.7s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-03T22:23:54.918933] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:23:55.035394] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:55.081552] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-10-03T22:23:55.081938] [INFO ] [MAIN ] WMB: Loaded 54061 existing records. [2025-10-03T22:23:55.195836] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-03T22:23:55.277302] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:23:55.277544] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-03T22:23:55.277596] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-03T22:23:55.277842] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-03T22:23:55.277950] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-03T22:23:55.664936] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:23:55.990681] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-03T22:23:56.148356] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T22:23:56.790739] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-03T22:23:57.142947] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T22:23:57.259803] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T22:23:57.590768] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-03T22:23:58.390723] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-03T22:23:58.483956] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:23:59.190942] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-03T22:23:59.453051] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T22:23:59.990625] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-03T22:24:00.490038] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T22:24:00.630608] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T22:24:00.790721] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-03T22:24:01.590731] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-03T22:24:01.897801] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T22:24:02.097529] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T22:24:02.390785] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-03T22:24:03.190725] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-03T22:24:03.311072] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:24:03.990753] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-03T22:24:04.130878] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T22:24:04.790721] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-03T22:24:05.006377] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T22:24:05.590805] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-03T22:24:05.783443] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T22:24:06.390754] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-03T22:24:06.682490] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T22:24:07.004310] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T22:24:07.190712] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-03T22:24:07.990734] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-03T22:24:08.340306] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T22:24:08.390887] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T22:24:08.790718] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-03T22:24:09.596218] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-03T22:24:09.612667] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T22:24:09.812052] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T22:24:10.390746] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-03T22:24:11.190756] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-03T22:24:11.565048] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T22:24:11.643072] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T22:24:11.990692] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-03T22:24:12.790763] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-03T22:24:13.114145] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T22:24:13.404544] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T22:24:13.590733] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-03T22:24:14.107619] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T22:24:14.110747] [INFO ] [REMOTE ] WLK: Full fetch complete (63165 records). [2025-10-03T22:24:14.110969] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-03T22:24:14.395936] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-03T22:24:14.558330] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T22:24:14.591858] [INFO ] [REMOTE ] WLY: Full fetch complete (42822 records). [2025-10-03T22:24:14.607897] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-03T22:24:14.608068] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-03T22:24:14.610004] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-03T22:24:14.610327] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-03T22:24:14.610196] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-03T22:24:14.652813] [DEBUG] [LOCAL ] WLK: Trimmed 63165 records to 46195 (keeping 200 days of data) [2025-10-03T22:24:15.134246] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-03T22:24:15.135045] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-03T22:24:15.136888] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-03T22:24:15.136977] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-03T22:24:15.141229] [DEBUG] [LOCAL ] WLY: Trimmed 42822 records to 30031 (keeping 200 days of data) [2025-10-03T22:24:15.195114] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-03T22:24:15.489467] [DEBUG] [LOCAL ] WLY: Primary data saved (30031 records). [2025-10-03T22:24:15.491187] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-03T22:24:15.491710] [INFO ] [MAIN ] Update Progress: 2303/2370 symbols completed. WLY took 26.6s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-03T22:24:15.714775] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:15.724296] [DEBUG] [LOCAL ] WLK: Primary data saved (46195 records). [2025-10-03T22:24:15.729135] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-03T22:24:15.729290] [INFO ] [MAIN ] Update Progress: 2304/2370 symbols completed. WLK took 51.8s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-03T22:24:15.834632] [DEBUG] [LOCAL ] WMK: Loaded 14606 existing records from primary storage. [2025-10-03T22:24:15.849868] [INFO ] [MAIN ] WMK: Loaded 14606 existing records. [2025-10-03T22:24:16.050952] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:16.135888] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:16.136248] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-03T22:24:16.136309] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-03T22:24:16.136592] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-03T22:24:16.136688] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-03T22:24:16.345061] [DEBUG] [LOCAL ] WMS: Loaded 39844 existing records from primary storage. [2025-10-03T22:24:16.385729] [INFO ] [MAIN ] WMS: Loaded 39844 existing records. [2025-10-03T22:24:16.719067] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:16.733548] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-03T22:24:16.733169] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:16.735154] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-03T22:24:16.735315] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-03T22:24:16.735786] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-03T22:24:16.735849] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-03T22:24:16.908289] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-03T22:24:16.984852] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-03T22:24:17.167267] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:17.207306] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T22:24:17.537769] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T22:24:17.590699] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-03T22:24:18.390716] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-03T22:24:18.977433] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T22:24:19.190665] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-03T22:24:19.223410] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T22:24:19.282705] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T22:24:19.990717] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-03T22:24:20.796402] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-03T22:24:20.798305] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T22:24:21.258677] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T22:24:21.590714] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-03T22:24:21.956114] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T22:24:22.390721] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-03T22:24:23.190718] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-03T22:24:23.322980] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T22:24:23.501465] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T22:24:23.990755] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-03T22:24:24.075951] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T22:24:24.790708] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-03T22:24:25.590799] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-03T22:24:25.778811] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T22:24:25.972391] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T22:24:26.390730] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-03T22:24:27.095213] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T22:24:27.190682] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-03T22:24:27.990639] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-03T22:24:28.320904] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T22:24:28.729887] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T22:24:28.790679] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-03T22:24:29.171975] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T22:24:29.590764] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-03T22:24:30.269402] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T22:24:30.390680] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-03T22:24:31.190788] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-03T22:24:31.619969] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T22:24:31.990773] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-03T22:24:32.028669] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T22:24:32.790679] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-03T22:24:32.912422] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T22:24:33.227945] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T22:24:33.590773] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-03T22:24:34.032243] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T22:24:34.035597] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-03T22:24:34.035778] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-03T22:24:34.397303] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-03T22:24:34.505159] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-03T22:24:34.505882] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-03T22:24:34.507690] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-03T22:24:34.512621] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-03T22:24:34.512334] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T22:24:34.528018] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54451 (keeping 200 days of data) [2025-10-03T22:24:34.883450] [DEBUG] [LOCAL ] WMB: Primary data saved (54451 records). [2025-10-03T22:24:34.883668] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-03T22:24:34.883848] [INFO ] [MAIN ] Update Progress: 2305/2370 symbols completed. WMB took 40.4s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-03T22:24:35.057834] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:35.114776] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-03T22:24:35.115218] [INFO ] [MAIN ] WMT: Loaded 54190 existing records. [2025-10-03T22:24:35.195828] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-03T22:24:35.301387] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:35.301739] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-03T22:24:35.301803] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-03T22:24:35.302105] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-03T22:24:35.302174] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-03T22:24:35.602584] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T22:24:35.737579] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:35.744133] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T22:24:35.748172] [INFO ] [REMOTE ] WM: Full fetch complete (73798 records). [2025-10-03T22:24:35.748430] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-03T22:24:35.995895] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-03T22:24:36.171358] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-03T22:24:36.171454] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-03T22:24:36.172931] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-03T22:24:36.173010] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-03T22:24:36.174664] [DEBUG] [LOCAL ] WM: Trimmed 73798 records to 51648 (keeping 200 days of data) [2025-10-03T22:24:36.518528] [DEBUG] [LOCAL ] WM: Primary data saved (51648 records). [2025-10-03T22:24:36.518727] [INFO ] [MAIN ] WM: Full history saved. [2025-10-03T22:24:36.519874] [INFO ] [MAIN ] Update Progress: 2306/2370 symbols completed. WM took 42.8s. Estimated remaining: 9m 0s. Rate: 7.1 symbols/min [2025-10-03T22:24:36.710996] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:36.760911] [DEBUG] [LOCAL ] WNC: Loaded 39582 existing records from primary storage. [2025-10-03T22:24:36.761377] [INFO ] [MAIN ] WNC: Loaded 39582 existing records. [2025-10-03T22:24:36.794800] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-03T22:24:36.959201] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:36.959544] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-03T22:24:36.959610] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-03T22:24:36.959921] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-03T22:24:36.960026] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-03T22:24:37.078560] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T22:24:37.369409] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:37.590732] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-03T22:24:38.368399] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T22:24:38.390668] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-03T22:24:39.190735] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-03T22:24:39.986164] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T22:24:39.995400] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-03T22:24:40.029186] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T22:24:40.233208] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-03T22:24:40.790704] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-03T22:24:41.037608] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T22:24:41.590736] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-03T22:24:42.166925] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T22:24:42.168513] [INFO ] [REMOTE ] WMK: Full fetch complete (19650 records). [2025-10-03T22:24:42.168599] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-03T22:24:42.276310] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T22:24:42.395509] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-03T22:24:42.606711] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-03T22:24:42.606799] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-03T22:24:42.607350] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-03T22:24:42.607431] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-03T22:24:42.608468] [DEBUG] [LOCAL ] WMK: Trimmed 19650 records to 14684 (keeping 200 days of data) [2025-10-03T22:24:42.705230] [DEBUG] [LOCAL ] WMK: Primary data saved (14684 records). [2025-10-03T22:24:42.705383] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-03T22:24:42.705497] [INFO ] [MAIN ] Update Progress: 2307/2370 symbols completed. WMK took 27.2s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-03T22:24:42.887330] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:42.930623] [DEBUG] [LOCAL ] WNS: Loaded 40206 existing records from primary storage. [2025-10-03T22:24:42.930960] [INFO ] [MAIN ] WNS: Loaded 40206 existing records. [2025-10-03T22:24:43.120976] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:43.121210] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-03T22:24:43.121264] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-03T22:24:43.121493] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-03T22:24:43.121553] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-03T22:24:43.195837] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-03T22:24:43.528909] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:43.917887] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T22:24:43.990760] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-03T22:24:44.790699] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-03T22:24:45.501031] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T22:24:45.590717] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-03T22:24:45.824238] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-03T22:24:46.043713] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T22:24:46.046276] [INFO ] [REMOTE ] WMS: Full fetch complete (57244 records). [2025-10-03T22:24:46.046396] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-03T22:24:46.406322] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-03T22:24:46.468190] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-03T22:24:46.468298] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-03T22:24:46.469739] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-03T22:24:46.469812] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-03T22:24:46.472031] [DEBUG] [LOCAL ] WMS: Trimmed 57244 records to 40088 (keeping 200 days of data) [2025-10-03T22:24:46.732235] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T22:24:46.767277] [DEBUG] [LOCAL ] WMS: Primary data saved (40088 records). [2025-10-03T22:24:46.767420] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-03T22:24:46.767532] [INFO ] [MAIN ] Update Progress: 2308/2370 symbols completed. WMS took 31.0s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-03T22:24:46.961003] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:24:47.015589] [DEBUG] [LOCAL ] WOLF: Loaded 53572 existing records from primary storage. [2025-10-03T22:24:47.016006] [INFO ] [MAIN ] WOLF: Loaded 53572 existing records. [2025-10-03T22:24:47.191733] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-03T22:24:47.230026] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:24:47.230426] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-03T22:24:47.230485] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-03T22:24:47.230845] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-03T22:24:47.230956] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-03T22:24:47.639134] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:24:47.990716] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-03T22:24:48.790817] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-03T22:24:48.962134] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T22:24:49.010074] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-03T22:24:49.397247] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T22:24:49.590758] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-03T22:24:50.390763] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-03T22:24:51.090007] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-03T22:24:51.149498] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T22:24:51.190619] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-03T22:24:51.753122] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T22:24:51.990730] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-03T22:24:52.734455] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T22:24:52.790718] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-03T22:24:53.590724] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-03T22:24:54.237507] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T22:24:54.390732] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-03T22:24:54.621092] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-03T22:24:55.190706] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-03T22:24:55.720847] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T22:24:55.866022] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-03T22:24:55.990750] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-03T22:24:56.790693] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-03T22:24:57.598505] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-03T22:24:57.621087] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T22:24:57.826716] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-03T22:24:58.390721] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-03T22:24:58.998137] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-03T22:24:59.179417] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T22:24:59.190613] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-03T22:24:59.856838] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T22:24:59.990698] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-03T22:25:00.355005] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T22:25:00.790710] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-03T22:25:01.590752] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-03T22:25:02.182897] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T22:25:02.390625] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-03T22:25:02.552506] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-03T22:25:02.838766] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T22:25:03.190701] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-03T22:25:03.990725] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-03T22:25:04.726550] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-03T22:25:04.790685] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-03T22:25:04.909994] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:25:04.943310] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T22:25:04.946218] [INFO ] [REMOTE ] WNC: Full fetch complete (57576 records). [2025-10-03T22:25:04.946385] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-03T22:25:05.384015] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-03T22:25:05.384196] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-03T22:25:05.385673] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-03T22:25:05.385754] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-03T22:25:05.389586] [DEBUG] [LOCAL ] WNC: Trimmed 57576 records to 39805 (keeping 200 days of data) [2025-10-03T22:25:05.609329] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-03T22:25:05.650855] [DEBUG] [LOCAL ] WNC: Primary data saved (39805 records). [2025-10-03T22:25:05.651008] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-03T22:25:05.651825] [INFO ] [MAIN ] Update Progress: 2309/2370 symbols completed. WNC took 29.1s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-03T22:25:05.829068] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:05.858169] [DEBUG] [LOCAL ] WOR: Loaded 25101 existing records from primary storage. [2025-10-03T22:25:05.858513] [INFO ] [MAIN ] WOR: Loaded 25101 existing records. [2025-10-03T22:25:06.052248] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:06.052553] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-03T22:25:06.052622] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-03T22:25:06.052929] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-03T22:25:06.052989] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-03T22:25:06.393325] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-03T22:25:06.433606] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:07.146594] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T22:25:07.190670] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-03T22:25:07.271004] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T22:25:07.990723] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-03T22:25:08.679623] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T22:25:08.791147] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-03T22:25:08.825919] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T22:25:08.927735] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-03T22:25:09.590742] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-03T22:25:09.885542] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T22:25:09.887983] [INFO ] [REMOTE ] WNS: Full fetch complete (55156 records). [2025-10-03T22:25:09.888090] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-03T22:25:10.297207] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-03T22:25:10.297569] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-03T22:25:10.298988] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-03T22:25:10.299060] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-03T22:25:10.300435] [DEBUG] [LOCAL ] WNS: Trimmed 55156 records to 40550 (keeping 200 days of data) [2025-10-03T22:25:10.391931] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-03T22:25:10.556744] [DEBUG] [LOCAL ] WNS: Primary data saved (40550 records). [2025-10-03T22:25:10.556888] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-03T22:25:10.557011] [INFO ] [MAIN ] Update Progress: 2310/2370 symbols completed. WNS took 27.9s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-03T22:25:10.748390] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:10.768149] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T22:25:10.801244] [DEBUG] [LOCAL ] WOW: Loaded 30711 existing records from primary storage. [2025-10-03T22:25:10.801536] [INFO ] [MAIN ] WOW: Loaded 30711 existing records. [2025-10-03T22:25:11.009022] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:11.009286] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-03T22:25:11.009345] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-03T22:25:11.009809] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-03T22:25:11.009877] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-03T22:25:11.200558] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-03T22:25:11.418438] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:11.990714] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-03T22:25:12.790780] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-03T22:25:13.129621] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-03T22:25:13.158223] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T22:25:13.590631] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-03T22:25:13.862840] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T22:25:13.965514] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T22:25:14.390766] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-03T22:25:15.190695] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-03T22:25:15.406274] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T22:25:15.587616] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T22:25:15.990730] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-03T22:25:16.284996] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T22:25:16.790708] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-03T22:25:17.083124] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T22:25:17.590706] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-03T22:25:18.015102] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T22:25:18.390708] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-03T22:25:18.559957] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T22:25:19.190704] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-03T22:25:19.990698] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-03T22:25:20.790715] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-03T22:25:21.156003] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-03T22:25:21.157312] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T22:25:21.300055] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T22:25:21.590681] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-03T22:25:22.156236] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T22:25:22.390705] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-03T22:25:22.680691] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T22:25:23.190700] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-03T22:25:23.449676] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T22:25:23.990714] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-03T22:25:24.570490] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T22:25:24.790625] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-03T22:25:25.180290] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T22:25:25.576864] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T22:25:25.590608] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-03T22:25:26.390738] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-03T22:25:26.865104] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T22:25:27.190696] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-03T22:25:27.853555] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T22:25:27.990735] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-03T22:25:28.790724] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-03T22:25:28.896387] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T22:25:28.898067] [INFO ] [REMOTE ] WOR: Full fetch complete (36669 records). [2025-10-03T22:25:28.898175] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-03T22:25:29.321337] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-03T22:25:29.321450] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-03T22:25:29.322543] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-03T22:25:29.322625] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-03T22:25:29.335144] [DEBUG] [LOCAL ] WOR: Trimmed 36669 records to 25285 (keeping 200 days of data) [2025-10-03T22:25:29.358453] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T22:25:29.541080] [DEBUG] [LOCAL ] WOR: Primary data saved (25285 records). [2025-10-03T22:25:29.541246] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-03T22:25:29.541478] [INFO ] [MAIN ] Update Progress: 2311/2370 symbols completed. WOR took 23.9s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-03T22:25:29.595818] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-03T22:25:29.735001] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:29.788505] [DEBUG] [LOCAL ] WPC: Loaded 48701 existing records from primary storage. [2025-10-03T22:25:29.788924] [INFO ] [MAIN ] WPC: Loaded 48701 existing records. [2025-10-03T22:25:29.989115] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:29.989572] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-03T22:25:29.989667] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-03T22:25:29.989919] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-03T22:25:29.989980] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-03T22:25:30.389382] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:30.400259] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-03T22:25:30.419391] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T22:25:31.190707] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-03T22:25:31.990735] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-03T22:25:32.148214] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-03T22:25:32.192771] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T22:25:32.790728] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-03T22:25:32.837071] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T22:25:33.243872] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:25:33.247022] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-03T22:25:33.247200] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-03T22:25:33.596172] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-03T22:25:33.818299] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-03T22:25:33.818449] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-03T22:25:33.820805] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-03T22:25:33.820908] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-03T22:25:33.826069] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54580 (keeping 200 days of data) [2025-10-03T22:25:34.214721] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-10-03T22:25:34.214942] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-03T22:25:34.215059] [INFO ] [MAIN ] Update Progress: 2312/2370 symbols completed. WMT took 59.3s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-03T22:25:34.406724] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-03T22:25:34.411098] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:34.452002] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-03T22:25:34.514434] [DEBUG] [LOCAL ] WPM: Loaded 53116 existing records from primary storage. [2025-10-03T22:25:34.514921] [INFO ] [MAIN ] WPM: Loaded 53116 existing records. [2025-10-03T22:25:34.654579] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T22:25:34.695305] [INFO ] [REMOTE ] WOW: Full fetch complete (42420 records). [2025-10-03T22:25:34.723416] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-03T22:25:34.729694] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:34.730545] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-03T22:25:34.730609] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-03T22:25:34.745497] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-03T22:25:34.767974] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-03T22:25:35.193269] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-03T22:25:35.546978] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:35.579075] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-03T22:25:35.579143] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-03T22:25:35.580893] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-03T22:25:35.580959] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-03T22:25:35.582188] [DEBUG] [LOCAL ] WOW: Trimmed 42420 records to 30989 (keeping 200 days of data) [2025-10-03T22:25:35.768836] [DEBUG] [LOCAL ] WOW: Primary data saved (30989 records). [2025-10-03T22:25:35.769074] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-03T22:25:35.769211] [INFO ] [MAIN ] Update Progress: 2313/2370 symbols completed. WOW took 25.2s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-03T22:25:35.945557] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:35.983076] [DEBUG] [LOCAL ] WPP: Loaded 34147 existing records from primary storage. [2025-10-03T22:25:35.983463] [INFO ] [MAIN ] WPP: Loaded 34147 existing records. [2025-10-03T22:25:35.996692] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-03T22:25:36.172964] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:36.173390] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-03T22:25:36.173550] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-03T22:25:36.174063] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-03T22:25:36.174131] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-03T22:25:36.309890] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T22:25:36.604101] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:36.790679] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-03T22:25:37.592944] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-03T22:25:37.596964] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-03T22:25:37.602156] [INFO ] [REMOTE ] WOLF: Full fetch complete (77250 records). [2025-10-03T22:25:37.602386] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-03T22:25:38.048523] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-03T22:25:38.081275] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-03T22:25:38.083352] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-03T22:25:38.083732] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-03T22:25:38.085833] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T22:25:38.098597] [DEBUG] [LOCAL ] WOLF: Trimmed 77250 records to 53962 (keeping 200 days of data) [2025-10-03T22:25:38.393584] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-03T22:25:38.444733] [DEBUG] [LOCAL ] WOLF: Primary data saved (53962 records). [2025-10-03T22:25:38.445082] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-03T22:25:38.445240] [INFO ] [MAIN ] Update Progress: 2314/2370 symbols completed. WOLF took 51.7s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-03T22:25:38.651007] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:25:38.675130] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-03T22:25:38.739287] [DEBUG] [LOCAL ] WRB: Loaded 50945 existing records from primary storage. [2025-10-03T22:25:38.739805] [INFO ] [MAIN ] WRB: Loaded 50945 existing records. [2025-10-03T22:25:38.898936] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T22:25:38.978026] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:25:38.978353] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-03T22:25:38.978419] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-03T22:25:38.978687] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-03T22:25:38.978783] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-03T22:25:39.193298] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-03T22:25:39.423191] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:25:39.990728] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-03T22:25:40.187680] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T22:25:40.790695] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-03T22:25:41.096903] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T22:25:41.590639] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-03T22:25:41.652446] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T22:25:42.134359] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T22:25:42.390731] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-03T22:25:43.026036] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T22:25:43.190704] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-03T22:25:43.720162] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T22:25:43.990748] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-03T22:25:44.790725] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-03T22:25:45.078427] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T22:25:45.119207] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T22:25:45.590731] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-03T22:25:46.369742] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T22:25:46.390620] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-03T22:25:47.190751] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-03T22:25:47.349097] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T22:25:47.990637] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-03T22:25:48.102634] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T22:25:48.790740] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-03T22:25:48.924418] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T22:25:49.590744] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-03T22:25:49.991478] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T22:25:50.390746] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-03T22:25:50.568576] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T22:25:51.190736] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-03T22:25:51.409850] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T22:25:51.854425] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T22:25:51.990747] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-03T22:25:52.790740] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-03T22:25:53.062321] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T22:25:53.256214] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T22:25:53.590720] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-03T22:25:54.182965] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T22:25:54.390724] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-03T22:25:55.190623] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-03T22:25:55.296208] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T22:25:55.990741] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-03T22:25:56.154630] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T22:25:56.265637] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T22:25:56.790737] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-03T22:25:57.590718] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-03T22:25:57.880884] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T22:25:58.390729] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-03T22:25:58.545559] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T22:25:59.190740] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-03T22:25:59.370508] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T22:25:59.736366] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T22:25:59.990698] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-03T22:26:00.790636] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-03T22:26:00.976748] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T22:26:01.590745] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-03T22:26:01.861770] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:26:01.903531] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T22:26:01.906092] [INFO ] [REMOTE ] WPC: Full fetch complete (70741 records). [2025-10-03T22:26:01.906368] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-03T22:26:02.342097] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-03T22:26:02.342192] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-03T22:26:02.343557] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-03T22:26:02.343627] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-03T22:26:02.345137] [DEBUG] [LOCAL ] WPC: Trimmed 70741 records to 49077 (keeping 200 days of data) [2025-10-03T22:26:02.402496] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-03T22:26:02.676721] [DEBUG] [LOCAL ] WPC: Primary data saved (49077 records). [2025-10-03T22:26:02.676952] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-03T22:26:02.677605] [INFO ] [MAIN ] Update Progress: 2315/2370 symbols completed. WPC took 33.1s. Estimated remaining: 7m 45s. Rate: 7.1 symbols/min [2025-10-03T22:26:02.865991] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:02.921965] [DEBUG] [LOCAL ] WRBY: Loaded 51140 existing records from primary storage. [2025-10-03T22:26:02.922319] [INFO ] [MAIN ] WRBY: Loaded 51140 existing records. [2025-10-03T22:26:03.123880] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:03.124310] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-03T22:26:03.124414] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-03T22:26:03.124930] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-03T22:26:03.124998] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-03T22:26:03.190951] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-03T22:26:03.263543] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T22:26:03.583018] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:03.990658] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-03T22:26:04.484526] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T22:26:04.790720] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-03T22:26:05.038246] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T22:26:05.602723] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-03T22:26:05.637364] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T22:26:06.390692] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-03T22:26:06.454820] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T22:26:07.190764] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-03T22:26:07.404085] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T22:26:07.990726] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-03T22:26:08.052354] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T22:26:08.438251] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:26:08.441301] [INFO ] [REMOTE ] WRB: Full fetch complete (73350 records). [2025-10-03T22:26:08.441450] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-03T22:26:08.795777] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-03T22:26:08.894988] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-03T22:26:08.895135] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-03T22:26:08.896658] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-03T22:26:08.896848] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-03T22:26:08.898704] [DEBUG] [LOCAL ] WRB: Trimmed 73350 records to 51321 (keeping 200 days of data) [2025-10-03T22:26:09.181740] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T22:26:09.302859] [DEBUG] [LOCAL ] WRB: Primary data saved (51321 records). [2025-10-03T22:26:09.303018] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-03T22:26:09.303197] [INFO ] [MAIN ] Update Progress: 2316/2370 symbols completed. WRB took 30.9s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-03T22:26:09.495463] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:09.521530] [DEBUG] [LOCAL ] WS: Loaded 24178 existing records from primary storage. [2025-10-03T22:26:09.521844] [INFO ] [MAIN ] WS: Loaded 24178 existing records. [2025-10-03T22:26:09.590796] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-03T22:26:09.724904] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:09.725151] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-03T22:26:09.725204] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-03T22:26:09.725510] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-03T22:26:09.725597] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-03T22:26:10.142484] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:10.390679] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-03T22:26:10.471050] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T22:26:11.148440] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T22:26:11.152465] [INFO ] [REMOTE ] WPM: Full fetch complete (75916 records). [2025-10-03T22:26:11.152741] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-03T22:26:11.197392] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-03T22:26:11.649082] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-03T22:26:11.649229] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-03T22:26:11.650810] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-03T22:26:11.650906] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-03T22:26:11.652881] [DEBUG] [LOCAL ] WPM: Trimmed 75916 records to 53501 (keeping 200 days of data) [2025-10-03T22:26:11.998234] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-03T22:26:12.017383] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T22:26:12.051109] [DEBUG] [LOCAL ] WPM: Primary data saved (53501 records). [2025-10-03T22:26:12.051318] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-03T22:26:12.051444] [INFO ] [MAIN ] Update Progress: 2317/2370 symbols completed. WPM took 37.8s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-03T22:26:12.790728] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-03T22:26:13.011444] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T22:26:13.267096] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T22:26:13.590720] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-03T22:26:14.002145] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T22:26:14.005960] [INFO ] [REMOTE ] WPP: Full fetch complete (45776 records). [2025-10-03T22:26:14.006156] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-03T22:26:14.395915] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-03T22:26:14.448859] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-03T22:26:14.448955] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-03T22:26:14.450004] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-03T22:26:14.450072] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-03T22:26:14.451370] [DEBUG] [LOCAL ] WPP: Trimmed 45776 records to 34410 (keeping 200 days of data) [2025-10-03T22:26:14.671899] [DEBUG] [LOCAL ] WPP: Primary data saved (34410 records). [2025-10-03T22:26:14.672048] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-03T22:26:14.672151] [INFO ] [MAIN ] Update Progress: 2318/2370 symbols completed. WPP took 38.9s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-03T22:26:15.436719] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T22:26:15.449609] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-03T22:26:15.489358] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T22:26:15.990705] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-03T22:26:17.215538] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T22:26:17.221752] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-03T22:26:17.276778] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T22:26:17.590706] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-03T22:26:18.494507] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T22:26:18.501211] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-03T22:26:18.982362] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T22:26:19.190680] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-03T22:26:19.628670] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T22:26:19.990721] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-03T22:26:20.641295] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T22:26:20.790723] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-03T22:26:21.047328] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T22:26:21.590751] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-03T22:26:22.384387] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T22:26:22.395977] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-03T22:26:22.415114] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T22:26:23.190747] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-03T22:26:24.059514] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T22:26:24.071639] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-03T22:26:24.113749] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T22:26:24.790731] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-03T22:26:25.443932] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T22:26:25.447103] [INFO ] [REMOTE ] WRBY: Full fetch complete (73489 records). [2025-10-03T22:26:25.447319] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-03T22:26:25.933307] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-03T22:26:25.933439] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-03T22:26:25.934939] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-03T22:26:25.935175] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-03T22:26:25.937003] [DEBUG] [LOCAL ] WRBY: Trimmed 73489 records to 51508 (keeping 200 days of data) [2025-10-03T22:26:26.053833] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T22:26:26.073472] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-03T22:26:26.287593] [DEBUG] [LOCAL ] WRBY: Primary data saved (51508 records). [2025-10-03T22:26:26.287787] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-03T22:26:26.288638] [INFO ] [MAIN ] Update Progress: 2319/2370 symbols completed. WRBY took 23.6s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-03T22:26:27.258033] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T22:26:27.264633] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-03T22:26:28.185038] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T22:26:28.188056] [INFO ] [REMOTE ] WS: Full fetch complete (36707 records). [2025-10-03T22:26:28.188168] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-03T22:26:28.602612] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-03T22:26:28.602724] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-03T22:26:28.603613] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-03T22:26:28.603687] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-03T22:26:28.605343] [DEBUG] [LOCAL ] WS: Trimmed 36707 records to 24345 (keeping 200 days of data) [2025-10-03T22:26:28.763400] [DEBUG] [LOCAL ] WS: Primary data saved (24345 records). [2025-10-03T22:26:28.763594] [INFO ] [MAIN ] WS: Full history saved. [2025-10-03T22:26:28.763759] [INFO ] [MAIN ] Update Progress: 2320/2370 symbols completed. WS took 19.5s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-03T22:26:29.479020] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:29.482412] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:29.501878] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:29.564284] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:29.595171] [DEBUG] [LOCAL ] WSR: Loaded 23174 existing records from primary storage. [2025-10-03T22:26:29.595821] [INFO ] [MAIN ] WSR: Loaded 23174 existing records. [2025-10-03T22:26:29.749214] [DEBUG] [LOCAL ] WSO: Loaded 24887 existing records from primary storage. [2025-10-03T22:26:29.766388] [INFO ] [MAIN ] WSO: Loaded 24887 existing records. [2025-10-03T22:26:29.766174] [DEBUG] [LOCAL ] WST: Loaded 37510 existing records from primary storage. [2025-10-03T22:26:29.836586] [INFO ] [MAIN ] WST: Loaded 37510 existing records. [2025-10-03T22:26:29.923700] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:29.935956] [DEBUG] [LOCAL ] WSM: Loaded 49937 existing records from primary storage. [2025-10-03T22:26:29.941344] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-03T22:26:29.965163] [INFO ] [MAIN ] WSM: Loaded 49937 existing records. [2025-10-03T22:26:30.035519] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-03T22:26:30.152769] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-03T22:26:30.257029] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-03T22:26:30.419418] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:30.522859] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-03T22:26:30.517345] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:30.561629] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-03T22:26:30.590035] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-03T22:26:30.588872] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-03T22:26:30.600615] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-03T22:26:30.609281] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-03T22:26:30.690675] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:30.690967] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-03T22:26:30.744764] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-03T22:26:30.771146] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-03T22:26:30.919635] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-03T22:26:31.050385] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-03T22:26:31.172496] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-03T22:26:31.903575] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:31.917154] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-03T22:26:32.094611] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:32.154005] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-03T22:26:32.147894] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:32.196181] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-03T22:26:32.346100] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:32.346440] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-03T22:26:33.210949] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T22:26:33.215992] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-03T22:26:33.337881] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T22:26:33.342211] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-03T22:26:34.090063] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T22:26:34.095439] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-03T22:26:34.175237] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T22:26:34.180721] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-03T22:26:34.341826] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-03T22:26:34.348678] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-03T22:26:35.097954] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T22:26:35.102433] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-03T22:26:35.158615] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-03T22:26:35.190706] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-03T22:26:35.537294] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T22:26:35.859803] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T22:26:35.990708] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-03T22:26:36.275285] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T22:26:36.611022] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T22:26:36.790750] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-03T22:26:37.590664] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-03T22:26:37.762959] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T22:26:38.390729] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-03T22:26:38.444683] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T22:26:38.763639] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T22:26:39.190717] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-03T22:26:39.990852] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-03T22:26:40.020999] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T22:26:40.248746] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T22:26:40.790931] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-03T22:26:41.590730] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-03T22:26:41.791210] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T22:26:41.973704] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T22:26:42.390697] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-03T22:26:42.856483] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T22:26:43.190731] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-03T22:26:43.990765] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-03T22:26:44.234009] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T22:26:44.393238] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T22:26:44.790741] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-03T22:26:45.590739] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-03T22:26:45.694172] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T22:26:46.390702] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-03T22:26:46.582250] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T22:26:46.722824] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T22:26:47.190751] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-03T22:26:47.529566] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T22:26:47.990708] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-03T22:26:48.711517] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T22:26:48.790629] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-03T22:26:49.169639] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T22:26:49.590716] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-03T22:26:50.260166] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:26:50.390753] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-03T22:26:51.190699] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-03T22:26:51.280008] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:26:51.901773] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T22:26:51.995778] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-03T22:26:52.004759] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T22:26:52.790762] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-03T22:26:53.059041] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T22:26:53.590760] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-03T22:26:54.192458] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T22:26:54.390689] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-03T22:26:55.190670] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-03T22:26:55.393496] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T22:26:55.433372] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T22:26:55.990744] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-03T22:26:56.258887] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T22:26:56.790739] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-03T22:26:57.264419] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T22:26:57.477664] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T22:26:57.479314] [INFO ] [REMOTE ] WSR: Full fetch complete (32894 records). [2025-10-03T22:26:57.479415] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-03T22:26:57.595870] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-03T22:26:57.900724] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-03T22:26:57.900831] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-03T22:26:57.901934] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-03T22:26:57.901998] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-03T22:26:57.902952] [DEBUG] [LOCAL ] WSR: Trimmed 32894 records to 23351 (keeping 200 days of data) [2025-10-03T22:26:58.056171] [DEBUG] [LOCAL ] WSR: Primary data saved (23351 records). [2025-10-03T22:26:58.056362] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-03T22:26:58.056499] [INFO ] [MAIN ] Update Progress: 2321/2370 symbols completed. WSR took 29.3s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-03T22:26:58.238293] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:26:58.294610] [DEBUG] [LOCAL ] WT: Loaded 48073 existing records from primary storage. [2025-10-03T22:26:58.295067] [INFO ] [MAIN ] WT: Loaded 48073 existing records. [2025-10-03T22:26:58.399262] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-03T22:26:58.492478] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:26:58.492897] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-03T22:26:58.492971] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-03T22:26:58.493375] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-03T22:26:58.493441] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-03T22:26:58.861935] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:26:59.155486] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T22:26:59.190612] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-03T22:26:59.990778] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-03T22:27:00.323619] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T22:27:00.332077] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T22:27:00.344720] [INFO ] [REMOTE ] WSO: Full fetch complete (34651 records). [2025-10-03T22:27:00.345384] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-03T22:27:00.726359] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-03T22:27:00.726461] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-03T22:27:00.727589] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-03T22:27:00.727679] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-03T22:27:00.728731] [DEBUG] [LOCAL ] WSO: Trimmed 34651 records to 25075 (keeping 200 days of data) [2025-10-03T22:27:00.791722] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-03T22:27:00.905515] [DEBUG] [LOCAL ] WSO: Primary data saved (25075 records). [2025-10-03T22:27:00.905741] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-03T22:27:00.905905] [INFO ] [MAIN ] Update Progress: 2322/2370 symbols completed. WSO took 32.1s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-03T22:27:01.085148] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:01.133313] [DEBUG] [LOCAL ] WTI: Loaded 44224 existing records from primary storage. [2025-10-03T22:27:01.133813] [INFO ] [MAIN ] WTI: Loaded 44224 existing records. [2025-10-03T22:27:01.321793] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:01.322081] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-03T22:27:01.322181] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-03T22:27:01.322493] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-03T22:27:01.322552] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-03T22:27:01.596750] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-03T22:27:01.696739] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:01.726832] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T22:27:02.100082] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T22:27:02.103136] [INFO ] [REMOTE ] WST: Full fetch complete (53944 records). [2025-10-03T22:27:02.103422] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-03T22:27:02.395860] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-03T22:27:02.536445] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-03T22:27:02.536554] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-03T22:27:02.538159] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-03T22:27:02.538265] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-03T22:27:02.539758] [DEBUG] [LOCAL ] WST: Trimmed 53944 records to 37749 (keeping 200 days of data) [2025-10-03T22:27:02.794379] [DEBUG] [LOCAL ] WST: Primary data saved (37749 records). [2025-10-03T22:27:02.794569] [INFO ] [MAIN ] WST: Full history saved. [2025-10-03T22:27:02.795681] [INFO ] [MAIN ] Update Progress: 2323/2370 symbols completed. WST took 34.0s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-03T22:27:02.984780] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:02.985009] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-03T22:27:02.985051] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-03T22:27:02.985180] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-03T22:27:02.985222] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-03T22:27:02.985264] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-03T22:27:02.985301] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-03T22:27:03.201566] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-03T22:27:03.382723] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:03.434663] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T22:27:03.990764] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-03T22:27:04.232709] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T22:27:04.318780] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-03T22:27:04.790717] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-03T22:27:05.027820] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T22:27:05.220057] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-03T22:27:05.590722] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-03T22:27:06.390698] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-03T22:27:06.824516] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T22:27:07.190681] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-03T22:27:07.245276] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T22:27:07.670894] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T22:27:07.990717] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-03T22:27:08.790734] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-03T22:27:09.254192] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T22:27:09.257476] [INFO ] [REMOTE ] WSM: Full fetch complete (71859 records). [2025-10-03T22:27:09.257615] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-03T22:27:09.595514] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-03T22:27:09.608278] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T22:27:09.711167] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-03T22:27:09.711280] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-03T22:27:09.712988] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-03T22:27:09.713086] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-03T22:27:09.714999] [DEBUG] [LOCAL ] WSM: Trimmed 71859 records to 50270 (keeping 200 days of data) [2025-10-03T22:27:10.048884] [DEBUG] [LOCAL ] WSM: Primary data saved (50270 records). [2025-10-03T22:27:10.049066] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-03T22:27:10.049171] [INFO ] [MAIN ] Update Progress: 2324/2370 symbols completed. WSM took 41.3s. Estimated remaining: 6m 28s. Rate: 7.1 symbols/min [2025-10-03T22:27:10.227192] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:10.298920] [DEBUG] [LOCAL ] WTRG: Loaded 51286 existing records from primary storage. [2025-10-03T22:27:10.299397] [INFO ] [MAIN ] WTRG: Loaded 51286 existing records. [2025-10-03T22:27:10.396851] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-03T22:27:10.479931] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:10.480310] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-03T22:27:10.480385] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-03T22:27:10.480810] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-03T22:27:10.480870] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-03T22:27:10.836292] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:11.005710] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T22:27:11.156307] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T22:27:11.190609] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-03T22:27:11.990720] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-03T22:27:12.412006] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-03T22:27:12.796777] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-03T22:27:12.802286] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T22:27:13.590699] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-03T22:27:14.400582] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-03T22:27:14.420586] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T22:27:15.065000] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T22:27:15.190691] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-03T22:27:15.230391] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T22:27:15.990726] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-03T22:27:16.790676] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-03T22:27:16.835767] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T22:27:17.531116] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T22:27:17.590628] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-03T22:27:18.337016] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T22:27:18.390674] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-03T22:27:19.190701] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-03T22:27:19.232247] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T22:27:19.974938] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T22:27:19.990610] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-03T22:27:20.445372] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T22:27:20.790731] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-03T22:27:21.268938] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T22:27:21.590697] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-03T22:27:21.794958] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T22:27:22.390721] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-03T22:27:22.907098] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T22:27:23.190687] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-03T22:27:23.235795] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T22:27:23.990748] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-03T22:27:24.790702] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-03T22:27:24.957433] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T22:27:25.590816] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-03T22:27:25.727773] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T22:27:26.390721] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-03T22:27:26.573146] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T22:27:27.022965] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T22:27:27.190720] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-03T22:27:27.265097] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T22:27:27.990742] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-03T22:27:28.790689] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-03T22:27:28.896493] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T22:27:29.362728] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T22:27:29.363721] [INFO ] [REMOTE ] WTM: Full fetch complete (2493 records). [2025-10-03T22:27:29.363814] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-03T22:27:29.553147] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T22:27:29.553626] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T22:27:29.553931] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T22:27:29.554037] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-03T22:27:29.554198] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-03T22:27:29.554280] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-03T22:27:29.554464] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-03T22:27:29.554591] [INFO ] [MAIN ] Update Progress: 2325/2370 symbols completed. WTM took 26.8s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-03T22:27:29.591613] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-03T22:27:29.745078] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:29.782017] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T22:27:29.808987] [DEBUG] [LOCAL ] WTS: Loaded 18239 existing records from primary storage. [2025-10-03T22:27:29.809350] [INFO ] [MAIN ] WTS: Loaded 18239 existing records. [2025-10-03T22:27:29.995014] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:29.995346] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-03T22:27:29.995411] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-03T22:27:29.995971] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-03T22:27:29.996033] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-03T22:27:30.365273] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:30.390680] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-03T22:27:31.190693] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-03T22:27:31.373028] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T22:27:31.396858] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T22:27:31.990739] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-03T22:27:32.501157] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T22:27:32.504108] [INFO ] [REMOTE ] WT: Full fetch complete (69274 records). [2025-10-03T22:27:32.504291] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-03T22:27:32.795783] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-03T22:27:32.908812] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-03T22:27:32.908922] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-03T22:27:32.910705] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-03T22:27:32.910774] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-03T22:27:32.912852] [DEBUG] [LOCAL ] WT: Trimmed 69274 records to 48451 (keeping 200 days of data) [2025-10-03T22:27:33.239065] [DEBUG] [LOCAL ] WT: Primary data saved (48451 records). [2025-10-03T22:27:33.239243] [INFO ] [MAIN ] WT: Full history saved. [2025-10-03T22:27:33.240087] [INFO ] [MAIN ] Update Progress: 2326/2370 symbols completed. WT took 35.2s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-03T22:27:33.416380] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:33.469184] [DEBUG] [LOCAL ] WTTR: Loaded 45266 existing records from primary storage. [2025-10-03T22:27:33.469585] [INFO ] [MAIN ] WTTR: Loaded 45266 existing records. [2025-10-03T22:27:33.595724] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-03T22:27:33.666473] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:33.666739] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-03T22:27:33.666797] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-03T22:27:33.667456] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-03T22:27:33.667562] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-03T22:27:34.052511] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:34.083394] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T22:27:34.293394] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T22:27:34.390619] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-03T22:27:34.748092] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T22:27:35.190754] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-03T22:27:35.990708] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-03T22:27:36.158848] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T22:27:36.488272] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T22:27:36.790754] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-03T22:27:37.590695] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-03T22:27:37.673552] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T22:27:38.390713] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-03T22:27:38.640223] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T22:27:38.690892] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T22:27:39.190741] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-03T22:27:39.990720] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-03T22:27:40.056095] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T22:27:40.790697] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-03T22:27:40.886073] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T22:27:41.101897] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T22:27:41.590732] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-03T22:27:41.964968] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:27:41.967459] [INFO ] [REMOTE ] WTI: Full fetch complete (64022 records). [2025-10-03T22:27:41.967578] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-03T22:27:42.374166] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-03T22:27:42.374282] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-03T22:27:42.378080] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-03T22:27:42.378165] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-03T22:27:42.380070] [DEBUG] [LOCAL ] WTI: Trimmed 64022 records to 44520 (keeping 200 days of data) [2025-10-03T22:27:42.430116] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-03T22:27:42.671524] [DEBUG] [LOCAL ] WTI: Primary data saved (44520 records). [2025-10-03T22:27:42.671756] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-03T22:27:42.671922] [INFO ] [MAIN ] Update Progress: 2327/2370 symbols completed. WTI took 41.8s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-03T22:27:42.843634] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:42.902601] [DEBUG] [LOCAL ] WU: Loaded 53843 existing records from primary storage. [2025-10-03T22:27:42.903121] [INFO ] [MAIN ] WU: Loaded 53843 existing records. [2025-10-03T22:27:43.085828] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:43.086317] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-03T22:27:43.086402] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-03T22:27:43.086790] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-03T22:27:43.086874] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-03T22:27:43.195780] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-03T22:27:43.480582] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:43.497173] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T22:27:43.990683] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-03T22:27:44.353534] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T22:27:44.405471] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T22:27:44.790735] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-03T22:27:45.590700] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-03T22:27:45.659769] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T22:27:45.776195] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T22:27:46.390736] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-03T22:27:46.914119] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T22:27:46.918535] [INFO ] [REMOTE ] WTRG: Full fetch complete (73460 records). [2025-10-03T22:27:46.918832] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-03T22:27:47.195896] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-03T22:27:47.363159] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-03T22:27:47.363248] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-03T22:27:47.364549] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-03T22:27:47.364617] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-03T22:27:47.366783] [DEBUG] [LOCAL ] WTRG: Trimmed 73460 records to 51656 (keeping 200 days of data) [2025-10-03T22:27:47.702064] [DEBUG] [LOCAL ] WTRG: Primary data saved (51656 records). [2025-10-03T22:27:47.702246] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-03T22:27:47.702368] [INFO ] [MAIN ] Update Progress: 2328/2370 symbols completed. WTRG took 37.7s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-03T22:27:47.890573] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:27:47.905469] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T22:27:47.953633] [DEBUG] [LOCAL ] WWW: Loaded 49485 existing records from primary storage. [2025-10-03T22:27:47.954046] [INFO ] [MAIN ] WWW: Loaded 49485 existing records. [2025-10-03T22:27:47.997696] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-03T22:27:48.152974] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:27:48.153254] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-03T22:27:48.153316] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-03T22:27:48.153573] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-03T22:27:48.153634] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-03T22:27:48.527282] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:27:48.790751] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-03T22:27:49.013195] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T22:27:49.590735] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-03T22:27:49.857765] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T22:27:49.914587] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T22:27:50.390716] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-03T22:27:51.157949] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T22:27:51.190688] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-03T22:27:51.990713] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-03T22:27:52.201602] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T22:27:52.790680] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-03T22:27:52.935771] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T22:27:53.550205] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T22:27:53.590716] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-03T22:27:54.288669] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T22:27:54.390726] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-03T22:27:55.117543] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T22:27:55.190728] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-03T22:27:55.993209] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-03T22:27:55.996546] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T22:27:56.790696] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-03T22:27:56.880081] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T22:27:57.130417] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T22:27:57.590687] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-03T22:27:58.284381] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T22:27:58.390686] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-03T22:27:58.860971] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T22:27:59.190701] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-03T22:27:59.951332] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T22:27:59.952740] [INFO ] [REMOTE ] WTS: Full fetch complete (26092 records). [2025-10-03T22:27:59.952814] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-03T22:27:59.995805] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-03T22:28:00.328078] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T22:28:00.473090] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-03T22:28:00.473198] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-03T22:28:00.474402] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-03T22:28:00.474471] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-03T22:28:00.475399] [DEBUG] [LOCAL ] WTS: Trimmed 26092 records to 18320 (keeping 200 days of data) [2025-10-03T22:28:00.609776] [DEBUG] [LOCAL ] WTS: Primary data saved (18320 records). [2025-10-03T22:28:00.609988] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-03T22:28:00.610150] [INFO ] [MAIN ] Update Progress: 2329/2370 symbols completed. WTS took 31.1s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-03T22:28:00.784252] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:00.790737] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-03T22:28:00.852097] [DEBUG] [LOCAL ] WY: Loaded 53514 existing records from primary storage. [2025-10-03T22:28:00.852638] [INFO ] [MAIN ] WY: Loaded 53514 existing records. [2025-10-03T22:28:01.031785] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:01.032140] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-03T22:28:01.032199] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-03T22:28:01.032509] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-03T22:28:01.032568] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-03T22:28:01.408920] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:01.590704] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-03T22:28:01.706050] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T22:28:01.825106] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T22:28:01.827997] [INFO ] [REMOTE ] WTTR: Full fetch complete (65626 records). [2025-10-03T22:28:01.828168] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-03T22:28:02.257308] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-03T22:28:02.257487] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-03T22:28:02.259260] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-03T22:28:02.259346] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-03T22:28:02.261536] [DEBUG] [LOCAL ] WTTR: Trimmed 65626 records to 45598 (keeping 200 days of data) [2025-10-03T22:28:02.391208] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-03T22:28:02.558693] [DEBUG] [LOCAL ] WTTR: Primary data saved (45598 records). [2025-10-03T22:28:02.558871] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-03T22:28:02.559554] [INFO ] [MAIN ] Update Progress: 2330/2370 symbols completed. WTTR took 29.3s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-03T22:28:02.740944] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:02.774859] [DEBUG] [LOCAL ] XFLT: Loaded 30037 existing records from primary storage. [2025-10-03T22:28:02.775191] [INFO ] [MAIN ] XFLT: Loaded 30037 existing records. [2025-10-03T22:28:02.970324] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:02.970612] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-03T22:28:02.970727] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-03T22:28:02.970971] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-03T22:28:02.971030] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-03T22:28:03.199890] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-03T22:28:03.364199] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:03.643480] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T22:28:03.990718] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-03T22:28:04.653827] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-03T22:28:04.790622] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-03T22:28:05.113912] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T22:28:05.590670] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-03T22:28:05.787554] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T22:28:06.390696] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-03T22:28:06.656968] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T22:28:06.700310] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T22:28:07.190771] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-03T22:28:07.990673] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-03T22:28:08.186309] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T22:28:08.790686] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-03T22:28:08.979460] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T22:28:09.349804] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T22:28:09.590759] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-03T22:28:10.390636] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-03T22:28:10.878859] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T22:28:11.190666] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-03T22:28:11.279891] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:28:11.630987] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T22:28:11.990761] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-03T22:28:12.790676] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-03T22:28:13.121185] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T22:28:13.326465] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T22:28:13.590747] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-03T22:28:14.345977] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T22:28:14.390669] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-03T22:28:15.190766] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-03T22:28:15.388860] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T22:28:15.692191] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T22:28:15.990720] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-03T22:28:16.790677] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-03T22:28:17.056143] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T22:28:17.336103] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T22:28:17.590728] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-03T22:28:18.390682] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-03T22:28:18.706407] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T22:28:18.762281] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T22:28:19.190718] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-03T22:28:19.990632] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-03T22:28:20.169725] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T22:28:20.790785] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-03T22:28:20.910731] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T22:28:21.590748] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-03T22:28:21.983335] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T22:28:22.301477] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T22:28:22.304589] [INFO ] [REMOTE ] WU: Full fetch complete (77354 records). [2025-10-03T22:28:22.304840] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-03T22:28:22.395947] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-03T22:28:22.730757] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-03T22:28:22.730880] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-03T22:28:22.732922] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-03T22:28:22.732991] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-03T22:28:22.735142] [DEBUG] [LOCAL ] WU: Trimmed 77354 records to 54233 (keeping 200 days of data) [2025-10-03T22:28:22.997405] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T22:28:23.007130] [INFO ] [REMOTE ] WWW: Full fetch complete (70270 records). [2025-10-03T22:28:23.007427] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-03T22:28:23.192042] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-03T22:28:23.536429] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-03T22:28:23.536927] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-03T22:28:23.540739] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-03T22:28:23.541371] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-03T22:28:23.546128] [DEBUG] [LOCAL ] WU: Primary data saved (54233 records). [2025-10-03T22:28:23.546524] [INFO ] [MAIN ] WU: Full history saved. [2025-10-03T22:28:23.546850] [INFO ] [MAIN ] Update Progress: 2331/2370 symbols completed. WU took 40.9s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-03T22:28:23.579981] [DEBUG] [LOCAL ] WWW: Trimmed 70270 records to 49849 (keeping 200 days of data) [2025-10-03T22:28:23.831838] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:23.850715] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T22:28:23.915429] [DEBUG] [LOCAL ] XHR: Loaded 44004 existing records from primary storage. [2025-10-03T22:28:23.917454] [INFO ] [MAIN ] XHR: Loaded 44004 existing records. [2025-10-03T22:28:23.995812] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-03T22:28:24.123383] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:24.187196] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-03T22:28:24.213278] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-03T22:28:24.214028] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-03T22:28:24.214472] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-03T22:28:24.646029] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:24.738772] [DEBUG] [LOCAL ] WWW: Primary data saved (49849 records). [2025-10-03T22:28:24.738979] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-03T22:28:24.739107] [INFO ] [MAIN ] Update Progress: 2332/2370 symbols completed. WWW took 37.0s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-03T22:28:24.799124] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-03T22:28:24.928487] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:24.928978] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-03T22:28:24.929056] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-03T22:28:24.929229] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-03T22:28:24.929404] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-03T22:28:24.929547] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-03T22:28:24.929616] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-03T22:28:25.312322] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T22:28:25.404979] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:25.463305] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T22:28:25.590758] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-03T22:28:25.800440] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:28:25.800923] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-03T22:28:25.801008] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:28:25.801064] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-03T22:28:25.801100] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:28:25.801142] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-03T22:28:25.801205] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-03T22:28:25.801248] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-03T22:28:25.801316] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-03T22:28:25.801390] [INFO ] [MAIN ] Update Progress: 2333/2370 symbols completed. XIFR took 1.1s. Estimated remaining: 5m 12s. Rate: 7.1 symbols/min [2025-10-03T22:28:25.994226] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:26.024852] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T22:28:26.088577] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-03T22:28:26.089277] [INFO ] [MAIN ] XOM: Loaded 54183 existing records. [2025-10-03T22:28:26.272755] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:26.273067] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-03T22:28:26.273119] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-03T22:28:26.273441] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-03T22:28:26.273502] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-03T22:28:26.395923] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-03T22:28:26.643705] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:27.190807] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-03T22:28:27.829917] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T22:28:27.990783] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-03T22:28:28.790753] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-03T22:28:29.367559] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T22:28:29.590701] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-03T22:28:29.696083] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-03T22:28:29.799158] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T22:28:30.338429] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T22:28:30.340571] [INFO ] [REMOTE ] XFLT: Full fetch complete (44137 records). [2025-10-03T22:28:30.340703] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-03T22:28:30.399882] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-03T22:28:30.766225] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-03T22:28:30.766482] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-03T22:28:30.767514] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-03T22:28:30.767581] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-03T22:28:30.768868] [DEBUG] [LOCAL ] XFLT: Trimmed 44137 records to 30237 (keeping 200 days of data) [2025-10-03T22:28:30.974828] [DEBUG] [LOCAL ] XFLT: Primary data saved (30237 records). [2025-10-03T22:28:30.974997] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-03T22:28:30.975735] [INFO ] [MAIN ] Update Progress: 2334/2370 symbols completed. XFLT took 28.4s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-03T22:28:31.161855] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:31.195033] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-03T22:28:31.195866] [DEBUG] [LOCAL ] XPER: Loaded 30056 existing records from primary storage. [2025-10-03T22:28:31.197519] [INFO ] [MAIN ] XPER: Loaded 30056 existing records. [2025-10-03T22:28:31.407260] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:31.407711] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-03T22:28:31.407775] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-03T22:28:31.408374] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-03T22:28:31.408445] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-03T22:28:31.818476] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:31.990697] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-03T22:28:32.317800] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T22:28:32.790727] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-03T22:28:33.314982] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T22:28:33.432586] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-03T22:28:33.590731] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-03T22:28:34.262459] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T22:28:34.390719] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-03T22:28:34.803484] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T22:28:35.190763] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-03T22:28:35.990667] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-03T22:28:36.424199] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T22:28:36.552841] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-03T22:28:36.790706] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-03T22:28:37.582981] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T22:28:37.592731] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-03T22:28:38.390727] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-03T22:28:38.895845] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T22:28:39.189525] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-03T22:28:39.200174] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-03T22:28:39.998312] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-03T22:28:40.024062] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T22:28:40.616711] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T22:28:40.790730] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-03T22:28:41.338735] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T22:28:41.590738] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-03T22:28:42.390704] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-03T22:28:42.554862] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T22:28:42.830270] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T22:28:43.190737] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-03T22:28:43.990688] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-03T22:28:44.082678] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T22:28:44.790713] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-03T22:28:44.848134] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-03T22:28:45.590697] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-03T22:28:45.712907] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T22:28:46.187939] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T22:28:46.390713] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-03T22:28:46.841788] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:28:46.844601] [INFO ] [REMOTE ] WY: Full fetch complete (76846 records). [2025-10-03T22:28:46.844798] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-03T22:28:47.197270] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-03T22:28:47.314094] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-03T22:28:47.314399] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-03T22:28:47.315965] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-03T22:28:47.324697] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-03T22:28:47.345386] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T22:28:47.345585] [DEBUG] [LOCAL ] WY: Trimmed 76846 records to 53893 (keeping 200 days of data) [2025-10-03T22:28:47.723214] [DEBUG] [LOCAL ] WY: Primary data saved (53893 records). [2025-10-03T22:28:47.723760] [INFO ] [MAIN ] WY: Full history saved. [2025-10-03T22:28:47.723958] [INFO ] [MAIN ] Update Progress: 2335/2370 symbols completed. WY took 47.1s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-03T22:28:47.935810] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:47.990262] [DEBUG] [LOCAL ] XPEV: Loaded 54026 existing records from primary storage. [2025-10-03T22:28:47.990616] [INFO ] [MAIN ] XPEV: Loaded 54026 existing records. [2025-10-03T22:28:47.990727] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-03T22:28:48.180907] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:48.181138] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-03T22:28:48.181235] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-03T22:28:48.181618] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-03T22:28:48.181726] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-03T22:28:48.581912] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:48.673594] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T22:28:48.790688] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-03T22:28:49.590675] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-03T22:28:49.650708] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T22:28:50.188005] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T22:28:50.390695] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-03T22:28:51.190739] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-03T22:28:51.975773] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T22:28:51.990613] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-03T22:28:52.794888] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T22:28:52.792598] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-03T22:28:52.829791] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-03T22:28:53.590700] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-03T22:28:54.041636] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T22:28:54.044209] [INFO ] [REMOTE ] XPER: Full fetch complete (43300 records). [2025-10-03T22:28:54.044348] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-03T22:28:54.392017] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-03T22:28:54.466975] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-03T22:28:54.467095] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-03T22:28:54.468403] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-03T22:28:54.468488] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-03T22:28:54.502827] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-03T22:28:54.501626] [DEBUG] [LOCAL ] XPER: Trimmed 43300 records to 30362 (keeping 200 days of data) [2025-10-03T22:28:54.692960] [DEBUG] [LOCAL ] XPER: Primary data saved (30362 records). [2025-10-03T22:28:54.693125] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-03T22:28:54.695035] [INFO ] [MAIN ] Update Progress: 2336/2370 symbols completed. XPER took 23.7s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-03T22:28:54.885288] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:54.913479] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T22:28:54.967463] [DEBUG] [LOCAL ] XPO: Loaded 48181 existing records from primary storage. [2025-10-03T22:28:54.967934] [INFO ] [MAIN ] XPO: Loaded 48181 existing records. [2025-10-03T22:28:55.152754] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:55.153001] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-03T22:28:55.153054] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-03T22:28:55.153338] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-03T22:28:55.153398] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-03T22:28:55.196382] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-03T22:28:55.530864] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:55.990693] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-03T22:28:56.790762] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-03T22:28:56.876639] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T22:28:57.265702] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T22:28:57.268927] [INFO ] [REMOTE ] XHR: Full fetch complete (61718 records). [2025-10-03T22:28:57.269149] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-03T22:28:57.591685] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-03T22:28:57.733101] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-03T22:28:57.733456] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-03T22:28:57.734941] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-03T22:28:57.735011] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-03T22:28:57.766713] [DEBUG] [LOCAL ] XHR: Trimmed 61718 records to 44335 (keeping 200 days of data) [2025-10-03T22:28:57.768732] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-03T22:28:58.075930] [DEBUG] [LOCAL ] XHR: Primary data saved (44335 records). [2025-10-03T22:28:58.076085] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-03T22:28:58.076198] [INFO ] [MAIN ] Update Progress: 2337/2370 symbols completed. XHR took 34.5s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-03T22:28:58.252184] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:28:58.288494] [DEBUG] [LOCAL ] XPOF: Loaded 38298 existing records from primary storage. [2025-10-03T22:28:58.288854] [INFO ] [MAIN ] XPOF: Loaded 38298 existing records. [2025-10-03T22:28:58.394399] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-03T22:28:58.483208] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:28:58.483496] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-03T22:28:58.483581] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-03T22:28:58.483948] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-03T22:28:58.484042] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-03T22:28:58.854074] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T22:28:58.934802] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:28:59.190692] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-03T22:28:59.990635] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-03T22:29:00.065780] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-03T22:29:00.790703] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-03T22:29:00.821943] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T22:29:00.961540] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T22:29:01.116835] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-03T22:29:01.590712] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-03T22:29:02.390700] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-03T22:29:03.190682] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-03T22:29:03.268010] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T22:29:03.318169] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-03T22:29:03.990627] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-03T22:29:04.083942] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T22:29:04.792244] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-03T22:29:04.799609] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-03T22:29:05.570104] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T22:29:05.590605] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-03T22:29:06.062888] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T22:29:06.390692] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-03T22:29:07.195765] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-03T22:29:07.215207] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T22:29:07.990700] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-03T22:29:08.618500] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T22:29:08.657414] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T22:29:08.790676] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-03T22:29:09.237243] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:29:09.240014] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-03T22:29:09.240140] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-03T22:29:09.593702] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-03T22:29:09.695258] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-03T22:29:09.695483] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-03T22:29:09.696979] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-03T22:29:09.697075] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-03T22:29:09.731284] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T22:29:09.741900] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54573 (keeping 200 days of data) [2025-10-03T22:29:10.122186] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-10-03T22:29:10.122387] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-03T22:29:10.123463] [INFO ] [MAIN ] Update Progress: 2338/2370 symbols completed. XOM took 44.3s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-03T22:29:10.323217] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:10.371108] [DEBUG] [LOCAL ] XPRO: Loaded 46175 existing records from primary storage. [2025-10-03T22:29:10.371507] [INFO ] [MAIN ] XPRO: Loaded 46175 existing records. [2025-10-03T22:29:10.395849] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-03T22:29:10.565194] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:29:10.565510] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-03T22:29:10.565582] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-03T22:29:10.565967] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-03T22:29:10.566027] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-03T22:29:10.969184] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:11.146512] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T22:29:11.190728] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-03T22:29:11.990715] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-03T22:29:12.658689] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T22:29:12.790665] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-03T22:29:12.968753] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-03T22:29:13.212907] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T22:29:13.590697] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-03T22:29:13.662519] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T22:29:14.390712] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-03T22:29:15.190719] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-03T22:29:15.980056] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-03T22:29:15.991179] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-03T22:29:16.046700] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T22:29:16.795813] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-03T22:29:16.809670] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T22:29:17.487573] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T22:29:17.590689] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-03T22:29:18.390696] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-03T22:29:18.529763] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T22:29:18.593502] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T22:29:19.190730] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-03T22:29:19.990717] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-03T22:29:20.734435] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T22:29:20.790625] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-03T22:29:20.831829] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T22:29:21.590742] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-03T22:29:21.708885] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T22:29:22.390721] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-03T22:29:23.054106] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T22:29:23.190692] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-03T22:29:23.253584] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-03T22:29:23.448812] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T22:29:23.990701] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-03T22:29:24.790662] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-03T22:29:24.905884] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T22:29:25.590717] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-03T22:29:26.328859] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T22:29:26.393718] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-03T22:29:26.412276] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-03T22:29:27.064453] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T22:29:27.066986] [INFO ] [REMOTE ] XPO: Full fetch complete (69843 records). [2025-10-03T22:29:27.067101] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-03T22:29:27.195932] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-03T22:29:27.505369] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-03T22:29:27.505465] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-03T22:29:27.506888] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-03T22:29:27.506960] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-03T22:29:27.508544] [DEBUG] [LOCAL ] XPO: Trimmed 69843 records to 48514 (keeping 200 days of data) [2025-10-03T22:29:27.790772] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T22:29:27.861484] [DEBUG] [LOCAL ] XPO: Primary data saved (48514 records). [2025-10-03T22:29:27.861632] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-03T22:29:27.862423] [INFO ] [MAIN ] Update Progress: 2339/2370 symbols completed. XPO took 33.2s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-03T22:29:28.005414] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-03T22:29:28.040780] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:28.079781] [DEBUG] [LOCAL ] XYF: Loaded 28667 existing records from primary storage. [2025-10-03T22:29:28.080103] [INFO ] [MAIN ] XYF: Loaded 28667 existing records. [2025-10-03T22:29:28.274956] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:29:28.275192] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-03T22:29:28.275244] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-03T22:29:28.275526] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-03T22:29:28.275587] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-03T22:29:28.668603] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:28.790726] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-03T22:29:29.068328] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T22:29:29.070221] [INFO ] [REMOTE ] XPOF: Full fetch complete (52276 records). [2025-10-03T22:29:29.070319] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-03T22:29:29.435830] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-03T22:29:29.464941] [INFO ] [REMOTE ] XPEV: Full fetch complete (77679 records). [2025-10-03T22:29:29.485609] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-03T22:29:29.597673] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-03T22:29:29.618724] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-03T22:29:29.657270] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-03T22:29:29.675509] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-03T22:29:29.691154] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-03T22:29:29.756313] [DEBUG] [LOCAL ] XPOF: Trimmed 52276 records to 38557 (keeping 200 days of data) [2025-10-03T22:29:30.082189] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-03T22:29:30.083757] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-03T22:29:30.086303] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-03T22:29:30.087071] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-03T22:29:30.114117] [DEBUG] [LOCAL ] XPEV: Trimmed 77679 records to 54416 (keeping 200 days of data) [2025-10-03T22:29:30.308795] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T22:29:30.335829] [DEBUG] [LOCAL ] XPOF: Primary data saved (38557 records). [2025-10-03T22:29:30.347391] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-03T22:29:30.353093] [INFO ] [MAIN ] Update Progress: 2340/2370 symbols completed. XPOF took 32.3s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-03T22:29:30.404391] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-03T22:29:30.406387] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T22:29:30.627439] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:30.803277] [DEBUG] [LOCAL ] XYL: Loaded 48309 existing records from primary storage. [2025-10-03T22:29:30.804685] [INFO ] [MAIN ] XYL: Loaded 48309 existing records. [2025-10-03T22:29:31.163173] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:29:31.208455] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T22:29:31.205327] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-03T22:29:31.215331] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-03T22:29:31.216479] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-03T22:29:31.220610] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-03T22:29:31.222490] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-03T22:29:31.606613] [DEBUG] [LOCAL ] XPEV: Primary data saved (54416 records). [2025-10-03T22:29:31.612945] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-03T22:29:31.650740] [INFO ] [MAIN ] Update Progress: 2341/2370 symbols completed. XPEV took 43.9s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-03T22:29:31.805383] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:31.918250] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:31.918451] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-03T22:29:31.918491] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-03T22:29:31.918610] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-03T22:29:31.918681] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-03T22:29:31.918749] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-03T22:29:31.918830] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-03T22:29:31.995875] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-03T22:29:32.303166] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:32.790684] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-03T22:29:32.971088] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T22:29:33.556768] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T22:29:33.590750] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-03T22:29:33.705129] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T22:29:33.818784] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T22:29:33.819134] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-03T22:29:33.819227] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T22:29:33.819280] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-03T22:29:33.819340] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T22:29:33.819414] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-03T22:29:33.819482] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-03T22:29:33.819521] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-03T22:29:33.819562] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-03T22:29:33.819632] [INFO ] [MAIN ] Update Progress: 2342/2370 symbols completed. XYZ took 2.1s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-03T22:29:34.007626] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:34.046192] [DEBUG] [LOCAL ] YALA: Loaded 37423 existing records from primary storage. [2025-10-03T22:29:34.046581] [INFO ] [MAIN ] YALA: Loaded 37423 existing records. [2025-10-03T22:29:34.246007] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:29:34.246280] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-03T22:29:34.246333] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-03T22:29:34.246540] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-03T22:29:34.246601] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-03T22:29:34.390945] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-03T22:29:34.669850] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:35.190730] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-03T22:29:35.991199] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-03T22:29:35.997567] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T22:29:36.056166] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T22:29:36.790637] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-03T22:29:37.162604] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T22:29:37.590737] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-03T22:29:38.390703] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-03T22:29:38.505882] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T22:29:39.185818] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T22:29:39.195321] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-03T22:29:39.353197] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T22:29:39.990705] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-03T22:29:40.790637] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-03T22:29:40.892288] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T22:29:41.216482] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T22:29:41.219014] [INFO ] [REMOTE ] XPRO: Full fetch complete (66429 records). [2025-10-03T22:29:41.219135] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-03T22:29:41.591569] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-03T22:29:41.663619] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-03T22:29:41.663775] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-03T22:29:41.665612] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-03T22:29:41.665779] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-03T22:29:41.668191] [DEBUG] [LOCAL ] XPRO: Trimmed 66429 records to 46504 (keeping 200 days of data) [2025-10-03T22:29:41.747515] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T22:29:41.974029] [DEBUG] [LOCAL ] XPRO: Primary data saved (46504 records). [2025-10-03T22:29:41.974179] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-03T22:29:41.974272] [INFO ] [MAIN ] Update Progress: 2343/2370 symbols completed. XPRO took 31.9s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-03T22:29:42.153920] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:29:42.199085] [DEBUG] [LOCAL ] YELP: Loaded 45636 existing records from primary storage. [2025-10-03T22:29:42.199459] [INFO ] [MAIN ] YELP: Loaded 45636 existing records. [2025-10-03T22:29:42.388686] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:29:42.388978] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-03T22:29:42.389036] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-03T22:29:42.389302] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-03T22:29:42.389362] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-03T22:29:42.400767] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-03T22:29:42.785969] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:29:42.799774] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T22:29:43.190735] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-03T22:29:43.392479] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T22:29:43.990708] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-03T22:29:44.756680] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T22:29:44.790664] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-03T22:29:45.590734] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-03T22:29:45.793518] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T22:29:46.352999] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T22:29:46.390732] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-03T22:29:46.971813] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T22:29:47.190694] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-03T22:29:47.990706] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-03T22:29:48.224911] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T22:29:48.571360] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T22:29:48.790737] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-03T22:29:49.306702] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T22:29:49.590692] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-03T22:29:50.395776] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-03T22:29:50.415272] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:29:51.190714] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-03T22:29:51.247288] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T22:29:51.990721] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-03T22:29:52.151705] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T22:29:52.783078] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T22:29:52.792494] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-03T22:29:53.477006] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T22:29:53.590681] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-03T22:29:54.390679] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-03T22:29:54.492244] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T22:29:54.963974] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T22:29:55.190688] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-03T22:29:55.994791] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-03T22:29:55.998268] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T22:29:56.253504] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T22:29:56.790639] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-03T22:29:57.590695] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-03T22:29:57.752767] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T22:29:58.277002] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T22:29:58.390687] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-03T22:29:58.871578] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T22:29:59.190692] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-03T22:29:59.990688] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-03T22:30:00.034861] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T22:30:00.548081] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T22:30:00.790681] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-03T22:30:00.911626] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T22:30:00.913262] [INFO ] [REMOTE ] XYF: Full fetch complete (32168 records). [2025-10-03T22:30:00.913365] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-03T22:30:01.325267] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-03T22:30:01.325380] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-03T22:30:01.326332] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-03T22:30:01.326402] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-03T22:30:01.327519] [DEBUG] [LOCAL ] XYF: Trimmed 32168 records to 28838 (keeping 200 days of data) [2025-10-03T22:30:01.534801] [DEBUG] [LOCAL ] XYF: Primary data saved (28838 records). [2025-10-03T22:30:01.534968] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-03T22:30:01.535628] [INFO ] [MAIN ] Update Progress: 2344/2370 symbols completed. XYF took 33.7s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-03T22:30:01.595838] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-03T22:30:01.797092] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:01.910241] [DEBUG] [LOCAL ] YETI: Loaded 52866 existing records from primary storage. [2025-10-03T22:30:01.910671] [INFO ] [MAIN ] YETI: Loaded 52866 existing records. [2025-10-03T22:30:02.128549] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:02.128951] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-03T22:30:02.129047] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-03T22:30:02.129302] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-03T22:30:02.129373] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-03T22:30:02.401195] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-03T22:30:02.558300] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:02.599523] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T22:30:03.190639] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-03T22:30:03.555350] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T22:30:03.990683] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-03T22:30:04.079413] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T22:30:04.790630] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-03T22:30:04.831577] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T22:30:05.590637] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-03T22:30:05.622391] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T22:30:06.130310] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T22:30:06.390728] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-03T22:30:07.021096] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T22:30:07.190717] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-03T22:30:07.323672] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T22:30:07.325510] [INFO ] [REMOTE ] YALA: Full fetch complete (46568 records). [2025-10-03T22:30:07.325862] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-03T22:30:07.741757] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-03T22:30:07.741864] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-03T22:30:07.743134] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-03T22:30:07.743208] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-03T22:30:07.744556] [DEBUG] [LOCAL ] YALA: Trimmed 46568 records to 37631 (keeping 200 days of data) [2025-10-03T22:30:07.982903] [DEBUG] [LOCAL ] YALA: Primary data saved (37631 records). [2025-10-03T22:30:07.983130] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-03T22:30:07.983254] [INFO ] [MAIN ] Update Progress: 2345/2370 symbols completed. YALA took 34.2s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-03T22:30:07.996136] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-03T22:30:08.182736] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:08.225052] [DEBUG] [LOCAL ] YEXT: Loaded 43429 existing records from primary storage. [2025-10-03T22:30:08.225411] [INFO ] [MAIN ] YEXT: Loaded 43429 existing records. [2025-10-03T22:30:08.424938] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:08.425150] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-03T22:30:08.425201] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-03T22:30:08.425456] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-03T22:30:08.425516] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-03T22:30:08.572911] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T22:30:08.643529] [INFO ] [REMOTE ] XYL: Full fetch complete (69760 records). [2025-10-03T22:30:08.668764] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-03T22:30:08.806774] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-03T22:30:08.978241] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:09.289762] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-03T22:30:09.354313] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-03T22:30:09.354409] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-03T22:30:09.355869] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-03T22:30:09.355940] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-03T22:30:09.357673] [DEBUG] [LOCAL ] XYL: Trimmed 69760 records to 48668 (keeping 200 days of data) [2025-10-03T22:30:09.591518] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-03T22:30:09.692922] [DEBUG] [LOCAL ] XYL: Primary data saved (48668 records). [2025-10-03T22:30:09.693120] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-03T22:30:09.693239] [INFO ] [MAIN ] Update Progress: 2346/2370 symbols completed. XYL took 39.3s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-03T22:30:09.880245] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:09.934870] [DEBUG] [LOCAL ] YMM: Loaded 53027 existing records from primary storage. [2025-10-03T22:30:09.935303] [INFO ] [MAIN ] YMM: Loaded 53027 existing records. [2025-10-03T22:30:10.132972] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:10.133214] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-03T22:30:10.133267] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-03T22:30:10.133513] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-03T22:30:10.133576] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-03T22:30:10.402595] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-03T22:30:10.548037] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:10.679949] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T22:30:11.190743] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-03T22:30:11.325726] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T22:30:11.990713] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-03T22:30:12.162177] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T22:30:12.717296] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T22:30:12.790720] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-03T22:30:13.131083] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T22:30:13.590726] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-03T22:30:14.390638] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-03T22:30:14.590288] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T22:30:14.744294] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T22:30:15.190736] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-03T22:30:15.824756] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T22:30:15.827700] [INFO ] [REMOTE ] YELP: Full fetch complete (64501 records). [2025-10-03T22:30:15.827811] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-03T22:30:15.992750] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-03T22:30:16.244275] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-03T22:30:16.244362] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-03T22:30:16.245590] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-03T22:30:16.245685] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-03T22:30:16.247086] [DEBUG] [LOCAL ] YELP: Trimmed 64501 records to 45980 (keeping 200 days of data) [2025-10-03T22:30:16.528384] [DEBUG] [LOCAL ] YELP: Primary data saved (45980 records). [2025-10-03T22:30:16.528587] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-03T22:30:16.528768] [INFO ] [MAIN ] Update Progress: 2347/2370 symbols completed. YELP took 34.6s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-03T22:30:16.709640] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:16.765393] [DEBUG] [LOCAL ] YOU: Loaded 50069 existing records from primary storage. [2025-10-03T22:30:16.765878] [INFO ] [MAIN ] YOU: Loaded 50069 existing records. [2025-10-03T22:30:16.797882] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-03T22:30:17.036066] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:17.037010] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-03T22:30:17.037077] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-03T22:30:17.037479] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-03T22:30:17.037553] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-03T22:30:17.389558] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T22:30:17.476747] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:17.590690] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-03T22:30:17.731381] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T22:30:18.390677] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-03T22:30:18.613680] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T22:30:19.011351] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T22:30:19.190745] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-03T22:30:19.905590] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T22:30:19.990688] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-03T22:30:20.790674] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-03T22:30:20.915982] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T22:30:21.113606] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T22:30:21.590734] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-03T22:30:22.212803] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T22:30:22.390745] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-03T22:30:23.195782] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-03T22:30:23.217117] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T22:30:23.990688] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-03T22:30:24.186181] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T22:30:24.604137] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T22:30:24.790733] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-03T22:30:25.590631] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-03T22:30:25.854786] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T22:30:26.390715] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-03T22:30:26.445396] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T22:30:26.663305] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T22:30:27.190754] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-03T22:30:27.990739] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-03T22:30:28.199746] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T22:30:28.740481] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T22:30:28.790676] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-03T22:30:29.590623] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-03T22:30:29.720625] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T22:30:30.390740] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-03T22:30:30.675543] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T22:30:31.190676] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-03T22:30:31.400156] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T22:30:31.981511] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T22:30:31.991078] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-03T22:30:32.790702] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-03T22:30:32.886943] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T22:30:33.590730] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-03T22:30:33.861874] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T22:30:34.390718] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-03T22:30:34.663749] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T22:30:35.190703] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-03T22:30:35.332589] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T22:30:35.560487] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T22:30:35.563232] [INFO ] [REMOTE ] YEXT: Full fetch complete (63208 records). [2025-10-03T22:30:35.563352] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-03T22:30:35.992045] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-03T22:30:36.041405] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-03T22:30:36.041518] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-03T22:30:36.042943] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-03T22:30:36.043015] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-03T22:30:36.050186] [DEBUG] [LOCAL ] YEXT: Trimmed 63208 records to 43743 (keeping 200 days of data) [2025-10-03T22:30:36.330159] [DEBUG] [LOCAL ] YEXT: Primary data saved (43743 records). [2025-10-03T22:30:36.330319] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-03T22:30:36.330482] [INFO ] [MAIN ] Update Progress: 2348/2370 symbols completed. YEXT took 28.3s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-03T22:30:36.527617] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:36.591500] [DEBUG] [LOCAL ] YPF: Loaded 50883 existing records from primary storage. [2025-10-03T22:30:36.592000] [INFO ] [MAIN ] YPF: Loaded 50883 existing records. [2025-10-03T22:30:36.798307] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:36.794712] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-03T22:30:36.799032] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-03T22:30:36.799352] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-03T22:30:36.801251] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-03T22:30:36.801319] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-03T22:30:37.009528] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T22:30:37.247579] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:37.590760] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-03T22:30:37.682391] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:30:38.163426] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T22:30:38.166173] [INFO ] [REMOTE ] YETI: Full fetch complete (75443 records). [2025-10-03T22:30:38.166324] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-03T22:30:38.395938] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-03T22:30:38.619500] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-03T22:30:38.619663] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-03T22:30:38.621600] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-03T22:30:38.621723] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-03T22:30:38.624031] [DEBUG] [LOCAL ] YETI: Trimmed 75443 records to 53220 (keeping 200 days of data) [2025-10-03T22:30:38.971451] [DEBUG] [LOCAL ] YETI: Primary data saved (53220 records). [2025-10-03T22:30:38.971606] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-03T22:30:38.973944] [INFO ] [MAIN ] Update Progress: 2349/2370 symbols completed. YETI took 37.4s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-03T22:30:39.169798] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:39.186936] [DEBUG] [LOCAL ] YRD: Loaded 12702 existing records from primary storage. [2025-10-03T22:30:39.187229] [INFO ] [MAIN ] YRD: Loaded 12702 existing records. [2025-10-03T22:30:39.209083] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-03T22:30:39.394309] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:39.394926] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-03T22:30:39.395150] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-03T22:30:39.395535] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-03T22:30:39.395681] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-03T22:30:39.590937] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T22:30:39.892374] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:39.990746] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-03T22:30:40.349306] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T22:30:40.790741] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-03T22:30:41.083449] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:30:41.590741] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-03T22:30:41.726403] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T22:30:41.879148] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T22:30:42.390669] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-03T22:30:43.190636] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-03T22:30:43.208787] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T22:30:43.439496] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T22:30:43.990704] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-03T22:30:44.790681] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-03T22:30:44.851602] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T22:30:45.057800] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T22:30:45.590700] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-03T22:30:46.390764] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-03T22:30:46.537073] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T22:30:46.706482] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T22:30:47.190733] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-03T22:30:47.990675] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-03T22:30:48.193540] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T22:30:48.579615] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T22:30:48.790733] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-03T22:30:48.961284] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T22:30:49.590714] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-03T22:30:50.390676] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-03T22:30:50.465604] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T22:30:50.859943] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T22:30:50.862906] [INFO ] [REMOTE ] YMM: Full fetch complete (76377 records). [2025-10-03T22:30:50.863050] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-03T22:30:51.192808] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-03T22:30:51.307511] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-03T22:30:51.307681] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-03T22:30:51.309537] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-03T22:30:51.309683] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-03T22:30:51.312015] [DEBUG] [LOCAL ] YMM: Trimmed 76377 records to 53399 (keeping 200 days of data) [2025-10-03T22:30:51.418124] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T22:30:51.674525] [DEBUG] [LOCAL ] YMM: Primary data saved (53399 records). [2025-10-03T22:30:51.674725] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-03T22:30:51.674832] [INFO ] [MAIN ] Update Progress: 2350/2370 symbols completed. YMM took 42.0s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-03T22:30:51.871833] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:51.898548] [DEBUG] [LOCAL ] YSG: Loaded 25699 existing records from primary storage. [2025-10-03T22:30:51.898868] [INFO ] [MAIN ] YSG: Loaded 25699 existing records. [2025-10-03T22:30:51.995867] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-03T22:30:52.086636] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:52.086902] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-03T22:30:52.086953] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-03T22:30:52.087219] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-03T22:30:52.087278] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-03T22:30:52.474538] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:52.596549] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T22:30:52.599499] [INFO ] [REMOTE ] YOU: Full fetch complete (72137 records). [2025-10-03T22:30:52.599639] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-03T22:30:52.793594] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-03T22:30:53.028470] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T22:30:53.061310] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-03T22:30:53.061693] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-03T22:30:53.063299] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-03T22:30:53.063370] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-03T22:30:53.065121] [DEBUG] [LOCAL ] YOU: Trimmed 72137 records to 50427 (keeping 200 days of data) [2025-10-03T22:30:53.388808] [DEBUG] [LOCAL ] YOU: Primary data saved (50427 records). [2025-10-03T22:30:53.388972] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-03T22:30:53.389084] [INFO ] [MAIN ] Update Progress: 2351/2370 symbols completed. YOU took 36.9s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-03T22:30:53.586997] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:30:53.590835] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-03T22:30:53.651801] [DEBUG] [LOCAL ] YUM: Loaded 51575 existing records from primary storage. [2025-10-03T22:30:53.652212] [INFO ] [MAIN ] YUM: Loaded 51575 existing records. [2025-10-03T22:30:53.863359] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:30:53.863671] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-03T22:30:53.863751] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-03T22:30:53.864130] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-03T22:30:53.864193] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-03T22:30:54.289602] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:30:54.298945] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T22:30:54.390628] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-03T22:30:54.432339] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T22:30:55.190737] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-03T22:30:55.800004] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T22:30:55.990697] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-03T22:30:56.790664] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-03T22:30:57.079837] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T22:30:57.590714] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-03T22:30:57.608369] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T22:30:57.765860] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T22:30:58.390724] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-03T22:30:59.003320] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T22:30:59.190787] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-03T22:30:59.989218] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T22:30:59.992931] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-03T22:31:00.084756] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T22:31:00.790806] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-03T22:31:01.490170] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T22:31:01.492081] [INFO ] [REMOTE ] YRD: Full fetch complete (19078 records). [2025-10-03T22:31:01.492321] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-03T22:31:01.593138] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-03T22:31:01.922482] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-03T22:31:01.922985] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-03T22:31:01.923758] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-03T22:31:01.923885] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-03T22:31:01.925075] [DEBUG] [LOCAL ] YRD: Trimmed 19078 records to 12794 (keeping 200 days of data) [2025-10-03T22:31:02.027802] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-03T22:31:02.061930] [DEBUG] [LOCAL ] YRD: Primary data saved (12794 records). [2025-10-03T22:31:02.062161] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-03T22:31:02.062315] [INFO ] [MAIN ] Update Progress: 2352/2370 symbols completed. YRD took 23.1s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-03T22:31:02.243503] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:31:02.304729] [DEBUG] [LOCAL ] YUMC: Loaded 53032 existing records from primary storage. [2025-10-03T22:31:02.305086] [INFO ] [MAIN ] YUMC: Loaded 53032 existing records. [2025-10-03T22:31:02.397547] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-03T22:31:02.497822] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:31:02.498185] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-03T22:31:02.498257] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-03T22:31:02.498913] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-03T22:31:02.498975] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-03T22:31:02.912000] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:31:03.190735] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-03T22:31:03.326329] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T22:31:03.476420] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T22:31:03.990719] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-03T22:31:04.790690] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-03T22:31:05.074543] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T22:31:05.583093] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T22:31:05.590604] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-03T22:31:05.727410] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T22:31:06.390704] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-03T22:31:06.541408] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T22:31:07.190745] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-03T22:31:07.990722] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-03T22:31:08.183526] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T22:31:08.790693] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-03T22:31:08.889449] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T22:31:09.590748] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-03T22:31:09.834774] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T22:31:10.282172] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T22:31:10.285144] [INFO ] [REMOTE ] YPF: Full fetch complete (73487 records). [2025-10-03T22:31:10.285278] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-03T22:31:10.398538] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-03T22:31:10.723475] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-03T22:31:10.723579] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-03T22:31:10.725065] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-03T22:31:10.725140] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-03T22:31:10.726927] [DEBUG] [LOCAL ] YPF: Trimmed 73487 records to 51246 (keeping 200 days of data) [2025-10-03T22:31:11.049054] [DEBUG] [LOCAL ] YPF: Primary data saved (51246 records). [2025-10-03T22:31:11.049261] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-03T22:31:11.049407] [INFO ] [MAIN ] Update Progress: 2353/2370 symbols completed. YPF took 34.7s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-03T22:31:11.195812] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-03T22:31:11.248576] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:31:11.304088] [DEBUG] [LOCAL ] ZBH: Loaded 51404 existing records from primary storage. [2025-10-03T22:31:11.304996] [INFO ] [MAIN ] ZBH: Loaded 51404 existing records. [2025-10-03T22:31:11.442860] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T22:31:11.524281] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:31:11.524680] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-03T22:31:11.524804] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-03T22:31:11.525200] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-03T22:31:11.525271] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-03T22:31:11.682166] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-03T22:31:11.963733] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:31:11.990621] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-03T22:31:12.790675] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-03T22:31:12.994473] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T22:31:13.590702] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-03T22:31:13.719554] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T22:31:13.741502] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T22:31:14.390764] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-03T22:31:15.190686] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-03T22:31:15.435934] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T22:31:15.794965] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T22:31:15.990622] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-03T22:31:16.804400] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-03T22:31:16.826027] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T22:31:17.590766] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-03T22:31:17.760891] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T22:31:18.255169] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T22:31:18.390745] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-03T22:31:19.190755] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-03T22:31:19.465410] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T22:31:19.543570] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T22:31:19.990732] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-03T22:31:20.794316] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T22:31:20.790893] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-03T22:31:21.265443] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T22:31:21.590752] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-03T22:31:22.390708] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-03T22:31:22.662087] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T22:31:23.190729] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-03T22:31:23.537080] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T22:31:23.595921] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T22:31:23.990738] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-03T22:31:24.790741] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-03T22:31:24.874495] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T22:31:24.876603] [INFO ] [REMOTE ] YSG: Full fetch complete (32463 records). [2025-10-03T22:31:24.876723] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-03T22:31:25.346168] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-03T22:31:25.346371] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-03T22:31:25.347278] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-03T22:31:25.347424] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-03T22:31:25.350970] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T22:31:25.362716] [DEBUG] [LOCAL ] YSG: Trimmed 32463 records to 25886 (keeping 200 days of data) [2025-10-03T22:31:25.527511] [DEBUG] [LOCAL ] YSG: Primary data saved (25886 records). [2025-10-03T22:31:25.527746] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-03T22:31:25.527987] [INFO ] [MAIN ] Update Progress: 2354/2370 symbols completed. YSG took 33.9s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-03T22:31:25.602535] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-03T22:31:25.724545] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:31:25.744670] [DEBUG] [LOCAL ] ZEPP: Loaded 17773 existing records from primary storage. [2025-10-03T22:31:25.744951] [INFO ] [MAIN ] ZEPP: Loaded 17773 existing records. [2025-10-03T22:31:25.937426] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:31:25.937697] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-03T22:31:25.937763] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-03T22:31:25.938039] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-03T22:31:25.938102] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-03T22:31:26.351983] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:31:26.390685] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-03T22:31:26.709041] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T22:31:27.190732] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-03T22:31:27.330605] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T22:31:27.535145] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-03T22:31:27.998627] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-03T22:31:28.005098] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T22:31:28.790718] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-03T22:31:29.271414] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T22:31:29.590723] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-03T22:31:29.870250] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T22:31:30.390765] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-03T22:31:30.906874] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T22:31:31.063532] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T22:31:31.190722] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-03T22:31:31.808490] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T22:31:31.990747] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-03T22:31:32.790746] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-03T22:31:33.348745] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T22:31:33.590727] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-03T22:31:33.708544] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T22:31:34.337173] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T22:31:34.390736] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-03T22:31:35.010412] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T22:31:35.190708] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-03T22:31:35.643835] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:31:35.651183] [INFO ] [REMOTE ] YUM: Full fetch complete (74480 records). [2025-10-03T22:31:35.651394] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-03T22:31:35.995870] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-03T22:31:36.092454] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-03T22:31:36.092771] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-03T22:31:36.094288] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-03T22:31:36.094361] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-03T22:31:36.096122] [DEBUG] [LOCAL ] YUM: Trimmed 74480 records to 51935 (keeping 200 days of data) [2025-10-03T22:31:36.449587] [DEBUG] [LOCAL ] YUM: Primary data saved (51935 records). [2025-10-03T22:31:36.449783] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-03T22:31:36.450672] [INFO ] [MAIN ] Update Progress: 2355/2370 symbols completed. YUM took 43.1s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-03T22:31:36.635756] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:31:36.696106] [DEBUG] [LOCAL ] ZETA: Loaded 53987 existing records from primary storage. [2025-10-03T22:31:36.696463] [INFO ] [MAIN ] ZETA: Loaded 53987 existing records. [2025-10-03T22:31:36.795760] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-03T22:31:36.909017] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:31:36.909326] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-03T22:31:36.909420] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-03T22:31:36.909832] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-03T22:31:36.909914] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-03T22:31:37.300417] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:31:37.590685] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-03T22:31:37.660313] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T22:31:38.390729] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-03T22:31:38.699962] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T22:31:39.190685] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-03T22:31:39.377112] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T22:31:39.990706] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-03T22:31:40.790728] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-03T22:31:40.828154] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T22:31:40.971706] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-03T22:31:41.590706] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-03T22:31:41.837717] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T22:31:42.390754] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-03T22:31:42.585154] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T22:31:43.190746] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-03T22:31:43.395628] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T22:31:43.640181] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:31:43.643203] [INFO ] [REMOTE ] ZBH: Full fetch complete (73836 records). [2025-10-03T22:31:43.643392] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-03T22:31:43.998516] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-03T22:31:44.091801] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-03T22:31:44.091921] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-03T22:31:44.093406] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-03T22:31:44.093559] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-03T22:31:44.095254] [DEBUG] [LOCAL ] ZBH: Trimmed 73836 records to 51739 (keeping 200 days of data) [2025-10-03T22:31:44.239910] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T22:31:44.498995] [DEBUG] [LOCAL ] ZBH: Primary data saved (51739 records). [2025-10-03T22:31:44.499187] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-03T22:31:44.499311] [INFO ] [MAIN ] Update Progress: 2356/2370 symbols completed. ZBH took 33.4s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-03T22:31:44.692806] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:31:44.733434] [DEBUG] [LOCAL ] ZGN: Loaded 41016 existing records from primary storage. [2025-10-03T22:31:44.733798] [INFO ] [MAIN ] ZGN: Loaded 41016 existing records. [2025-10-03T22:31:44.795820] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-03T22:31:45.020858] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:31:45.021158] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-03T22:31:45.021238] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-03T22:31:45.021477] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-03T22:31:45.021538] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-03T22:31:45.442857] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T22:31:45.477427] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:31:45.590705] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-03T22:31:46.390748] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-03T22:31:46.588344] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T22:31:46.589628] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19264 records). [2025-10-03T22:31:46.589733] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-03T22:31:46.997481] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-03T22:31:46.997598] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-03T22:31:46.998122] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-03T22:31:46.998192] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-03T22:31:46.999035] [DEBUG] [LOCAL ] ZEPP: Trimmed 19264 records to 17887 (keeping 200 days of data) [2025-10-03T22:31:47.121039] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17887 records). [2025-10-03T22:31:47.121241] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-03T22:31:47.121367] [INFO ] [MAIN ] Update Progress: 2357/2370 symbols completed. ZEPP took 21.6s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-03T22:31:47.190668] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-03T22:31:47.260229] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-03T22:31:47.764077] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T22:31:47.990699] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-03T22:31:48.695620] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T22:31:48.790704] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-03T22:31:49.390860] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T22:31:49.393703] [INFO ] [REMOTE ] YUMC: Full fetch complete (76171 records). [2025-10-03T22:31:49.393827] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-03T22:31:49.600694] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-03T22:31:49.828475] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-03T22:31:49.828584] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-03T22:31:49.830502] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-03T22:31:49.830626] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-03T22:31:49.832502] [DEBUG] [LOCAL ] YUMC: Trimmed 76171 records to 53407 (keeping 200 days of data) [2025-10-03T22:31:50.194455] [DEBUG] [LOCAL ] YUMC: Primary data saved (53407 records). [2025-10-03T22:31:50.194683] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-03T22:31:50.195335] [INFO ] [MAIN ] Update Progress: 2358/2370 symbols completed. YUMC took 48.1s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-03T22:31:50.236581] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T22:31:50.390694] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-03T22:31:51.722694] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T22:31:51.731543] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-03T22:31:52.060523] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-03T22:31:52.075201] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-03T22:31:53.191925] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T22:31:53.206108] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-03T22:31:53.779979] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T22:31:53.792271] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-03T22:31:54.536804] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T22:31:54.551008] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-03T22:31:55.950972] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T22:31:55.964007] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-03T22:31:56.048500] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T22:31:56.058109] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-03T22:31:57.495563] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T22:31:57.504993] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-03T22:31:57.744664] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T22:31:57.757330] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-03T22:31:58.751017] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T22:31:58.761626] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-03T22:32:00.268840] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T22:32:00.283704] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-03T22:32:00.357517] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-03T22:32:00.371706] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-03T22:32:01.763421] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T22:32:01.772994] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-03T22:32:02.915668] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-03T22:32:02.937331] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T22:32:02.940751] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-03T22:32:02.942446] [INFO ] [REMOTE ] ZGN: Full fetch complete (58167 records). [2025-10-03T22:32:02.942619] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-03T22:32:03.373475] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-03T22:32:03.373582] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-03T22:32:03.374951] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-03T22:32:03.375023] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-03T22:32:03.376591] [DEBUG] [LOCAL ] ZGN: Trimmed 58167 records to 41301 (keeping 200 days of data) [2025-10-03T22:32:03.630121] [DEBUG] [LOCAL ] ZGN: Primary data saved (41301 records). [2025-10-03T22:32:03.630263] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-03T22:32:03.630364] [INFO ] [MAIN ] Update Progress: 2359/2370 symbols completed. ZGN took 19.1s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-03T22:32:05.457321] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-03T22:32:05.473166] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-03T22:32:07.490690] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-03T22:32:07.493771] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-03T22:32:07.493972] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-03T22:32:07.931624] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-03T22:32:07.931749] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-03T22:32:07.933300] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-03T22:32:07.933370] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-03T22:32:07.935276] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 54377 (keeping 200 days of data) [2025-10-03T22:32:08.277498] [DEBUG] [LOCAL ] ZETA: Primary data saved (54377 records). [2025-10-03T22:32:08.277688] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-03T22:32:08.277819] [INFO ] [MAIN ] Update Progress: 2360/2370 symbols completed. ZETA took 31.8s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-03T22:32:09.005287] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:09.031668] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:09.062542] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:09.088608] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:09.144611] [DEBUG] [LOCAL ] ZH: Loaded 26565 existing records from primary storage. [2025-10-03T22:32:09.145957] [INFO ] [MAIN ] ZH: Loaded 26565 existing records. [2025-10-03T22:32:09.236351] [DEBUG] [LOCAL ] ZIP: Loaded 44430 existing records from primary storage. [2025-10-03T22:32:09.305336] [INFO ] [MAIN ] ZIP: Loaded 44430 existing records. [2025-10-03T22:32:09.322981] [DEBUG] [LOCAL ] ZK: Loaded 39862 existing records from primary storage. [2025-10-03T22:32:09.366208] [INFO ] [MAIN ] ZK: Loaded 39862 existing records. [2025-10-03T22:32:09.464475] [DEBUG] [LOCAL ] ZIM: Loaded 53904 existing records from primary storage. [2025-10-03T22:32:09.546718] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:09.543217] [INFO ] [MAIN ] ZIM: Loaded 53904 existing records. [2025-10-03T22:32:09.571061] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-03T22:32:09.612561] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-03T22:32:09.727672] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-03T22:32:09.809407] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-03T22:32:09.855695] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:09.990107] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-03T22:32:10.003661] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:10.024484] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-03T22:32:10.035060] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-03T22:32:10.128818] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-03T22:32:10.128382] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:10.125160] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-03T22:32:10.139426] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-03T22:32:10.169519] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-03T22:32:10.154983] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-03T22:32:10.224374] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-03T22:32:10.224292] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-03T22:32:10.254678] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-03T22:32:10.260055] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-03T22:32:11.026724] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:11.141926] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-03T22:32:11.586990] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:11.652376] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-03T22:32:11.674910] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:11.686454] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-03T22:32:11.723736] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:11.724759] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-03T22:32:12.588611] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T22:32:12.594498] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-03T22:32:12.732521] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T22:32:12.739680] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-03T22:32:13.300351] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T22:32:13.309146] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-03T22:32:13.655132] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T22:32:13.659900] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-03T22:32:13.920993] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T22:32:13.933041] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-03T22:32:13.972256] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T22:32:13.978930] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-03T22:32:14.721493] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T22:32:14.729744] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-03T22:32:14.924290] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T22:32:14.933393] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-03T22:32:15.336818] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T22:32:15.344387] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-03T22:32:15.722787] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T22:32:15.734306] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-03T22:32:15.826782] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T22:32:15.835453] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-03T22:32:16.401977] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T22:32:16.410867] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-03T22:32:16.975949] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T22:32:16.987028] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-03T22:32:17.508017] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T22:32:17.519574] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-03T22:32:17.716694] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T22:32:17.725113] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-03T22:32:17.756834] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T22:32:18.321713] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T22:32:18.390721] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-03T22:32:18.750225] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T22:32:19.190638] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-03T22:32:19.238316] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T22:32:19.765778] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T22:32:19.990696] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-03T22:32:20.790745] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-03T22:32:21.452959] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T22:32:21.528312] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-03T22:32:21.590744] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-03T22:32:22.089819] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T22:32:22.390739] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-03T22:32:23.046126] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T22:32:23.190710] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-03T22:32:23.755779] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T22:32:23.990718] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-03T22:32:24.701980] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T22:32:24.790708] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-03T22:32:25.441552] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T22:32:25.590776] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-03T22:32:26.331163] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T22:32:26.390731] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-03T22:32:27.190751] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-03T22:32:27.990739] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-03T22:32:28.231452] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-03T22:32:28.370439] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T22:32:28.790709] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-03T22:32:29.137030] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T22:32:29.140216] [INFO ] [REMOTE ] ZIP: Full fetch complete (59789 records). [2025-10-03T22:32:29.140337] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-03T22:32:29.562668] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-03T22:32:29.562770] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-03T22:32:29.563971] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-03T22:32:29.564076] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-03T22:32:29.565531] [DEBUG] [LOCAL ] ZIP: Trimmed 59789 records to 44711 (keeping 200 days of data) [2025-10-03T22:32:29.617100] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-03T22:32:29.843836] [DEBUG] [LOCAL ] ZIP: Primary data saved (44711 records). [2025-10-03T22:32:29.843991] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-03T22:32:29.844164] [INFO ] [MAIN ] Update Progress: 2361/2370 symbols completed. ZIP took 21.6s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-03T22:32:30.022312] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:30.035697] [DEBUG] [LOCAL ] ZKH: Loaded 7854 existing records from primary storage. [2025-10-03T22:32:30.036025] [INFO ] [MAIN ] ZKH: Loaded 7854 existing records. [2025-10-03T22:32:30.239632] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:30.239964] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-03T22:32:30.240024] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-03T22:32:30.240241] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-03T22:32:30.240300] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-03T22:32:30.617273] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:30.617733] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-03T22:32:31.212358] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T22:32:31.214271] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-03T22:32:31.949942] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T22:32:31.990618] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-03T22:32:32.370798] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (5.98 seconds). [2025-10-03T22:32:32.790793] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-03T22:32:32.819729] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T22:32:33.590736] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-03T22:32:34.165382] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (5.37 seconds). [2025-10-03T22:32:34.358456] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T22:32:34.390635] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-03T22:32:35.190727] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-03T22:32:36.407387] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T22:32:36.415140] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-03T22:32:36.505348] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (6.89 seconds). [2025-10-03T22:32:36.790690] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-03T22:32:37.582318] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (4.79 seconds). [2025-10-03T22:32:37.592976] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-03T22:32:37.640482] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-10-03T22:32:37.672460] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T22:32:38.390699] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-03T22:32:38.796033] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T22:32:38.798293] [INFO ] [REMOTE ] ZK: Full fetch complete (57047 records). [2025-10-03T22:32:38.798439] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-03T22:32:39.194231] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-03T22:32:39.236042] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T22:32:39.240360] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-03T22:32:39.242129] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-03T22:32:39.243579] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-03T22:32:39.243994] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-03T22:32:39.244414] [INFO ] [REMOTE ] ZH: Full fetch complete (40144 records). [2025-10-03T22:32:39.244682] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-03T22:32:39.268834] [DEBUG] [LOCAL ] ZK: Trimmed 57047 records to 40134 (keeping 200 days of data) [2025-10-03T22:32:39.487793] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-03T22:32:39.820068] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-03T22:32:39.820473] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-03T22:32:39.821741] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-03T22:32:39.821825] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-03T22:32:39.830480] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T22:32:39.834927] [DEBUG] [LOCAL ] ZH: Trimmed 40144 records to 26692 (keeping 200 days of data) [2025-10-03T22:32:39.991039] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-03T22:32:40.147264] [DEBUG] [LOCAL ] ZK: Primary data saved (40134 records). [2025-10-03T22:32:40.148495] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-03T22:32:40.149078] [INFO ] [MAIN ] Update Progress: 2362/2370 symbols completed. ZK took 31.9s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-03T22:32:40.271855] [DEBUG] [LOCAL ] ZH: Primary data saved (26692 records). [2025-10-03T22:32:40.272078] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-03T22:32:40.272572] [INFO ] [MAIN ] Update Progress: 2363/2370 symbols completed. ZH took 32.0s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-03T22:32:40.472726] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:40.561164] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:40.591388] [DEBUG] [LOCAL ] ZTR: Loaded 16811 existing records from primary storage. [2025-10-03T22:32:40.591710] [INFO ] [MAIN ] ZTR: Loaded 16811 existing records. [2025-10-03T22:32:40.662750] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T22:32:40.735213] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-10-03T22:32:40.735886] [INFO ] [MAIN ] ZTO: Loaded 50213 existing records. [2025-10-03T22:32:40.801458] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-03T22:32:40.947829] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:40.953305] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-03T22:32:40.958519] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-03T22:32:40.990526] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-03T22:32:41.007280] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-03T22:32:41.080083] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:41.119003] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-03T22:32:41.141480] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-03T22:32:41.153068] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-03T22:32:41.163561] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-03T22:32:41.606959] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-03T22:32:41.685311] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:41.897856] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:41.923625] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T22:32:42.390706] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-03T22:32:43.148930] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T22:32:43.190636] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-03T22:32:43.573328] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T22:32:43.938957] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T22:32:43.990635] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-03T22:32:44.790714] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-03T22:32:45.590719] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-03T22:32:45.806506] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T22:32:45.991830] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T22:32:46.037694] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T22:32:46.038629] [INFO ] [REMOTE ] ZKH: Full fetch complete (11877 records). [2025-10-03T22:32:46.038755] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-03T22:32:46.393570] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-03T22:32:46.420352] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-03T22:32:46.420451] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-03T22:32:46.420959] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-03T22:32:46.421345] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-03T22:32:46.423463] [DEBUG] [LOCAL ] ZKH: Trimmed 11877 records to 7885 (keeping 200 days of data) [2025-10-03T22:32:46.472611] [DEBUG] [LOCAL ] ZKH: Primary data saved (7885 records). [2025-10-03T22:32:46.472851] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-03T22:32:46.472990] [INFO ] [MAIN ] Update Progress: 2364/2370 symbols completed. ZKH took 16.6s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-03T22:32:46.695274] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:46.761865] [DEBUG] [LOCAL ] ZTS: Loaded 53383 existing records from primary storage. [2025-10-03T22:32:46.762269] [INFO ] [MAIN ] ZTS: Loaded 53383 existing records. [2025-10-03T22:32:46.956630] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:46.956931] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-03T22:32:46.956988] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-03T22:32:46.957212] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-03T22:32:46.957280] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-03T22:32:47.195892] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-03T22:32:47.337932] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:47.990707] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-03T22:32:48.407408] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T22:32:48.577360] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T22:32:48.790703] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-03T22:32:49.590716] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-03T22:32:50.167460] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T22:32:50.390635] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-03T22:32:50.552826] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T22:32:50.556292] [INFO ] [REMOTE ] ZIM: Full fetch complete (77500 records). [2025-10-03T22:32:50.556596] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-03T22:32:50.872428] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T22:32:50.985238] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-03T22:32:50.985348] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-03T22:32:50.987288] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-03T22:32:50.987362] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-03T22:32:50.989406] [DEBUG] [LOCAL ] ZIM: Trimmed 77500 records to 54289 (keeping 200 days of data) [2025-10-03T22:32:51.216281] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-03T22:32:51.350107] [DEBUG] [LOCAL ] ZIM: Primary data saved (54289 records). [2025-10-03T22:32:51.350297] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-03T22:32:51.350399] [INFO ] [MAIN ] Update Progress: 2365/2370 symbols completed. ZIM took 43.1s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-03T22:32:51.518884] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:32:51.556297] [DEBUG] [LOCAL ] ZVIA: Loaded 35700 existing records from primary storage. [2025-10-03T22:32:51.556675] [INFO ] [MAIN ] ZVIA: Loaded 35700 existing records. [2025-10-03T22:32:51.733772] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:32:51.734042] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-03T22:32:51.734092] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-03T22:32:51.734397] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-03T22:32:51.734455] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-03T22:32:51.995202] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-03T22:32:52.106721] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:32:52.157043] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T22:32:52.790677] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-03T22:32:52.996224] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T22:32:53.043105] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T22:32:53.590737] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-03T22:32:54.236310] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T22:32:54.390733] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-03T22:32:54.623005] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T22:32:55.190707] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-03T22:32:55.990845] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-03T22:32:56.046504] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T22:32:56.053113] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T22:32:56.790696] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-03T22:32:57.553090] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T22:32:57.590627] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-03T22:32:58.390687] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-03T22:32:58.647763] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T22:32:58.683925] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T22:32:59.190724] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-03T22:32:59.931877] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T22:32:59.990635] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-03T22:33:00.699243] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T22:33:00.790750] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-03T22:33:01.590638] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-03T22:33:01.792963] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T22:33:02.100548] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T22:33:02.390761] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-03T22:33:03.190789] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-03T22:33:03.420236] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T22:33:03.458335] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T22:33:03.990755] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-03T22:33:04.745382] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T22:33:04.790634] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-03T22:33:05.185055] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T22:33:05.590682] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-03T22:33:06.301004] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T22:33:06.390624] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-03T22:33:07.190722] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-03T22:33:07.291910] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T22:33:07.409706] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T22:33:07.990704] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-03T22:33:08.790699] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-03T22:33:09.116782] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T22:33:09.590717] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-03T22:33:09.815295] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T22:33:10.296986] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T22:33:10.330173] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T22:33:10.390629] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-03T22:33:11.190768] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-03T22:33:11.401749] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T22:33:11.990776] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-03T22:33:12.790750] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-03T22:33:13.028314] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T22:33:13.381995] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T22:33:13.383494] [INFO ] [REMOTE ] ZTR: Full fetch complete (27036 records). [2025-10-03T22:33:13.383766] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-03T22:33:13.598418] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-03T22:33:13.737006] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T22:33:13.900029] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-03T22:33:13.900127] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-03T22:33:13.900889] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-03T22:33:13.900954] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-03T22:33:13.901774] [DEBUG] [LOCAL ] ZTR: Trimmed 27036 records to 16981 (keeping 200 days of data) [2025-10-03T22:33:14.012624] [DEBUG] [LOCAL ] ZTR: Primary data saved (16981 records). [2025-10-03T22:33:14.012895] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-03T22:33:14.013036] [INFO ] [MAIN ] Update Progress: 2366/2370 symbols completed. ZTR took 33.7s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-03T22:33:14.190994] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T22:33:14.244122] [DEBUG] [LOCAL ] ZWS: Loaded 42597 existing records from primary storage. [2025-10-03T22:33:14.244556] [INFO ] [MAIN ] ZWS: Loaded 42597 existing records. [2025-10-03T22:33:14.395741] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-03T22:33:14.438723] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T22:33:14.439116] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-03T22:33:14.439170] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-03T22:33:14.439514] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-03T22:33:14.439576] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-03T22:33:14.824178] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T22:33:15.190692] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-03T22:33:15.565727] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-03T22:33:15.990687] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-03T22:33:16.048613] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T22:33:16.379735] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T22:33:16.790710] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-03T22:33:17.590733] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-03T22:33:17.980758] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T22:33:18.390758] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-03T22:33:18.555504] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T22:33:18.740576] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T22:33:19.190720] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-03T22:33:19.315996] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T22:33:19.318287] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52629 records). [2025-10-03T22:33:19.318438] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-03T22:33:19.753969] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-03T22:33:19.754067] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-03T22:33:19.755398] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-03T22:33:19.755468] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-03T22:33:19.756869] [DEBUG] [LOCAL ] ZVIA: Trimmed 52629 records to 35928 (keeping 200 days of data) [2025-10-03T22:33:19.976367] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35928 records). [2025-10-03T22:33:19.976554] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-03T22:33:19.976719] [INFO ] [MAIN ] Update Progress: 2367/2370 symbols completed. ZVIA took 28.6s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-03T22:33:19.990636] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-03T22:33:20.759088] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T22:33:20.790631] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-03T22:33:21.590739] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-03T22:33:21.952046] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T22:33:22.395909] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-03T22:33:22.412446] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T22:33:23.137832] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T22:33:23.190780] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-03T22:33:23.990756] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-03T22:33:24.095965] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T22:33:24.368024] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T22:33:24.790715] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-03T22:33:25.251337] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T22:33:25.254072] [INFO ] [REMOTE ] ZTS: Full fetch complete (76712 records). [2025-10-03T22:33:25.254197] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-03T22:33:25.591801] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-03T22:33:25.695408] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-03T22:33:25.695523] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-03T22:33:25.697001] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-03T22:33:25.697136] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-03T22:33:25.699616] [DEBUG] [LOCAL ] ZTS: Trimmed 76712 records to 53769 (keeping 200 days of data) [2025-10-03T22:33:25.738184] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T22:33:26.108828] [DEBUG] [LOCAL ] ZTS: Primary data saved (53769 records). [2025-10-03T22:33:26.109010] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-03T22:33:26.109129] [INFO ] [MAIN ] Update Progress: 2368/2370 symbols completed. ZTS took 39.6s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-03T22:33:26.390730] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-03T22:33:27.290303] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T22:33:27.300299] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-03T22:33:27.377080] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T22:33:27.379791] [INFO ] [REMOTE ] ZTO: Full fetch complete (72977 records). [2025-10-03T22:33:27.379991] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-03T22:33:27.808321] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-03T22:33:27.808429] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-03T22:33:27.809961] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-03T22:33:27.810044] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-03T22:33:27.811960] [DEBUG] [LOCAL ] ZTO: Trimmed 72977 records to 50585 (keeping 200 days of data) [2025-10-03T22:33:28.149270] [DEBUG] [LOCAL ] ZTO: Primary data saved (50585 records). [2025-10-03T22:33:28.149429] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-03T22:33:28.149590] [INFO ] [MAIN ] Update Progress: 2369/2370 symbols completed. ZTO took 48.0s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-03T22:33:28.634319] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T22:33:28.642803] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-03T22:33:30.287438] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T22:33:30.298119] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-03T22:33:31.824749] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T22:33:31.834943] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-03T22:33:33.372501] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T22:33:33.383021] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-03T22:33:34.581816] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T22:33:34.584184] [INFO ] [REMOTE ] ZWS: Full fetch complete (62053 records). [2025-10-03T22:33:34.584286] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-03T22:33:35.003630] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-03T22:33:35.003756] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-03T22:33:35.005222] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-03T22:33:35.005319] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-03T22:33:35.007259] [DEBUG] [LOCAL ] ZWS: Trimmed 62053 records to 42932 (keeping 200 days of data) [2025-10-03T22:33:35.297280] [DEBUG] [LOCAL ] ZWS: Primary data saved (42932 records). [2025-10-03T22:33:35.297427] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-03T22:33:35.297541] [INFO ] [MAIN ] Update Progress: 2370/2370 symbols completed. ZWS took 21.3s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-03T22:33:35.299748] [INFO ] [MAIN ] Parallel update completed in 5h 33m 31s [2025-10-03T22:33:35.299893] [WARN ] [MAIN ] Failed symbols (297): AAMI, AAM, AAUC, ABBV, ABG, ACEL, ACHR, AD, AEXA, AFGB... [2025-10-03T22:33:35.299979] [INFO ] [MAIN ] Update success rate: 87.5% (2073/2370 symbols) [2025-10-03T22:33:36.094491] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2073/2370 @ 87.47%)' [2025-10-03T22:33:36.095146] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-03T22:33:36.095226] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-03T22:33:36.095267] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-03T22:33:36.095389] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-03T22:33:36.095427] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-03T22:33:37.765210] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-03T22:33:37.765380] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-03T22:33:37.765616] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-03T22:33:37.767488] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-03T22:33:37.767551] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-03T22:33:37.767586] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-03T22:33:37.767695] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-03T22:33:37.767778] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-03T22:33:37.767828] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-03T22:33:37.768262] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-03T22:33:37.768316] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-03T22:33:37.768541] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-03T22:33:37.768614] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-03T22:33:37.768708] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-03T22:33:37.768778] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-03T22:33:37.800230] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-03T22:33:37.829834] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-03T22:33:37.830005] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-03T22:33:37.830044] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-03T22:33:37.830075] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-03T22:33:37.830173] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-03T22:33:37.830230] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-03T22:33:37.830271] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-03T22:33:37.831566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-03T22:33:37.831866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-03T22:33:37.832103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-03T22:33:37.832291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-10-03T22:33:37.833510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-03T22:33:37.833731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-03T22:33:37.833879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-03T22:33:37.834080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-03T22:33:37.834277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-03T22:33:37.834475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-03T22:33:37.834686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-03T22:33:37.834885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-03T22:33:37.835050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-03T22:33:37.835291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-03T22:33:37.835514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-03T22:33:37.835776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-03T22:33:37.836122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-03T22:33:37.836319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-03T22:33:37.836508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-03T22:33:37.836697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-03T22:33:37.836877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-03T22:33:37.837049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-03T22:33:37.837231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-03T22:33:37.837524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-03T22:33:37.837718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-03T22:33:37.837916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-03T22:33:37.838095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-03T22:33:37.838430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-03T22:33:37.838631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-03T22:33:37.838775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-03T22:33:37.838946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-03T22:33:37.839117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-03T22:33:37.839276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-03T22:33:37.839450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-03T22:33:37.839767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-03T22:33:37.839936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-03T22:33:37.840109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-03T22:33:37.840259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-03T22:33:37.840457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-03T22:33:37.840586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-03T22:33:37.840757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-03T22:33:37.840908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-03T22:33:37.841057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-03T22:33:37.841218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-03T22:33:37.841417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-03T22:33:37.841555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-03T22:33:37.841734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-03T22:33:37.841893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-03T22:33:37.842066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-03T22:33:37.842288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-03T22:33:37.842492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-03T22:33:37.842713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-03T22:33:37.842905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-03T22:33:37.843068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-03T22:33:37.843247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-03T22:33:37.843411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-03T22:33:37.843591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-03T22:33:37.843763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-03T22:33:37.843876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-03T22:33:37.844029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-03T22:33:37.844195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-03T22:33:37.844332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-03T22:33:37.844490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-03T22:33:37.844687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-03T22:33:37.844897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-03T22:33:37.845065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-03T22:33:37.845219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-03T22:33:37.845366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-03T22:33:37.845487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-03T22:33:37.845679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-03T22:33:37.845826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-03T22:33:37.845981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-03T22:33:37.846108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-10-03T22:33:37.846259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-03T22:33:37.846467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-03T22:33:37.846638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-03T22:33:37.846822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-03T22:33:37.846987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-03T22:33:37.847136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-10-03T22:33:37.847279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-03T22:33:37.847414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-03T22:33:37.847567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-03T22:33:37.847751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-03T22:33:37.847960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-03T22:33:37.848164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-03T22:33:37.848385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-10-03T22:33:37.848603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-03T22:33:37.848798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-03T22:33:37.848928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-03T22:33:37.849099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-03T22:33:37.849319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-03T22:33:37.849484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-03T22:33:37.849662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-03T22:33:37.849809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-10-03T22:33:37.849975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-03T22:33:37.850104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-03T22:33:37.850296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-03T22:33:37.850495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-03T22:33:37.850600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-03T22:33:37.850765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-03T22:33:37.850937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-03T22:33:37.851082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-03T22:33:37.851209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-03T22:33:37.851358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-03T22:33:37.851502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-03T22:33:37.851716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-03T22:33:37.851888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-03T22:33:37.852022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-03T22:33:37.852226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-03T22:33:37.852387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-03T22:33:37.852551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-03T22:33:37.852711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-03T22:33:37.852880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-03T22:33:37.853048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-03T22:33:37.853193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-03T22:33:37.853336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-03T22:33:37.853481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-03T22:33:37.853699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-03T22:33:37.853915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-03T22:33:37.854056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-03T22:33:37.854223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-03T22:33:37.854436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-03T22:33:37.854572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-03T22:33:37.854734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-03T22:33:37.854871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-03T22:33:37.854998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-03T22:33:37.855234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-03T22:33:37.855383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-03T22:33:37.855542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-03T22:33:37.855707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-03T22:33:37.855858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-03T22:33:37.856005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-03T22:33:37.856121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-03T22:33:37.856250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-03T22:33:37.856393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-03T22:33:37.856547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-03T22:33:37.856903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-03T22:33:37.857043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-03T22:33:37.857193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-03T22:33:37.857335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-03T22:33:37.857454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-03T22:33:37.857576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-10-03T22:33:37.857747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-03T22:33:37.857914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-03T22:33:37.858097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-03T22:33:37.858267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-03T22:33:37.858401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-03T22:33:37.858535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-03T22:33:37.858704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-03T22:33:37.858909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-03T22:33:37.859069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-03T22:33:37.859185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-03T22:33:37.859423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-03T22:33:37.859537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-03T22:33:37.859734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-03T22:33:37.859936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-03T22:33:37.860293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-03T22:33:37.860483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-03T22:33:37.860603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-03T22:33:37.860785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-03T22:33:37.860914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-03T22:33:37.861030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-03T22:33:37.861176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-03T22:33:37.861298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-03T22:33:37.861467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-03T22:33:37.861582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-03T22:33:37.861740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-03T22:33:37.861855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-03T22:33:37.861975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-03T22:33:37.862104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-03T22:33:37.862254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-03T22:33:37.862369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-03T22:33:37.862527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-03T22:33:37.862710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-03T22:33:37.862832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-03T22:33:37.862955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-03T22:33:37.863090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-03T22:33:37.863287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-03T22:33:37.863431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-03T22:33:37.863588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-03T22:33:37.863766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-03T22:33:37.863916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-03T22:33:37.864059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-03T22:33:37.864189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-03T22:33:37.864343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-03T22:33:37.864495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-03T22:33:37.864630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-03T22:33:37.865074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-03T22:33:37.865188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-03T22:33:37.865409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-03T22:33:37.865557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-03T22:33:37.865717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-03T22:33:37.865844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-03T22:33:37.865980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-03T22:33:37.866115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-03T22:33:37.866304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-03T22:33:37.866454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-03T22:33:37.866589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-03T22:33:37.866765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-03T22:33:37.866893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-03T22:33:37.867011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-03T22:33:37.867126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-03T22:33:37.867263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-03T22:33:37.867381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-03T22:33:37.867520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-03T22:33:37.867626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-03T22:33:37.867783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-03T22:33:37.867945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-03T22:33:37.868072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-03T22:33:37.868217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-03T22:33:37.868398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-03T22:33:37.868520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-03T22:33:37.868682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-03T22:33:37.868834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-03T22:33:37.868993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-03T22:33:37.869156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-03T22:33:37.869307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-03T22:33:37.869439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-03T22:33:37.869564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-03T22:33:37.869768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-03T22:33:37.869916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-03T22:33:37.870042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-03T22:33:37.870156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-03T22:33:37.870274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-03T22:33:37.870417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-03T22:33:37.870684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-03T22:33:37.870905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-03T22:33:37.871082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-10-03T22:33:37.871260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-03T22:33:37.871401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-03T22:33:37.871544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-03T22:33:37.871694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-03T22:33:37.871826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-03T22:33:37.871953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-03T22:33:37.872107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-03T22:33:37.872286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-03T22:33:37.872413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-03T22:33:37.872543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-03T22:33:37.872803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-03T22:33:37.872969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-03T22:33:37.873116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-03T22:33:37.873363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-03T22:33:37.873492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-03T22:33:37.873609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-03T22:33:37.873753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-03T22:33:37.873891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-03T22:33:37.874035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-03T22:33:37.874169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-03T22:33:37.874300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-03T22:33:37.874445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-03T22:33:37.874561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-03T22:33:37.874716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-03T22:33:37.875013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-03T22:33:37.875132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-03T22:33:37.875259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-03T22:33:37.875376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-03T22:33:37.875491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-03T22:33:37.875620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-03T22:33:37.875787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-03T22:33:37.875907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-03T22:33:37.876032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-03T22:33:37.876139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-10-03T22:33:37.876279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-03T22:33:37.876448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-03T22:33:37.876567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-03T22:33:37.876722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-03T22:33:37.876856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-03T22:33:37.877018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-03T22:33:37.877131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-03T22:33:37.877300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-03T22:33:37.877427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-03T22:33:37.877559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-03T22:33:37.877724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-03T22:33:37.877828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-03T22:33:37.877999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-03T22:33:37.878130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-03T22:33:37.878266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-03T22:33:37.878398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-03T22:33:37.878554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-03T22:33:37.878730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-03T22:33:37.878884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-03T22:33:37.879013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-03T22:33:37.879161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-03T22:33:37.879274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-03T22:33:37.879390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-03T22:33:37.879507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-03T22:33:37.879668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-03T22:33:37.879805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-03T22:33:37.879940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-03T22:33:37.880075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-03T22:33:37.880201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-10-03T22:33:37.880326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-03T22:33:37.880457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-03T22:33:37.880604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-03T22:33:37.881029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-03T22:33:37.881154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-03T22:33:37.881254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-03T22:33:37.881466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-10-03T22:33:37.881633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-03T22:33:37.881801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-03T22:33:37.881940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-03T22:33:37.882124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-03T22:33:37.882258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-03T22:33:37.882425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-03T22:33:37.882585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-03T22:33:37.882772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-03T22:33:37.882900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-03T22:33:37.883024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-10-03T22:33:37.883136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-03T22:33:37.883248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-03T22:33:37.883373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-10-03T22:33:37.883516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-03T22:33:37.883674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-03T22:33:37.883869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-03T22:33:37.883979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-03T22:33:37.884092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-03T22:33:37.884216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-03T22:33:37.884335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-03T22:33:37.884436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-03T22:33:37.884567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-03T22:33:37.884828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-03T22:33:37.884980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-03T22:33:37.885095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-03T22:33:37.885219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-03T22:33:37.885351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-03T22:33:37.885475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-03T22:33:37.885684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-03T22:33:37.885819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-03T22:33:37.885949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-03T22:33:37.886059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-03T22:33:37.886181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-03T22:33:37.886310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-03T22:33:37.886433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-03T22:33:37.886549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-03T22:33:37.886708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-03T22:33:37.886863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-03T22:33:37.886990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-03T22:33:37.887181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-03T22:33:37.887316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-10-03T22:33:37.887422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-03T22:33:37.887544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-03T22:33:37.887701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-03T22:33:37.888140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-03T22:33:37.888272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-03T22:33:37.888394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-10-03T22:33:37.888567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-03T22:33:37.888726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-03T22:33:37.888870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-03T22:33:37.888993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-03T22:33:37.889113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-03T22:33:37.889234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-03T22:33:37.889399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-03T22:33:37.889514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-03T22:33:37.889678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-03T22:33:37.889800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-03T22:33:37.889905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-03T22:33:37.890013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-03T22:33:37.890126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-03T22:33:37.890248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-03T22:33:37.890370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-03T22:33:37.890494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-03T22:33:37.890634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-03T22:33:37.890870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-03T22:33:37.890978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-03T22:33:37.891112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-03T22:33:37.891218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-03T22:33:37.891332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-03T22:33:37.891444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-03T22:33:37.891605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-03T22:33:37.891808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-03T22:33:37.891925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-10-03T22:33:37.892054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-03T22:33:37.892171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-03T22:33:37.892285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-03T22:33:37.892411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-03T22:33:37.892538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-03T22:33:37.892836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-03T22:33:37.892959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-03T22:33:37.893115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-03T22:33:37.893247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-03T22:33:37.893426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-03T22:33:37.893542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-03T22:33:37.893705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-03T22:33:37.893830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-03T22:33:37.893939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-03T22:33:37.894087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-03T22:33:37.894208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-03T22:33:37.894386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-03T22:33:37.894508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-03T22:33:37.894622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-03T22:33:37.894753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-03T22:33:37.894893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-03T22:33:37.895014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-03T22:33:37.895119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-03T22:33:37.895234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-03T22:33:37.895364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-03T22:33:37.895486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-03T22:33:37.895607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-03T22:33:37.895794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-03T22:33:37.895917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-03T22:33:37.896051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-03T22:33:37.896173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-03T22:33:37.896313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-03T22:33:37.896451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-03T22:33:37.896596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-03T22:33:37.896740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-03T22:33:37.896856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-03T22:33:37.897028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-10-03T22:33:37.897169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-03T22:33:37.897285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-03T22:33:37.897417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-10-03T22:33:37.897532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-03T22:33:37.897791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-03T22:33:37.897970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-03T22:33:37.898083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-03T22:33:37.898186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-03T22:33:37.898307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-03T22:33:37.898438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-03T22:33:37.898585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-03T22:33:37.898738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-03T22:33:37.898866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-03T22:33:37.898974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-03T22:33:37.899078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-03T22:33:37.899209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-03T22:33:37.899335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-03T22:33:37.899452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-03T22:33:37.899552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-03T22:33:37.899673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-03T22:33:37.899791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-03T22:33:37.899913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-03T22:33:37.900032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-03T22:33:37.900146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-03T22:33:37.900287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-03T22:33:37.900427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-10-03T22:33:37.900551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-03T22:33:37.900753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-03T22:33:37.900894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-03T22:33:37.901013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-03T22:33:37.901138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-03T22:33:37.901328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-03T22:33:37.901434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-03T22:33:37.901565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-03T22:33:37.901731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-03T22:33:37.901868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-03T22:33:37.901992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-03T22:33:37.902126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-03T22:33:37.902249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-10-03T22:33:37.902380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-03T22:33:37.902507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-10-03T22:33:37.902661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-03T22:33:37.902771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-03T22:33:37.902925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-03T22:33:37.903035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-03T22:33:37.903192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-03T22:33:37.903298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-03T22:33:37.903502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-03T22:33:37.903718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-03T22:33:37.903832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-03T22:33:37.903950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-03T22:33:37.904069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-03T22:33:37.904188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-03T22:33:37.904294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-03T22:33:37.904408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-03T22:33:37.904535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-10-03T22:33:37.904670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-03T22:33:37.904789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-10-03T22:33:37.904895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-03T22:33:37.905005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-03T22:33:37.905128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-03T22:33:37.905252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-03T22:33:37.905386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-03T22:33:37.905563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-03T22:33:37.905711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-03T22:33:37.905823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-03T22:33:37.905956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-03T22:33:37.906079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-03T22:33:37.906219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-03T22:33:37.906334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-03T22:33:37.906511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-03T22:33:37.906624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-03T22:33:37.906745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-03T22:33:37.906853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-03T22:33:37.906946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-03T22:33:37.907039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-03T22:33:37.907204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-03T22:33:37.907323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-03T22:33:37.907417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-03T22:33:37.907508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-03T22:33:37.907639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-10-03T22:33:37.907786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-03T22:33:37.907926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-03T22:33:37.908051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-03T22:33:37.908174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-03T22:33:37.908288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-03T22:33:37.908439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-03T22:33:37.908569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-03T22:33:37.908854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-03T22:33:37.908971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-03T22:33:37.909086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-03T22:33:37.909194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-03T22:33:37.909297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-03T22:33:37.909399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-03T22:33:37.909528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-03T22:33:37.909630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-03T22:33:37.909770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-10-03T22:33:37.909893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-03T22:33:37.910012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-03T22:33:37.910118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-03T22:33:37.910239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-03T22:33:37.910359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-03T22:33:37.910488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-03T22:33:37.910593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-03T22:33:37.910760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-10-03T22:33:37.910874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-03T22:33:37.910987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-10-03T22:33:37.911090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-03T22:33:37.911197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-03T22:33:37.911289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-03T22:33:37.911373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-03T22:33:37.911463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-03T22:33:37.911591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-03T22:33:37.911734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-03T22:33:37.911880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-03T22:33:37.912002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-03T22:33:37.912129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-03T22:33:37.912258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-03T22:33:37.912374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-03T22:33:37.912480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-03T22:33:37.912584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-03T22:33:37.912883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-03T22:33:37.913020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-10-03T22:33:37.913136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-03T22:33:37.913284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-03T22:33:37.913389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-03T22:33:37.913483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-03T22:33:37.913561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-03T22:33:37.913732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-03T22:33:37.913841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-03T22:33:37.913947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-10-03T22:33:37.914069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-03T22:33:37.914216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-03T22:33:37.914335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-03T22:33:37.914435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-03T22:33:37.914531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-03T22:33:37.914637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-03T22:33:37.914756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-03T22:33:37.914848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-03T22:33:37.914958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-03T22:33:37.915084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-10-03T22:33:37.915211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-03T22:33:37.915329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-03T22:33:37.915429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-03T22:33:37.915521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-03T22:33:37.915683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-03T22:33:37.915820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-03T22:33:37.915929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-03T22:33:37.916058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-03T22:33:37.916184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-03T22:33:37.916297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-03T22:33:37.916394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-03T22:33:37.916484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-03T22:33:37.916587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-03T22:33:37.916711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-03T22:33:37.916802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-03T22:33:37.916893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-03T22:33:37.916987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-03T22:33:37.917101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-03T22:33:37.917210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-10-03T22:33:37.917336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-03T22:33:37.917455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-03T22:33:37.917575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-03T22:33:37.917758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-03T22:33:37.917913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-03T22:33:37.918034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-03T22:33:37.918146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-03T22:33:37.918317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-03T22:33:37.918445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-03T22:33:37.918553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-03T22:33:37.918685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-03T22:33:37.918794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-03T22:33:37.918915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-03T22:33:37.919067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-03T22:33:37.919164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-03T22:33:37.919251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-03T22:33:37.919364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-03T22:33:37.919478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-10-03T22:33:37.919599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-03T22:33:37.919756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-03T22:33:37.919874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-03T22:33:37.920001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-03T22:33:37.920124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-03T22:33:37.920220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-10-03T22:33:37.920314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-03T22:33:37.920438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-03T22:33:37.920546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-03T22:33:37.920834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-03T22:33:37.920953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-03T22:33:37.921072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-03T22:33:37.921180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-03T22:33:37.921350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-03T22:33:37.921453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-03T22:33:37.921573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-10-03T22:33:37.921703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-03T22:33:37.921818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-03T22:33:37.921914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-03T22:33:37.921994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-03T22:33:37.922109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-03T22:33:37.922233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-03T22:33:37.922328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-03T22:33:37.922432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-03T22:33:37.922541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-03T22:33:37.922671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-03T22:33:37.922808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-03T22:33:37.922928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-03T22:33:37.923042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-03T22:33:37.923157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-03T22:33:37.923264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-03T22:33:37.923372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-03T22:33:37.923487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-03T22:33:37.923607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-03T22:33:37.923762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-03T22:33:37.923859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-03T22:33:37.923947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-03T22:33:37.924063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-03T22:33:37.924178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-03T22:33:37.924272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-03T22:33:37.924341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-03T22:33:37.924436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-03T22:33:37.924545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-03T22:33:37.924638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-03T22:33:37.924792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-03T22:33:37.924930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-03T22:33:37.925044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-03T22:33:37.925154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-03T22:33:37.925259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-03T22:33:37.925388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-03T22:33:37.925496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-03T22:33:37.925615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-03T22:33:37.925757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-03T22:33:37.925849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-10-03T22:33:37.925973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-03T22:33:37.926107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-03T22:33:37.926227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-03T22:33:37.926327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-03T22:33:37.926399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-03T22:33:37.926488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-03T22:33:37.926594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-03T22:33:37.926869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-03T22:33:37.926975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-03T22:33:37.927117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-03T22:33:37.927294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-03T22:33:37.927411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-03T22:33:37.927583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-03T22:33:37.927754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-03T22:33:37.927863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-03T22:33:37.927986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-03T22:33:37.928069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-03T22:33:37.928183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-03T22:33:37.928333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-03T22:33:37.928451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-03T22:33:37.928572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-03T22:33:37.928792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-03T22:33:37.928900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-03T22:33:37.929017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-03T22:33:37.929148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-03T22:33:37.929306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-03T22:33:37.929413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-03T22:33:37.929527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-03T22:33:37.929634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-03T22:33:37.929772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-03T22:33:37.929874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-03T22:33:37.929978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-03T22:33:37.930077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-03T22:33:37.930151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-03T22:33:37.930232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-03T22:33:37.930356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-03T22:33:37.930463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-03T22:33:37.930562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-03T22:33:37.930683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-03T22:33:37.930795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-03T22:33:37.930933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-03T22:33:37.931048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-03T22:33:37.931159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-03T22:33:37.931325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-03T22:33:37.931452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-03T22:33:37.931595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-03T22:33:37.931766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-03T22:33:37.931865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-03T22:33:37.931983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-03T22:33:37.932099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-03T22:33:37.932226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-03T22:33:37.932343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-03T22:33:37.932458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-03T22:33:37.932579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-03T22:33:37.932725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-03T22:33:37.932847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-03T22:33:37.932967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-03T22:33:37.933076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-03T22:33:37.933177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-03T22:33:37.933280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-03T22:33:37.933381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-03T22:33:37.933549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-03T22:33:37.933670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-03T22:33:37.933837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-03T22:33:37.933944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-03T22:33:37.934031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-03T22:33:37.934140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-03T22:33:37.934260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-03T22:33:37.934453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-03T22:33:37.934572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-03T22:33:37.934739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-03T22:33:37.934841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-03T22:33:37.934965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-03T22:33:37.935083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-03T22:33:37.935205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-03T22:33:37.935323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-03T22:33:37.935438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-03T22:33:37.935563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-03T22:33:37.935826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-03T22:33:37.935956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-03T22:33:37.936076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-03T22:33:37.936194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-03T22:33:37.936300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-03T22:33:37.936470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-03T22:33:37.936588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-03T22:33:37.936939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-03T22:33:37.937060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-03T22:33:37.937178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-03T22:33:37.937309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-03T22:33:37.937432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-03T22:33:37.937539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-03T22:33:37.937664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-03T22:33:37.937760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-03T22:33:37.937853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-03T22:33:37.937972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-03T22:33:37.938059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-03T22:33:37.938199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-03T22:33:37.938294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-03T22:33:37.938386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-03T22:33:37.938497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-03T22:33:37.938630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-03T22:33:37.938760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-03T22:33:37.938870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-03T22:33:37.938963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-03T22:33:37.939073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-03T22:33:37.939184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-03T22:33:37.939300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-03T22:33:37.939413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-03T22:33:37.939518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-03T22:33:37.939624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-03T22:33:37.939771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-03T22:33:37.939876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-03T22:33:37.939971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-03T22:33:37.940111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-03T22:33:37.940228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-03T22:33:37.940326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-03T22:33:37.940407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-03T22:33:37.940524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-03T22:33:37.940622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-03T22:33:37.940890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-03T22:33:37.940976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-10-03T22:33:37.941058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-03T22:33:37.941282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-03T22:33:37.941393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-03T22:33:37.941534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-03T22:33:37.941626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-03T22:33:37.941747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-03T22:33:37.941859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-03T22:33:37.941997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-03T22:33:37.942102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-03T22:33:37.942222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-03T22:33:37.942337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-03T22:33:37.942435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-03T22:33:37.942527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-03T22:33:37.942688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-03T22:33:37.942781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-03T22:33:37.942880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-03T22:33:37.943018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-03T22:33:37.943142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-03T22:33:37.943236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-03T22:33:37.943305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-03T22:33:37.943397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-03T22:33:37.943499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-03T22:33:37.943598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-03T22:33:37.943749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-03T22:33:37.943848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-03T22:33:37.943917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-03T22:33:37.944001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-03T22:33:37.944101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-03T22:33:37.944215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-03T22:33:37.944327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-10-03T22:33:37.944470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-03T22:33:37.944582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-03T22:33:37.944725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-10-03T22:33:37.944869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-03T22:33:37.944988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-03T22:33:37.945095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-03T22:33:37.945201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-03T22:33:37.945295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-10-03T22:33:37.945428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-03T22:33:37.945614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-03T22:33:37.945750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-03T22:33:37.945870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-03T22:33:37.946020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-03T22:33:37.946159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-03T22:33:37.946265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-03T22:33:37.946337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-03T22:33:37.946440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-03T22:33:37.946527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-03T22:33:37.946660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-03T22:33:37.946782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-03T22:33:37.946912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-03T22:33:37.947011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-03T22:33:37.947103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-03T22:33:37.947219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-03T22:33:37.947325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-03T22:33:37.947482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-03T22:33:37.947596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-03T22:33:37.947727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-03T22:33:37.947834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-03T22:33:37.947972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-03T22:33:37.948072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-03T22:33:37.948176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-03T22:33:37.948269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-03T22:33:37.948339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-03T22:33:37.948426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-03T22:33:37.948566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-03T22:33:37.948824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-03T22:33:37.948982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-03T22:33:37.949148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-03T22:33:37.949246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-03T22:33:37.949343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-03T22:33:37.949455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-03T22:33:37.949570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-03T22:33:37.949702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-03T22:33:37.949812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-03T22:33:37.949920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-03T22:33:37.950030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-03T22:33:37.950169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-03T22:33:37.950273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-03T22:33:37.950386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-03T22:33:37.950496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-03T22:33:37.950593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-03T22:33:37.950703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-03T22:33:37.950802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-03T22:33:37.950893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-03T22:33:37.951037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-03T22:33:37.951158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-03T22:33:37.951280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-03T22:33:37.951398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-03T22:33:37.951519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-03T22:33:37.951623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-03T22:33:37.951765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-03T22:33:37.951862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-03T22:33:37.951940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-03T22:33:37.952030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-03T22:33:37.952130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-03T22:33:37.952210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-03T22:33:37.952338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-03T22:33:37.952446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-03T22:33:37.952557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-03T22:33:37.952678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-03T22:33:37.952791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-03T22:33:37.952894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-03T22:33:37.953006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-03T22:33:37.953173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-03T22:33:37.953282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-03T22:33:37.953401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-03T22:33:37.953511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-03T22:33:37.953617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-03T22:33:37.953749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-03T22:33:37.953856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-03T22:33:37.953971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-03T22:33:37.954093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-03T22:33:37.954200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-03T22:33:37.954301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-03T22:33:37.954433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-03T22:33:37.954538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-03T22:33:37.954659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-03T22:33:37.954782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-10-03T22:33:37.954880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-03T22:33:37.954959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-03T22:33:37.955062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-03T22:33:37.955192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-03T22:33:37.955324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-03T22:33:37.955458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-03T22:33:37.955550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-03T22:33:37.955637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-03T22:33:37.955766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-03T22:33:37.955858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-03T22:33:37.956003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-03T22:33:37.956101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-03T22:33:37.956185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-03T22:33:37.956321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-03T22:33:37.956449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-03T22:33:37.956544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-03T22:33:37.956755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-03T22:33:37.956866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-03T22:33:37.956956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-03T22:33:37.957034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-03T22:33:37.957137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-03T22:33:37.957232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-03T22:33:37.957310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-10-03T22:33:37.957413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-03T22:33:37.957527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-03T22:33:37.957633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-03T22:33:37.957750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-03T22:33:37.957946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-03T22:33:37.958049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-03T22:33:37.958156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-03T22:33:37.958247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-03T22:33:37.958316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-10-03T22:33:37.958382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-03T22:33:37.958452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-03T22:33:37.958562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-03T22:33:37.958695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-03T22:33:37.958815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-03T22:33:37.958939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-03T22:33:37.959035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-03T22:33:37.959125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-03T22:33:37.959222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-03T22:33:37.959294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-03T22:33:37.959383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-03T22:33:37.959482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-03T22:33:37.959582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-03T22:33:37.959718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-03T22:33:37.959819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-03T22:33:37.959890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-03T22:33:37.959961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-03T22:33:37.960038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-03T22:33:37.960151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-03T22:33:37.960258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-03T22:33:37.960355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-03T22:33:37.960439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-03T22:33:37.960548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-03T22:33:37.960663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-03T22:33:37.960804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-03T22:33:37.960914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-10-03T22:33:37.961020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-03T22:33:37.961118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-03T22:33:37.961190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-03T22:33:37.961274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-03T22:33:37.961369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-03T22:33:37.961460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-03T22:33:37.961565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-03T22:33:37.961686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-03T22:33:37.961779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-03T22:33:37.961849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-03T22:33:37.961942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-10-03T22:33:37.962060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-03T22:33:37.962156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-03T22:33:37.962229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-03T22:33:37.962315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-10-03T22:33:37.962453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-03T22:33:37.962594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-03T22:33:37.962717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-03T22:33:37.962822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-03T22:33:37.962919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-03T22:33:37.963014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-10-03T22:33:37.963134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-03T22:33:37.963243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-03T22:33:37.963345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-03T22:33:37.963451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-03T22:33:37.963556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-03T22:33:37.963725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-03T22:33:37.963834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-10-03T22:33:37.963931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-03T22:33:37.964004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-03T22:33:37.964089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-03T22:33:37.964186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-03T22:33:37.964258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-03T22:33:37.964342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-03T22:33:37.964447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-03T22:33:37.964548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-03T22:33:37.964635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-03T22:33:37.964987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-03T22:33:37.965103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-03T22:33:37.965265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-03T22:33:37.965381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-03T22:33:37.965513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-03T22:33:37.965622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-03T22:33:37.965753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-03T22:33:37.965848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-03T22:33:37.965935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-03T22:33:37.966043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-03T22:33:37.966159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-03T22:33:37.966337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-03T22:33:37.966433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-03T22:33:37.966533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-03T22:33:37.966717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-10-03T22:33:37.966864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-03T22:33:37.967017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-03T22:33:37.967127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-03T22:33:37.967240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-03T22:33:37.967388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-03T22:33:37.967498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-03T22:33:37.967591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-03T22:33:37.967703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-03T22:33:37.967830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-03T22:33:37.967939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-03T22:33:37.968039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-03T22:33:37.968146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-03T22:33:37.968259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-03T22:33:37.968368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-03T22:33:37.968485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-03T22:33:37.968602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-03T22:33:37.968777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-03T22:33:37.968947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-03T22:33:37.969061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-03T22:33:37.969180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-03T22:33:37.969287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-03T22:33:37.969392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-03T22:33:37.969499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-03T22:33:37.969598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-03T22:33:37.969787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-03T22:33:37.969894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-03T22:33:37.970008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-03T22:33:37.970103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-03T22:33:37.970185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-03T22:33:37.970284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-03T22:33:37.970392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-10-03T22:33:37.970490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-03T22:33:37.970614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-03T22:33:37.970772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-03T22:33:37.970868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-03T22:33:37.970948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-03T22:33:37.971061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-03T22:33:37.971269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-03T22:33:37.971376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-03T22:33:37.971521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-03T22:33:37.971628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-03T22:33:37.971779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-03T22:33:37.971871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-03T22:33:37.972042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-03T22:33:37.972155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-03T22:33:37.972301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-03T22:33:37.972416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-03T22:33:37.972536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-03T22:33:37.972846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-03T22:33:37.972943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-03T22:33:37.973012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-03T22:33:37.973100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-03T22:33:37.973234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-03T22:33:37.973464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-03T22:33:37.973589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-03T22:33:37.973738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-03T22:33:37.973889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-03T22:33:37.973989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-03T22:33:37.974151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-10-03T22:33:37.974262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-03T22:33:37.974367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-03T22:33:37.974477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-03T22:33:37.974586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-03T22:33:37.974730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-03T22:33:37.974826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-03T22:33:37.974916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-03T22:33:37.975017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-03T22:33:37.975110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-03T22:33:37.975215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-03T22:33:37.975301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-10-03T22:33:37.975403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-03T22:33:37.975487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-03T22:33:37.975569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-03T22:33:37.975712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-03T22:33:37.975826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-03T22:33:37.975937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-03T22:33:37.976040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-03T22:33:37.976147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-03T22:33:37.976243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-03T22:33:37.976348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-03T22:33:37.976454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-03T22:33:37.976563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-03T22:33:37.976739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-03T22:33:37.976835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-03T22:33:37.976917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-10-03T22:33:37.977040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-03T22:33:37.977152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-03T22:33:37.977254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-03T22:33:37.977394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-03T22:33:37.977495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-03T22:33:37.977592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-03T22:33:37.977725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-03T22:33:37.977826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-03T22:33:37.981750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-10-03T22:33:37.981894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-03T22:33:37.982025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-03T22:33:37.982146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-03T22:33:37.982250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-03T22:33:37.982388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-03T22:33:37.982494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-03T22:33:37.982587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-03T22:33:37.982693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-03T22:33:37.982810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-03T22:33:37.982928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-03T22:33:37.983069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-03T22:33:37.983206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-03T22:33:37.983342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-03T22:33:37.983474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-10-03T22:33:37.983604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-03T22:33:37.983752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-03T22:33:37.983912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-03T22:33:37.984026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-03T22:33:37.984148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-03T22:33:37.984249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-03T22:33:37.984356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-03T22:33:37.984445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-03T22:33:37.984566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-03T22:33:37.984713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-03T22:33:37.984807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-03T22:33:37.984876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-03T22:33:37.984970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-03T22:33:37.985069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-03T22:33:37.985211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-03T22:33:37.985319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-03T22:33:37.985424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-03T22:33:37.985514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-03T22:33:37.985580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-03T22:33:37.985703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-03T22:33:37.985810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-03T22:33:37.985923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-03T22:33:37.986029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-03T22:33:37.986133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-03T22:33:37.986226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-03T22:33:37.986331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-03T22:33:37.986438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-03T22:33:37.986529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-03T22:33:37.986597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-03T22:33:37.986697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-03T22:33:37.986867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-03T22:33:37.986983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-03T22:33:37.987074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-03T22:33:37.987162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-03T22:33:37.987257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-10-03T22:33:37.987344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-03T22:33:37.987469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-03T22:33:37.987559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-03T22:33:37.987626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-03T22:33:37.987760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-03T22:33:37.987853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-03T22:33:37.987974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-03T22:33:37.988072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-03T22:33:37.988183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-03T22:33:37.988283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-03T22:33:37.988387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-03T22:33:37.988511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-03T22:33:37.988604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-03T22:33:37.988898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-03T22:33:37.989002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-10-03T22:33:37.989128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-03T22:33:37.989385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-03T22:33:37.989492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-03T22:33:37.989582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-03T22:33:37.989688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-03T22:33:37.989783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-03T22:33:37.989870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-03T22:33:37.989970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-03T22:33:37.990073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-03T22:33:37.990165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-03T22:33:37.990247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-03T22:33:37.990338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-03T22:33:37.990408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-03T22:33:37.990475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-03T22:33:37.990540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-03T22:33:37.990604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-03T22:33:37.990697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-03T22:33:37.990790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-10-03T22:33:37.990895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-03T22:33:37.991004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-03T22:33:37.991101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-03T22:33:37.991196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-10-03T22:33:37.991346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-03T22:33:37.991447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-03T22:33:37.991515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-03T22:33:37.991611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-03T22:33:37.991743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-03T22:33:37.991844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-03T22:33:37.991969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-03T22:33:37.992078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-03T22:33:37.992174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-03T22:33:37.992273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-03T22:33:37.992459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-03T22:33:37.992583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-03T22:33:37.992737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-03T22:33:37.992848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-03T22:33:37.992952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-03T22:33:37.993055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-03T22:33:37.993134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-03T22:33:37.993205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-03T22:33:37.993301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-03T22:33:37.993406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-03T22:33:37.993505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-03T22:33:37.993591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-03T22:33:37.993753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-03T22:33:37.993867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-03T22:33:37.993965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-03T22:33:37.994037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-03T22:33:37.994109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-03T22:33:37.994189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-10-03T22:33:37.994304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-03T22:33:37.994413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-03T22:33:37.994503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-03T22:33:37.994573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-03T22:33:37.994671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-10-03T22:33:37.994786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-03T22:33:37.994887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-10-03T22:33:37.994982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-03T22:33:37.995074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-03T22:33:37.995172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-03T22:33:37.995245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-03T22:33:37.995314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-03T22:33:37.995407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-03T22:33:37.995507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-03T22:33:37.995583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-03T22:33:37.995716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-03T22:33:37.995835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-03T22:33:37.995948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-10-03T22:33:37.996045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-03T22:33:37.996140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-03T22:33:37.996245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-03T22:33:37.996353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-03T22:33:37.996512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-03T22:33:37.996607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-03T22:33:37.996809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-03T22:33:37.996926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-03T22:33:37.997035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-03T22:33:37.997209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-03T22:33:37.997345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-03T22:33:37.997427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-03T22:33:37.997550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-03T22:33:37.997838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-03T22:33:37.997977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-03T22:33:37.998110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-03T22:33:37.998223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-03T22:33:37.998317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-03T22:33:37.998396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-03T22:33:37.998505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-03T22:33:37.998598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-03T22:33:37.998718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-03T22:33:37.998845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-03T22:33:37.998950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-03T22:33:37.999049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-03T22:33:37.999119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-03T22:33:37.999203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-03T22:33:37.999397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-03T22:33:37.999491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-03T22:33:37.999562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-03T22:33:37.999684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-03T22:33:37.999781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-03T22:33:37.999868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-03T22:33:37.999970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-03T22:33:38.000094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-03T22:33:38.000186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-03T22:33:38.000258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-03T22:33:38.000336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-03T22:33:38.000432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-03T22:33:38.000513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-03T22:33:38.000608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-03T22:33:38.000955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-03T22:33:38.001095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-03T22:33:38.001195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-03T22:33:38.001266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-03T22:33:38.001357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-03T22:33:38.001463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-03T22:33:38.001570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-03T22:33:38.001720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-03T22:33:38.001867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-03T22:33:38.001985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-03T22:33:38.002081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-03T22:33:38.002215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-03T22:33:38.002314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-03T22:33:38.002524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-03T22:33:38.002637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-03T22:33:38.002766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-03T22:33:38.002873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-03T22:33:38.003111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-03T22:33:38.003213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-03T22:33:38.003309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-03T22:33:38.003378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-03T22:33:38.003446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-03T22:33:38.003577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-03T22:33:38.003698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-03T22:33:38.003803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-03T22:33:38.003909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-03T22:33:38.004046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-03T22:33:38.004151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-03T22:33:38.004284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-03T22:33:38.004377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-03T22:33:38.004458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-03T22:33:38.004553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-03T22:33:38.004621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-03T22:33:38.004727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-03T22:33:38.004910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-03T22:33:38.005025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-03T22:33:38.005119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-03T22:33:38.005222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-03T22:33:38.005332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-03T22:33:38.005437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-03T22:33:38.005511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-03T22:33:38.005578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-03T22:33:38.005672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-03T22:33:38.005783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-03T22:33:38.005895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-03T22:33:38.005991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-03T22:33:38.006078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-03T22:33:38.006172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-03T22:33:38.006295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-03T22:33:38.006392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-03T22:33:38.006465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-10-03T22:33:38.006545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-03T22:33:38.006709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-03T22:33:38.006819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-03T22:33:38.006918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-03T22:33:38.007001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-03T22:33:38.007099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-03T22:33:38.007172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-03T22:33:38.007278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-03T22:33:38.007387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-03T22:33:38.007502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-03T22:33:38.007603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-03T22:33:38.007714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-03T22:33:38.007820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-03T22:33:38.007948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-03T22:33:38.008053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-03T22:33:38.008163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-03T22:33:38.008290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-03T22:33:38.008383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-03T22:33:38.008453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-03T22:33:38.008521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-03T22:33:38.008613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-03T22:33:38.009033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-03T22:33:38.009143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-03T22:33:38.009257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-03T22:33:38.009356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-03T22:33:38.009427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-03T22:33:38.009523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-03T22:33:38.009666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-03T22:33:38.009836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-03T22:33:38.009951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-10-03T22:33:38.010057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-03T22:33:38.010152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-03T22:33:38.010234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-03T22:33:38.010328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-03T22:33:38.010434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-03T22:33:38.010543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-03T22:33:38.010690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-03T22:33:38.010786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-03T22:33:38.010867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-03T22:33:38.010986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-03T22:33:38.011081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-03T22:33:38.011153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-03T22:33:38.011252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-03T22:33:38.011345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-03T22:33:38.011430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-03T22:33:38.011555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-03T22:33:38.011685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-10-03T22:33:38.011791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-03T22:33:38.011883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-03T22:33:38.011998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-03T22:33:38.012115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-03T22:33:38.012221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-03T22:33:38.012318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-03T22:33:38.012414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-03T22:33:38.012541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-03T22:33:38.012637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-03T22:33:38.012801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-03T22:33:38.012899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-03T22:33:38.012980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-03T22:33:38.013074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-03T22:33:38.013161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-03T22:33:38.013265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-03T22:33:38.013359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-03T22:33:38.013443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-03T22:33:38.013543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-03T22:33:38.013704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-03T22:33:38.013813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-03T22:33:38.013939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-03T22:33:38.014044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-03T22:33:38.014150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-03T22:33:38.014270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-03T22:33:38.014378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-03T22:33:38.014472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-03T22:33:38.014579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-03T22:33:38.014707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-03T22:33:38.014803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-03T22:33:38.014908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-03T22:33:38.015000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-03T22:33:38.015070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-03T22:33:38.015137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-03T22:33:38.015219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-03T22:33:38.015311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-03T22:33:38.015380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-03T22:33:38.015446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-03T22:33:38.015510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-03T22:33:38.015575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-03T22:33:38.015674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-03T22:33:38.015769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-03T22:33:38.015848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-03T22:33:38.015943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-03T22:33:38.016067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-03T22:33:38.016169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-03T22:33:38.016265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-03T22:33:38.016334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-03T22:33:38.016423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-03T22:33:38.016535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-03T22:33:38.016786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-03T22:33:38.016877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-03T22:33:38.016955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-03T22:33:38.017080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-03T22:33:38.017176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-03T22:33:38.017271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-03T22:33:38.017362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-03T22:33:38.017471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-10-03T22:33:38.017566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-03T22:33:38.017663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-03T22:33:38.017758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-03T22:33:38.017824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-03T22:33:38.017925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-03T22:33:38.018021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-03T22:33:38.018093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-03T22:33:38.018178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-03T22:33:38.018301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-03T22:33:38.018405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-03T22:33:38.018503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-10-03T22:33:38.018582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-03T22:33:38.018704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-03T22:33:38.018792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-03T22:33:38.018864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-03T22:33:38.018932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-03T22:33:38.019006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-03T22:33:38.019124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-03T22:33:38.019250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-03T22:33:38.019341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-03T22:33:38.019422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-10-03T22:33:38.019549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-03T22:33:38.019626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-03T22:33:38.019861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-03T22:33:38.019968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-03T22:33:38.020062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-03T22:33:38.020134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-03T22:33:38.020269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-03T22:33:38.020374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-10-03T22:33:38.020480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-03T22:33:38.020572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-03T22:33:38.020667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-03T22:33:38.020777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-03T22:33:38.020873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-03T22:33:38.020953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-03T22:33:38.021050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-03T22:33:38.021118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-03T22:33:38.021235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-10-03T22:33:38.021341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-03T22:33:38.021457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-03T22:33:38.021546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-03T22:33:38.021617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-03T22:33:38.021726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-03T22:33:38.021831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-03T22:33:38.021928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-03T22:33:38.022007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-03T22:33:38.022115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-03T22:33:38.022207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-03T22:33:38.022277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-03T22:33:38.022344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-03T22:33:38.022410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-03T22:33:38.022499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-03T22:33:38.022603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-03T22:33:38.022739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-03T22:33:38.022837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-03T22:33:38.022908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-03T22:33:38.022975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-10-03T22:33:38.023062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-03T22:33:38.023157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-03T22:33:38.023227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-03T22:33:38.023302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-03T22:33:38.023398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-03T22:33:38.023490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-03T22:33:38.023600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-03T22:33:38.023729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-03T22:33:38.023811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-03T22:33:38.023896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-03T22:33:38.023992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-03T22:33:38.024086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-03T22:33:38.024210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-03T22:33:38.024312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-03T22:33:38.024419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-03T22:33:38.024525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-03T22:33:38.024621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-03T22:33:38.024851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-03T22:33:38.025066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-03T22:33:38.025165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-03T22:33:38.025235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-03T22:33:38.025311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-03T22:33:38.025407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-03T22:33:38.025486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-03T22:33:38.025581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-03T22:33:38.025728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-03T22:33:38.025832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-03T22:33:38.025926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-03T22:33:38.025994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-03T22:33:38.026078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-03T22:33:38.026209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-03T22:33:38.026299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-03T22:33:38.026368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-03T22:33:38.026433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-03T22:33:38.026508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-03T22:33:38.026665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-03T22:33:38.026762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-10-03T22:33:38.026831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-03T22:33:38.026974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-03T22:33:38.027065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-03T22:33:38.027181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-03T22:33:38.027306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-03T22:33:38.027398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-03T22:33:38.027476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-03T22:33:38.027579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-03T22:33:38.027699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-03T22:33:38.027815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-03T22:33:38.027943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-03T22:33:38.028027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-03T22:33:38.028120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-03T22:33:38.028214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-03T22:33:38.028292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-03T22:33:38.028389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-03T22:33:38.028458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-03T22:33:38.028531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-03T22:33:38.028595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-03T22:33:38.028818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-03T22:33:38.028952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-03T22:33:38.029051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-10-03T22:33:38.029172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-03T22:33:38.029280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-03T22:33:38.029388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-03T22:33:38.029484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-03T22:33:38.029564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-03T22:33:38.029787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-03T22:33:38.029884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-03T22:33:38.029954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-03T22:33:38.030024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-03T22:33:38.030105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-03T22:33:38.030213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-03T22:33:38.030316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-10-03T22:33:38.030412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-03T22:33:38.030510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-03T22:33:38.030615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-03T22:33:38.030734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-03T22:33:38.030813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-03T22:33:38.030880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-03T22:33:38.030944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-03T22:33:38.031007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-03T22:33:38.031085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-10-03T22:33:38.031195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-03T22:33:38.031301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-03T22:33:38.031399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-03T22:33:38.031488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-03T22:33:38.031581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-03T22:33:38.031690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-03T22:33:38.031787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-03T22:33:38.031859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-03T22:33:38.031926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-03T22:33:38.032057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-03T22:33:38.032164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-03T22:33:38.032238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-03T22:33:38.032330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-03T22:33:38.032425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-03T22:33:38.032493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-03T22:33:38.032612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-03T22:33:38.032736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-03T22:33:38.032814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-03T22:33:38.032905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-03T22:33:38.033004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-03T22:33:38.033088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-03T22:33:38.033184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-03T22:33:38.033346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-03T22:33:38.033447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-03T22:33:38.033543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-03T22:33:38.033622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-03T22:33:38.033773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-03T22:33:38.033891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-03T22:33:38.033994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-03T22:33:38.034091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-03T22:33:38.034163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-03T22:33:38.034255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-03T22:33:38.034362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-03T22:33:38.034457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-03T22:33:38.034527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-03T22:33:38.034612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-03T22:33:38.034735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-03T22:33:38.034815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-10-03T22:33:38.034908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-03T22:33:38.035006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-03T22:33:38.035075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-03T22:33:38.035142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-03T22:33:38.035218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-03T22:33:38.035342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-03T22:33:38.035451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-03T22:33:38.035550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-03T22:33:38.035676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-03T22:33:38.035777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-03T22:33:38.035845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-03T22:33:38.035929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-10-03T22:33:38.036047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-03T22:33:38.036157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-03T22:33:38.036272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-03T22:33:38.036377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-03T22:33:38.036448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-03T22:33:38.036516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-03T22:33:38.036583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-03T22:33:38.036827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-03T22:33:38.036939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-03T22:33:38.037044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-03T22:33:38.037171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-03T22:33:38.037250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-03T22:33:38.037318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-03T22:33:38.037394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-03T22:33:38.037500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-03T22:33:38.037595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-03T22:33:38.037730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-03T22:33:38.037833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-03T22:33:38.037980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-10-03T22:33:38.038065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-03T22:33:38.038132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-03T22:33:38.038215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-03T22:33:38.038305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-03T22:33:38.038412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-03T22:33:38.038505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-03T22:33:38.038575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-03T22:33:38.038660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-03T22:33:38.038758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-03T22:33:38.038855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-03T22:33:38.038950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-03T22:33:38.039045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-10-03T22:33:38.039160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-03T22:33:38.039271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-03T22:33:38.039350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-03T22:33:38.039417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-03T22:33:38.039482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-03T22:33:38.039566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-10-03T22:33:38.039701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-03T22:33:38.039796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-03T22:33:38.039874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-03T22:33:38.039994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-03T22:33:38.040125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-03T22:33:38.040247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-03T22:33:38.040352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-03T22:33:38.040447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-03T22:33:38.040520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-03T22:33:38.040608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-03T22:33:38.040775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-03T22:33:38.040901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-03T22:33:38.040997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-03T22:33:38.041078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-03T22:33:38.041200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-03T22:33:38.041310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-03T22:33:38.041439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-03T22:33:38.041564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-03T22:33:38.041707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-03T22:33:38.041863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-03T22:33:38.041959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-10-03T22:33:38.042053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-03T22:33:38.042165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-03T22:33:38.042269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-03T22:33:38.042378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-03T22:33:38.042547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-03T22:33:38.042681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-03T22:33:38.042782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-03T22:33:38.042908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-03T22:33:38.043026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-10-03T22:33:38.043183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-03T22:33:38.043279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-03T22:33:38.043397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-03T22:33:38.043513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-03T22:33:38.043609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-03T22:33:38.043721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-03T22:33:38.043813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-03T22:33:38.043921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-03T22:33:38.044040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-03T22:33:38.044157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-03T22:33:38.044272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-03T22:33:38.044425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-03T22:33:38.044527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-03T22:33:38.044763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-03T22:33:38.044872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-03T22:33:38.045037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-03T22:33:38.045184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-03T22:33:38.045288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-03T22:33:38.045420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-03T22:33:38.045516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-03T22:33:38.045600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-03T22:33:38.045730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-03T22:33:38.045841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-03T22:33:38.045925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-03T22:33:38.046006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-03T22:33:38.046103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-03T22:33:38.046211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-03T22:33:38.046328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-03T22:33:38.046444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-03T22:33:38.046537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-03T22:33:38.046615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-10-03T22:33:38.046738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-03T22:33:38.046818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-10-03T22:33:38.046885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-03T22:33:38.046964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-03T22:33:38.047072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-03T22:33:38.047227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-03T22:33:38.047330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-03T22:33:38.047425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-03T22:33:38.047494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-03T22:33:38.047574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-03T22:33:38.047702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-03T22:33:38.047794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-03T22:33:38.047864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-03T22:33:38.048102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-03T22:33:38.048196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-03T22:33:38.048289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-03T22:33:38.048360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-10-03T22:33:38.048442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-03T22:33:38.048551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-03T22:33:38.048693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-03T22:33:38.048885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-03T22:33:38.048996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-03T22:33:38.049118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-03T22:33:38.049244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-03T22:33:38.049419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-03T22:33:38.049514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-03T22:33:38.049594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-03T22:33:38.049784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-03T22:33:38.049878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-03T22:33:38.049950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-10-03T22:33:38.050018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-03T22:33:38.050118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-03T22:33:38.050212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-03T22:33:38.050291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-03T22:33:38.050421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-03T22:33:38.050514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-03T22:33:38.050584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-03T22:33:38.050686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-03T22:33:38.050781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-03T22:33:38.050870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-03T22:33:38.050960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-03T22:33:38.051030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-10-03T22:33:38.051106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-03T22:33:38.051200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-03T22:33:38.051269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-03T22:33:38.051337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-03T22:33:38.051414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-03T22:33:38.051524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-03T22:33:38.051615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-03T22:33:38.051762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-03T22:33:38.051877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-03T22:33:38.051970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-03T22:33:38.052038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-03T22:33:38.052104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-03T22:33:38.052186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-03T22:33:38.052277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-03T22:33:38.052353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-03T22:33:38.052457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-03T22:33:38.052579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-03T22:33:38.052920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-03T22:33:38.053082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-03T22:33:38.053184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-03T22:33:38.053279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-03T22:33:38.053379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-03T22:33:38.053461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-10-03T22:33:38.053559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-03T22:33:38.053632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-10-03T22:33:38.053756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-03T22:33:38.053854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-03T22:33:38.053928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-03T22:33:38.053996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-03T22:33:38.054062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-03T22:33:38.054141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-03T22:33:38.054252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-03T22:33:38.054411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-10-03T22:33:38.054505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-03T22:33:38.054587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-03T22:33:38.054717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-03T22:33:38.054847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-10-03T22:33:38.054955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-03T22:33:38.055050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-03T22:33:38.055123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-03T22:33:38.055195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-03T22:33:38.055261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-03T22:33:38.055385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-03T22:33:38.055477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-03T22:33:38.055567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-03T22:33:38.055698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-03T22:33:38.055792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-03T22:33:38.055862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-03T22:33:38.055931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-03T22:33:38.056101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-10-03T22:33:38.056265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-03T22:33:38.056390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-03T22:33:38.056488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-03T22:33:38.056583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-03T22:33:38.056800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-03T22:33:38.056898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-03T22:33:38.056971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-03T22:33:38.057039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-03T22:33:38.057107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-03T22:33:38.057173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-03T22:33:38.057250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-03T22:33:38.057346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-03T22:33:38.057429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-03T22:33:38.057526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-03T22:33:38.057594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-03T22:33:38.057688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-03T22:33:38.057786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-03T22:33:38.057858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-03T22:33:38.057982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-10-03T22:33:38.058092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-03T22:33:38.058187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-03T22:33:38.058278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-03T22:33:38.058384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-03T22:33:38.058480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-03T22:33:38.058565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-03T22:33:38.058704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-03T22:33:38.058867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-03T22:33:38.058993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-03T22:33:38.059162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-03T22:33:38.059267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-03T22:33:38.059448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-03T22:33:38.059551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-03T22:33:38.059623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-03T22:33:38.059762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-03T22:33:38.059940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-03T22:33:38.060129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-03T22:33:38.060229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-10-03T22:33:38.060304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-10-03T22:33:38.060383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-03T22:33:38.060479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-03T22:33:38.060551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-03T22:33:38.060621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-03T22:33:38.060971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-03T22:33:38.061067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-03T22:33:38.061137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-03T22:33:38.061298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-03T22:33:38.061408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-03T22:33:38.061508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-03T22:33:38.061604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-10-03T22:33:38.061702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-03T22:33:38.061794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-03T22:33:38.061921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-03T22:33:38.062024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-03T22:33:38.062149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-03T22:33:38.062258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-03T22:33:38.062438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-03T22:33:38.062530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-03T22:33:38.062599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-03T22:33:38.062691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-03T22:33:38.062792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-03T22:33:38.062918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-03T22:33:38.063007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-03T22:33:38.063116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-03T22:33:38.063206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-03T22:33:38.063284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-03T22:33:38.063380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-03T22:33:38.063449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-03T22:33:38.063517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-03T22:33:38.063582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-03T22:33:38.063681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-03T22:33:38.063839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-03T22:33:38.063967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-03T22:33:38.064078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-10-03T22:33:38.064173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-03T22:33:38.064263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-03T22:33:38.064331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-03T22:33:38.064407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-03T22:33:38.064515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-03T22:33:38.064675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-03T22:33:38.064772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-03T22:33:38.064840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-10-03T22:33:38.064947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-03T22:33:38.065030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-03T22:33:38.065135] [INFO ] [LOCAL ] Deleted 1872 derivative data files. [2025-10-03T22:33:38.065173] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-03T22:33:38.067319] [INFO ] [LOCAL ] Found 2073 symbols with primary data. [2025-10-03T22:33:38.067783] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2073 symbols [2025-10-03T22:33:38.069270] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:38.069779] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:38.068980] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:38.168674] [DEBUG] [LOCAL ] A: Loaded 51488 existing records from primary storage. [2025-10-03T22:33:38.170101] [DEBUG] [LOCAL ] AA: Loaded 54395 existing records from primary storage. [2025-10-03T22:33:38.169044] [INFO ] [MAIN ] A: Loaded 51488 primary data records. [2025-10-03T22:33:38.170472] [INFO ] [MAIN ] AA: Loaded 54395 primary data records. [2025-10-03T22:33:38.473516] [DEBUG] [LOCAL ] AAP: Loaded 52648 existing records from primary storage. [2025-10-03T22:33:38.502514] [INFO ] [MAIN ] AAP: Loaded 52648 primary data records. [2025-10-03T22:33:39.301759] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:39.305027] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54395 primary records. [2025-10-03T22:33:39.305503] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-03T22:33:39.337597] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:39.339815] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51488 primary records. [2025-10-03T22:33:39.340252] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-03T22:33:39.357206] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-10-03T22:33:39.358684] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-03T22:33:39.362729] [INFO ] [MAIN ] Derivative Progress: 1/2073 symbols completed. AA took 1.3s. Estimated remaining: 44m 44s. Rate: 46.3 symbols/min [2025-10-03T22:33:39.364535] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:39.382046] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-10-03T22:33:39.382193] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-03T22:33:39.381546] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:39.383178] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52648 primary records. [2025-10-03T22:33:39.383388] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-03T22:33:39.385888] [INFO ] [MAIN ] Derivative Progress: 2/2073 symbols completed. A took 1.3s. Estimated remaining: 22m 45s. Rate: 91.0 symbols/min [2025-10-03T22:33:39.387255] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:39.416352] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-10-03T22:33:39.416744] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-03T22:33:39.420855] [INFO ] [MAIN ] Derivative Progress: 3/2073 symbols completed. AAP took 1.4s. Estimated remaining: 15m 34s. Rate: 133.0 symbols/min [2025-10-03T22:33:39.421365] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:39.444501] [DEBUG] [LOCAL ] AAT: Loaded 30838 existing records from primary storage. [2025-10-03T22:33:39.444770] [INFO ] [MAIN ] AAT: Loaded 30838 primary data records. [2025-10-03T22:33:39.565036] [DEBUG] [LOCAL ] AB: Loaded 27775 existing records from primary storage. [2025-10-03T22:33:39.577448] [INFO ] [MAIN ] AB: Loaded 27775 primary data records. [2025-10-03T22:33:39.922512] [DEBUG] [LOCAL ] ABCB: Loaded 30916 existing records from primary storage. [2025-10-03T22:33:39.939606] [INFO ] [MAIN ] ABCB: Loaded 30916 primary data records. [2025-10-03T22:33:40.521383] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:40.523043] [INFO ] [MAIN ] AAT: Generated 1820 derivative records from 30838 primary records. [2025-10-03T22:33:40.523305] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-03T22:33:40.560778] [DEBUG] [LOCAL ] AAT: Derivative data saved (1820 records). [2025-10-03T22:33:40.561257] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:40.562528] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-03T22:33:40.562274] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 27775 primary records. [2025-10-03T22:33:40.564711] [INFO ] [MAIN ] Derivative Progress: 4/2073 symbols completed. AAT took 1.2s. Estimated remaining: 21m 32s. Rate: 96.1 symbols/min [2025-10-03T22:33:40.564838] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-03T22:33:40.564925] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:40.586056] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-10-03T22:33:40.586217] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-03T22:33:40.588536] [INFO ] [MAIN ] Derivative Progress: 5/2073 symbols completed. AB took 1.2s. Estimated remaining: 17m 23s. Rate: 119.0 symbols/min [2025-10-03T22:33:40.588837] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:40.603692] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:40.604877] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 30916 primary records. [2025-10-03T22:33:40.605673] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-03T22:33:40.628144] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-10-03T22:33:40.638351] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-03T22:33:40.641326] [INFO ] [MAIN ] Derivative Progress: 6/2073 symbols completed. ABCB took 1.2s. Estimated remaining: 14m 47s. Rate: 139.9 symbols/min [2025-10-03T22:33:40.641758] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:40.669268] [DEBUG] [LOCAL ] ABM: Loaded 32469 existing records from primary storage. [2025-10-03T22:33:40.669441] [INFO ] [MAIN ] ABM: Loaded 32469 primary data records. [2025-10-03T22:33:40.787632] [DEBUG] [LOCAL ] ABEV: Loaded 54058 existing records from primary storage. [2025-10-03T22:33:40.810130] [INFO ] [MAIN ] ABEV: Loaded 54058 primary data records. [2025-10-03T22:33:41.171447] [DEBUG] [LOCAL ] ABR: Loaded 52754 existing records from primary storage. [2025-10-03T22:33:41.177923] [INFO ] [MAIN ] ABR: Loaded 52754 primary data records. [2025-10-03T22:33:41.825187] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:41.826729] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32469 primary records. [2025-10-03T22:33:41.827335] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-03T22:33:41.862445] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:41.866313] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54058 primary records. [2025-10-03T22:33:41.867338] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-03T22:33:41.894957] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:41.899450] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-10-03T22:33:41.901746] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52754 primary records. [2025-10-03T22:33:41.899769] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-03T22:33:41.904111] [INFO ] [MAIN ] Derivative Progress: 7/2073 symbols completed. ABEV took 1.3s. Estimated remaining: 18m 52s. Rate: 109.5 symbols/min [2025-10-03T22:33:41.900806] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-10-03T22:33:41.904540] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-03T22:33:41.904297] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-03T22:33:41.907586] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:41.907704] [INFO ] [MAIN ] Derivative Progress: 8/2073 symbols completed. ABM took 1.3s. Estimated remaining: 16m 31s. Rate: 125.0 symbols/min [2025-10-03T22:33:41.909178] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:41.927586] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-10-03T22:33:41.927775] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-03T22:33:41.931831] [INFO ] [MAIN ] Derivative Progress: 9/2073 symbols completed. ABR took 1.3s. Estimated remaining: 14m 46s. Rate: 139.7 symbols/min [2025-10-03T22:33:41.932272] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:41.954389] [DEBUG] [LOCAL ] ACA: Loaded 23677 existing records from primary storage. [2025-10-03T22:33:41.954602] [INFO ] [MAIN ] ACA: Loaded 23677 primary data records. [2025-10-03T22:33:42.230882] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-10-03T22:33:42.343844] [DEBUG] [LOCAL ] ACCO: Loaded 37807 existing records from primary storage. [2025-10-03T22:33:42.357971] [INFO ] [MAIN ] ABT: Loaded 54400 primary data records. [2025-10-03T22:33:42.359580] [INFO ] [MAIN ] ACCO: Loaded 37807 primary data records. [2025-10-03T22:33:43.027804] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:43.029690] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 23677 primary records. [2025-10-03T22:33:43.030000] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-03T22:33:43.050474] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-10-03T22:33:43.051146] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-03T22:33:43.053722] [INFO ] [MAIN ] Derivative Progress: 10/2073 symbols completed. ACA took 1.1s. Estimated remaining: 17m 9s. Rate: 120.3 symbols/min [2025-10-03T22:33:43.054118] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:43.078010] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:43.092102] [INFO ] [MAIN ] ABT: Generated 1820 derivative records from 54400 primary records. [2025-10-03T22:33:43.092712] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-03T22:33:43.093056] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:43.095021] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 37807 primary records. [2025-10-03T22:33:43.095221] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-03T22:33:43.127735] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-10-03T22:33:43.129498] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-03T22:33:43.129258] [DEBUG] [LOCAL ] ABT: Derivative data saved (1820 records). [2025-10-03T22:33:43.132854] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-03T22:33:43.132548] [INFO ] [MAIN ] Derivative Progress: 11/2073 symbols completed. ACCO took 1.2s. Estimated remaining: 15m 49s. Rate: 130.3 symbols/min [2025-10-03T22:33:43.135985] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:43.136397] [INFO ] [MAIN ] Derivative Progress: 12/2073 symbols completed. ABT took 1.2s. Estimated remaining: 14m 31s. Rate: 142.0 symbols/min [2025-10-03T22:33:43.137018] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:43.180059] [DEBUG] [LOCAL ] ACI: Loaded 54030 existing records from primary storage. [2025-10-03T22:33:43.180383] [INFO ] [MAIN ] ACI: Loaded 54030 primary data records. [2025-10-03T22:33:43.519690] [DEBUG] [LOCAL ] ACM: Loaded 43665 existing records from primary storage. [2025-10-03T22:33:43.534863] [INFO ] [MAIN ] ACM: Loaded 43665 primary data records. [2025-10-03T22:33:43.659258] [DEBUG] [LOCAL ] ACN: Loaded 54205 existing records from primary storage. [2025-10-03T22:33:43.670282] [INFO ] [MAIN ] ACN: Loaded 54205 primary data records. [2025-10-03T22:33:44.283877] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:44.285135] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54030 primary records. [2025-10-03T22:33:44.286212] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-03T22:33:44.309519] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-10-03T22:33:44.309840] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-03T22:33:44.313163] [INFO ] [MAIN ] Derivative Progress: 13/2073 symbols completed. ACI took 1.3s. Estimated remaining: 16m 30s. Rate: 124.9 symbols/min [2025-10-03T22:33:44.327719] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:44.328523] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43665 primary records. [2025-10-03T22:33:44.328969] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-03T22:33:44.349971] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-10-03T22:33:44.350215] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-03T22:33:44.353595] [INFO ] [MAIN ] Derivative Progress: 14/2073 symbols completed. ACM took 1.2s. Estimated remaining: 15m 25s. Rate: 133.6 symbols/min [2025-10-03T22:33:44.366810] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:44.367555] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54205 primary records. [2025-10-03T22:33:44.367621] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-03T22:33:44.383911] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-10-03T22:33:44.384035] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-03T22:33:44.386758] [INFO ] [MAIN ] Derivative Progress: 15/2073 symbols completed. ACN took 1.2s. Estimated remaining: 14m 27s. Rate: 142.4 symbols/min [2025-10-03T22:33:44.387281] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:44.387183] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:44.387234] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:44.399634] [DEBUG] [LOCAL ] ACR: Loaded 6006 existing records from primary storage. [2025-10-03T22:33:44.399852] [INFO ] [MAIN ] ACR: Loaded 6006 primary data records. [2025-10-03T22:33:44.746445] [DEBUG] [LOCAL ] ACRE: Loaded 34079 existing records from primary storage. [2025-10-03T22:33:44.746318] [DEBUG] [LOCAL ] ACP: Loaded 31458 existing records from primary storage. [2025-10-03T22:33:44.746880] [INFO ] [MAIN ] ACRE: Loaded 34079 primary data records. [2025-10-03T22:33:44.747129] [INFO ] [MAIN ] ACP: Loaded 31458 primary data records. [2025-10-03T22:33:45.410141] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:45.412630] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6006 primary records. [2025-10-03T22:33:45.412788] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-03T22:33:45.431450] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-10-03T22:33:45.431862] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-03T22:33:45.435036] [INFO ] [MAIN ] Derivative Progress: 16/2073 symbols completed. ACR took 1.0s. Estimated remaining: 15m 47s. Rate: 130.3 symbols/min [2025-10-03T22:33:45.435518] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:45.457299] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:45.458757] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34079 primary records. [2025-10-03T22:33:45.463714] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-03T22:33:45.466927] [DEBUG] [LOCAL ] ACV: Loaded 7512 existing records from primary storage. [2025-10-03T22:33:45.484171] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-10-03T22:33:45.496831] [INFO ] [MAIN ] ACV: Loaded 7512 primary data records. [2025-10-03T22:33:45.502878] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-03T22:33:45.503140] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:45.517256] [INFO ] [MAIN ] Derivative Progress: 17/2073 symbols completed. ACRE took 1.1s. Estimated remaining: 15m 1s. Rate: 136.9 symbols/min [2025-10-03T22:33:45.528897] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:45.523530] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31458 primary records. [2025-10-03T22:33:45.548266] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-03T22:33:45.719217] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-10-03T22:33:45.857979] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-03T22:33:45.862095] [INFO ] [MAIN ] Derivative Progress: 18/2073 symbols completed. ACP took 1.5s. Estimated remaining: 14m 50s. Rate: 138.6 symbols/min [2025-10-03T22:33:45.862723] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:45.886863] [DEBUG] [LOCAL ] ACVA: Loaded 49976 existing records from primary storage. [2025-10-03T22:33:45.887156] [INFO ] [MAIN ] ACVA: Loaded 49976 primary data records. [2025-10-03T22:33:46.287087] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:46.303254] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7512 primary records. [2025-10-03T22:33:46.305012] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-03T22:33:46.304817] [DEBUG] [LOCAL ] ADC: Loaded 46854 existing records from primary storage. [2025-10-03T22:33:46.307107] [INFO ] [MAIN ] ADC: Loaded 46854 primary data records. [2025-10-03T22:33:46.368878] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-10-03T22:33:46.391977] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-03T22:33:46.406911] [INFO ] [MAIN ] Derivative Progress: 19/2073 symbols completed. ACV took 1.0s. Estimated remaining: 15m 2s. Rate: 136.7 symbols/min [2025-10-03T22:33:46.423758] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:46.658305] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:46.659876] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 49976 primary records. [2025-10-03T22:33:46.660392] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-03T22:33:46.690592] [DEBUG] [LOCAL ] ADCT: Loaded 35209 existing records from primary storage. [2025-10-03T22:33:46.692033] [INFO ] [MAIN ] ADCT: Loaded 35209 primary data records. [2025-10-03T22:33:46.715768] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-10-03T22:33:46.716103] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-03T22:33:46.729011] [INFO ] [MAIN ] Derivative Progress: 20/2073 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 49s. Rate: 138.5 symbols/min [2025-10-03T22:33:46.734585] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:46.902947] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:47.021460] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46854 primary records. [2025-10-03T22:33:47.029318] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-03T22:33:47.090843] [DEBUG] [LOCAL ] ADM: Loaded 54167 existing records from primary storage. [2025-10-03T22:33:47.091125] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-10-03T22:33:47.091663] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-03T22:33:47.091791] [INFO ] [MAIN ] ADM: Loaded 54167 primary data records. [2025-10-03T22:33:47.094927] [INFO ] [MAIN ] Derivative Progress: 21/2073 symbols completed. ADC took 1.2s. Estimated remaining: 14m 42s. Rate: 139.6 symbols/min [2025-10-03T22:33:47.134220] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:47.426960] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:47.443832] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 35209 primary records. [2025-10-03T22:33:47.444077] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-03T22:33:47.479141] [DEBUG] [LOCAL ] ADNT: Loaded 47831 existing records from primary storage. [2025-10-03T22:33:47.480228] [INFO ] [MAIN ] ADNT: Loaded 47831 primary data records. [2025-10-03T22:33:47.503795] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-10-03T22:33:47.546475] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-03T22:33:47.560901] [INFO ] [MAIN ] Derivative Progress: 22/2073 symbols completed. ADCT took 1.1s. Estimated remaining: 14m 45s. Rate: 139.0 symbols/min [2025-10-03T22:33:47.567572] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:47.840164] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:47.841485] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54167 primary records. [2025-10-03T22:33:47.841996] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-03T22:33:47.879688] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-10-03T22:33:47.879881] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-03T22:33:47.883156] [INFO ] [MAIN ] Derivative Progress: 23/2073 symbols completed. ADM took 1.1s. Estimated remaining: 14m 35s. Rate: 140.6 symbols/min [2025-10-03T22:33:47.885389] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:47.886682] [DEBUG] [LOCAL ] ADT: Loaded 54224 existing records from primary storage. [2025-10-03T22:33:47.887938] [INFO ] [MAIN ] ADT: Loaded 54224 primary data records. [2025-10-03T22:33:48.098913] [DEBUG] [LOCAL ] ADX: Loaded 27928 existing records from primary storage. [2025-10-03T22:33:48.217508] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:48.282311] [INFO ] [MAIN ] ADX: Loaded 27928 primary data records. [2025-10-03T22:33:48.282244] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 47831 primary records. [2025-10-03T22:33:48.282547] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-03T22:33:48.434844] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-10-03T22:33:48.487338] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-03T22:33:48.605542] [INFO ] [MAIN ] Derivative Progress: 24/2073 symbols completed. ADNT took 1.5s. Estimated remaining: 14m 60s. Rate: 136.6 symbols/min [2025-10-03T22:33:48.615136] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:48.650765] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:48.651699] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54224 primary records. [2025-10-03T22:33:48.651993] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-03T22:33:48.704582] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-10-03T22:33:48.705426] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-03T22:33:48.708289] [INFO ] [MAIN ] Derivative Progress: 25/2073 symbols completed. ADT took 1.1s. Estimated remaining: 14m 32s. Rate: 141.0 symbols/min [2025-10-03T22:33:48.705358] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:48.710852] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:48.710688] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 27928 primary records. [2025-10-03T22:33:48.725521] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-03T22:33:48.737109] [DEBUG] [LOCAL ] AEE: Loaded 50827 existing records from primary storage. [2025-10-03T22:33:48.741407] [INFO ] [MAIN ] AEE: Loaded 50827 primary data records. [2025-10-03T22:33:48.780450] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-10-03T22:33:48.813770] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-03T22:33:48.860227] [DEBUG] [LOCAL ] AEFC: Loaded 8584 existing records from primary storage. [2025-10-03T22:33:48.864279] [INFO ] [MAIN ] Derivative Progress: 26/2073 symbols completed. ADX took 1.0s. Estimated remaining: 14m 10s. Rate: 144.5 symbols/min [2025-10-03T22:33:48.883249] [INFO ] [MAIN ] AEFC: Loaded 8584 primary data records. [2025-10-03T22:33:48.883424] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:49.457863] [DEBUG] [LOCAL ] AEG: Loaded 50249 existing records from primary storage. [2025-10-03T22:33:49.458236] [INFO ] [MAIN ] AEG: Loaded 50249 primary data records. [2025-10-03T22:33:49.532103] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:49.567923] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50827 primary records. [2025-10-03T22:33:49.568165] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-03T22:33:49.639912] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:49.655804] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8584 primary records. [2025-10-03T22:33:49.690678] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-03T22:33:49.859359] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-10-03T22:33:49.859519] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-03T22:33:49.858567] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-10-03T22:33:49.859675] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-03T22:33:49.862634] [INFO ] [MAIN ] Derivative Progress: 27/2073 symbols completed. AEE took 1.2s. Estimated remaining: 14m 54s. Rate: 137.3 symbols/min [2025-10-03T22:33:49.866580] [INFO ] [MAIN ] Derivative Progress: 28/2073 symbols completed. AEFC took 1.2s. Estimated remaining: 14m 22s. Rate: 142.4 symbols/min [2025-10-03T22:33:49.866161] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:49.900436] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:49.901398] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50249 primary records. [2025-10-03T22:33:49.904326] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-03T22:33:49.923091] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-10-03T22:33:49.923383] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-03T22:33:49.926666] [INFO ] [MAIN ] Derivative Progress: 29/2073 symbols completed. AEG took 1.0s. Estimated remaining: 13m 56s. Rate: 146.7 symbols/min [2025-10-03T22:33:49.974192] [DEBUG] [LOCAL ] AEM: Loaded 54239 existing records from primary storage. [2025-10-03T22:33:49.974419] [INFO ] [MAIN ] AEM: Loaded 54239 primary data records. [2025-10-03T22:33:50.342947] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:50.343834] [INFO ] [MAIN ] AEM: Generated 1820 derivative records from 54239 primary records. [2025-10-03T22:33:50.343902] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-03T22:33:50.360414] [DEBUG] [LOCAL ] AEM: Derivative data saved (1820 records). [2025-10-03T22:33:50.360488] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-03T22:33:50.363337] [INFO ] [MAIN ] Derivative Progress: 30/2073 symbols completed. AEM took 0.5s. Estimated remaining: 13m 57s. Rate: 146.4 symbols/min [2025-10-03T22:33:50.364467] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:50.364393] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:50.364269] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:50.437479] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-10-03T22:33:50.437787] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-10-03T22:33:50.627393] [DEBUG] [LOCAL ] AEO: Loaded 54337 existing records from primary storage. [2025-10-03T22:33:50.620035] [DEBUG] [LOCAL ] AER: Loaded 49029 existing records from primary storage. [2025-10-03T22:33:50.650102] [INFO ] [MAIN ] AEO: Loaded 54337 primary data records. [2025-10-03T22:33:50.650223] [INFO ] [MAIN ] AER: Loaded 49029 primary data records. [2025-10-03T22:33:51.552247] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:51.553673] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-10-03T22:33:51.553966] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-03T22:33:51.580497] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-10-03T22:33:51.589306] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-03T22:33:51.606543] [INFO ] [MAIN ] Derivative Progress: 31/2073 symbols completed. AES took 1.2s. Estimated remaining: 14m 52s. Rate: 137.4 symbols/min [2025-10-03T22:33:51.603625] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:51.611959] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:51.613704] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 49029 primary records. [2025-10-03T22:33:51.614258] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-03T22:33:51.614147] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:51.617073] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54337 primary records. [2025-10-03T22:33:51.617309] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-03T22:33:51.649439] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-10-03T22:33:51.650229] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-03T22:33:51.654037] [INFO ] [MAIN ] Derivative Progress: 32/2073 symbols completed. AEO took 1.3s. Estimated remaining: 14m 27s. Rate: 141.3 symbols/min [2025-10-03T22:33:51.654983] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:51.659863] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-10-03T22:33:51.660269] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-03T22:33:51.663344] [INFO ] [MAIN ] Derivative Progress: 33/2073 symbols completed. AER took 1.3s. Estimated remaining: 14m 0s. Rate: 145.6 symbols/min [2025-10-03T22:33:51.663788] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:51.678458] [DEBUG] [LOCAL ] AFB: Loaded 11614 existing records from primary storage. [2025-10-03T22:33:51.691547] [INFO ] [MAIN ] AFB: Loaded 11614 primary data records. [2025-10-03T22:33:51.855824] [DEBUG] [LOCAL ] AESI: Loaded 50229 existing records from primary storage. [2025-10-03T22:33:51.889431] [INFO ] [MAIN ] AESI: Loaded 50229 primary data records. [2025-10-03T22:33:52.122960] [DEBUG] [LOCAL ] AFG: Loaded 32819 existing records from primary storage. [2025-10-03T22:33:52.150851] [INFO ] [MAIN ] AFG: Loaded 32819 primary data records. [2025-10-03T22:33:52.786994] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:52.788382] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11614 primary records. [2025-10-03T22:33:52.789251] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-03T22:33:52.809821] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-10-03T22:33:52.811495] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-03T22:33:52.814814] [INFO ] [MAIN ] Derivative Progress: 34/2073 symbols completed. AFB took 1.2s. Estimated remaining: 14m 44s. Rate: 138.3 symbols/min [2025-10-03T22:33:52.815896] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:52.840496] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:52.842669] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50229 primary records. [2025-10-03T22:33:52.846289] [DEBUG] [LOCAL ] AFGC: Loaded 2568 existing records from primary storage. [2025-10-03T22:33:52.846565] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-03T22:33:52.847937] [INFO ] [MAIN ] AFGC: Loaded 2568 primary data records. [2025-10-03T22:33:52.962554] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-10-03T22:33:52.993506] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-03T22:33:52.996803] [INFO ] [MAIN ] Derivative Progress: 35/2073 symbols completed. AESI took 1.4s. Estimated remaining: 14m 29s. Rate: 140.7 symbols/min [2025-10-03T22:33:53.007794] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:53.013225] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:53.019406] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 32819 primary records. [2025-10-03T22:33:53.038283] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-03T22:33:53.215827] [DEBUG] [LOCAL ] AFGD: Loaded 1836 existing records from primary storage. [2025-10-03T22:33:53.215953] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-10-03T22:33:53.216429] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-03T22:33:53.216547] [INFO ] [MAIN ] AFGD: Loaded 1836 primary data records. [2025-10-03T22:33:53.220117] [INFO ] [MAIN ] Derivative Progress: 36/2073 symbols completed. AFG took 1.6s. Estimated remaining: 14m 17s. Rate: 142.5 symbols/min [2025-10-03T22:33:53.233084] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:53.331574] [DEBUG] [LOCAL ] AFGE: Loaded 2471 existing records from primary storage. [2025-10-03T22:33:53.335523] [INFO ] [MAIN ] AFGE: Loaded 2471 primary data records. [2025-10-03T22:33:53.790932] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:33:53.939402] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2568 primary records. [2025-10-03T22:33:53.940769] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-03T22:33:53.967446] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-10-03T22:33:53.967976] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-03T22:33:53.970494] [INFO ] [MAIN ] Derivative Progress: 37/2073 symbols completed. AFGC took 1.2s. Estimated remaining: 14m 35s. Rate: 139.6 symbols/min [2025-10-03T22:33:53.971235] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:53.990489] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:53.991528] [INFO ] [MAIN ] AFGD: Generated 1820 derivative records from 1836 primary records. [2025-10-03T22:33:53.991731] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-03T22:33:54.007044] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1820 records). [2025-10-03T22:33:54.007169] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-03T22:33:54.010100] [INFO ] [MAIN ] Derivative Progress: 38/2073 symbols completed. AFGD took 1.0s. Estimated remaining: 14m 14s. Rate: 143.0 symbols/min [2025-10-03T22:33:54.011709] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:54.030615] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:54.031684] [INFO ] [MAIN ] AFGE: Generated 1820 derivative records from 2471 primary records. [2025-10-03T22:33:54.032008] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-03T22:33:54.065821] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1820 records). [2025-10-03T22:33:54.066156] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-03T22:33:54.069093] [INFO ] [MAIN ] Derivative Progress: 39/2073 symbols completed. AFGE took 0.8s. Estimated remaining: 13m 55s. Rate: 146.2 symbols/min [2025-10-03T22:33:54.069419] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:54.105878] [DEBUG] [LOCAL ] AFL: Loaded 53923 existing records from primary storage. [2025-10-03T22:33:54.106191] [INFO ] [MAIN ] AFL: Loaded 53923 primary data records. [2025-10-03T22:33:54.231582] [DEBUG] [LOCAL ] AG: Loaded 54422 existing records from primary storage. [2025-10-03T22:33:54.236143] [INFO ] [MAIN ] AG: Loaded 54422 primary data records. [2025-10-03T22:33:54.664029] [DEBUG] [LOCAL ] AGCO: Loaded 42995 existing records from primary storage. [2025-10-03T22:33:54.689217] [INFO ] [MAIN ] AGCO: Loaded 42995 primary data records. [2025-10-03T22:33:55.207620] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:55.208807] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53923 primary records. [2025-10-03T22:33:55.209486] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-03T22:33:55.247187] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:55.249533] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54422 primary records. [2025-10-03T22:33:55.250177] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-03T22:33:55.251545] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-10-03T22:33:55.251696] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-03T22:33:55.254256] [INFO ] [MAIN ] Derivative Progress: 40/2073 symbols completed. AFL took 1.3s. Estimated remaining: 14m 34s. Rate: 139.6 symbols/min [2025-10-03T22:33:55.265695] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:55.285744] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:55.287439] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 42995 primary records. [2025-10-03T22:33:55.287679] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-03T22:33:55.302521] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-10-03T22:33:55.310136] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-03T22:33:55.313753] [INFO ] [MAIN ] Derivative Progress: 41/2073 symbols completed. AG took 1.3s. Estimated remaining: 14m 15s. Rate: 142.6 symbols/min [2025-10-03T22:33:55.314063] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:55.316503] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-10-03T22:33:55.316681] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-03T22:33:55.322953] [INFO ] [MAIN ] Derivative Progress: 42/2073 symbols completed. AGCO took 1.3s. Estimated remaining: 13m 54s. Rate: 146.0 symbols/min [2025-10-03T22:33:55.324205] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:55.354672] [DEBUG] [LOCAL ] AGM: Loaded 10383 existing records from primary storage. [2025-10-03T22:33:55.356037] [INFO ] [MAIN ] AGM: Loaded 10383 primary data records. [2025-10-03T22:33:55.457367] [DEBUG] [LOCAL ] AGI: Loaded 54194 existing records from primary storage. [2025-10-03T22:33:55.495055] [INFO ] [MAIN ] AGI: Loaded 54194 primary data records. [2025-10-03T22:33:55.822149] [DEBUG] [LOCAL ] AGL: Loaded 53221 existing records from primary storage. [2025-10-03T22:33:55.841828] [INFO ] [MAIN ] AGL: Loaded 53221 primary data records. [2025-10-03T22:33:56.399712] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:56.401557] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10383 primary records. [2025-10-03T22:33:56.401930] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-03T22:33:56.430059] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-10-03T22:33:56.435674] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-03T22:33:56.438811] [INFO ] [MAIN ] Derivative Progress: 43/2073 symbols completed. AGM took 1.1s. Estimated remaining: 14m 27s. Rate: 140.4 symbols/min [2025-10-03T22:33:56.439442] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:56.440774] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54194 primary records. [2025-10-03T22:33:56.440855] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-03T22:33:56.472821] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-10-03T22:33:56.472945] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-03T22:33:56.471464] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:56.476750] [INFO ] [MAIN ] Derivative Progress: 44/2073 symbols completed. AGI took 1.2s. Estimated remaining: 14m 9s. Rate: 143.4 symbols/min [2025-10-03T22:33:56.477952] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53221 primary records. [2025-10-03T22:33:56.478019] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-03T22:33:56.494148] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-10-03T22:33:56.494216] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-03T22:33:56.496882] [INFO ] [MAIN ] Derivative Progress: 45/2073 symbols completed. AGL took 1.2s. Estimated remaining: 13m 51s. Rate: 146.5 symbols/min [2025-10-03T22:33:56.497325] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:56.497420] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:56.497501] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:56.548543] [DEBUG] [LOCAL ] AGO: Loaded 28380 existing records from primary storage. [2025-10-03T22:33:56.559975] [INFO ] [MAIN ] AGO: Loaded 28380 primary data records. [2025-10-03T22:33:56.592914] [DEBUG] [LOCAL ] AGX: Loaded 33569 existing records from primary storage. [2025-10-03T22:33:56.598451] [INFO ] [MAIN ] AGX: Loaded 33569 primary data records. [2025-10-03T22:33:56.625334] [DEBUG] [LOCAL ] AGRO: Loaded 33939 existing records from primary storage. [2025-10-03T22:33:56.693228] [INFO ] [MAIN ] AGRO: Loaded 33939 primary data records. [2025-10-03T22:33:57.725263] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:57.727691] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33569 primary records. [2025-10-03T22:33:57.727805] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-03T22:33:57.737757] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:57.758739] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:57.761952] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28380 primary records. [2025-10-03T22:33:57.762449] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-03T22:33:57.767708] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-10-03T22:33:57.768724] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-03T22:33:57.772177] [INFO ] [MAIN ] Derivative Progress: 46/2073 symbols completed. AGX took 1.3s. Estimated remaining: 14m 28s. Rate: 140.1 symbols/min [2025-10-03T22:33:57.784875] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:57.780557] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 33939 primary records. [2025-10-03T22:33:57.788984] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-03T22:33:57.790441] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-10-03T22:33:57.790842] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-03T22:33:57.795999] [INFO ] [MAIN ] Derivative Progress: 47/2073 symbols completed. AGO took 1.3s. Estimated remaining: 14m 10s. Rate: 142.9 symbols/min [2025-10-03T22:33:57.796468] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:57.817329] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-10-03T22:33:57.817634] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-03T22:33:57.821074] [INFO ] [MAIN ] Derivative Progress: 48/2073 symbols completed. AGRO took 1.3s. Estimated remaining: 13m 53s. Rate: 145.8 symbols/min [2025-10-03T22:33:57.821430] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:57.835336] [DEBUG] [LOCAL ] AHT: Loaded 6250 existing records from primary storage. [2025-10-03T22:33:57.836019] [INFO ] [MAIN ] AHT: Loaded 6250 primary data records. [2025-10-03T22:33:58.042664] [DEBUG] [LOCAL ] AHH: Loaded 41619 existing records from primary storage. [2025-10-03T22:33:58.063623] [INFO ] [MAIN ] AHH: Loaded 41619 primary data records. [2025-10-03T22:33:58.230223] [DEBUG] [LOCAL ] AHR: Loaded 49849 existing records from primary storage. [2025-10-03T22:33:58.278100] [INFO ] [MAIN ] AHR: Loaded 49849 primary data records. [2025-10-03T22:33:58.947840] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:58.949149] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6250 primary records. [2025-10-03T22:33:58.949422] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-03T22:33:58.968071] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-10-03T22:33:58.968468] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-03T22:33:58.971496] [INFO ] [MAIN ] Derivative Progress: 49/2073 symbols completed. AHT took 1.2s. Estimated remaining: 14m 23s. Rate: 140.6 symbols/min [2025-10-03T22:33:58.972348] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:59.011323] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:59.012086] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:33:59.013229] [INFO ] [MAIN ] AHR: Generated 1820 derivative records from 49849 primary records. [2025-10-03T22:33:59.014262] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-03T22:33:59.015490] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41619 primary records. [2025-10-03T22:33:59.015664] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-03T22:33:59.052297] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-10-03T22:33:59.052498] [DEBUG] [LOCAL ] AHR: Derivative data saved (1820 records). [2025-10-03T22:33:59.052925] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-03T22:33:59.056071] [INFO ] [MAIN ] Derivative Progress: 50/2073 symbols completed. AHH took 1.3s. Estimated remaining: 14m 9s. Rate: 142.9 symbols/min [2025-10-03T22:33:59.056225] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-03T22:33:59.059212] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:59.059443] [INFO ] [MAIN ] Derivative Progress: 51/2073 symbols completed. AHR took 1.3s. Estimated remaining: 13m 52s. Rate: 145.8 symbols/min [2025-10-03T22:33:59.060203] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:33:59.108684] [DEBUG] [LOCAL ] AI: Loaded 54530 existing records from primary storage. [2025-10-03T22:33:59.119248] [INFO ] [MAIN ] AI: Loaded 54530 primary data records. [2025-10-03T22:33:59.242823] [DEBUG] [LOCAL ] AIN: Loaded 24987 existing records from primary storage. [2025-10-03T22:33:59.244421] [DEBUG] [LOCAL ] AIT: Loaded 27793 existing records from primary storage. [2025-10-03T22:33:59.243154] [INFO ] [MAIN ] AIN: Loaded 24987 primary data records. [2025-10-03T22:33:59.260241] [INFO ] [MAIN ] AIT: Loaded 27793 primary data records. [2025-10-03T22:34:00.132065] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:00.134985] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54530 primary records. [2025-10-03T22:34:00.135202] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-03T22:34:00.155234] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-10-03T22:34:00.155957] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-03T22:34:00.160077] [INFO ] [MAIN ] Derivative Progress: 52/2073 symbols completed. AI took 1.2s. Estimated remaining: 14m 19s. Rate: 141.2 symbols/min [2025-10-03T22:34:00.160613] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:00.181346] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:00.183357] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24987 primary records. [2025-10-03T22:34:00.183577] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-03T22:34:00.212538] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:00.216027] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 27793 primary records. [2025-10-03T22:34:00.216226] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-03T22:34:00.215129] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-10-03T22:34:00.216516] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-03T22:34:00.220613] [INFO ] [MAIN ] Derivative Progress: 53/2073 symbols completed. AIN took 1.2s. Estimated remaining: 14m 4s. Rate: 143.5 symbols/min [2025-10-03T22:34:00.221527] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:00.252424] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-10-03T22:34:00.252599] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-03T22:34:00.255997] [INFO ] [MAIN ] Derivative Progress: 54/2073 symbols completed. AIT took 1.2s. Estimated remaining: 13m 50s. Rate: 146.0 symbols/min [2025-10-03T22:34:00.256460] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:00.282072] [DEBUG] [LOCAL ] AIV: Loaded 41125 existing records from primary storage. [2025-10-03T22:34:00.282451] [INFO ] [MAIN ] AIV: Loaded 41125 primary data records. [2025-10-03T22:34:00.332995] [DEBUG] [LOCAL ] AIZN: Loaded 4108 existing records from primary storage. [2025-10-03T22:34:00.356560] [INFO ] [MAIN ] AIZN: Loaded 4108 primary data records. [2025-10-03T22:34:00.389224] [DEBUG] [LOCAL ] AIZ: Loaded 30255 existing records from primary storage. [2025-10-03T22:34:00.429032] [INFO ] [MAIN ] AIZ: Loaded 30255 primary data records. [2025-10-03T22:34:01.342928] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:01.344269] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 41125 primary records. [2025-10-03T22:34:01.344454] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-03T22:34:01.380582] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:01.391401] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 4108 primary records. [2025-10-03T22:34:01.397087] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-03T22:34:01.398965] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:01.401376] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30255 primary records. [2025-10-03T22:34:01.401517] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-10-03T22:34:01.401923] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-03T22:34:01.411417] [INFO ] [MAIN ] Derivative Progress: 55/2073 symbols completed. AIV took 1.3s. Estimated remaining: 14m 17s. Rate: 141.4 symbols/min [2025-10-03T22:34:01.401850] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-03T22:34:01.415986] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:01.421564] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-10-03T22:34:01.422114] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-03T22:34:01.434873] [INFO ] [MAIN ] Derivative Progress: 56/2073 symbols completed. AIZN took 1.2s. Estimated remaining: 14m 2s. Rate: 143.8 symbols/min [2025-10-03T22:34:01.435205] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:01.448070] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-10-03T22:34:01.448337] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-03T22:34:01.453368] [INFO ] [MAIN ] Derivative Progress: 57/2073 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 47s. Rate: 146.2 symbols/min [2025-10-03T22:34:01.454101] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:01.541678] [DEBUG] [LOCAL ] AJG: Loaded 47485 existing records from primary storage. [2025-10-03T22:34:01.540486] [DEBUG] [LOCAL ] AKR: Loaded 46431 existing records from primary storage. [2025-10-03T22:34:01.554511] [INFO ] [MAIN ] AJG: Loaded 47485 primary data records. [2025-10-03T22:34:01.554596] [INFO ] [MAIN ] AKR: Loaded 46431 primary data records. [2025-10-03T22:34:01.621560] [DEBUG] [LOCAL ] AL: Loaded 44986 existing records from primary storage. [2025-10-03T22:34:01.637551] [INFO ] [MAIN ] AL: Loaded 44986 primary data records. [2025-10-03T22:34:02.614090] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:02.614456] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:02.615686] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47485 primary records. [2025-10-03T22:34:02.616439] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46431 primary records. [2025-10-03T22:34:02.616577] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-03T22:34:02.631128] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-03T22:34:02.640544] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:02.656731] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44986 primary records. [2025-10-03T22:34:02.657090] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-03T22:34:02.671874] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-10-03T22:34:02.675238] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-03T22:34:02.678580] [INFO ] [MAIN ] Derivative Progress: 58/2073 symbols completed. AKR took 1.2s. Estimated remaining: 14m 15s. Rate: 141.4 symbols/min [2025-10-03T22:34:02.684461] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-10-03T22:34:02.685454] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-03T22:34:02.685388] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-10-03T22:34:02.688887] [INFO ] [MAIN ] Derivative Progress: 59/2073 symbols completed. AJG took 1.3s. Estimated remaining: 14m 0s. Rate: 143.8 symbols/min [2025-10-03T22:34:02.689073] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-03T22:34:02.691573] [INFO ] [MAIN ] Derivative Progress: 60/2073 symbols completed. AL took 1.2s. Estimated remaining: 13m 46s. Rate: 146.2 symbols/min [2025-10-03T22:34:02.692086] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:02.692262] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:02.692146] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:02.766141] [DEBUG] [LOCAL ] ALE: Loaded 31333 existing records from primary storage. [2025-10-03T22:34:02.766536] [INFO ] [MAIN ] ALE: Loaded 31333 primary data records. [2025-10-03T22:34:02.895539] [DEBUG] [LOCAL ] ALC: Loaded 51600 existing records from primary storage. [2025-10-03T22:34:02.908817] [INFO ] [MAIN ] ALC: Loaded 51600 primary data records. [2025-10-03T22:34:02.909904] [DEBUG] [LOCAL ] ALB: Loaded 54012 existing records from primary storage. [2025-10-03T22:34:02.915316] [INFO ] [MAIN ] ALB: Loaded 54012 primary data records. [2025-10-03T22:34:03.883241] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:03.884965] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 31333 primary records. [2025-10-03T22:34:03.885449] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-03T22:34:03.913132] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-10-03T22:34:03.927062] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-03T22:34:03.928191] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:03.945728] [INFO ] [MAIN ] Derivative Progress: 61/2073 symbols completed. ALE took 1.3s. Estimated remaining: 14m 14s. Rate: 141.4 symbols/min [2025-10-03T22:34:03.946495] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:03.947483] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51600 primary records. [2025-10-03T22:34:03.948598] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-03T22:34:03.948464] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:03.950237] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54012 primary records. [2025-10-03T22:34:03.950822] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-03T22:34:03.982618] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-10-03T22:34:03.982974] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-03T22:34:03.985585] [INFO ] [MAIN ] Derivative Progress: 62/2073 symbols completed. ALC took 1.3s. Estimated remaining: 14m 1s. Rate: 143.5 symbols/min [2025-10-03T22:34:03.985900] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:03.990701] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-10-03T22:34:03.990824] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-03T22:34:03.994242] [INFO ] [MAIN ] Derivative Progress: 63/2073 symbols completed. ALB took 1.3s. Estimated remaining: 13m 47s. Rate: 145.8 symbols/min [2025-10-03T22:34:03.994667] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:04.016450] [DEBUG] [LOCAL ] ALG: Loaded 10359 existing records from primary storage. [2025-10-03T22:34:04.016844] [INFO ] [MAIN ] ALG: Loaded 10359 primary data records. [2025-10-03T22:34:04.129595] [DEBUG] [LOCAL ] ALEX: Loaded 31583 existing records from primary storage. [2025-10-03T22:34:04.148173] [INFO ] [MAIN ] ALEX: Loaded 31583 primary data records. [2025-10-03T22:34:04.541557] [DEBUG] [LOCAL ] ALIT: Loaded 53540 existing records from primary storage. [2025-10-03T22:34:04.566621] [INFO ] [MAIN ] ALIT: Loaded 53540 primary data records. [2025-10-03T22:34:05.076464] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:05.078061] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10359 primary records. [2025-10-03T22:34:05.078337] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-03T22:34:05.115176] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:05.116986] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31583 primary records. [2025-10-03T22:34:05.117591] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-03T22:34:05.119954] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-10-03T22:34:05.120742] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-03T22:34:05.131376] [INFO ] [MAIN ] Derivative Progress: 64/2073 symbols completed. ALG took 1.1s. Estimated remaining: 14m 10s. Rate: 141.9 symbols/min [2025-10-03T22:34:05.133381] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:05.146125] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-10-03T22:34:05.146689] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-03T22:34:05.149454] [INFO ] [MAIN ] Derivative Progress: 65/2073 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 57s. Rate: 144.0 symbols/min [2025-10-03T22:34:05.149916] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:05.164599] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:05.166004] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53540 primary records. [2025-10-03T22:34:05.166237] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-03T22:34:05.202882] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-10-03T22:34:05.203247] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-03T22:34:05.207062] [INFO ] [MAIN ] Derivative Progress: 66/2073 symbols completed. ALIT took 1.2s. Estimated remaining: 13m 45s. Rate: 145.9 symbols/min [2025-10-03T22:34:05.207383] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:05.266512] [DEBUG] [LOCAL ] ALK: Loaded 53834 existing records from primary storage. [2025-10-03T22:34:05.281266] [INFO ] [MAIN ] ALK: Loaded 53834 primary data records. [2025-10-03T22:34:05.294279] [DEBUG] [LOCAL ] ALL: Loaded 50729 existing records from primary storage. [2025-10-03T22:34:05.309717] [INFO ] [MAIN ] ALL: Loaded 50729 primary data records. [2025-10-03T22:34:05.614069] [DEBUG] [LOCAL ] ALLE: Loaded 45291 existing records from primary storage. [2025-10-03T22:34:05.620826] [INFO ] [MAIN ] ALLE: Loaded 45291 primary data records. [2025-10-03T22:34:06.375074] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:06.377202] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53834 primary records. [2025-10-03T22:34:06.378716] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-03T22:34:06.411766] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-10-03T22:34:06.411142] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:06.411887] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-03T22:34:06.412777] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50729 primary records. [2025-10-03T22:34:06.413048] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-03T22:34:06.416977] [INFO ] [MAIN ] Derivative Progress: 67/2073 symbols completed. ALK took 1.3s. Estimated remaining: 14m 9s. Rate: 141.8 symbols/min [2025-10-03T22:34:06.425785] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:06.435875] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-10-03T22:34:06.436468] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-03T22:34:06.439766] [INFO ] [MAIN ] Derivative Progress: 68/2073 symbols completed. ALL took 1.3s. Estimated remaining: 13m 57s. Rate: 143.8 symbols/min [2025-10-03T22:34:06.440401] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:06.461122] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:06.462266] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 45291 primary records. [2025-10-03T22:34:06.462493] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-03T22:34:06.482593] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-10-03T22:34:06.483015] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-03T22:34:06.486972] [INFO ] [MAIN ] Derivative Progress: 69/2073 symbols completed. ALLE took 1.3s. Estimated remaining: 13m 45s. Rate: 145.7 symbols/min [2025-10-03T22:34:06.487477] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:06.538448] [DEBUG] [LOCAL ] ALLY: Loaded 53994 existing records from primary storage. [2025-10-03T22:34:06.538821] [INFO ] [MAIN ] ALLY: Loaded 53994 primary data records. [2025-10-03T22:34:06.640198] [DEBUG] [LOCAL ] ALSN: Loaded 43927 existing records from primary storage. [2025-10-03T22:34:06.659132] [INFO ] [MAIN ] ALSN: Loaded 43927 primary data records. [2025-10-03T22:34:06.781494] [DEBUG] [LOCAL ] ALTG: Loaded 23811 existing records from primary storage. [2025-10-03T22:34:06.820807] [INFO ] [MAIN ] ALTG: Loaded 23811 primary data records. [2025-10-03T22:34:07.633107] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:07.635728] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53994 primary records. [2025-10-03T22:34:07.636410] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-03T22:34:07.657698] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-10-03T22:34:07.657988] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-03T22:34:07.668828] [INFO ] [MAIN ] Derivative Progress: 70/2073 symbols completed. ALLY took 1.2s. Estimated remaining: 14m 7s. Rate: 141.9 symbols/min [2025-10-03T22:34:07.674242] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:07.675481] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:07.676533] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 43927 primary records. [2025-10-03T22:34:07.676768] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-03T22:34:07.707598] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-10-03T22:34:07.713327] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:07.713506] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-03T22:34:07.714240] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 23811 primary records. [2025-10-03T22:34:07.717789] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-03T22:34:07.717606] [INFO ] [MAIN ] Derivative Progress: 71/2073 symbols completed. ALSN took 1.3s. Estimated remaining: 13m 56s. Rate: 143.7 symbols/min [2025-10-03T22:34:07.719537] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:07.740692] [DEBUG] [LOCAL ] ALUR: Loaded 10863 existing records from primary storage. [2025-10-03T22:34:07.740917] [INFO ] [MAIN ] ALUR: Loaded 10863 primary data records. [2025-10-03T22:34:07.747282] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-10-03T22:34:07.764381] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-03T22:34:07.777899] [INFO ] [MAIN ] Derivative Progress: 72/2073 symbols completed. ALTG took 1.3s. Estimated remaining: 13m 46s. Rate: 145.4 symbols/min [2025-10-03T22:34:07.783484] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:07.862484] [DEBUG] [LOCAL ] ALX: Loaded 6349 existing records from primary storage. [2025-10-03T22:34:07.862969] [INFO ] [MAIN ] ALX: Loaded 6349 primary data records. [2025-10-03T22:34:08.235821] [DEBUG] [LOCAL ] ALV: Loaded 42942 existing records from primary storage. [2025-10-03T22:34:08.288582] [INFO ] [MAIN ] ALV: Loaded 42942 primary data records. [2025-10-03T22:34:08.776702] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:08.779580] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10863 primary records. [2025-10-03T22:34:08.780666] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-03T22:34:08.803012] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-10-03T22:34:08.805407] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-03T22:34:08.808408] [INFO ] [MAIN ] Derivative Progress: 73/2073 symbols completed. ALUR took 1.1s. Estimated remaining: 14m 2s. Rate: 142.5 symbols/min [2025-10-03T22:34:08.824264] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:08.825281] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6349 primary records. [2025-10-03T22:34:08.825469] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-03T22:34:08.844019] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-10-03T22:34:08.844227] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-03T22:34:08.847807] [INFO ] [MAIN ] Derivative Progress: 74/2073 symbols completed. ALX took 1.1s. Estimated remaining: 13m 51s. Rate: 144.2 symbols/min [2025-10-03T22:34:08.860928] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:08.861667] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 42942 primary records. [2025-10-03T22:34:08.861737] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-03T22:34:08.877817] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-10-03T22:34:08.877907] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-03T22:34:08.881090] [INFO ] [MAIN ] Derivative Progress: 75/2073 symbols completed. ALV took 1.2s. Estimated remaining: 13m 41s. Rate: 146.0 symbols/min [2025-10-03T22:34:08.881924] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:08.882391] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:08.881805] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:08.951242] [DEBUG] [LOCAL ] AMBC: Loaded 37179 existing records from primary storage. [2025-10-03T22:34:08.968625] [INFO ] [MAIN ] AMBC: Loaded 37179 primary data records. [2025-10-03T22:34:09.003890] [DEBUG] [LOCAL ] AM: Loaded 52803 existing records from primary storage. [2025-10-03T22:34:09.042240] [INFO ] [MAIN ] AM: Loaded 52803 primary data records. [2025-10-03T22:34:09.232926] [DEBUG] [LOCAL ] AMBP: Loaded 45523 existing records from primary storage. [2025-10-03T22:34:09.292527] [INFO ] [MAIN ] AMBP: Loaded 45523 primary data records. [2025-10-03T22:34:10.064238] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:10.065668] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 37179 primary records. [2025-10-03T22:34:10.078728] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-03T22:34:10.079514] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:10.082260] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52803 primary records. [2025-10-03T22:34:10.082547] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-03T22:34:10.115851] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-10-03T22:34:10.117278] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-10-03T22:34:10.117429] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-03T22:34:10.119293] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-03T22:34:10.121784] [INFO ] [MAIN ] Derivative Progress: 76/2073 symbols completed. AMBC took 1.2s. Estimated remaining: 14m 2s. Rate: 142.3 symbols/min [2025-10-03T22:34:10.126195] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:10.126493] [INFO ] [MAIN ] Derivative Progress: 77/2073 symbols completed. AM took 1.2s. Estimated remaining: 13m 51s. Rate: 144.1 symbols/min [2025-10-03T22:34:10.134802] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:10.140575] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:10.141321] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45523 primary records. [2025-10-03T22:34:10.141385] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-03T22:34:10.159001] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-10-03T22:34:10.159304] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-03T22:34:10.163211] [INFO ] [MAIN ] Derivative Progress: 78/2073 symbols completed. AMBP took 1.3s. Estimated remaining: 13m 41s. Rate: 145.8 symbols/min [2025-10-03T22:34:10.163480] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:10.245310] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-03T22:34:10.246393] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-10-03T22:34:10.246279] [DEBUG] [LOCAL ] AMC: Loaded 54540 existing records from primary storage. [2025-10-03T22:34:10.246887] [INFO ] [MAIN ] AMC: Loaded 54540 primary data records. [2025-10-03T22:34:10.528399] [DEBUG] [LOCAL ] AME: Loaded 49208 existing records from primary storage. [2025-10-03T22:34:10.578742] [INFO ] [MAIN ] AME: Loaded 49208 primary data records. [2025-10-03T22:34:11.365760] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:11.372107] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:11.374242] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54540 primary records. [2025-10-03T22:34:11.373233] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-10-03T22:34:11.374723] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-03T22:34:11.374623] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-03T22:34:11.405843] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-10-03T22:34:11.405997] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-03T22:34:11.409747] [INFO ] [MAIN ] Derivative Progress: 79/2073 symbols completed. AMCR took 1.3s. Estimated remaining: 14m 2s. Rate: 142.2 symbols/min [2025-10-03T22:34:11.410473] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:11.419016] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-10-03T22:34:11.419241] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-03T22:34:11.430069] [INFO ] [MAIN ] Derivative Progress: 80/2073 symbols completed. AMC took 1.3s. Estimated remaining: 13m 51s. Rate: 143.9 symbols/min [2025-10-03T22:34:11.435517] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:11.435997] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:11.437521] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49208 primary records. [2025-10-03T22:34:11.444419] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-03T22:34:11.475868] [DEBUG] [LOCAL ] AMG: Loaded 20722 existing records from primary storage. [2025-10-03T22:34:11.477436] [INFO ] [MAIN ] AMG: Loaded 20722 primary data records. [2025-10-03T22:34:11.516041] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-10-03T22:34:11.549776] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-03T22:34:11.553876] [INFO ] [MAIN ] Derivative Progress: 81/2073 symbols completed. AME took 1.4s. Estimated remaining: 13m 44s. Rate: 145.1 symbols/min [2025-10-03T22:34:11.572300] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:11.846904] [DEBUG] [LOCAL ] AMH: Loaded 52479 existing records from primary storage. [2025-10-03T22:34:11.847333] [INFO ] [MAIN ] AMH: Loaded 52479 primary data records. [2025-10-03T22:34:12.015908] [DEBUG] [LOCAL ] AMN: Loaded 42418 existing records from primary storage. [2025-10-03T22:34:12.032529] [INFO ] [MAIN ] AMN: Loaded 42418 primary data records. [2025-10-03T22:34:12.474379] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:12.486541] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 20722 primary records. [2025-10-03T22:34:12.491771] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-03T22:34:12.699458] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-10-03T22:34:12.702427] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-03T22:34:12.706298] [INFO ] [MAIN ] Derivative Progress: 82/2073 symbols completed. AMG took 1.3s. Estimated remaining: 14m 1s. Rate: 142.0 symbols/min [2025-10-03T22:34:12.707086] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:12.721023] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:12.721869] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52479 primary records. [2025-10-03T22:34:12.722072] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-03T22:34:12.741187] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-10-03T22:34:12.742341] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-03T22:34:12.746404] [INFO ] [MAIN ] Derivative Progress: 83/2073 symbols completed. AMH took 1.3s. Estimated remaining: 13m 51s. Rate: 143.6 symbols/min [2025-10-03T22:34:12.746881] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:12.761843] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:12.763843] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42418 primary records. [2025-10-03T22:34:12.763996] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-03T22:34:12.791690] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-10-03T22:34:12.791945] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-03T22:34:12.795149] [INFO ] [MAIN ] Derivative Progress: 84/2073 symbols completed. AMN took 1.2s. Estimated remaining: 13m 42s. Rate: 145.1 symbols/min [2025-10-03T22:34:12.795547] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:12.809961] [DEBUG] [LOCAL ] AMP: Loaded 32637 existing records from primary storage. [2025-10-03T22:34:12.810353] [INFO ] [MAIN ] AMP: Loaded 32637 primary data records. [2025-10-03T22:34:13.052009] [DEBUG] [LOCAL ] AMPX: Loaded 53077 existing records from primary storage. [2025-10-03T22:34:13.064035] [INFO ] [MAIN ] AMPX: Loaded 53077 primary data records. [2025-10-03T22:34:13.203272] [DEBUG] [LOCAL ] AMPY: Loaded 38558 existing records from primary storage. [2025-10-03T22:34:13.228427] [INFO ] [MAIN ] AMPY: Loaded 38558 primary data records. [2025-10-03T22:34:13.870045] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:13.872456] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 32637 primary records. [2025-10-03T22:34:13.872831] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-03T22:34:13.892923] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-10-03T22:34:13.893749] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-03T22:34:13.897413] [INFO ] [MAIN ] Derivative Progress: 85/2073 symbols completed. AMP took 1.2s. Estimated remaining: 13m 58s. Rate: 142.3 symbols/min [2025-10-03T22:34:13.897936] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:13.925436] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:13.934682] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 38558 primary records. [2025-10-03T22:34:13.939562] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-03T22:34:13.941106] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:13.942584] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 53077 primary records. [2025-10-03T22:34:13.942732] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-03T22:34:13.984920] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-10-03T22:34:13.986382] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-03T22:34:13.986135] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-10-03T22:34:13.989674] [INFO ] [MAIN ] Derivative Progress: 86/2073 symbols completed. AMPY took 1.2s. Estimated remaining: 13m 50s. Rate: 143.6 symbols/min [2025-10-03T22:34:13.989848] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-03T22:34:13.990066] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:13.993587] [INFO ] [MAIN ] Derivative Progress: 87/2073 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 40s. Rate: 145.3 symbols/min [2025-10-03T22:34:13.994475] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:14.006052] [DEBUG] [LOCAL ] AMR: Loaded 29401 existing records from primary storage. [2025-10-03T22:34:14.006353] [INFO ] [MAIN ] AMR: Loaded 29401 primary data records. [2025-10-03T22:34:14.403944] [DEBUG] [LOCAL ] AMRC: Loaded 38763 existing records from primary storage. [2025-10-03T22:34:14.409448] [INFO ] [MAIN ] AMRC: Loaded 38763 primary data records. [2025-10-03T22:34:14.502866] [DEBUG] [LOCAL ] AMT: Loaded 53193 existing records from primary storage. [2025-10-03T22:34:14.526169] [INFO ] [MAIN ] AMT: Loaded 53193 primary data records. [2025-10-03T22:34:14.926372] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:15.047560] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29401 primary records. [2025-10-03T22:34:15.048265] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-03T22:34:15.074217] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-10-03T22:34:15.074447] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-03T22:34:15.078465] [INFO ] [MAIN ] Derivative Progress: 88/2073 symbols completed. AMR took 1.2s. Estimated remaining: 13m 55s. Rate: 142.7 symbols/min [2025-10-03T22:34:15.095251] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:15.096013] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38763 primary records. [2025-10-03T22:34:15.096170] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-03T22:34:15.115534] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-10-03T22:34:15.128124] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-03T22:34:15.131445] [INFO ] [MAIN ] Derivative Progress: 89/2073 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 46s. Rate: 144.1 symbols/min [2025-10-03T22:34:15.128492] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:15.132457] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53193 primary records. [2025-10-03T22:34:15.132543] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-03T22:34:15.148877] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-10-03T22:34:15.148938] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-03T22:34:15.152144] [INFO ] [MAIN ] Derivative Progress: 90/2073 symbols completed. AMT took 1.2s. Estimated remaining: 13m 37s. Rate: 145.6 symbols/min [2025-10-03T22:34:15.152696] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:15.152762] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:15.152623] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:15.164358] [DEBUG] [LOCAL ] AMTD: Loaded 3698 existing records from primary storage. [2025-10-03T22:34:15.164693] [INFO ] [MAIN ] AMTD: Loaded 3698 primary data records. [2025-10-03T22:34:15.378474] [DEBUG] [LOCAL ] AMTB: Loaded 20620 existing records from primary storage. [2025-10-03T22:34:15.399762] [INFO ] [MAIN ] AMTB: Loaded 20620 primary data records. [2025-10-03T22:34:15.655449] [DEBUG] [LOCAL ] AMTM: Loaded 51421 existing records from primary storage. [2025-10-03T22:34:15.661562] [INFO ] [MAIN ] AMTM: Loaded 51421 primary data records. [2025-10-03T22:34:16.259134] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:16.260406] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3698 primary records. [2025-10-03T22:34:16.260804] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-03T22:34:16.276703] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-10-03T22:34:16.277221] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-03T22:34:16.280023] [INFO ] [MAIN ] Derivative Progress: 91/2073 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 52s. Rate: 142.9 symbols/min [2025-10-03T22:34:16.281063] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:16.299401] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:16.302563] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20620 primary records. [2025-10-03T22:34:16.302896] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-03T22:34:16.319429] [DEBUG] [LOCAL ] AMWL: Loaded 9067 existing records from primary storage. [2025-10-03T22:34:16.319690] [INFO ] [MAIN ] AMWL: Loaded 9067 primary data records. [2025-10-03T22:34:16.453300] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-10-03T22:34:16.468942] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-03T22:34:16.485464] [INFO ] [MAIN ] Derivative Progress: 92/2073 symbols completed. AMTB took 1.3s. Estimated remaining: 13m 47s. Rate: 143.7 symbols/min [2025-10-03T22:34:16.520226] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:16.494570] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:16.659059] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51421 primary records. [2025-10-03T22:34:16.660129] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-03T22:34:16.686301] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-10-03T22:34:16.686609] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-03T22:34:16.690403] [INFO ] [MAIN ] Derivative Progress: 93/2073 symbols completed. AMTM took 1.5s. Estimated remaining: 13m 42s. Rate: 144.5 symbols/min [2025-10-03T22:34:16.690782] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:16.729719] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:16.731000] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 9067 primary records. [2025-10-03T22:34:16.731195] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-03T22:34:16.773975] [DEBUG] [LOCAL ] AMX: Loaded 49863 existing records from primary storage. [2025-10-03T22:34:16.772316] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-10-03T22:34:16.774193] [INFO ] [MAIN ] AMX: Loaded 49863 primary data records. [2025-10-03T22:34:16.774471] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-03T22:34:16.777787] [INFO ] [MAIN ] Derivative Progress: 94/2073 symbols completed. AMWL took 0.5s. Estimated remaining: 13m 35s. Rate: 145.7 symbols/min [2025-10-03T22:34:16.825675] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:16.851180] [DEBUG] [LOCAL ] AN: Loaded 32323 existing records from primary storage. [2025-10-03T22:34:16.851327] [INFO ] [MAIN ] AN: Loaded 32323 primary data records. [2025-10-03T22:34:17.474279] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-03T22:34:17.475623] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-10-03T22:34:17.625150] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:17.637043] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49863 primary records. [2025-10-03T22:34:17.664800] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-03T22:34:17.841243] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-10-03T22:34:17.846525] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-03T22:34:17.857863] [INFO ] [MAIN ] Derivative Progress: 95/2073 symbols completed. AMX took 1.4s. Estimated remaining: 13m 48s. Rate: 143.3 symbols/min [2025-10-03T22:34:17.863847] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:17.865379] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:17.866390] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32323 primary records. [2025-10-03T22:34:17.866511] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-03T22:34:17.888738] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-10-03T22:34:17.888887] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-03T22:34:17.892014] [INFO ] [MAIN ] Derivative Progress: 96/2073 symbols completed. AN took 1.2s. Estimated remaining: 13m 40s. Rate: 144.6 symbols/min [2025-10-03T22:34:17.892436] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:17.913566] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:17.914457] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-10-03T22:34:17.914595] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-03T22:34:17.951758] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-10-03T22:34:17.961037] [DEBUG] [LOCAL ] ANVS: Loaded 23555 existing records from primary storage. [2025-10-03T22:34:17.960584] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-03T22:34:17.977359] [INFO ] [MAIN ] Derivative Progress: 97/2073 symbols completed. ANET took 1.2s. Estimated remaining: 13m 33s. Rate: 145.8 symbols/min [2025-10-03T22:34:17.978975] [INFO ] [MAIN ] ANVS: Loaded 23555 primary data records. [2025-10-03T22:34:17.979222] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:17.986252] [DEBUG] [LOCAL ] ANF: Loaded 52869 existing records from primary storage. [2025-10-03T22:34:18.013387] [INFO ] [MAIN ] ANF: Loaded 52869 primary data records. [2025-10-03T22:34:18.383159] [DEBUG] [LOCAL ] AOD: Loaded 30678 existing records from primary storage. [2025-10-03T22:34:18.607341] [INFO ] [MAIN ] AOD: Loaded 30678 primary data records. [2025-10-03T22:34:19.000635] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:19.002703] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52869 primary records. [2025-10-03T22:34:19.003531] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-03T22:34:19.026759] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:19.034221] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23555 primary records. [2025-10-03T22:34:19.034388] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-03T22:34:19.036394] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-10-03T22:34:19.036934] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-03T22:34:19.039743] [INFO ] [MAIN ] Derivative Progress: 98/2073 symbols completed. ANF took 1.2s. Estimated remaining: 13m 46s. Rate: 143.5 symbols/min [2025-10-03T22:34:19.047255] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:19.059491] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-10-03T22:34:19.060016] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-03T22:34:19.062871] [INFO ] [MAIN ] Derivative Progress: 99/2073 symbols completed. ANVS took 1.2s. Estimated remaining: 13m 37s. Rate: 144.9 symbols/min [2025-10-03T22:34:19.063136] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:19.093250] [DEBUG] [LOCAL ] AOMR: Loaded 16719 existing records from primary storage. [2025-10-03T22:34:19.093699] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:19.093978] [INFO ] [MAIN ] AOMR: Loaded 16719 primary data records. [2025-10-03T22:34:19.095024] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30678 primary records. [2025-10-03T22:34:19.117153] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-03T22:34:19.235560] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-10-03T22:34:19.269095] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-03T22:34:19.313367] [INFO ] [MAIN ] Derivative Progress: 100/2073 symbols completed. AOD took 1.3s. Estimated remaining: 13m 34s. Rate: 145.5 symbols/min [2025-10-03T22:34:19.313665] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:19.466948] [DEBUG] [LOCAL ] AON: Loaded 45997 existing records from primary storage. [2025-10-03T22:34:19.467542] [INFO ] [MAIN ] AON: Loaded 45997 primary data records. [2025-10-03T22:34:19.600877] [DEBUG] [LOCAL ] AORT: Loaded 29872 existing records from primary storage. [2025-10-03T22:34:19.613157] [INFO ] [MAIN ] AORT: Loaded 29872 primary data records. [2025-10-03T22:34:20.022907] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:20.131056] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16719 primary records. [2025-10-03T22:34:20.139676] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-03T22:34:20.159206] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-10-03T22:34:20.160753] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-03T22:34:20.164067] [INFO ] [MAIN ] Derivative Progress: 101/2073 symbols completed. AOMR took 1.1s. Estimated remaining: 13m 42s. Rate: 144.0 symbols/min [2025-10-03T22:34:20.164798] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:20.186534] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:20.187477] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 45997 primary records. [2025-10-03T22:34:20.187609] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-03T22:34:20.206504] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-10-03T22:34:20.206744] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-03T22:34:20.211342] [INFO ] [MAIN ] Derivative Progress: 102/2073 symbols completed. AON took 1.1s. Estimated remaining: 13m 34s. Rate: 145.2 symbols/min [2025-10-03T22:34:20.211797] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:20.227144] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:20.228002] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 29872 primary records. [2025-10-03T22:34:20.241613] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-03T22:34:20.260996] [DEBUG] [LOCAL ] AP: Loaded 7267 existing records from primary storage. [2025-10-03T22:34:20.261746] [INFO ] [MAIN ] AP: Loaded 7267 primary data records. [2025-10-03T22:34:20.285339] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-10-03T22:34:20.292176] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-03T22:34:20.304014] [INFO ] [MAIN ] Derivative Progress: 103/2073 symbols completed. AORT took 1.0s. Estimated remaining: 13m 28s. Rate: 146.3 symbols/min [2025-10-03T22:34:20.417481] [DEBUG] [LOCAL ] AOS: Loaded 49496 existing records from primary storage. [2025-10-03T22:34:20.417799] [INFO ] [MAIN ] AOS: Loaded 49496 primary data records. [2025-10-03T22:34:21.003083] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:21.004148] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 7267 primary records. [2025-10-03T22:34:21.004276] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-03T22:34:21.020380] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-10-03T22:34:21.020494] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-03T22:34:21.023037] [INFO ] [MAIN ] Derivative Progress: 104/2073 symbols completed. AP took 0.8s. Estimated remaining: 13m 33s. Rate: 145.3 symbols/min [2025-10-03T22:34:21.038416] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:21.039060] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49496 primary records. [2025-10-03T22:34:21.039125] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-03T22:34:21.054755] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-10-03T22:34:21.054819] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-03T22:34:21.057843] [INFO ] [MAIN ] Derivative Progress: 105/2073 symbols completed. AOS took 0.9s. Estimated remaining: 13m 26s. Rate: 146.5 symbols/min [2025-10-03T22:34:21.058448] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:21.058553] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:21.058864] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:21.102383] [DEBUG] [LOCAL ] APAM: Loaded 36607 existing records from primary storage. [2025-10-03T22:34:21.102666] [INFO ] [MAIN ] APAM: Loaded 36607 primary data records. [2025-10-03T22:34:21.294666] [DEBUG] [LOCAL ] APG: Loaded 50954 existing records from primary storage. [2025-10-03T22:34:21.337695] [INFO ] [MAIN ] APG: Loaded 50954 primary data records. [2025-10-03T22:34:21.562214] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-03T22:34:21.581205] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-10-03T22:34:22.127430] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:22.128689] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36607 primary records. [2025-10-03T22:34:22.128797] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-03T22:34:22.147306] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-10-03T22:34:22.147565] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-03T22:34:22.151131] [INFO ] [MAIN ] Derivative Progress: 106/2073 symbols completed. APAM took 1.1s. Estimated remaining: 13m 38s. Rate: 144.3 symbols/min [2025-10-03T22:34:22.151496] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:22.168687] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:22.169749] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 50954 primary records. [2025-10-03T22:34:22.169916] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-03T22:34:22.199187] [DEBUG] [LOCAL ] APOS: Loaded 7664 existing records from primary storage. [2025-10-03T22:34:22.206495] [INFO ] [MAIN ] APOS: Loaded 7664 primary data records. [2025-10-03T22:34:22.207916] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-10-03T22:34:22.213477] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:22.245367] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-10-03T22:34:22.229372] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-03T22:34:22.264829] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-03T22:34:22.267225] [INFO ] [MAIN ] Derivative Progress: 107/2073 symbols completed. APG took 1.2s. Estimated remaining: 13m 32s. Rate: 145.2 symbols/min [2025-10-03T22:34:22.276505] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:22.583876] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-10-03T22:34:22.584231] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-03T22:34:22.588104] [INFO ] [MAIN ] Derivative Progress: 108/2073 symbols completed. APH took 1.5s. Estimated remaining: 13m 30s. Rate: 145.6 symbols/min [2025-10-03T22:34:22.589817] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:22.621066] [DEBUG] [LOCAL ] AQNB: Loaded 4198 existing records from primary storage. [2025-10-03T22:34:22.621523] [INFO ] [MAIN ] AQNB: Loaded 4198 primary data records. [2025-10-03T22:34:22.772710] [DEBUG] [LOCAL ] APTV: Loaded 52852 existing records from primary storage. [2025-10-03T22:34:22.773341] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:22.779333] [INFO ] [MAIN ] APTV: Loaded 52852 primary data records. [2025-10-03T22:34:22.774133] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7664 primary records. [2025-10-03T22:34:22.779535] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-03T22:34:23.093969] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-10-03T22:34:23.094344] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-03T22:34:23.097230] [INFO ] [MAIN ] Derivative Progress: 109/2073 symbols completed. APOS took 0.9s. Estimated remaining: 13m 31s. Rate: 145.2 symbols/min [2025-10-03T22:34:23.119353] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:23.346860] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:23.348253] [INFO ] [MAIN ] AQNB: Generated 1820 derivative records from 4198 primary records. [2025-10-03T22:34:23.350686] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-03T22:34:23.390540] [DEBUG] [LOCAL ] AR: Loaded 54363 existing records from primary storage. [2025-10-03T22:34:23.396728] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:23.401910] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52852 primary records. [2025-10-03T22:34:23.401029] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1820 records). [2025-10-03T22:34:23.402062] [INFO ] [MAIN ] AR: Loaded 54363 primary data records. [2025-10-03T22:34:23.402301] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-03T22:34:23.402405] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-03T22:34:23.411516] [INFO ] [MAIN ] Derivative Progress: 110/2073 symbols completed. AQNB took 0.8s. Estimated remaining: 13m 29s. Rate: 145.6 symbols/min [2025-10-03T22:34:23.437313] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:23.565982] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-10-03T22:34:23.579912] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-03T22:34:23.621066] [INFO ] [MAIN ] Derivative Progress: 111/2073 symbols completed. APTV took 1.3s. Estimated remaining: 13m 25s. Rate: 146.2 symbols/min [2025-10-03T22:34:23.732100] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:23.782331] [DEBUG] [LOCAL ] ARCO: Loaded 44983 existing records from primary storage. [2025-10-03T22:34:23.782710] [INFO ] [MAIN ] ARCO: Loaded 44983 primary data records. [2025-10-03T22:34:23.907786] [DEBUG] [LOCAL ] ARDC: Loaded 15051 existing records from primary storage. [2025-10-03T22:34:23.911310] [INFO ] [MAIN ] ARDC: Loaded 15051 primary data records. [2025-10-03T22:34:24.254779] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:24.275818] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54363 primary records. [2025-10-03T22:34:24.316138] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-03T22:34:24.531994] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-10-03T22:34:24.532689] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-03T22:34:24.535928] [INFO ] [MAIN ] Derivative Progress: 112/2073 symbols completed. AR took 1.4s. Estimated remaining: 13m 34s. Rate: 144.6 symbols/min [2025-10-03T22:34:24.537077] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:24.560029] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:24.560962] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 44983 primary records. [2025-10-03T22:34:24.561233] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-03T22:34:24.611915] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-10-03T22:34:24.612556] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-03T22:34:24.617163] [INFO ] [MAIN ] Derivative Progress: 113/2073 symbols completed. ARCO took 1.2s. Estimated remaining: 13m 27s. Rate: 145.7 symbols/min [2025-10-03T22:34:24.612502] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:24.618587] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 15051 primary records. [2025-10-03T22:34:24.619415] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-03T22:34:24.617492] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:24.642039] [DEBUG] [LOCAL ] ARDT: Loaded 28156 existing records from primary storage. [2025-10-03T22:34:24.642794] [INFO ] [MAIN ] ARDT: Loaded 28156 primary data records. [2025-10-03T22:34:24.735782] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-10-03T22:34:24.742174] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-03T22:34:24.757711] [INFO ] [MAIN ] Derivative Progress: 114/2073 symbols completed. ARDC took 1.0s. Estimated remaining: 13m 22s. Rate: 146.5 symbols/min [2025-10-03T22:34:24.758513] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:24.993154] [DEBUG] [LOCAL ] ARE: Loaded 51371 existing records from primary storage. [2025-10-03T22:34:24.993848] [INFO ] [MAIN ] ARE: Loaded 51371 primary data records. [2025-10-03T22:34:25.300442] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-10-03T22:34:25.322760] [INFO ] [MAIN ] ARES: Loaded 50322 primary data records. [2025-10-03T22:34:25.497329] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:25.525738] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28156 primary records. [2025-10-03T22:34:25.527609] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-03T22:34:25.677952] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-10-03T22:34:25.678836] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-03T22:34:25.681991] [INFO ] [MAIN ] Derivative Progress: 115/2073 symbols completed. ARDT took 1.1s. Estimated remaining: 13m 31s. Rate: 144.9 symbols/min [2025-10-03T22:34:25.683895] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:25.700963] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:25.703348] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51371 primary records. [2025-10-03T22:34:25.703719] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-03T22:34:25.722228] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-10-03T22:34:25.726263] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-03T22:34:25.729636] [INFO ] [MAIN ] Derivative Progress: 116/2073 symbols completed. ARE took 1.1s. Estimated remaining: 13m 24s. Rate: 146.0 symbols/min [2025-10-03T22:34:25.730109] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:25.759863] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:25.760699] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50322 primary records. [2025-10-03T22:34:25.760919] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-03T22:34:25.809601] [DEBUG] [LOCAL ] ARI: Loaded 44168 existing records from primary storage. [2025-10-03T22:34:25.826559] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-10-03T22:34:25.826432] [INFO ] [MAIN ] ARI: Loaded 44168 primary data records. [2025-10-03T22:34:25.827153] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-03T22:34:25.830592] [INFO ] [MAIN ] Derivative Progress: 117/2073 symbols completed. ARES took 1.1s. Estimated remaining: 13m 19s. Rate: 147.0 symbols/min [2025-10-03T22:34:25.866142] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:25.968083] [DEBUG] [LOCAL ] ARLO: Loaded 44465 existing records from primary storage. [2025-10-03T22:34:25.979753] [INFO ] [MAIN ] ARLO: Loaded 44465 primary data records. [2025-10-03T22:34:26.417122] [DEBUG] [LOCAL ] ARMK: Loaded 51071 existing records from primary storage. [2025-10-03T22:34:26.441314] [INFO ] [MAIN ] ARMK: Loaded 51071 primary data records. [2025-10-03T22:34:26.839461] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:26.971274] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44168 primary records. [2025-10-03T22:34:26.972102] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-03T22:34:27.004360] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-10-03T22:34:27.004763] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-03T22:34:27.015551] [INFO ] [MAIN ] Derivative Progress: 118/2073 symbols completed. ARI took 1.3s. Estimated remaining: 13m 31s. Rate: 144.6 symbols/min [2025-10-03T22:34:27.022493] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:27.024020] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44465 primary records. [2025-10-03T22:34:27.024127] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-03T22:34:27.044851] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-10-03T22:34:27.045106] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-03T22:34:27.048922] [INFO ] [MAIN ] Derivative Progress: 119/2073 symbols completed. ARLO took 1.3s. Estimated remaining: 13m 24s. Rate: 145.8 symbols/min [2025-10-03T22:34:27.067130] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:27.068006] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51071 primary records. [2025-10-03T22:34:27.068077] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-03T22:34:27.084588] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-10-03T22:34:27.084753] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-03T22:34:27.088288] [INFO ] [MAIN ] Derivative Progress: 120/2073 symbols completed. ARMK took 1.2s. Estimated remaining: 13m 18s. Rate: 146.9 symbols/min [2025-10-03T22:34:27.088843] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:27.089094] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:27.088948] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:27.177575] [DEBUG] [LOCAL ] AROC: Loaded 49675 existing records from primary storage. [2025-10-03T22:34:27.179353] [INFO ] [MAIN ] AROC: Loaded 49675 primary data records. [2025-10-03T22:34:27.178735] [DEBUG] [LOCAL ] ARW: Loaded 33549 existing records from primary storage. [2025-10-03T22:34:27.179884] [INFO ] [MAIN ] ARW: Loaded 33549 primary data records. [2025-10-03T22:34:27.295335] [DEBUG] [LOCAL ] ARR: Loaded 52803 existing records from primary storage. [2025-10-03T22:34:27.407122] [INFO ] [MAIN ] ARR: Loaded 52803 primary data records. [2025-10-03T22:34:28.480922] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:28.498027] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33549 primary records. [2025-10-03T22:34:28.498497] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:28.500494] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49675 primary records. [2025-10-03T22:34:28.500854] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-03T22:34:28.501070] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-03T22:34:28.529635] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:28.551222] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52803 primary records. [2025-10-03T22:34:28.554077] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-10-03T22:34:28.551439] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-03T22:34:28.557131] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-03T22:34:28.559739] [INFO ] [MAIN ] Derivative Progress: 121/2073 symbols completed. ARW took 1.5s. Estimated remaining: 13m 35s. Rate: 143.8 symbols/min [2025-10-03T22:34:28.559977] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:28.557268] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-10-03T22:34:28.560296] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-03T22:34:28.565257] [INFO ] [MAIN ] Derivative Progress: 122/2073 symbols completed. AROC took 1.5s. Estimated remaining: 13m 28s. Rate: 145.0 symbols/min [2025-10-03T22:34:28.573671] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:28.590194] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-10-03T22:34:28.590519] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-03T22:34:28.594687] [INFO ] [MAIN ] Derivative Progress: 123/2073 symbols completed. ARR took 1.5s. Estimated remaining: 13m 21s. Rate: 146.1 symbols/min [2025-10-03T22:34:28.595337] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:28.611947] [DEBUG] [LOCAL ] ASA: Loaded 14433 existing records from primary storage. [2025-10-03T22:34:28.612132] [INFO ] [MAIN ] ASA: Loaded 14433 primary data records. [2025-10-03T22:34:28.990903] [DEBUG] [LOCAL ] AS: Loaded 53862 existing records from primary storage. [2025-10-03T22:34:28.991134] [INFO ] [MAIN ] AS: Loaded 53862 primary data records. [2025-10-03T22:34:29.140877] [DEBUG] [LOCAL ] ASAN: Loaded 53500 existing records from primary storage. [2025-10-03T22:34:29.156804] [INFO ] [MAIN ] ASAN: Loaded 53500 primary data records. [2025-10-03T22:34:29.768233] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:29.769511] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 14433 primary records. [2025-10-03T22:34:29.769865] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-03T22:34:29.792717] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-10-03T22:34:29.793091] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-03T22:34:29.797221] [INFO ] [MAIN ] Derivative Progress: 124/2073 symbols completed. ASA took 1.2s. Estimated remaining: 13m 33s. Rate: 143.8 symbols/min [2025-10-03T22:34:29.799779] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:29.818258] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:34:29.819913] [INFO ] [MAIN ] AS: Generated 1819 derivative records from 53862 primary records. [2025-10-03T22:34:29.820005] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-03T22:34:29.840970] [DEBUG] [LOCAL ] AS: Derivative data saved (1819 records). [2025-10-03T22:34:29.841413] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-03T22:34:29.846347] [INFO ] [MAIN ] Derivative Progress: 125/2073 symbols completed. AS took 1.3s. Estimated remaining: 13m 27s. Rate: 144.8 symbols/min [2025-10-03T22:34:29.847532] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:29.862956] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:29.877178] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53500 primary records. [2025-10-03T22:34:29.877519] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-03T22:34:29.881280] [DEBUG] [LOCAL ] ASBA: Loaded 3492 existing records from primary storage. [2025-10-03T22:34:29.881719] [INFO ] [MAIN ] ASBA: Loaded 3492 primary data records. [2025-10-03T22:34:29.951440] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-10-03T22:34:29.974313] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-03T22:34:29.977571] [INFO ] [MAIN ] Derivative Progress: 126/2073 symbols completed. ASAN took 1.4s. Estimated remaining: 13m 22s. Rate: 145.6 symbols/min [2025-10-03T22:34:29.977852] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:30.039094] [DEBUG] [LOCAL ] ASB: Loaded 50265 existing records from primary storage. [2025-10-03T22:34:30.060454] [INFO ] [MAIN ] ASB: Loaded 50265 primary data records. [2025-10-03T22:34:30.519848] [DEBUG] [LOCAL ] ASC: Loaded 37981 existing records from primary storage. [2025-10-03T22:34:30.645879] [INFO ] [MAIN ] ASC: Loaded 37981 primary data records. [2025-10-03T22:34:31.039822] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:34:31.046990] [INFO ] [MAIN ] ASBA: Generated 1819 derivative records from 3492 primary records. [2025-10-03T22:34:31.048189] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-03T22:34:31.068004] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:31.079167] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50265 primary records. [2025-10-03T22:34:31.079327] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-03T22:34:31.098357] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1819 records). [2025-10-03T22:34:31.104434] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-03T22:34:31.107528] [INFO ] [MAIN ] Derivative Progress: 127/2073 symbols completed. ASBA took 1.3s. Estimated remaining: 13m 33s. Rate: 143.7 symbols/min [2025-10-03T22:34:31.111615] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-10-03T22:34:31.112064] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-03T22:34:31.115483] [INFO ] [MAIN ] Derivative Progress: 128/2073 symbols completed. ASB took 1.3s. Estimated remaining: 13m 26s. Rate: 144.8 symbols/min [2025-10-03T22:34:31.115378] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:31.117611] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:31.135661] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:31.136637] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 37981 primary records. [2025-10-03T22:34:31.136805] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-03T22:34:31.162576] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-10-03T22:34:31.162936] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-03T22:34:31.171174] [INFO ] [MAIN ] Derivative Progress: 129/2073 symbols completed. ASC took 1.2s. Estimated remaining: 13m 20s. Rate: 145.8 symbols/min [2025-10-03T22:34:31.179265] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:31.179780] [DEBUG] [LOCAL ] ASG: Loaded 20131 existing records from primary storage. [2025-10-03T22:34:31.188329] [DEBUG] [LOCAL ] ASGI: Loaded 23076 existing records from primary storage. [2025-10-03T22:34:31.188686] [INFO ] [MAIN ] ASGI: Loaded 23076 primary data records. [2025-10-03T22:34:31.187931] [INFO ] [MAIN ] ASG: Loaded 20131 primary data records. [2025-10-03T22:34:31.998057] [DEBUG] [LOCAL ] ASGN: Loaded 36722 existing records from primary storage. [2025-10-03T22:34:32.000531] [INFO ] [MAIN ] ASGN: Loaded 36722 primary data records. [2025-10-03T22:34:32.355064] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:32.356555] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 20131 primary records. [2025-10-03T22:34:32.372064] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-03T22:34:32.375667] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:32.376796] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 23076 primary records. [2025-10-03T22:34:32.378709] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-03T22:34:32.409352] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-10-03T22:34:32.413257] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-03T22:34:32.414325] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-10-03T22:34:32.417308] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-03T22:34:32.417213] [INFO ] [MAIN ] Derivative Progress: 130/2073 symbols completed. ASG took 1.3s. Estimated remaining: 13m 32s. Rate: 143.5 symbols/min [2025-10-03T22:34:32.420614] [INFO ] [MAIN ] Derivative Progress: 131/2073 symbols completed. ASGI took 1.3s. Estimated remaining: 13m 26s. Rate: 144.6 symbols/min [2025-10-03T22:34:32.420362] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:32.421274] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:32.441054] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:32.442723] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36722 primary records. [2025-10-03T22:34:32.442841] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-03T22:34:32.464538] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-10-03T22:34:32.465041] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-03T22:34:32.468540] [INFO ] [MAIN ] Derivative Progress: 132/2073 symbols completed. ASGN took 1.3s. Estimated remaining: 13m 20s. Rate: 145.6 symbols/min [2025-10-03T22:34:32.469079] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:32.505825] [DEBUG] [LOCAL ] ASR: Loaded 9420 existing records from primary storage. [2025-10-03T22:34:32.506108] [INFO ] [MAIN ] ASR: Loaded 9420 primary data records. [2025-10-03T22:34:32.636071] [DEBUG] [LOCAL ] ASPN: Loaded 50328 existing records from primary storage. [2025-10-03T22:34:32.649253] [INFO ] [MAIN ] ASPN: Loaded 50328 primary data records. [2025-10-03T22:34:32.622098] [DEBUG] [LOCAL ] ASH: Loaded 38329 existing records from primary storage. [2025-10-03T22:34:32.649445] [INFO ] [MAIN ] ASH: Loaded 38329 primary data records. [2025-10-03T22:34:33.618822] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:33.619519] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:33.620758] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9420 primary records. [2025-10-03T22:34:33.621420] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50328 primary records. [2025-10-03T22:34:33.621528] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-03T22:34:33.622357] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-03T22:34:33.657836] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-10-03T22:34:33.673319] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-10-03T22:34:33.673864] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-03T22:34:33.673631] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-03T22:34:33.674299] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:33.676847] [INFO ] [MAIN ] Derivative Progress: 133/2073 symbols completed. ASR took 1.2s. Estimated remaining: 13m 31s. Rate: 143.5 symbols/min [2025-10-03T22:34:33.678064] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38329 primary records. [2025-10-03T22:34:33.681682] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-03T22:34:33.682401] [INFO ] [MAIN ] Derivative Progress: 134/2073 symbols completed. ASPN took 1.3s. Estimated remaining: 13m 25s. Rate: 144.6 symbols/min [2025-10-03T22:34:33.698392] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-10-03T22:34:33.698469] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-03T22:34:33.701817] [INFO ] [MAIN ] Derivative Progress: 135/2073 symbols completed. ASH took 1.3s. Estimated remaining: 13m 19s. Rate: 145.6 symbols/min [2025-10-03T22:34:33.702283] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:33.702342] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:33.702485] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:33.761039] [DEBUG] [LOCAL ] ATGE: Loaded 31813 existing records from primary storage. [2025-10-03T22:34:33.761252] [INFO ] [MAIN ] ATGE: Loaded 31813 primary data records. [2025-10-03T22:34:33.845338] [DEBUG] [LOCAL ] ATEN: Loaded 39883 existing records from primary storage. [2025-10-03T22:34:33.883978] [INFO ] [MAIN ] ATEN: Loaded 39883 primary data records. [2025-10-03T22:34:33.895271] [DEBUG] [LOCAL ] ASX: Loaded 53615 existing records from primary storage. [2025-10-03T22:34:33.932576] [INFO ] [MAIN ] ASX: Loaded 53615 primary data records. [2025-10-03T22:34:34.806881] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:34.808518] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 31813 primary records. [2025-10-03T22:34:34.812515] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-03T22:34:34.837768] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:34.843153] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 39883 primary records. [2025-10-03T22:34:34.845029] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-03T22:34:34.849685] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-10-03T22:34:34.857918] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-03T22:34:34.878387] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:34.871337] [INFO ] [MAIN ] Derivative Progress: 136/2073 symbols completed. ATGE took 1.2s. Estimated remaining: 13m 29s. Rate: 143.7 symbols/min [2025-10-03T22:34:34.881922] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53615 primary records. [2025-10-03T22:34:34.883031] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-10-03T22:34:34.883132] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-03T22:34:34.883807] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:34.884248] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-03T22:34:34.887142] [INFO ] [MAIN ] Derivative Progress: 137/2073 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 23s. Rate: 144.7 symbols/min [2025-10-03T22:34:34.887899] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:34.905620] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-10-03T22:34:34.905907] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-03T22:34:34.910966] [INFO ] [MAIN ] Derivative Progress: 138/2073 symbols completed. ASX took 1.2s. Estimated remaining: 13m 17s. Rate: 145.7 symbols/min [2025-10-03T22:34:34.911380] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:34.918840] [DEBUG] [LOCAL ] ATHS: Loaded 7008 existing records from primary storage. [2025-10-03T22:34:34.919206] [INFO ] [MAIN ] ATHS: Loaded 7008 primary data records. [2025-10-03T22:34:35.115346] [DEBUG] [LOCAL ] ATHM: Loaded 32487 existing records from primary storage. [2025-10-03T22:34:35.147105] [INFO ] [MAIN ] ATHM: Loaded 32487 primary data records. [2025-10-03T22:34:35.358697] [DEBUG] [LOCAL ] ATKR: Loaded 36223 existing records from primary storage. [2025-10-03T22:34:35.379385] [INFO ] [MAIN ] ATKR: Loaded 36223 primary data records. [2025-10-03T22:34:36.038869] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:36.040073] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7008 primary records. [2025-10-03T22:34:36.040186] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-03T22:34:36.064553] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-10-03T22:34:36.064952] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-03T22:34:36.067674] [INFO ] [MAIN ] Derivative Progress: 139/2073 symbols completed. ATHS took 1.2s. Estimated remaining: 13m 27s. Rate: 143.8 symbols/min [2025-10-03T22:34:36.076358] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:36.083356] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:36.084334] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 32487 primary records. [2025-10-03T22:34:36.084559] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-03T22:34:36.117550] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:36.119189] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36223 primary records. [2025-10-03T22:34:36.119948] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-03T22:34:36.130971] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-10-03T22:34:36.135814] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-03T22:34:36.140099] [INFO ] [MAIN ] Derivative Progress: 140/2073 symbols completed. ATHM took 1.3s. Estimated remaining: 13m 22s. Rate: 144.6 symbols/min [2025-10-03T22:34:36.140730] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:36.153954] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-10-03T22:34:36.154063] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-03T22:34:36.157344] [INFO ] [MAIN ] Derivative Progress: 141/2073 symbols completed. ATKR took 1.2s. Estimated remaining: 13m 16s. Rate: 145.6 symbols/min [2025-10-03T22:34:36.157730] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:36.173936] [DEBUG] [LOCAL ] ATMU: Loaded 39950 existing records from primary storage. [2025-10-03T22:34:36.174381] [INFO ] [MAIN ] ATMU: Loaded 39950 primary data records. [2025-10-03T22:34:36.318764] [DEBUG] [LOCAL ] ATS: Loaded 18034 existing records from primary storage. [2025-10-03T22:34:36.334721] [INFO ] [MAIN ] ATS: Loaded 18034 primary data records. [2025-10-03T22:34:36.455209] [DEBUG] [LOCAL ] ATO: Loaded 42462 existing records from primary storage. [2025-10-03T22:34:36.614762] [INFO ] [MAIN ] ATO: Loaded 42462 primary data records. [2025-10-03T22:34:37.227666] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:37.229127] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 39950 primary records. [2025-10-03T22:34:37.229238] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-03T22:34:37.265980] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:37.268064] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18034 primary records. [2025-10-03T22:34:37.268282] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-03T22:34:37.271131] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-10-03T22:34:37.279764] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-03T22:34:37.284308] [INFO ] [MAIN ] Derivative Progress: 142/2073 symbols completed. ATMU took 1.2s. Estimated remaining: 13m 25s. Rate: 143.9 symbols/min [2025-10-03T22:34:37.291095] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:37.292427] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-10-03T22:34:37.295012] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-03T22:34:37.298771] [INFO ] [MAIN ] Derivative Progress: 143/2073 symbols completed. ATS took 1.1s. Estimated remaining: 13m 19s. Rate: 144.9 symbols/min [2025-10-03T22:34:37.299126] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:37.313483] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:37.314577] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42462 primary records. [2025-10-03T22:34:37.314824] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-03T22:34:37.348432] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-10-03T22:34:37.348613] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-03T22:34:37.352250] [INFO ] [MAIN ] Derivative Progress: 144/2073 symbols completed. ATO took 1.2s. Estimated remaining: 13m 14s. Rate: 145.7 symbols/min [2025-10-03T22:34:37.352674] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:37.407015] [DEBUG] [LOCAL ] ATUS: Loaded 49993 existing records from primary storage. [2025-10-03T22:34:37.421030] [INFO ] [MAIN ] ATUS: Loaded 49993 primary data records. [2025-10-03T22:34:37.490118] [DEBUG] [LOCAL ] AU: Loaded 53773 existing records from primary storage. [2025-10-03T22:34:37.523022] [INFO ] [MAIN ] AU: Loaded 53773 primary data records. [2025-10-03T22:34:37.735904] [DEBUG] [LOCAL ] AUB: Loaded 46979 existing records from primary storage. [2025-10-03T22:34:37.787038] [INFO ] [MAIN ] AUB: Loaded 46979 primary data records. [2025-10-03T22:34:38.562371] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:38.563751] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49993 primary records. [2025-10-03T22:34:38.564158] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-03T22:34:38.601932] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:38.604579] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-10-03T22:34:38.605909] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-03T22:34:38.605732] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53773 primary records. [2025-10-03T22:34:38.606166] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-03T22:34:38.609114] [INFO ] [MAIN ] Derivative Progress: 145/2073 symbols completed. ATUS took 1.3s. Estimated remaining: 13m 25s. Rate: 143.7 symbols/min [2025-10-03T22:34:38.631413] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:38.640596] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-10-03T22:34:38.641160] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:38.641944] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-03T22:34:38.642751] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 46979 primary records. [2025-10-03T22:34:38.642855] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-03T22:34:38.647353] [INFO ] [MAIN ] Derivative Progress: 146/2073 symbols completed. AU took 1.3s. Estimated remaining: 13m 20s. Rate: 144.6 symbols/min [2025-10-03T22:34:38.657065] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:38.667475] [DEBUG] [LOCAL ] AUNA: Loaded 5004 existing records from primary storage. [2025-10-03T22:34:38.670746] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-10-03T22:34:38.670874] [INFO ] [MAIN ] AUNA: Loaded 5004 primary data records. [2025-10-03T22:34:38.671128] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-03T22:34:38.674535] [INFO ] [MAIN ] Derivative Progress: 147/2073 symbols completed. AUB took 1.3s. Estimated remaining: 13m 14s. Rate: 145.5 symbols/min [2025-10-03T22:34:38.680319] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:38.820856] [DEBUG] [LOCAL ] AVAL: Loaded 8914 existing records from primary storage. [2025-10-03T22:34:38.852102] [INFO ] [MAIN ] AVAL: Loaded 8914 primary data records. [2025-10-03T22:34:38.937499] [DEBUG] [LOCAL ] AVA: Loaded 39939 existing records from primary storage. [2025-10-03T22:34:39.052186] [INFO ] [MAIN ] AVA: Loaded 39939 primary data records. [2025-10-03T22:34:39.764485] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:39.766505] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 5004 primary records. [2025-10-03T22:34:39.767004] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-03T22:34:39.798334] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:39.800460] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 8914 primary records. [2025-10-03T22:34:39.801538] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-03T22:34:39.803703] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-10-03T22:34:39.813637] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-03T22:34:39.822913] [INFO ] [MAIN ] Derivative Progress: 148/2073 symbols completed. AUNA took 1.2s. Estimated remaining: 13m 23s. Rate: 143.8 symbols/min [2025-10-03T22:34:39.825486] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-10-03T22:34:39.825951] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-03T22:34:39.829825] [INFO ] [MAIN ] Derivative Progress: 149/2073 symbols completed. AVAL took 1.1s. Estimated remaining: 13m 18s. Rate: 144.7 symbols/min [2025-10-03T22:34:39.842755] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:39.843598] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 39939 primary records. [2025-10-03T22:34:39.843691] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-03T22:34:39.859879] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-10-03T22:34:39.859961] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-03T22:34:39.864063] [INFO ] [MAIN ] Derivative Progress: 150/2073 symbols completed. AVA took 1.2s. Estimated remaining: 13m 12s. Rate: 145.6 symbols/min [2025-10-03T22:34:39.864855] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:39.864944] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:39.865077] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:39.895907] [DEBUG] [LOCAL ] AVK: Loaded 18373 existing records from primary storage. [2025-10-03T22:34:39.905389] [INFO ] [MAIN ] AVK: Loaded 18373 primary data records. [2025-10-03T22:34:39.928721] [DEBUG] [LOCAL ] AVD: Loaded 22804 existing records from primary storage. [2025-10-03T22:34:39.964149] [INFO ] [MAIN ] AVD: Loaded 22804 primary data records. [2025-10-03T22:34:40.115960] [DEBUG] [LOCAL ] AVB: Loaded 42525 existing records from primary storage. [2025-10-03T22:34:40.148789] [INFO ] [MAIN ] AVB: Loaded 42525 primary data records. [2025-10-03T22:34:40.996769] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:40.998007] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18373 primary records. [2025-10-03T22:34:40.998301] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-03T22:34:41.035484] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:41.037053] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 22804 primary records. [2025-10-03T22:34:41.037234] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-03T22:34:41.046293] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-10-03T22:34:41.046446] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-03T22:34:41.049313] [INFO ] [MAIN ] Derivative Progress: 151/2073 symbols completed. AVK took 1.2s. Estimated remaining: 13m 22s. Rate: 143.9 symbols/min [2025-10-03T22:34:41.062489] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:41.054897] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:41.063977] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42525 primary records. [2025-10-03T22:34:41.065923] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-03T22:34:41.091043] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-10-03T22:34:41.092761] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-03T22:34:41.092859] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-10-03T22:34:41.096484] [INFO ] [MAIN ] Derivative Progress: 152/2073 symbols completed. AVB took 1.2s. Estimated remaining: 13m 17s. Rate: 144.7 symbols/min [2025-10-03T22:34:41.097022] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:41.096627] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-03T22:34:41.109195] [INFO ] [MAIN ] Derivative Progress: 153/2073 symbols completed. AVD took 1.2s. Estimated remaining: 13m 11s. Rate: 145.6 symbols/min [2025-10-03T22:34:41.109702] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:41.151318] [DEBUG] [LOCAL ] AVNS: Loaded 34232 existing records from primary storage. [2025-10-03T22:34:41.151790] [INFO ] [MAIN ] AVNS: Loaded 34232 primary data records. [2025-10-03T22:34:41.275717] [DEBUG] [LOCAL ] AVNT: Loaded 39711 existing records from primary storage. [2025-10-03T22:34:41.276327] [INFO ] [MAIN ] AVNT: Loaded 39711 primary data records. [2025-10-03T22:34:41.654955] [DEBUG] [LOCAL ] AVTR: Loaded 54342 existing records from primary storage. [2025-10-03T22:34:41.673688] [INFO ] [MAIN ] AVTR: Loaded 54342 primary data records. [2025-10-03T22:34:42.289800] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:42.291075] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34232 primary records. [2025-10-03T22:34:42.291258] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-03T22:34:42.314334] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-10-03T22:34:42.315268] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-03T22:34:42.318822] [INFO ] [MAIN ] Derivative Progress: 154/2073 symbols completed. AVNS took 1.3s. Estimated remaining: 13m 21s. Rate: 143.8 symbols/min [2025-10-03T22:34:42.319202] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:42.336046] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:42.336984] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39711 primary records. [2025-10-03T22:34:42.337117] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-03T22:34:42.356334] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-10-03T22:34:42.357614] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-03T22:34:42.361864] [INFO ] [MAIN ] Derivative Progress: 155/2073 symbols completed. AVNT took 1.3s. Estimated remaining: 13m 16s. Rate: 144.6 symbols/min [2025-10-03T22:34:42.362839] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:42.377122] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:42.377939] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54342 primary records. [2025-10-03T22:34:42.378212] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-03T22:34:42.412253] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-10-03T22:34:42.412452] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-03T22:34:42.425599] [INFO ] [MAIN ] Derivative Progress: 156/2073 symbols completed. AVTR took 1.3s. Estimated remaining: 13m 11s. Rate: 145.4 symbols/min [2025-10-03T22:34:42.427332] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:42.429546] [DEBUG] [LOCAL ] AVY: Loaded 38061 existing records from primary storage. [2025-10-03T22:34:42.438154] [DEBUG] [LOCAL ] AWF: Loaded 24788 existing records from primary storage. [2025-10-03T22:34:42.437698] [INFO ] [MAIN ] AVY: Loaded 38061 primary data records. [2025-10-03T22:34:42.438297] [INFO ] [MAIN ] AWF: Loaded 24788 primary data records. [2025-10-03T22:34:42.758556] [DEBUG] [LOCAL ] AWI: Loaded 25738 existing records from primary storage. [2025-10-03T22:34:42.863171] [INFO ] [MAIN ] AWI: Loaded 25738 primary data records. [2025-10-03T22:34:43.500095] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:43.501412] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24788 primary records. [2025-10-03T22:34:43.522000] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-03T22:34:43.523228] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:43.524964] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38061 primary records. [2025-10-03T22:34:43.525266] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-03T22:34:43.568910] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-10-03T22:34:43.572751] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-03T22:34:43.571581] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-10-03T22:34:43.572901] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-03T22:34:43.577361] [INFO ] [MAIN ] Derivative Progress: 157/2073 symbols completed. AVY took 1.3s. Estimated remaining: 13m 19s. Rate: 143.8 symbols/min [2025-10-03T22:34:43.578509] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:43.581430] [INFO ] [MAIN ] Derivative Progress: 158/2073 symbols completed. AWF took 1.2s. Estimated remaining: 13m 14s. Rate: 144.7 symbols/min [2025-10-03T22:34:43.582362] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:43.596952] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:43.597789] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 25738 primary records. [2025-10-03T22:34:43.597958] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-03T22:34:43.622304] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-10-03T22:34:43.628003] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-03T22:34:43.631316] [INFO ] [MAIN ] Derivative Progress: 159/2073 symbols completed. AWI took 1.2s. Estimated remaining: 13m 9s. Rate: 145.5 symbols/min [2025-10-03T22:34:43.631630] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:43.643672] [DEBUG] [LOCAL ] AWR: Loaded 22954 existing records from primary storage. [2025-10-03T22:34:43.654359] [INFO ] [MAIN ] AWR: Loaded 22954 primary data records. [2025-10-03T22:34:43.655016] [DEBUG] [LOCAL ] AWP: Loaded 21755 existing records from primary storage. [2025-10-03T22:34:43.655389] [INFO ] [MAIN ] AWP: Loaded 21755 primary data records. [2025-10-03T22:34:43.943692] [DEBUG] [LOCAL ] AX: Loaded 28727 existing records from primary storage. [2025-10-03T22:34:43.980105] [INFO ] [MAIN ] AX: Loaded 28727 primary data records. [2025-10-03T22:34:44.801639] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:44.811400] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 22954 primary records. [2025-10-03T22:34:44.816369] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-03T22:34:44.819792] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:44.829995] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21755 primary records. [2025-10-03T22:34:44.830274] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-03T22:34:44.847764] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-10-03T22:34:44.851233] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-03T22:34:44.856022] [INFO ] [MAIN ] Derivative Progress: 160/2073 symbols completed. AWR took 1.3s. Estimated remaining: 13m 19s. Rate: 143.7 symbols/min [2025-10-03T22:34:44.857996] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:44.861323] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-10-03T22:34:44.862115] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-03T22:34:44.866894] [INFO ] [MAIN ] Derivative Progress: 161/2073 symbols completed. AWP took 1.3s. Estimated remaining: 13m 13s. Rate: 144.6 symbols/min [2025-10-03T22:34:44.868615] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:44.882748] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:44.884009] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28727 primary records. [2025-10-03T22:34:44.884089] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-03T22:34:44.901529] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-10-03T22:34:44.901782] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-03T22:34:44.920072] [INFO ] [MAIN ] Derivative Progress: 162/2073 symbols completed. AX took 1.3s. Estimated remaining: 13m 9s. Rate: 145.4 symbols/min [2025-10-03T22:34:44.920573] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:44.927017] [DEBUG] [LOCAL ] AXR: Loaded 3061 existing records from primary storage. [2025-10-03T22:34:44.943865] [INFO ] [MAIN ] AXR: Loaded 3061 primary data records. [2025-10-03T22:34:45.105840] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-10-03T22:34:45.156933] [DEBUG] [LOCAL ] AXP: Loaded 53964 existing records from primary storage. [2025-10-03T22:34:45.184338] [INFO ] [MAIN ] AXL: Loaded 51239 primary data records. [2025-10-03T22:34:45.191149] [INFO ] [MAIN ] AXP: Loaded 53964 primary data records. [2025-10-03T22:34:45.982165] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:34:45.983470] [INFO ] [MAIN ] AXR: Generated 1819 derivative records from 3061 primary records. [2025-10-03T22:34:45.983805] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-03T22:34:46.004859] [DEBUG] [LOCAL ] AXR: Derivative data saved (1819 records). [2025-10-03T22:34:46.005134] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-03T22:34:46.008783] [INFO ] [MAIN ] Derivative Progress: 163/2073 symbols completed. AXR took 1.1s. Estimated remaining: 13m 16s. Rate: 143.9 symbols/min [2025-10-03T22:34:46.036210] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:46.037338] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53964 primary records. [2025-10-03T22:34:46.049471] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-03T22:34:46.050666] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:46.051480] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51239 primary records. [2025-10-03T22:34:46.062767] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-03T22:34:46.090727] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-10-03T22:34:46.091705] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-10-03T22:34:46.091773] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-03T22:34:46.097136] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-03T22:34:46.097226] [INFO ] [MAIN ] Derivative Progress: 164/2073 symbols completed. AXP took 1.2s. Estimated remaining: 13m 12s. Rate: 144.6 symbols/min [2025-10-03T22:34:46.100673] [INFO ] [MAIN ] Derivative Progress: 165/2073 symbols completed. AXL took 1.2s. Estimated remaining: 13m 7s. Rate: 145.5 symbols/min [2025-10-03T22:34:46.101193] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:46.101065] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:46.101130] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:46.126247] [DEBUG] [LOCAL ] AZO: Loaded 11424 existing records from primary storage. [2025-10-03T22:34:46.126928] [INFO ] [MAIN ] AZO: Loaded 11424 primary data records. [2025-10-03T22:34:46.366396] [DEBUG] [LOCAL ] AXS: Loaded 38977 existing records from primary storage. [2025-10-03T22:34:46.366620] [INFO ] [MAIN ] AXS: Loaded 38977 primary data records. [2025-10-03T22:34:46.477462] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-03T22:34:46.534374] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-10-03T22:34:47.204733] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:47.206617] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11424 primary records. [2025-10-03T22:34:47.206783] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-03T22:34:47.225752] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-10-03T22:34:47.227473] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-03T22:34:47.230203] [INFO ] [MAIN ] Derivative Progress: 166/2073 symbols completed. AZO took 1.1s. Estimated remaining: 13m 15s. Rate: 144.0 symbols/min [2025-10-03T22:34:47.230902] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:47.249449] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:47.250451] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38977 primary records. [2025-10-03T22:34:47.250697] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-03T22:34:47.280674] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:47.282172] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-10-03T22:34:47.282747] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-03T22:34:47.311016] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-10-03T22:34:47.311220] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-03T22:34:47.318248] [INFO ] [MAIN ] Derivative Progress: 167/2073 symbols completed. AXS took 1.2s. Estimated remaining: 13m 10s. Rate: 144.7 symbols/min [2025-10-03T22:34:47.319152] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:47.338901] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-10-03T22:34:47.339059] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-03T22:34:47.342729] [INFO ] [MAIN ] Derivative Progress: 168/2073 symbols completed. BABA took 1.2s. Estimated remaining: 13m 6s. Rate: 145.5 symbols/min [2025-10-03T22:34:47.345902] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:47.368057] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-03T22:34:47.368403] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-10-03T22:34:47.625447] [DEBUG] [LOCAL ] BAH: Loaded 52444 existing records from primary storage. [2025-10-03T22:34:47.739292] [DEBUG] [LOCAL ] BAK: Loaded 39773 existing records from primary storage. [2025-10-03T22:34:47.738540] [INFO ] [MAIN ] BAH: Loaded 52444 primary data records. [2025-10-03T22:34:47.754803] [INFO ] [MAIN ] BAK: Loaded 39773 primary data records. [2025-10-03T22:34:48.445611] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:48.447032] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-10-03T22:34:48.447598] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-03T22:34:48.470064] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-10-03T22:34:48.471830] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-03T22:34:48.476773] [INFO ] [MAIN ] Derivative Progress: 169/2073 symbols completed. BAC took 1.2s. Estimated remaining: 13m 13s. Rate: 144.0 symbols/min [2025-10-03T22:34:48.477170] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:48.515630] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:48.517990] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39773 primary records. [2025-10-03T22:34:48.518286] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-03T22:34:48.519259] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:48.521206] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52444 primary records. [2025-10-03T22:34:48.521424] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-03T22:34:48.560103] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-10-03T22:34:48.560824] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-10-03T22:34:48.561245] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-03T22:34:48.565271] [INFO ] [MAIN ] Derivative Progress: 170/2073 symbols completed. BAH took 1.2s. Estimated remaining: 13m 9s. Rate: 144.7 symbols/min [2025-10-03T22:34:48.565808] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:48.565522] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-03T22:34:48.569207] [INFO ] [MAIN ] Derivative Progress: 171/2073 symbols completed. BAK took 1.2s. Estimated remaining: 13m 4s. Rate: 145.5 symbols/min [2025-10-03T22:34:48.569635] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:48.626266] [DEBUG] [LOCAL ] BALL: Loaded 52561 existing records from primary storage. [2025-10-03T22:34:48.626593] [INFO ] [MAIN ] BALL: Loaded 52561 primary data records. [2025-10-03T22:34:48.858257] [DEBUG] [LOCAL ] BANC: Loaded 52011 existing records from primary storage. [2025-10-03T22:34:48.879189] [INFO ] [MAIN ] BANC: Loaded 52011 primary data records. [2025-10-03T22:34:48.878898] [DEBUG] [LOCAL ] BAM: Loaded 52767 existing records from primary storage. [2025-10-03T22:34:48.908744] [INFO ] [MAIN ] BAM: Loaded 52767 primary data records. [2025-10-03T22:34:49.815201] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:49.817818] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52561 primary records. [2025-10-03T22:34:49.818372] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-03T22:34:49.838682] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-10-03T22:34:49.839579] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-03T22:34:49.843187] [INFO ] [MAIN ] Derivative Progress: 172/2073 symbols completed. BALL took 1.4s. Estimated remaining: 13m 13s. Rate: 143.8 symbols/min [2025-10-03T22:34:49.843746] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:49.867202] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:49.880832] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52011 primary records. [2025-10-03T22:34:49.881157] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:49.881365] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-03T22:34:49.881958] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52767 primary records. [2025-10-03T22:34:49.882860] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-03T22:34:49.934811] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-10-03T22:34:49.935298] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-03T22:34:49.939162] [INFO ] [MAIN ] Derivative Progress: 173/2073 symbols completed. BANC took 1.4s. Estimated remaining: 13m 9s. Rate: 144.4 symbols/min [2025-10-03T22:34:49.940839] [DEBUG] [LOCAL ] BAP: Loaded 26537 existing records from primary storage. [2025-10-03T22:34:49.941477] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:49.942228] [INFO ] [MAIN ] BAP: Loaded 26537 primary data records. [2025-10-03T22:34:49.942904] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-10-03T22:34:49.943132] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-03T22:34:49.948430] [INFO ] [MAIN ] Derivative Progress: 174/2073 symbols completed. BAM took 1.4s. Estimated remaining: 13m 4s. Rate: 145.2 symbols/min [2025-10-03T22:34:49.949189] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:50.322188] [DEBUG] [LOCAL ] BARK: Loaded 38579 existing records from primary storage. [2025-10-03T22:34:50.339107] [INFO ] [MAIN ] BARK: Loaded 38579 primary data records. [2025-10-03T22:34:50.486135] [DEBUG] [LOCAL ] BAX: Loaded 54272 existing records from primary storage. [2025-10-03T22:34:50.486798] [INFO ] [MAIN ] BAX: Loaded 54272 primary data records. [2025-10-03T22:34:51.100341] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:51.166879] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26537 primary records. [2025-10-03T22:34:51.167239] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-03T22:34:51.197493] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-10-03T22:34:51.197912] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-03T22:34:51.215208] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:51.208808] [INFO ] [MAIN ] Derivative Progress: 175/2073 symbols completed. BAP took 1.4s. Estimated remaining: 13m 13s. Rate: 143.6 symbols/min [2025-10-03T22:34:51.215507] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:51.216446] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38579 primary records. [2025-10-03T22:34:51.216786] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-03T22:34:51.236085] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-10-03T22:34:51.236448] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-03T22:34:51.240074] [INFO ] [MAIN ] Derivative Progress: 176/2073 symbols completed. BARK took 1.3s. Estimated remaining: 13m 9s. Rate: 144.3 symbols/min [2025-10-03T22:34:51.240423] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:51.258632] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:51.261579] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54272 primary records. [2025-10-03T22:34:51.261854] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-03T22:34:51.279250] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-10-03T22:34:51.279470] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-03T22:34:51.284178] [INFO ] [MAIN ] Derivative Progress: 177/2073 symbols completed. BAX took 1.3s. Estimated remaining: 13m 4s. Rate: 145.0 symbols/min [2025-10-03T22:34:51.284810] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:51.345022] [DEBUG] [LOCAL ] BB: Loaded 53710 existing records from primary storage. [2025-10-03T22:34:51.345457] [INFO ] [MAIN ] BB: Loaded 53710 primary data records. [2025-10-03T22:34:51.427440] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-03T22:34:51.451293] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-10-03T22:34:51.650337] [DEBUG] [LOCAL ] BBAR: Loaded 42223 existing records from primary storage. [2025-10-03T22:34:51.661991] [INFO ] [MAIN ] BBAR: Loaded 42223 primary data records. [2025-10-03T22:34:52.422757] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:52.438209] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53710 primary records. [2025-10-03T22:34:52.437124] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:52.438530] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-03T22:34:52.441076] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-10-03T22:34:52.442792] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-03T22:34:52.472557] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-10-03T22:34:52.474285] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-03T22:34:52.478175] [INFO ] [MAIN ] Derivative Progress: 178/2073 symbols completed. BBAI took 1.2s. Estimated remaining: 13m 12s. Rate: 143.5 symbols/min [2025-10-03T22:34:52.485365] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-10-03T22:34:52.485492] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-03T22:34:52.488459] [INFO ] [MAIN ] Derivative Progress: 179/2073 symbols completed. BB took 1.3s. Estimated remaining: 13m 7s. Rate: 144.3 symbols/min [2025-10-03T22:34:52.501518] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:52.502341] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 42223 primary records. [2025-10-03T22:34:52.502410] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-03T22:34:52.518629] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-10-03T22:34:52.518774] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-03T22:34:52.522514] [INFO ] [MAIN ] Derivative Progress: 180/2073 symbols completed. BBAR took 1.2s. Estimated remaining: 13m 3s. Rate: 145.1 symbols/min [2025-10-03T22:34:52.523233] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:52.523139] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:52.523028] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:52.533794] [DEBUG] [LOCAL ] BBDO: Loaded 5032 existing records from primary storage. [2025-10-03T22:34:52.534093] [INFO ] [MAIN ] BBDO: Loaded 5032 primary data records. [2025-10-03T22:34:52.886182] [DEBUG] [LOCAL ] BBDC: Loaded 33442 existing records from primary storage. [2025-10-03T22:34:52.887626] [INFO ] [MAIN ] BBDC: Loaded 33442 primary data records. [2025-10-03T22:34:53.018693] [DEBUG] [LOCAL ] BBD: Loaded 53976 existing records from primary storage. [2025-10-03T22:34:53.019595] [INFO ] [MAIN ] BBD: Loaded 53976 primary data records. [2025-10-03T22:34:53.668370] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:53.670082] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5032 primary records. [2025-10-03T22:34:53.671015] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-03T22:34:53.689746] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-10-03T22:34:53.690090] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-03T22:34:53.693377] [INFO ] [MAIN ] Derivative Progress: 181/2073 symbols completed. BBDO took 1.2s. Estimated remaining: 13m 11s. Rate: 143.6 symbols/min [2025-10-03T22:34:53.694800] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:53.724517] [DEBUG] [LOCAL ] BBU: Loaded 4913 existing records from primary storage. [2025-10-03T22:34:53.727053] [INFO ] [MAIN ] BBU: Loaded 4913 primary data records. [2025-10-03T22:34:53.739868] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:53.789464] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33442 primary records. [2025-10-03T22:34:53.819207] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-03T22:34:53.899818] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:53.906402] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53976 primary records. [2025-10-03T22:34:53.907384] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-03T22:34:53.986299] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-10-03T22:34:54.102270] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-03T22:34:54.127117] [INFO ] [MAIN ] Derivative Progress: 182/2073 symbols completed. BBDC took 1.6s. Estimated remaining: 13m 10s. Rate: 143.6 symbols/min [2025-10-03T22:34:54.128419] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:54.142184] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-10-03T22:34:54.142535] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-03T22:34:54.146151] [INFO ] [MAIN ] Derivative Progress: 183/2073 symbols completed. BBD took 1.6s. Estimated remaining: 13m 6s. Rate: 144.3 symbols/min [2025-10-03T22:34:54.147708] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:54.154784] [DEBUG] [LOCAL ] BBUC: Loaded 13645 existing records from primary storage. [2025-10-03T22:34:54.155405] [INFO ] [MAIN ] BBUC: Loaded 13645 primary data records. [2025-10-03T22:34:54.531543] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:54.533529] [INFO ] [MAIN ] BBU: Generated 1820 derivative records from 4913 primary records. [2025-10-03T22:34:54.534056] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-03T22:34:54.553858] [DEBUG] [LOCAL ] BBU: Derivative data saved (1820 records). [2025-10-03T22:34:54.555066] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-03T22:34:54.558582] [INFO ] [MAIN ] Derivative Progress: 184/2073 symbols completed. BBU took 0.9s. Estimated remaining: 13m 5s. Rate: 144.3 symbols/min [2025-10-03T22:34:54.559597] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:54.580539] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-10-03T22:34:54.580986] [INFO ] [MAIN ] BBWI: Loaded 54360 primary data records. [2025-10-03T22:34:54.962150] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:54.964052] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13645 primary records. [2025-10-03T22:34:54.964682] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-03T22:34:54.984960] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-10-03T22:34:54.999673] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-03T22:34:55.004548] [INFO ] [MAIN ] Derivative Progress: 185/2073 symbols completed. BBUC took 0.9s. Estimated remaining: 13m 5s. Rate: 144.3 symbols/min [2025-10-03T22:34:55.005221] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:55.006424] [DEBUG] [LOCAL ] BBY: Loaded 54237 existing records from primary storage. [2025-10-03T22:34:55.007836] [INFO ] [MAIN ] BBY: Loaded 54237 primary data records. [2025-10-03T22:34:55.135733] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:55.143505] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54360 primary records. [2025-10-03T22:34:55.159495] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-03T22:34:55.371001] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-10-03T22:34:55.386268] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-03T22:34:55.390133] [INFO ] [MAIN ] Derivative Progress: 186/2073 symbols completed. BBWI took 1.2s. Estimated remaining: 13m 4s. Rate: 144.3 symbols/min [2025-10-03T22:34:55.393269] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:55.392110] [DEBUG] [LOCAL ] BC: Loaded 44767 existing records from primary storage. [2025-10-03T22:34:55.393528] [INFO ] [MAIN ] BC: Loaded 44767 primary data records. [2025-10-03T22:34:55.791886] [DEBUG] [LOCAL ] BCAT: Loaded 34696 existing records from primary storage. [2025-10-03T22:34:55.797835] [INFO ] [MAIN ] BCAT: Loaded 34696 primary data records. [2025-10-03T22:34:55.940303] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:55.955522] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54237 primary records. [2025-10-03T22:34:55.956213] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-03T22:34:56.199236] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-10-03T22:34:56.200723] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-03T22:34:56.203798] [INFO ] [MAIN ] Derivative Progress: 187/2073 symbols completed. BBY took 1.6s. Estimated remaining: 13m 8s. Rate: 143.6 symbols/min [2025-10-03T22:34:56.204343] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:56.230453] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:56.231723] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 44767 primary records. [2025-10-03T22:34:56.231979] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-03T22:34:56.252052] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-10-03T22:34:56.261670] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-03T22:34:56.264992] [INFO ] [MAIN ] Derivative Progress: 188/2073 symbols completed. BC took 1.3s. Estimated remaining: 13m 4s. Rate: 144.2 symbols/min [2025-10-03T22:34:56.265470] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:56.280712] [DEBUG] [LOCAL ] BCC: Loaded 28698 existing records from primary storage. [2025-10-03T22:34:56.293999] [INFO ] [MAIN ] BCC: Loaded 28698 primary data records. [2025-10-03T22:34:56.300150] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:56.333915] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34696 primary records. [2025-10-03T22:34:56.367267] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-03T22:34:56.421832] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-10-03T22:34:56.432508] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-03T22:34:56.441731] [INFO ] [MAIN ] Derivative Progress: 189/2073 symbols completed. BCAT took 1.0s. Estimated remaining: 13m 1s. Rate: 144.7 symbols/min [2025-10-03T22:34:56.466753] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:56.663071] [DEBUG] [LOCAL ] BCE: Loaded 52991 existing records from primary storage. [2025-10-03T22:34:56.664422] [INFO ] [MAIN ] BCE: Loaded 52991 primary data records. [2025-10-03T22:34:56.807204] [DEBUG] [LOCAL ] BCH: Loaded 30138 existing records from primary storage. [2025-10-03T22:34:56.821013] [INFO ] [MAIN ] BCH: Loaded 30138 primary data records. [2025-10-03T22:34:57.272917] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:57.402141] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28698 primary records. [2025-10-03T22:34:57.403503] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-03T22:34:57.429523] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-10-03T22:34:57.430511] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-03T22:34:57.434335] [INFO ] [MAIN ] Derivative Progress: 190/2073 symbols completed. BCC took 1.2s. Estimated remaining: 13m 7s. Rate: 143.6 symbols/min [2025-10-03T22:34:57.449557] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:57.451008] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:57.452313] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 52991 primary records. [2025-10-03T22:34:57.452511] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-03T22:34:57.471303] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-10-03T22:34:57.471541] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-03T22:34:57.474594] [INFO ] [MAIN ] Derivative Progress: 191/2073 symbols completed. BCE took 1.2s. Estimated remaining: 13m 2s. Rate: 144.3 symbols/min [2025-10-03T22:34:57.475296] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:57.501470] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:57.502400] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30138 primary records. [2025-10-03T22:34:57.502568] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-03T22:34:57.534686] [DEBUG] [LOCAL ] BCO: Loaded 26271 existing records from primary storage. [2025-10-03T22:34:57.534454] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-10-03T22:34:57.535295] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-03T22:34:57.539749] [INFO ] [MAIN ] Derivative Progress: 192/2073 symbols completed. BCH took 1.1s. Estimated remaining: 12m 59s. Rate: 145.0 symbols/min [2025-10-03T22:34:57.540222] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:57.540041] [INFO ] [MAIN ] BCO: Loaded 26271 primary data records. [2025-10-03T22:34:57.890009] [DEBUG] [LOCAL ] BCS: Loaded 54229 existing records from primary storage. [2025-10-03T22:34:57.957222] [DEBUG] [LOCAL ] BCSF: Loaded 28192 existing records from primary storage. [2025-10-03T22:34:57.967955] [INFO ] [MAIN ] BCSF: Loaded 28192 primary data records. [2025-10-03T22:34:57.967742] [INFO ] [MAIN ] BCS: Loaded 54229 primary data records. [2025-10-03T22:34:58.674229] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:58.676185] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26271 primary records. [2025-10-03T22:34:58.676325] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-03T22:34:58.697026] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-10-03T22:34:58.697288] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-03T22:34:58.700455] [INFO ] [MAIN ] Derivative Progress: 193/2073 symbols completed. BCO took 1.3s. Estimated remaining: 13m 5s. Rate: 143.6 symbols/min [2025-10-03T22:34:58.722269] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:58.724378] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28192 primary records. [2025-10-03T22:34:58.725491] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-03T22:34:58.753248] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:58.754891] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54229 primary records. [2025-10-03T22:34:58.754982] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-03T22:34:58.774032] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-10-03T22:34:58.774879] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-03T22:34:58.778389] [INFO ] [MAIN ] Derivative Progress: 194/2073 symbols completed. BCS took 1.3s. Estimated remaining: 13m 2s. Rate: 144.2 symbols/min [2025-10-03T22:34:58.779354] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-10-03T22:34:58.779520] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-03T22:34:58.782856] [INFO ] [MAIN ] Derivative Progress: 195/2073 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 57s. Rate: 145.0 symbols/min [2025-10-03T22:34:58.783522] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:58.783345] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:58.783411] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:34:58.823969] [DEBUG] [LOCAL ] BCX: Loaded 22000 existing records from primary storage. [2025-10-03T22:34:58.824260] [INFO ] [MAIN ] BCX: Loaded 22000 primary data records. [2025-10-03T22:34:58.939521] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-03T22:34:58.957821] [DEBUG] [LOCAL ] BDC: Loaded 24963 existing records from primary storage. [2025-10-03T22:34:58.963394] [INFO ] [MAIN ] BDC: Loaded 24963 primary data records. [2025-10-03T22:34:58.968837] [INFO ] [MAIN ] BDJ: Loaded 29333 primary data records. [2025-10-03T22:34:59.989138] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:34:59.990920] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 22000 primary records. [2025-10-03T22:34:59.991173] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-03T22:35:00.009607] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-10-03T22:35:00.010020] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-03T22:35:00.017328] [INFO ] [MAIN ] Derivative Progress: 196/2073 symbols completed. BCX took 1.2s. Estimated remaining: 13m 5s. Rate: 143.5 symbols/min [2025-10-03T22:35:00.018121] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:00.034027] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:00.035075] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 24963 primary records. [2025-10-03T22:35:00.035211] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-03T22:35:00.058475] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-10-03T22:35:00.066494] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-03T22:35:00.075259] [INFO ] [MAIN ] Derivative Progress: 197/2073 symbols completed. BDC took 1.3s. Estimated remaining: 13m 1s. Rate: 144.1 symbols/min [2025-10-03T22:35:00.075882] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:00.076149] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:00.077243] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29333 primary records. [2025-10-03T22:35:00.089415] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-03T22:35:00.107710] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-10-03T22:35:00.107965] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-03T22:35:00.110752] [INFO ] [MAIN ] Derivative Progress: 198/2073 symbols completed. BDJ took 1.3s. Estimated remaining: 12m 57s. Rate: 144.8 symbols/min [2025-10-03T22:35:00.111871] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:00.130088] [DEBUG] [LOCAL ] BDN: Loaded 48182 existing records from primary storage. [2025-10-03T22:35:00.130435] [INFO ] [MAIN ] BDN: Loaded 48182 primary data records. [2025-10-03T22:35:00.468691] [DEBUG] [LOCAL ] BDX: Loaded 53085 existing records from primary storage. [2025-10-03T22:35:00.518402] [INFO ] [MAIN ] BDX: Loaded 53085 primary data records. [2025-10-03T22:35:00.666943] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-10-03T22:35:00.667758] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-10-03T22:35:01.099483] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:01.133230] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48182 primary records. [2025-10-03T22:35:01.173067] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-03T22:35:01.328176] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-10-03T22:35:01.328635] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-03T22:35:01.331555] [INFO ] [MAIN ] Derivative Progress: 199/2073 symbols completed. BDN took 1.3s. Estimated remaining: 13m 4s. Rate: 143.4 symbols/min [2025-10-03T22:35:01.332260] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:01.358371] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:01.359848] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53085 primary records. [2025-10-03T22:35:01.360356] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-03T22:35:01.413365] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:01.414727] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-10-03T22:35:01.414825] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-03T22:35:01.413702] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-10-03T22:35:01.415312] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-03T22:35:01.419802] [INFO ] [MAIN ] Derivative Progress: 200/2073 symbols completed. BDX took 1.3s. Estimated remaining: 13m 1s. Rate: 144.0 symbols/min [2025-10-03T22:35:01.420752] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:01.438455] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-10-03T22:35:01.438673] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-03T22:35:01.444019] [INFO ] [MAIN ] Derivative Progress: 201/2073 symbols completed. BE took 1.3s. Estimated remaining: 12m 57s. Rate: 144.6 symbols/min [2025-10-03T22:35:01.444415] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:01.472848] [DEBUG] [LOCAL ] BEKE: Loaded 54017 existing records from primary storage. [2025-10-03T22:35:01.473323] [INFO ] [MAIN ] BEKE: Loaded 54017 primary data records. [2025-10-03T22:35:01.879033] [DEBUG] [LOCAL ] BEP: Loaded 39305 existing records from primary storage. [2025-10-03T22:35:01.913803] [INFO ] [MAIN ] BEP: Loaded 39305 primary data records. [2025-10-03T22:35:01.915350] [DEBUG] [LOCAL ] BEN: Loaded 53814 existing records from primary storage. [2025-10-03T22:35:01.921122] [INFO ] [MAIN ] BEN: Loaded 53814 primary data records. [2025-10-03T22:35:02.736264] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:02.738076] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54017 primary records. [2025-10-03T22:35:02.738462] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-03T22:35:02.760205] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-10-03T22:35:02.760478] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-03T22:35:02.763854] [INFO ] [MAIN ] Derivative Progress: 202/2073 symbols completed. BEKE took 1.4s. Estimated remaining: 13m 4s. Rate: 143.1 symbols/min [2025-10-03T22:35:02.764370] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:02.795181] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:02.796613] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39305 primary records. [2025-10-03T22:35:02.797137] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-03T22:35:02.825087] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-10-03T22:35:02.837798] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-03T22:35:02.841935] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:02.841508] [INFO ] [MAIN ] Derivative Progress: 203/2073 symbols completed. BEP took 1.4s. Estimated remaining: 13m 1s. Rate: 143.7 symbols/min [2025-10-03T22:35:02.856110] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53814 primary records. [2025-10-03T22:35:02.856268] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-03T22:35:02.856442] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:02.879759] [DEBUG] [LOCAL ] BEPH: Loaded 5430 existing records from primary storage. [2025-10-03T22:35:02.881591] [INFO ] [MAIN ] BEPH: Loaded 5430 primary data records. [2025-10-03T22:35:02.961687] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-10-03T22:35:02.975995] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-03T22:35:02.996738] [INFO ] [MAIN ] Derivative Progress: 204/2073 symbols completed. BEN took 1.6s. Estimated remaining: 12m 58s. Rate: 144.1 symbols/min [2025-10-03T22:35:03.002873] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:03.018582] [DEBUG] [LOCAL ] BEPC: Loaded 47157 existing records from primary storage. [2025-10-03T22:35:03.020325] [INFO ] [MAIN ] BEPC: Loaded 47157 primary data records. [2025-10-03T22:35:03.190245] [DEBUG] [LOCAL ] BEPI: Loaded 3576 existing records from primary storage. [2025-10-03T22:35:03.340346] [INFO ] [MAIN ] BEPI: Loaded 3576 primary data records. [2025-10-03T22:35:03.954453] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:03.955687] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5430 primary records. [2025-10-03T22:35:03.955881] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-03T22:35:03.978764] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-10-03T22:35:03.979288] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-03T22:35:03.982090] [INFO ] [MAIN ] Derivative Progress: 205/2073 symbols completed. BEPH took 1.1s. Estimated remaining: 13m 3s. Rate: 143.2 symbols/min [2025-10-03T22:35:03.995754] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:03.996784] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:03.998681] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47157 primary records. [2025-10-03T22:35:03.998788] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-03T22:35:04.037366] [DEBUG] [LOCAL ] BEPJ: Loaded 3166 existing records from primary storage. [2025-10-03T22:35:04.038696] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:04.039764] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3576 primary records. [2025-10-03T22:35:04.037935] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-10-03T22:35:04.040091] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-03T22:35:04.039874] [INFO ] [MAIN ] BEPJ: Loaded 3166 primary data records. [2025-10-03T22:35:04.053814] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-03T22:35:04.062493] [INFO ] [MAIN ] Derivative Progress: 206/2073 symbols completed. BEPC took 1.3s. Estimated remaining: 12m 59s. Rate: 143.7 symbols/min [2025-10-03T22:35:04.107166] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:04.154051] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-10-03T22:35:04.159555] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-03T22:35:04.186147] [INFO ] [MAIN ] Derivative Progress: 207/2073 symbols completed. BEPI took 1.2s. Estimated remaining: 12m 56s. Rate: 144.2 symbols/min [2025-10-03T22:35:04.186550] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:04.432670] [DEBUG] [LOCAL ] BFAM: Loaded 33682 existing records from primary storage. [2025-10-03T22:35:04.445014] [INFO ] [MAIN ] BFAM: Loaded 33682 primary data records. [2025-10-03T22:35:04.568289] [DEBUG] [LOCAL ] BFH: Loaded 42221 existing records from primary storage. [2025-10-03T22:35:04.572862] [INFO ] [MAIN ] BFH: Loaded 42221 primary data records. [2025-10-03T22:35:04.966135] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:04.974332] [INFO ] [MAIN ] BEPJ: Generated 1819 derivative records from 3166 primary records. [2025-10-03T22:35:04.981253] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-03T22:35:05.089103] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1819 records). [2025-10-03T22:35:05.115553] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-03T22:35:05.234559] [INFO ] [MAIN ] Derivative Progress: 208/2073 symbols completed. BEPJ took 1.2s. Estimated remaining: 13m 2s. Rate: 143.2 symbols/min [2025-10-03T22:35:05.279577] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:05.281337] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33682 primary records. [2025-10-03T22:35:05.282001] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-03T22:35:05.310600] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-10-03T22:35:05.312325] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-03T22:35:05.315430] [INFO ] [MAIN ] Derivative Progress: 209/2073 symbols completed. BFAM took 1.2s. Estimated remaining: 12m 58s. Rate: 143.7 symbols/min [2025-10-03T22:35:05.328404] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:05.329135] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42221 primary records. [2025-10-03T22:35:05.329199] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-03T22:35:05.344946] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-10-03T22:35:05.345021] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-03T22:35:05.348586] [INFO ] [MAIN ] Derivative Progress: 210/2073 symbols completed. BFH took 1.2s. Estimated remaining: 12m 54s. Rate: 144.4 symbols/min [2025-10-03T22:35:05.349531] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:05.349424] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:05.349888] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:05.371206] [DEBUG] [LOCAL ] BFZ: Loaded 12261 existing records from primary storage. [2025-10-03T22:35:05.371345] [INFO ] [MAIN ] BFZ: Loaded 12261 primary data records. [2025-10-03T22:35:05.420264] [DEBUG] [LOCAL ] BFS: Loaded 9281 existing records from primary storage. [2025-10-03T22:35:05.451998] [INFO ] [MAIN ] BFS: Loaded 9281 primary data records. [2025-10-03T22:35:05.862981] [DEBUG] [LOCAL ] BFLY: Loaded 52549 existing records from primary storage. [2025-10-03T22:35:05.880002] [INFO ] [MAIN ] BFLY: Loaded 52549 primary data records. [2025-10-03T22:35:06.429313] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:06.432991] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12261 primary records. [2025-10-03T22:35:06.434136] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-03T22:35:06.461144] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:06.462816] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9281 primary records. [2025-10-03T22:35:06.463922] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-03T22:35:06.476674] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-10-03T22:35:06.479894] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-03T22:35:06.484816] [INFO ] [MAIN ] Derivative Progress: 211/2073 symbols completed. BFZ took 1.1s. Estimated remaining: 13m 0s. Rate: 143.2 symbols/min [2025-10-03T22:35:06.487559] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-10-03T22:35:06.488031] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:06.489583] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-03T22:35:06.495485] [INFO ] [MAIN ] Derivative Progress: 212/2073 symbols completed. BFS took 1.1s. Estimated remaining: 12m 56s. Rate: 143.8 symbols/min [2025-10-03T22:35:06.495941] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:06.511126] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:06.512144] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52549 primary records. [2025-10-03T22:35:06.512213] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-03T22:35:06.538804] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-10-03T22:35:06.545334] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-03T22:35:06.545726] [DEBUG] [LOCAL ] BGB: Loaded 17901 existing records from primary storage. [2025-10-03T22:35:06.549504] [INFO ] [MAIN ] Derivative Progress: 213/2073 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 53s. Rate: 144.4 symbols/min [2025-10-03T22:35:06.549904] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:06.549989] [INFO ] [MAIN ] BGB: Loaded 17901 primary data records. [2025-10-03T22:35:06.719617] [DEBUG] [LOCAL ] BGH: Loaded 17279 existing records from primary storage. [2025-10-03T22:35:06.782804] [INFO ] [MAIN ] BGH: Loaded 17279 primary data records. [2025-10-03T22:35:06.976446] [DEBUG] [LOCAL ] BG: Loaded 51115 existing records from primary storage. [2025-10-03T22:35:06.983013] [INFO ] [MAIN ] BG: Loaded 51115 primary data records. [2025-10-03T22:35:07.635688] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:07.638042] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17901 primary records. [2025-10-03T22:35:07.638331] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-03T22:35:07.659488] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-10-03T22:35:07.660427] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-03T22:35:07.665456] [INFO ] [MAIN ] Derivative Progress: 214/2073 symbols completed. BGB took 1.2s. Estimated remaining: 12m 58s. Rate: 143.3 symbols/min [2025-10-03T22:35:07.666078] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:07.687935] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:07.693377] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 17279 primary records. [2025-10-03T22:35:07.693877] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-03T22:35:07.724087] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:07.726489] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51115 primary records. [2025-10-03T22:35:07.726991] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-03T22:35:07.730254] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-10-03T22:35:07.739716] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-03T22:35:07.742636] [INFO ] [MAIN ] Derivative Progress: 215/2073 symbols completed. BGH took 1.2s. Estimated remaining: 12m 55s. Rate: 143.9 symbols/min [2025-10-03T22:35:07.746050] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:07.774384] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-10-03T22:35:07.774626] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-03T22:35:07.777943] [INFO ] [MAIN ] Derivative Progress: 216/2073 symbols completed. BG took 1.3s. Estimated remaining: 12m 51s. Rate: 144.5 symbols/min [2025-10-03T22:35:07.778233] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:07.783620] [DEBUG] [LOCAL ] BGSF: Loaded 7724 existing records from primary storage. [2025-10-03T22:35:07.783847] [INFO ] [MAIN ] BGSF: Loaded 7724 primary data records. [2025-10-03T22:35:07.917717] [DEBUG] [LOCAL ] BGS: Loaded 51155 existing records from primary storage. [2025-10-03T22:35:07.923757] [INFO ] [MAIN ] BGS: Loaded 51155 primary data records. [2025-10-03T22:35:07.972935] [DEBUG] [LOCAL ] BGT: Loaded 16780 existing records from primary storage. [2025-10-03T22:35:08.095224] [INFO ] [MAIN ] BGT: Loaded 16780 primary data records. [2025-10-03T22:35:08.963002] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:08.964299] [INFO ] [MAIN ] BGSF: Generated 1820 derivative records from 7724 primary records. [2025-10-03T22:35:08.964555] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-03T22:35:08.994819] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1820 records). [2025-10-03T22:35:09.000686] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-03T22:35:09.004268] [INFO ] [MAIN ] Derivative Progress: 217/2073 symbols completed. BGSF took 1.3s. Estimated remaining: 12m 58s. Rate: 143.2 symbols/min [2025-10-03T22:35:09.005429] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:09.005271] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:09.007357] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51155 primary records. [2025-10-03T22:35:09.007800] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-03T22:35:09.043062] [DEBUG] [LOCAL ] BGX: Loaded 11262 existing records from primary storage. [2025-10-03T22:35:09.049058] [INFO ] [MAIN ] BGX: Loaded 11262 primary data records. [2025-10-03T22:35:09.042370] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-10-03T22:35:09.055293] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-03T22:35:09.112845] [INFO ] [MAIN ] Derivative Progress: 218/2073 symbols completed. BGS took 1.4s. Estimated remaining: 12m 55s. Rate: 143.7 symbols/min [2025-10-03T22:35:09.132739] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:09.132500] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:09.151766] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16780 primary records. [2025-10-03T22:35:09.177605] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-03T22:35:09.419465] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-10-03T22:35:09.427069] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-03T22:35:09.431863] [INFO ] [MAIN ] Derivative Progress: 219/2073 symbols completed. BGT took 1.7s. Estimated remaining: 12m 53s. Rate: 143.8 symbols/min [2025-10-03T22:35:09.432852] [DEBUG] [LOCAL ] BGY: Loaded 22654 existing records from primary storage. [2025-10-03T22:35:09.433005] [INFO ] [MAIN ] BGY: Loaded 22654 primary data records. [2025-10-03T22:35:09.433136] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:09.583187] [DEBUG] [LOCAL ] BH: Loaded 16097 existing records from primary storage. [2025-10-03T22:35:09.652103] [INFO ] [MAIN ] BH: Loaded 16097 primary data records. [2025-10-03T22:35:09.943397] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:10.012987] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 11262 primary records. [2025-10-03T22:35:10.131540] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-03T22:35:10.191501] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-10-03T22:35:10.192277] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-03T22:35:10.195960] [INFO ] [MAIN ] Derivative Progress: 220/2073 symbols completed. BGX took 1.2s. Estimated remaining: 12m 56s. Rate: 143.3 symbols/min [2025-10-03T22:35:10.192791] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:10.196581] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:10.197828] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22654 primary records. [2025-10-03T22:35:10.198068] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-03T22:35:10.216150] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-10-03T22:35:10.216424] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-03T22:35:10.220910] [INFO ] [MAIN ] Derivative Progress: 221/2073 symbols completed. BGY took 1.1s. Estimated remaining: 12m 52s. Rate: 143.9 symbols/min [2025-10-03T22:35:10.221251] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:10.241101] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:10.242207] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 16097 primary records. [2025-10-03T22:35:10.242622] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-03T22:35:10.277850] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-10-03T22:35:10.290882] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-03T22:35:10.296088] [INFO ] [MAIN ] Derivative Progress: 222/2073 symbols completed. BH took 0.9s. Estimated remaining: 12m 49s. Rate: 144.4 symbols/min [2025-10-03T22:35:10.296464] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:10.306919] [DEBUG] [LOCAL ] BHC: Loaded 47483 existing records from primary storage. [2025-10-03T22:35:10.308136] [INFO ] [MAIN ] BHC: Loaded 47483 primary data records. [2025-10-03T22:35:10.308020] [DEBUG] [LOCAL ] BHE: Loaded 24909 existing records from primary storage. [2025-10-03T22:35:10.320939] [INFO ] [MAIN ] BHE: Loaded 24909 primary data records. [2025-10-03T22:35:10.654207] [DEBUG] [LOCAL ] BHK: Loaded 23317 existing records from primary storage. [2025-10-03T22:35:10.700363] [INFO ] [MAIN ] BHK: Loaded 23317 primary data records. [2025-10-03T22:35:11.449913] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:11.452400] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47483 primary records. [2025-10-03T22:35:11.452619] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-03T22:35:11.486598] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:11.489627] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 24909 primary records. [2025-10-03T22:35:11.490199] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-03T22:35:11.500998] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-10-03T22:35:11.505732] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-03T22:35:11.509810] [INFO ] [MAIN ] Derivative Progress: 223/2073 symbols completed. BHC took 1.3s. Estimated remaining: 12m 55s. Rate: 143.2 symbols/min [2025-10-03T22:35:11.518522] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-10-03T22:35:11.519121] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-03T22:35:11.522565] [INFO ] [MAIN ] Derivative Progress: 224/2073 symbols completed. BHE took 1.3s. Estimated remaining: 12m 51s. Rate: 143.8 symbols/min [2025-10-03T22:35:11.537056] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:11.538074] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 23317 primary records. [2025-10-03T22:35:11.538153] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-03T22:35:11.555559] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-10-03T22:35:11.555772] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-03T22:35:11.559091] [INFO ] [MAIN ] Derivative Progress: 225/2073 symbols completed. BHK took 1.3s. Estimated remaining: 12m 48s. Rate: 144.4 symbols/min [2025-10-03T22:35:11.559929] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:11.560193] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:11.560442] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:11.612874] [DEBUG] [LOCAL ] BHR: Loaded 21779 existing records from primary storage. [2025-10-03T22:35:11.613394] [INFO ] [MAIN ] BHR: Loaded 21779 primary data records. [2025-10-03T22:35:11.758109] [DEBUG] [LOCAL ] BHP: Loaded 54148 existing records from primary storage. [2025-10-03T22:35:11.763891] [INFO ] [MAIN ] BHP: Loaded 54148 primary data records. [2025-10-03T22:35:11.859261] [DEBUG] [LOCAL ] BHVN: Loaded 50537 existing records from primary storage. [2025-10-03T22:35:11.908038] [INFO ] [MAIN ] BHVN: Loaded 50537 primary data records. [2025-10-03T22:35:12.720141] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:12.730893] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21779 primary records. [2025-10-03T22:35:12.736375] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-03T22:35:12.738102] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:12.739616] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54148 primary records. [2025-10-03T22:35:12.747039] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-03T22:35:12.775314] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-10-03T22:35:12.790018] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-03T22:35:12.794490] [INFO ] [MAIN ] Derivative Progress: 226/2073 symbols completed. BHR took 1.2s. Estimated remaining: 12m 54s. Rate: 143.1 symbols/min [2025-10-03T22:35:12.796376] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:12.798296] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:12.799605] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50537 primary records. [2025-10-03T22:35:12.799817] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-03T22:35:12.800461] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-10-03T22:35:12.801349] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-03T22:35:12.804712] [INFO ] [MAIN ] Derivative Progress: 227/2073 symbols completed. BHP took 1.2s. Estimated remaining: 12m 50s. Rate: 143.8 symbols/min [2025-10-03T22:35:12.805194] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:12.824163] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-10-03T22:35:12.824394] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-03T22:35:12.828114] [INFO ] [MAIN ] Derivative Progress: 228/2073 symbols completed. BHVN took 1.3s. Estimated remaining: 12m 47s. Rate: 144.4 symbols/min [2025-10-03T22:35:12.828638] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:12.891459] [DEBUG] [LOCAL ] BIP: Loaded 40146 existing records from primary storage. [2025-10-03T22:35:12.893245] [INFO ] [MAIN ] BIP: Loaded 40146 primary data records. [2025-10-03T22:35:12.915424] [DEBUG] [LOCAL ] BILL: Loaded 53112 existing records from primary storage. [2025-10-03T22:35:12.952585] [INFO ] [MAIN ] BILL: Loaded 53112 primary data records. [2025-10-03T22:35:13.417060] [DEBUG] [LOCAL ] BIPC: Loaded 41980 existing records from primary storage. [2025-10-03T22:35:13.433291] [INFO ] [MAIN ] BIPC: Loaded 41980 primary data records. [2025-10-03T22:35:13.989486] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:13.990583] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40146 primary records. [2025-10-03T22:35:13.998804] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-03T22:35:14.014709] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:14.020480] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53112 primary records. [2025-10-03T22:35:14.021540] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-03T22:35:14.044963] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-10-03T22:35:14.046875] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-03T22:35:14.046942] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-10-03T22:35:14.050848] [INFO ] [MAIN ] Derivative Progress: 229/2073 symbols completed. BILL took 1.3s. Estimated remaining: 12m 53s. Rate: 143.1 symbols/min [2025-10-03T22:35:14.047637] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-03T22:35:14.053670] [INFO ] [MAIN ] Derivative Progress: 230/2073 symbols completed. BIP took 1.2s. Estimated remaining: 12m 49s. Rate: 143.8 symbols/min [2025-10-03T22:35:14.055798] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:14.051056] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:14.071854] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:14.073877] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 41980 primary records. [2025-10-03T22:35:14.075123] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-03T22:35:14.086595] [DEBUG] [LOCAL ] BIPH: Loaded 2595 existing records from primary storage. [2025-10-03T22:35:14.088364] [INFO ] [MAIN ] BIPH: Loaded 2595 primary data records. [2025-10-03T22:35:14.118613] [DEBUG] [LOCAL ] BIPI: Loaded 3229 existing records from primary storage. [2025-10-03T22:35:14.138030] [INFO ] [MAIN ] BIPI: Loaded 3229 primary data records. [2025-10-03T22:35:14.246017] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-10-03T22:35:14.313152] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-03T22:35:14.341136] [INFO ] [MAIN ] Derivative Progress: 231/2073 symbols completed. BIPC took 1.5s. Estimated remaining: 12m 48s. Rate: 144.0 symbols/min [2025-10-03T22:35:14.387474] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:14.789805] [DEBUG] [LOCAL ] BIPJ: Loaded 3148 existing records from primary storage. [2025-10-03T22:35:14.790396] [INFO ] [MAIN ] BIPJ: Loaded 3148 primary data records. [2025-10-03T22:35:15.146403] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:15.149193] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2595 primary records. [2025-10-03T22:35:15.149601] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-03T22:35:15.175630] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:15.177267] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3229 primary records. [2025-10-03T22:35:15.178577] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-03T22:35:15.190450] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-10-03T22:35:15.193213] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-03T22:35:15.196206] [INFO ] [MAIN ] Derivative Progress: 232/2073 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 51s. Rate: 143.3 symbols/min [2025-10-03T22:35:15.197321] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:15.203598] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-10-03T22:35:15.205910] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-03T22:35:15.210334] [INFO ] [MAIN ] Derivative Progress: 233/2073 symbols completed. BIPI took 1.2s. Estimated remaining: 12m 47s. Rate: 143.9 symbols/min [2025-10-03T22:35:15.210741] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:15.226392] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:15.227349] [INFO ] [MAIN ] BIPJ: Generated 1819 derivative records from 3148 primary records. [2025-10-03T22:35:15.227602] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-03T22:35:15.252228] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1819 records). [2025-10-03T22:35:15.252399] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-03T22:35:15.255900] [INFO ] [MAIN ] Derivative Progress: 234/2073 symbols completed. BIPJ took 0.9s. Estimated remaining: 12m 44s. Rate: 144.5 symbols/min [2025-10-03T22:35:15.256175] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:15.280244] [DEBUG] [LOCAL ] BIT: Loaded 23266 existing records from primary storage. [2025-10-03T22:35:15.280441] [INFO ] [MAIN ] BIT: Loaded 23266 primary data records. [2025-10-03T22:35:15.408260] [DEBUG] [LOCAL ] BIRK: Loaded 51678 existing records from primary storage. [2025-10-03T22:35:15.425265] [INFO ] [MAIN ] BIRK: Loaded 51678 primary data records. [2025-10-03T22:35:15.843846] [DEBUG] [LOCAL ] BJ: Loaded 52136 existing records from primary storage. [2025-10-03T22:35:15.887797] [INFO ] [MAIN ] BJ: Loaded 52136 primary data records. [2025-10-03T22:35:16.441495] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:16.442709] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 23266 primary records. [2025-10-03T22:35:16.443023] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-03T22:35:16.469609] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-10-03T22:35:16.478390] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-03T22:35:16.486354] [INFO ] [MAIN ] Derivative Progress: 235/2073 symbols completed. BIT took 1.3s. Estimated remaining: 12m 50s. Rate: 143.3 symbols/min [2025-10-03T22:35:16.487019] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:16.487589] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:16.489238] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51678 primary records. [2025-10-03T22:35:16.489321] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-03T22:35:16.511939] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-10-03T22:35:16.512323] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-03T22:35:16.515987] [INFO ] [MAIN ] Derivative Progress: 236/2073 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 46s. Rate: 143.8 symbols/min [2025-10-03T22:35:16.530987] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:16.531370] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:16.532918] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52136 primary records. [2025-10-03T22:35:16.533316] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-03T22:35:16.565611] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-10-03T22:35:16.565844] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-03T22:35:16.569144] [INFO ] [MAIN ] Derivative Progress: 237/2073 symbols completed. BJ took 1.3s. Estimated remaining: 12m 43s. Rate: 144.4 symbols/min [2025-10-03T22:35:16.569507] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:16.592494] [DEBUG] [LOCAL ] BK: Loaded 54317 existing records from primary storage. [2025-10-03T22:35:16.592882] [INFO ] [MAIN ] BK: Loaded 54317 primary data records. [2025-10-03T22:35:16.811843] [DEBUG] [LOCAL ] BKD: Loaded 50962 existing records from primary storage. [2025-10-03T22:35:16.838894] [INFO ] [MAIN ] BKD: Loaded 50962 primary data records. [2025-10-03T22:35:16.846311] [DEBUG] [LOCAL ] BKE: Loaded 34858 existing records from primary storage. [2025-10-03T22:35:16.972609] [INFO ] [MAIN ] BKE: Loaded 34858 primary data records. [2025-10-03T22:35:17.824527] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:17.826411] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54317 primary records. [2025-10-03T22:35:17.826622] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-03T22:35:17.851309] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-10-03T22:35:17.851954] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-03T22:35:17.854400] [INFO ] [MAIN ] Derivative Progress: 238/2073 symbols completed. BK took 1.4s. Estimated remaining: 12m 49s. Rate: 143.1 symbols/min [2025-10-03T22:35:17.876285] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:17.890545] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 34858 primary records. [2025-10-03T22:35:17.890425] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:17.891451] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50962 primary records. [2025-10-03T22:35:17.891577] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-03T22:35:17.892256] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-03T22:35:17.926325] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-10-03T22:35:17.927077] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-10-03T22:35:17.927249] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-03T22:35:17.927375] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-03T22:35:17.932486] [INFO ] [MAIN ] Derivative Progress: 239/2073 symbols completed. BKE took 1.4s. Estimated remaining: 12m 46s. Rate: 143.6 symbols/min [2025-10-03T22:35:17.936855] [INFO ] [MAIN ] Derivative Progress: 240/2073 symbols completed. BKD took 1.4s. Estimated remaining: 12m 43s. Rate: 144.2 symbols/min [2025-10-03T22:35:17.937491] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:17.937630] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:17.937821] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:17.954387] [DEBUG] [LOCAL ] BKN: Loaded 7844 existing records from primary storage. [2025-10-03T22:35:17.954598] [INFO ] [MAIN ] BKN: Loaded 7844 primary data records. [2025-10-03T22:35:18.159169] [DEBUG] [LOCAL ] BKH: Loaded 37195 existing records from primary storage. [2025-10-03T22:35:18.181553] [INFO ] [MAIN ] BKH: Loaded 37195 primary data records. [2025-10-03T22:35:18.351528] [DEBUG] [LOCAL ] BKSY: Loaded 48985 existing records from primary storage. [2025-10-03T22:35:18.396930] [INFO ] [MAIN ] BKSY: Loaded 48985 primary data records. [2025-10-03T22:35:19.039758] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:19.041285] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7844 primary records. [2025-10-03T22:35:19.042420] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-03T22:35:19.059958] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-10-03T22:35:19.061338] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-03T22:35:19.065404] [INFO ] [MAIN ] Derivative Progress: 241/2073 symbols completed. BKN took 1.1s. Estimated remaining: 12m 48s. Rate: 143.2 symbols/min [2025-10-03T22:35:19.066251] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:19.088346] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:19.093632] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37195 primary records. [2025-10-03T22:35:19.095830] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-03T22:35:19.131728] [DEBUG] [LOCAL ] BKT: Loaded 11681 existing records from primary storage. [2025-10-03T22:35:19.131235] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:19.133099] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 48985 primary records. [2025-10-03T22:35:19.131898] [INFO ] [MAIN ] BKT: Loaded 11681 primary data records. [2025-10-03T22:35:19.138415] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-03T22:35:19.224334] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-10-03T22:35:19.226025] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-03T22:35:19.236244] [INFO ] [MAIN ] Derivative Progress: 242/2073 symbols completed. BKH took 1.3s. Estimated remaining: 12m 45s. Rate: 143.5 symbols/min [2025-10-03T22:35:19.243051] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:19.270361] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-10-03T22:35:19.282011] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-03T22:35:19.320948] [INFO ] [MAIN ] Derivative Progress: 243/2073 symbols completed. BKSY took 1.4s. Estimated remaining: 12m 43s. Rate: 144.0 symbols/min [2025-10-03T22:35:19.360547] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:19.541172] [DEBUG] [LOCAL ] BKU: Loaded 42022 existing records from primary storage. [2025-10-03T22:35:19.541552] [INFO ] [MAIN ] BKU: Loaded 42022 primary data records. [2025-10-03T22:35:19.720520] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:19.766126] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 11681 primary records. [2025-10-03T22:35:19.727587] [DEBUG] [LOCAL ] BLCO: Loaded 35851 existing records from primary storage. [2025-10-03T22:35:19.816405] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-03T22:35:20.026026] [INFO ] [MAIN ] BLCO: Loaded 35851 primary data records. [2025-10-03T22:35:20.238779] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-10-03T22:35:20.266731] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-03T22:35:20.282215] [INFO ] [MAIN ] Derivative Progress: 244/2073 symbols completed. BKT took 1.2s. Estimated remaining: 12m 46s. Rate: 143.2 symbols/min [2025-10-03T22:35:20.324327] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:20.609428] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:20.623874] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42022 primary records. [2025-10-03T22:35:20.624521] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-03T22:35:20.625762] [DEBUG] [LOCAL ] BLD: Loaded 27960 existing records from primary storage. [2025-10-03T22:35:20.628042] [INFO ] [MAIN ] BLD: Loaded 27960 primary data records. [2025-10-03T22:35:20.735128] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-10-03T22:35:20.746112] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-03T22:35:20.763058] [INFO ] [MAIN ] Derivative Progress: 245/2073 symbols completed. BKU took 1.5s. Estimated remaining: 12m 46s. Rate: 143.1 symbols/min [2025-10-03T22:35:20.791674] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:21.024313] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:21.025917] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 35851 primary records. [2025-10-03T22:35:21.026166] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-03T22:35:21.047128] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-10-03T22:35:21.047384] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-03T22:35:21.050208] [INFO ] [MAIN ] Derivative Progress: 246/2073 symbols completed. BLCO took 1.7s. Estimated remaining: 12m 45s. Rate: 143.3 symbols/min [2025-10-03T22:35:21.050533] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:21.117682] [DEBUG] [LOCAL ] BLE: Loaded 14475 existing records from primary storage. [2025-10-03T22:35:21.122926] [INFO ] [MAIN ] BLE: Loaded 14475 primary data records. [2025-10-03T22:35:21.125427] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:21.126312] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 27960 primary records. [2025-10-03T22:35:21.131935] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-03T22:35:21.126496] [DEBUG] [LOCAL ] BLDR: Loaded 52382 existing records from primary storage. [2025-10-03T22:35:21.185502] [INFO ] [MAIN ] BLDR: Loaded 52382 primary data records. [2025-10-03T22:35:21.229372] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-10-03T22:35:21.246553] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-03T22:35:21.262998] [INFO ] [MAIN ] Derivative Progress: 247/2073 symbols completed. BLD took 0.9s. Estimated remaining: 12m 43s. Rate: 143.6 symbols/min [2025-10-03T22:35:21.305486] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:21.882676] [DEBUG] [LOCAL ] BLK: Loaded 34890 existing records from primary storage. [2025-10-03T22:35:21.883062] [INFO ] [MAIN ] BLK: Loaded 34890 primary data records. [2025-10-03T22:35:22.371129] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:22.374634] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14475 primary records. [2025-10-03T22:35:22.375691] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-03T22:35:22.401917] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:22.407588] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52382 primary records. [2025-10-03T22:35:22.408769] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-03T22:35:22.427168] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-10-03T22:35:22.432816] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-03T22:35:22.441337] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-10-03T22:35:22.441860] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-03T22:35:22.437434] [INFO ] [MAIN ] Derivative Progress: 248/2073 symbols completed. BLE took 1.4s. Estimated remaining: 12m 48s. Rate: 142.6 symbols/min [2025-10-03T22:35:22.446412] [INFO ] [MAIN ] Derivative Progress: 249/2073 symbols completed. BLDR took 1.7s. Estimated remaining: 12m 45s. Rate: 143.1 symbols/min [2025-10-03T22:35:22.446292] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:22.447529] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:22.476141] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:22.477350] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 34890 primary records. [2025-10-03T22:35:22.477599] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-03T22:35:22.502121] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-10-03T22:35:22.503129] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-03T22:35:22.502994] [DEBUG] [LOCAL ] BLW: Loaded 13457 existing records from primary storage. [2025-10-03T22:35:22.508433] [INFO ] [MAIN ] BLW: Loaded 13457 primary data records. [2025-10-03T22:35:22.507978] [INFO ] [MAIN ] Derivative Progress: 250/2073 symbols completed. BLK took 1.2s. Estimated remaining: 12m 42s. Rate: 143.6 symbols/min [2025-10-03T22:35:22.532292] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:22.659833] [DEBUG] [LOCAL ] BLND: Loaded 49987 existing records from primary storage. [2025-10-03T22:35:22.671055] [INFO ] [MAIN ] BLND: Loaded 49987 primary data records. [2025-10-03T22:35:22.757433] [DEBUG] [LOCAL ] BLX: Loaded 15829 existing records from primary storage. [2025-10-03T22:35:22.899717] [INFO ] [MAIN ] BLX: Loaded 15829 primary data records. [2025-10-03T22:35:23.576255] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:23.577851] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13457 primary records. [2025-10-03T22:35:23.578708] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-03T22:35:23.619905] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-10-03T22:35:23.620217] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-03T22:35:23.624008] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:23.623247] [INFO ] [MAIN ] Derivative Progress: 251/2073 symbols completed. BLW took 1.2s. Estimated remaining: 12m 46s. Rate: 142.7 symbols/min [2025-10-03T22:35:23.624305] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:23.626983] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 49987 primary records. [2025-10-03T22:35:23.628407] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-03T22:35:23.661072] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:23.663277] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15829 primary records. [2025-10-03T22:35:23.664820] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-10-03T22:35:23.666066] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-03T22:35:23.665952] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-03T22:35:23.670831] [INFO ] [MAIN ] Derivative Progress: 252/2073 symbols completed. BLND took 1.2s. Estimated remaining: 12m 43s. Rate: 143.2 symbols/min [2025-10-03T22:35:23.671171] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:23.699148] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-10-03T22:35:23.701620] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-03T22:35:23.705462] [INFO ] [MAIN ] Derivative Progress: 253/2073 symbols completed. BLX took 1.2s. Estimated remaining: 12m 40s. Rate: 143.7 symbols/min [2025-10-03T22:35:23.720496] [DEBUG] [LOCAL ] BMA: Loaded 35953 existing records from primary storage. [2025-10-03T22:35:23.726278] [DEBUG] [LOCAL ] BME: Loaded 11124 existing records from primary storage. [2025-10-03T22:35:23.726450] [INFO ] [MAIN ] BMA: Loaded 35953 primary data records. [2025-10-03T22:35:23.726667] [INFO ] [MAIN ] BME: Loaded 11124 primary data records. [2025-10-03T22:35:24.465099] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:24.466636] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 11124 primary records. [2025-10-03T22:35:24.466964] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-03T22:35:24.506393] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-10-03T22:35:24.506834] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-03T22:35:24.506248] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:24.509479] [INFO ] [MAIN ] Derivative Progress: 254/2073 symbols completed. BME took 0.8s. Estimated remaining: 12m 42s. Rate: 143.2 symbols/min [2025-10-03T22:35:24.510708] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35953 primary records. [2025-10-03T22:35:24.511025] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-03T22:35:24.531049] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-10-03T22:35:24.531233] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-03T22:35:24.534851] [INFO ] [MAIN ] Derivative Progress: 255/2073 symbols completed. BMA took 0.9s. Estimated remaining: 12m 39s. Rate: 143.7 symbols/min [2025-10-03T22:35:24.535627] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:24.536058] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:24.535566] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:24.542553] [DEBUG] [LOCAL ] BMN: Loaded 2606 existing records from primary storage. [2025-10-03T22:35:24.542886] [INFO ] [MAIN ] BMN: Loaded 2606 primary data records. [2025-10-03T22:35:24.791378] [DEBUG] [LOCAL ] BMI: Loaded 24515 existing records from primary storage. [2025-10-03T22:35:24.948882] [INFO ] [MAIN ] BMI: Loaded 24515 primary data records. [2025-10-03T22:35:25.026982] [DEBUG] [LOCAL ] BMO: Loaded 41826 existing records from primary storage. [2025-10-03T22:35:25.050827] [INFO ] [MAIN ] BMO: Loaded 41826 primary data records. [2025-10-03T22:35:25.659351] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-10-03T22:35:25.661382] [INFO ] [MAIN ] BMN: Generated 1814 derivative records from 2606 primary records. [2025-10-03T22:35:25.662141] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-03T22:35:25.680844] [DEBUG] [LOCAL ] BMN: Derivative data saved (1814 records). [2025-10-03T22:35:25.681109] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-03T22:35:25.685738] [INFO ] [MAIN ] Derivative Progress: 256/2073 symbols completed. BMN took 1.2s. Estimated remaining: 12m 44s. Rate: 142.7 symbols/min [2025-10-03T22:35:25.686082] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:25.706076] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:25.707331] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24515 primary records. [2025-10-03T22:35:25.707637] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-03T22:35:25.727949] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-10-03T22:35:25.730345] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-03T22:35:25.734369] [INFO ] [MAIN ] Derivative Progress: 257/2073 symbols completed. BMI took 1.2s. Estimated remaining: 12m 41s. Rate: 143.2 symbols/min [2025-10-03T22:35:25.735017] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:25.749157] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:25.750265] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41826 primary records. [2025-10-03T22:35:25.750399] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-03T22:35:25.800241] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-10-03T22:35:25.802385] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-03T22:35:25.806104] [INFO ] [MAIN ] Derivative Progress: 258/2073 symbols completed. BMO took 1.3s. Estimated remaining: 12m 38s. Rate: 143.7 symbols/min [2025-10-03T22:35:25.806507] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:25.808970] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-03T22:35:25.809398] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-10-03T22:35:26.052431] [DEBUG] [LOCAL ] BNED: Loaded 29850 existing records from primary storage. [2025-10-03T22:35:26.052969] [INFO ] [MAIN ] BNED: Loaded 29850 primary data records. [2025-10-03T22:35:26.241193] [DEBUG] [LOCAL ] BN: Loaded 53772 existing records from primary storage. [2025-10-03T22:35:26.271837] [INFO ] [MAIN ] BN: Loaded 53772 primary data records. [2025-10-03T22:35:26.983837] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:26.986099] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-10-03T22:35:26.986903] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-03T22:35:27.010343] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-10-03T22:35:27.010819] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-03T22:35:27.014278] [INFO ] [MAIN ] Derivative Progress: 259/2073 symbols completed. BMY took 1.3s. Estimated remaining: 12m 43s. Rate: 142.6 symbols/min [2025-10-03T22:35:27.015292] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:27.030088] [DEBUG] [LOCAL ] BNH: Loaded 5198 existing records from primary storage. [2025-10-03T22:35:27.045359] [INFO ] [MAIN ] BNH: Loaded 5198 primary data records. [2025-10-03T22:35:27.045856] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:27.080998] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 29850 primary records. [2025-10-03T22:35:27.113038] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:27.112386] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-03T22:35:27.129967] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53772 primary records. [2025-10-03T22:35:27.169506] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-03T22:35:27.278745] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-10-03T22:35:27.296378] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-03T22:35:27.438843] [INFO ] [MAIN ] Derivative Progress: 260/2073 symbols completed. BNED took 1.6s. Estimated remaining: 12m 43s. Rate: 142.6 symbols/min [2025-10-03T22:35:27.458552] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:27.463557] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-10-03T22:35:27.463923] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-03T22:35:27.469217] [INFO ] [MAIN ] Derivative Progress: 261/2073 symbols completed. BN took 1.7s. Estimated remaining: 12m 40s. Rate: 143.1 symbols/min [2025-10-03T22:35:27.470871] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:27.476747] [DEBUG] [LOCAL ] BNJ: Loaded 2666 existing records from primary storage. [2025-10-03T22:35:27.477563] [INFO ] [MAIN ] BNJ: Loaded 2666 primary data records. [2025-10-03T22:35:27.889919] [DEBUG] [LOCAL ] BNL: Loaded 47668 existing records from primary storage. [2025-10-03T22:35:27.905102] [INFO ] [MAIN ] BNL: Loaded 47668 primary data records. [2025-10-03T22:35:27.906274] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:27.919559] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 5198 primary records. [2025-10-03T22:35:27.957549] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-03T22:35:28.089752] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-10-03T22:35:28.099025] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-03T22:35:28.185066] [INFO ] [MAIN ] Derivative Progress: 262/2073 symbols completed. BNH took 1.2s. Estimated remaining: 12m 41s. Rate: 142.8 symbols/min [2025-10-03T22:35:28.265670] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:28.287892] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:35:28.289294] [INFO ] [MAIN ] BNJ: Generated 1818 derivative records from 2666 primary records. [2025-10-03T22:35:28.289443] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-03T22:35:28.309779] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1818 records). [2025-10-03T22:35:28.310547] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-03T22:35:28.313900] [INFO ] [MAIN ] Derivative Progress: 263/2073 symbols completed. BNJ took 0.9s. Estimated remaining: 12m 39s. Rate: 143.1 symbols/min [2025-10-03T22:35:28.314851] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:28.338926] [DEBUG] [LOCAL ] BNT: Loaded 3434 existing records from primary storage. [2025-10-03T22:35:28.339486] [INFO ] [MAIN ] BNT: Loaded 3434 primary data records. [2025-10-03T22:35:28.504426] [DEBUG] [LOCAL ] BNS: Loaded 52238 existing records from primary storage. [2025-10-03T22:35:28.505245] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:28.505379] [INFO ] [MAIN ] BNS: Loaded 52238 primary data records. [2025-10-03T22:35:28.506353] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47668 primary records. [2025-10-03T22:35:28.549798] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-03T22:35:29.177612] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-10-03T22:35:29.188873] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-03T22:35:29.192713] [INFO ] [MAIN ] Derivative Progress: 264/2073 symbols completed. BNL took 1.7s. Estimated remaining: 12m 41s. Rate: 142.5 symbols/min [2025-10-03T22:35:29.193268] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:29.213084] [DEBUG] [LOCAL ] BNY: Loaded 7209 existing records from primary storage. [2025-10-03T22:35:29.214432] [INFO ] [MAIN ] BNY: Loaded 7209 primary data records. [2025-10-03T22:35:29.385395] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:29.438791] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3434 primary records. [2025-10-03T22:35:29.459468] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-03T22:35:29.459982] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:29.605461] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52238 primary records. [2025-10-03T22:35:29.605777] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-03T22:35:29.638330] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-10-03T22:35:29.642280] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-03T22:35:29.641988] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-10-03T22:35:29.645762] [INFO ] [MAIN ] Derivative Progress: 265/2073 symbols completed. BNT took 1.3s. Estimated remaining: 12m 41s. Rate: 142.5 symbols/min [2025-10-03T22:35:29.646521] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-03T22:35:29.650983] [INFO ] [MAIN ] Derivative Progress: 266/2073 symbols completed. BNS took 1.4s. Estimated remaining: 12m 38s. Rate: 143.0 symbols/min [2025-10-03T22:35:29.650878] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:29.651605] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:29.688715] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:29.689675] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7209 primary records. [2025-10-03T22:35:29.690253] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-03T22:35:29.705384] [DEBUG] [LOCAL ] BOE: Loaded 18104 existing records from primary storage. [2025-10-03T22:35:29.714356] [DEBUG] [LOCAL ] BOC: Loaded 18490 existing records from primary storage. [2025-10-03T22:35:29.717952] [INFO ] [MAIN ] BOE: Loaded 18104 primary data records. [2025-10-03T22:35:29.719630] [INFO ] [MAIN ] BOC: Loaded 18490 primary data records. [2025-10-03T22:35:29.867448] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-10-03T22:35:29.910198] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-03T22:35:29.939283] [INFO ] [MAIN ] Derivative Progress: 267/2073 symbols completed. BNY took 0.7s. Estimated remaining: 12m 37s. Rate: 143.2 symbols/min [2025-10-03T22:35:29.967472] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:30.435847] [DEBUG] [LOCAL ] BOND: Loaded 32665 existing records from primary storage. [2025-10-03T22:35:30.436305] [INFO ] [MAIN ] BOND: Loaded 32665 primary data records. [2025-10-03T22:35:30.806140] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:30.825787] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:30.819930] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18490 primary records. [2025-10-03T22:35:30.826685] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 18104 primary records. [2025-10-03T22:35:30.827241] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-03T22:35:30.827387] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-03T22:35:30.861895] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-10-03T22:35:30.864248] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-10-03T22:35:30.864420] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-03T22:35:30.864524] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-03T22:35:30.868749] [INFO ] [MAIN ] Derivative Progress: 268/2073 symbols completed. BOE took 1.2s. Estimated remaining: 12m 40s. Rate: 142.6 symbols/min [2025-10-03T22:35:30.872861] [INFO ] [MAIN ] Derivative Progress: 269/2073 symbols completed. BOC took 1.2s. Estimated remaining: 12m 37s. Rate: 143.1 symbols/min [2025-10-03T22:35:30.891497] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:30.892194] [INFO ] [MAIN ] BOND: Generated 1819 derivative records from 32665 primary records. [2025-10-03T22:35:30.892260] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-03T22:35:30.908805] [DEBUG] [LOCAL ] BOND: Derivative data saved (1819 records). [2025-10-03T22:35:30.908897] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-03T22:35:30.912527] [INFO ] [MAIN ] Derivative Progress: 270/2073 symbols completed. BOND took 0.9s. Estimated remaining: 12m 34s. Rate: 143.6 symbols/min [2025-10-03T22:35:30.913118] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:30.913068] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:30.913334] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:30.943419] [DEBUG] [LOCAL ] BOW: Loaded 24158 existing records from primary storage. [2025-10-03T22:35:30.943773] [INFO ] [MAIN ] BOW: Loaded 24158 primary data records. [2025-10-03T22:35:31.120982] [DEBUG] [LOCAL ] BOOT: Loaded 41070 existing records from primary storage. [2025-10-03T22:35:31.150976] [INFO ] [MAIN ] BOOT: Loaded 41070 primary data records. [2025-10-03T22:35:31.309221] [DEBUG] [LOCAL ] BORR: Loaded 51865 existing records from primary storage. [2025-10-03T22:35:31.342585] [INFO ] [MAIN ] BORR: Loaded 51865 primary data records. [2025-10-03T22:35:32.090107] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:32.091933] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 24158 primary records. [2025-10-03T22:35:32.092315] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-03T22:35:32.112509] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-10-03T22:35:32.115662] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-03T22:35:32.119874] [INFO ] [MAIN ] Derivative Progress: 271/2073 symbols completed. BOW took 1.2s. Estimated remaining: 12m 38s. Rate: 142.6 symbols/min [2025-10-03T22:35:32.134540] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:32.147817] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:32.149045] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41070 primary records. [2025-10-03T22:35:32.149246] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-03T22:35:32.149529] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:32.151238] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51865 primary records. [2025-10-03T22:35:32.151535] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-03T22:35:32.184803] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-10-03T22:35:32.185720] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-03T22:35:32.185452] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-10-03T22:35:32.188858] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-03T22:35:32.188776] [INFO ] [MAIN ] Derivative Progress: 272/2073 symbols completed. BOOT took 1.3s. Estimated remaining: 12m 36s. Rate: 143.0 symbols/min [2025-10-03T22:35:32.193458] [INFO ] [MAIN ] Derivative Progress: 273/2073 symbols completed. BORR took 1.3s. Estimated remaining: 12m 32s. Rate: 143.5 symbols/min [2025-10-03T22:35:32.193684] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:32.193386] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:32.261713] [DEBUG] [LOCAL ] BOX: Loaded 50948 existing records from primary storage. [2025-10-03T22:35:32.262023] [INFO ] [MAIN ] BOX: Loaded 50948 primary data records. [2025-10-03T22:35:32.262605] [DEBUG] [LOCAL ] BR: Loaded 35147 existing records from primary storage. [2025-10-03T22:35:32.302709] [INFO ] [MAIN ] BR: Loaded 35147 primary data records. [2025-10-03T22:35:32.572531] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-10-03T22:35:32.627503] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-10-03T22:35:33.341261] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:33.342259] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 50948 primary records. [2025-10-03T22:35:33.342621] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-03T22:35:33.378672] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:33.380586] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-10-03T22:35:33.381556] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35147 primary records. [2025-10-03T22:35:33.381828] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-03T22:35:33.381697] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-03T22:35:33.384341] [INFO ] [MAIN ] Derivative Progress: 274/2073 symbols completed. BOX took 1.2s. Estimated remaining: 12m 37s. Rate: 142.6 symbols/min [2025-10-03T22:35:33.393729] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:33.399976] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:33.412521] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-10-03T22:35:33.414448] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-03T22:35:33.417976] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-10-03T22:35:33.418327] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-03T22:35:33.421874] [INFO ] [MAIN ] Derivative Progress: 275/2073 symbols completed. BR took 1.2s. Estimated remaining: 12m 34s. Rate: 143.0 symbols/min [2025-10-03T22:35:33.422414] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:33.446529] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-10-03T22:35:33.446949] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-03T22:35:33.451230] [INFO ] [MAIN ] Derivative Progress: 276/2073 symbols completed. BP took 1.3s. Estimated remaining: 12m 31s. Rate: 143.5 symbols/min [2025-10-03T22:35:33.451629] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:33.499486] [DEBUG] [LOCAL ] BRBR: Loaded 52061 existing records from primary storage. [2025-10-03T22:35:33.499887] [INFO ] [MAIN ] BRBR: Loaded 52061 primary data records. [2025-10-03T22:35:33.814542] [DEBUG] [LOCAL ] BROS: Loaded 54071 existing records from primary storage. [2025-10-03T22:35:33.906036] [DEBUG] [LOCAL ] BRO: Loaded 52641 existing records from primary storage. [2025-10-03T22:35:33.906143] [INFO ] [MAIN ] BROS: Loaded 54071 primary data records. [2025-10-03T22:35:33.921718] [INFO ] [MAIN ] BRO: Loaded 52641 primary data records. [2025-10-03T22:35:34.582980] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:34.584118] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 52061 primary records. [2025-10-03T22:35:34.584617] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-03T22:35:34.605877] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-10-03T22:35:34.606522] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-03T22:35:34.609224] [INFO ] [MAIN ] Derivative Progress: 277/2073 symbols completed. BRBR took 1.2s. Estimated remaining: 12m 36s. Rate: 142.6 symbols/min [2025-10-03T22:35:34.609553] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:34.643721] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:34.643444] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:34.644542] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52641 primary records. [2025-10-03T22:35:34.644705] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-03T22:35:34.645274] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54071 primary records. [2025-10-03T22:35:34.646220] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-03T22:35:34.678764] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-10-03T22:35:34.688295] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-03T22:35:34.691441] [INFO ] [MAIN ] Derivative Progress: 278/2073 symbols completed. BRO took 1.3s. Estimated remaining: 12m 33s. Rate: 143.0 symbols/min [2025-10-03T22:35:34.688047] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-10-03T22:35:34.691694] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-03T22:35:34.691826] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:34.696733] [INFO ] [MAIN ] Derivative Progress: 279/2073 symbols completed. BROS took 1.2s. Estimated remaining: 12m 30s. Rate: 143.5 symbols/min [2025-10-03T22:35:34.697263] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:34.715679] [DEBUG] [LOCAL ] BRT: Loaded 5030 existing records from primary storage. [2025-10-03T22:35:34.717139] [DEBUG] [LOCAL ] BRSP: Loaded 37343 existing records from primary storage. [2025-10-03T22:35:34.717386] [INFO ] [MAIN ] BRT: Loaded 5030 primary data records. [2025-10-03T22:35:34.717285] [INFO ] [MAIN ] BRSP: Loaded 37343 primary data records. [2025-10-03T22:35:34.975958] [DEBUG] [LOCAL ] BRW: Loaded 20684 existing records from primary storage. [2025-10-03T22:35:34.991922] [INFO ] [MAIN ] BRW: Loaded 20684 primary data records. [2025-10-03T22:35:35.831623] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:35.831960] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:35.832894] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5030 primary records. [2025-10-03T22:35:35.833091] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-03T22:35:35.833749] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37343 primary records. [2025-10-03T22:35:35.834900] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-03T22:35:35.863785] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-10-03T22:35:35.865943] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-03T22:35:35.878130] [INFO ] [MAIN ] Derivative Progress: 280/2073 symbols completed. BRT took 1.2s. Estimated remaining: 12m 34s. Rate: 142.6 symbols/min [2025-10-03T22:35:35.884229] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:35.886068] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:35.885045] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 20684 primary records. [2025-10-03T22:35:35.885953] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-10-03T22:35:35.886246] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-03T22:35:35.886355] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-03T22:35:35.892039] [INFO ] [MAIN ] Derivative Progress: 281/2073 symbols completed. BRSP took 1.3s. Estimated remaining: 12m 31s. Rate: 143.1 symbols/min [2025-10-03T22:35:35.893137] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:35.910810] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-10-03T22:35:35.911120] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-03T22:35:35.914946] [INFO ] [MAIN ] Derivative Progress: 282/2073 symbols completed. BRW took 1.2s. Estimated remaining: 12m 28s. Rate: 143.6 symbols/min [2025-10-03T22:35:35.915190] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:35.948508] [DEBUG] [LOCAL ] BSL: Loaded 8434 existing records from primary storage. [2025-10-03T22:35:35.948817] [INFO ] [MAIN ] BSL: Loaded 8434 primary data records. [2025-10-03T22:35:36.057363] [DEBUG] [LOCAL ] BSAC: Loaded 33459 existing records from primary storage. [2025-10-03T22:35:36.088721] [INFO ] [MAIN ] BSAC: Loaded 33459 primary data records. [2025-10-03T22:35:36.110833] [DEBUG] [LOCAL ] BSBR: Loaded 35923 existing records from primary storage. [2025-10-03T22:35:36.139238] [INFO ] [MAIN ] BSBR: Loaded 35923 primary data records. [2025-10-03T22:35:37.042672] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:37.044074] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8434 primary records. [2025-10-03T22:35:37.044418] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-03T22:35:37.073800] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-10-03T22:35:37.076728] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-03T22:35:37.080532] [INFO ] [MAIN ] Derivative Progress: 283/2073 symbols completed. BSL took 1.2s. Estimated remaining: 12m 33s. Rate: 142.7 symbols/min [2025-10-03T22:35:37.095488] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:37.096544] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33459 primary records. [2025-10-03T22:35:37.096815] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-03T22:35:37.130553] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-10-03T22:35:37.131763] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-03T22:35:37.131635] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:37.132778] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35923 primary records. [2025-10-03T22:35:37.132879] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-03T22:35:37.136389] [INFO ] [MAIN ] Derivative Progress: 284/2073 symbols completed. BSAC took 1.3s. Estimated remaining: 12m 30s. Rate: 143.1 symbols/min [2025-10-03T22:35:37.153281] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-10-03T22:35:37.153445] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-03T22:35:37.157123] [INFO ] [MAIN ] Derivative Progress: 285/2073 symbols completed. BSBR took 1.3s. Estimated remaining: 12m 27s. Rate: 143.6 symbols/min [2025-10-03T22:35:37.158086] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:37.158226] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:37.158297] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:37.168976] [DEBUG] [LOCAL ] BTA: Loaded 5450 existing records from primary storage. [2025-10-03T22:35:37.169268] [INFO ] [MAIN ] BTA: Loaded 5450 primary data records. [2025-10-03T22:35:37.315377] [DEBUG] [LOCAL ] BST: Loaded 19287 existing records from primary storage. [2025-10-03T22:35:37.347171] [INFO ] [MAIN ] BST: Loaded 19287 primary data records. [2025-10-03T22:35:37.379458] [DEBUG] [LOCAL ] BSTZ: Loaded 25154 existing records from primary storage. [2025-10-03T22:35:37.387404] [INFO ] [MAIN ] BSTZ: Loaded 25154 primary data records. [2025-10-03T22:35:38.353925] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:38.356277] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5450 primary records. [2025-10-03T22:35:38.356430] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-03T22:35:38.380389] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-10-03T22:35:38.394441] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-03T22:35:38.397583] [INFO ] [MAIN ] Derivative Progress: 286/2073 symbols completed. BTA took 1.2s. Estimated remaining: 12m 32s. Rate: 142.6 symbols/min [2025-10-03T22:35:38.397975] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:38.399061] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:38.400059] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19287 primary records. [2025-10-03T22:35:38.400272] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-03T22:35:38.421424] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-10-03T22:35:38.426836] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-03T22:35:38.430791] [INFO ] [MAIN ] Derivative Progress: 287/2073 symbols completed. BST took 1.3s. Estimated remaining: 12m 29s. Rate: 143.1 symbols/min [2025-10-03T22:35:38.447761] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:38.457202] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:38.457901] [DEBUG] [LOCAL ] BTCM: Loaded 15705 existing records from primary storage. [2025-10-03T22:35:38.459467] [INFO ] [MAIN ] BTCM: Loaded 15705 primary data records. [2025-10-03T22:35:38.459226] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25154 primary records. [2025-10-03T22:35:38.459722] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-03T22:35:38.587629] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-10-03T22:35:38.592003] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-03T22:35:38.596144] [INFO ] [MAIN ] Derivative Progress: 288/2073 symbols completed. BSTZ took 1.4s. Estimated remaining: 12m 27s. Rate: 143.4 symbols/min [2025-10-03T22:35:38.612724] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:38.833981] [DEBUG] [LOCAL ] BTO: Loaded 8859 existing records from primary storage. [2025-10-03T22:35:38.834319] [INFO ] [MAIN ] BTO: Loaded 8859 primary data records. [2025-10-03T22:35:38.957351] [DEBUG] [LOCAL ] BTI: Loaded 54336 existing records from primary storage. [2025-10-03T22:35:38.977688] [INFO ] [MAIN ] BTI: Loaded 54336 primary data records. [2025-10-03T22:35:39.553858] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:39.555689] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 15705 primary records. [2025-10-03T22:35:39.556246] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-03T22:35:39.577710] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-10-03T22:35:39.578325] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-03T22:35:39.581214] [INFO ] [MAIN ] Derivative Progress: 289/2073 symbols completed. BTCM took 1.2s. Estimated remaining: 12m 30s. Rate: 142.7 symbols/min [2025-10-03T22:35:39.581556] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:39.601873] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:39.602939] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8859 primary records. [2025-10-03T22:35:39.603039] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-03T22:35:39.629693] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-10-03T22:35:39.638794] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-03T22:35:39.639574] [DEBUG] [LOCAL ] BTT: Loaded 16174 existing records from primary storage. [2025-10-03T22:35:39.643250] [INFO ] [MAIN ] Derivative Progress: 290/2073 symbols completed. BTO took 1.0s. Estimated remaining: 12m 27s. Rate: 143.1 symbols/min [2025-10-03T22:35:39.651326] [INFO ] [MAIN ] BTT: Loaded 16174 primary data records. [2025-10-03T22:35:39.657763] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:39.707402] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:39.720989] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54336 primary records. [2025-10-03T22:35:39.745243] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-03T22:35:40.091431] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-10-03T22:35:40.093206] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-03T22:35:40.099016] [INFO ] [MAIN ] Derivative Progress: 291/2073 symbols completed. BTI took 1.7s. Estimated remaining: 12m 27s. Rate: 143.1 symbols/min [2025-10-03T22:35:40.100336] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:40.142499] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:40.148521] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16174 primary records. [2025-10-03T22:35:40.164361] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-03T22:35:40.169018] [DEBUG] [LOCAL ] BTU: Loaded 54088 existing records from primary storage. [2025-10-03T22:35:40.169710] [INFO ] [MAIN ] BTU: Loaded 54088 primary data records. [2025-10-03T22:35:40.255255] [DEBUG] [LOCAL ] BTZ: Loaded 23173 existing records from primary storage. [2025-10-03T22:35:40.305725] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-10-03T22:35:40.289621] [INFO ] [MAIN ] BTZ: Loaded 23173 primary data records. [2025-10-03T22:35:40.310747] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-03T22:35:40.313838] [INFO ] [MAIN ] Derivative Progress: 292/2073 symbols completed. BTT took 0.7s. Estimated remaining: 12m 26s. Rate: 143.3 symbols/min [2025-10-03T22:35:40.341757] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:40.914721] [DEBUG] [LOCAL ] BUD: Loaded 53478 existing records from primary storage. [2025-10-03T22:35:40.916610] [INFO ] [MAIN ] BUD: Loaded 53478 primary data records. [2025-10-03T22:35:41.055309] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:41.083403] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54088 primary records. [2025-10-03T22:35:41.113687] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-03T22:35:41.321795] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:41.328137] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23173 primary records. [2025-10-03T22:35:41.327001] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-10-03T22:35:41.328410] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-03T22:35:41.328489] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-03T22:35:41.331154] [INFO ] [MAIN ] Derivative Progress: 293/2073 symbols completed. BTU took 1.7s. Estimated remaining: 12m 29s. Rate: 142.6 symbols/min [2025-10-03T22:35:41.332917] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:41.353340] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-10-03T22:35:41.353673] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-03T22:35:41.360366] [INFO ] [MAIN ] Derivative Progress: 294/2073 symbols completed. BTZ took 1.3s. Estimated remaining: 12m 26s. Rate: 143.1 symbols/min [2025-10-03T22:35:41.361107] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:41.374027] [DEBUG] [LOCAL ] BUI: Loaded 11813 existing records from primary storage. [2025-10-03T22:35:41.374563] [INFO ] [MAIN ] BUI: Loaded 11813 primary data records. [2025-10-03T22:35:41.596042] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:41.617230] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53478 primary records. [2025-10-03T22:35:41.667459] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-03T22:35:41.808689] [DEBUG] [LOCAL ] BUR: Loaded 45747 existing records from primary storage. [2025-10-03T22:35:41.810893] [INFO ] [MAIN ] BUR: Loaded 45747 primary data records. [2025-10-03T22:35:41.929182] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-10-03T22:35:41.950968] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-03T22:35:41.967783] [INFO ] [MAIN ] Derivative Progress: 295/2073 symbols completed. BUD took 1.6s. Estimated remaining: 12m 27s. Rate: 142.9 symbols/min [2025-10-03T22:35:41.968261] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:42.214423] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:42.216151] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11813 primary records. [2025-10-03T22:35:42.217344] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-03T22:35:42.249755] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-10-03T22:35:42.250028] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-03T22:35:42.252714] [INFO ] [MAIN ] Derivative Progress: 296/2073 symbols completed. BUI took 0.9s. Estimated remaining: 12m 26s. Rate: 143.0 symbols/min [2025-10-03T22:35:42.253694] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:42.281271] [DEBUG] [LOCAL ] BURL: Loaded 46622 existing records from primary storage. [2025-10-03T22:35:42.281905] [INFO ] [MAIN ] BURL: Loaded 46622 primary data records. [2025-10-03T22:35:42.385883] [DEBUG] [LOCAL ] BUXX: Loaded 15366 existing records from primary storage. [2025-10-03T22:35:42.405250] [INFO ] [MAIN ] BUXX: Loaded 15366 primary data records. [2025-10-03T22:35:42.413136] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:42.451003] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45747 primary records. [2025-10-03T22:35:42.535734] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-03T22:35:42.734104] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-10-03T22:35:42.750971] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-03T22:35:42.913098] [INFO ] [MAIN ] Derivative Progress: 297/2073 symbols completed. BUR took 1.6s. Estimated remaining: 12m 27s. Rate: 142.7 symbols/min [2025-10-03T22:35:42.924837] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:43.114582] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:43.115517] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:43.116585] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15366 primary records. [2025-10-03T22:35:43.117239] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46622 primary records. [2025-10-03T22:35:43.117402] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-03T22:35:43.117357] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-03T22:35:43.142836] [DEBUG] [LOCAL ] BV: Loaded 38880 existing records from primary storage. [2025-10-03T22:35:43.150441] [INFO ] [MAIN ] BV: Loaded 38880 primary data records. [2025-10-03T22:35:43.164491] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-10-03T22:35:43.183366] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-03T22:35:43.203132] [INFO ] [MAIN ] Derivative Progress: 298/2073 symbols completed. BUXX took 0.9s. Estimated remaining: 12m 25s. Rate: 142.9 symbols/min [2025-10-03T22:35:43.240004] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-10-03T22:35:43.267585] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-03T22:35:43.285965] [INFO ] [MAIN ] Derivative Progress: 299/2073 symbols completed. BURL took 1.3s. Estimated remaining: 12m 23s. Rate: 143.3 symbols/min [2025-10-03T22:35:43.516313] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:43.517152] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 38880 primary records. [2025-10-03T22:35:43.517224] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-03T22:35:43.533674] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-10-03T22:35:43.533830] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-03T22:35:43.536534] [INFO ] [MAIN ] Derivative Progress: 300/2073 symbols completed. BV took 0.6s. Estimated remaining: 12m 22s. Rate: 143.5 symbols/min [2025-10-03T22:35:43.537402] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:43.537300] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:43.537817] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:43.610970] [DEBUG] [LOCAL ] BW: Loaded 40559 existing records from primary storage. [2025-10-03T22:35:43.625136] [INFO ] [MAIN ] BW: Loaded 40559 primary data records. [2025-10-03T22:35:43.670331] [DEBUG] [LOCAL ] BVN: Loaded 44704 existing records from primary storage. [2025-10-03T22:35:43.711935] [DEBUG] [LOCAL ] BWA: Loaded 52955 existing records from primary storage. [2025-10-03T22:35:43.722366] [INFO ] [MAIN ] BVN: Loaded 44704 primary data records. [2025-10-03T22:35:43.735939] [INFO ] [MAIN ] BWA: Loaded 52955 primary data records. [2025-10-03T22:35:44.825158] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:44.826546] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40559 primary records. [2025-10-03T22:35:44.826891] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-03T22:35:44.867314] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-10-03T22:35:44.867618] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:44.868855] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-03T22:35:44.869839] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52955 primary records. [2025-10-03T22:35:44.870018] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-03T22:35:44.872697] [INFO ] [MAIN ] Derivative Progress: 301/2073 symbols completed. BW took 1.3s. Estimated remaining: 12m 27s. Rate: 142.4 symbols/min [2025-10-03T22:35:44.873999] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:44.888744] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:44.903772] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44704 primary records. [2025-10-03T22:35:44.905791] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-03T22:35:44.906165] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-10-03T22:35:44.907394] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-03T22:35:44.910289] [INFO ] [MAIN ] Derivative Progress: 302/2073 symbols completed. BWA took 1.4s. Estimated remaining: 12m 24s. Rate: 142.9 symbols/min [2025-10-03T22:35:44.910673] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:44.934743] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-10-03T22:35:44.934915] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-03T22:35:44.938054] [INFO ] [MAIN ] Derivative Progress: 303/2073 symbols completed. BVN took 1.4s. Estimated remaining: 12m 21s. Rate: 143.3 symbols/min [2025-10-03T22:35:44.944349] [DEBUG] [LOCAL ] BWG: Loaded 12694 existing records from primary storage. [2025-10-03T22:35:44.944038] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:44.944784] [INFO ] [MAIN ] BWG: Loaded 12694 primary data records. [2025-10-03T22:35:45.072927] [DEBUG] [LOCAL ] BWMX: Loaded 7749 existing records from primary storage. [2025-10-03T22:35:45.107758] [INFO ] [MAIN ] BWMX: Loaded 7749 primary data records. [2025-10-03T22:35:45.145580] [DEBUG] [LOCAL ] BWLP: Loaded 32876 existing records from primary storage. [2025-10-03T22:35:45.175799] [INFO ] [MAIN ] BWLP: Loaded 32876 primary data records. [2025-10-03T22:35:46.060478] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:46.061594] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12694 primary records. [2025-10-03T22:35:46.062833] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-03T22:35:46.084406] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-10-03T22:35:46.084861] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-03T22:35:46.087421] [INFO ] [MAIN ] Derivative Progress: 304/2073 symbols completed. BWG took 1.2s. Estimated remaining: 12m 25s. Rate: 142.5 symbols/min [2025-10-03T22:35:46.088457] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:46.112187] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:46.113487] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7749 primary records. [2025-10-03T22:35:46.116870] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-03T22:35:46.117166] [DEBUG] [LOCAL ] BWNB: Loaded 4475 existing records from primary storage. [2025-10-03T22:35:46.131995] [INFO ] [MAIN ] BWNB: Loaded 4475 primary data records. [2025-10-03T22:35:46.147671] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:46.184197] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 32876 primary records. [2025-10-03T22:35:46.192995] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-03T22:35:46.201557] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-10-03T22:35:46.253762] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-03T22:35:46.270377] [INFO ] [MAIN ] Derivative Progress: 305/2073 symbols completed. BWMX took 1.3s. Estimated remaining: 12m 23s. Rate: 142.7 symbols/min [2025-10-03T22:35:46.279956] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:46.289810] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-10-03T22:35:46.295530] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-03T22:35:46.310659] [INFO ] [MAIN ] Derivative Progress: 306/2073 symbols completed. BWLP took 1.4s. Estimated remaining: 12m 21s. Rate: 143.2 symbols/min [2025-10-03T22:35:46.360384] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:46.382531] [DEBUG] [LOCAL ] BWSN: Loaded 5290 existing records from primary storage. [2025-10-03T22:35:46.389705] [INFO ] [MAIN ] BWSN: Loaded 5290 primary data records. [2025-10-03T22:35:46.957038] [DEBUG] [LOCAL ] BWXT: Loaded 47600 existing records from primary storage. [2025-10-03T22:35:46.957699] [INFO ] [MAIN ] BWXT: Loaded 47600 primary data records. [2025-10-03T22:35:47.106917] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:47.108065] [INFO ] [MAIN ] BWNB: Generated 1820 derivative records from 4475 primary records. [2025-10-03T22:35:47.108211] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-03T22:35:47.212934] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1820 records). [2025-10-03T22:35:47.337266] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-03T22:35:47.340619] [INFO ] [MAIN ] Derivative Progress: 307/2073 symbols completed. BWNB took 1.3s. Estimated remaining: 12m 24s. Rate: 142.5 symbols/min [2025-10-03T22:35:47.341315] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:47.360473] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:47.362010] [INFO ] [MAIN ] BWSN: Generated 1819 derivative records from 5290 primary records. [2025-10-03T22:35:47.362517] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-03T22:35:47.385798] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1819 records). [2025-10-03T22:35:47.387685] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-03T22:35:47.390844] [INFO ] [MAIN ] Derivative Progress: 308/2073 symbols completed. BWSN took 1.1s. Estimated remaining: 12m 21s. Rate: 142.9 symbols/min [2025-10-03T22:35:47.391622] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:47.447101] [DEBUG] [LOCAL ] BXC: Loaded 13793 existing records from primary storage. [2025-10-03T22:35:47.448014] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:47.448104] [INFO ] [MAIN ] BXC: Loaded 13793 primary data records. [2025-10-03T22:35:47.449261] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47600 primary records. [2025-10-03T22:35:47.472865] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-03T22:35:47.562807] [DEBUG] [LOCAL ] BX: Loaded 54266 existing records from primary storage. [2025-10-03T22:35:47.591070] [INFO ] [MAIN ] BX: Loaded 54266 primary data records. [2025-10-03T22:35:47.753714] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-10-03T22:35:47.807612] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-03T22:35:47.936704] [INFO ] [MAIN ] Derivative Progress: 309/2073 symbols completed. BWXT took 1.6s. Estimated remaining: 12m 21s. Rate: 142.8 symbols/min [2025-10-03T22:35:47.949090] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:48.208364] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:48.209898] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13793 primary records. [2025-10-03T22:35:48.209981] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-03T22:35:48.259790] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-10-03T22:35:48.260798] [DEBUG] [LOCAL ] BXMT: Loaded 47953 existing records from primary storage. [2025-10-03T22:35:48.259262] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:48.261297] [INFO ] [MAIN ] BXMT: Loaded 47953 primary data records. [2025-10-03T22:35:48.261132] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-03T22:35:48.265461] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54266 primary records. [2025-10-03T22:35:48.264461] [INFO ] [MAIN ] Derivative Progress: 310/2073 symbols completed. BXC took 0.9s. Estimated remaining: 12m 20s. Rate: 142.9 symbols/min [2025-10-03T22:35:48.271137] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:48.277743] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-03T22:35:48.428126] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-10-03T22:35:48.450321] [DEBUG] [LOCAL ] BXMX: Loaded 19909 existing records from primary storage. [2025-10-03T22:35:48.471883] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-03T22:35:48.489346] [INFO ] [MAIN ] Derivative Progress: 311/2073 symbols completed. BX took 1.1s. Estimated remaining: 12m 19s. Rate: 143.1 symbols/min [2025-10-03T22:35:48.486620] [INFO ] [MAIN ] BXMX: Loaded 19909 primary data records. [2025-10-03T22:35:48.564857] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:49.071431] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:49.088737] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47953 primary records. [2025-10-03T22:35:49.089782] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-03T22:35:49.091974] [DEBUG] [LOCAL ] BXP: Loaded 50590 existing records from primary storage. [2025-10-03T22:35:49.092235] [INFO ] [MAIN ] BXP: Loaded 50590 primary data records. [2025-10-03T22:35:49.164110] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-10-03T22:35:49.188277] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-03T22:35:49.209162] [INFO ] [MAIN ] Derivative Progress: 312/2073 symbols completed. BXMT took 1.3s. Estimated remaining: 12m 20s. Rate: 142.7 symbols/min [2025-10-03T22:35:49.228979] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:49.331572] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:49.461808] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19909 primary records. [2025-10-03T22:35:49.462064] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-03T22:35:49.482229] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-10-03T22:35:49.482960] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-03T22:35:49.485752] [INFO ] [MAIN ] Derivative Progress: 313/2073 symbols completed. BXMX took 1.2s. Estimated remaining: 12m 19s. Rate: 142.9 symbols/min [2025-10-03T22:35:49.521507] [DEBUG] [LOCAL ] BXSL: Loaded 48413 existing records from primary storage. [2025-10-03T22:35:49.534255] [INFO ] [MAIN ] BXSL: Loaded 48413 primary data records. [2025-10-03T22:35:49.534803] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:49.535619] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50590 primary records. [2025-10-03T22:35:49.582577] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-03T22:35:49.870345] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-10-03T22:35:49.870507] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-03T22:35:49.873913] [INFO ] [MAIN ] Derivative Progress: 314/2073 symbols completed. BXP took 1.3s. Estimated remaining: 12m 18s. Rate: 142.9 symbols/min [2025-10-03T22:35:49.900100] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:49.900845] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48413 primary records. [2025-10-03T22:35:49.900919] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-03T22:35:49.917762] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-10-03T22:35:49.917912] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-03T22:35:49.920380] [INFO ] [MAIN ] Derivative Progress: 315/2073 symbols completed. BXSL took 0.7s. Estimated remaining: 12m 16s. Rate: 143.3 symbols/min [2025-10-03T22:35:49.920954] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:49.921055] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:49.921121] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:49.937733] [DEBUG] [LOCAL ] BYM: Loaded 12190 existing records from primary storage. [2025-10-03T22:35:49.938003] [INFO ] [MAIN ] BYM: Loaded 12190 primary data records. [2025-10-03T22:35:50.085077] [DEBUG] [LOCAL ] BY: Loaded 21972 existing records from primary storage. [2025-10-03T22:35:50.101472] [INFO ] [MAIN ] BY: Loaded 21972 primary data records. [2025-10-03T22:35:50.327049] [DEBUG] [LOCAL ] BYD: Loaded 45568 existing records from primary storage. [2025-10-03T22:35:50.360374] [INFO ] [MAIN ] BYD: Loaded 45568 primary data records. [2025-10-03T22:35:51.038373] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:51.041214] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12190 primary records. [2025-10-03T22:35:51.042634] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-03T22:35:51.061932] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-10-03T22:35:51.062950] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-03T22:35:51.066462] [INFO ] [MAIN ] Derivative Progress: 316/2073 symbols completed. BYM took 1.1s. Estimated remaining: 12m 19s. Rate: 142.6 symbols/min [2025-10-03T22:35:51.068241] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:51.090544] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:51.091570] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21972 primary records. [2025-10-03T22:35:51.091637] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-03T22:35:51.114015] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-10-03T22:35:51.115281] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-03T22:35:51.118939] [INFO ] [MAIN ] Derivative Progress: 317/2073 symbols completed. BY took 1.2s. Estimated remaining: 12m 17s. Rate: 143.0 symbols/min [2025-10-03T22:35:51.119581] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:51.143012] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:51.143904] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45568 primary records. [2025-10-03T22:35:51.144057] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-03T22:35:51.174337] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-10-03T22:35:51.174592] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-03T22:35:51.177265] [INFO ] [MAIN ] Derivative Progress: 318/2073 symbols completed. BYD took 1.3s. Estimated remaining: 12m 15s. Rate: 143.3 symbols/min [2025-10-03T22:35:51.178879] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:51.178570] [DEBUG] [LOCAL ] BZH: Loaded 32801 existing records from primary storage. [2025-10-03T22:35:51.179823] [INFO ] [MAIN ] BZH: Loaded 32801 primary data records. [2025-10-03T22:35:51.337296] [DEBUG] [LOCAL ] CAAP: Loaded 20340 existing records from primary storage. [2025-10-03T22:35:51.353263] [INFO ] [MAIN ] CAAP: Loaded 20340 primary data records. [2025-10-03T22:35:51.538620] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-03T22:35:51.677740] [INFO ] [MAIN ] C: Loaded 54520 primary data records. [2025-10-03T22:35:52.253063] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:52.254151] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 32801 primary records. [2025-10-03T22:35:52.254731] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-03T22:35:52.275729] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-10-03T22:35:52.276129] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-03T22:35:52.287034] [INFO ] [MAIN ] Derivative Progress: 319/2073 symbols completed. BZH took 1.2s. Estimated remaining: 12m 18s. Rate: 142.6 symbols/min [2025-10-03T22:35:52.293251] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:52.292705] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:52.294292] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20340 primary records. [2025-10-03T22:35:52.294824] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-03T22:35:52.314742] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-10-03T22:35:52.315163] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-03T22:35:52.335207] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:52.334785] [INFO ] [MAIN ] Derivative Progress: 320/2073 symbols completed. CAAP took 1.2s. Estimated remaining: 12m 16s. Rate: 143.0 symbols/min [2025-10-03T22:35:52.336215] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54520 primary records. [2025-10-03T22:35:52.336321] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-03T22:35:52.336461] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:52.358956] [DEBUG] [LOCAL ] CABO: Loaded 17184 existing records from primary storage. [2025-10-03T22:35:52.359841] [INFO ] [MAIN ] CABO: Loaded 17184 primary data records. [2025-10-03T22:35:52.406497] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-10-03T22:35:52.433117] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-03T22:35:52.442747] [INFO ] [MAIN ] Derivative Progress: 321/2073 symbols completed. C took 1.3s. Estimated remaining: 12m 13s. Rate: 143.3 symbols/min [2025-10-03T22:35:52.448093] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:52.691068] [DEBUG] [LOCAL ] CACI: Loaded 24817 existing records from primary storage. [2025-10-03T22:35:52.702810] [INFO ] [MAIN ] CACI: Loaded 24817 primary data records. [2025-10-03T22:35:53.057714] [DEBUG] [LOCAL ] CADE: Loaded 49604 existing records from primary storage. [2025-10-03T22:35:53.058989] [INFO ] [MAIN ] CADE: Loaded 49604 primary data records. [2025-10-03T22:35:53.283944] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:53.481270] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17184 primary records. [2025-10-03T22:35:53.481703] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-03T22:35:53.503120] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-10-03T22:35:53.504050] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-03T22:35:53.507993] [INFO ] [MAIN ] Derivative Progress: 322/2073 symbols completed. CABO took 1.2s. Estimated remaining: 12m 17s. Rate: 142.6 symbols/min [2025-10-03T22:35:53.511404] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:53.529766] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:35:53.530947] [INFO ] [MAIN ] CACI: Generated 1819 derivative records from 24817 primary records. [2025-10-03T22:35:53.531086] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-03T22:35:53.552524] [DEBUG] [LOCAL ] CACI: Derivative data saved (1819 records). [2025-10-03T22:35:53.552919] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-03T22:35:53.556907] [INFO ] [MAIN ] Derivative Progress: 323/2073 symbols completed. CACI took 1.2s. Estimated remaining: 12m 14s. Rate: 143.0 symbols/min [2025-10-03T22:35:53.558721] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:53.594255] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:53.595416] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 49604 primary records. [2025-10-03T22:35:53.595683] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-03T22:35:53.599817] [DEBUG] [LOCAL ] CAF: Loaded 3474 existing records from primary storage. [2025-10-03T22:35:53.600675] [INFO ] [MAIN ] CAF: Loaded 3474 primary data records. [2025-10-03T22:35:53.657622] [DEBUG] [LOCAL ] CAE: Loaded 39676 existing records from primary storage. [2025-10-03T22:35:53.676130] [INFO ] [MAIN ] CAE: Loaded 39676 primary data records. [2025-10-03T22:35:53.908927] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-10-03T22:35:53.995427] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-03T22:35:54.108376] [INFO ] [MAIN ] Derivative Progress: 324/2073 symbols completed. CADE took 1.7s. Estimated remaining: 12m 14s. Rate: 142.9 symbols/min [2025-10-03T22:35:54.108718] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:54.397274] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:54.398384] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3474 primary records. [2025-10-03T22:35:54.414505] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-03T22:35:54.416936] [DEBUG] [LOCAL ] CAG: Loaded 54443 existing records from primary storage. [2025-10-03T22:35:54.425529] [INFO ] [MAIN ] CAG: Loaded 54443 primary data records. [2025-10-03T22:35:54.507812] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:54.524123] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39676 primary records. [2025-10-03T22:35:54.536469] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-03T22:35:54.551393] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-10-03T22:35:54.551513] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-03T22:35:54.566277] [INFO ] [MAIN ] Derivative Progress: 325/2073 symbols completed. CAF took 1.0s. Estimated remaining: 12m 14s. Rate: 142.9 symbols/min [2025-10-03T22:35:54.575528] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:54.676526] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-10-03T22:35:54.676902] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-03T22:35:54.680000] [INFO ] [MAIN ] Derivative Progress: 326/2073 symbols completed. CAE took 1.2s. Estimated remaining: 12m 12s. Rate: 143.2 symbols/min [2025-10-03T22:35:54.797285] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:54.880228] [DEBUG] [LOCAL ] CAH: Loaded 52181 existing records from primary storage. [2025-10-03T22:35:54.880818] [INFO ] [MAIN ] CAH: Loaded 52181 primary data records. [2025-10-03T22:35:54.881212] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:54.888053] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54443 primary records. [2025-10-03T22:35:54.906196] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-03T22:35:55.031480] [DEBUG] [LOCAL ] CAL: Loaded 43747 existing records from primary storage. [2025-10-03T22:35:55.038187] [INFO ] [MAIN ] CAL: Loaded 43747 primary data records. [2025-10-03T22:35:55.362097] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-10-03T22:35:55.383771] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-03T22:35:55.387545] [INFO ] [MAIN ] Derivative Progress: 327/2073 symbols completed. CAG took 1.3s. Estimated remaining: 12m 13s. Rate: 142.9 symbols/min [2025-10-03T22:35:55.398443] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:55.706462] [DEBUG] [LOCAL ] CALX: Loaded 38363 existing records from primary storage. [2025-10-03T22:35:55.716463] [INFO ] [MAIN ] CALX: Loaded 38363 primary data records. [2025-10-03T22:35:55.722876] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:55.741830] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52181 primary records. [2025-10-03T22:35:55.742218] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-03T22:35:55.884777] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-10-03T22:35:55.890278] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-03T22:35:55.898523] [INFO ] [MAIN ] Derivative Progress: 328/2073 symbols completed. CAH took 1.3s. Estimated remaining: 12m 13s. Rate: 142.8 symbols/min [2025-10-03T22:35:55.933416] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:55.965851] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43747 primary records. [2025-10-03T22:35:55.969585] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-03T22:35:56.105948] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-10-03T22:35:56.106115] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-03T22:35:56.109103] [INFO ] [MAIN ] Derivative Progress: 329/2073 symbols completed. CAL took 1.3s. Estimated remaining: 12m 12s. Rate: 143.0 symbols/min [2025-10-03T22:35:56.134280] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:56.135078] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38363 primary records. [2025-10-03T22:35:56.135145] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-03T22:35:56.151490] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-10-03T22:35:56.151606] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-03T22:35:56.154248] [INFO ] [MAIN ] Derivative Progress: 330/2073 symbols completed. CALX took 0.8s. Estimated remaining: 12m 9s. Rate: 143.4 symbols/min [2025-10-03T22:35:56.155018] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:56.154910] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:56.155517] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:56.164876] [DEBUG] [LOCAL ] CAPL: Loaded 5854 existing records from primary storage. [2025-10-03T22:35:56.165049] [INFO ] [MAIN ] CAPL: Loaded 5854 primary data records. [2025-10-03T22:35:56.352043] [DEBUG] [LOCAL ] CANG: Loaded 27426 existing records from primary storage. [2025-10-03T22:35:56.494283] [INFO ] [MAIN ] CANG: Loaded 27426 primary data records. [2025-10-03T22:35:56.664692] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-10-03T22:35:56.669566] [INFO ] [MAIN ] CARR: Loaded 54374 primary data records. [2025-10-03T22:35:57.259860] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:57.263141] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5854 primary records. [2025-10-03T22:35:57.264263] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-03T22:35:57.305738] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:57.307404] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-10-03T22:35:57.307687] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-03T22:35:57.311580] [INFO ] [MAIN ] Derivative Progress: 331/2073 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 13s. Rate: 142.6 symbols/min [2025-10-03T22:35:57.312255] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27426 primary records. [2025-10-03T22:35:57.313696] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-03T22:35:57.313001] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:57.349407] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:57.350965] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54374 primary records. [2025-10-03T22:35:57.351117] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-03T22:35:57.354623] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-10-03T22:35:57.362583] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-03T22:35:57.370177] [INFO ] [MAIN ] Derivative Progress: 332/2073 symbols completed. CANG took 1.2s. Estimated remaining: 12m 11s. Rate: 143.0 symbols/min [2025-10-03T22:35:57.382631] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:57.388632] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-10-03T22:35:57.388911] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-03T22:35:57.391978] [INFO ] [MAIN ] Derivative Progress: 333/2073 symbols completed. CARR took 1.2s. Estimated remaining: 12m 8s. Rate: 143.4 symbols/min [2025-10-03T22:35:57.392481] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:57.407330] [DEBUG] [LOCAL ] CARS: Loaded 40377 existing records from primary storage. [2025-10-03T22:35:57.408122] [INFO ] [MAIN ] CARS: Loaded 40377 primary data records. [2025-10-03T22:35:57.502881] [DEBUG] [LOCAL ] CATO: Loaded 7167 existing records from primary storage. [2025-10-03T22:35:57.516854] [INFO ] [MAIN ] CATO: Loaded 7167 primary data records. [2025-10-03T22:35:58.215738] [DEBUG] [LOCAL ] CAT: Loaded 53696 existing records from primary storage. [2025-10-03T22:35:58.216620] [INFO ] [MAIN ] CAT: Loaded 53696 primary data records. [2025-10-03T22:35:58.622218] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:58.624689] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40377 primary records. [2025-10-03T22:35:58.626493] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-03T22:35:58.656180] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:58.658060] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7167 primary records. [2025-10-03T22:35:58.658173] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-03T22:35:58.675305] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-10-03T22:35:58.677193] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-03T22:35:58.682130] [INFO ] [MAIN ] Derivative Progress: 334/2073 symbols completed. CARS took 1.4s. Estimated remaining: 12m 12s. Rate: 142.5 symbols/min [2025-10-03T22:35:58.683759] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:58.685779] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-10-03T22:35:58.686099] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-03T22:35:58.689478] [INFO ] [MAIN ] Derivative Progress: 335/2073 symbols completed. CATO took 1.3s. Estimated remaining: 12m 10s. Rate: 142.9 symbols/min [2025-10-03T22:35:58.690398] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:58.711500] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:35:58.712369] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53696 primary records. [2025-10-03T22:35:58.712595] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-03T22:35:58.754107] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-10-03T22:35:58.754303] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-03T22:35:58.756838] [INFO ] [MAIN ] Derivative Progress: 336/2073 symbols completed. CAT took 1.4s. Estimated remaining: 12m 7s. Rate: 143.3 symbols/min [2025-10-03T22:35:58.757309] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:35:58.818587] [DEBUG] [LOCAL ] CAVA: Loaded 54332 existing records from primary storage. [2025-10-03T22:35:58.819008] [INFO ] [MAIN ] CAVA: Loaded 54332 primary data records. [2025-10-03T22:35:58.861537] [DEBUG] [LOCAL ] CBAN: Loaded 10995 existing records from primary storage. [2025-10-03T22:35:58.861142] [DEBUG] [LOCAL ] CB: Loaded 50658 existing records from primary storage. [2025-10-03T22:35:58.888105] [INFO ] [MAIN ] CB: Loaded 50658 primary data records. [2025-10-03T22:35:58.888019] [INFO ] [MAIN ] CBAN: Loaded 10995 primary data records. [2025-10-03T22:36:00.040959] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:00.040309] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:00.044576] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54332 primary records. [2025-10-03T22:36:00.045817] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50658 primary records. [2025-10-03T22:36:00.046159] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-03T22:36:00.046889] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-03T22:36:00.064294] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:00.084268] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 10995 primary records. [2025-10-03T22:36:00.084776] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-03T22:36:00.121880] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-10-03T22:36:00.125911] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-03T22:36:00.130081] [INFO ] [MAIN ] Derivative Progress: 337/2073 symbols completed. CAVA took 1.4s. Estimated remaining: 12m 12s. Rate: 142.3 symbols/min [2025-10-03T22:36:00.131352] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:00.125743] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-10-03T22:36:00.134017] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-03T22:36:00.136528] [INFO ] [MAIN ] Derivative Progress: 338/2073 symbols completed. CBAN took 1.4s. Estimated remaining: 12m 9s. Rate: 142.7 symbols/min [2025-10-03T22:36:00.137139] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:00.138795] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-10-03T22:36:00.139614] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-03T22:36:00.142976] [INFO ] [MAIN ] Derivative Progress: 339/2073 symbols completed. CB took 1.5s. Estimated remaining: 12m 7s. Rate: 143.2 symbols/min [2025-10-03T22:36:00.143413] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:00.148729] [DEBUG] [LOCAL ] CBNA: Loaded 2938 existing records from primary storage. [2025-10-03T22:36:00.149255] [INFO ] [MAIN ] CBNA: Loaded 2938 primary data records. [2025-10-03T22:36:00.266829] [DEBUG] [LOCAL ] CBL: Loaded 16471 existing records from primary storage. [2025-10-03T22:36:00.278982] [INFO ] [MAIN ] CBL: Loaded 16471 primary data records. [2025-10-03T22:36:00.739130] [DEBUG] [LOCAL ] CBRE: Loaded 51279 existing records from primary storage. [2025-10-03T22:36:00.865394] [INFO ] [MAIN ] CBRE: Loaded 51279 primary data records. [2025-10-03T22:36:01.240459] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:01.241915] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2938 primary records. [2025-10-03T22:36:01.243786] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-03T22:36:01.274806] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:01.276830] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16471 primary records. [2025-10-03T22:36:01.277321] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-03T22:36:01.294710] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-10-03T22:36:01.295680] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-03T22:36:01.299094] [INFO ] [MAIN ] Derivative Progress: 340/2073 symbols completed. CBNA took 1.2s. Estimated remaining: 12m 10s. Rate: 142.4 symbols/min [2025-10-03T22:36:01.300385] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:01.304674] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-10-03T22:36:01.306475] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-03T22:36:01.311200] [INFO ] [MAIN ] Derivative Progress: 341/2073 symbols completed. CBL took 1.2s. Estimated remaining: 12m 8s. Rate: 142.8 symbols/min [2025-10-03T22:36:01.311525] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:01.329082] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:01.330222] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51279 primary records. [2025-10-03T22:36:01.330490] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-03T22:36:01.364611] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-10-03T22:36:01.364810] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-03T22:36:01.367943] [INFO ] [MAIN ] Derivative Progress: 342/2073 symbols completed. CBRE took 1.2s. Estimated remaining: 12m 5s. Rate: 143.2 symbols/min [2025-10-03T22:36:01.368325] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:01.378841] [DEBUG] [LOCAL ] CBU: Loaded 23000 existing records from primary storage. [2025-10-03T22:36:01.379204] [INFO ] [MAIN ] CBU: Loaded 23000 primary data records. [2025-10-03T22:36:01.438761] [DEBUG] [LOCAL ] CBT: Loaded 31248 existing records from primary storage. [2025-10-03T22:36:01.456323] [INFO ] [MAIN ] CBT: Loaded 31248 primary data records. [2025-10-03T22:36:01.723043] [DEBUG] [LOCAL ] CBZ: Loaded 34222 existing records from primary storage. [2025-10-03T22:36:01.761768] [INFO ] [MAIN ] CBZ: Loaded 34222 primary data records. [2025-10-03T22:36:02.628292] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:02.631106] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23000 primary records. [2025-10-03T22:36:02.631746] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-03T22:36:02.652349] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-10-03T22:36:02.652890] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-03T22:36:02.655621] [INFO ] [MAIN ] Derivative Progress: 343/2073 symbols completed. CBU took 1.3s. Estimated remaining: 12m 9s. Rate: 142.3 symbols/min [2025-10-03T22:36:02.674729] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:02.677238] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34222 primary records. [2025-10-03T22:36:02.677460] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-03T22:36:02.702423] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:02.705950] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31248 primary records. [2025-10-03T22:36:02.708124] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-03T22:36:02.710518] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-10-03T22:36:02.710611] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-03T22:36:02.713832] [INFO ] [MAIN ] Derivative Progress: 344/2073 symbols completed. CBZ took 1.3s. Estimated remaining: 12m 7s. Rate: 142.7 symbols/min [2025-10-03T22:36:02.734294] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-10-03T22:36:02.734428] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-03T22:36:02.738004] [INFO ] [MAIN ] Derivative Progress: 345/2073 symbols completed. CBT took 1.4s. Estimated remaining: 12m 5s. Rate: 143.1 symbols/min [2025-10-03T22:36:02.738755] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:02.738860] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:02.738614] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:02.761972] [DEBUG] [LOCAL ] CCIF: Loaded 15916 existing records from primary storage. [2025-10-03T22:36:02.762166] [INFO ] [MAIN ] CCIF: Loaded 15916 primary data records. [2025-10-03T22:36:03.148029] [DEBUG] [LOCAL ] CC: Loaded 53769 existing records from primary storage. [2025-10-03T22:36:03.148276] [INFO ] [MAIN ] CC: Loaded 53769 primary data records. [2025-10-03T22:36:03.147899] [DEBUG] [LOCAL ] CCI: Loaded 53918 existing records from primary storage. [2025-10-03T22:36:03.148534] [INFO ] [MAIN ] CCI: Loaded 53918 primary data records. [2025-10-03T22:36:03.864020] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:03.865824] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15916 primary records. [2025-10-03T22:36:03.866577] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-03T22:36:03.887302] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-10-03T22:36:03.887553] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-03T22:36:03.890500] [INFO ] [MAIN ] Derivative Progress: 346/2073 symbols completed. CCIF took 1.2s. Estimated remaining: 12m 8s. Rate: 142.4 symbols/min [2025-10-03T22:36:03.891461] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:03.921961] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:03.928551] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53769 primary records. [2025-10-03T22:36:03.928711] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-03T22:36:03.927676] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:03.929361] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53918 primary records. [2025-10-03T22:36:03.929891] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-03T22:36:03.960348] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-10-03T22:36:03.961170] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-03T22:36:03.964066] [INFO ] [MAIN ] Derivative Progress: 347/2073 symbols completed. CCI took 1.2s. Estimated remaining: 12m 6s. Rate: 142.7 symbols/min [2025-10-03T22:36:03.964819] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:03.969528] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-10-03T22:36:03.969717] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-03T22:36:03.972874] [INFO ] [MAIN ] Derivative Progress: 348/2073 symbols completed. CC took 1.2s. Estimated remaining: 12m 3s. Rate: 143.1 symbols/min [2025-10-03T22:36:03.973252] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:04.022690] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-10-03T22:36:04.023027] [INFO ] [MAIN ] CCJ: Loaded 54453 primary data records. [2025-10-03T22:36:04.227461] [DEBUG] [LOCAL ] CCK: Loaded 46844 existing records from primary storage. [2025-10-03T22:36:04.291246] [INFO ] [MAIN ] CCK: Loaded 46844 primary data records. [2025-10-03T22:36:04.434061] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-03T22:36:04.458314] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-10-03T22:36:05.170789] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:05.172891] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54453 primary records. [2025-10-03T22:36:05.173416] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-03T22:36:05.198850] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-10-03T22:36:05.205507] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-03T22:36:05.209351] [INFO ] [MAIN ] Derivative Progress: 349/2073 symbols completed. CCJ took 1.3s. Estimated remaining: 12m 7s. Rate: 142.3 symbols/min [2025-10-03T22:36:05.227826] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:05.230221] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:05.232103] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 46844 primary records. [2025-10-03T22:36:05.232211] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-03T22:36:05.269599] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:05.271527] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-10-03T22:36:05.272410] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-03T22:36:05.301337] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-10-03T22:36:05.298371] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-10-03T22:36:05.301713] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-03T22:36:05.301796] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-03T22:36:05.306023] [INFO ] [MAIN ] Derivative Progress: 350/2073 symbols completed. CCK took 1.3s. Estimated remaining: 12m 5s. Rate: 142.6 symbols/min [2025-10-03T22:36:05.306240] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:05.309018] [INFO ] [MAIN ] Derivative Progress: 351/2073 symbols completed. CCL took 1.3s. Estimated remaining: 12m 2s. Rate: 143.0 symbols/min [2025-10-03T22:36:05.309368] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:05.337223] [DEBUG] [LOCAL ] CCRD: Loaded 9165 existing records from primary storage. [2025-10-03T22:36:05.337414] [INFO ] [MAIN ] CCRD: Loaded 9165 primary data records. [2025-10-03T22:36:05.469461] [DEBUG] [LOCAL ] CCO: Loaded 48625 existing records from primary storage. [2025-10-03T22:36:05.509000] [INFO ] [MAIN ] CCO: Loaded 48625 primary data records. [2025-10-03T22:36:05.569154] [DEBUG] [LOCAL ] CCS: Loaded 30853 existing records from primary storage. [2025-10-03T22:36:05.593753] [INFO ] [MAIN ] CCS: Loaded 30853 primary data records. [2025-10-03T22:36:06.499238] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:06.500927] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9165 primary records. [2025-10-03T22:36:06.501137] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-03T22:36:06.521173] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-10-03T22:36:06.521333] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-03T22:36:06.524210] [INFO ] [MAIN ] Derivative Progress: 352/2073 symbols completed. CCRD took 1.2s. Estimated remaining: 12m 6s. Rate: 142.3 symbols/min [2025-10-03T22:36:06.524759] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:06.545716] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:06.548113] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48625 primary records. [2025-10-03T22:36:06.548535] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-03T22:36:06.585923] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:06.587924] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 30853 primary records. [2025-10-03T22:36:06.588612] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-03T22:36:06.590615] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-10-03T22:36:06.590962] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-03T22:36:06.614275] [INFO ] [MAIN ] Derivative Progress: 353/2073 symbols completed. CCO took 1.4s. Estimated remaining: 12m 4s. Rate: 142.6 symbols/min [2025-10-03T22:36:06.617279] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:06.619635] [DEBUG] [LOCAL ] CCU: Loaded 23444 existing records from primary storage. [2025-10-03T22:36:06.621615] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-10-03T22:36:06.622282] [INFO ] [MAIN ] CCU: Loaded 23444 primary data records. [2025-10-03T22:36:06.622787] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-03T22:36:06.662363] [INFO ] [MAIN ] Derivative Progress: 354/2073 symbols completed. CCS took 1.4s. Estimated remaining: 12m 2s. Rate: 142.9 symbols/min [2025-10-03T22:36:06.680596] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:06.837461] [DEBUG] [LOCAL ] CDLR: Loaded 10028 existing records from primary storage. [2025-10-03T22:36:06.991365] [INFO ] [MAIN ] CDLR: Loaded 10028 primary data records. [2025-10-03T22:36:07.186639] [DEBUG] [LOCAL ] CDE: Loaded 54422 existing records from primary storage. [2025-10-03T22:36:07.244780] [INFO ] [MAIN ] CDE: Loaded 54422 primary data records. [2025-10-03T22:36:07.720076] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:07.736912] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23444 primary records. [2025-10-03T22:36:07.737126] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-03T22:36:07.758307] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-10-03T22:36:07.759751] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-03T22:36:07.762946] [INFO ] [MAIN ] Derivative Progress: 355/2073 symbols completed. CCU took 1.2s. Estimated remaining: 12m 4s. Rate: 142.3 symbols/min [2025-10-03T22:36:07.764010] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:07.787799] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:07.788993] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 10028 primary records. [2025-10-03T22:36:07.789350] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-03T22:36:07.812944] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-10-03T22:36:07.813183] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-03T22:36:07.817013] [INFO ] [MAIN ] Derivative Progress: 356/2073 symbols completed. CDLR took 1.1s. Estimated remaining: 12m 2s. Rate: 142.6 symbols/min [2025-10-03T22:36:07.818163] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:07.844604] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:07.845496] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54422 primary records. [2025-10-03T22:36:07.845729] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-03T22:36:07.883119] [DEBUG] [LOCAL ] CDP: Loaded 43241 existing records from primary storage. [2025-10-03T22:36:07.883988] [INFO ] [MAIN ] CDP: Loaded 43241 primary data records. [2025-10-03T22:36:07.973147] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-10-03T22:36:07.981727] [DEBUG] [LOCAL ] CDRE: Loaded 25295 existing records from primary storage. [2025-10-03T22:36:08.000777] [INFO ] [MAIN ] CDRE: Loaded 25295 primary data records. [2025-10-03T22:36:07.993046] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-03T22:36:08.016760] [INFO ] [MAIN ] Derivative Progress: 357/2073 symbols completed. CDE took 1.4s. Estimated remaining: 12m 1s. Rate: 142.8 symbols/min [2025-10-03T22:36:08.022465] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:08.621615] [DEBUG] [LOCAL ] CE: Loaded 52243 existing records from primary storage. [2025-10-03T22:36:08.623618] [INFO ] [MAIN ] CE: Loaded 52243 primary data records. [2025-10-03T22:36:08.728479] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:08.753391] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43241 primary records. [2025-10-03T22:36:08.766300] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-03T22:36:09.070887] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-10-03T22:36:09.081486] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-03T22:36:09.084791] [INFO ] [MAIN ] Derivative Progress: 358/2073 symbols completed. CDP took 1.3s. Estimated remaining: 12m 3s. Rate: 142.2 symbols/min [2025-10-03T22:36:09.099038] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:09.100716] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25295 primary records. [2025-10-03T22:36:09.100969] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-03T22:36:09.126213] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-10-03T22:36:09.126510] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-03T22:36:09.129297] [INFO ] [MAIN ] Derivative Progress: 359/2073 symbols completed. CDRE took 1.3s. Estimated remaining: 12m 1s. Rate: 142.6 symbols/min [2025-10-03T22:36:09.148469] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:09.149396] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52243 primary records. [2025-10-03T22:36:09.149477] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-03T22:36:09.166909] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-10-03T22:36:09.167043] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-03T22:36:09.169686] [INFO ] [MAIN ] Derivative Progress: 360/2073 symbols completed. CE took 1.1s. Estimated remaining: 11m 59s. Rate: 142.9 symbols/min [2025-10-03T22:36:09.170384] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:09.170289] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:09.170474] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:09.180299] [DEBUG] [LOCAL ] CEE: Loaded 5980 existing records from primary storage. [2025-10-03T22:36:09.180515] [INFO ] [MAIN ] CEE: Loaded 5980 primary data records. [2025-10-03T22:36:09.368909] [DEBUG] [LOCAL ] CEPU: Loaded 26369 existing records from primary storage. [2025-10-03T22:36:09.423230] [INFO ] [MAIN ] CEPU: Loaded 26369 primary data records. [2025-10-03T22:36:09.629626] [DEBUG] [LOCAL ] CF: Loaded 52917 existing records from primary storage. [2025-10-03T22:36:09.652562] [INFO ] [MAIN ] CF: Loaded 52917 primary data records. [2025-10-03T22:36:10.262861] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:10.264103] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 5980 primary records. [2025-10-03T22:36:10.264760] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-03T22:36:10.283411] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-10-03T22:36:10.283620] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-03T22:36:10.286340] [INFO ] [MAIN ] Derivative Progress: 361/2073 symbols completed. CEE took 1.1s. Estimated remaining: 12m 2s. Rate: 142.3 symbols/min [2025-10-03T22:36:10.288237] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:10.306036] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:10.309455] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26369 primary records. [2025-10-03T22:36:10.309755] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-03T22:36:10.335965] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:10.338157] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52917 primary records. [2025-10-03T22:36:10.338269] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-03T22:36:10.342903] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-10-03T22:36:10.343215] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-03T22:36:10.345580] [INFO ] [MAIN ] Derivative Progress: 362/2073 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 60s. Rate: 142.6 symbols/min [2025-10-03T22:36:10.357128] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:10.363722] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-10-03T22:36:10.363864] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-03T22:36:10.367715] [INFO ] [MAIN ] Derivative Progress: 363/2073 symbols completed. CF took 1.2s. Estimated remaining: 11m 57s. Rate: 143.0 symbols/min [2025-10-03T22:36:10.368352] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:10.422929] [DEBUG] [LOCAL ] CFR: Loaded 33593 existing records from primary storage. [2025-10-03T22:36:10.448305] [INFO ] [MAIN ] CFR: Loaded 33593 primary data records. [2025-10-03T22:36:10.455316] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-10-03T22:36:10.483041] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-10-03T22:36:10.625550] [DEBUG] [LOCAL ] CGAU: Loaded 43455 existing records from primary storage. [2025-10-03T22:36:10.668218] [INFO ] [MAIN ] CGAU: Loaded 43455 primary data records. [2025-10-03T22:36:11.570714] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:11.572196] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33593 primary records. [2025-10-03T22:36:11.572448] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-03T22:36:11.571277] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:11.573324] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-10-03T22:36:11.574315] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-03T22:36:11.608581] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-10-03T22:36:11.610612] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-03T22:36:11.614078] [INFO ] [MAIN ] Derivative Progress: 364/2073 symbols completed. CFR took 1.3s. Estimated remaining: 12m 1s. Rate: 142.2 symbols/min [2025-10-03T22:36:11.614917] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:11.629962] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-10-03T22:36:11.630884] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-03T22:36:11.630821] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:11.634276] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43455 primary records. [2025-10-03T22:36:11.634413] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-03T22:36:11.633421] [INFO ] [MAIN ] Derivative Progress: 365/2073 symbols completed. CFG took 1.3s. Estimated remaining: 11m 59s. Rate: 142.6 symbols/min [2025-10-03T22:36:11.634688] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:11.650841] [DEBUG] [LOCAL ] CGV: Loaded 1411 existing records from primary storage. [2025-10-03T22:36:11.651885] [INFO ] [MAIN ] CGV: Loaded 1411 primary data records. [2025-10-03T22:36:11.743946] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-10-03T22:36:11.775077] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-03T22:36:11.804867] [DEBUG] [LOCAL ] CHCT: Loaded 24161 existing records from primary storage. [2025-10-03T22:36:11.812915] [INFO ] [MAIN ] Derivative Progress: 366/2073 symbols completed. CGAU took 1.4s. Estimated remaining: 11m 57s. Rate: 142.8 symbols/min [2025-10-03T22:36:11.868295] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:11.868129] [INFO ] [MAIN ] CHCT: Loaded 24161 primary data records. [2025-10-03T22:36:12.401700] [DEBUG] [LOCAL ] CHD: Loaded 52856 existing records from primary storage. [2025-10-03T22:36:12.417592] [INFO ] [MAIN ] CHD: Loaded 52856 primary data records. [2025-10-03T22:36:12.418015] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:36:12.419361] [INFO ] [MAIN ] CGV: Generated 1819 derivative records from 1411 primary records. [2025-10-03T22:36:12.425057] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-03T22:36:12.588360] [DEBUG] [LOCAL ] CGV: Derivative data saved (1819 records). [2025-10-03T22:36:12.594544] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-03T22:36:12.618610] [INFO ] [MAIN ] Derivative Progress: 367/2073 symbols completed. CGV took 1.0s. Estimated remaining: 11m 58s. Rate: 142.5 symbols/min [2025-10-03T22:36:12.663850] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:12.866544] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:12.869326] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24161 primary records. [2025-10-03T22:36:12.869809] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-03T22:36:12.897088] [DEBUG] [LOCAL ] CHE: Loaded 15300 existing records from primary storage. [2025-10-03T22:36:12.905807] [INFO ] [MAIN ] CHE: Loaded 15300 primary data records. [2025-10-03T22:36:12.905336] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-10-03T22:36:12.906566] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-03T22:36:12.915165] [INFO ] [MAIN ] Derivative Progress: 368/2073 symbols completed. CHCT took 1.3s. Estimated remaining: 11m 57s. Rate: 142.6 symbols/min [2025-10-03T22:36:12.938251] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:13.134492] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:13.152198] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52856 primary records. [2025-10-03T22:36:13.197173] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-03T22:36:13.290315] [DEBUG] [LOCAL ] CHGG: Loaded 48372 existing records from primary storage. [2025-10-03T22:36:13.291159] [INFO ] [MAIN ] CHGG: Loaded 48372 primary data records. [2025-10-03T22:36:13.571279] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-10-03T22:36:13.584781] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-03T22:36:13.593812] [INFO ] [MAIN ] Derivative Progress: 369/2073 symbols completed. CHD took 1.7s. Estimated remaining: 11m 58s. Rate: 142.4 symbols/min [2025-10-03T22:36:13.620938] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:14.004950] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:14.021186] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 15300 primary records. [2025-10-03T22:36:14.021476] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-03T22:36:14.023519] [DEBUG] [LOCAL ] CHH: Loaded 32481 existing records from primary storage. [2025-10-03T22:36:14.035782] [INFO ] [MAIN ] CHH: Loaded 32481 primary data records. [2025-10-03T22:36:14.112574] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-10-03T22:36:14.141405] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-03T22:36:14.154845] [INFO ] [MAIN ] Derivative Progress: 370/2073 symbols completed. CHE took 1.5s. Estimated remaining: 11m 58s. Rate: 142.2 symbols/min [2025-10-03T22:36:14.175101] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:14.405853] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:14.407015] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48372 primary records. [2025-10-03T22:36:14.415508] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-03T22:36:14.417023] [DEBUG] [LOCAL ] CHMI: Loaded 22168 existing records from primary storage. [2025-10-03T22:36:14.418129] [INFO ] [MAIN ] CHMI: Loaded 22168 primary data records. [2025-10-03T22:36:14.614386] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-10-03T22:36:14.753434] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-03T22:36:14.770741] [INFO ] [MAIN ] Derivative Progress: 371/2073 symbols completed. CHGG took 1.8s. Estimated remaining: 11m 59s. Rate: 142.1 symbols/min [2025-10-03T22:36:14.771403] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:14.786583] [DEBUG] [LOCAL ] CHN: Loaded 4866 existing records from primary storage. [2025-10-03T22:36:14.787208] [INFO ] [MAIN ] CHN: Loaded 4866 primary data records. [2025-10-03T22:36:14.813245] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:14.820419] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32481 primary records. [2025-10-03T22:36:14.838789] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-03T22:36:14.947140] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-10-03T22:36:14.952834] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-03T22:36:14.966249] [INFO ] [MAIN ] Derivative Progress: 372/2073 symbols completed. CHH took 1.3s. Estimated remaining: 11m 57s. Rate: 142.3 symbols/min [2025-10-03T22:36:14.989550] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:15.188626] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:15.190206] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22168 primary records. [2025-10-03T22:36:15.190691] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-03T22:36:15.210744] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-10-03T22:36:15.211054] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-03T22:36:15.218948] [INFO ] [MAIN ] Derivative Progress: 373/2073 symbols completed. CHMI took 1.0s. Estimated remaining: 11m 56s. Rate: 142.4 symbols/min [2025-10-03T22:36:15.259295] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:15.260336] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4866 primary records. [2025-10-03T22:36:15.261484] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-03T22:36:15.287935] [DEBUG] [LOCAL ] CHPT: Loaded 49254 existing records from primary storage. [2025-10-03T22:36:15.292400] [INFO ] [MAIN ] CHPT: Loaded 49254 primary data records. [2025-10-03T22:36:15.292281] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-10-03T22:36:15.297961] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-03T22:36:15.329886] [INFO ] [MAIN ] Derivative Progress: 374/2073 symbols completed. CHN took 0.6s. Estimated remaining: 11m 54s. Rate: 142.7 symbols/min [2025-10-03T22:36:15.621614] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:15.622503] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 49254 primary records. [2025-10-03T22:36:15.622575] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-03T22:36:15.639339] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-10-03T22:36:15.639441] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-03T22:36:15.643994] [INFO ] [MAIN ] Derivative Progress: 375/2073 symbols completed. CHPT took 0.7s. Estimated remaining: 11m 54s. Rate: 142.8 symbols/min [2025-10-03T22:36:15.644715] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:15.644782] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:15.644557] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:15.674764] [DEBUG] [LOCAL ] CHT: Loaded 19918 existing records from primary storage. [2025-10-03T22:36:15.674934] [INFO ] [MAIN ] CHT: Loaded 19918 primary data records. [2025-10-03T22:36:15.965542] [DEBUG] [LOCAL ] CI: Loaded 50475 existing records from primary storage. [2025-10-03T22:36:16.106558] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-10-03T22:36:16.106799] [INFO ] [MAIN ] CI: Loaded 50475 primary data records. [2025-10-03T22:36:16.107310] [INFO ] [MAIN ] CHWY: Loaded 54434 primary data records. [2025-10-03T22:36:16.823067] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:16.824538] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19918 primary records. [2025-10-03T22:36:16.824866] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-03T22:36:16.854930] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-10-03T22:36:16.858810] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-03T22:36:16.863916] [INFO ] [MAIN ] Derivative Progress: 376/2073 symbols completed. CHT took 1.2s. Estimated remaining: 11m 57s. Rate: 142.1 symbols/min [2025-10-03T22:36:16.864332] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:16.893053] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:16.894786] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54434 primary records. [2025-10-03T22:36:16.895448] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-03T22:36:16.895230] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:16.897501] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50475 primary records. [2025-10-03T22:36:16.897990] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-03T22:36:16.922752] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-10-03T22:36:16.923007] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-03T22:36:16.930760] [INFO ] [MAIN ] Derivative Progress: 377/2073 symbols completed. CHWY took 1.3s. Estimated remaining: 11m 55s. Rate: 142.4 symbols/min [2025-10-03T22:36:16.931059] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:16.947455] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-10-03T22:36:16.947704] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-03T22:36:16.950088] [INFO ] [MAIN ] Derivative Progress: 378/2073 symbols completed. CI took 1.3s. Estimated remaining: 11m 52s. Rate: 142.7 symbols/min [2025-10-03T22:36:16.950391] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:16.968367] [DEBUG] [LOCAL ] CIB: Loaded 31243 existing records from primary storage. [2025-10-03T22:36:16.968817] [INFO ] [MAIN ] CIB: Loaded 31243 primary data records. [2025-10-03T22:36:16.977488] [DEBUG] [LOCAL ] CIF: Loaded 4246 existing records from primary storage. [2025-10-03T22:36:16.992008] [INFO ] [MAIN ] CIF: Loaded 4246 primary data records. [2025-10-03T22:36:17.388576] [DEBUG] [LOCAL ] CIEN: Loaded 52838 existing records from primary storage. [2025-10-03T22:36:17.548482] [INFO ] [MAIN ] CIEN: Loaded 52838 primary data records. [2025-10-03T22:36:18.101925] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:18.104159] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31243 primary records. [2025-10-03T22:36:18.104605] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-03T22:36:18.133945] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:18.139006] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-10-03T22:36:18.139267] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-03T22:36:18.141795] [INFO ] [MAIN ] Derivative Progress: 379/2073 symbols completed. CIB took 1.3s. Estimated remaining: 11m 55s. Rate: 142.1 symbols/min [2025-10-03T22:36:18.142248] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:18.137439] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4246 primary records. [2025-10-03T22:36:18.142468] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-03T22:36:18.163575] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-10-03T22:36:18.164008] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-03T22:36:18.167496] [INFO ] [MAIN ] Derivative Progress: 380/2073 symbols completed. CIF took 1.2s. Estimated remaining: 11m 53s. Rate: 142.4 symbols/min [2025-10-03T22:36:18.168465] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:18.198757] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:18.199669] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52838 primary records. [2025-10-03T22:36:18.199768] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-03T22:36:18.242024] [DEBUG] [LOCAL ] CII: Loaded 15458 existing records from primary storage. [2025-10-03T22:36:18.243371] [INFO ] [MAIN ] CII: Loaded 15458 primary data records. [2025-10-03T22:36:18.259000] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-10-03T22:36:18.245615] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-03T22:36:18.269083] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-03T22:36:18.269217] [INFO ] [MAIN ] CIG: Loaded 44526 primary data records. [2025-10-03T22:36:18.282603] [INFO ] [MAIN ] Derivative Progress: 381/2073 symbols completed. CIEN took 1.4s. Estimated remaining: 11m 52s. Rate: 142.7 symbols/min [2025-10-03T22:36:18.362364] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:18.946073] [DEBUG] [LOCAL ] CIM: Loaded 38123 existing records from primary storage. [2025-10-03T22:36:18.949488] [INFO ] [MAIN ] CIM: Loaded 38123 primary data records. [2025-10-03T22:36:19.332389] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:19.339289] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44526 primary records. [2025-10-03T22:36:19.338174] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:19.340195] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15458 primary records. [2025-10-03T22:36:19.340364] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-03T22:36:19.340308] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-03T22:36:19.376394] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-10-03T22:36:19.377098] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-03T22:36:19.380278] [INFO ] [MAIN ] Derivative Progress: 382/2073 symbols completed. CIG took 1.2s. Estimated remaining: 11m 54s. Rate: 142.1 symbols/min [2025-10-03T22:36:19.381386] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:19.381460] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-10-03T22:36:19.382155] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-03T22:36:19.384431] [INFO ] [MAIN ] Derivative Progress: 383/2073 symbols completed. CII took 1.2s. Estimated remaining: 11m 52s. Rate: 142.5 symbols/min [2025-10-03T22:36:19.384816] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:19.401012] [DEBUG] [LOCAL ] CIMN: Loaded 2714 existing records from primary storage. [2025-10-03T22:36:19.407699] [INFO ] [MAIN ] CIMN: Loaded 2714 primary data records. [2025-10-03T22:36:19.421064] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:19.464023] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 38123 primary records. [2025-10-03T22:36:19.493959] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-03T22:36:19.569521] [DEBUG] [LOCAL ] CINT: Loaded 19081 existing records from primary storage. [2025-10-03T22:36:19.582381] [INFO ] [MAIN ] CINT: Loaded 19081 primary data records. [2025-10-03T22:36:19.623429] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-10-03T22:36:19.684696] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-03T22:36:19.886946] [INFO ] [MAIN ] Derivative Progress: 384/2073 symbols completed. CIM took 1.5s. Estimated remaining: 11m 52s. Rate: 142.4 symbols/min [2025-10-03T22:36:19.902977] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:20.153020] [DEBUG] [LOCAL ] CIO: Loaded 20752 existing records from primary storage. [2025-10-03T22:36:20.153338] [INFO ] [MAIN ] CIO: Loaded 20752 primary data records. [2025-10-03T22:36:20.568480] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:36:20.569503] [INFO ] [MAIN ] CIMN: Generated 1818 derivative records from 2714 primary records. [2025-10-03T22:36:20.569799] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-03T22:36:20.588902] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1818 records). [2025-10-03T22:36:20.589409] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-03T22:36:20.592618] [INFO ] [MAIN ] Derivative Progress: 385/2073 symbols completed. CIMN took 1.2s. Estimated remaining: 11m 53s. Rate: 142.1 symbols/min [2025-10-03T22:36:20.595581] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:20.613586] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:20.615114] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 19081 primary records. [2025-10-03T22:36:20.615388] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-03T22:36:20.638606] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-10-03T22:36:20.640586] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-03T22:36:20.653502] [INFO ] [MAIN ] Derivative Progress: 386/2073 symbols completed. CINT took 1.3s. Estimated remaining: 11m 51s. Rate: 142.4 symbols/min [2025-10-03T22:36:20.654305] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:20.669050] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:20.669905] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20752 primary records. [2025-10-03T22:36:20.670133] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-03T22:36:20.701048] [DEBUG] [LOCAL ] CION: Loaded 29192 existing records from primary storage. [2025-10-03T22:36:20.701483] [INFO ] [MAIN ] CION: Loaded 29192 primary data records. [2025-10-03T22:36:20.724039] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-10-03T22:36:20.777730] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-03T22:36:20.810512] [INFO ] [MAIN ] Derivative Progress: 387/2073 symbols completed. CIO took 0.9s. Estimated remaining: 11m 49s. Rate: 142.7 symbols/min [2025-10-03T22:36:20.837352] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:21.113570] [DEBUG] [LOCAL ] CIVI: Loaded 53365 existing records from primary storage. [2025-10-03T22:36:21.113939] [INFO ] [MAIN ] CIVI: Loaded 53365 primary data records. [2025-10-03T22:36:21.404689] [DEBUG] [LOCAL ] CL: Loaded 54425 existing records from primary storage. [2025-10-03T22:36:21.405018] [INFO ] [MAIN ] CL: Loaded 54425 primary data records. [2025-10-03T22:36:21.692835] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:21.753333] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29192 primary records. [2025-10-03T22:36:21.884554] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-03T22:36:21.924274] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:21.924938] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-10-03T22:36:21.925825] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53365 primary records. [2025-10-03T22:36:21.926317] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-03T22:36:21.927760] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-03T22:36:21.943425] [INFO ] [MAIN ] Derivative Progress: 388/2073 symbols completed. CION took 1.3s. Estimated remaining: 11m 52s. Rate: 142.1 symbols/min [2025-10-03T22:36:21.949282] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-10-03T22:36:21.949485] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-03T22:36:21.952576] [INFO ] [MAIN ] Derivative Progress: 389/2073 symbols completed. CIVI took 1.3s. Estimated remaining: 11m 49s. Rate: 142.4 symbols/min [2025-10-03T22:36:21.976559] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:21.977491] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54425 primary records. [2025-10-03T22:36:21.977569] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-03T22:36:21.995403] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-10-03T22:36:21.995526] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-03T22:36:21.998284] [INFO ] [MAIN ] Derivative Progress: 390/2073 symbols completed. CL took 1.2s. Estimated remaining: 11m 47s. Rate: 142.7 symbols/min [2025-10-03T22:36:21.998825] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:21.999068] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:21.998968] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:22.021312] [DEBUG] [LOCAL ] CLCO: Loaded 13025 existing records from primary storage. [2025-10-03T22:36:22.021592] [INFO ] [MAIN ] CLCO: Loaded 13025 primary data records. [2025-10-03T22:36:22.176307] [DEBUG] [LOCAL ] CLB: Loaded 33416 existing records from primary storage. [2025-10-03T22:36:22.192894] [DEBUG] [LOCAL ] CLDT: Loaded 25759 existing records from primary storage. [2025-10-03T22:36:22.203334] [INFO ] [MAIN ] CLDT: Loaded 25759 primary data records. [2025-10-03T22:36:22.192978] [INFO ] [MAIN ] CLB: Loaded 33416 primary data records. [2025-10-03T22:36:23.100234] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:23.103245] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13025 primary records. [2025-10-03T22:36:23.106060] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-03T22:36:23.142599] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:23.144275] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-10-03T22:36:23.144458] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-03T22:36:23.147507] [INFO ] [MAIN ] Derivative Progress: 391/2073 symbols completed. CLCO took 1.1s. Estimated remaining: 11m 50s. Rate: 142.1 symbols/min [2025-10-03T22:36:23.148063] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:23.149231] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 25759 primary records. [2025-10-03T22:36:23.150268] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-03T22:36:23.185016] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:23.186393] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33416 primary records. [2025-10-03T22:36:23.187908] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-03T22:36:23.188761] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-10-03T22:36:23.188847] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-03T22:36:23.192158] [INFO ] [MAIN ] Derivative Progress: 392/2073 symbols completed. CLDT took 1.2s. Estimated remaining: 11m 48s. Rate: 142.4 symbols/min [2025-10-03T22:36:23.199773] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:23.218248] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-10-03T22:36:23.227171] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-03T22:36:23.230918] [INFO ] [MAIN ] Derivative Progress: 393/2073 symbols completed. CLB took 1.2s. Estimated remaining: 11m 46s. Rate: 142.8 symbols/min [2025-10-03T22:36:23.231113] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:23.232104] [DEBUG] [LOCAL ] CLH: Loaded 28188 existing records from primary storage. [2025-10-03T22:36:23.234741] [INFO ] [MAIN ] CLH: Loaded 28188 primary data records. [2025-10-03T22:36:23.299323] [DEBUG] [LOCAL ] CLPR: Loaded 11502 existing records from primary storage. [2025-10-03T22:36:23.326922] [INFO ] [MAIN ] CLPR: Loaded 11502 primary data records. [2025-10-03T22:36:23.822242] [DEBUG] [LOCAL ] CLS: Loaded 54389 existing records from primary storage. [2025-10-03T22:36:23.941919] [INFO ] [MAIN ] CLS: Loaded 54389 primary data records. [2025-10-03T22:36:24.344756] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:24.346721] [INFO ] [MAIN ] CLH: Generated 1820 derivative records from 28188 primary records. [2025-10-03T22:36:24.347388] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-03T22:36:24.386726] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:24.386294] [DEBUG] [LOCAL ] CLH: Derivative data saved (1820 records). [2025-10-03T22:36:24.388235] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11502 primary records. [2025-10-03T22:36:24.388504] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-03T22:36:24.388765] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-03T22:36:24.392382] [INFO ] [MAIN ] Derivative Progress: 394/2073 symbols completed. CLH took 1.2s. Estimated remaining: 11m 49s. Rate: 142.1 symbols/min [2025-10-03T22:36:24.393739] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:24.413158] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-10-03T22:36:24.413309] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-03T22:36:24.416242] [INFO ] [MAIN ] Derivative Progress: 395/2073 symbols completed. CLPR took 1.2s. Estimated remaining: 11m 47s. Rate: 142.5 symbols/min [2025-10-03T22:36:24.416494] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:24.446797] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:24.447793] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54389 primary records. [2025-10-03T22:36:24.447919] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-03T22:36:24.485428] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-10-03T22:36:24.485753] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-03T22:36:24.489219] [INFO ] [MAIN ] Derivative Progress: 396/2073 symbols completed. CLS took 1.3s. Estimated remaining: 11m 45s. Rate: 142.8 symbols/min [2025-10-03T22:36:24.489770] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:24.524311] [DEBUG] [LOCAL ] CLVT: Loaded 52720 existing records from primary storage. [2025-10-03T22:36:24.524761] [INFO ] [MAIN ] CLVT: Loaded 52720 primary data records. [2025-10-03T22:36:24.659216] [DEBUG] [LOCAL ] CLX: Loaded 52222 existing records from primary storage. [2025-10-03T22:36:24.659633] [INFO ] [MAIN ] CLX: Loaded 52222 primary data records. [2025-10-03T22:36:25.078147] [DEBUG] [LOCAL ] CM: Loaded 49298 existing records from primary storage. [2025-10-03T22:36:25.099493] [INFO ] [MAIN ] CM: Loaded 49298 primary data records. [2025-10-03T22:36:25.675697] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:25.677125] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52720 primary records. [2025-10-03T22:36:25.677403] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-03T22:36:25.701152] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-10-03T22:36:25.701604] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-03T22:36:25.718736] [INFO ] [MAIN ] Derivative Progress: 397/2073 symbols completed. CLVT took 1.3s. Estimated remaining: 11m 48s. Rate: 142.1 symbols/min [2025-10-03T22:36:25.720315] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:25.722044] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:25.721817] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52222 primary records. [2025-10-03T22:36:25.722485] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-03T22:36:25.763120] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-10-03T22:36:25.763608] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-03T22:36:25.763983] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:25.768425] [INFO ] [MAIN ] Derivative Progress: 398/2073 symbols completed. CLX took 1.4s. Estimated remaining: 11m 46s. Rate: 142.4 symbols/min [2025-10-03T22:36:25.769737] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49298 primary records. [2025-10-03T22:36:25.769956] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-03T22:36:25.770151] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:25.789473] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-10-03T22:36:25.789784] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-03T22:36:25.793097] [INFO ] [MAIN ] Derivative Progress: 399/2073 symbols completed. CM took 1.3s. Estimated remaining: 11m 44s. Rate: 142.7 symbols/min [2025-10-03T22:36:25.813446] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:25.825683] [DEBUG] [LOCAL ] CMBT: Loaded 24208 existing records from primary storage. [2025-10-03T22:36:25.826596] [INFO ] [MAIN ] CMBT: Loaded 24208 primary data records. [2025-10-03T22:36:25.927911] [DEBUG] [LOCAL ] CMA: Loaded 50603 existing records from primary storage. [2025-10-03T22:36:25.946974] [INFO ] [MAIN ] CMA: Loaded 50603 primary data records. [2025-10-03T22:36:26.340888] [DEBUG] [LOCAL ] CMC: Loaded 46192 existing records from primary storage. [2025-10-03T22:36:26.373583] [INFO ] [MAIN ] CMC: Loaded 46192 primary data records. [2025-10-03T22:36:26.938704] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:26.941544] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 24208 primary records. [2025-10-03T22:36:26.945348] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-03T22:36:26.971973] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:26.978276] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50603 primary records. [2025-10-03T22:36:26.979439] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-03T22:36:27.003118] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-10-03T22:36:27.004379] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-03T22:36:27.007799] [INFO ] [MAIN ] Derivative Progress: 400/2073 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 47s. Rate: 142.1 symbols/min [2025-10-03T22:36:27.008041] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:27.004921] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-10-03T22:36:27.010029] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-03T22:36:27.014226] [INFO ] [MAIN ] Derivative Progress: 401/2073 symbols completed. CMA took 1.3s. Estimated remaining: 11m 44s. Rate: 142.4 symbols/min [2025-10-03T22:36:27.014571] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:27.036514] [DEBUG] [LOCAL ] CMCM: Loaded 4794 existing records from primary storage. [2025-10-03T22:36:27.043076] [INFO ] [MAIN ] CMCM: Loaded 4794 primary data records. [2025-10-03T22:36:27.049271] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:27.084394] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46192 primary records. [2025-10-03T22:36:27.111382] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-03T22:36:27.262435] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-10-03T22:36:27.268282] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-03T22:36:27.379441] [INFO ] [MAIN ] Derivative Progress: 402/2073 symbols completed. CMC took 1.6s. Estimated remaining: 11m 44s. Rate: 142.5 symbols/min [2025-10-03T22:36:27.388379] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:27.417263] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-10-03T22:36:27.418281] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-10-03T22:36:27.781149] [DEBUG] [LOCAL ] CMI: Loaded 42360 existing records from primary storage. [2025-10-03T22:36:27.781749] [INFO ] [MAIN ] CMI: Loaded 42360 primary data records. [2025-10-03T22:36:27.835267] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:27.888391] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4794 primary records. [2025-10-03T22:36:27.901004] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-03T22:36:28.009283] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-10-03T22:36:28.017213] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-03T22:36:28.133733] [INFO ] [MAIN ] Derivative Progress: 403/2073 symbols completed. CMCM took 1.1s. Estimated remaining: 11m 45s. Rate: 142.2 symbols/min [2025-10-03T22:36:28.166391] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:28.167345] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-10-03T22:36:28.167591] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-03T22:36:28.186356] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-10-03T22:36:28.186638] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-03T22:36:28.193680] [INFO ] [MAIN ] Derivative Progress: 404/2073 symbols completed. CMG took 1.2s. Estimated remaining: 11m 43s. Rate: 142.5 symbols/min [2025-10-03T22:36:28.212114] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:28.213134] [INFO ] [MAIN ] CMI: Generated 1820 derivative records from 42360 primary records. [2025-10-03T22:36:28.213206] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-03T22:36:28.230360] [DEBUG] [LOCAL ] CMI: Derivative data saved (1820 records). [2025-10-03T22:36:28.230456] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-03T22:36:28.233840] [INFO ] [MAIN ] Derivative Progress: 405/2073 symbols completed. CMI took 0.8s. Estimated remaining: 11m 41s. Rate: 142.8 symbols/min [2025-10-03T22:36:28.234335] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:28.234491] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:28.234433] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:28.307256] [DEBUG] [LOCAL ] CMPO: Loaded 39703 existing records from primary storage. [2025-10-03T22:36:28.320076] [INFO ] [MAIN ] CMPO: Loaded 39703 primary data records. [2025-10-03T22:36:28.308474] [DEBUG] [LOCAL ] CMP: Loaded 36601 existing records from primary storage. [2025-10-03T22:36:28.320744] [INFO ] [MAIN ] CMP: Loaded 36601 primary data records. [2025-10-03T22:36:28.353187] [DEBUG] [LOCAL ] CMRE: Loaded 35928 existing records from primary storage. [2025-10-03T22:36:28.398858] [INFO ] [MAIN ] CMRE: Loaded 35928 primary data records. [2025-10-03T22:36:29.443777] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:29.445870] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 39703 primary records. [2025-10-03T22:36:29.446012] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-03T22:36:29.497478] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-10-03T22:36:29.498274] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-03T22:36:29.498812] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:29.502431] [INFO ] [MAIN ] Derivative Progress: 406/2073 symbols completed. CMPO took 1.3s. Estimated remaining: 11m 44s. Rate: 142.1 symbols/min [2025-10-03T22:36:29.503263] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:29.503002] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:29.505404] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36601 primary records. [2025-10-03T22:36:29.506525] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 35928 primary records. [2025-10-03T22:36:29.506784] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-03T22:36:29.506693] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-03T22:36:29.544200] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-10-03T22:36:29.546634] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-03T22:36:29.546380] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-10-03T22:36:29.549716] [INFO ] [MAIN ] Derivative Progress: 407/2073 symbols completed. CMRE took 1.3s. Estimated remaining: 11m 42s. Rate: 142.4 symbols/min [2025-10-03T22:36:29.550269] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:29.550128] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-03T22:36:29.553867] [INFO ] [MAIN ] Derivative Progress: 408/2073 symbols completed. CMP took 1.3s. Estimated remaining: 11m 40s. Rate: 142.8 symbols/min [2025-10-03T22:36:29.554855] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:29.569155] [DEBUG] [LOCAL ] CMSA: Loaded 3544 existing records from primary storage. [2025-10-03T22:36:29.569476] [INFO ] [MAIN ] CMSA: Loaded 3544 primary data records. [2025-10-03T22:36:29.618184] [DEBUG] [LOCAL ] CMSC: Loaded 5138 existing records from primary storage. [2025-10-03T22:36:29.661113] [INFO ] [MAIN ] CMSC: Loaded 5138 primary data records. [2025-10-03T22:36:29.904964] [DEBUG] [LOCAL ] CMS: Loaded 53374 existing records from primary storage. [2025-10-03T22:36:29.946666] [INFO ] [MAIN ] CMS: Loaded 53374 primary data records. [2025-10-03T22:36:30.645053] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:30.646056] [INFO ] [MAIN ] CMSA: Generated 1820 derivative records from 3544 primary records. [2025-10-03T22:36:30.646396] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-03T22:36:30.664517] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1820 records). [2025-10-03T22:36:30.665159] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-03T22:36:30.667504] [INFO ] [MAIN ] Derivative Progress: 409/2073 symbols completed. CMSA took 1.1s. Estimated remaining: 11m 42s. Rate: 142.2 symbols/min [2025-10-03T22:36:30.667802] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:30.689890] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:30.695821] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5138 primary records. [2025-10-03T22:36:30.696540] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-03T22:36:30.724057] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:30.732750] [DEBUG] [LOCAL ] CMSD: Loaded 8171 existing records from primary storage. [2025-10-03T22:36:30.733140] [INFO ] [MAIN ] CMSD: Loaded 8171 primary data records. [2025-10-03T22:36:30.739190] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53374 primary records. [2025-10-03T22:36:30.757132] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-03T22:36:30.850254] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-10-03T22:36:30.858862] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-03T22:36:30.863003] [INFO ] [MAIN ] Derivative Progress: 410/2073 symbols completed. CMSC took 1.3s. Estimated remaining: 11m 41s. Rate: 142.4 symbols/min [2025-10-03T22:36:30.874315] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:30.947963] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-10-03T22:36:31.067445] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-03T22:36:31.071089] [INFO ] [MAIN ] Derivative Progress: 411/2073 symbols completed. CMS took 1.6s. Estimated remaining: 11m 40s. Rate: 142.5 symbols/min [2025-10-03T22:36:31.071635] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:31.095599] [DEBUG] [LOCAL ] CMU: Loaded 6911 existing records from primary storage. [2025-10-03T22:36:31.095801] [INFO ] [MAIN ] CMU: Loaded 6911 primary data records. [2025-10-03T22:36:31.232114] [DEBUG] [LOCAL ] CMTG: Loaded 37256 existing records from primary storage. [2025-10-03T22:36:31.237286] [INFO ] [MAIN ] CMTG: Loaded 37256 primary data records. [2025-10-03T22:36:31.569811] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:31.607782] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8171 primary records. [2025-10-03T22:36:31.619411] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-03T22:36:31.736400] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-10-03T22:36:31.736553] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-03T22:36:31.739586] [INFO ] [MAIN ] Derivative Progress: 412/2073 symbols completed. CMSD took 1.1s. Estimated remaining: 11m 40s. Rate: 142.3 symbols/min [2025-10-03T22:36:31.740050] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:31.893849] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:31.894829] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 6911 primary records. [2025-10-03T22:36:31.895047] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-03T22:36:31.932154] [DEBUG] [LOCAL ] CNA: Loaded 33259 existing records from primary storage. [2025-10-03T22:36:31.934448] [INFO ] [MAIN ] CNA: Loaded 33259 primary data records. [2025-10-03T22:36:31.934328] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-10-03T22:36:31.940781] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-03T22:36:31.961491] [INFO ] [MAIN ] Derivative Progress: 413/2073 symbols completed. CMU took 0.9s. Estimated remaining: 11m 39s. Rate: 142.5 symbols/min [2025-10-03T22:36:32.031721] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:32.050747] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 37256 primary records. [2025-10-03T22:36:32.025950] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:32.070785] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-03T22:36:32.151766] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-10-03T22:36:32.173691] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-03T22:36:32.303345] [INFO ] [MAIN ] Derivative Progress: 414/2073 symbols completed. CMTG took 1.4s. Estimated remaining: 11m 38s. Rate: 142.6 symbols/min [2025-10-03T22:36:32.304810] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:32.365790] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:32.367307] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-10-03T22:36:32.367557] [INFO ] [MAIN ] CNC: Loaded 54518 primary data records. [2025-10-03T22:36:32.368516] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33259 primary records. [2025-10-03T22:36:32.369087] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-03T22:36:32.480184] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-10-03T22:36:32.496070] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-03T22:36:32.500541] [INFO ] [MAIN ] Derivative Progress: 415/2073 symbols completed. CNA took 0.8s. Estimated remaining: 11m 37s. Rate: 142.7 symbols/min [2025-10-03T22:36:32.514674] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:32.565100] [DEBUG] [LOCAL ] CNH: Loaded 54333 existing records from primary storage. [2025-10-03T22:36:32.571339] [INFO ] [MAIN ] CNH: Loaded 54333 primary data records. [2025-10-03T22:36:33.008708] [DEBUG] [LOCAL ] CNI: Loaded 52388 existing records from primary storage. [2025-10-03T22:36:33.015619] [INFO ] [MAIN ] CNI: Loaded 52388 primary data records. [2025-10-03T22:36:33.551059] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:33.552008] [INFO ] [MAIN ] CNC: Generated 1820 derivative records from 54518 primary records. [2025-10-03T22:36:33.552399] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-03T22:36:33.589495] [DEBUG] [LOCAL ] CNC: Derivative data saved (1820 records). [2025-10-03T22:36:33.590063] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-03T22:36:33.594194] [INFO ] [MAIN ] Derivative Progress: 416/2073 symbols completed. CNC took 1.6s. Estimated remaining: 11m 39s. Rate: 142.2 symbols/min [2025-10-03T22:36:33.591026] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:33.595699] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:33.596565] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54333 primary records. [2025-10-03T22:36:33.597694] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-03T22:36:33.616078] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-10-03T22:36:33.616411] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-03T22:36:33.619632] [INFO ] [MAIN ] Derivative Progress: 417/2073 symbols completed. CNH took 1.3s. Estimated remaining: 11m 37s. Rate: 142.5 symbols/min [2025-10-03T22:36:33.620187] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:33.641966] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:33.643179] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52388 primary records. [2025-10-03T22:36:33.643355] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-03T22:36:33.666830] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-10-03T22:36:33.667052] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-03T22:36:33.670021] [INFO ] [MAIN ] Derivative Progress: 418/2073 symbols completed. CNI took 1.2s. Estimated remaining: 11m 35s. Rate: 142.8 symbols/min [2025-10-03T22:36:33.738354] [DEBUG] [LOCAL ] CNK: Loaded 53649 existing records from primary storage. [2025-10-03T22:36:33.739382] [INFO ] [MAIN ] CNK: Loaded 53649 primary data records. [2025-10-03T22:36:33.739271] [DEBUG] [LOCAL ] CNM: Loaded 51723 existing records from primary storage. [2025-10-03T22:36:33.772444] [INFO ] [MAIN ] CNM: Loaded 51723 primary data records. [2025-10-03T22:36:34.495633] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:34.497916] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51723 primary records. [2025-10-03T22:36:34.499080] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-03T22:36:34.527572] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:34.532074] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53649 primary records. [2025-10-03T22:36:34.531046] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-10-03T22:36:34.532245] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-03T22:36:34.532366] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-03T22:36:34.535359] [INFO ] [MAIN ] Derivative Progress: 419/2073 symbols completed. CNM took 0.9s. Estimated remaining: 11m 37s. Rate: 142.5 symbols/min [2025-10-03T22:36:34.552114] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-10-03T22:36:34.552192] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-03T22:36:34.555938] [INFO ] [MAIN ] Derivative Progress: 420/2073 symbols completed. CNK took 1.0s. Estimated remaining: 11m 35s. Rate: 142.8 symbols/min [2025-10-03T22:36:34.556571] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:34.556813] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:34.557245] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:34.616207] [DEBUG] [LOCAL ] CNMD: Loaded 32705 existing records from primary storage. [2025-10-03T22:36:34.617089] [DEBUG] [LOCAL ] CNNE: Loaded 36931 existing records from primary storage. [2025-10-03T22:36:34.629761] [INFO ] [MAIN ] CNMD: Loaded 32705 primary data records. [2025-10-03T22:36:34.630092] [INFO ] [MAIN ] CNNE: Loaded 36931 primary data records. [2025-10-03T22:36:34.871487] [DEBUG] [LOCAL ] CNO: Loaded 41722 existing records from primary storage. [2025-10-03T22:36:34.896986] [INFO ] [MAIN ] CNO: Loaded 41722 primary data records. [2025-10-03T22:36:35.782717] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:35.784349] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32705 primary records. [2025-10-03T22:36:35.784589] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-03T22:36:35.799568] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:35.800529] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 36931 primary records. [2025-10-03T22:36:35.808123] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-03T22:36:35.831856] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-10-03T22:36:35.831992] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-03T22:36:35.836073] [INFO ] [MAIN ] Derivative Progress: 421/2073 symbols completed. CNMD took 1.3s. Estimated remaining: 11m 38s. Rate: 142.1 symbols/min [2025-10-03T22:36:35.837954] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:35.853635] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-10-03T22:36:35.853924] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-03T22:36:35.856912] [INFO ] [MAIN ] Derivative Progress: 422/2073 symbols completed. CNNE took 1.3s. Estimated remaining: 11m 36s. Rate: 142.4 symbols/min [2025-10-03T22:36:35.857078] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:35.854383] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:35.858747] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41722 primary records. [2025-10-03T22:36:35.858853] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-03T22:36:35.877832] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-10-03T22:36:35.878042] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-03T22:36:35.881036] [INFO ] [MAIN ] Derivative Progress: 423/2073 symbols completed. CNO took 1.3s. Estimated remaining: 11m 34s. Rate: 142.7 symbols/min [2025-10-03T22:36:35.881378] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:35.972522] [DEBUG] [LOCAL ] CNP: Loaded 54248 existing records from primary storage. [2025-10-03T22:36:35.974417] [INFO ] [MAIN ] CNP: Loaded 54248 primary data records. [2025-10-03T22:36:35.997583] [DEBUG] [LOCAL ] CNQ: Loaded 54359 existing records from primary storage. [2025-10-03T22:36:36.058557] [INFO ] [MAIN ] CNQ: Loaded 54359 primary data records. [2025-10-03T22:36:36.077590] [DEBUG] [LOCAL ] CNX: Loaded 52109 existing records from primary storage. [2025-10-03T22:36:36.118953] [INFO ] [MAIN ] CNX: Loaded 52109 primary data records. [2025-10-03T22:36:36.991765] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:36.993030] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54248 primary records. [2025-10-03T22:36:36.993135] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-03T22:36:37.020370] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:37.024154] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54359 primary records. [2025-10-03T22:36:37.024431] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-03T22:36:37.047690] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:37.052571] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-10-03T22:36:37.058042] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52109 primary records. [2025-10-03T22:36:37.058992] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-03T22:36:37.058258] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-03T22:36:37.063507] [INFO ] [MAIN ] Derivative Progress: 424/2073 symbols completed. CNP took 1.2s. Estimated remaining: 11m 36s. Rate: 142.1 symbols/min [2025-10-03T22:36:37.064488] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:37.083243] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-10-03T22:36:37.084108] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-03T22:36:37.087361] [INFO ] [MAIN ] Derivative Progress: 425/2073 symbols completed. CNQ took 1.2s. Estimated remaining: 11m 34s. Rate: 142.4 symbols/min [2025-10-03T22:36:37.089848] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-10-03T22:36:37.090006] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-03T22:36:37.089606] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:37.092993] [INFO ] [MAIN ] Derivative Progress: 426/2073 symbols completed. CNX took 1.2s. Estimated remaining: 11m 32s. Rate: 142.8 symbols/min [2025-10-03T22:36:37.093352] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:37.155253] [DEBUG] [LOCAL ] CODI: Loaded 40570 existing records from primary storage. [2025-10-03T22:36:37.155440] [INFO ] [MAIN ] CODI: Loaded 40570 primary data records. [2025-10-03T22:36:37.327023] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-10-03T22:36:37.359948] [INFO ] [MAIN ] COF: Loaded 54389 primary data records. [2025-10-03T22:36:37.446946] [DEBUG] [LOCAL ] COHR: Loaded 54136 existing records from primary storage. [2025-10-03T22:36:37.602607] [INFO ] [MAIN ] COHR: Loaded 54136 primary data records. [2025-10-03T22:36:38.256286] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:38.257838] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40570 primary records. [2025-10-03T22:36:38.258146] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-03T22:36:38.292170] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:38.294526] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54389 primary records. [2025-10-03T22:36:38.295234] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-03T22:36:38.294695] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-10-03T22:36:38.296563] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-03T22:36:38.299316] [INFO ] [MAIN ] Derivative Progress: 427/2073 symbols completed. CODI took 1.2s. Estimated remaining: 11m 35s. Rate: 142.2 symbols/min [2025-10-03T22:36:38.299935] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:38.328552] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:38.333590] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54136 primary records. [2025-10-03T22:36:38.334319] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-03T22:36:38.336315] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-10-03T22:36:38.336594] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-03T22:36:38.346885] [INFO ] [MAIN ] Derivative Progress: 428/2073 symbols completed. COF took 1.3s. Estimated remaining: 11m 33s. Rate: 142.4 symbols/min [2025-10-03T22:36:38.347167] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:38.356143] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-10-03T22:36:38.356213] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-03T22:36:38.359889] [INFO ] [MAIN ] Derivative Progress: 429/2073 symbols completed. COHR took 1.3s. Estimated remaining: 11m 31s. Rate: 142.8 symbols/min [2025-10-03T22:36:38.360082] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:38.433416] [DEBUG] [LOCAL ] COLD: Loaded 52854 existing records from primary storage. [2025-10-03T22:36:38.444750] [INFO ] [MAIN ] COLD: Loaded 52854 primary data records. [2025-10-03T22:36:38.456990] [DEBUG] [LOCAL ] CON: Loaded 39417 existing records from primary storage. [2025-10-03T22:36:38.488999] [INFO ] [MAIN ] CON: Loaded 39417 primary data records. [2025-10-03T22:36:38.658829] [DEBUG] [LOCAL ] COMP: Loaded 54169 existing records from primary storage. [2025-10-03T22:36:38.681132] [INFO ] [MAIN ] COMP: Loaded 54169 primary data records. [2025-10-03T22:36:39.406615] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:39.407950] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39417 primary records. [2025-10-03T22:36:39.415481] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-03T22:36:39.420868] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:39.421988] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52854 primary records. [2025-10-03T22:36:39.422075] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-03T22:36:39.455210] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-10-03T22:36:39.469227] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-10-03T22:36:39.463500] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-03T22:36:39.469588] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-03T22:36:39.471879] [INFO ] [MAIN ] Derivative Progress: 430/2073 symbols completed. COLD took 1.2s. Estimated remaining: 11m 33s. Rate: 142.2 symbols/min [2025-10-03T22:36:39.475113] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:39.475803] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:39.476699] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54169 primary records. [2025-10-03T22:36:39.476796] [INFO ] [MAIN ] Derivative Progress: 431/2073 symbols completed. CON took 1.1s. Estimated remaining: 11m 31s. Rate: 142.6 symbols/min [2025-10-03T22:36:39.476977] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:39.477411] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-03T22:36:39.494688] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-10-03T22:36:39.494933] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-03T22:36:39.498350] [INFO ] [MAIN ] Derivative Progress: 432/2073 symbols completed. COMP took 1.2s. Estimated remaining: 11m 29s. Rate: 142.9 symbols/min [2025-10-03T22:36:39.498580] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:39.532848] [DEBUG] [LOCAL ] COOK: Loaded 24640 existing records from primary storage. [2025-10-03T22:36:39.533134] [INFO ] [MAIN ] COOK: Loaded 24640 primary data records. [2025-10-03T22:36:39.784619] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-03T22:36:39.904220] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-10-03T22:36:39.905963] [DEBUG] [LOCAL ] COR: Loaded 47718 existing records from primary storage. [2025-10-03T22:36:39.906559] [INFO ] [MAIN ] COR: Loaded 47718 primary data records. [2025-10-03T22:36:40.646073] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:40.647245] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24640 primary records. [2025-10-03T22:36:40.647500] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-03T22:36:40.668781] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-10-03T22:36:40.669001] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-03T22:36:40.671840] [INFO ] [MAIN ] Derivative Progress: 433/2073 symbols completed. COOK took 1.2s. Estimated remaining: 11m 32s. Rate: 142.3 symbols/min [2025-10-03T22:36:40.686215] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:40.688504] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47718 primary records. [2025-10-03T22:36:40.688693] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-03T22:36:40.713927] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:40.715592] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-10-03T22:36:40.716304] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-03T22:36:40.719261] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-10-03T22:36:40.726536] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-03T22:36:40.730214] [INFO ] [MAIN ] Derivative Progress: 434/2073 symbols completed. COR took 1.2s. Estimated remaining: 11m 30s. Rate: 142.6 symbols/min [2025-10-03T22:36:40.737074] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-10-03T22:36:40.737137] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-03T22:36:40.740921] [INFO ] [MAIN ] Derivative Progress: 435/2073 symbols completed. COP took 1.3s. Estimated remaining: 11m 28s. Rate: 142.9 symbols/min [2025-10-03T22:36:40.741451] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:40.741572] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:40.742046] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:40.820064] [DEBUG] [LOCAL ] COTY: Loaded 54004 existing records from primary storage. [2025-10-03T22:36:40.833320] [INFO ] [MAIN ] COTY: Loaded 54004 primary data records. [2025-10-03T22:36:40.905699] [DEBUG] [LOCAL ] COUR: Loaded 49645 existing records from primary storage. [2025-10-03T22:36:40.926577] [INFO ] [MAIN ] COUR: Loaded 49645 primary data records. [2025-10-03T22:36:40.949118] [DEBUG] [LOCAL ] CP: Loaded 54043 existing records from primary storage. [2025-10-03T22:36:40.999725] [INFO ] [MAIN ] CP: Loaded 54043 primary data records. [2025-10-03T22:36:41.829556] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:41.831017] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54004 primary records. [2025-10-03T22:36:41.831121] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-03T22:36:41.851566] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-10-03T22:36:41.866805] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-03T22:36:41.870572] [INFO ] [MAIN ] Derivative Progress: 436/2073 symbols completed. COTY took 1.1s. Estimated remaining: 11m 30s. Rate: 142.3 symbols/min [2025-10-03T22:36:41.871549] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:41.871730] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:41.872833] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49645 primary records. [2025-10-03T22:36:41.872928] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-03T22:36:41.905228] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-10-03T22:36:41.905801] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-03T22:36:41.909155] [INFO ] [MAIN ] Derivative Progress: 437/2073 symbols completed. COUR took 1.2s. Estimated remaining: 11m 28s. Rate: 142.6 symbols/min [2025-10-03T22:36:41.909763] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:41.909937] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:41.912129] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54043 primary records. [2025-10-03T22:36:41.912570] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-03T22:36:41.942499] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-10-03T22:36:41.942853] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-03T22:36:41.945725] [INFO ] [MAIN ] Derivative Progress: 438/2073 symbols completed. CP took 1.2s. Estimated remaining: 11m 26s. Rate: 142.9 symbols/min [2025-10-03T22:36:41.946094] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:41.966022] [DEBUG] [LOCAL ] CPA: Loaded 28805 existing records from primary storage. [2025-10-03T22:36:41.966301] [INFO ] [MAIN ] CPA: Loaded 28805 primary data records. [2025-10-03T22:36:42.058529] [DEBUG] [LOCAL ] CPAY: Loaded 30967 existing records from primary storage. [2025-10-03T22:36:42.089292] [INFO ] [MAIN ] CPAY: Loaded 30967 primary data records. [2025-10-03T22:36:42.134796] [DEBUG] [LOCAL ] CPF: Loaded 15402 existing records from primary storage. [2025-10-03T22:36:42.204315] [INFO ] [MAIN ] CPF: Loaded 15402 primary data records. [2025-10-03T22:36:42.988837] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:42.991671] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 28805 primary records. [2025-10-03T22:36:42.992095] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-03T22:36:43.021986] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-10-03T22:36:43.022392] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-03T22:36:43.024907] [INFO ] [MAIN ] Derivative Progress: 439/2073 symbols completed. CPA took 1.2s. Estimated remaining: 11m 28s. Rate: 142.4 symbols/min [2025-10-03T22:36:43.025232] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:43.039472] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:43.040365] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 30967 primary records. [2025-10-03T22:36:43.040583] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-03T22:36:43.072125] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:43.073428] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15402 primary records. [2025-10-03T22:36:43.074024] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-03T22:36:43.075168] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-10-03T22:36:43.075408] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-03T22:36:43.078668] [INFO ] [MAIN ] Derivative Progress: 440/2073 symbols completed. CPAY took 1.2s. Estimated remaining: 11m 27s. Rate: 142.7 symbols/min [2025-10-03T22:36:43.086014] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:43.095285] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-10-03T22:36:43.095482] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-03T22:36:43.099084] [INFO ] [MAIN ] Derivative Progress: 441/2073 symbols completed. CPF took 1.2s. Estimated remaining: 11m 25s. Rate: 143.0 symbols/min [2025-10-03T22:36:43.099362] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:43.157570] [DEBUG] [LOCAL ] CPNG: Loaded 54451 existing records from primary storage. [2025-10-03T22:36:43.157945] [INFO ] [MAIN ] CPNG: Loaded 54451 primary data records. [2025-10-03T22:36:43.305799] [DEBUG] [LOCAL ] CPRI: Loaded 53294 existing records from primary storage. [2025-10-03T22:36:43.311127] [INFO ] [MAIN ] CPRI: Loaded 53294 primary data records. [2025-10-03T22:36:43.423004] [DEBUG] [LOCAL ] CPT: Loaded 44977 existing records from primary storage. [2025-10-03T22:36:43.464610] [INFO ] [MAIN ] CPT: Loaded 44977 primary data records. [2025-10-03T22:36:44.287517] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:44.289833] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54451 primary records. [2025-10-03T22:36:44.290232] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-03T22:36:44.321595] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:44.323346] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53294 primary records. [2025-10-03T22:36:44.323589] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-03T22:36:44.354544] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-10-03T22:36:44.360462] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-03T22:36:44.364282] [INFO ] [MAIN ] Derivative Progress: 442/2073 symbols completed. CPRI took 1.3s. Estimated remaining: 11m 27s. Rate: 142.4 symbols/min [2025-10-03T22:36:44.364743] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:44.365202] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:44.366191] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-10-03T22:36:44.366361] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-03T22:36:44.367206] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 44977 primary records. [2025-10-03T22:36:44.369961] [INFO ] [MAIN ] Derivative Progress: 443/2073 symbols completed. CPNG took 1.3s. Estimated remaining: 11m 25s. Rate: 142.7 symbols/min [2025-10-03T22:36:44.370131] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-03T22:36:44.370490] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:44.396905] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-10-03T22:36:44.396806] [DEBUG] [LOCAL ] CRBD: Loaded 9105 existing records from primary storage. [2025-10-03T22:36:44.397108] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-03T22:36:44.400133] [INFO ] [MAIN ] Derivative Progress: 444/2073 symbols completed. CPT took 1.3s. Estimated remaining: 11m 24s. Rate: 143.0 symbols/min [2025-10-03T22:36:44.400543] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:44.400242] [INFO ] [MAIN ] CRBD: Loaded 9105 primary data records. [2025-10-03T22:36:44.537203] [DEBUG] [LOCAL ] CR: Loaded 24735 existing records from primary storage. [2025-10-03T22:36:44.537960] [INFO ] [MAIN ] CR: Loaded 24735 primary data records. [2025-10-03T22:36:45.085235] [DEBUG] [LOCAL ] CRBG: Loaded 53133 existing records from primary storage. [2025-10-03T22:36:45.085699] [INFO ] [MAIN ] CRBG: Loaded 53133 primary data records. [2025-10-03T22:36:45.419859] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:45.421034] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9105 primary records. [2025-10-03T22:36:45.421289] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-03T22:36:45.453509] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:45.456228] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 24735 primary records. [2025-10-03T22:36:45.456459] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-03T22:36:45.471251] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-10-03T22:36:45.475399] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-10-03T22:36:45.475586] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-03T22:36:45.475754] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-03T22:36:45.478214] [INFO ] [MAIN ] Derivative Progress: 445/2073 symbols completed. CRBD took 1.1s. Estimated remaining: 11m 26s. Rate: 142.5 symbols/min [2025-10-03T22:36:45.481519] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:45.481636] [INFO ] [MAIN ] Derivative Progress: 446/2073 symbols completed. CR took 1.1s. Estimated remaining: 11m 24s. Rate: 142.8 symbols/min [2025-10-03T22:36:45.482229] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:45.502156] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:45.502963] [INFO ] [MAIN ] CRBG: Generated 1820 derivative records from 53133 primary records. [2025-10-03T22:36:45.503028] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-03T22:36:45.523157] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1820 records). [2025-10-03T22:36:45.523438] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-03T22:36:45.527018] [INFO ] [MAIN ] Derivative Progress: 447/2073 symbols completed. CRBG took 1.1s. Estimated remaining: 11m 22s. Rate: 143.1 symbols/min [2025-10-03T22:36:45.527431] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:45.616130] [DEBUG] [LOCAL ] CRGY: Loaded 53284 existing records from primary storage. [2025-10-03T22:36:45.616346] [INFO ] [MAIN ] CRGY: Loaded 53284 primary data records. [2025-10-03T22:36:45.632182] [DEBUG] [LOCAL ] CRI: Loaded 50562 existing records from primary storage. [2025-10-03T22:36:45.669784] [INFO ] [MAIN ] CRI: Loaded 50562 primary data records. [2025-10-03T22:36:45.868235] [DEBUG] [LOCAL ] CRK: Loaded 52920 existing records from primary storage. [2025-10-03T22:36:45.911566] [INFO ] [MAIN ] CRK: Loaded 52920 primary data records. [2025-10-03T22:36:46.721664] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:46.722785] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53284 primary records. [2025-10-03T22:36:46.723044] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-03T22:36:46.759105] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-10-03T22:36:46.760751] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:46.760273] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-03T22:36:46.765693] [INFO ] [MAIN ] Derivative Progress: 448/2073 symbols completed. CRGY took 1.3s. Estimated remaining: 11m 24s. Rate: 142.4 symbols/min [2025-10-03T22:36:46.767640] [INFO ] [MAIN ] CRI: Generated 1820 derivative records from 50562 primary records. [2025-10-03T22:36:46.767817] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-03T22:36:46.789627] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:46.795014] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52920 primary records. [2025-10-03T22:36:46.795104] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-03T22:36:46.815227] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-10-03T22:36:46.815539] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-03T22:36:46.819604] [INFO ] [MAIN ] Derivative Progress: 449/2073 symbols completed. CRK took 1.3s. Estimated remaining: 11m 23s. Rate: 142.7 symbols/min [2025-10-03T22:36:46.819694] [DEBUG] [LOCAL ] CRI: Derivative data saved (1820 records). [2025-10-03T22:36:46.819822] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-03T22:36:46.823291] [INFO ] [MAIN ] Derivative Progress: 450/2073 symbols completed. CRI took 1.3s. Estimated remaining: 11m 21s. Rate: 143.0 symbols/min [2025-10-03T22:36:46.823832] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:46.824015] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:46.824214] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:46.913086] [DEBUG] [LOCAL ] CRS: Loaded 43817 existing records from primary storage. [2025-10-03T22:36:46.914182] [DEBUG] [LOCAL ] CRL: Loaded 43656 existing records from primary storage. [2025-10-03T22:36:46.914547] [INFO ] [MAIN ] CRL: Loaded 43656 primary data records. [2025-10-03T22:36:46.914474] [INFO ] [MAIN ] CRS: Loaded 43817 primary data records. [2025-10-03T22:36:47.090406] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-03T22:36:47.162790] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-10-03T22:36:47.947078] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:47.948177] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43656 primary records. [2025-10-03T22:36:47.949609] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-03T22:36:47.981940] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:47.987986] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43817 primary records. [2025-10-03T22:36:47.988750] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-10-03T22:36:47.990711] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-03T22:36:47.993316] [INFO ] [MAIN ] Derivative Progress: 451/2073 symbols completed. CRL took 1.2s. Estimated remaining: 11m 23s. Rate: 142.5 symbols/min [2025-10-03T22:36:47.988932] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-03T22:36:47.993500] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:48.020636] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:48.028081] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-10-03T22:36:48.031158] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-03T22:36:48.030935] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-10-03T22:36:48.032410] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-03T22:36:48.036344] [INFO ] [MAIN ] Derivative Progress: 452/2073 symbols completed. CRS took 1.2s. Estimated remaining: 11m 21s. Rate: 142.8 symbols/min [2025-10-03T22:36:48.054079] [DEBUG] [LOCAL ] CRT: Loaded 5044 existing records from primary storage. [2025-10-03T22:36:48.054293] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:48.056097] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-10-03T22:36:48.056878] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-03T22:36:48.060819] [INFO ] [MAIN ] Derivative Progress: 453/2073 symbols completed. CRM took 1.2s. Estimated remaining: 11m 19s. Rate: 143.1 symbols/min [2025-10-03T22:36:48.055064] [INFO ] [MAIN ] CRT: Loaded 5044 primary data records. [2025-10-03T22:36:48.061192] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:48.418112] [DEBUG] [LOCAL ] CSAN: Loaded 42880 existing records from primary storage. [2025-10-03T22:36:48.420271] [INFO ] [MAIN ] CSAN: Loaded 42880 primary data records. [2025-10-03T22:36:48.434028] [DEBUG] [LOCAL ] CSL: Loaded 31939 existing records from primary storage. [2025-10-03T22:36:48.459427] [INFO ] [MAIN ] CSL: Loaded 31939 primary data records. [2025-10-03T22:36:49.158203] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:49.159961] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 5044 primary records. [2025-10-03T22:36:49.160317] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-03T22:36:49.179928] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-10-03T22:36:49.180044] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-03T22:36:49.183384] [INFO ] [MAIN ] Derivative Progress: 454/2073 symbols completed. CRT took 1.2s. Estimated remaining: 11m 22s. Rate: 142.5 symbols/min [2025-10-03T22:36:49.184669] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:49.209023] [DEBUG] [LOCAL ] CSR: Loaded 12973 existing records from primary storage. [2025-10-03T22:36:49.218446] [INFO ] [MAIN ] CSR: Loaded 12973 primary data records. [2025-10-03T22:36:49.277178] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:49.304699] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42880 primary records. [2025-10-03T22:36:49.305528] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:49.305107] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-03T22:36:49.318936] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 31939 primary records. [2025-10-03T22:36:49.324995] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-03T22:36:49.462083] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-10-03T22:36:49.469431] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-03T22:36:49.473268] [INFO ] [MAIN ] Derivative Progress: 455/2073 symbols completed. CSAN took 1.4s. Estimated remaining: 11m 21s. Rate: 142.6 symbols/min [2025-10-03T22:36:49.473704] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:49.600720] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-10-03T22:36:49.601575] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-03T22:36:49.604968] [INFO ] [MAIN ] Derivative Progress: 456/2073 symbols completed. CSL took 1.5s. Estimated remaining: 11m 19s. Rate: 142.8 symbols/min [2025-10-03T22:36:49.605283] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:49.625227] [DEBUG] [LOCAL ] CSV: Loaded 13044 existing records from primary storage. [2025-10-03T22:36:49.625709] [INFO ] [MAIN ] CSV: Loaded 13044 primary data records. [2025-10-03T22:36:49.787440] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:49.845107] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 12973 primary records. [2025-10-03T22:36:49.847074] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-03T22:36:50.030499] [DEBUG] [LOCAL ] CSTM: Loaded 48106 existing records from primary storage. [2025-10-03T22:36:50.032311] [INFO ] [MAIN ] CSTM: Loaded 48106 primary data records. [2025-10-03T22:36:50.048612] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-10-03T22:36:50.058895] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-03T22:36:50.077042] [INFO ] [MAIN ] Derivative Progress: 457/2073 symbols completed. CSR took 0.9s. Estimated remaining: 11m 19s. Rate: 142.8 symbols/min [2025-10-03T22:36:50.077320] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:50.401927] [DEBUG] [LOCAL ] CTO: Loaded 28288 existing records from primary storage. [2025-10-03T22:36:50.403552] [INFO ] [MAIN ] CTO: Loaded 28288 primary data records. [2025-10-03T22:36:50.453321] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:50.476154] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 13044 primary records. [2025-10-03T22:36:50.486712] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-03T22:36:50.616136] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-10-03T22:36:50.632068] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-03T22:36:50.645745] [INFO ] [MAIN ] Derivative Progress: 458/2073 symbols completed. CSV took 1.0s. Estimated remaining: 11m 19s. Rate: 142.7 symbols/min [2025-10-03T22:36:50.669153] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:50.898060] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:50.900508] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48106 primary records. [2025-10-03T22:36:50.901188] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-03T22:36:50.942890] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-10-03T22:36:50.943353] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-03T22:36:50.947373] [INFO ] [MAIN ] Derivative Progress: 459/2073 symbols completed. CSTM took 1.5s. Estimated remaining: 11m 18s. Rate: 142.8 symbols/min [2025-10-03T22:36:50.947914] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:50.949399] [DEBUG] [LOCAL ] CTOS: Loaded 37159 existing records from primary storage. [2025-10-03T22:36:50.950040] [INFO ] [MAIN ] CTOS: Loaded 37159 primary data records. [2025-10-03T22:36:51.094974] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:51.155609] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28288 primary records. [2025-10-03T22:36:51.259228] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-03T22:36:51.312431] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-10-03T22:36:51.313070] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-03T22:36:51.332338] [INFO ] [MAIN ] Derivative Progress: 460/2073 symbols completed. CTO took 1.3s. Estimated remaining: 11m 18s. Rate: 142.8 symbols/min [2025-10-03T22:36:51.332818] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:51.334465] [DEBUG] [LOCAL ] CTRA: Loaded 54427 existing records from primary storage. [2025-10-03T22:36:51.335134] [INFO ] [MAIN ] CTRA: Loaded 54427 primary data records. [2025-10-03T22:36:51.692672] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:51.694511] [DEBUG] [LOCAL ] CTRE: Loaded 49988 existing records from primary storage. [2025-10-03T22:36:51.695693] [INFO ] [MAIN ] CTOS: Generated 1820 derivative records from 37159 primary records. [2025-10-03T22:36:51.695376] [INFO ] [MAIN ] CTRE: Loaded 49988 primary data records. [2025-10-03T22:36:51.695889] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-03T22:36:51.851985] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1820 records). [2025-10-03T22:36:51.862623] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-03T22:36:51.866247] [INFO ] [MAIN ] Derivative Progress: 461/2073 symbols completed. CTOS took 1.2s. Estimated remaining: 11m 18s. Rate: 142.7 symbols/min [2025-10-03T22:36:51.866456] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:52.060767] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:52.062169] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54427 primary records. [2025-10-03T22:36:52.062439] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-03T22:36:52.084787] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-10-03T22:36:52.085073] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-03T22:36:52.088287] [INFO ] [MAIN ] Derivative Progress: 462/2073 symbols completed. CTRA took 1.1s. Estimated remaining: 11m 17s. Rate: 142.9 symbols/min [2025-10-03T22:36:52.088612] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:52.126149] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:52.143377] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 49988 primary records. [2025-10-03T22:36:52.145964] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-03T22:36:52.149577] [DEBUG] [LOCAL ] CTVA: Loaded 54019 existing records from primary storage. [2025-10-03T22:36:52.157297] [INFO ] [MAIN ] CTVA: Loaded 54019 primary data records. [2025-10-03T22:36:52.316289] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-10-03T22:36:52.316535] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-03T22:36:52.351710] [INFO ] [MAIN ] Derivative Progress: 463/2073 symbols completed. CTRE took 1.0s. Estimated remaining: 11m 16s. Rate: 143.0 symbols/min [2025-10-03T22:36:52.504261] [DEBUG] [LOCAL ] CUBE: Loaded 51365 existing records from primary storage. [2025-10-03T22:36:52.514118] [INFO ] [MAIN ] CUBE: Loaded 51365 primary data records. [2025-10-03T22:36:52.839252] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:52.840289] [INFO ] [MAIN ] CTVA: Generated 1820 derivative records from 54019 primary records. [2025-10-03T22:36:52.840473] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-03T22:36:52.859864] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1820 records). [2025-10-03T22:36:52.859996] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-03T22:36:52.862841] [INFO ] [MAIN ] Derivative Progress: 464/2073 symbols completed. CTVA took 1.0s. Estimated remaining: 11m 15s. Rate: 142.9 symbols/min [2025-10-03T22:36:52.878970] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:52.879603] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51365 primary records. [2025-10-03T22:36:52.879688] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-03T22:36:52.896069] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-10-03T22:36:52.896134] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-03T22:36:52.899019] [INFO ] [MAIN ] Derivative Progress: 465/2073 symbols completed. CUBE took 0.8s. Estimated remaining: 11m 14s. Rate: 143.2 symbols/min [2025-10-03T22:36:52.899569] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:52.899683] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:52.899770] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:52.906422] [DEBUG] [LOCAL ] CULP: Loaded 2970 existing records from primary storage. [2025-10-03T22:36:52.906680] [INFO ] [MAIN ] CULP: Loaded 2970 primary data records. [2025-10-03T22:36:53.276124] [DEBUG] [LOCAL ] CUBI: Loaded 27487 existing records from primary storage. [2025-10-03T22:36:53.276525] [INFO ] [MAIN ] CUBI: Loaded 27487 primary data records. [2025-10-03T22:36:53.404420] [DEBUG] [LOCAL ] CUK: Loaded 51758 existing records from primary storage. [2025-10-03T22:36:53.415240] [INFO ] [MAIN ] CUK: Loaded 51758 primary data records. [2025-10-03T22:36:53.992911] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:53.994589] [INFO ] [MAIN ] CULP: Generated 1820 derivative records from 2970 primary records. [2025-10-03T22:36:53.994994] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-03T22:36:54.014109] [DEBUG] [LOCAL ] CULP: Derivative data saved (1820 records). [2025-10-03T22:36:54.015443] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-03T22:36:54.019691] [INFO ] [MAIN ] Derivative Progress: 466/2073 symbols completed. CULP took 1.1s. Estimated remaining: 11m 16s. Rate: 142.7 symbols/min [2025-10-03T22:36:54.022429] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:54.038486] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:54.039695] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27487 primary records. [2025-10-03T22:36:54.040411] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-03T22:36:54.088629] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:54.091570] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51758 primary records. [2025-10-03T22:36:54.091808] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-03T22:36:54.091942] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-10-03T22:36:54.092872] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-03T22:36:54.095959] [INFO ] [MAIN ] Derivative Progress: 467/2073 symbols completed. CUBI took 1.2s. Estimated remaining: 11m 14s. Rate: 142.9 symbols/min [2025-10-03T22:36:54.096632] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:54.126323] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-10-03T22:36:54.126747] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-03T22:36:54.131938] [INFO ] [MAIN ] Derivative Progress: 468/2073 symbols completed. CUK took 1.2s. Estimated remaining: 11m 12s. Rate: 143.2 symbols/min [2025-10-03T22:36:54.127584] [DEBUG] [LOCAL ] CURB: Loaded 33201 existing records from primary storage. [2025-10-03T22:36:54.132377] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:54.132682] [INFO ] [MAIN ] CURB: Loaded 33201 primary data records. [2025-10-03T22:36:54.304489] [DEBUG] [LOCAL ] CURV: Loaded 27147 existing records from primary storage. [2025-10-03T22:36:54.328086] [INFO ] [MAIN ] CURV: Loaded 27147 primary data records. [2025-10-03T22:36:54.679383] [DEBUG] [LOCAL ] CUZ: Loaded 50071 existing records from primary storage. [2025-10-03T22:36:54.710929] [INFO ] [MAIN ] CUZ: Loaded 50071 primary data records. [2025-10-03T22:36:55.238533] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:55.240683] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33201 primary records. [2025-10-03T22:36:55.241095] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-03T22:36:55.260816] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-10-03T22:36:55.261595] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-03T22:36:55.264551] [INFO ] [MAIN ] Derivative Progress: 469/2073 symbols completed. CURB took 1.2s. Estimated remaining: 11m 14s. Rate: 142.7 symbols/min [2025-10-03T22:36:55.265721] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:55.287304] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:55.289105] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 27147 primary records. [2025-10-03T22:36:55.289327] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-03T22:36:55.315202] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-10-03T22:36:55.323468] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-03T22:36:55.326760] [INFO ] [MAIN ] Derivative Progress: 470/2073 symbols completed. CURV took 1.2s. Estimated remaining: 11m 13s. Rate: 143.0 symbols/min [2025-10-03T22:36:55.326970] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:55.333482] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:55.334491] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50071 primary records. [2025-10-03T22:36:55.334818] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-03T22:36:55.374834] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-10-03T22:36:55.375043] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-03T22:36:55.378185] [INFO ] [MAIN ] Derivative Progress: 471/2073 symbols completed. CUZ took 1.2s. Estimated remaining: 11m 11s. Rate: 143.2 symbols/min [2025-10-03T22:36:55.378491] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:55.386285] [DEBUG] [LOCAL ] CVEO: Loaded 15333 existing records from primary storage. [2025-10-03T22:36:55.386485] [INFO ] [MAIN ] CVEO: Loaded 15333 primary data records. [2025-10-03T22:36:55.492826] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-10-03T22:36:55.504509] [INFO ] [MAIN ] CVE: Loaded 54336 primary data records. [2025-10-03T22:36:55.915459] [DEBUG] [LOCAL ] CVI: Loaded 47178 existing records from primary storage. [2025-10-03T22:36:55.920332] [INFO ] [MAIN ] CVI: Loaded 47178 primary data records. [2025-10-03T22:36:56.429199] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:56.431138] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15333 primary records. [2025-10-03T22:36:56.431247] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-03T22:36:56.467848] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-10-03T22:36:56.468345] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:56.469567] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54336 primary records. [2025-10-03T22:36:56.468549] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-03T22:36:56.469741] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-03T22:36:56.472466] [INFO ] [MAIN ] Derivative Progress: 472/2073 symbols completed. CVEO took 1.1s. Estimated remaining: 11m 13s. Rate: 142.7 symbols/min [2025-10-03T22:36:56.472851] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:56.514133] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:56.523709] [DEBUG] [LOCAL ] CVLG: Loaded 15666 existing records from primary storage. [2025-10-03T22:36:56.523228] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-10-03T22:36:56.524765] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47178 primary records. [2025-10-03T22:36:56.525006] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-03T22:36:56.525180] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-03T22:36:56.525093] [INFO ] [MAIN ] CVLG: Loaded 15666 primary data records. [2025-10-03T22:36:56.528398] [INFO ] [MAIN ] Derivative Progress: 473/2073 symbols completed. CVE took 1.3s. Estimated remaining: 11m 11s. Rate: 143.0 symbols/min [2025-10-03T22:36:56.561109] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:56.634058] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-10-03T22:36:56.646789] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-03T22:36:56.663857] [INFO ] [MAIN ] Derivative Progress: 474/2073 symbols completed. CVI took 1.3s. Estimated remaining: 11m 10s. Rate: 143.2 symbols/min [2025-10-03T22:36:56.664228] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:56.928079] [DEBUG] [LOCAL ] CVNA: Loaded 53720 existing records from primary storage. [2025-10-03T22:36:56.929431] [INFO ] [MAIN ] CVNA: Loaded 53720 primary data records. [2025-10-03T22:36:57.021591] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-03T22:36:57.031924] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-10-03T22:36:57.250466] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:57.282097] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15666 primary records. [2025-10-03T22:36:57.458247] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-03T22:36:57.700112] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-10-03T22:36:57.701035] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-03T22:36:57.706200] [INFO ] [MAIN ] Derivative Progress: 475/2073 symbols completed. CVLG took 1.2s. Estimated remaining: 11m 12s. Rate: 142.8 symbols/min [2025-10-03T22:36:57.707398] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:57.768326] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:36:57.769691] [INFO ] [MAIN ] CVNA: Generated 1819 derivative records from 53720 primary records. [2025-10-03T22:36:57.769930] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-03T22:36:57.770179] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:57.772008] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-10-03T22:36:57.772127] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-03T22:36:57.818566] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-10-03T22:36:57.819280] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-03T22:36:57.822414] [INFO ] [MAIN ] Derivative Progress: 476/2073 symbols completed. CVX took 1.2s. Estimated remaining: 11m 10s. Rate: 143.0 symbols/min [2025-10-03T22:36:57.822898] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:57.825818] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1819 records). [2025-10-03T22:36:57.825912] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-03T22:36:57.842031] [INFO ] [MAIN ] Derivative Progress: 477/2073 symbols completed. CVNA took 1.3s. Estimated remaining: 11m 8s. Rate: 143.3 symbols/min [2025-10-03T22:36:57.843818] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:57.845588] [DEBUG] [LOCAL ] CWAN: Loaded 53184 existing records from primary storage. [2025-10-03T22:36:57.845923] [INFO ] [MAIN ] CWAN: Loaded 53184 primary data records. [2025-10-03T22:36:58.219695] [DEBUG] [LOCAL ] CWH: Loaded 52068 existing records from primary storage. [2025-10-03T22:36:58.235457] [INFO ] [MAIN ] CWH: Loaded 52068 primary data records. [2025-10-03T22:36:58.275551] [DEBUG] [LOCAL ] CWK: Loaded 50148 existing records from primary storage. [2025-10-03T22:36:58.305247] [INFO ] [MAIN ] CWK: Loaded 50148 primary data records. [2025-10-03T22:36:58.898503] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:58.913477] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53184 primary records. [2025-10-03T22:36:58.914421] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-03T22:36:58.933484] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-10-03T22:36:58.934919] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-03T22:36:58.939142] [INFO ] [MAIN ] Derivative Progress: 478/2073 symbols completed. CWAN took 1.2s. Estimated remaining: 11m 10s. Rate: 142.8 symbols/min [2025-10-03T22:36:58.961594] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:58.962623] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52068 primary records. [2025-10-03T22:36:58.962759] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-03T22:36:58.991945] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:36:58.993114] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50148 primary records. [2025-10-03T22:36:58.993404] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-03T22:36:59.008432] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-10-03T22:36:59.008762] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-03T22:36:59.012266] [INFO ] [MAIN ] Derivative Progress: 479/2073 symbols completed. CWH took 1.2s. Estimated remaining: 11m 9s. Rate: 143.0 symbols/min [2025-10-03T22:36:59.015026] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-10-03T22:36:59.015093] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-03T22:36:59.018215] [INFO ] [MAIN ] Derivative Progress: 480/2073 symbols completed. CWK took 1.2s. Estimated remaining: 11m 7s. Rate: 143.3 symbols/min [2025-10-03T22:36:59.018674] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:59.018728] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:59.018839] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:36:59.031211] [DEBUG] [LOCAL ] CXH: Loaded 4450 existing records from primary storage. [2025-10-03T22:36:59.031514] [INFO ] [MAIN ] CXH: Loaded 4450 primary data records. [2025-10-03T22:36:59.067618] [DEBUG] [LOCAL ] CXE: Loaded 6646 existing records from primary storage. [2025-10-03T22:36:59.080070] [INFO ] [MAIN ] CXE: Loaded 6646 primary data records. [2025-10-03T22:36:59.719161] [DEBUG] [LOCAL ] CX: Loaded 53593 existing records from primary storage. [2025-10-03T22:36:59.719702] [INFO ] [MAIN ] CX: Loaded 53593 primary data records. [2025-10-03T22:37:00.094587] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:00.096429] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4450 primary records. [2025-10-03T22:37:00.097238] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-03T22:37:00.111104] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:00.112060] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 6646 primary records. [2025-10-03T22:37:00.122681] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-03T22:37:00.143197] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-10-03T22:37:00.143869] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-03T22:37:00.147380] [INFO ] [MAIN ] Derivative Progress: 481/2073 symbols completed. CXE took 1.1s. Estimated remaining: 11m 9s. Rate: 142.8 symbols/min [2025-10-03T22:37:00.147579] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:00.150525] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-10-03T22:37:00.150900] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-03T22:37:00.153987] [INFO ] [MAIN ] Derivative Progress: 482/2073 symbols completed. CXH took 1.1s. Estimated remaining: 11m 7s. Rate: 143.1 symbols/min [2025-10-03T22:37:00.154428] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:00.174934] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:00.175794] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53593 primary records. [2025-10-03T22:37:00.176218] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-03T22:37:00.196283] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-10-03T22:37:00.205893] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-03T22:37:00.209686] [INFO ] [MAIN ] Derivative Progress: 483/2073 symbols completed. CX took 1.2s. Estimated remaining: 11m 5s. Rate: 143.4 symbols/min [2025-10-03T22:37:00.209942] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:00.237755] [DEBUG] [LOCAL ] CXT: Loaded 31460 existing records from primary storage. [2025-10-03T22:37:00.238034] [INFO ] [MAIN ] CXT: Loaded 31460 primary data records. [2025-10-03T22:37:00.308598] [DEBUG] [LOCAL ] CXM: Loaded 48291 existing records from primary storage. [2025-10-03T22:37:00.341009] [INFO ] [MAIN ] CXM: Loaded 48291 primary data records. [2025-10-03T22:37:00.658367] [DEBUG] [LOCAL ] CXW: Loaded 44678 existing records from primary storage. [2025-10-03T22:37:00.698603] [INFO ] [MAIN ] CXW: Loaded 44678 primary data records. [2025-10-03T22:37:01.232282] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:01.233319] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31460 primary records. [2025-10-03T22:37:01.233493] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-03T22:37:01.253836] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-10-03T22:37:01.254863] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-03T22:37:01.260110] [INFO ] [MAIN ] Derivative Progress: 484/2073 symbols completed. CXT took 1.1s. Estimated remaining: 11m 7s. Rate: 142.9 symbols/min [2025-10-03T22:37:01.260457] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:01.275004] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:01.275946] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48291 primary records. [2025-10-03T22:37:01.276190] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-03T22:37:01.315812] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:01.317259] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-10-03T22:37:01.318193] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44678 primary records. [2025-10-03T22:37:01.318385] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-03T22:37:01.318338] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-03T22:37:01.323053] [INFO ] [MAIN ] Derivative Progress: 485/2073 symbols completed. CXM took 1.2s. Estimated remaining: 11m 6s. Rate: 143.2 symbols/min [2025-10-03T22:37:01.323816] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:01.349913] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-10-03T22:37:01.349811] [DEBUG] [LOCAL ] CYD: Loaded 26957 existing records from primary storage. [2025-10-03T22:37:01.350301] [INFO ] [MAIN ] CYD: Loaded 26957 primary data records. [2025-10-03T22:37:01.350380] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-03T22:37:01.376133] [INFO ] [MAIN ] Derivative Progress: 486/2073 symbols completed. CXW took 1.2s. Estimated remaining: 11m 4s. Rate: 143.4 symbols/min [2025-10-03T22:37:01.398916] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:01.726422] [DEBUG] [LOCAL ] CYH: Loaded 48183 existing records from primary storage. [2025-10-03T22:37:01.726834] [INFO ] [MAIN ] CYH: Loaded 48183 primary data records. [2025-10-03T22:37:01.924937] [DEBUG] [LOCAL ] D: Loaded 54424 existing records from primary storage. [2025-10-03T22:37:01.933628] [INFO ] [MAIN ] D: Loaded 54424 primary data records. [2025-10-03T22:37:02.434064] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:02.435324] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 26957 primary records. [2025-10-03T22:37:02.435556] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-03T22:37:02.459815] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-10-03T22:37:02.460489] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-03T22:37:02.477011] [INFO ] [MAIN ] Derivative Progress: 487/2073 symbols completed. CYD took 1.2s. Estimated remaining: 11m 6s. Rate: 142.9 symbols/min [2025-10-03T22:37:02.478087] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:02.479146] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48183 primary records. [2025-10-03T22:37:02.479319] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:02.479762] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-03T22:37:02.496776] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-10-03T22:37:02.497172] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-03T22:37:02.499747] [INFO ] [MAIN ] Derivative Progress: 488/2073 symbols completed. CYH took 1.2s. Estimated remaining: 11m 4s. Rate: 143.2 symbols/min [2025-10-03T22:37:02.500028] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:02.529953] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:02.530890] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54424 primary records. [2025-10-03T22:37:02.531336] [DEBUG] [LOCAL ] DAC: Loaded 12664 existing records from primary storage. [2025-10-03T22:37:02.531510] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-03T22:37:02.532124] [INFO ] [MAIN ] DAC: Loaded 12664 primary data records. [2025-10-03T22:37:02.748685] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-10-03T22:37:02.754046] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-03T22:37:02.875666] [INFO ] [MAIN ] Derivative Progress: 489/2073 symbols completed. D took 1.5s. Estimated remaining: 11m 3s. Rate: 143.3 symbols/min [2025-10-03T22:37:02.892484] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:02.893675] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-03T22:37:02.893996] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-10-03T22:37:03.098858] [DEBUG] [LOCAL ] DAO: Loaded 20992 existing records from primary storage. [2025-10-03T22:37:03.208426] [INFO ] [MAIN ] DAO: Loaded 20992 primary data records. [2025-10-03T22:37:03.601002] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:03.602121] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12664 primary records. [2025-10-03T22:37:03.602352] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-03T22:37:03.621909] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-10-03T22:37:03.622337] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-03T22:37:03.626010] [INFO ] [MAIN ] Derivative Progress: 490/2073 symbols completed. DAC took 1.1s. Estimated remaining: 11m 4s. Rate: 143.0 symbols/min [2025-10-03T22:37:03.626301] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:03.645216] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:03.646049] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-10-03T22:37:03.646326] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-03T22:37:03.679540] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-10-03T22:37:03.680035] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:03.681119] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-03T22:37:03.680840] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 20992 primary records. [2025-10-03T22:37:03.681214] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-03T22:37:03.685269] [INFO ] [MAIN ] Derivative Progress: 491/2073 symbols completed. DAL took 1.2s. Estimated remaining: 11m 2s. Rate: 143.3 symbols/min [2025-10-03T22:37:03.686161] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:03.720487] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-10-03T22:37:03.720747] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-03T22:37:03.724421] [INFO ] [MAIN ] Derivative Progress: 492/2073 symbols completed. DAO took 0.8s. Estimated remaining: 11m 1s. Rate: 143.5 symbols/min [2025-10-03T22:37:03.724614] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:03.743634] [DEBUG] [LOCAL ] DAR: Loaded 52592 existing records from primary storage. [2025-10-03T22:37:03.743977] [INFO ] [MAIN ] DAR: Loaded 52592 primary data records. [2025-10-03T22:37:03.899233] [DEBUG] [LOCAL ] DAVA: Loaded 41673 existing records from primary storage. [2025-10-03T22:37:03.905437] [INFO ] [MAIN ] DAVA: Loaded 41673 primary data records. [2025-10-03T22:37:04.224868] [DEBUG] [LOCAL ] DAY: Loaded 50058 existing records from primary storage. [2025-10-03T22:37:04.234126] [INFO ] [MAIN ] DAY: Loaded 50058 primary data records. [2025-10-03T22:37:04.812610] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:04.813895] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52592 primary records. [2025-10-03T22:37:04.814761] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-03T22:37:04.855580] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:04.858520] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 41673 primary records. [2025-10-03T22:37:04.859587] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-03T22:37:04.875693] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-10-03T22:37:04.879297] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-03T22:37:04.885120] [INFO ] [MAIN ] Derivative Progress: 493/2073 symbols completed. DAR took 1.3s. Estimated remaining: 11m 3s. Rate: 143.0 symbols/min [2025-10-03T22:37:04.907309] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:04.910281] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-10-03T22:37:04.910193] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 50058 primary records. [2025-10-03T22:37:04.910390] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-03T22:37:04.910473] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-03T22:37:04.914604] [INFO ] [MAIN ] Derivative Progress: 494/2073 symbols completed. DAVA took 1.2s. Estimated remaining: 11m 1s. Rate: 143.3 symbols/min [2025-10-03T22:37:04.931972] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-10-03T22:37:04.932135] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-03T22:37:04.935237] [INFO ] [MAIN ] Derivative Progress: 495/2073 symbols completed. DAY took 1.2s. Estimated remaining: 10m 59s. Rate: 143.6 symbols/min [2025-10-03T22:37:04.936129] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:04.936269] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:04.937095] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:04.952675] [DEBUG] [LOCAL ] DBL: Loaded 9400 existing records from primary storage. [2025-10-03T22:37:04.952854] [INFO ] [MAIN ] DBL: Loaded 9400 primary data records. [2025-10-03T22:37:05.334419] [DEBUG] [LOCAL ] DCI: Loaded 37763 existing records from primary storage. [2025-10-03T22:37:05.399121] [INFO ] [MAIN ] DCI: Loaded 37763 primary data records. [2025-10-03T22:37:05.430441] [DEBUG] [LOCAL ] DBRG: Loaded 50472 existing records from primary storage. [2025-10-03T22:37:05.458496] [INFO ] [MAIN ] DBRG: Loaded 50472 primary data records. [2025-10-03T22:37:06.347277] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:06.348898] [INFO ] [MAIN ] DBL: Generated 1820 derivative records from 9400 primary records. [2025-10-03T22:37:06.349350] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-03T22:37:06.373255] [DEBUG] [LOCAL ] DBL: Derivative data saved (1820 records). [2025-10-03T22:37:06.373614] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-03T22:37:06.376810] [INFO ] [MAIN ] Derivative Progress: 496/2073 symbols completed. DBL took 1.4s. Estimated remaining: 11m 2s. Rate: 142.9 symbols/min [2025-10-03T22:37:06.378698] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:06.397423] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:06.398404] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 37763 primary records. [2025-10-03T22:37:06.398588] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-03T22:37:06.422033] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-10-03T22:37:06.422947] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-03T22:37:06.425548] [INFO ] [MAIN ] Derivative Progress: 497/2073 symbols completed. DCI took 1.5s. Estimated remaining: 11m 1s. Rate: 143.1 symbols/min [2025-10-03T22:37:06.425757] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:06.433299] [DEBUG] [LOCAL ] DCO: Loaded 14009 existing records from primary storage. [2025-10-03T22:37:06.441339] [INFO ] [MAIN ] DCO: Loaded 14009 primary data records. [2025-10-03T22:37:06.470847] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:06.504923] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50472 primary records. [2025-10-03T22:37:06.524427] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-03T22:37:06.819179] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-10-03T22:37:06.819694] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-03T22:37:06.822782] [INFO ] [MAIN ] Derivative Progress: 498/2073 symbols completed. DBRG took 1.9s. Estimated remaining: 11m 0s. Rate: 143.1 symbols/min [2025-10-03T22:37:06.823019] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:06.846276] [DEBUG] [LOCAL ] DD: Loaded 53600 existing records from primary storage. [2025-10-03T22:37:06.846793] [INFO ] [MAIN ] DD: Loaded 53600 primary data records. [2025-10-03T22:37:07.200146] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:07.199678] [DEBUG] [LOCAL ] DDD: Loaded 51654 existing records from primary storage. [2025-10-03T22:37:07.209189] [INFO ] [MAIN ] DDD: Loaded 51654 primary data records. [2025-10-03T22:37:07.210275] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14009 primary records. [2025-10-03T22:37:07.216051] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-03T22:37:07.439835] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-10-03T22:37:07.557997] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-03T22:37:07.570484] [INFO ] [MAIN ] Derivative Progress: 499/2073 symbols completed. DCO took 1.2s. Estimated remaining: 11m 1s. Rate: 142.9 symbols/min [2025-10-03T22:37:07.571546] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:07.592848] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:07.594315] [INFO ] [MAIN ] DD: Generated 1820 derivative records from 53600 primary records. [2025-10-03T22:37:07.599837] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-03T22:37:07.620073] [DEBUG] [LOCAL ] DDS: Loaded 13150 existing records from primary storage. [2025-10-03T22:37:07.620237] [INFO ] [MAIN ] DDS: Loaded 13150 primary data records. [2025-10-03T22:37:07.636413] [DEBUG] [LOCAL ] DD: Derivative data saved (1820 records). [2025-10-03T22:37:07.646970] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-03T22:37:07.687485] [INFO ] [MAIN ] Derivative Progress: 500/2073 symbols completed. DD took 1.3s. Estimated remaining: 10m 59s. Rate: 143.1 symbols/min [2025-10-03T22:37:07.709870] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:08.003547] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:08.014055] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51654 primary records. [2025-10-03T22:37:08.014303] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-03T22:37:08.044968] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-10-03T22:37:08.045961] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-03T22:37:08.049509] [INFO ] [MAIN ] Derivative Progress: 501/2073 symbols completed. DDD took 1.2s. Estimated remaining: 10m 59s. Rate: 143.2 symbols/min [2025-10-03T22:37:08.050186] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:08.071998] [DEBUG] [LOCAL ] DE: Loaded 48234 existing records from primary storage. [2025-10-03T22:37:08.072670] [INFO ] [MAIN ] DE: Loaded 48234 primary data records. [2025-10-03T22:37:08.227225] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:08.276319] [INFO ] [MAIN ] DDS: Generated 1820 derivative records from 13150 primary records. [2025-10-03T22:37:08.309403] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-03T22:37:08.432728] [DEBUG] [LOCAL ] DEA: Loaded 41408 existing records from primary storage. [2025-10-03T22:37:08.442556] [INFO ] [MAIN ] DEA: Loaded 41408 primary data records. [2025-10-03T22:37:08.631365] [DEBUG] [LOCAL ] DDS: Derivative data saved (1820 records). [2025-10-03T22:37:08.640832] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-03T22:37:08.666450] [INFO ] [MAIN ] Derivative Progress: 502/2073 symbols completed. DDS took 1.1s. Estimated remaining: 10m 59s. Rate: 143.0 symbols/min [2025-10-03T22:37:08.666779] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:08.836793] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:08.838174] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48234 primary records. [2025-10-03T22:37:08.838290] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-03T22:37:08.858318] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-10-03T22:37:08.869155] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-03T22:37:08.869745] [DEBUG] [LOCAL ] DEC: Loaded 31087 existing records from primary storage. [2025-10-03T22:37:08.872992] [INFO ] [MAIN ] Derivative Progress: 503/2073 symbols completed. DE took 1.2s. Estimated remaining: 10m 58s. Rate: 143.2 symbols/min [2025-10-03T22:37:08.873428] [INFO ] [MAIN ] DEC: Loaded 31087 primary data records. [2025-10-03T22:37:08.873610] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:09.003207] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:09.004997] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41408 primary records. [2025-10-03T22:37:09.015847] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-03T22:37:09.226278] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-10-03T22:37:09.226526] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-03T22:37:09.229412] [INFO ] [MAIN ] Derivative Progress: 504/2073 symbols completed. DEA took 1.2s. Estimated remaining: 10m 57s. Rate: 143.2 symbols/min [2025-10-03T22:37:09.229947] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:09.279259] [DEBUG] [LOCAL ] DECK: Loaded 54072 existing records from primary storage. [2025-10-03T22:37:09.281557] [INFO ] [MAIN ] DECK: Loaded 54072 primary data records. [2025-10-03T22:37:09.370571] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:09.389708] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 31087 primary records. [2025-10-03T22:37:09.408316] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-03T22:37:09.428217] [DEBUG] [LOCAL ] DEI: Loaded 49012 existing records from primary storage. [2025-10-03T22:37:09.435587] [INFO ] [MAIN ] DEI: Loaded 49012 primary data records. [2025-10-03T22:37:09.752252] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-10-03T22:37:09.757729] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-03T22:37:09.776094] [INFO ] [MAIN ] Derivative Progress: 505/2073 symbols completed. DEC took 1.1s. Estimated remaining: 10m 57s. Rate: 143.1 symbols/min [2025-10-03T22:37:09.804103] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:09.987778] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:09.989596] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54072 primary records. [2025-10-03T22:37:09.989931] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-03T22:37:10.023827] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-10-03T22:37:10.024472] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-03T22:37:10.027300] [INFO ] [MAIN ] Derivative Progress: 506/2073 symbols completed. DECK took 1.2s. Estimated remaining: 10m 56s. Rate: 143.2 symbols/min [2025-10-03T22:37:10.027880] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:10.047248] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:10.048175] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49012 primary records. [2025-10-03T22:37:10.048323] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-03T22:37:10.079681] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-10-03T22:37:10.080474] [INFO ] [MAIN ] DELL: Loaded 54515 primary data records. [2025-10-03T22:37:10.089899] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-10-03T22:37:10.117896] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-03T22:37:10.138153] [INFO ] [MAIN ] Derivative Progress: 507/2073 symbols completed. DEI took 0.9s. Estimated remaining: 10m 55s. Rate: 143.4 symbols/min [2025-10-03T22:37:10.156030] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:10.461431] [DEBUG] [LOCAL ] DEO: Loaded 49783 existing records from primary storage. [2025-10-03T22:37:10.470170] [INFO ] [MAIN ] DEO: Loaded 49783 primary data records. [2025-10-03T22:37:10.612471] [DEBUG] [LOCAL ] DFH: Loaded 32660 existing records from primary storage. [2025-10-03T22:37:10.648196] [INFO ] [MAIN ] DFH: Loaded 32660 primary data records. [2025-10-03T22:37:11.123886] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:11.124996] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54515 primary records. [2025-10-03T22:37:11.125098] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-03T22:37:11.147963] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-10-03T22:37:11.148137] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-03T22:37:11.151197] [INFO ] [MAIN ] Derivative Progress: 508/2073 symbols completed. DELL took 1.3s. Estimated remaining: 10m 56s. Rate: 143.0 symbols/min [2025-10-03T22:37:11.168032] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:11.168956] [INFO ] [MAIN ] DEO: Generated 1820 derivative records from 49783 primary records. [2025-10-03T22:37:11.169112] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-03T22:37:11.188417] [DEBUG] [LOCAL ] DEO: Derivative data saved (1820 records). [2025-10-03T22:37:11.188569] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-03T22:37:11.191448] [INFO ] [MAIN ] Derivative Progress: 509/2073 symbols completed. DEO took 1.2s. Estimated remaining: 10m 55s. Rate: 143.3 symbols/min [2025-10-03T22:37:11.204459] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:11.205104] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 32660 primary records. [2025-10-03T22:37:11.205166] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-03T22:37:11.220992] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-10-03T22:37:11.221063] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-03T22:37:11.224057] [INFO ] [MAIN ] Derivative Progress: 510/2073 symbols completed. DFH took 1.1s. Estimated remaining: 10m 53s. Rate: 143.6 symbols/min [2025-10-03T22:37:11.224495] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:11.224605] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:11.224899] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:11.249135] [DEBUG] [LOCAL ] DFP: Loaded 11537 existing records from primary storage. [2025-10-03T22:37:11.249311] [INFO ] [MAIN ] DFP: Loaded 11537 primary data records. [2025-10-03T22:37:11.376214] [DEBUG] [LOCAL ] DFIN: Loaded 23342 existing records from primary storage. [2025-10-03T22:37:11.396365] [INFO ] [MAIN ] DFIN: Loaded 23342 primary data records. [2025-10-03T22:37:11.693945] [DEBUG] [LOCAL ] DG: Loaded 54057 existing records from primary storage. [2025-10-03T22:37:11.706117] [INFO ] [MAIN ] DG: Loaded 54057 primary data records. [2025-10-03T22:37:12.326156] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:12.328102] [INFO ] [MAIN ] DFP: Generated 1820 derivative records from 11537 primary records. [2025-10-03T22:37:12.329097] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-03T22:37:12.352466] [DEBUG] [LOCAL ] DFP: Derivative data saved (1820 records). [2025-10-03T22:37:12.352809] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-03T22:37:12.358317] [INFO ] [MAIN ] Derivative Progress: 511/2073 symbols completed. DFP took 1.1s. Estimated remaining: 10m 55s. Rate: 143.1 symbols/min [2025-10-03T22:37:12.358714] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:12.375252] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:12.377295] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 23342 primary records. [2025-10-03T22:37:12.377552] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-03T22:37:12.406051] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:12.410354] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54057 primary records. [2025-10-03T22:37:12.411840] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-03T22:37:12.411765] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-10-03T22:37:12.411993] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-03T22:37:12.415603] [INFO ] [MAIN ] Derivative Progress: 512/2073 symbols completed. DFIN took 1.2s. Estimated remaining: 10m 54s. Rate: 143.3 symbols/min [2025-10-03T22:37:12.416851] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:12.436423] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-10-03T22:37:12.436785] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-03T22:37:12.440751] [INFO ] [MAIN ] Derivative Progress: 513/2073 symbols completed. DG took 1.2s. Estimated remaining: 10m 52s. Rate: 143.6 symbols/min [2025-10-03T22:37:12.454905] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:12.473063] [DEBUG] [LOCAL ] DHF: Loaded 21451 existing records from primary storage. [2025-10-03T22:37:12.473272] [INFO ] [MAIN ] DHF: Loaded 21451 primary data records. [2025-10-03T22:37:12.597338] [DEBUG] [LOCAL ] DGX: Loaded 45574 existing records from primary storage. [2025-10-03T22:37:12.612995] [INFO ] [MAIN ] DGX: Loaded 45574 primary data records. [2025-10-03T22:37:12.833867] [DEBUG] [LOCAL ] DHT: Loaded 48575 existing records from primary storage. [2025-10-03T22:37:12.845333] [INFO ] [MAIN ] DHT: Loaded 48575 primary data records. [2025-10-03T22:37:13.515012] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:13.516504] [INFO ] [MAIN ] DHF: Generated 1820 derivative records from 21451 primary records. [2025-10-03T22:37:13.516671] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-03T22:37:13.538222] [DEBUG] [LOCAL ] DHF: Derivative data saved (1820 records). [2025-10-03T22:37:13.538865] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-03T22:37:13.542062] [INFO ] [MAIN ] Derivative Progress: 514/2073 symbols completed. DHF took 1.1s. Estimated remaining: 10m 54s. Rate: 143.1 symbols/min [2025-10-03T22:37:13.542420] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:13.557428] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:13.558519] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 45574 primary records. [2025-10-03T22:37:13.558803] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-03T22:37:13.580298] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-10-03T22:37:13.583991] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-03T22:37:13.587441] [INFO ] [MAIN ] Derivative Progress: 515/2073 symbols completed. DGX took 1.2s. Estimated remaining: 10m 52s. Rate: 143.4 symbols/min [2025-10-03T22:37:13.588040] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:13.602145] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:13.602994] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48575 primary records. [2025-10-03T22:37:13.608363] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-03T22:37:13.608751] [DEBUG] [LOCAL ] DHX: Loaded 13198 existing records from primary storage. [2025-10-03T22:37:13.608892] [INFO ] [MAIN ] DHX: Loaded 13198 primary data records. [2025-10-03T22:37:13.739800] [DEBUG] [LOCAL ] DIAX: Loaded 13148 existing records from primary storage. [2025-10-03T22:37:13.744544] [INFO ] [MAIN ] DIAX: Loaded 13148 primary data records. [2025-10-03T22:37:13.767743] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-10-03T22:37:13.778701] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-03T22:37:13.806056] [INFO ] [MAIN ] Derivative Progress: 516/2073 symbols completed. DHT took 1.4s. Estimated remaining: 10m 51s. Rate: 143.5 symbols/min [2025-10-03T22:37:13.816574] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:14.364471] [DEBUG] [LOCAL ] DIN: Loaded 37756 existing records from primary storage. [2025-10-03T22:37:14.365707] [INFO ] [MAIN ] DIN: Loaded 37756 primary data records. [2025-10-03T22:37:14.437609] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:14.452880] [INFO ] [MAIN ] DHX: Generated 1820 derivative records from 13198 primary records. [2025-10-03T22:37:14.470324] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-03T22:37:14.700104] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:14.716116] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 13148 primary records. [2025-10-03T22:37:14.716956] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-03T22:37:14.727477] [DEBUG] [LOCAL ] DHX: Derivative data saved (1820 records). [2025-10-03T22:37:14.730355] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-03T22:37:14.737292] [INFO ] [MAIN ] Derivative Progress: 517/2073 symbols completed. DHX took 1.2s. Estimated remaining: 10m 52s. Rate: 143.2 symbols/min [2025-10-03T22:37:14.738610] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-10-03T22:37:14.738864] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-03T22:37:14.743284] [INFO ] [MAIN ] Derivative Progress: 518/2073 symbols completed. DIAX took 1.2s. Estimated remaining: 10m 50s. Rate: 143.4 symbols/min [2025-10-03T22:37:14.739767] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:14.744393] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:14.770105] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:14.771112] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37756 primary records. [2025-10-03T22:37:14.771217] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-03T22:37:14.789136] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-10-03T22:37:14.789289] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-03T22:37:14.792443] [INFO ] [MAIN ] Derivative Progress: 519/2073 symbols completed. DIN took 1.0s. Estimated remaining: 10m 49s. Rate: 143.7 symbols/min [2025-10-03T22:37:14.793021] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:14.879401] [DEBUG] [LOCAL ] DINO: Loaded 53696 existing records from primary storage. [2025-10-03T22:37:14.879565] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-03T22:37:14.879987] [INFO ] [MAIN ] DINO: Loaded 53696 primary data records. [2025-10-03T22:37:14.880280] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-10-03T22:37:15.156089] [DEBUG] [LOCAL ] DK: Loaded 50047 existing records from primary storage. [2025-10-03T22:37:15.185675] [INFO ] [MAIN ] DK: Loaded 50047 primary data records. [2025-10-03T22:37:15.969028] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:15.970713] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-10-03T22:37:15.969464] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:15.971805] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53696 primary records. [2025-10-03T22:37:15.972088] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-03T22:37:15.972669] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-03T22:37:16.022133] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-10-03T22:37:16.022408] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:16.024556] [INFO ] [MAIN ] DK: Generated 1820 derivative records from 50047 primary records. [2025-10-03T22:37:16.024703] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-03T22:37:16.025854] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-03T22:37:16.029308] [INFO ] [MAIN ] Derivative Progress: 520/2073 symbols completed. DINO took 1.3s. Estimated remaining: 10m 51s. Rate: 143.1 symbols/min [2025-10-03T22:37:16.025777] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-10-03T22:37:16.030272] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-03T22:37:16.030430] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:16.033627] [INFO ] [MAIN ] Derivative Progress: 521/2073 symbols completed. DIS took 1.3s. Estimated remaining: 10m 49s. Rate: 143.4 symbols/min [2025-10-03T22:37:16.042105] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:16.051768] [DEBUG] [LOCAL ] DK: Derivative data saved (1820 records). [2025-10-03T22:37:16.051931] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-03T22:37:16.056567] [INFO ] [MAIN ] Derivative Progress: 522/2073 symbols completed. DK took 1.3s. Estimated remaining: 10m 48s. Rate: 143.7 symbols/min [2025-10-03T22:37:16.057193] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:16.078851] [DEBUG] [LOCAL ] DKL: Loaded 18799 existing records from primary storage. [2025-10-03T22:37:16.079094] [INFO ] [MAIN ] DKL: Loaded 18799 primary data records. [2025-10-03T22:37:16.249516] [DEBUG] [LOCAL ] DLB: Loaded 32449 existing records from primary storage. [2025-10-03T22:37:16.249817] [INFO ] [MAIN ] DLB: Loaded 32449 primary data records. [2025-10-03T22:37:16.396033] [DEBUG] [LOCAL ] DKS: Loaded 50431 existing records from primary storage. [2025-10-03T22:37:16.597087] [INFO ] [MAIN ] DKS: Loaded 50431 primary data records. [2025-10-03T22:37:17.212521] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:17.214807] [INFO ] [MAIN ] DKL: Generated 1820 derivative records from 18799 primary records. [2025-10-03T22:37:17.218287] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-03T22:37:17.243498] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:17.248639] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32449 primary records. [2025-10-03T22:37:17.249080] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-03T22:37:17.287375] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:17.291664] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-10-03T22:37:17.290324] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50431 primary records. [2025-10-03T22:37:17.291909] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-03T22:37:17.292264] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-03T22:37:17.292135] [DEBUG] [LOCAL ] DKL: Derivative data saved (1820 records). [2025-10-03T22:37:17.297033] [INFO ] [MAIN ] Derivative Progress: 523/2073 symbols completed. DLB took 1.2s. Estimated remaining: 10m 50s. Rate: 143.1 symbols/min [2025-10-03T22:37:17.297455] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-03T22:37:17.301238] [INFO ] [MAIN ] Derivative Progress: 524/2073 symbols completed. DKL took 1.3s. Estimated remaining: 10m 48s. Rate: 143.4 symbols/min [2025-10-03T22:37:17.325919] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-10-03T22:37:17.326127] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-03T22:37:17.330181] [INFO ] [MAIN ] Derivative Progress: 525/2073 symbols completed. DKS took 1.3s. Estimated remaining: 10m 47s. Rate: 143.7 symbols/min [2025-10-03T22:37:17.330919] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:17.331017] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:17.331207] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:17.343840] [DEBUG] [LOCAL ] DLNG: Loaded 6166 existing records from primary storage. [2025-10-03T22:37:17.344009] [INFO ] [MAIN ] DLNG: Loaded 6166 primary data records. [2025-10-03T22:37:17.533395] [DEBUG] [LOCAL ] DLX: Loaded 28911 existing records from primary storage. [2025-10-03T22:37:17.574610] [INFO ] [MAIN ] DLX: Loaded 28911 primary data records. [2025-10-03T22:37:17.852941] [DEBUG] [LOCAL ] DLR: Loaded 51668 existing records from primary storage. [2025-10-03T22:37:17.870072] [INFO ] [MAIN ] DLR: Loaded 51668 primary data records. [2025-10-03T22:37:18.415714] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:18.417464] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6166 primary records. [2025-10-03T22:37:18.417893] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-03T22:37:18.440594] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-10-03T22:37:18.441320] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-03T22:37:18.444306] [INFO ] [MAIN ] Derivative Progress: 526/2073 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 48s. Rate: 143.2 symbols/min [2025-10-03T22:37:18.444734] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:18.460998] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:18.462306] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 28911 primary records. [2025-10-03T22:37:18.462796] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-03T22:37:18.481438] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-10-03T22:37:18.481741] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-03T22:37:18.485361] [INFO ] [MAIN ] Derivative Progress: 527/2073 symbols completed. DLX took 1.2s. Estimated remaining: 10m 47s. Rate: 143.5 symbols/min [2025-10-03T22:37:18.485841] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:18.513834] [DEBUG] [LOCAL ] DMA: Loaded 4595 existing records from primary storage. [2025-10-03T22:37:18.523241] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:18.523402] [INFO ] [MAIN ] DMA: Loaded 4595 primary data records. [2025-10-03T22:37:18.529193] [DEBUG] [LOCAL ] DLY: Loaded 20380 existing records from primary storage. [2025-10-03T22:37:18.557039] [INFO ] [MAIN ] DLY: Loaded 20380 primary data records. [2025-10-03T22:37:18.563173] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51668 primary records. [2025-10-03T22:37:18.600181] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-03T22:37:18.911272] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-10-03T22:37:18.949892] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-03T22:37:18.968780] [INFO ] [MAIN ] Derivative Progress: 528/2073 symbols completed. DLR took 1.6s. Estimated remaining: 10m 46s. Rate: 143.4 symbols/min [2025-10-03T22:37:18.969160] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:19.277617] [DEBUG] [LOCAL ] DMB: Loaded 10319 existing records from primary storage. [2025-10-03T22:37:19.278463] [INFO ] [MAIN ] DMB: Loaded 10319 primary data records. [2025-10-03T22:37:19.626942] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:19.640185] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:19.642274] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 20380 primary records. [2025-10-03T22:37:19.641183] [INFO ] [MAIN ] DMA: Generated 1820 derivative records from 4595 primary records. [2025-10-03T22:37:19.642526] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-03T22:37:19.643114] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-03T22:37:19.677824] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-10-03T22:37:19.679707] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-03T22:37:19.684739] [INFO ] [MAIN ] Derivative Progress: 529/2073 symbols completed. DLY took 1.2s. Estimated remaining: 10m 47s. Rate: 143.2 symbols/min [2025-10-03T22:37:19.686335] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:19.689147] [DEBUG] [LOCAL ] DMA: Derivative data saved (1820 records). [2025-10-03T22:37:19.689552] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-03T22:37:19.693147] [INFO ] [MAIN ] Derivative Progress: 530/2073 symbols completed. DMA took 1.2s. Estimated remaining: 10m 45s. Rate: 143.5 symbols/min [2025-10-03T22:37:19.693568] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:19.715683] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:19.722512] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10319 primary records. [2025-10-03T22:37:19.723210] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-03T22:37:19.723028] [DEBUG] [LOCAL ] DMO: Loaded 10026 existing records from primary storage. [2025-10-03T22:37:19.724035] [INFO ] [MAIN ] DMO: Loaded 10026 primary data records. [2025-10-03T22:37:19.843009] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-10-03T22:37:19.867976] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-03T22:37:19.871577] [INFO ] [MAIN ] Derivative Progress: 531/2073 symbols completed. DMB took 0.9s. Estimated remaining: 10m 44s. Rate: 143.6 symbols/min [2025-10-03T22:37:19.882435] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:20.088263] [DEBUG] [LOCAL ] DNA: Loaded 49019 existing records from primary storage. [2025-10-03T22:37:20.088567] [INFO ] [MAIN ] DNA: Loaded 49019 primary data records. [2025-10-03T22:37:20.438156] [DEBUG] [LOCAL ] DNOW: Loaded 44313 existing records from primary storage. [2025-10-03T22:37:20.439530] [INFO ] [MAIN ] DNOW: Loaded 44313 primary data records. [2025-10-03T22:37:20.627715] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:20.669710] [INFO ] [MAIN ] DMO: Generated 1820 derivative records from 10026 primary records. [2025-10-03T22:37:20.853633] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-03T22:37:20.900043] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:20.903071] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 49019 primary records. [2025-10-03T22:37:20.903742] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-03T22:37:20.907281] [DEBUG] [LOCAL ] DMO: Derivative data saved (1820 records). [2025-10-03T22:37:20.919774] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-03T22:37:20.922968] [INFO ] [MAIN ] Derivative Progress: 532/2073 symbols completed. DMO took 1.2s. Estimated remaining: 10m 46s. Rate: 143.2 symbols/min [2025-10-03T22:37:20.923419] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:20.932003] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-10-03T22:37:20.932397] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-03T22:37:20.935411] [INFO ] [MAIN ] Derivative Progress: 533/2073 symbols completed. DNA took 1.2s. Estimated remaining: 10m 44s. Rate: 143.5 symbols/min [2025-10-03T22:37:20.935938] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:20.954581] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:20.955551] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44313 primary records. [2025-10-03T22:37:20.955855] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-03T22:37:20.992934] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-10-03T22:37:20.994346] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-03T22:37:20.997571] [INFO ] [MAIN ] Derivative Progress: 534/2073 symbols completed. DNOW took 1.1s. Estimated remaining: 10m 42s. Rate: 143.7 symbols/min [2025-10-03T22:37:20.999234] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:20.999114] [DEBUG] [LOCAL ] DNP: Loaded 33654 existing records from primary storage. [2025-10-03T22:37:20.999692] [INFO ] [MAIN ] DNP: Loaded 33654 primary data records. [2025-10-03T22:37:21.347224] [DEBUG] [LOCAL ] DOC: Loaded 54318 existing records from primary storage. [2025-10-03T22:37:21.347608] [INFO ] [MAIN ] DOC: Loaded 54318 primary data records. [2025-10-03T22:37:21.481925] [DEBUG] [LOCAL ] DOCN: Loaded 51332 existing records from primary storage. [2025-10-03T22:37:21.482796] [INFO ] [MAIN ] DOCN: Loaded 51332 primary data records. [2025-10-03T22:37:22.050481] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:22.051934] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33654 primary records. [2025-10-03T22:37:22.052137] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-03T22:37:22.075467] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-10-03T22:37:22.076619] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-03T22:37:22.080244] [INFO ] [MAIN ] Derivative Progress: 535/2073 symbols completed. DNP took 1.2s. Estimated remaining: 10m 44s. Rate: 143.3 symbols/min [2025-10-03T22:37:22.080665] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:22.094880] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:22.096131] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54318 primary records. [2025-10-03T22:37:22.096236] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-03T22:37:22.130459] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:22.131048] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-10-03T22:37:22.131226] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-03T22:37:22.134769] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51332 primary records. [2025-10-03T22:37:22.133883] [INFO ] [MAIN ] Derivative Progress: 536/2073 symbols completed. DOC took 1.2s. Estimated remaining: 10m 43s. Rate: 143.5 symbols/min [2025-10-03T22:37:22.135486] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-03T22:37:22.135404] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:22.164406] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-10-03T22:37:22.164564] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-03T22:37:22.168494] [INFO ] [MAIN ] Derivative Progress: 537/2073 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 41s. Rate: 143.8 symbols/min [2025-10-03T22:37:22.168961] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:22.200295] [DEBUG] [LOCAL ] DOLE: Loaded 39011 existing records from primary storage. [2025-10-03T22:37:22.200550] [INFO ] [MAIN ] DOLE: Loaded 39011 primary data records. [2025-10-03T22:37:22.294778] [DEBUG] [LOCAL ] DPG: Loaded 13698 existing records from primary storage. [2025-10-03T22:37:22.329074] [INFO ] [MAIN ] DPG: Loaded 13698 primary data records. [2025-10-03T22:37:22.367247] [DEBUG] [LOCAL ] DOUG: Loaded 34792 existing records from primary storage. [2025-10-03T22:37:22.475883] [INFO ] [MAIN ] DOUG: Loaded 34792 primary data records. [2025-10-03T22:37:23.270629] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:23.272189] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 39011 primary records. [2025-10-03T22:37:23.272548] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-03T22:37:23.318097] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:23.319637] [INFO ] [MAIN ] DPG: Generated 1820 derivative records from 13698 primary records. [2025-10-03T22:37:23.320063] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-03T22:37:23.319988] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:23.322028] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 34792 primary records. [2025-10-03T22:37:23.322322] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-03T22:37:23.348890] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-10-03T22:37:23.349010] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-03T22:37:23.355084] [INFO ] [MAIN ] Derivative Progress: 538/2073 symbols completed. DOLE took 1.3s. Estimated remaining: 10m 43s. Rate: 143.3 symbols/min [2025-10-03T22:37:23.358403] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-10-03T22:37:23.359914] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-03T22:37:23.360530] [DEBUG] [LOCAL ] DPG: Derivative data saved (1820 records). [2025-10-03T22:37:23.364048] [INFO ] [MAIN ] Derivative Progress: 539/2073 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 41s. Rate: 143.5 symbols/min [2025-10-03T22:37:23.364162] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-03T22:37:23.368167] [INFO ] [MAIN ] Derivative Progress: 540/2073 symbols completed. DPG took 1.2s. Estimated remaining: 10m 40s. Rate: 143.8 symbols/min [2025-10-03T22:37:23.368848] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:23.368957] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:23.369022] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:23.448375] [DEBUG] [LOCAL ] DRI: Loaded 48491 existing records from primary storage. [2025-10-03T22:37:23.460009] [INFO ] [MAIN ] DRI: Loaded 48491 primary data records. [2025-10-03T22:37:23.472248] [DEBUG] [LOCAL ] DRD: Loaded 37644 existing records from primary storage. [2025-10-03T22:37:23.497911] [INFO ] [MAIN ] DRD: Loaded 37644 primary data records. [2025-10-03T22:37:23.559316] [DEBUG] [LOCAL ] DQ: Loaded 44035 existing records from primary storage. [2025-10-03T22:37:23.587286] [INFO ] [MAIN ] DQ: Loaded 44035 primary data records. [2025-10-03T22:37:24.475079] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:24.476174] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48491 primary records. [2025-10-03T22:37:24.476369] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-03T22:37:24.492743] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:24.502704] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37644 primary records. [2025-10-03T22:37:24.509538] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-03T22:37:24.513634] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-10-03T22:37:24.514153] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-03T22:37:24.530396] [INFO ] [MAIN ] Derivative Progress: 541/2073 symbols completed. DRI took 1.2s. Estimated remaining: 10m 41s. Rate: 143.3 symbols/min [2025-10-03T22:37:24.540546] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:24.554252] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-10-03T22:37:24.555550] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-03T22:37:24.560233] [INFO ] [MAIN ] Derivative Progress: 542/2073 symbols completed. DRD took 1.2s. Estimated remaining: 10m 40s. Rate: 143.6 symbols/min [2025-10-03T22:37:24.560873] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:24.556099] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:24.562571] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 44035 primary records. [2025-10-03T22:37:24.563418] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-03T22:37:24.583571] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-10-03T22:37:24.583956] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-03T22:37:24.587955] [INFO ] [MAIN ] Derivative Progress: 543/2073 symbols completed. DQ took 1.2s. Estimated remaining: 10m 38s. Rate: 143.8 symbols/min [2025-10-03T22:37:24.593907] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:24.617452] [DEBUG] [LOCAL ] DSMC: Loaded 1903 existing records from primary storage. [2025-10-03T22:37:24.618226] [INFO ] [MAIN ] DSMC: Loaded 1903 primary data records. [2025-10-03T22:37:24.618109] [DEBUG] [LOCAL ] DSM: Loaded 15256 existing records from primary storage. [2025-10-03T22:37:24.630026] [INFO ] [MAIN ] DSM: Loaded 15256 primary data records. [2025-10-03T22:37:24.811901] [DEBUG] [LOCAL ] DSL: Loaded 28880 existing records from primary storage. [2025-10-03T22:37:24.840474] [INFO ] [MAIN ] DSL: Loaded 28880 primary data records. [2025-10-03T22:37:25.686163] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:25.687075] [INFO ] [MAIN ] DSMC: Generated 1820 derivative records from 1903 primary records. [2025-10-03T22:37:25.688022] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-03T22:37:25.724378] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1820 records). [2025-10-03T22:37:25.733814] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-03T22:37:25.736680] [INFO ] [MAIN ] Derivative Progress: 544/2073 symbols completed. DSMC took 1.1s. Estimated remaining: 10m 40s. Rate: 143.4 symbols/min [2025-10-03T22:37:25.733631] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:25.743044] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 15256 primary records. [2025-10-03T22:37:25.743270] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-03T22:37:25.744355] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:25.744845] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:25.746809] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 28880 primary records. [2025-10-03T22:37:25.747363] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-03T22:37:25.787342] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-10-03T22:37:25.787518] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-03T22:37:25.791045] [INFO ] [MAIN ] Derivative Progress: 545/2073 symbols completed. DSL took 1.3s. Estimated remaining: 10m 38s. Rate: 143.6 symbols/min [2025-10-03T22:37:25.787618] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-10-03T22:37:25.791509] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:25.791381] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-03T22:37:25.802441] [INFO ] [MAIN ] Derivative Progress: 546/2073 symbols completed. DSM took 1.2s. Estimated remaining: 10m 37s. Rate: 143.9 symbols/min [2025-10-03T22:37:25.804187] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:25.805481] [DEBUG] [LOCAL ] DSU: Loaded 22916 existing records from primary storage. [2025-10-03T22:37:25.805762] [INFO ] [MAIN ] DSU: Loaded 22916 primary data records. [2025-10-03T22:37:26.180411] [DEBUG] [LOCAL ] DT: Loaded 53705 existing records from primary storage. [2025-10-03T22:37:26.181550] [INFO ] [MAIN ] DT: Loaded 53705 primary data records. [2025-10-03T22:37:26.276745] [DEBUG] [LOCAL ] DTE: Loaded 48375 existing records from primary storage. [2025-10-03T22:37:26.296115] [INFO ] [MAIN ] DTE: Loaded 48375 primary data records. [2025-10-03T22:37:26.882522] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:26.884438] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 22916 primary records. [2025-10-03T22:37:26.884986] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-03T22:37:26.904797] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-10-03T22:37:26.905588] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-03T22:37:26.908744] [INFO ] [MAIN ] Derivative Progress: 547/2073 symbols completed. DSU took 1.2s. Estimated remaining: 10m 38s. Rate: 143.4 symbols/min [2025-10-03T22:37:26.909241] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:26.924822] [DEBUG] [LOCAL ] DTG: Loaded 6011 existing records from primary storage. [2025-10-03T22:37:26.925318] [INFO ] [MAIN ] DTG: Loaded 6011 primary data records. [2025-10-03T22:37:26.996517] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:27.012248] [INFO ] [MAIN ] DT: Generated 1820 derivative records from 53705 primary records. [2025-10-03T22:37:27.012626] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-03T22:37:27.203982] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:27.244580] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48375 primary records. [2025-10-03T22:37:27.369070] [DEBUG] [LOCAL ] DT: Derivative data saved (1820 records). [2025-10-03T22:37:27.369433] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-03T22:37:27.369480] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-03T22:37:27.373344] [INFO ] [MAIN ] Derivative Progress: 548/2073 symbols completed. DT took 1.6s. Estimated remaining: 10m 38s. Rate: 143.4 symbols/min [2025-10-03T22:37:27.374041] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:27.395689] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-10-03T22:37:27.396965] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-03T22:37:27.400347] [INFO ] [MAIN ] Derivative Progress: 549/2073 symbols completed. DTE took 1.6s. Estimated remaining: 10m 37s. Rate: 143.6 symbols/min [2025-10-03T22:37:27.400765] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:27.429508] [DEBUG] [LOCAL ] DUKB: Loaded 6427 existing records from primary storage. [2025-10-03T22:37:27.430089] [INFO ] [MAIN ] DUKB: Loaded 6427 primary data records. [2025-10-03T22:37:27.429870] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:27.430995] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 6011 primary records. [2025-10-03T22:37:27.431204] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-03T22:37:27.600354] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-10-03T22:37:27.654941] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-03T22:37:27.666891] [INFO ] [MAIN ] Derivative Progress: 550/2073 symbols completed. DTG took 0.8s. Estimated remaining: 10m 36s. Rate: 143.7 symbols/min [2025-10-03T22:37:27.686864] [DEBUG] [LOCAL ] DUK: Loaded 54233 existing records from primary storage. [2025-10-03T22:37:27.692746] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:27.692884] [INFO ] [MAIN ] DUK: Loaded 54233 primary data records. [2025-10-03T22:37:28.205761] [DEBUG] [LOCAL ] DV: Loaded 52046 existing records from primary storage. [2025-10-03T22:37:28.206699] [INFO ] [MAIN ] DV: Loaded 52046 primary data records. [2025-10-03T22:37:28.324189] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:28.346192] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6427 primary records. [2025-10-03T22:37:28.346960] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-03T22:37:28.423530] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-10-03T22:37:28.426968] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-03T22:37:28.447139] [INFO ] [MAIN ] Derivative Progress: 551/2073 symbols completed. DUKB took 1.0s. Estimated remaining: 10m 36s. Rate: 143.5 symbols/min [2025-10-03T22:37:28.453863] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:28.605482] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:28.606891] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54233 primary records. [2025-10-03T22:37:28.607080] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-03T22:37:28.628402] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-10-03T22:37:28.628560] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-03T22:37:28.632736] [INFO ] [MAIN ] Derivative Progress: 552/2073 symbols completed. DUK took 1.3s. Estimated remaining: 10m 35s. Rate: 143.6 symbols/min [2025-10-03T22:37:28.633019] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:28.651552] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:28.652296] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52046 primary records. [2025-10-03T22:37:28.652418] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-03T22:37:28.681795] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-10-03T22:37:28.682081] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-03T22:37:28.685192] [INFO ] [MAIN ] Derivative Progress: 553/2073 symbols completed. DV took 1.0s. Estimated remaining: 10m 34s. Rate: 143.9 symbols/min [2025-10-03T22:37:28.699167] [DEBUG] [LOCAL ] DVA: Loaded 41630 existing records from primary storage. [2025-10-03T22:37:28.699418] [INFO ] [MAIN ] DVA: Loaded 41630 primary data records. [2025-10-03T22:37:29.020896] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-03T22:37:29.029824] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-10-03T22:37:29.440381] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:29.442749] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41630 primary records. [2025-10-03T22:37:29.442965] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-03T22:37:29.461145] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-10-03T22:37:29.461368] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-03T22:37:29.464877] [INFO ] [MAIN ] Derivative Progress: 554/2073 symbols completed. DVA took 1.0s. Estimated remaining: 10m 34s. Rate: 143.6 symbols/min [2025-10-03T22:37:29.482721] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:29.483812] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-10-03T22:37:29.483885] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-03T22:37:29.501854] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-10-03T22:37:29.502037] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-03T22:37:29.505007] [INFO ] [MAIN ] Derivative Progress: 555/2073 symbols completed. DVN took 0.9s. Estimated remaining: 10m 33s. Rate: 143.9 symbols/min [2025-10-03T22:37:29.505785] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:29.505974] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:29.507304] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:29.563791] [DEBUG] [LOCAL ] DXYZ: Loaded 37604 existing records from primary storage. [2025-10-03T22:37:29.563984] [INFO ] [MAIN ] DXYZ: Loaded 37604 primary data records. [2025-10-03T22:37:29.714398] [DEBUG] [LOCAL ] DXC: Loaded 50520 existing records from primary storage. [2025-10-03T22:37:29.715067] [INFO ] [MAIN ] DXC: Loaded 50520 primary data records. [2025-10-03T22:37:29.991252] [DEBUG] [LOCAL ] DX: Loaded 53234 existing records from primary storage. [2025-10-03T22:37:30.033018] [INFO ] [MAIN ] DX: Loaded 53234 primary data records. [2025-10-03T22:37:30.696029] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:37:30.697825] [INFO ] [MAIN ] DXYZ: Generated 1819 derivative records from 37604 primary records. [2025-10-03T22:37:30.698215] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-03T22:37:30.738284] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:30.739618] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1819 records). [2025-10-03T22:37:30.740690] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50520 primary records. [2025-10-03T22:37:30.741109] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-03T22:37:30.741419] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-03T22:37:30.744428] [INFO ] [MAIN ] Derivative Progress: 556/2073 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 35s. Rate: 143.4 symbols/min [2025-10-03T22:37:30.744857] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:30.767372] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-10-03T22:37:30.780561] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-03T22:37:30.783871] [INFO ] [MAIN ] Derivative Progress: 557/2073 symbols completed. DXC took 1.3s. Estimated remaining: 10m 33s. Rate: 143.6 symbols/min [2025-10-03T22:37:30.784493] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:30.784328] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:30.786007] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53234 primary records. [2025-10-03T22:37:30.786231] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-03T22:37:30.815941] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-10-03T22:37:30.816037] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-03T22:37:30.819203] [INFO ] [MAIN ] Derivative Progress: 558/2073 symbols completed. DX took 1.3s. Estimated remaining: 10m 32s. Rate: 143.8 symbols/min [2025-10-03T22:37:30.820014] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:30.833368] [DEBUG] [LOCAL ] DY: Loaded 29368 existing records from primary storage. [2025-10-03T22:37:30.833687] [INFO ] [MAIN ] DY: Loaded 29368 primary data records. [2025-10-03T22:37:31.005727] [DEBUG] [LOCAL ] EAF: Loaded 43181 existing records from primary storage. [2025-10-03T22:37:31.025396] [INFO ] [MAIN ] EAF: Loaded 43181 primary data records. [2025-10-03T22:37:31.304817] [DEBUG] [LOCAL ] EARN: Loaded 30021 existing records from primary storage. [2025-10-03T22:37:31.330435] [INFO ] [MAIN ] EARN: Loaded 30021 primary data records. [2025-10-03T22:37:32.003692] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:32.005842] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 29368 primary records. [2025-10-03T22:37:32.006312] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-03T22:37:32.030504] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-10-03T22:37:32.031996] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-03T22:37:32.034858] [INFO ] [MAIN ] Derivative Progress: 559/2073 symbols completed. DY took 1.3s. Estimated remaining: 10m 34s. Rate: 143.4 symbols/min [2025-10-03T22:37:32.036459] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:32.054306] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:32.058350] [INFO ] [MAIN ] EAF: Generated 1820 derivative records from 43181 primary records. [2025-10-03T22:37:32.058758] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-03T22:37:32.081980] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:32.086091] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 30021 primary records. [2025-10-03T22:37:32.086796] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-03T22:37:32.108558] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-10-03T22:37:32.109325] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-03T22:37:32.109703] [DEBUG] [LOCAL ] EAF: Derivative data saved (1820 records). [2025-10-03T22:37:32.113078] [INFO ] [MAIN ] Derivative Progress: 560/2073 symbols completed. EARN took 1.3s. Estimated remaining: 10m 32s. Rate: 143.6 symbols/min [2025-10-03T22:37:32.109879] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-03T22:37:32.128614] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:32.128708] [INFO ] [MAIN ] Derivative Progress: 561/2073 symbols completed. EAF took 1.3s. Estimated remaining: 10m 31s. Rate: 143.8 symbols/min [2025-10-03T22:37:32.129168] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:32.146980] [DEBUG] [LOCAL ] EB: Loaded 37650 existing records from primary storage. [2025-10-03T22:37:32.147193] [INFO ] [MAIN ] EB: Loaded 37650 primary data records. [2025-10-03T22:37:32.250561] [DEBUG] [LOCAL ] EBF: Loaded 19506 existing records from primary storage. [2025-10-03T22:37:32.272098] [INFO ] [MAIN ] EBF: Loaded 19506 primary data records. [2025-10-03T22:37:32.514941] [DEBUG] [LOCAL ] EBR: Loaded 43694 existing records from primary storage. [2025-10-03T22:37:32.636127] [INFO ] [MAIN ] EBR: Loaded 43694 primary data records. [2025-10-03T22:37:33.214342] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:33.217066] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 37650 primary records. [2025-10-03T22:37:33.217761] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-03T22:37:33.250994] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-10-03T22:37:33.251590] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-03T22:37:33.251420] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:33.254517] [INFO ] [MAIN ] Derivative Progress: 562/2073 symbols completed. EB took 1.2s. Estimated remaining: 10m 32s. Rate: 143.4 symbols/min [2025-10-03T22:37:33.255974] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19506 primary records. [2025-10-03T22:37:33.254896] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:33.256860] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-03T22:37:33.280335] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-10-03T22:37:33.280806] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-03T22:37:33.284620] [INFO ] [MAIN ] Derivative Progress: 563/2073 symbols completed. EBF took 1.2s. Estimated remaining: 10m 31s. Rate: 143.6 symbols/min [2025-10-03T22:37:33.292934] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:33.298841] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:33.300526] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43694 primary records. [2025-10-03T22:37:33.300741] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-03T22:37:33.318175] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-10-03T22:37:33.318348] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-03T22:37:33.321829] [INFO ] [MAIN ] Derivative Progress: 564/2073 symbols completed. EBR took 1.2s. Estimated remaining: 10m 29s. Rate: 143.8 symbols/min [2025-10-03T22:37:33.322091] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:33.358808] [DEBUG] [LOCAL ] EBS: Loaded 47245 existing records from primary storage. [2025-10-03T22:37:33.359201] [INFO ] [MAIN ] EBS: Loaded 47245 primary data records. [2025-10-03T22:37:33.558160] [DEBUG] [LOCAL ] ECAT: Loaded 29940 existing records from primary storage. [2025-10-03T22:37:33.570892] [DEBUG] [LOCAL ] EC: Loaded 49923 existing records from primary storage. [2025-10-03T22:37:33.592256] [INFO ] [MAIN ] EC: Loaded 49923 primary data records. [2025-10-03T22:37:33.586835] [INFO ] [MAIN ] ECAT: Loaded 29940 primary data records. [2025-10-03T22:37:34.529254] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:34.530964] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47245 primary records. [2025-10-03T22:37:34.531446] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-03T22:37:34.552691] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-10-03T22:37:34.553278] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-03T22:37:34.557266] [INFO ] [MAIN ] Derivative Progress: 565/2073 symbols completed. EBS took 1.3s. Estimated remaining: 10m 31s. Rate: 143.3 symbols/min [2025-10-03T22:37:34.557707] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:34.574937] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:34.576214] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 29940 primary records. [2025-10-03T22:37:34.576499] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-03T22:37:34.600921] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-10-03T22:37:34.601181] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-03T22:37:34.605063] [INFO ] [MAIN ] Derivative Progress: 566/2073 symbols completed. ECAT took 1.3s. Estimated remaining: 10m 30s. Rate: 143.6 symbols/min [2025-10-03T22:37:34.605593] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:34.621127] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:34.622191] [INFO ] [MAIN ] EC: Generated 1820 derivative records from 49923 primary records. [2025-10-03T22:37:34.623016] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-03T22:37:34.655126] [DEBUG] [LOCAL ] EC: Derivative data saved (1820 records). [2025-10-03T22:37:34.655392] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-03T22:37:34.658890] [INFO ] [MAIN ] Derivative Progress: 567/2073 symbols completed. EC took 1.4s. Estimated remaining: 10m 28s. Rate: 143.8 symbols/min [2025-10-03T22:37:34.659367] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:34.686496] [DEBUG] [LOCAL ] ECC: Loaded 43966 existing records from primary storage. [2025-10-03T22:37:34.686848] [INFO ] [MAIN ] ECC: Loaded 43966 primary data records. [2025-10-03T22:37:34.808924] [DEBUG] [LOCAL ] ECG: Loaded 34260 existing records from primary storage. [2025-10-03T22:37:34.825532] [INFO ] [MAIN ] ECG: Loaded 34260 primary data records. [2025-10-03T22:37:35.159490] [DEBUG] [LOCAL ] ECL: Loaded 47436 existing records from primary storage. [2025-10-03T22:37:35.160507] [INFO ] [MAIN ] ECL: Loaded 47436 primary data records. [2025-10-03T22:37:35.739075] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:35.741830] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 43966 primary records. [2025-10-03T22:37:35.741953] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-03T22:37:35.761874] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-10-03T22:37:35.762562] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-03T22:37:35.765733] [INFO ] [MAIN ] Derivative Progress: 568/2073 symbols completed. ECC took 1.2s. Estimated remaining: 10m 30s. Rate: 143.4 symbols/min [2025-10-03T22:37:35.784876] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:35.785935] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 34260 primary records. [2025-10-03T22:37:35.786027] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-03T22:37:35.819138] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-10-03T22:37:35.819246] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-03T22:37:35.818023] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:35.822810] [INFO ] [MAIN ] Derivative Progress: 569/2073 symbols completed. ECG took 1.2s. Estimated remaining: 10m 28s. Rate: 143.6 symbols/min [2025-10-03T22:37:35.823825] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47436 primary records. [2025-10-03T22:37:35.824166] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-03T22:37:35.841257] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-10-03T22:37:35.841326] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-03T22:37:35.845244] [INFO ] [MAIN ] Derivative Progress: 570/2073 symbols completed. ECL took 1.2s. Estimated remaining: 10m 27s. Rate: 143.8 symbols/min [2025-10-03T22:37:35.845868] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:35.846261] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:35.846048] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:35.874967] [DEBUG] [LOCAL ] ECO: Loaded 18643 existing records from primary storage. [2025-10-03T22:37:35.875191] [INFO ] [MAIN ] ECO: Loaded 18643 primary data records. [2025-10-03T22:37:36.102809] [DEBUG] [LOCAL ] ECVT: Loaded 43747 existing records from primary storage. [2025-10-03T22:37:36.273464] [INFO ] [MAIN ] ECVT: Loaded 43747 primary data records. [2025-10-03T22:37:36.301769] [DEBUG] [LOCAL ] ED: Loaded 53511 existing records from primary storage. [2025-10-03T22:37:36.324459] [INFO ] [MAIN ] ED: Loaded 53511 primary data records. [2025-10-03T22:37:36.929631] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:36.931012] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18643 primary records. [2025-10-03T22:37:36.931751] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-03T22:37:36.950663] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-10-03T22:37:36.951432] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-03T22:37:36.954952] [INFO ] [MAIN ] Derivative Progress: 571/2073 symbols completed. ECO took 1.1s. Estimated remaining: 10m 28s. Rate: 143.4 symbols/min [2025-10-03T22:37:36.955342] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:36.975267] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:36.976454] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43747 primary records. [2025-10-03T22:37:36.976634] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-03T22:37:36.998043] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:37.003021] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53511 primary records. [2025-10-03T22:37:37.004807] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-03T22:37:37.030776] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-10-03T22:37:37.032286] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-03T22:37:37.035471] [INFO ] [MAIN ] Derivative Progress: 572/2073 symbols completed. ECVT took 1.2s. Estimated remaining: 10m 27s. Rate: 143.6 symbols/min [2025-10-03T22:37:37.036022] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:37.039386] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-10-03T22:37:37.040190] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-03T22:37:37.045402] [INFO ] [MAIN ] Derivative Progress: 573/2073 symbols completed. ED took 1.2s. Estimated remaining: 10m 26s. Rate: 143.9 symbols/min [2025-10-03T22:37:37.055604] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:37.057004] [DEBUG] [LOCAL ] EDD: Loaded 27540 existing records from primary storage. [2025-10-03T22:37:37.057088] [INFO ] [MAIN ] EDD: Loaded 27540 primary data records. [2025-10-03T22:37:37.166726] [DEBUG] [LOCAL ] EDF: Loaded 13491 existing records from primary storage. [2025-10-03T22:37:37.179785] [INFO ] [MAIN ] EDF: Loaded 13491 primary data records. [2025-10-03T22:37:37.330361] [DEBUG] [LOCAL ] EDN: Loaded 18464 existing records from primary storage. [2025-10-03T22:37:37.372076] [INFO ] [MAIN ] EDN: Loaded 18464 primary data records. [2025-10-03T22:37:38.142963] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:38.144151] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27540 primary records. [2025-10-03T22:37:38.145637] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-03T22:37:38.183413] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:38.183538] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-10-03T22:37:38.184953] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-03T22:37:38.187879] [INFO ] [MAIN ] Derivative Progress: 574/2073 symbols completed. EDD took 1.2s. Estimated remaining: 10m 27s. Rate: 143.4 symbols/min [2025-10-03T22:37:38.189627] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13491 primary records. [2025-10-03T22:37:38.189978] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:38.190156] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-03T22:37:38.205742] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:38.213417] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18464 primary records. [2025-10-03T22:37:38.218040] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-03T22:37:38.237597] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-10-03T22:37:38.238630] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-03T22:37:38.243716] [INFO ] [MAIN ] Derivative Progress: 575/2073 symbols completed. EDF took 1.2s. Estimated remaining: 10m 26s. Rate: 143.6 symbols/min [2025-10-03T22:37:38.245393] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:38.249972] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-10-03T22:37:38.250149] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-03T22:37:38.253487] [INFO ] [MAIN ] Derivative Progress: 576/2073 symbols completed. EDN took 1.2s. Estimated remaining: 10m 24s. Rate: 143.9 symbols/min [2025-10-03T22:37:38.264961] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:38.285853] [DEBUG] [LOCAL ] EDU: Loaded 45595 existing records from primary storage. [2025-10-03T22:37:38.377614] [INFO ] [MAIN ] EDU: Loaded 45595 primary data records. [2025-10-03T22:37:38.509819] [DEBUG] [LOCAL ] EFR: Loaded 14886 existing records from primary storage. [2025-10-03T22:37:38.522954] [INFO ] [MAIN ] EFR: Loaded 14886 primary data records. [2025-10-03T22:37:38.885790] [DEBUG] [LOCAL ] EFC: Loaded 46894 existing records from primary storage. [2025-10-03T22:37:38.903609] [INFO ] [MAIN ] EFC: Loaded 46894 primary data records. [2025-10-03T22:37:39.452575] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:39.455415] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45595 primary records. [2025-10-03T22:37:39.455787] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-03T22:37:39.471723] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:39.486510] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 14886 primary records. [2025-10-03T22:37:39.486924] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-03T22:37:39.490108] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-10-03T22:37:39.490206] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-03T22:37:39.493885] [INFO ] [MAIN ] Derivative Progress: 577/2073 symbols completed. EDU took 1.3s. Estimated remaining: 10m 26s. Rate: 143.4 symbols/min [2025-10-03T22:37:39.494831] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:39.513972] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-10-03T22:37:39.514220] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-03T22:37:39.517840] [INFO ] [MAIN ] Derivative Progress: 578/2073 symbols completed. EFR took 1.3s. Estimated remaining: 10m 25s. Rate: 143.6 symbols/min [2025-10-03T22:37:39.518697] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:39.541608] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:39.548687] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 46894 primary records. [2025-10-03T22:37:39.548974] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-03T22:37:39.550581] [DEBUG] [LOCAL ] EFT: Loaded 13268 existing records from primary storage. [2025-10-03T22:37:39.551317] [INFO ] [MAIN ] EFT: Loaded 13268 primary data records. [2025-10-03T22:37:39.654540] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-10-03T22:37:39.667977] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-03T22:37:39.684506] [INFO ] [MAIN ] Derivative Progress: 579/2073 symbols completed. EFC took 1.4s. Estimated remaining: 10m 23s. Rate: 143.8 symbols/min [2025-10-03T22:37:39.691782] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:39.719354] [DEBUG] [LOCAL ] EFXT: Loaded 29657 existing records from primary storage. [2025-10-03T22:37:39.731305] [INFO ] [MAIN ] EFXT: Loaded 29657 primary data records. [2025-10-03T22:37:40.331498] [DEBUG] [LOCAL ] EG: Loaded 28480 existing records from primary storage. [2025-10-03T22:37:40.341752] [INFO ] [MAIN ] EG: Loaded 28480 primary data records. [2025-10-03T22:37:40.566472] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:40.683270] [INFO ] [MAIN ] EFT: Generated 1820 derivative records from 13268 primary records. [2025-10-03T22:37:40.684038] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-03T22:37:40.710749] [DEBUG] [LOCAL ] EFT: Derivative data saved (1820 records). [2025-10-03T22:37:40.711329] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-03T22:37:40.716197] [INFO ] [MAIN ] Derivative Progress: 580/2073 symbols completed. EFT took 1.2s. Estimated remaining: 10m 25s. Rate: 143.4 symbols/min [2025-10-03T22:37:40.717035] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:40.732498] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:40.734248] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 29657 primary records. [2025-10-03T22:37:40.734538] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-03T22:37:40.754714] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-10-03T22:37:40.756786] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-03T22:37:40.761171] [INFO ] [MAIN ] Derivative Progress: 581/2073 symbols completed. EFXT took 1.2s. Estimated remaining: 10m 23s. Rate: 143.6 symbols/min [2025-10-03T22:37:40.761709] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:40.775822] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:40.776761] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 28480 primary records. [2025-10-03T22:37:40.776900] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-03T22:37:40.794615] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-10-03T22:37:40.794964] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-03T22:37:40.798223] [INFO ] [MAIN ] Derivative Progress: 582/2073 symbols completed. EG took 1.1s. Estimated remaining: 10m 22s. Rate: 143.9 symbols/min [2025-10-03T22:37:40.815438] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:40.894957] [DEBUG] [LOCAL ] EGO: Loaded 52369 existing records from primary storage. [2025-10-03T22:37:40.895279] [INFO ] [MAIN ] EGO: Loaded 52369 primary data records. [2025-10-03T22:37:40.896007] [DEBUG] [LOCAL ] EGP: Loaded 31284 existing records from primary storage. [2025-10-03T22:37:40.908714] [INFO ] [MAIN ] EGP: Loaded 31284 primary data records. [2025-10-03T22:37:41.058715] [DEBUG] [LOCAL ] EHAB: Loaded 29954 existing records from primary storage. [2025-10-03T22:37:41.099406] [INFO ] [MAIN ] EHAB: Loaded 29954 primary data records. [2025-10-03T22:37:41.950513] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:41.957729] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31284 primary records. [2025-10-03T22:37:41.956442] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:41.958046] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-03T22:37:41.959226] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52369 primary records. [2025-10-03T22:37:41.959698] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-03T22:37:41.999411] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-10-03T22:37:42.008705] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-03T22:37:42.013217] [INFO ] [MAIN ] Derivative Progress: 583/2073 symbols completed. EGO took 1.3s. Estimated remaining: 10m 23s. Rate: 143.4 symbols/min [2025-10-03T22:37:42.022055] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:42.023492] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 29954 primary records. [2025-10-03T22:37:42.024444] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-03T22:37:42.024331] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-10-03T22:37:42.025152] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-03T22:37:42.029923] [INFO ] [MAIN ] Derivative Progress: 584/2073 symbols completed. EGP took 1.3s. Estimated remaining: 10m 22s. Rate: 143.6 symbols/min [2025-10-03T22:37:42.045497] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-10-03T22:37:42.045577] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-03T22:37:42.049107] [INFO ] [MAIN ] Derivative Progress: 585/2073 symbols completed. EHAB took 1.2s. Estimated remaining: 10m 21s. Rate: 143.9 symbols/min [2025-10-03T22:37:42.049699] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:42.049792] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:42.049998] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:42.069440] [DEBUG] [LOCAL ] EHI: Loaded 10783 existing records from primary storage. [2025-10-03T22:37:42.069633] [INFO ] [MAIN ] EHI: Loaded 10783 primary data records. [2025-10-03T22:37:42.246033] [DEBUG] [LOCAL ] EHC: Loaded 41700 existing records from primary storage. [2025-10-03T22:37:42.270432] [INFO ] [MAIN ] EHC: Loaded 41700 primary data records. [2025-10-03T22:37:42.281759] [DEBUG] [LOCAL ] EIC: Loaded 23785 existing records from primary storage. [2025-10-03T22:37:42.344535] [INFO ] [MAIN ] EIC: Loaded 23785 primary data records. [2025-10-03T22:37:43.281520] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:43.282869] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10783 primary records. [2025-10-03T22:37:43.283001] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-03T22:37:43.302842] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-10-03T22:37:43.303090] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-03T22:37:43.306293] [INFO ] [MAIN ] Derivative Progress: 586/2073 symbols completed. EHI took 1.3s. Estimated remaining: 10m 22s. Rate: 143.4 symbols/min [2025-10-03T22:37:43.306736] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:43.338084] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:43.338966] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41700 primary records. [2025-10-03T22:37:43.346066] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-03T22:37:43.360848] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:43.373062] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 23785 primary records. [2025-10-03T22:37:43.373501] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-03T22:37:43.406929] [DEBUG] [LOCAL ] EIG: Loaded 20583 existing records from primary storage. [2025-10-03T22:37:43.409014] [INFO ] [MAIN ] EIG: Loaded 20583 primary data records. [2025-10-03T22:37:43.408843] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-10-03T22:37:43.423932] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-10-03T22:37:43.411072] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-03T22:37:43.457321] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-03T22:37:43.457117] [INFO ] [MAIN ] Derivative Progress: 587/2073 symbols completed. EIC took 1.4s. Estimated remaining: 10m 21s. Rate: 143.5 symbols/min [2025-10-03T22:37:43.499518] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:43.510322] [INFO ] [MAIN ] Derivative Progress: 588/2073 symbols completed. EHC took 1.4s. Estimated remaining: 10m 20s. Rate: 143.7 symbols/min [2025-10-03T22:37:43.521249] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:43.831004] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:43.848712] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20583 primary records. [2025-10-03T22:37:43.849715] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-03T22:37:43.850811] [DEBUG] [LOCAL ] EIX: Loaded 54120 existing records from primary storage. [2025-10-03T22:37:43.867207] [INFO ] [MAIN ] EIX: Loaded 54120 primary data records. [2025-10-03T22:37:43.890601] [DEBUG] [LOCAL ] ELAN: Loaded 54031 existing records from primary storage. [2025-10-03T22:37:43.927500] [INFO ] [MAIN ] ELAN: Loaded 54031 primary data records. [2025-10-03T22:37:44.100304] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-10-03T22:37:44.140693] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-03T22:37:44.154104] [INFO ] [MAIN ] Derivative Progress: 589/2073 symbols completed. EIG took 0.8s. Estimated remaining: 10m 20s. Rate: 143.6 symbols/min [2025-10-03T22:37:44.227015] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:44.589712] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:44.590196] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:44.591442] [INFO ] [MAIN ] EIX: Generated 1820 derivative records from 54120 primary records. [2025-10-03T22:37:44.592468] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-03T22:37:44.592345] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 54031 primary records. [2025-10-03T22:37:44.592619] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-03T22:37:44.623513] [DEBUG] [LOCAL ] EIX: Derivative data saved (1820 records). [2025-10-03T22:37:44.638323] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-03T22:37:44.641945] [INFO ] [MAIN ] Derivative Progress: 590/2073 symbols completed. EIX took 1.1s. Estimated remaining: 10m 20s. Rate: 143.6 symbols/min [2025-10-03T22:37:44.643529] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:44.646277] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-10-03T22:37:44.646416] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-03T22:37:44.649203] [INFO ] [MAIN ] Derivative Progress: 591/2073 symbols completed. ELAN took 1.1s. Estimated remaining: 10m 18s. Rate: 143.8 symbols/min [2025-10-03T22:37:44.649522] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:44.669163] [DEBUG] [LOCAL ] ELF: Loaded 52899 existing records from primary storage. [2025-10-03T22:37:44.669496] [INFO ] [MAIN ] ELF: Loaded 52899 primary data records. [2025-10-03T22:37:45.048261] [DEBUG] [LOCAL ] ELP: Loaded 25951 existing records from primary storage. [2025-10-03T22:37:45.050076] [DEBUG] [LOCAL ] ELME: Loaded 39824 existing records from primary storage. [2025-10-03T22:37:45.050723] [INFO ] [MAIN ] ELME: Loaded 39824 primary data records. [2025-10-03T22:37:45.050618] [INFO ] [MAIN ] ELP: Loaded 25951 primary data records. [2025-10-03T22:37:45.742982] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:45.745952] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 52899 primary records. [2025-10-03T22:37:45.746353] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-03T22:37:45.766073] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-10-03T22:37:45.766462] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-03T22:37:45.769734] [INFO ] [MAIN ] Derivative Progress: 592/2073 symbols completed. ELF took 1.5s. Estimated remaining: 10m 20s. Rate: 143.4 symbols/min [2025-10-03T22:37:45.770129] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:45.793560] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:45.795047] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 25951 primary records. [2025-10-03T22:37:45.795234] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-03T22:37:45.812994] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:45.823279] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39824 primary records. [2025-10-03T22:37:45.823401] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-03T22:37:45.838741] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-10-03T22:37:45.847686] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-10-03T22:37:45.847951] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-03T22:37:45.843104] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-03T22:37:45.851463] [INFO ] [MAIN ] Derivative Progress: 593/2073 symbols completed. ELME took 1.2s. Estimated remaining: 10m 18s. Rate: 143.6 symbols/min [2025-10-03T22:37:45.851848] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:45.855134] [INFO ] [MAIN ] Derivative Progress: 594/2073 symbols completed. ELP took 1.2s. Estimated remaining: 10m 17s. Rate: 143.8 symbols/min [2025-10-03T22:37:45.867529] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:45.895460] [DEBUG] [LOCAL ] ELS: Loaded 50194 existing records from primary storage. [2025-10-03T22:37:45.895870] [INFO ] [MAIN ] ELS: Loaded 50194 primary data records. [2025-10-03T22:37:46.017572] [DEBUG] [LOCAL ] EMD: Loaded 21522 existing records from primary storage. [2025-10-03T22:37:46.029783] [INFO ] [MAIN ] EMD: Loaded 21522 primary data records. [2025-10-03T22:37:46.074865] [DEBUG] [LOCAL ] EME: Loaded 31702 existing records from primary storage. [2025-10-03T22:37:46.149963] [INFO ] [MAIN ] EME: Loaded 31702 primary data records. [2025-10-03T22:37:46.994060] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:46.995271] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50194 primary records. [2025-10-03T22:37:46.995436] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-03T22:37:47.018922] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-10-03T22:37:47.020179] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-03T22:37:47.023959] [INFO ] [MAIN ] Derivative Progress: 595/2073 symbols completed. ELS took 1.3s. Estimated remaining: 10m 18s. Rate: 143.4 symbols/min [2025-10-03T22:37:47.024359] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:47.041783] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:47.042799] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21522 primary records. [2025-10-03T22:37:47.043119] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-03T22:37:47.047335] [DEBUG] [LOCAL ] EMF: Loaded 3480 existing records from primary storage. [2025-10-03T22:37:47.049758] [INFO ] [MAIN ] EMF: Loaded 3480 primary data records. [2025-10-03T22:37:47.146320] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:47.171586] [INFO ] [MAIN ] EME: Generated 1820 derivative records from 31702 primary records. [2025-10-03T22:37:47.182734] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-03T22:37:47.185049] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-10-03T22:37:47.214955] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-03T22:37:47.223165] [INFO ] [MAIN ] Derivative Progress: 596/2073 symbols completed. EMD took 1.4s. Estimated remaining: 10m 17s. Rate: 143.5 symbols/min [2025-10-03T22:37:47.243626] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:47.288785] [DEBUG] [LOCAL ] EME: Derivative data saved (1820 records). [2025-10-03T22:37:47.289151] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-03T22:37:47.397267] [INFO ] [MAIN ] Derivative Progress: 597/2073 symbols completed. EME took 1.5s. Estimated remaining: 10m 16s. Rate: 143.7 symbols/min [2025-10-03T22:37:47.412706] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:47.431611] [DEBUG] [LOCAL ] EMO: Loaded 12774 existing records from primary storage. [2025-10-03T22:37:47.431892] [INFO ] [MAIN ] EMO: Loaded 12774 primary data records. [2025-10-03T22:37:47.652258] [DEBUG] [LOCAL ] EMN: Loaded 51219 existing records from primary storage. [2025-10-03T22:37:47.683882] [INFO ] [MAIN ] EMN: Loaded 51219 primary data records. [2025-10-03T22:37:47.691380] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:47.826668] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3480 primary records. [2025-10-03T22:37:47.860619] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-03T22:37:47.998483] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-10-03T22:37:48.021084] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-03T22:37:48.030949] [INFO ] [MAIN ] Derivative Progress: 598/2073 symbols completed. EMF took 1.0s. Estimated remaining: 10m 17s. Rate: 143.5 symbols/min [2025-10-03T22:37:48.172042] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:48.173948] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 12774 primary records. [2025-10-03T22:37:48.174269] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-03T22:37:48.193951] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-10-03T22:37:48.194034] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-03T22:37:48.197391] [INFO ] [MAIN ] Derivative Progress: 599/2073 symbols completed. EMO took 0.8s. Estimated remaining: 10m 16s. Rate: 143.7 symbols/min [2025-10-03T22:37:48.215956] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:48.216672] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51219 primary records. [2025-10-03T22:37:48.216741] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-03T22:37:48.232956] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-10-03T22:37:48.233021] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-03T22:37:48.235762] [INFO ] [MAIN ] Derivative Progress: 600/2073 symbols completed. EMN took 1.0s. Estimated remaining: 10m 14s. Rate: 143.9 symbols/min [2025-10-03T22:37:48.236217] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:48.236522] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:48.236375] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:48.245832] [DEBUG] [LOCAL ] EMP: Loaded 3108 existing records from primary storage. [2025-10-03T22:37:48.246100] [INFO ] [MAIN ] EMP: Loaded 3108 primary data records. [2025-10-03T22:37:48.607406] [DEBUG] [LOCAL ] ENB: Loaded 54287 existing records from primary storage. [2025-10-03T22:37:48.608465] [INFO ] [MAIN ] ENB: Loaded 54287 primary data records. [2025-10-03T22:37:48.658156] [DEBUG] [LOCAL ] EMR: Loaded 54022 existing records from primary storage. [2025-10-03T22:37:48.675726] [INFO ] [MAIN ] EMR: Loaded 54022 primary data records. [2025-10-03T22:37:49.300320] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:49.316589] [INFO ] [MAIN ] EMP: Generated 1820 derivative records from 3108 primary records. [2025-10-03T22:37:49.317364] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-03T22:37:49.336896] [DEBUG] [LOCAL ] EMP: Derivative data saved (1820 records). [2025-10-03T22:37:49.337357] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-03T22:37:49.341349] [INFO ] [MAIN ] Derivative Progress: 601/2073 symbols completed. EMP took 1.1s. Estimated remaining: 10m 15s. Rate: 143.5 symbols/min [2025-10-03T22:37:49.342014] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:49.350835] [DEBUG] [LOCAL ] ENFY: Loaded 3201 existing records from primary storage. [2025-10-03T22:37:49.351139] [INFO ] [MAIN ] ENFY: Loaded 3201 primary data records. [2025-10-03T22:37:49.524580] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:49.556078] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54287 primary records. [2025-10-03T22:37:49.671318] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-03T22:37:49.702505] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:49.707675] [INFO ] [MAIN ] EMR: Generated 1820 derivative records from 54022 primary records. [2025-10-03T22:37:49.708614] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-03T22:37:49.727505] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-10-03T22:37:49.728368] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-03T22:37:49.731179] [INFO ] [MAIN ] Derivative Progress: 602/2073 symbols completed. ENB took 1.5s. Estimated remaining: 10m 15s. Rate: 143.5 symbols/min [2025-10-03T22:37:49.731640] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:49.738871] [DEBUG] [LOCAL ] EMR: Derivative data saved (1820 records). [2025-10-03T22:37:49.739014] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-03T22:37:49.742675] [INFO ] [MAIN ] Derivative Progress: 603/2073 symbols completed. EMR took 1.5s. Estimated remaining: 10m 14s. Rate: 143.8 symbols/min [2025-10-03T22:37:49.743017] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:49.748595] [DEBUG] [LOCAL ] ENO: Loaded 1938 existing records from primary storage. [2025-10-03T22:37:49.748987] [INFO ] [MAIN ] ENO: Loaded 1938 primary data records. [2025-10-03T22:37:49.880062] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:49.881209] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3201 primary records. [2025-10-03T22:37:49.886547] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-03T22:37:50.104598] [DEBUG] [LOCAL ] ENIC: Loaded 36843 existing records from primary storage. [2025-10-03T22:37:50.108485] [INFO ] [MAIN ] ENIC: Loaded 36843 primary data records. [2025-10-03T22:37:50.109148] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-10-03T22:37:50.109264] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-03T22:37:50.113629] [INFO ] [MAIN ] Derivative Progress: 604/2073 symbols completed. ENFY took 0.8s. Estimated remaining: 10m 13s. Rate: 143.8 symbols/min [2025-10-03T22:37:50.119256] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:50.484957] [DEBUG] [LOCAL ] ENOV: Loaded 45484 existing records from primary storage. [2025-10-03T22:37:50.485240] [INFO ] [MAIN ] ENOV: Loaded 45484 primary data records. [2025-10-03T22:37:50.482403] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:50.486703] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1938 primary records. [2025-10-03T22:37:50.493229] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-03T22:37:50.675671] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-10-03T22:37:50.699280] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-03T22:37:50.888455] [INFO ] [MAIN ] Derivative Progress: 605/2073 symbols completed. ENO took 1.1s. Estimated remaining: 10m 13s. Rate: 143.6 symbols/min [2025-10-03T22:37:50.903717] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:50.918614] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:50.921132] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 36843 primary records. [2025-10-03T22:37:50.921467] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-03T22:37:50.945370] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-10-03T22:37:50.964768] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-03T22:37:50.968562] [INFO ] [MAIN ] Derivative Progress: 606/2073 symbols completed. ENIC took 1.2s. Estimated remaining: 10m 12s. Rate: 143.8 symbols/min [2025-10-03T22:37:50.969063] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:51.003585] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:51.004554] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45484 primary records. [2025-10-03T22:37:51.004861] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-03T22:37:51.046365] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-10-03T22:37:51.048392] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-03T22:37:51.047997] [DEBUG] [LOCAL ] ENR: Loaded 43463 existing records from primary storage. [2025-10-03T22:37:51.051083] [INFO ] [MAIN ] Derivative Progress: 607/2073 symbols completed. ENOV took 0.9s. Estimated remaining: 10m 11s. Rate: 144.0 symbols/min [2025-10-03T22:37:51.051405] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:51.051590] [INFO ] [MAIN ] ENR: Loaded 43463 primary data records. [2025-10-03T22:37:51.170687] [DEBUG] [LOCAL ] ENS: Loaded 29820 existing records from primary storage. [2025-10-03T22:37:51.171484] [INFO ] [MAIN ] ENS: Loaded 29820 primary data records. [2025-10-03T22:37:51.312020] [DEBUG] [LOCAL ] ENVA: Loaded 25618 existing records from primary storage. [2025-10-03T22:37:51.325792] [INFO ] [MAIN ] ENVA: Loaded 25618 primary data records. [2025-10-03T22:37:52.106760] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:52.109798] [INFO ] [MAIN ] ENR: Generated 1820 derivative records from 43463 primary records. [2025-10-03T22:37:52.110592] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-03T22:37:52.147325] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:52.150472] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29820 primary records. [2025-10-03T22:37:52.151792] [DEBUG] [LOCAL ] ENR: Derivative data saved (1820 records). [2025-10-03T22:37:52.152090] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-03T22:37:52.151994] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-03T22:37:52.156369] [INFO ] [MAIN ] Derivative Progress: 608/2073 symbols completed. ENR took 1.3s. Estimated remaining: 10m 12s. Rate: 143.6 symbols/min [2025-10-03T22:37:52.157723] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:52.179335] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-10-03T22:37:52.179530] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-03T22:37:52.182908] [INFO ] [MAIN ] Derivative Progress: 609/2073 symbols completed. ENS took 1.2s. Estimated remaining: 10m 11s. Rate: 143.8 symbols/min [2025-10-03T22:37:52.183296] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:52.198999] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:52.200317] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25618 primary records. [2025-10-03T22:37:52.205572] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-03T22:37:52.222948] [DEBUG] [LOCAL ] EOD: Loaded 14703 existing records from primary storage. [2025-10-03T22:37:52.226314] [INFO ] [MAIN ] EOD: Loaded 14703 primary data records. [2025-10-03T22:37:52.242986] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-10-03T22:37:52.268374] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-03T22:37:52.305864] [INFO ] [MAIN ] Derivative Progress: 610/2073 symbols completed. ENVA took 1.3s. Estimated remaining: 10m 10s. Rate: 144.0 symbols/min [2025-10-03T22:37:52.330370] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:52.572967] [DEBUG] [LOCAL ] EOT: Loaded 6963 existing records from primary storage. [2025-10-03T22:37:52.573164] [INFO ] [MAIN ] EOT: Loaded 6963 primary data records. [2025-10-03T22:37:52.711922] [DEBUG] [LOCAL ] EOG: Loaded 54124 existing records from primary storage. [2025-10-03T22:37:52.724293] [INFO ] [MAIN ] EOG: Loaded 54124 primary data records. [2025-10-03T22:37:53.365710] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:53.367957] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 14703 primary records. [2025-10-03T22:37:53.368565] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-03T22:37:53.393382] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-10-03T22:37:53.393607] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-03T22:37:53.397765] [INFO ] [MAIN ] Derivative Progress: 611/2073 symbols completed. EOD took 1.2s. Estimated remaining: 10m 11s. Rate: 143.6 symbols/min [2025-10-03T22:37:53.398048] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:53.418168] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:53.419349] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6963 primary records. [2025-10-03T22:37:53.419732] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-03T22:37:53.462966] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:53.466742] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54124 primary records. [2025-10-03T22:37:53.467744] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-03T22:37:53.465024] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-10-03T22:37:53.478606] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-03T22:37:53.500105] [DEBUG] [LOCAL ] EPAC: Loaded 27317 existing records from primary storage. [2025-10-03T22:37:53.501286] [INFO ] [MAIN ] EPAC: Loaded 27317 primary data records. [2025-10-03T22:37:53.495273] [INFO ] [MAIN ] Derivative Progress: 612/2073 symbols completed. EOT took 1.2s. Estimated remaining: 10m 10s. Rate: 143.8 symbols/min [2025-10-03T22:37:53.512636] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:53.610761] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-10-03T22:37:53.632095] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-03T22:37:53.640717] [INFO ] [MAIN ] Derivative Progress: 613/2073 symbols completed. EOG took 1.5s. Estimated remaining: 10m 9s. Rate: 143.9 symbols/min [2025-10-03T22:37:53.943825] [DEBUG] [LOCAL ] EPAM: Loaded 40286 existing records from primary storage. [2025-10-03T22:37:53.944279] [INFO ] [MAIN ] EPAM: Loaded 40286 primary data records. [2025-10-03T22:37:54.331002] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:54.332030] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27317 primary records. [2025-10-03T22:37:54.332119] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-03T22:37:54.351466] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-10-03T22:37:54.352240] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-03T22:37:54.355037] [INFO ] [MAIN ] Derivative Progress: 614/2073 symbols completed. EPAC took 1.0s. Estimated remaining: 10m 9s. Rate: 143.7 symbols/min [2025-10-03T22:37:54.376960] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:54.377797] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 40286 primary records. [2025-10-03T22:37:54.377891] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-03T22:37:54.393888] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-10-03T22:37:54.393948] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-03T22:37:54.397319] [INFO ] [MAIN ] Derivative Progress: 615/2073 symbols completed. EPAM took 0.9s. Estimated remaining: 10m 8s. Rate: 144.0 symbols/min [2025-10-03T22:37:54.398008] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:54.398236] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:54.399052] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:54.445516] [DEBUG] [LOCAL ] EPC: Loaded 40372 existing records from primary storage. [2025-10-03T22:37:54.445751] [INFO ] [MAIN ] EPC: Loaded 40372 primary data records. [2025-10-03T22:37:54.837990] [DEBUG] [LOCAL ] EPRT: Loaded 49188 existing records from primary storage. [2025-10-03T22:37:54.838430] [INFO ] [MAIN ] EPRT: Loaded 49188 primary data records. [2025-10-03T22:37:54.839303] [DEBUG] [LOCAL ] EPD: Loaded 54388 existing records from primary storage. [2025-10-03T22:37:54.845893] [INFO ] [MAIN ] EPD: Loaded 54388 primary data records. [2025-10-03T22:37:55.560821] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:55.563287] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40372 primary records. [2025-10-03T22:37:55.563905] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-03T22:37:55.587779] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-10-03T22:37:55.588298] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-03T22:37:55.592409] [INFO ] [MAIN ] Derivative Progress: 616/2073 symbols completed. EPC took 1.2s. Estimated remaining: 10m 9s. Rate: 143.5 symbols/min [2025-10-03T22:37:55.592869] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:55.618265] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:55.619786] [INFO ] [MAIN ] EPD: Generated 1820 derivative records from 54388 primary records. [2025-10-03T22:37:55.633793] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-03T22:37:55.634298] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:55.637361] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49188 primary records. [2025-10-03T22:37:55.647553] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-03T22:37:55.659242] [DEBUG] [LOCAL ] EPD: Derivative data saved (1820 records). [2025-10-03T22:37:55.667084] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-03T22:37:55.674714] [INFO ] [MAIN ] Derivative Progress: 617/2073 symbols completed. EPD took 1.3s. Estimated remaining: 10m 8s. Rate: 143.7 symbols/min [2025-10-03T22:37:55.675629] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:55.697104] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-10-03T22:37:55.697287] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-03T22:37:55.700306] [INFO ] [MAIN ] Derivative Progress: 618/2073 symbols completed. EPRT took 1.3s. Estimated remaining: 10m 7s. Rate: 143.9 symbols/min [2025-10-03T22:37:55.700772] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:55.711416] [DEBUG] [LOCAL ] EQV: Loaded 2754 existing records from primary storage. [2025-10-03T22:37:55.711905] [INFO ] [MAIN ] EQV: Loaded 2754 primary data records. [2025-10-03T22:37:55.776389] [DEBUG] [LOCAL ] EQR: Loaded 52274 existing records from primary storage. [2025-10-03T22:37:55.790370] [INFO ] [MAIN ] EQR: Loaded 52274 primary data records. [2025-10-03T22:37:56.106840] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-10-03T22:37:56.297710] [INFO ] [MAIN ] EQT: Loaded 54462 primary data records. [2025-10-03T22:37:56.777579] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:56.779466] [INFO ] [MAIN ] EQV: Generated 1820 derivative records from 2754 primary records. [2025-10-03T22:37:56.779916] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-03T22:37:56.795084] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:56.796550] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52274 primary records. [2025-10-03T22:37:56.796851] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-03T22:37:56.828358] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-10-03T22:37:56.828862] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-03T22:37:56.832366] [INFO ] [MAIN ] Derivative Progress: 619/2073 symbols completed. EQR took 1.2s. Estimated remaining: 10m 8s. Rate: 143.5 symbols/min [2025-10-03T22:37:56.835096] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:56.836097] [DEBUG] [LOCAL ] EQV: Derivative data saved (1820 records). [2025-10-03T22:37:56.836362] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-03T22:37:56.839530] [INFO ] [MAIN ] Derivative Progress: 620/2073 symbols completed. EQV took 1.1s. Estimated remaining: 10m 6s. Rate: 143.8 symbols/min [2025-10-03T22:37:56.854767] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:56.856405] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:56.857615] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54462 primary records. [2025-10-03T22:37:56.857751] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-03T22:37:56.877249] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-10-03T22:37:56.877346] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-03T22:37:56.881388] [INFO ] [MAIN ] Derivative Progress: 621/2073 symbols completed. EQT took 1.2s. Estimated remaining: 10m 5s. Rate: 144.0 symbols/min [2025-10-03T22:37:56.881664] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:56.983421] [DEBUG] [LOCAL ] ERO: Loaded 41941 existing records from primary storage. [2025-10-03T22:37:56.984568] [INFO ] [MAIN ] ERO: Loaded 41941 primary data records. [2025-10-03T22:37:56.984414] [DEBUG] [LOCAL ] ERJ: Loaded 51385 existing records from primary storage. [2025-10-03T22:37:57.012781] [INFO ] [MAIN ] ERJ: Loaded 51385 primary data records. [2025-10-03T22:37:57.062517] [DEBUG] [LOCAL ] ES: Loaded 53348 existing records from primary storage. [2025-10-03T22:37:57.107406] [INFO ] [MAIN ] ES: Loaded 53348 primary data records. [2025-10-03T22:37:58.116178] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:58.117534] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51385 primary records. [2025-10-03T22:37:58.130775] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-03T22:37:58.132525] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:58.141322] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 41941 primary records. [2025-10-03T22:37:58.143784] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-03T22:37:58.178986] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-10-03T22:37:58.179941] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:58.180334] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-03T22:37:58.182045] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53348 primary records. [2025-10-03T22:37:58.184971] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-03T22:37:58.184831] [INFO ] [MAIN ] Derivative Progress: 622/2073 symbols completed. ERJ took 1.3s. Estimated remaining: 10m 7s. Rate: 143.5 symbols/min [2025-10-03T22:37:58.186669] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:58.206056] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-10-03T22:37:58.206685] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-03T22:37:58.211092] [INFO ] [MAIN ] Derivative Progress: 623/2073 symbols completed. ERO took 1.4s. Estimated remaining: 10m 5s. Rate: 143.7 symbols/min [2025-10-03T22:37:58.211696] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:58.214044] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-10-03T22:37:58.214296] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-03T22:37:58.218541] [INFO ] [MAIN ] Derivative Progress: 624/2073 symbols completed. ES took 1.3s. Estimated remaining: 10m 4s. Rate: 143.9 symbols/min [2025-10-03T22:37:58.219153] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:58.247894] [DEBUG] [LOCAL ] ESAB: Loaded 26556 existing records from primary storage. [2025-10-03T22:37:58.248060] [INFO ] [MAIN ] ESAB: Loaded 26556 primary data records. [2025-10-03T22:37:58.329426] [DEBUG] [LOCAL ] ESE: Loaded 16903 existing records from primary storage. [2025-10-03T22:37:58.346743] [INFO ] [MAIN ] ESE: Loaded 16903 primary data records. [2025-10-03T22:37:58.795149] [DEBUG] [LOCAL ] ESI: Loaded 51476 existing records from primary storage. [2025-10-03T22:37:58.795924] [INFO ] [MAIN ] ESI: Loaded 51476 primary data records. [2025-10-03T22:37:59.271174] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:59.285952] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16903 primary records. [2025-10-03T22:37:59.284936] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:59.287204] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26556 primary records. [2025-10-03T22:37:59.287409] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-03T22:37:59.287586] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-03T22:37:59.323709] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-10-03T22:37:59.324292] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-03T22:37:59.327334] [INFO ] [MAIN ] Derivative Progress: 625/2073 symbols completed. ESAB took 1.1s. Estimated remaining: 10m 5s. Rate: 143.5 symbols/min [2025-10-03T22:37:59.341503] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:59.343255] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:37:59.344410] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51476 primary records. [2025-10-03T22:37:59.344532] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-03T22:37:59.343397] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-10-03T22:37:59.345732] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-03T22:37:59.349244] [INFO ] [MAIN ] Derivative Progress: 626/2073 symbols completed. ESE took 1.1s. Estimated remaining: 10m 4s. Rate: 143.8 symbols/min [2025-10-03T22:37:59.349773] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:59.371361] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-10-03T22:37:59.371555] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-03T22:37:59.375406] [INFO ] [MAIN ] Derivative Progress: 627/2073 symbols completed. ESI took 1.2s. Estimated remaining: 10m 3s. Rate: 144.0 symbols/min [2025-10-03T22:37:59.375840] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:37:59.443183] [DEBUG] [LOCAL ] ESS: Loaded 30332 existing records from primary storage. [2025-10-03T22:37:59.454247] [INFO ] [MAIN ] ESS: Loaded 30332 primary data records. [2025-10-03T22:37:59.468315] [DEBUG] [LOCAL ] ESNT: Loaded 38930 existing records from primary storage. [2025-10-03T22:37:59.527984] [INFO ] [MAIN ] ESNT: Loaded 38930 primary data records. [2025-10-03T22:37:59.538086] [DEBUG] [LOCAL ] ESRT: Loaded 47041 existing records from primary storage. [2025-10-03T22:37:59.566459] [INFO ] [MAIN ] ESRT: Loaded 47041 primary data records. [2025-10-03T22:38:00.488780] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:00.489963] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30332 primary records. [2025-10-03T22:38:00.491809] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-03T22:38:00.528446] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:00.530548] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47041 primary records. [2025-10-03T22:38:00.531581] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-03T22:38:00.531335] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-10-03T22:38:00.532611] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-03T22:38:00.535202] [INFO ] [MAIN ] Derivative Progress: 628/2073 symbols completed. ESS took 1.2s. Estimated remaining: 10m 4s. Rate: 143.6 symbols/min [2025-10-03T22:38:00.556573] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:00.560054] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 38930 primary records. [2025-10-03T22:38:00.560573] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-03T22:38:00.578298] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-10-03T22:38:00.578825] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-03T22:38:00.583085] [INFO ] [MAIN ] Derivative Progress: 629/2073 symbols completed. ESRT took 1.2s. Estimated remaining: 10m 3s. Rate: 143.8 symbols/min [2025-10-03T22:38:00.584826] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-10-03T22:38:00.584891] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-03T22:38:00.588231] [INFO ] [MAIN ] Derivative Progress: 630/2073 symbols completed. ESNT took 1.2s. Estimated remaining: 10m 1s. Rate: 144.0 symbols/min [2025-10-03T22:38:00.588681] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:00.588831] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:00.588902] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:00.622404] [DEBUG] [LOCAL ] ETB: Loaded 12368 existing records from primary storage. [2025-10-03T22:38:00.622761] [INFO ] [MAIN ] ETB: Loaded 12368 primary data records. [2025-10-03T22:38:00.810970] [DEBUG] [LOCAL ] ESTC: Loaded 50664 existing records from primary storage. [2025-10-03T22:38:00.869203] [INFO ] [MAIN ] ESTC: Loaded 50664 primary data records. [2025-10-03T22:38:01.034972] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-03T22:38:01.052718] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-10-03T22:38:01.687635] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:01.689521] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12368 primary records. [2025-10-03T22:38:01.689898] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-03T22:38:01.708957] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-10-03T22:38:01.709352] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-03T22:38:01.712920] [INFO ] [MAIN ] Derivative Progress: 631/2073 symbols completed. ETB took 1.1s. Estimated remaining: 10m 2s. Rate: 143.6 symbols/min [2025-10-03T22:38:01.713459] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:01.733936] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:01.735082] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50664 primary records. [2025-10-03T22:38:01.737199] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-03T22:38:01.775190] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:01.777777] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-10-03T22:38:01.777969] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-03T22:38:01.787800] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-10-03T22:38:01.797021] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-03T22:38:01.799784] [INFO ] [MAIN ] Derivative Progress: 632/2073 symbols completed. ESTC took 1.2s. Estimated remaining: 10m 1s. Rate: 143.8 symbols/min [2025-10-03T22:38:01.805082] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:01.800796] [DEBUG] [LOCAL ] ETD: Loaded 27784 existing records from primary storage. [2025-10-03T22:38:01.806250] [INFO ] [MAIN ] ETD: Loaded 27784 primary data records. [2025-10-03T22:38:01.889973] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-10-03T22:38:01.908174] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-03T22:38:01.936189] [INFO ] [MAIN ] Derivative Progress: 633/2073 symbols completed. ET took 1.3s. Estimated remaining: 10m 0s. Rate: 143.9 symbols/min [2025-10-03T22:38:01.952545] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:01.964685] [DEBUG] [LOCAL ] ETG: Loaded 16693 existing records from primary storage. [2025-10-03T22:38:01.989433] [INFO ] [MAIN ] ETG: Loaded 16693 primary data records. [2025-10-03T22:38:02.301886] [DEBUG] [LOCAL ] ETJ: Loaded 17112 existing records from primary storage. [2025-10-03T22:38:02.302768] [INFO ] [MAIN ] ETJ: Loaded 17112 primary data records. [2025-10-03T22:38:02.856218] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:02.858792] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27784 primary records. [2025-10-03T22:38:02.859292] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-03T22:38:02.882027] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-10-03T22:38:02.882558] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-03T22:38:02.885414] [INFO ] [MAIN ] Derivative Progress: 634/2073 symbols completed. ETD took 1.2s. Estimated remaining: 10m 1s. Rate: 143.6 symbols/min [2025-10-03T22:38:02.894012] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:02.900252] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:02.901497] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16693 primary records. [2025-10-03T22:38:02.901846] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-03T22:38:02.923438] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-10-03T22:38:02.923849] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-03T22:38:02.947754] [INFO ] [MAIN ] Derivative Progress: 635/2073 symbols completed. ETG took 1.1s. Estimated remaining: 9m 60s. Rate: 143.8 symbols/min [2025-10-03T22:38:02.948344] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:02.948768] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:02.949941] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 17112 primary records. [2025-10-03T22:38:02.950625] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-03T22:38:02.975874] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-10-03T22:38:02.974616] [DEBUG] [LOCAL ] ETO: Loaded 6702 existing records from primary storage. [2025-10-03T22:38:02.976042] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-03T22:38:02.980238] [INFO ] [MAIN ] Derivative Progress: 636/2073 symbols completed. ETJ took 1.0s. Estimated remaining: 9m 59s. Rate: 144.0 symbols/min [2025-10-03T22:38:02.980450] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:02.976155] [INFO ] [MAIN ] ETO: Loaded 6702 primary data records. [2025-10-03T22:38:03.182424] [DEBUG] [LOCAL ] ETN: Loaded 53510 existing records from primary storage. [2025-10-03T22:38:03.213241] [INFO ] [MAIN ] ETN: Loaded 53510 primary data records. [2025-10-03T22:38:03.550797] [DEBUG] [LOCAL ] ETR: Loaded 54002 existing records from primary storage. [2025-10-03T22:38:03.560680] [INFO ] [MAIN ] ETR: Loaded 54002 primary data records. [2025-10-03T22:38:04.131791] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:04.132834] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6702 primary records. [2025-10-03T22:38:04.133947] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-03T22:38:04.157415] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-10-03T22:38:04.158571] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-03T22:38:04.161796] [INFO ] [MAIN ] Derivative Progress: 637/2073 symbols completed. ETO took 1.2s. Estimated remaining: 9m 60s. Rate: 143.6 symbols/min [2025-10-03T22:38:04.162306] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:04.178393] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:04.179944] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53510 primary records. [2025-10-03T22:38:04.180223] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-03T22:38:04.201143] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:04.206560] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 54002 primary records. [2025-10-03T22:38:04.207712] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-03T22:38:04.228587] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-10-03T22:38:04.232151] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-03T22:38:04.236619] [INFO ] [MAIN ] Derivative Progress: 638/2073 symbols completed. ETN took 1.3s. Estimated remaining: 9m 59s. Rate: 143.8 symbols/min [2025-10-03T22:38:04.244747] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:04.247392] [DEBUG] [LOCAL ] ETW: Loaded 25554 existing records from primary storage. [2025-10-03T22:38:04.249978] [INFO ] [MAIN ] ETW: Loaded 25554 primary data records. [2025-10-03T22:38:04.309816] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-10-03T22:38:04.318734] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-03T22:38:04.322080] [INFO ] [MAIN ] Derivative Progress: 639/2073 symbols completed. ETR took 1.3s. Estimated remaining: 9m 58s. Rate: 144.0 symbols/min [2025-10-03T22:38:04.322274] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:04.343346] [DEBUG] [LOCAL ] ETX: Loaded 5236 existing records from primary storage. [2025-10-03T22:38:04.357060] [INFO ] [MAIN ] ETX: Loaded 5236 primary data records. [2025-10-03T22:38:04.596746] [DEBUG] [LOCAL ] ETY: Loaded 23218 existing records from primary storage. [2025-10-03T22:38:04.711604] [INFO ] [MAIN ] ETY: Loaded 23218 primary data records. [2025-10-03T22:38:05.270700] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:05.272899] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25554 primary records. [2025-10-03T22:38:05.273365] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-03T22:38:05.312591] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-10-03T22:38:05.313356] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-03T22:38:05.316107] [INFO ] [MAIN ] Derivative Progress: 640/2073 symbols completed. ETW took 1.2s. Estimated remaining: 9m 58s. Rate: 143.7 symbols/min [2025-10-03T22:38:05.316519] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:05.317030] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:05.321359] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 5236 primary records. [2025-10-03T22:38:05.322428] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-03T22:38:05.337013] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:05.358347] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23218 primary records. [2025-10-03T22:38:05.358482] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-03T22:38:05.357373] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-10-03T22:38:05.358634] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-03T22:38:05.362057] [INFO ] [MAIN ] Derivative Progress: 641/2073 symbols completed. ETX took 1.1s. Estimated remaining: 9m 57s. Rate: 143.9 symbols/min [2025-10-03T22:38:05.363196] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:05.386770] [DEBUG] [LOCAL ] EVC: Loaded 18787 existing records from primary storage. [2025-10-03T22:38:05.387379] [INFO ] [MAIN ] EVC: Loaded 18787 primary data records. [2025-10-03T22:38:05.401589] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-10-03T22:38:05.438435] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-03T22:38:05.472588] [INFO ] [MAIN ] Derivative Progress: 642/2073 symbols completed. ETY took 1.2s. Estimated remaining: 9m 56s. Rate: 144.1 symbols/min [2025-10-03T22:38:05.491015] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:05.606001] [DEBUG] [LOCAL ] EVEX: Loaded 31245 existing records from primary storage. [2025-10-03T22:38:05.699076] [DEBUG] [LOCAL ] EVF: Loaded 9646 existing records from primary storage. [2025-10-03T22:38:05.746196] [INFO ] [MAIN ] EVF: Loaded 9646 primary data records. [2025-10-03T22:38:05.746055] [INFO ] [MAIN ] EVEX: Loaded 31245 primary data records. [2025-10-03T22:38:06.468405] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:06.469904] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 18787 primary records. [2025-10-03T22:38:06.470410] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-03T22:38:06.493150] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-10-03T22:38:06.493787] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-03T22:38:06.496880] [INFO ] [MAIN ] Derivative Progress: 643/2073 symbols completed. EVC took 1.2s. Estimated remaining: 9m 57s. Rate: 143.7 symbols/min [2025-10-03T22:38:06.519342] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:06.520698] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9646 primary records. [2025-10-03T22:38:06.520806] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-03T22:38:06.536005] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:06.537307] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 31245 primary records. [2025-10-03T22:38:06.543613] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-03T22:38:06.565378] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-10-03T22:38:06.565729] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-03T22:38:06.569883] [INFO ] [MAIN ] Derivative Progress: 644/2073 symbols completed. EVF took 1.1s. Estimated remaining: 9m 56s. Rate: 143.9 symbols/min [2025-10-03T22:38:06.571834] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-10-03T22:38:06.571905] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-03T22:38:06.575402] [INFO ] [MAIN ] Derivative Progress: 645/2073 symbols completed. EVEX took 1.2s. Estimated remaining: 9m 54s. Rate: 144.1 symbols/min [2025-10-03T22:38:06.575829] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:06.575939] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:06.576024] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:06.585334] [DEBUG] [LOCAL ] EVG: Loaded 6027 existing records from primary storage. [2025-10-03T22:38:06.585570] [INFO ] [MAIN ] EVG: Loaded 6027 primary data records. [2025-10-03T22:38:06.699460] [DEBUG] [LOCAL ] EVN: Loaded 11412 existing records from primary storage. [2025-10-03T22:38:06.713337] [INFO ] [MAIN ] EVN: Loaded 11412 primary data records. [2025-10-03T22:38:07.189801] [DEBUG] [LOCAL ] EVH: Loaded 50116 existing records from primary storage. [2025-10-03T22:38:07.309241] [INFO ] [MAIN ] EVH: Loaded 50116 primary data records. [2025-10-03T22:38:07.673811] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:07.676357] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 6027 primary records. [2025-10-03T22:38:07.676511] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-03T22:38:07.715559] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:07.716322] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-10-03T22:38:07.716781] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-03T22:38:07.718032] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11412 primary records. [2025-10-03T22:38:07.722446] [INFO ] [MAIN ] Derivative Progress: 646/2073 symbols completed. EVG took 1.1s. Estimated remaining: 9m 56s. Rate: 143.7 symbols/min [2025-10-03T22:38:07.723366] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-03T22:38:07.724535] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:07.746241] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-10-03T22:38:07.746440] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-03T22:38:07.749883] [INFO ] [MAIN ] Derivative Progress: 647/2073 symbols completed. EVN took 1.2s. Estimated remaining: 9m 54s. Rate: 143.9 symbols/min [2025-10-03T22:38:07.751137] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:07.765552] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:07.766569] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50116 primary records. [2025-10-03T22:38:07.767111] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-03T22:38:07.806470] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-10-03T22:38:07.807210] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-03T22:38:07.812120] [INFO ] [MAIN ] Derivative Progress: 648/2073 symbols completed. EVH took 1.2s. Estimated remaining: 9m 53s. Rate: 144.1 symbols/min [2025-10-03T22:38:07.807725] [DEBUG] [LOCAL ] EVT: Loaded 17194 existing records from primary storage. [2025-10-03T22:38:07.822466] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:07.824406] [INFO ] [MAIN ] EVT: Loaded 17194 primary data records. [2025-10-03T22:38:07.838004] [DEBUG] [LOCAL ] EVR: Loaded 35297 existing records from primary storage. [2025-10-03T22:38:07.865071] [INFO ] [MAIN ] EVR: Loaded 35297 primary data records. [2025-10-03T22:38:08.121529] [DEBUG] [LOCAL ] EVTC: Loaded 26688 existing records from primary storage. [2025-10-03T22:38:08.140931] [INFO ] [MAIN ] EVTC: Loaded 26688 primary data records. [2025-10-03T22:38:08.976487] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:08.979062] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17194 primary records. [2025-10-03T22:38:08.979703] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-03T22:38:08.979570] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:08.982491] [INFO ] [MAIN ] EVR: Generated 1820 derivative records from 35297 primary records. [2025-10-03T22:38:08.983253] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-03T22:38:09.035609] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-10-03T22:38:09.039565] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-03T22:38:09.043628] [INFO ] [MAIN ] Derivative Progress: 649/2073 symbols completed. EVT took 1.3s. Estimated remaining: 9m 55s. Rate: 143.7 symbols/min [2025-10-03T22:38:09.039167] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:09.045176] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 26688 primary records. [2025-10-03T22:38:09.045847] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-03T22:38:09.047481] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:09.068827] [DEBUG] [LOCAL ] EVR: Derivative data saved (1820 records). [2025-10-03T22:38:09.070584] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-10-03T22:38:09.070952] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-03T22:38:09.071107] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-03T22:38:09.075085] [INFO ] [MAIN ] Derivative Progress: 650/2073 symbols completed. EVTC took 1.3s. Estimated remaining: 9m 53s. Rate: 143.9 symbols/min [2025-10-03T22:38:09.079813] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:09.080031] [INFO ] [MAIN ] Derivative Progress: 651/2073 symbols completed. EVR took 1.4s. Estimated remaining: 9m 52s. Rate: 144.1 symbols/min [2025-10-03T22:38:09.080962] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:09.134124] [DEBUG] [LOCAL ] EVTR: Loaded 24179 existing records from primary storage. [2025-10-03T22:38:09.135610] [DEBUG] [LOCAL ] EVTL: Loaded 39032 existing records from primary storage. [2025-10-03T22:38:09.134373] [INFO ] [MAIN ] EVTR: Loaded 24179 primary data records. [2025-10-03T22:38:09.136270] [INFO ] [MAIN ] EVTL: Loaded 39032 primary data records. [2025-10-03T22:38:09.476934] [DEBUG] [LOCAL ] EW: Loaded 54180 existing records from primary storage. [2025-10-03T22:38:09.557391] [INFO ] [MAIN ] EW: Loaded 54180 primary data records. [2025-10-03T22:38:10.244915] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:10.247498] [INFO ] [MAIN ] EVTR: Generated 1820 derivative records from 24179 primary records. [2025-10-03T22:38:10.247953] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-03T22:38:10.273845] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:10.276031] [INFO ] [MAIN ] EVTL: Generated 1820 derivative records from 39032 primary records. [2025-10-03T22:38:10.277568] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-03T22:38:10.292074] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1820 records). [2025-10-03T22:38:10.295782] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-03T22:38:10.300529] [INFO ] [MAIN ] Derivative Progress: 652/2073 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 53s. Rate: 143.7 symbols/min [2025-10-03T22:38:10.300792] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:10.316228] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1820 records). [2025-10-03T22:38:10.316844] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:10.317628] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54180 primary records. [2025-10-03T22:38:10.317750] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-03T22:38:10.321790] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-03T22:38:10.321637] [INFO ] [MAIN ] Derivative Progress: 653/2073 symbols completed. EVTL took 1.3s. Estimated remaining: 9m 52s. Rate: 143.9 symbols/min [2025-10-03T22:38:10.322923] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:10.342669] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-10-03T22:38:10.343382] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-03T22:38:10.346743] [INFO ] [MAIN ] Derivative Progress: 654/2073 symbols completed. EW took 1.3s. Estimated remaining: 9m 51s. Rate: 144.1 symbols/min [2025-10-03T22:38:10.347066] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:10.378977] [DEBUG] [LOCAL ] EXG: Loaded 34616 existing records from primary storage. [2025-10-03T22:38:10.379314] [INFO ] [MAIN ] EXG: Loaded 34616 primary data records. [2025-10-03T22:38:10.522798] [DEBUG] [LOCAL ] EXP: Loaded 29982 existing records from primary storage. [2025-10-03T22:38:10.558450] [INFO ] [MAIN ] EXP: Loaded 29982 primary data records. [2025-10-03T22:38:10.600346] [DEBUG] [LOCAL ] EXK: Loaded 53915 existing records from primary storage. [2025-10-03T22:38:10.610791] [INFO ] [MAIN ] EXK: Loaded 53915 primary data records. [2025-10-03T22:38:11.504214] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:11.507735] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34616 primary records. [2025-10-03T22:38:11.508484] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-03T22:38:11.547623] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:11.549771] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-10-03T22:38:11.549914] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-03T22:38:11.549681] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 29982 primary records. [2025-10-03T22:38:11.550286] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-03T22:38:11.553565] [INFO ] [MAIN ] Derivative Progress: 655/2073 symbols completed. EXG took 1.3s. Estimated remaining: 9m 52s. Rate: 143.7 symbols/min [2025-10-03T22:38:11.555189] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:11.573052] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-10-03T22:38:11.573320] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-03T22:38:11.577561] [INFO ] [MAIN ] Derivative Progress: 656/2073 symbols completed. EXP took 1.2s. Estimated remaining: 9m 51s. Rate: 143.9 symbols/min [2025-10-03T22:38:11.577983] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:11.595598] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:11.596445] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53915 primary records. [2025-10-03T22:38:11.596597] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-03T22:38:11.619545] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-10-03T22:38:11.619736] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-03T22:38:11.627394] [INFO ] [MAIN ] Derivative Progress: 657/2073 symbols completed. EXK took 1.3s. Estimated remaining: 9m 50s. Rate: 144.1 symbols/min [2025-10-03T22:38:11.627754] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:11.682089] [DEBUG] [LOCAL ] EXR: Loaded 45914 existing records from primary storage. [2025-10-03T22:38:11.682363] [INFO ] [MAIN ] EXR: Loaded 45914 primary data records. [2025-10-03T22:38:11.820228] [DEBUG] [LOCAL ] EXPD: Loaded 48594 existing records from primary storage. [2025-10-03T22:38:11.822200] [INFO ] [MAIN ] EXPD: Loaded 48594 primary data records. [2025-10-03T22:38:11.970732] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-03T22:38:12.129555] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-10-03T22:38:12.839989] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:12.842089] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 45914 primary records. [2025-10-03T22:38:12.842572] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-03T22:38:12.879939] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:12.881993] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48594 primary records. [2025-10-03T22:38:12.882950] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-03T22:38:12.883525] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-10-03T22:38:12.883874] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-03T22:38:12.887538] [INFO ] [MAIN ] Derivative Progress: 658/2073 symbols completed. EXR took 1.3s. Estimated remaining: 9m 51s. Rate: 143.7 symbols/min [2025-10-03T22:38:12.922334] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-10-03T22:38:12.922795] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-03T22:38:12.922608] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:12.929135] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-10-03T22:38:12.927741] [INFO ] [MAIN ] Derivative Progress: 659/2073 symbols completed. EXPD took 1.4s. Estimated remaining: 9m 50s. Rate: 143.9 symbols/min [2025-10-03T22:38:12.929334] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-03T22:38:12.947091] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-10-03T22:38:12.947190] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-03T22:38:12.950322] [INFO ] [MAIN ] Derivative Progress: 660/2073 symbols completed. F took 1.3s. Estimated remaining: 9m 48s. Rate: 144.1 symbols/min [2025-10-03T22:38:12.950888] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:12.951013] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:12.950828] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:12.991811] [DEBUG] [LOCAL ] FBK: Loaded 26556 existing records from primary storage. [2025-10-03T22:38:12.992104] [INFO ] [MAIN ] FBK: Loaded 26556 primary data records. [2025-10-03T22:38:13.272374] [DEBUG] [LOCAL ] FAF: Loaded 42190 existing records from primary storage. [2025-10-03T22:38:13.345776] [INFO ] [MAIN ] FAF: Loaded 42190 primary data records. [2025-10-03T22:38:13.411183] [DEBUG] [LOCAL ] FBIN: Loaded 51057 existing records from primary storage. [2025-10-03T22:38:13.429514] [INFO ] [MAIN ] FBIN: Loaded 51057 primary data records. [2025-10-03T22:38:14.049067] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:14.050933] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 26556 primary records. [2025-10-03T22:38:14.051375] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-03T22:38:14.071985] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-10-03T22:38:14.072538] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-03T22:38:14.076513] [INFO ] [MAIN ] Derivative Progress: 661/2073 symbols completed. FBK took 1.1s. Estimated remaining: 9m 50s. Rate: 143.7 symbols/min [2025-10-03T22:38:14.077347] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:14.100897] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:14.102023] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42190 primary records. [2025-10-03T22:38:14.102120] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-03T22:38:14.229597] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:14.231045] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51057 primary records. [2025-10-03T22:38:14.231361] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-03T22:38:14.242796] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-10-03T22:38:14.245893] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-03T22:38:14.252446] [INFO ] [MAIN ] Derivative Progress: 662/2073 symbols completed. FAF took 1.3s. Estimated remaining: 9m 49s. Rate: 143.8 symbols/min [2025-10-03T22:38:14.252923] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:14.268247] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-10-03T22:38:14.268411] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-03T22:38:14.271418] [INFO ] [MAIN ] Derivative Progress: 663/2073 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 47s. Rate: 144.0 symbols/min [2025-10-03T22:38:14.271674] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:14.289235] [DEBUG] [LOCAL ] FBP: Loaded 46650 existing records from primary storage. [2025-10-03T22:38:14.289422] [INFO ] [MAIN ] FBP: Loaded 46650 primary data records. [2025-10-03T22:38:14.390802] [DEBUG] [LOCAL ] FC: Loaded 15641 existing records from primary storage. [2025-10-03T22:38:14.402271] [INFO ] [MAIN ] FC: Loaded 15641 primary data records. [2025-10-03T22:38:14.647882] [DEBUG] [LOCAL ] FBRT: Loaded 35221 existing records from primary storage. [2025-10-03T22:38:14.812142] [INFO ] [MAIN ] FBRT: Loaded 35221 primary data records. [2025-10-03T22:38:15.793710] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:15.796037] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46650 primary records. [2025-10-03T22:38:15.796989] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-03T22:38:15.819161] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-10-03T22:38:15.819499] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-03T22:38:15.823167] [INFO ] [MAIN ] Derivative Progress: 664/2073 symbols completed. FBP took 1.7s. Estimated remaining: 9m 49s. Rate: 143.4 symbols/min [2025-10-03T22:38:15.825767] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:15.848894] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:15.850062] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15641 primary records. [2025-10-03T22:38:15.850251] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-03T22:38:15.875844] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-10-03T22:38:15.890429] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-03T22:38:15.890852] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:15.894998] [INFO ] [MAIN ] Derivative Progress: 665/2073 symbols completed. FC took 1.6s. Estimated remaining: 9m 48s. Rate: 143.6 symbols/min [2025-10-03T22:38:15.896578] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 35221 primary records. [2025-10-03T22:38:15.895305] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:15.896997] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-03T22:38:15.927033] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-10-03T22:38:15.927208] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-03T22:38:15.930970] [INFO ] [MAIN ] Derivative Progress: 666/2073 symbols completed. FBRT took 1.7s. Estimated remaining: 9m 47s. Rate: 143.8 symbols/min [2025-10-03T22:38:15.931487] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:15.957532] [DEBUG] [LOCAL ] FCF: Loaded 39961 existing records from primary storage. [2025-10-03T22:38:15.957973] [INFO ] [MAIN ] FCF: Loaded 39961 primary data records. [2025-10-03T22:38:16.072936] [DEBUG] [LOCAL ] FCN: Loaded 26319 existing records from primary storage. [2025-10-03T22:38:16.096618] [INFO ] [MAIN ] FCN: Loaded 26319 primary data records. [2025-10-03T22:38:16.428591] [DEBUG] [LOCAL ] FCPT: Loaded 37913 existing records from primary storage. [2025-10-03T22:38:16.444338] [INFO ] [MAIN ] FCPT: Loaded 37913 primary data records. [2025-10-03T22:38:17.044014] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:17.045940] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 39961 primary records. [2025-10-03T22:38:17.047578] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-03T22:38:17.088586] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:17.089476] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-10-03T22:38:17.090720] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-03T22:38:17.092167] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26319 primary records. [2025-10-03T22:38:17.096533] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-03T22:38:17.095165] [INFO ] [MAIN ] Derivative Progress: 667/2073 symbols completed. FCF took 1.3s. Estimated remaining: 9m 48s. Rate: 143.4 symbols/min [2025-10-03T22:38:17.098943] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:17.130794] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:17.133599] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37913 primary records. [2025-10-03T22:38:17.133759] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-03T22:38:17.132695] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-10-03T22:38:17.138877] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-03T22:38:17.154605] [INFO ] [MAIN ] Derivative Progress: 668/2073 symbols completed. FCN took 1.3s. Estimated remaining: 9m 47s. Rate: 143.6 symbols/min [2025-10-03T22:38:17.159544] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-10-03T22:38:17.159739] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:17.165907] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-03T22:38:17.170471] [INFO ] [MAIN ] Derivative Progress: 669/2073 symbols completed. FCPT took 1.2s. Estimated remaining: 9m 46s. Rate: 143.8 symbols/min [2025-10-03T22:38:17.171332] [DEBUG] [LOCAL ] FCT: Loaded 14890 existing records from primary storage. [2025-10-03T22:38:17.171734] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:17.172079] [INFO ] [MAIN ] FCT: Loaded 14890 primary data records. [2025-10-03T22:38:17.590860] [DEBUG] [LOCAL ] FDP: Loaded 30517 existing records from primary storage. [2025-10-03T22:38:17.591185] [INFO ] [MAIN ] FDP: Loaded 30517 primary data records. [2025-10-03T22:38:17.698522] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-10-03T22:38:17.711278] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-10-03T22:38:18.295149] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:18.296605] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14890 primary records. [2025-10-03T22:38:18.297909] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-03T22:38:18.320991] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-10-03T22:38:18.322413] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-03T22:38:18.326882] [INFO ] [MAIN ] Derivative Progress: 670/2073 symbols completed. FCT took 1.2s. Estimated remaining: 9m 47s. Rate: 143.4 symbols/min [2025-10-03T22:38:18.328294] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:18.345116] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:18.346515] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30517 primary records. [2025-10-03T22:38:18.346913] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-03T22:38:18.365272] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-10-03T22:38:18.365469] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-03T22:38:18.368410] [INFO ] [MAIN ] Derivative Progress: 671/2073 symbols completed. FDP took 1.2s. Estimated remaining: 9m 46s. Rate: 143.6 symbols/min [2025-10-03T22:38:18.368949] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:18.397511] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:18.398585] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-10-03T22:38:18.398870] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-03T22:38:18.417558] [DEBUG] [LOCAL ] FDS: Loaded 27155 existing records from primary storage. [2025-10-03T22:38:18.418746] [INFO ] [MAIN ] FDS: Loaded 27155 primary data records. [2025-10-03T22:38:18.559735] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-10-03T22:38:18.581404] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-03T22:38:18.666019] [INFO ] [MAIN ] Derivative Progress: 672/2073 symbols completed. FCX took 1.5s. Estimated remaining: 9m 45s. Rate: 143.7 symbols/min [2025-10-03T22:38:18.795496] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:18.798909] [DEBUG] [LOCAL ] FDX: Loaded 52286 existing records from primary storage. [2025-10-03T22:38:18.799154] [INFO ] [MAIN ] FDX: Loaded 52286 primary data records. [2025-10-03T22:38:19.182195] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:19.183418] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 27155 primary records. [2025-10-03T22:38:19.197543] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-03T22:38:19.202465] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-10-03T22:38:19.210261] [INFO ] [MAIN ] FE: Loaded 54208 primary data records. [2025-10-03T22:38:19.313874] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-10-03T22:38:19.333489] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-03T22:38:19.360927] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:19.366994] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52286 primary records. [2025-10-03T22:38:19.349354] [INFO ] [MAIN ] Derivative Progress: 673/2073 symbols completed. FDS took 1.0s. Estimated remaining: 9m 45s. Rate: 143.6 symbols/min [2025-10-03T22:38:19.372258] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-03T22:38:19.443783] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-10-03T22:38:19.449520] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-03T22:38:19.453467] [INFO ] [MAIN ] Derivative Progress: 674/2073 symbols completed. FDX took 1.1s. Estimated remaining: 9m 44s. Rate: 143.7 symbols/min [2025-10-03T22:38:19.621488] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:19.622391] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54208 primary records. [2025-10-03T22:38:19.622463] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-03T22:38:19.641068] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-10-03T22:38:19.641188] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-03T22:38:19.644260] [INFO ] [MAIN ] Derivative Progress: 675/2073 symbols completed. FE took 0.8s. Estimated remaining: 9m 43s. Rate: 143.8 symbols/min [2025-10-03T22:38:19.645077] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:19.645185] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:19.645012] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:19.665458] [DEBUG] [LOCAL ] FET: Loaded 13092 existing records from primary storage. [2025-10-03T22:38:19.671813] [INFO ] [MAIN ] FET: Loaded 13092 primary data records. [2025-10-03T22:38:19.788337] [DEBUG] [LOCAL ] FF: Loaded 25223 existing records from primary storage. [2025-10-03T22:38:19.806621] [INFO ] [MAIN ] FF: Loaded 25223 primary data records. [2025-10-03T22:38:20.267163] [DEBUG] [LOCAL ] FERG: Loaded 49585 existing records from primary storage. [2025-10-03T22:38:20.309499] [INFO ] [MAIN ] FERG: Loaded 49585 primary data records. [2025-10-03T22:38:20.804514] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:20.818863] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 13092 primary records. [2025-10-03T22:38:20.820298] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:20.820828] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-03T22:38:20.822315] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 25223 primary records. [2025-10-03T22:38:20.822861] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-03T22:38:20.854389] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-10-03T22:38:20.855879] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-03T22:38:20.859733] [INFO ] [MAIN ] Derivative Progress: 676/2073 symbols completed. FET took 1.2s. Estimated remaining: 9m 44s. Rate: 143.4 symbols/min [2025-10-03T22:38:20.861110] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:20.863833] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-10-03T22:38:20.865899] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-03T22:38:20.870403] [INFO ] [MAIN ] Derivative Progress: 677/2073 symbols completed. FF took 1.2s. Estimated remaining: 9m 43s. Rate: 143.6 symbols/min [2025-10-03T22:38:20.871110] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:20.887164] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:20.888167] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49585 primary records. [2025-10-03T22:38:20.888247] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-03T22:38:20.900341] [DEBUG] [LOCAL ] FFA: Loaded 6012 existing records from primary storage. [2025-10-03T22:38:20.904223] [INFO ] [MAIN ] FFA: Loaded 6012 primary data records. [2025-10-03T22:38:20.908764] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-10-03T22:38:20.914239] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-03T22:38:20.934851] [INFO ] [MAIN ] Derivative Progress: 678/2073 symbols completed. FERG took 1.3s. Estimated remaining: 9m 42s. Rate: 143.8 symbols/min [2025-10-03T22:38:20.963219] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:21.030188] [DEBUG] [LOCAL ] FFC: Loaded 16957 existing records from primary storage. [2025-10-03T22:38:21.034381] [INFO ] [MAIN ] FFC: Loaded 16957 primary data records. [2025-10-03T22:38:21.467883] [DEBUG] [LOCAL ] FFWM: Loaded 36233 existing records from primary storage. [2025-10-03T22:38:21.586097] [INFO ] [MAIN ] FFWM: Loaded 36233 primary data records. [2025-10-03T22:38:22.044925] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:22.046467] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 6012 primary records. [2025-10-03T22:38:22.046622] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-03T22:38:22.084035] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:22.086185] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16957 primary records. [2025-10-03T22:38:22.086915] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-03T22:38:22.089491] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-10-03T22:38:22.097077] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-03T22:38:22.101142] [INFO ] [MAIN ] Derivative Progress: 679/2073 symbols completed. FFA took 1.2s. Estimated remaining: 9m 43s. Rate: 143.4 symbols/min [2025-10-03T22:38:22.104253] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:22.111368] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-10-03T22:38:22.111694] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-03T22:38:22.115325] [INFO ] [MAIN ] Derivative Progress: 680/2073 symbols completed. FFC took 1.2s. Estimated remaining: 9m 42s. Rate: 143.6 symbols/min [2025-10-03T22:38:22.115936] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:22.138876] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:22.133315] [DEBUG] [LOCAL ] FGN: Loaded 3930 existing records from primary storage. [2025-10-03T22:38:22.139938] [INFO ] [MAIN ] FGN: Loaded 3930 primary data records. [2025-10-03T22:38:22.139793] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36233 primary records. [2025-10-03T22:38:22.152306] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-03T22:38:22.255518] [DEBUG] [LOCAL ] FG: Loaded 23125 existing records from primary storage. [2025-10-03T22:38:22.282446] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-10-03T22:38:22.301696] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-03T22:38:22.287779] [INFO ] [MAIN ] FG: Loaded 23125 primary data records. [2025-10-03T22:38:22.314190] [INFO ] [MAIN ] Derivative Progress: 681/2073 symbols completed. FFWM took 1.4s. Estimated remaining: 9m 41s. Rate: 143.7 symbols/min [2025-10-03T22:38:22.314464] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:22.894312] [DEBUG] [LOCAL ] FHI: Loaded 40721 existing records from primary storage. [2025-10-03T22:38:22.895275] [INFO ] [MAIN ] FHI: Loaded 40721 primary data records. [2025-10-03T22:38:23.118145] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:23.240583] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3930 primary records. [2025-10-03T22:38:23.253243] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-03T22:38:23.284435] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:23.289612] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 23125 primary records. [2025-10-03T22:38:23.291471] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-10-03T22:38:23.291619] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-03T22:38:23.292280] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-03T22:38:23.296720] [INFO ] [MAIN ] Derivative Progress: 682/2073 symbols completed. FGN took 1.2s. Estimated remaining: 9m 42s. Rate: 143.5 symbols/min [2025-10-03T22:38:23.298106] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:23.317052] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-10-03T22:38:23.317308] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-03T22:38:23.320370] [INFO ] [MAIN ] Derivative Progress: 683/2073 symbols completed. FG took 1.2s. Estimated remaining: 9m 41s. Rate: 143.7 symbols/min [2025-10-03T22:38:23.321124] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:23.340965] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:23.341901] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 40721 primary records. [2025-10-03T22:38:23.342228] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-03T22:38:23.360225] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-10-03T22:38:23.360401] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-03T22:38:23.364167] [INFO ] [MAIN ] Derivative Progress: 684/2073 symbols completed. FHI took 1.0s. Estimated remaining: 9m 39s. Rate: 143.9 symbols/min [2025-10-03T22:38:23.364479] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:23.425874] [DEBUG] [LOCAL ] FHN: Loaded 54145 existing records from primary storage. [2025-10-03T22:38:23.441062] [INFO ] [MAIN ] FHN: Loaded 54145 primary data records. [2025-10-03T22:38:23.449032] [DEBUG] [LOCAL ] FICO: Loaded 21102 existing records from primary storage. [2025-10-03T22:38:23.449570] [INFO ] [MAIN ] FICO: Loaded 21102 primary data records. [2025-10-03T22:38:23.450467] [DEBUG] [LOCAL ] FI: Loaded 54278 existing records from primary storage. [2025-10-03T22:38:23.478616] [INFO ] [MAIN ] FI: Loaded 54278 primary data records. [2025-10-03T22:38:24.574577] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:24.576374] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54145 primary records. [2025-10-03T22:38:24.576688] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-03T22:38:24.575019] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:38:24.577889] [INFO ] [MAIN ] FICO: Generated 1819 derivative records from 21102 primary records. [2025-10-03T22:38:24.578065] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-03T22:38:24.614244] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-10-03T22:38:24.616348] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-03T22:38:24.620727] [INFO ] [MAIN ] Derivative Progress: 685/2073 symbols completed. FHN took 1.3s. Estimated remaining: 9m 41s. Rate: 143.4 symbols/min [2025-10-03T22:38:24.620937] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:24.626203] [DEBUG] [LOCAL ] FICO: Derivative data saved (1819 records). [2025-10-03T22:38:24.634825] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-03T22:38:24.641711] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:24.645559] [INFO ] [MAIN ] Derivative Progress: 686/2073 symbols completed. FICO took 1.3s. Estimated remaining: 9m 39s. Rate: 143.6 symbols/min [2025-10-03T22:38:24.645929] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:24.648072] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54278 primary records. [2025-10-03T22:38:24.648301] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-03T22:38:24.672562] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-10-03T22:38:24.672867] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-03T22:38:24.684615] [INFO ] [MAIN ] Derivative Progress: 687/2073 symbols completed. FI took 1.4s. Estimated remaining: 9m 38s. Rate: 143.8 symbols/min [2025-10-03T22:38:24.685130] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:24.731202] [DEBUG] [LOCAL ] FIGS: Loaded 49571 existing records from primary storage. [2025-10-03T22:38:24.732609] [INFO ] [MAIN ] FIGS: Loaded 49571 primary data records. [2025-10-03T22:38:24.789478] [DEBUG] [LOCAL ] FINS: Loaded 8348 existing records from primary storage. [2025-10-03T22:38:24.783921] [DEBUG] [LOCAL ] FIHL: Loaded 40409 existing records from primary storage. [2025-10-03T22:38:24.800115] [INFO ] [MAIN ] FINS: Loaded 8348 primary data records. [2025-10-03T22:38:24.800033] [INFO ] [MAIN ] FIHL: Loaded 40409 primary data records. [2025-10-03T22:38:25.830425] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:25.833002] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49571 primary records. [2025-10-03T22:38:25.833996] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-03T22:38:25.867942] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-10-03T22:38:25.868681] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-03T22:38:25.871835] [INFO ] [MAIN ] Derivative Progress: 688/2073 symbols completed. FIGS took 1.3s. Estimated remaining: 9m 39s. Rate: 143.4 symbols/min [2025-10-03T22:38:25.868448] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:25.886193] [INFO ] [MAIN ] FINS: Generated 1820 derivative records from 8348 primary records. [2025-10-03T22:38:25.886685] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-03T22:38:25.887759] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:25.889456] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 40409 primary records. [2025-10-03T22:38:25.896447] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-03T22:38:25.906157] [DEBUG] [LOCAL ] FINS: Derivative data saved (1820 records). [2025-10-03T22:38:25.906567] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-03T22:38:25.909825] [INFO ] [MAIN ] Derivative Progress: 689/2073 symbols completed. FINS took 1.2s. Estimated remaining: 9m 38s. Rate: 143.6 symbols/min [2025-10-03T22:38:25.926115] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-10-03T22:38:25.926278] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-03T22:38:25.929725] [INFO ] [MAIN ] Derivative Progress: 690/2073 symbols completed. FIHL took 1.3s. Estimated remaining: 9m 37s. Rate: 143.8 symbols/min [2025-10-03T22:38:25.930365] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:25.930278] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:25.930519] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:25.992835] [DEBUG] [LOCAL ] FIX: Loaded 30134 existing records from primary storage. [2025-10-03T22:38:25.993026] [INFO ] [MAIN ] FIX: Loaded 30134 primary data records. [2025-10-03T22:38:26.066972] [DEBUG] [LOCAL ] FIS: Loaded 54138 existing records from primary storage. [2025-10-03T22:38:26.107224] [INFO ] [MAIN ] FIS: Loaded 54138 primary data records. [2025-10-03T22:38:26.141322] [DEBUG] [LOCAL ] FINV: Loaded 45997 existing records from primary storage. [2025-10-03T22:38:26.195678] [INFO ] [MAIN ] FINV: Loaded 45997 primary data records. [2025-10-03T22:38:27.144794] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:27.159162] [INFO ] [MAIN ] FIX: Generated 1820 derivative records from 30134 primary records. [2025-10-03T22:38:27.159568] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-03T22:38:27.160358] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:27.164320] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54138 primary records. [2025-10-03T22:38:27.173801] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-03T22:38:27.189453] [DEBUG] [LOCAL ] FIX: Derivative data saved (1820 records). [2025-10-03T22:38:27.195902] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:27.196003] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-03T22:38:27.198881] [INFO ] [MAIN ] Derivative Progress: 691/2073 symbols completed. FIX took 1.3s. Estimated remaining: 9m 38s. Rate: 143.4 symbols/min [2025-10-03T22:38:27.199990] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45997 primary records. [2025-10-03T22:38:27.200364] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-03T22:38:27.210354] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:27.234673] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-10-03T22:38:27.235154] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-03T22:38:27.238845] [INFO ] [MAIN ] Derivative Progress: 692/2073 symbols completed. FIS took 1.3s. Estimated remaining: 9m 37s. Rate: 143.6 symbols/min [2025-10-03T22:38:27.241458] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-10-03T22:38:27.240613] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:27.241831] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-03T22:38:27.247072] [INFO ] [MAIN ] Derivative Progress: 693/2073 symbols completed. FINV took 1.3s. Estimated remaining: 9m 36s. Rate: 143.8 symbols/min [2025-10-03T22:38:27.251728] [DEBUG] [LOCAL ] FLC: Loaded 5459 existing records from primary storage. [2025-10-03T22:38:27.252105] [INFO ] [MAIN ] FLC: Loaded 5459 primary data records. [2025-10-03T22:38:27.251836] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:27.622485] [DEBUG] [LOCAL ] FLNG: Loaded 34143 existing records from primary storage. [2025-10-03T22:38:27.623091] [INFO ] [MAIN ] FLNG: Loaded 34143 primary data records. [2025-10-03T22:38:27.754481] [DEBUG] [LOCAL ] FLG: Loaded 54100 existing records from primary storage. [2025-10-03T22:38:27.755998] [INFO ] [MAIN ] FLG: Loaded 54100 primary data records. [2025-10-03T22:38:28.344996] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:28.346150] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5459 primary records. [2025-10-03T22:38:28.347213] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-03T22:38:28.371515] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-10-03T22:38:28.372545] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-03T22:38:28.376084] [INFO ] [MAIN ] Derivative Progress: 694/2073 symbols completed. FLC took 1.2s. Estimated remaining: 9m 37s. Rate: 143.4 symbols/min [2025-10-03T22:38:28.376632] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:28.396105] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:28.397341] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34143 primary records. [2025-10-03T22:38:28.397790] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-03T22:38:28.418024] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-10-03T22:38:28.418988] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-03T22:38:28.421662] [INFO ] [MAIN ] Derivative Progress: 695/2073 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 36s. Rate: 143.6 symbols/min [2025-10-03T22:38:28.422093] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:28.440487] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:28.441854] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54100 primary records. [2025-10-03T22:38:28.442026] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-03T22:38:28.464808] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-10-03T22:38:28.465038] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-03T22:38:28.468567] [INFO ] [MAIN ] Derivative Progress: 696/2073 symbols completed. FLG took 1.2s. Estimated remaining: 9m 35s. Rate: 143.8 symbols/min [2025-10-03T22:38:28.468957] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:28.522043] [DEBUG] [LOCAL ] FLO: Loaded 52669 existing records from primary storage. [2025-10-03T22:38:28.522390] [INFO ] [MAIN ] FLO: Loaded 52669 primary data records. [2025-10-03T22:38:28.662133] [DEBUG] [LOCAL ] FLR: Loaded 53897 existing records from primary storage. [2025-10-03T22:38:28.679950] [INFO ] [MAIN ] FLR: Loaded 53897 primary data records. [2025-10-03T22:38:28.804785] [DEBUG] [LOCAL ] FLS: Loaded 50938 existing records from primary storage. [2025-10-03T22:38:28.997113] [INFO ] [MAIN ] FLS: Loaded 50938 primary data records. [2025-10-03T22:38:29.639772] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:29.641472] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52669 primary records. [2025-10-03T22:38:29.641770] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-03T22:38:29.663887] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-10-03T22:38:29.666405] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-03T22:38:29.669347] [INFO ] [MAIN ] Derivative Progress: 697/2073 symbols completed. FLO took 1.3s. Estimated remaining: 9m 36s. Rate: 143.4 symbols/min [2025-10-03T22:38:29.671350] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:29.686086] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:29.688967] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53897 primary records. [2025-10-03T22:38:29.689167] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-03T22:38:29.717777] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:29.726414] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 50938 primary records. [2025-10-03T22:38:29.726622] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-03T22:38:29.725274] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-10-03T22:38:29.727733] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-03T22:38:29.732253] [INFO ] [MAIN ] Derivative Progress: 698/2073 symbols completed. FLR took 1.3s. Estimated remaining: 9m 35s. Rate: 143.6 symbols/min [2025-10-03T22:38:29.732945] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:29.752208] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-10-03T22:38:29.752390] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-03T22:38:29.755884] [INFO ] [MAIN ] Derivative Progress: 699/2073 symbols completed. FLS took 1.3s. Estimated remaining: 9m 33s. Rate: 143.8 symbols/min [2025-10-03T22:38:29.756274] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:29.793356] [DEBUG] [LOCAL ] FLXR: Loaded 20820 existing records from primary storage. [2025-10-03T22:38:29.793784] [INFO ] [MAIN ] FLXR: Loaded 20820 primary data records. [2025-10-03T22:38:29.907338] [DEBUG] [LOCAL ] FLUT: Loaded 51557 existing records from primary storage. [2025-10-03T22:38:29.951768] [INFO ] [MAIN ] FLUT: Loaded 51557 primary data records. [2025-10-03T22:38:30.150246] [DEBUG] [LOCAL ] FMC: Loaded 52558 existing records from primary storage. [2025-10-03T22:38:30.167208] [INFO ] [MAIN ] FMC: Loaded 52558 primary data records. [2025-10-03T22:38:31.008130] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:31.009600] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 20820 primary records. [2025-10-03T22:38:31.010123] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-03T22:38:31.050368] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-10-03T22:38:31.050769] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-03T22:38:31.053826] [INFO ] [MAIN ] Derivative Progress: 700/2073 symbols completed. FLXR took 1.3s. Estimated remaining: 9m 35s. Rate: 143.4 symbols/min [2025-10-03T22:38:31.054009] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:31.054678] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:31.061025] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51557 primary records. [2025-10-03T22:38:31.072582] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:31.072841] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-03T22:38:31.073969] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52558 primary records. [2025-10-03T22:38:31.074766] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-03T22:38:31.113889] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-10-03T22:38:31.114435] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-03T22:38:31.118389] [INFO ] [MAIN ] Derivative Progress: 701/2073 symbols completed. FMC took 1.4s. Estimated remaining: 9m 34s. Rate: 143.5 symbols/min [2025-10-03T22:38:31.114101] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-10-03T22:38:31.118680] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:31.119382] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-03T22:38:31.127811] [INFO ] [MAIN ] Derivative Progress: 702/2073 symbols completed. FLUT took 1.5s. Estimated remaining: 9m 32s. Rate: 143.7 symbols/min [2025-10-03T22:38:31.128370] [DEBUG] [LOCAL ] FMN: Loaded 5644 existing records from primary storage. [2025-10-03T22:38:31.128902] [INFO ] [MAIN ] FMN: Loaded 5644 primary data records. [2025-10-03T22:38:31.129040] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:31.513397] [DEBUG] [LOCAL ] FMS: Loaded 30400 existing records from primary storage. [2025-10-03T22:38:31.515098] [INFO ] [MAIN ] FMS: Loaded 30400 primary data records. [2025-10-03T22:38:31.529078] [DEBUG] [LOCAL ] FMX: Loaded 41194 existing records from primary storage. [2025-10-03T22:38:31.539164] [INFO ] [MAIN ] FMX: Loaded 41194 primary data records. [2025-10-03T22:38:32.189087] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:32.190256] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 5644 primary records. [2025-10-03T22:38:32.190380] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-03T22:38:32.210362] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-10-03T22:38:32.210583] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-03T22:38:32.214379] [INFO ] [MAIN ] Derivative Progress: 703/2073 symbols completed. FMN took 1.2s. Estimated remaining: 9m 33s. Rate: 143.4 symbols/min [2025-10-03T22:38:32.246052] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:32.245804] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:32.246916] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30400 primary records. [2025-10-03T22:38:32.247477] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41194 primary records. [2025-10-03T22:38:32.247537] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-03T22:38:32.248322] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-03T22:38:32.276206] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-10-03T22:38:32.276736] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-03T22:38:32.280422] [INFO ] [MAIN ] Derivative Progress: 704/2073 symbols completed. FMX took 1.2s. Estimated remaining: 9m 32s. Rate: 143.6 symbols/min [2025-10-03T22:38:32.283331] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-10-03T22:38:32.283400] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-03T22:38:32.286123] [INFO ] [MAIN ] Derivative Progress: 705/2073 symbols completed. FMS took 1.2s. Estimated remaining: 9m 31s. Rate: 143.8 symbols/min [2025-10-03T22:38:32.286912] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:32.287036] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:32.286845] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:32.291581] [DEBUG] [LOCAL ] FMY: Loaded 1401 existing records from primary storage. [2025-10-03T22:38:32.292072] [INFO ] [MAIN ] FMY: Loaded 1401 primary data records. [2025-10-03T22:38:32.652145] [DEBUG] [LOCAL ] FN: Loaded 39003 existing records from primary storage. [2025-10-03T22:38:32.653109] [INFO ] [MAIN ] FN: Loaded 39003 primary data records. [2025-10-03T22:38:32.713883] [DEBUG] [LOCAL ] FNB: Loaded 53238 existing records from primary storage. [2025-10-03T22:38:32.740605] [INFO ] [MAIN ] FNB: Loaded 53238 primary data records. [2025-10-03T22:38:33.415683] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:33.417822] [INFO ] [MAIN ] FMY: Generated 1820 derivative records from 1401 primary records. [2025-10-03T22:38:33.418572] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-03T22:38:33.439699] [DEBUG] [LOCAL ] FMY: Derivative data saved (1820 records). [2025-10-03T22:38:33.440953] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-03T22:38:33.445290] [INFO ] [MAIN ] Derivative Progress: 706/2073 symbols completed. FMY took 1.2s. Estimated remaining: 9m 32s. Rate: 143.4 symbols/min [2025-10-03T22:38:33.445730] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:33.460601] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:33.461579] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 39003 primary records. [2025-10-03T22:38:33.461843] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-03T22:38:33.479954] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-10-03T22:38:33.480163] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-03T22:38:33.482964] [INFO ] [MAIN ] Derivative Progress: 707/2073 symbols completed. FN took 1.2s. Estimated remaining: 9m 31s. Rate: 143.6 symbols/min [2025-10-03T22:38:33.486197] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:33.502810] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:33.503722] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53238 primary records. [2025-10-03T22:38:33.503949] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-03T22:38:33.524503] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-10-03T22:38:33.524775] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-03T22:38:33.528634] [INFO ] [MAIN ] Derivative Progress: 708/2073 symbols completed. FNB took 1.2s. Estimated remaining: 9m 30s. Rate: 143.8 symbols/min [2025-10-03T22:38:33.528864] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:33.581292] [DEBUG] [LOCAL ] FND: Loaded 52854 existing records from primary storage. [2025-10-03T22:38:33.581695] [INFO ] [MAIN ] FND: Loaded 52854 primary data records. [2025-10-03T22:38:33.703325] [DEBUG] [LOCAL ] FNF: Loaded 49705 existing records from primary storage. [2025-10-03T22:38:33.729098] [INFO ] [MAIN ] FNF: Loaded 49705 primary data records. [2025-10-03T22:38:33.902190] [DEBUG] [LOCAL ] FNV: Loaded 46785 existing records from primary storage. [2025-10-03T22:38:33.943925] [INFO ] [MAIN ] FNV: Loaded 46785 primary data records. [2025-10-03T22:38:34.646200] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:34.647375] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52854 primary records. [2025-10-03T22:38:34.647598] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-03T22:38:34.667598] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-10-03T22:38:34.668137] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-03T22:38:34.670554] [INFO ] [MAIN ] Derivative Progress: 709/2073 symbols completed. FND took 1.2s. Estimated remaining: 9m 31s. Rate: 143.4 symbols/min [2025-10-03T22:38:34.670967] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:34.687269] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:34.688883] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49705 primary records. [2025-10-03T22:38:34.689050] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-03T22:38:34.719999] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:34.721980] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 46785 primary records. [2025-10-03T22:38:34.728272] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-03T22:38:34.729955] [DEBUG] [LOCAL ] FOA: Loaded 13268 existing records from primary storage. [2025-10-03T22:38:34.730575] [INFO ] [MAIN ] FOA: Loaded 13268 primary data records. [2025-10-03T22:38:34.730863] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-10-03T22:38:34.742168] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-03T22:38:34.747475] [INFO ] [MAIN ] Derivative Progress: 710/2073 symbols completed. FNF took 1.3s. Estimated remaining: 9m 30s. Rate: 143.6 symbols/min [2025-10-03T22:38:34.755505] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-10-03T22:38:34.753128] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:34.781893] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-03T22:38:34.792507] [INFO ] [MAIN ] Derivative Progress: 711/2073 symbols completed. FNV took 1.3s. Estimated remaining: 9m 28s. Rate: 143.8 symbols/min [2025-10-03T22:38:34.821087] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:34.932521] [DEBUG] [LOCAL ] FOF: Loaded 8526 existing records from primary storage. [2025-10-03T22:38:34.967670] [INFO ] [MAIN ] FOF: Loaded 8526 primary data records. [2025-10-03T22:38:35.223021] [DEBUG] [LOCAL ] FOR: Loaded 20020 existing records from primary storage. [2025-10-03T22:38:35.229530] [INFO ] [MAIN ] FOR: Loaded 20020 primary data records. [2025-10-03T22:38:35.823862] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:35.826062] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13268 primary records. [2025-10-03T22:38:35.826207] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-03T22:38:35.848773] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-10-03T22:38:35.849568] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-03T22:38:35.853691] [INFO ] [MAIN ] Derivative Progress: 712/2073 symbols completed. FOA took 1.2s. Estimated remaining: 9m 29s. Rate: 143.5 symbols/min [2025-10-03T22:38:35.854916] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:35.870585] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:35.871719] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8526 primary records. [2025-10-03T22:38:35.872040] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-03T22:38:35.905995] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-10-03T22:38:35.906818] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-03T22:38:35.906555] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:35.911045] [INFO ] [MAIN ] Derivative Progress: 713/2073 symbols completed. FOF took 1.2s. Estimated remaining: 9m 28s. Rate: 143.6 symbols/min [2025-10-03T22:38:35.911567] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:35.912493] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20020 primary records. [2025-10-03T22:38:35.913545] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-03T22:38:35.943518] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-10-03T22:38:35.943623] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-03T22:38:35.947576] [INFO ] [MAIN ] Derivative Progress: 714/2073 symbols completed. FOR took 1.1s. Estimated remaining: 9m 27s. Rate: 143.8 symbols/min [2025-10-03T22:38:35.947936] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:35.971409] [DEBUG] [LOCAL ] FOUR: Loaded 50298 existing records from primary storage. [2025-10-03T22:38:35.979390] [INFO ] [MAIN ] FOUR: Loaded 50298 primary data records. [2025-10-03T22:38:36.009419] [DEBUG] [LOCAL ] FPF: Loaded 18584 existing records from primary storage. [2025-10-03T22:38:36.026402] [INFO ] [MAIN ] FPF: Loaded 18584 primary data records. [2025-10-03T22:38:36.209898] [DEBUG] [LOCAL ] FPH: Loaded 19674 existing records from primary storage. [2025-10-03T22:38:36.233876] [INFO ] [MAIN ] FPH: Loaded 19674 primary data records. [2025-10-03T22:38:37.022115] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:37.023164] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:37.024157] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 18584 primary records. [2025-10-03T22:38:37.024843] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50298 primary records. [2025-10-03T22:38:37.025031] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-03T22:38:37.024969] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-03T22:38:37.048874] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-10-03T22:38:37.062301] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-03T22:38:37.066300] [INFO ] [MAIN ] Derivative Progress: 715/2073 symbols completed. FOUR took 1.2s. Estimated remaining: 9m 28s. Rate: 143.5 symbols/min [2025-10-03T22:38:37.078217] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:37.078734] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:37.083607] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19674 primary records. [2025-10-03T22:38:37.084090] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-03T22:38:37.090602] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-10-03T22:38:37.090932] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-03T22:38:37.101413] [INFO ] [MAIN ] Derivative Progress: 716/2073 symbols completed. FPF took 1.2s. Estimated remaining: 9m 27s. Rate: 143.7 symbols/min [2025-10-03T22:38:37.106397] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:37.112808] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-10-03T22:38:37.112942] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-03T22:38:37.120710] [INFO ] [MAIN ] Derivative Progress: 717/2073 symbols completed. FPH took 1.2s. Estimated remaining: 9m 26s. Rate: 143.9 symbols/min [2025-10-03T22:38:37.120895] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:37.150495] [DEBUG] [LOCAL ] FPI: Loaded 31480 existing records from primary storage. [2025-10-03T22:38:37.150833] [INFO ] [MAIN ] FPI: Loaded 31480 primary data records. [2025-10-03T22:38:37.228857] [DEBUG] [LOCAL ] FRA: Loaded 14755 existing records from primary storage. [2025-10-03T22:38:37.262528] [INFO ] [MAIN ] FRA: Loaded 14755 primary data records. [2025-10-03T22:38:37.430432] [DEBUG] [LOCAL ] FR: Loaded 47072 existing records from primary storage. [2025-10-03T22:38:37.479466] [INFO ] [MAIN ] FR: Loaded 47072 primary data records. [2025-10-03T22:38:38.244026] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:38.245897] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31480 primary records. [2025-10-03T22:38:38.246142] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-03T22:38:38.267750] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-10-03T22:38:38.271076] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-03T22:38:38.274726] [INFO ] [MAIN ] Derivative Progress: 718/2073 symbols completed. FPI took 1.2s. Estimated remaining: 9m 27s. Rate: 143.5 symbols/min [2025-10-03T22:38:38.290386] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:38.291363] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14755 primary records. [2025-10-03T22:38:38.291537] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-03T22:38:38.323979] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:38.325610] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47072 primary records. [2025-10-03T22:38:38.325980] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-03T22:38:38.327471] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-10-03T22:38:38.327960] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-03T22:38:38.331806] [INFO ] [MAIN ] Derivative Progress: 719/2073 symbols completed. FRA took 1.2s. Estimated remaining: 9m 25s. Rate: 143.7 symbols/min [2025-10-03T22:38:38.347462] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-10-03T22:38:38.347566] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-03T22:38:38.351010] [INFO ] [MAIN ] Derivative Progress: 720/2073 symbols completed. FR took 1.2s. Estimated remaining: 9m 24s. Rate: 143.9 symbols/min [2025-10-03T22:38:38.351534] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:38.351745] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:38.351874] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:38.377235] [DEBUG] [LOCAL ] FRGE: Loaded 17810 existing records from primary storage. [2025-10-03T22:38:38.377562] [INFO ] [MAIN ] FRGE: Loaded 17810 primary data records. [2025-10-03T22:38:38.581148] [DEBUG] [LOCAL ] FSCO: Loaded 38288 existing records from primary storage. [2025-10-03T22:38:38.583122] [INFO ] [MAIN ] FSCO: Loaded 38288 primary data records. [2025-10-03T22:38:38.594369] [DEBUG] [LOCAL ] FRO: Loaded 52466 existing records from primary storage. [2025-10-03T22:38:38.646999] [INFO ] [MAIN ] FRO: Loaded 52466 primary data records. [2025-10-03T22:38:39.532524] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:39.534279] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 17810 primary records. [2025-10-03T22:38:39.534500] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-03T22:38:39.566596] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-10-03T22:38:39.567134] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-03T22:38:39.567070] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:39.571197] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 38288 primary records. [2025-10-03T22:38:39.571346] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-03T22:38:39.570242] [INFO ] [MAIN ] Derivative Progress: 721/2073 symbols completed. FRGE took 1.2s. Estimated remaining: 9m 25s. Rate: 143.5 symbols/min [2025-10-03T22:38:39.573026] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:39.595013] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-10-03T22:38:39.595247] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-03T22:38:39.598767] [INFO ] [MAIN ] Derivative Progress: 722/2073 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 24s. Rate: 143.7 symbols/min [2025-10-03T22:38:39.599002] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:39.617062] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:39.618152] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52466 primary records. [2025-10-03T22:38:39.618246] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-03T22:38:39.637217] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-10-03T22:38:39.637575] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-03T22:38:39.641323] [INFO ] [MAIN ] Derivative Progress: 723/2073 symbols completed. FRO took 1.3s. Estimated remaining: 9m 23s. Rate: 143.8 symbols/min [2025-10-03T22:38:39.641760] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:39.692598] [DEBUG] [LOCAL ] FSK: Loaded 50184 existing records from primary storage. [2025-10-03T22:38:39.693675] [INFO ] [MAIN ] FSK: Loaded 50184 primary data records. [2025-10-03T22:38:39.774231] [DEBUG] [LOCAL ] FSLY: Loaded 52001 existing records from primary storage. [2025-10-03T22:38:39.797723] [INFO ] [MAIN ] FSLY: Loaded 52001 primary data records. [2025-10-03T22:38:40.044028] [DEBUG] [LOCAL ] FSM: Loaded 54070 existing records from primary storage. [2025-10-03T22:38:40.174958] [INFO ] [MAIN ] FSM: Loaded 54070 primary data records. [2025-10-03T22:38:40.793594] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:40.795308] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50184 primary records. [2025-10-03T22:38:40.795561] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-03T22:38:40.821572] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-10-03T22:38:40.821809] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-03T22:38:40.824547] [INFO ] [MAIN ] Derivative Progress: 724/2073 symbols completed. FSK took 1.3s. Estimated remaining: 9m 24s. Rate: 143.5 symbols/min [2025-10-03T22:38:40.838374] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:40.839617] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:40.840907] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 52001 primary records. [2025-10-03T22:38:40.841137] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-03T22:38:40.873171] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:40.875824] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54070 primary records. [2025-10-03T22:38:40.876252] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-03T22:38:40.887910] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-10-03T22:38:40.908430] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-03T22:38:40.913412] [INFO ] [MAIN ] Derivative Progress: 725/2073 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 23s. Rate: 143.6 symbols/min [2025-10-03T22:38:40.913743] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:40.921059] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-10-03T22:38:40.921443] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-03T22:38:40.925217] [INFO ] [MAIN ] Derivative Progress: 726/2073 symbols completed. FSM took 1.3s. Estimated remaining: 9m 22s. Rate: 143.8 symbols/min [2025-10-03T22:38:40.928396] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:40.941835] [DEBUG] [LOCAL ] FSS: Loaded 34548 existing records from primary storage. [2025-10-03T22:38:40.942103] [INFO ] [MAIN ] FSS: Loaded 34548 primary data records. [2025-10-03T22:38:40.968768] [DEBUG] [LOCAL ] FT: Loaded 6616 existing records from primary storage. [2025-10-03T22:38:41.005258] [INFO ] [MAIN ] FT: Loaded 6616 primary data records. [2025-10-03T22:38:41.213985] [DEBUG] [LOCAL ] FTHY: Loaded 12277 existing records from primary storage. [2025-10-03T22:38:41.227104] [INFO ] [MAIN ] FTHY: Loaded 12277 primary data records. [2025-10-03T22:38:41.995561] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:42.002573] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6616 primary records. [2025-10-03T22:38:42.003185] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:42.003291] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-03T22:38:42.005246] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34548 primary records. [2025-10-03T22:38:42.005761] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-03T22:38:42.037049] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-10-03T22:38:42.037945] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-03T22:38:42.041847] [INFO ] [MAIN ] Derivative Progress: 727/2073 symbols completed. FT took 1.1s. Estimated remaining: 9m 23s. Rate: 143.5 symbols/min [2025-10-03T22:38:42.042124] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:42.058373] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:42.060116] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 12277 primary records. [2025-10-03T22:38:42.060812] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-03T22:38:42.076992] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-10-03T22:38:42.081368] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-03T22:38:42.084762] [INFO ] [MAIN ] Derivative Progress: 728/2073 symbols completed. FSS took 1.2s. Estimated remaining: 9m 22s. Rate: 143.7 symbols/min [2025-10-03T22:38:42.086005] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:42.085613] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-10-03T22:38:42.087268] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-03T22:38:42.090735] [INFO ] [MAIN ] Derivative Progress: 729/2073 symbols completed. FTHY took 1.2s. Estimated remaining: 9m 21s. Rate: 143.9 symbols/min [2025-10-03T22:38:42.091044] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:42.155688] [DEBUG] [LOCAL ] FTK: Loaded 32705 existing records from primary storage. [2025-10-03T22:38:42.157187] [INFO ] [MAIN ] FTK: Loaded 32705 primary data records. [2025-10-03T22:38:42.170979] [DEBUG] [LOCAL ] FTI: Loaded 54076 existing records from primary storage. [2025-10-03T22:38:42.171262] [INFO ] [MAIN ] FTI: Loaded 54076 primary data records. [2025-10-03T22:38:42.458360] [DEBUG] [LOCAL ] FTS: Loaded 42797 existing records from primary storage. [2025-10-03T22:38:42.527809] [INFO ] [MAIN ] FTS: Loaded 42797 primary data records. [2025-10-03T22:38:43.202247] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:43.217436] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 32705 primary records. [2025-10-03T22:38:43.217732] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-03T22:38:43.220578] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:43.235800] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54076 primary records. [2025-10-03T22:38:43.236491] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-03T22:38:43.258129] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:43.264487] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 42797 primary records. [2025-10-03T22:38:43.265371] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-03T22:38:43.277008] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-10-03T22:38:43.277422] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-03T22:38:43.281614] [INFO ] [MAIN ] Derivative Progress: 730/2073 symbols completed. FTK took 1.2s. Estimated remaining: 9m 22s. Rate: 143.5 symbols/min [2025-10-03T22:38:43.283577] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:43.290227] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-10-03T22:38:43.290578] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-03T22:38:43.293619] [INFO ] [MAIN ] Derivative Progress: 731/2073 symbols completed. FTI took 1.3s. Estimated remaining: 9m 20s. Rate: 143.7 symbols/min [2025-10-03T22:38:43.294129] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:43.299165] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-10-03T22:38:43.300259] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-03T22:38:43.304878] [INFO ] [MAIN ] Derivative Progress: 732/2073 symbols completed. FTS took 1.2s. Estimated remaining: 9m 19s. Rate: 143.9 symbols/min [2025-10-03T22:38:43.305230] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:43.308667] [DEBUG] [LOCAL ] FTWO: Loaded 1873 existing records from primary storage. [2025-10-03T22:38:43.309041] [INFO ] [MAIN ] FTWO: Loaded 1873 primary data records. [2025-10-03T22:38:43.757668] [DEBUG] [LOCAL ] FTV: Loaded 53708 existing records from primary storage. [2025-10-03T22:38:43.759790] [INFO ] [MAIN ] FTV: Loaded 53708 primary data records. [2025-10-03T22:38:43.891463] [DEBUG] [LOCAL ] FUBO: Loaded 54477 existing records from primary storage. [2025-10-03T22:38:43.896036] [INFO ] [MAIN ] FUBO: Loaded 54477 primary data records. [2025-10-03T22:38:44.459402] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:38:44.461174] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1873 primary records. [2025-10-03T22:38:44.461379] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-03T22:38:44.489221] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-10-03T22:38:44.491258] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-03T22:38:44.497388] [INFO ] [MAIN ] Derivative Progress: 733/2073 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 20s. Rate: 143.5 symbols/min [2025-10-03T22:38:44.512348] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:44.513597] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53708 primary records. [2025-10-03T22:38:44.513715] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-03T22:38:44.548571] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-10-03T22:38:44.548968] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:44.549119] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-03T22:38:44.552807] [INFO ] [MAIN ] Derivative Progress: 734/2073 symbols completed. FTV took 1.3s. Estimated remaining: 9m 19s. Rate: 143.7 symbols/min [2025-10-03T22:38:44.553819] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54477 primary records. [2025-10-03T22:38:44.554207] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-03T22:38:44.572149] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-10-03T22:38:44.572225] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-03T22:38:44.575630] [INFO ] [MAIN ] Derivative Progress: 735/2073 symbols completed. FUBO took 1.3s. Estimated remaining: 9m 18s. Rate: 143.9 symbols/min [2025-10-03T22:38:44.576330] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:44.576482] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:44.576243] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:44.616943] [DEBUG] [LOCAL ] FVR: Loaded 21967 existing records from primary storage. [2025-10-03T22:38:44.617278] [INFO ] [MAIN ] FVR: Loaded 21967 primary data records. [2025-10-03T22:38:44.772958] [DEBUG] [LOCAL ] FUL: Loaded 33460 existing records from primary storage. [2025-10-03T22:38:44.773628] [INFO ] [MAIN ] FUL: Loaded 33460 primary data records. [2025-10-03T22:38:45.001049] [DEBUG] [LOCAL ] FUN: Loaded 52377 existing records from primary storage. [2025-10-03T22:38:45.117970] [INFO ] [MAIN ] FUN: Loaded 52377 primary data records. [2025-10-03T22:38:45.719325] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:45.721481] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 21967 primary records. [2025-10-03T22:38:45.721961] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-03T22:38:45.758282] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:45.760975] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33460 primary records. [2025-10-03T22:38:45.761193] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-03T22:38:45.777368] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:45.786924] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52377 primary records. [2025-10-03T22:38:45.787465] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-03T22:38:45.794233] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-10-03T22:38:45.795123] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-03T22:38:45.798183] [INFO ] [MAIN ] Derivative Progress: 736/2073 symbols completed. FVR took 1.2s. Estimated remaining: 9m 19s. Rate: 143.5 symbols/min [2025-10-03T22:38:45.799934] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:45.805436] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-10-03T22:38:45.805918] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-03T22:38:45.809697] [INFO ] [MAIN ] Derivative Progress: 737/2073 symbols completed. FUL took 1.2s. Estimated remaining: 9m 18s. Rate: 143.7 symbols/min [2025-10-03T22:38:45.810008] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:45.827959] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-10-03T22:38:45.828698] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-10-03T22:38:45.908537] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-10-03T22:38:45.938006] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-03T22:38:45.949037] [INFO ] [MAIN ] Derivative Progress: 738/2073 symbols completed. FUN took 1.4s. Estimated remaining: 9m 17s. Rate: 143.8 symbols/min [2025-10-03T22:38:45.961703] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:46.070898] [DEBUG] [LOCAL ] FVRR: Loaded 40657 existing records from primary storage. [2025-10-03T22:38:46.150811] [INFO ] [MAIN ] FVRR: Loaded 40657 primary data records. [2025-10-03T22:38:46.618938] [DEBUG] [LOCAL ] G: Loaded 50591 existing records from primary storage. [2025-10-03T22:38:46.631461] [INFO ] [MAIN ] G: Loaded 50591 primary data records. [2025-10-03T22:38:46.849347] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:38:46.985104] [INFO ] [MAIN ] FXED: Generated 1819 derivative records from 1259 primary records. [2025-10-03T22:38:46.986852] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-03T22:38:47.026145] [DEBUG] [LOCAL ] FXED: Derivative data saved (1819 records). [2025-10-03T22:38:47.025343] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:47.026563] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-03T22:38:47.030205] [INFO ] [MAIN ] Derivative Progress: 739/2073 symbols completed. FXED took 1.2s. Estimated remaining: 9m 18s. Rate: 143.5 symbols/min [2025-10-03T22:38:47.031511] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40657 primary records. [2025-10-03T22:38:47.031694] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:47.033027] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-03T22:38:47.054920] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-10-03T22:38:47.063102] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-03T22:38:47.067402] [INFO ] [MAIN ] Derivative Progress: 740/2073 symbols completed. FVRR took 1.3s. Estimated remaining: 9m 17s. Rate: 143.7 symbols/min [2025-10-03T22:38:47.068832] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:47.085073] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:47.097132] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50591 primary records. [2025-10-03T22:38:47.097412] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-03T22:38:47.097976] [DEBUG] [LOCAL ] GAB: Loaded 28299 existing records from primary storage. [2025-10-03T22:38:47.101861] [DEBUG] [LOCAL ] GAM: Loaded 4101 existing records from primary storage. [2025-10-03T22:38:47.109340] [INFO ] [MAIN ] GAB: Loaded 28299 primary data records. [2025-10-03T22:38:47.109456] [INFO ] [MAIN ] GAM: Loaded 4101 primary data records. [2025-10-03T22:38:47.346321] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-10-03T22:38:47.398051] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-03T22:38:47.461908] [INFO ] [MAIN ] Derivative Progress: 741/2073 symbols completed. G took 1.5s. Estimated remaining: 9m 16s. Rate: 143.7 symbols/min [2025-10-03T22:38:47.489567] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:47.821308] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:47.826388] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4101 primary records. [2025-10-03T22:38:47.826550] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-03T22:38:47.868073] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:47.871480] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28299 primary records. [2025-10-03T22:38:47.871928] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-03T22:38:47.886972] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-10-03T22:38:47.888549] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-03T22:38:47.891941] [INFO ] [MAIN ] Derivative Progress: 742/2073 symbols completed. GAM took 0.8s. Estimated remaining: 9m 16s. Rate: 143.7 symbols/min [2025-10-03T22:38:47.892592] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:47.914294] [DEBUG] [LOCAL ] GAP: Loaded 54434 existing records from primary storage. [2025-10-03T22:38:47.915320] [INFO ] [MAIN ] GAP: Loaded 54434 primary data records. [2025-10-03T22:38:47.956724] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-10-03T22:38:48.006496] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-03T22:38:48.037807] [INFO ] [MAIN ] Derivative Progress: 743/2073 symbols completed. GAB took 1.0s. Estimated remaining: 9m 15s. Rate: 143.8 symbols/min [2025-10-03T22:38:48.048015] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:48.050046] [DEBUG] [LOCAL ] GATX: Loaded 18362 existing records from primary storage. [2025-10-03T22:38:48.056237] [INFO ] [MAIN ] GATX: Loaded 18362 primary data records. [2025-10-03T22:38:48.397573] [DEBUG] [LOCAL ] GBAB: Loaded 13203 existing records from primary storage. [2025-10-03T22:38:48.415526] [INFO ] [MAIN ] GBAB: Loaded 13203 primary data records. [2025-10-03T22:38:49.013445] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:49.014819] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54434 primary records. [2025-10-03T22:38:49.015084] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-03T22:38:49.034312] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-10-03T22:38:49.035474] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-03T22:38:49.038528] [INFO ] [MAIN ] Derivative Progress: 744/2073 symbols completed. GAP took 1.5s. Estimated remaining: 9m 15s. Rate: 143.6 symbols/min [2025-10-03T22:38:49.039276] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:49.060949] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:49.064978] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18362 primary records. [2025-10-03T22:38:49.066522] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-03T22:38:49.083629] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:49.092398] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13203 primary records. [2025-10-03T22:38:49.092629] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-03T22:38:49.128388] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-10-03T22:38:49.139384] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-03T22:38:49.143864] [INFO ] [MAIN ] Derivative Progress: 745/2073 symbols completed. GBAB took 1.1s. Estimated remaining: 9m 15s. Rate: 143.7 symbols/min [2025-10-03T22:38:49.144780] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:49.146666] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-10-03T22:38:49.146757] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-03T22:38:49.150823] [INFO ] [MAIN ] Derivative Progress: 746/2073 symbols completed. GATX took 1.3s. Estimated remaining: 9m 13s. Rate: 143.9 symbols/min [2025-10-03T22:38:49.150992] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:49.151871] [DEBUG] [LOCAL ] GBCI: Loaded 40821 existing records from primary storage. [2025-10-03T22:38:49.152955] [INFO ] [MAIN ] GBCI: Loaded 40821 primary data records. [2025-10-03T22:38:49.512545] [DEBUG] [LOCAL ] GBX: Loaded 29520 existing records from primary storage. [2025-10-03T22:38:49.513936] [INFO ] [MAIN ] GBX: Loaded 29520 primary data records. [2025-10-03T22:38:49.561975] [DEBUG] [LOCAL ] GBTG: Loaded 40575 existing records from primary storage. [2025-10-03T22:38:49.606543] [INFO ] [MAIN ] GBTG: Loaded 40575 primary data records. [2025-10-03T22:38:50.299245] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:50.300412] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 40821 primary records. [2025-10-03T22:38:50.300764] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-03T22:38:50.327627] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-10-03T22:38:50.328442] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-03T22:38:50.332748] [INFO ] [MAIN ] Derivative Progress: 747/2073 symbols completed. GBCI took 1.3s. Estimated remaining: 9m 14s. Rate: 143.5 symbols/min [2025-10-03T22:38:50.333418] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:50.353732] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:50.355070] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29520 primary records. [2025-10-03T22:38:50.355168] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-03T22:38:50.376349] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-10-03T22:38:50.376594] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-03T22:38:50.379778] [INFO ] [MAIN ] Derivative Progress: 748/2073 symbols completed. GBX took 1.2s. Estimated remaining: 9m 13s. Rate: 143.7 symbols/min [2025-10-03T22:38:50.394496] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:50.395419] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40575 primary records. [2025-10-03T22:38:50.395495] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-03T22:38:50.425383] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-10-03T22:38:50.425570] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-03T22:38:50.429177] [INFO ] [MAIN ] Derivative Progress: 749/2073 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 12s. Rate: 143.9 symbols/min [2025-10-03T22:38:50.454925] [DEBUG] [LOCAL ] GCI: Loaded 44716 existing records from primary storage. [2025-10-03T22:38:50.455149] [INFO ] [MAIN ] GCI: Loaded 44716 primary data records. [2025-10-03T22:38:50.793822] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:50.794782] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44716 primary records. [2025-10-03T22:38:50.794854] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-03T22:38:50.811193] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-10-03T22:38:50.811270] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-03T22:38:50.814586] [INFO ] [MAIN ] Derivative Progress: 750/2073 symbols completed. GCI took 0.5s. Estimated remaining: 9m 12s. Rate: 143.9 symbols/min [2025-10-03T22:38:50.815949] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:50.815786] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:50.815634] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:50.849554] [DEBUG] [LOCAL ] GCO: Loaded 24918 existing records from primary storage. [2025-10-03T22:38:50.849824] [INFO ] [MAIN ] GCO: Loaded 24918 primary data records. [2025-10-03T22:38:50.929058] [DEBUG] [LOCAL ] GCTS: Loaded 20197 existing records from primary storage. [2025-10-03T22:38:50.941215] [INFO ] [MAIN ] GCTS: Loaded 20197 primary data records. [2025-10-03T22:38:51.218430] [DEBUG] [LOCAL ] GD: Loaded 47780 existing records from primary storage. [2025-10-03T22:38:51.398817] [INFO ] [MAIN ] GD: Loaded 47780 primary data records. [2025-10-03T22:38:51.910912] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:51.915297] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 24918 primary records. [2025-10-03T22:38:51.915520] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-03T22:38:51.948184] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-10-03T22:38:51.947969] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:51.949814] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20197 primary records. [2025-10-03T22:38:51.948832] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-03T22:38:51.950232] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-03T22:38:51.954462] [INFO ] [MAIN ] Derivative Progress: 751/2073 symbols completed. GCO took 1.1s. Estimated remaining: 9m 13s. Rate: 143.6 symbols/min [2025-10-03T22:38:51.955064] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:51.973929] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-10-03T22:38:51.974142] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-03T22:38:51.980107] [INFO ] [MAIN ] Derivative Progress: 752/2073 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 11s. Rate: 143.7 symbols/min [2025-10-03T22:38:51.980353] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:51.996878] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:51.999541] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47780 primary records. [2025-10-03T22:38:51.999791] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-03T22:38:52.004704] [DEBUG] [LOCAL ] GDIV: Loaded 3667 existing records from primary storage. [2025-10-03T22:38:52.017014] [INFO ] [MAIN ] GDIV: Loaded 3667 primary data records. [2025-10-03T22:38:52.147741] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-10-03T22:38:52.152134] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-03T22:38:52.156391] [INFO ] [MAIN ] Derivative Progress: 753/2073 symbols completed. GD took 1.3s. Estimated remaining: 9m 11s. Rate: 143.8 symbols/min [2025-10-03T22:38:52.156902] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:52.267365] [DEBUG] [LOCAL ] GDDY: Loaded 50457 existing records from primary storage. [2025-10-03T22:38:52.429745] [INFO ] [MAIN ] GDDY: Loaded 50457 primary data records. [2025-10-03T22:38:52.461594] [DEBUG] [LOCAL ] GDL: Loaded 2587 existing records from primary storage. [2025-10-03T22:38:52.475871] [INFO ] [MAIN ] GDL: Loaded 2587 primary data records. [2025-10-03T22:38:53.191857] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:38:53.194325] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3667 primary records. [2025-10-03T22:38:53.194433] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-03T22:38:53.215316] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-10-03T22:38:53.215630] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-03T22:38:53.219857] [INFO ] [MAIN ] Derivative Progress: 754/2073 symbols completed. GDIV took 1.2s. Estimated remaining: 9m 11s. Rate: 143.5 symbols/min [2025-10-03T22:38:53.220794] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:53.242451] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:53.243680] [INFO ] [MAIN ] GDL: Generated 1820 derivative records from 2587 primary records. [2025-10-03T22:38:53.243819] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-03T22:38:53.247564] [DEBUG] [LOCAL ] GDO: Loaded 6068 existing records from primary storage. [2025-10-03T22:38:53.249733] [INFO ] [MAIN ] GDO: Loaded 6068 primary data records. [2025-10-03T22:38:53.350548] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:53.375398] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50457 primary records. [2025-10-03T22:38:53.382008] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-03T22:38:53.394801] [DEBUG] [LOCAL ] GDL: Derivative data saved (1820 records). [2025-10-03T22:38:53.434427] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-03T22:38:53.487972] [INFO ] [MAIN ] Derivative Progress: 755/2073 symbols completed. GDL took 1.3s. Estimated remaining: 9m 11s. Rate: 143.6 symbols/min [2025-10-03T22:38:53.615750] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:53.623916] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-10-03T22:38:53.624695] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-03T22:38:53.628858] [INFO ] [MAIN ] Derivative Progress: 756/2073 symbols completed. GDDY took 1.7s. Estimated remaining: 9m 10s. Rate: 143.7 symbols/min [2025-10-03T22:38:53.629580] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:53.684199] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:53.685103] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 6068 primary records. [2025-10-03T22:38:53.685264] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-03T22:38:53.706063] [DEBUG] [LOCAL ] GDV: Loaded 19748 existing records from primary storage. [2025-10-03T22:38:53.719224] [INFO ] [MAIN ] GDV: Loaded 19748 primary data records. [2025-10-03T22:38:53.734111] [DEBUG] [LOCAL ] GDOT: Loaded 38866 existing records from primary storage. [2025-10-03T22:38:53.746533] [INFO ] [MAIN ] GDOT: Loaded 38866 primary data records. [2025-10-03T22:38:53.926918] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-10-03T22:38:53.969091] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-03T22:38:53.994358] [INFO ] [MAIN ] Derivative Progress: 757/2073 symbols completed. GDO took 0.8s. Estimated remaining: 9m 9s. Rate: 143.8 symbols/min [2025-10-03T22:38:53.995412] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:54.527570] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:54.561896] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 38866 primary records. [2025-10-03T22:38:54.562137] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-03T22:38:54.562615] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:54.565150] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-10-03T22:38:54.574340] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19748 primary records. [2025-10-03T22:38:54.579052] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-03T22:38:54.579264] [INFO ] [MAIN ] GE: Loaded 54493 primary data records. [2025-10-03T22:38:54.584788] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-10-03T22:38:54.600250] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-03T22:38:54.610972] [INFO ] [MAIN ] Derivative Progress: 758/2073 symbols completed. GDOT took 1.0s. Estimated remaining: 9m 9s. Rate: 143.7 symbols/min [2025-10-03T22:38:54.648246] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-10-03T22:38:54.669835] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:54.661605] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-03T22:38:54.706890] [INFO ] [MAIN ] Derivative Progress: 759/2073 symbols completed. GDV took 1.1s. Estimated remaining: 9m 8s. Rate: 143.8 symbols/min [2025-10-03T22:38:54.722639] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:54.994241] [DEBUG] [LOCAL ] GEF: Loaded 20967 existing records from primary storage. [2025-10-03T22:38:54.995316] [INFO ] [MAIN ] GEF: Loaded 20967 primary data records. [2025-10-03T22:38:55.159260] [DEBUG] [LOCAL ] GEL: Loaded 33461 existing records from primary storage. [2025-10-03T22:38:55.166230] [INFO ] [MAIN ] GEL: Loaded 33461 primary data records. [2025-10-03T22:38:55.577516] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:55.614299] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54493 primary records. [2025-10-03T22:38:55.688743] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-03T22:38:55.770579] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-10-03T22:38:55.773023] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-03T22:38:55.778683] [INFO ] [MAIN ] Derivative Progress: 760/2073 symbols completed. GE took 1.8s. Estimated remaining: 9m 9s. Rate: 143.5 symbols/min [2025-10-03T22:38:55.779933] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:55.793754] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:55.795028] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 20967 primary records. [2025-10-03T22:38:55.795197] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-03T22:38:55.817090] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-10-03T22:38:55.817280] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-03T22:38:55.833600] [INFO ] [MAIN ] Derivative Progress: 761/2073 symbols completed. GEF took 1.2s. Estimated remaining: 9m 8s. Rate: 143.7 symbols/min [2025-10-03T22:38:55.834668] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:55.834809] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:55.837008] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 33461 primary records. [2025-10-03T22:38:55.837131] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-03T22:38:55.855224] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-10-03T22:38:55.855572] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-03T22:38:55.859165] [INFO ] [MAIN ] Derivative Progress: 762/2073 symbols completed. GEL took 1.1s. Estimated remaining: 9m 7s. Rate: 143.9 symbols/min [2025-10-03T22:38:55.859468] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:55.916173] [DEBUG] [LOCAL ] GENI: Loaded 53710 existing records from primary storage. [2025-10-03T22:38:55.916614] [INFO ] [MAIN ] GENI: Loaded 53710 primary data records. [2025-10-03T22:38:56.050256] [DEBUG] [LOCAL ] GEO: Loaded 52673 existing records from primary storage. [2025-10-03T22:38:56.062157] [INFO ] [MAIN ] GEO: Loaded 52673 primary data records. [2025-10-03T22:38:56.257160] [DEBUG] [LOCAL ] GES: Loaded 39908 existing records from primary storage. [2025-10-03T22:38:56.395549] [INFO ] [MAIN ] GES: Loaded 39908 primary data records. [2025-10-03T22:38:57.054260] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:57.069439] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53710 primary records. [2025-10-03T22:38:57.070241] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-03T22:38:57.070530] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:57.072404] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52673 primary records. [2025-10-03T22:38:57.072956] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-03T22:38:57.108925] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-10-03T22:38:57.110898] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-03T22:38:57.115715] [INFO ] [MAIN ] Derivative Progress: 763/2073 symbols completed. GEO took 1.3s. Estimated remaining: 9m 8s. Rate: 143.5 symbols/min [2025-10-03T22:38:57.125938] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-10-03T22:38:57.132343] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-03T22:38:57.132698] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:57.135202] [INFO ] [MAIN ] Derivative Progress: 764/2073 symbols completed. GENI took 1.4s. Estimated remaining: 9m 7s. Rate: 143.7 symbols/min [2025-10-03T22:38:57.136240] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 39908 primary records. [2025-10-03T22:38:57.136330] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-03T22:38:57.153690] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-10-03T22:38:57.153803] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-03T22:38:57.156782] [INFO ] [MAIN ] Derivative Progress: 765/2073 symbols completed. GES took 1.3s. Estimated remaining: 9m 6s. Rate: 143.8 symbols/min [2025-10-03T22:38:57.157309] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:57.157471] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:57.157600] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:57.165436] [DEBUG] [LOCAL ] GF: Loaded 2996 existing records from primary storage. [2025-10-03T22:38:57.165764] [INFO ] [MAIN ] GF: Loaded 2996 primary data records. [2025-10-03T22:38:57.440110] [DEBUG] [LOCAL ] GETY: Loaded 36087 existing records from primary storage. [2025-10-03T22:38:57.444987] [INFO ] [MAIN ] GETY: Loaded 36087 primary data records. [2025-10-03T22:38:57.665469] [DEBUG] [LOCAL ] GEV: Loaded 53810 existing records from primary storage. [2025-10-03T22:38:57.700617] [INFO ] [MAIN ] GEV: Loaded 53810 primary data records. [2025-10-03T22:38:58.288360] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:58.290291] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 2996 primary records. [2025-10-03T22:38:58.290887] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-03T22:38:58.312905] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-10-03T22:38:58.313306] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-03T22:38:58.316578] [INFO ] [MAIN ] Derivative Progress: 766/2073 symbols completed. GF took 1.2s. Estimated remaining: 9m 6s. Rate: 143.5 symbols/min [2025-10-03T22:38:58.316854] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:58.332014] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:58.333267] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 36087 primary records. [2025-10-03T22:38:58.333487] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-03T22:38:58.351606] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-10-03T22:38:58.351947] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-03T22:38:58.356075] [INFO ] [MAIN ] Derivative Progress: 767/2073 symbols completed. GETY took 1.2s. Estimated remaining: 9m 5s. Rate: 143.7 symbols/min [2025-10-03T22:38:58.356269] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:58.372787] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:58.373587] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53810 primary records. [2025-10-03T22:38:58.374059] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-03T22:38:58.401336] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-10-03T22:38:58.401409] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-03T22:38:58.404544] [INFO ] [MAIN ] Derivative Progress: 768/2073 symbols completed. GEV took 1.2s. Estimated remaining: 9m 4s. Rate: 143.8 symbols/min [2025-10-03T22:38:58.405100] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:58.424844] [DEBUG] [LOCAL ] GFF: Loaded 30788 existing records from primary storage. [2025-10-03T22:38:58.425877] [INFO ] [MAIN ] GFF: Loaded 30788 primary data records. [2025-10-03T22:38:58.683856] [DEBUG] [LOCAL ] GFI: Loaded 53875 existing records from primary storage. [2025-10-03T22:38:58.709153] [INFO ] [MAIN ] GFI: Loaded 53875 primary data records. [2025-10-03T22:38:58.965612] [DEBUG] [LOCAL ] GFL: Loaded 48679 existing records from primary storage. [2025-10-03T22:38:58.977215] [INFO ] [MAIN ] GFL: Loaded 48679 primary data records. [2025-10-03T22:38:59.614602] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:59.615817] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 30788 primary records. [2025-10-03T22:38:59.618966] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-03T22:38:59.639293] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-10-03T22:38:59.639809] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-03T22:38:59.642849] [INFO ] [MAIN ] Derivative Progress: 769/2073 symbols completed. GFF took 1.3s. Estimated remaining: 9m 5s. Rate: 143.5 symbols/min [2025-10-03T22:38:59.644812] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:38:59.668008] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:59.674087] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53875 primary records. [2025-10-03T22:38:59.672675] [DEBUG] [LOCAL ] GFR: Loaded 8439 existing records from primary storage. [2025-10-03T22:38:59.674197] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-03T22:38:59.674828] [INFO ] [MAIN ] GFR: Loaded 8439 primary data records. [2025-10-03T22:38:59.813204] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:38:59.839954] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-10-03T22:38:59.830976] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48679 primary records. [2025-10-03T22:38:59.840135] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-03T22:38:59.851094] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-03T22:38:59.866300] [INFO ] [MAIN ] Derivative Progress: 770/2073 symbols completed. GFI took 1.5s. Estimated remaining: 9m 5s. Rate: 143.6 symbols/min [2025-10-03T22:38:59.879820] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:00.094503] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-10-03T22:39:00.095340] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-03T22:39:00.100249] [INFO ] [MAIN ] Derivative Progress: 771/2073 symbols completed. GFL took 1.7s. Estimated remaining: 9m 4s. Rate: 143.6 symbols/min [2025-10-03T22:39:00.101232] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:00.142792] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:00.143593] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8439 primary records. [2025-10-03T22:39:00.143722] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-03T22:39:00.182560] [DEBUG] [LOCAL ] GGB: Loaded 51859 existing records from primary storage. [2025-10-03T22:39:00.183164] [INFO ] [MAIN ] GGB: Loaded 51859 primary data records. [2025-10-03T22:39:00.251150] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-10-03T22:39:00.295044] [DEBUG] [LOCAL ] GGG: Loaded 41546 existing records from primary storage. [2025-10-03T22:39:00.317153] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-03T22:39:00.318014] [INFO ] [MAIN ] GGG: Loaded 41546 primary data records. [2025-10-03T22:39:00.331961] [INFO ] [MAIN ] Derivative Progress: 772/2073 symbols completed. GFR took 0.7s. Estimated remaining: 9m 3s. Rate: 143.7 symbols/min [2025-10-03T22:39:00.342787] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:00.669425] [DEBUG] [LOCAL ] GGT: Loaded 14275 existing records from primary storage. [2025-10-03T22:39:00.693800] [INFO ] [MAIN ] GGT: Loaded 14275 primary data records. [2025-10-03T22:39:01.292050] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:01.295064] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51859 primary records. [2025-10-03T22:39:01.295674] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-03T22:39:01.318283] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-10-03T22:39:01.322529] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-03T22:39:01.325803] [INFO ] [MAIN ] Derivative Progress: 773/2073 symbols completed. GGB took 1.4s. Estimated remaining: 9m 4s. Rate: 143.5 symbols/min [2025-10-03T22:39:01.326923] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:01.343037] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:01.345422] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41546 primary records. [2025-10-03T22:39:01.345542] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-03T22:39:01.360555] [DEBUG] [LOCAL ] GGZ: Loaded 2447 existing records from primary storage. [2025-10-03T22:39:01.365988] [INFO ] [MAIN ] GGZ: Loaded 2447 primary data records. [2025-10-03T22:39:01.471067] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:01.511386] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-10-03T22:39:01.512201] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-03T22:39:01.498958] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14275 primary records. [2025-10-03T22:39:01.531847] [INFO ] [MAIN ] Derivative Progress: 774/2073 symbols completed. GGG took 1.4s. Estimated remaining: 9m 3s. Rate: 143.6 symbols/min [2025-10-03T22:39:01.537303] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:01.528200] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-03T22:39:01.618495] [DEBUG] [LOCAL ] GHC: Loaded 2749 existing records from primary storage. [2025-10-03T22:39:01.769947] [INFO ] [MAIN ] GHC: Loaded 2749 primary data records. [2025-10-03T22:39:01.826353] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-10-03T22:39:01.882223] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-03T22:39:01.931467] [INFO ] [MAIN ] Derivative Progress: 775/2073 symbols completed. GGT took 1.6s. Estimated remaining: 9m 2s. Rate: 143.6 symbols/min [2025-10-03T22:39:01.933203] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:02.160306] [DEBUG] [LOCAL ] GHG: Loaded 3234 existing records from primary storage. [2025-10-03T22:39:02.160799] [INFO ] [MAIN ] GHG: Loaded 3234 primary data records. [2025-10-03T22:39:02.342494] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:02.361229] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2447 primary records. [2025-10-03T22:39:02.381324] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-03T22:39:02.544213] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:02.545402] [INFO ] [MAIN ] GHC: Generated 1820 derivative records from 2749 primary records. [2025-10-03T22:39:02.546360] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-03T22:39:02.543842] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-10-03T22:39:02.547360] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-03T22:39:02.550864] [INFO ] [MAIN ] Derivative Progress: 776/2073 symbols completed. GGZ took 1.2s. Estimated remaining: 9m 2s. Rate: 143.5 symbols/min [2025-10-03T22:39:02.557698] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:02.567514] [DEBUG] [LOCAL ] GHC: Derivative data saved (1820 records). [2025-10-03T22:39:02.567624] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-03T22:39:02.570834] [INFO ] [MAIN ] Derivative Progress: 777/2073 symbols completed. GHC took 1.0s. Estimated remaining: 9m 1s. Rate: 143.7 symbols/min [2025-10-03T22:39:02.571165] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:02.599868] [DEBUG] [LOCAL ] GHI: Loaded 7159 existing records from primary storage. [2025-10-03T22:39:02.600853] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:39:02.600058] [DEBUG] [LOCAL ] GHLD: Loaded 4227 existing records from primary storage. [2025-10-03T22:39:02.601878] [INFO ] [MAIN ] GHG: Generated 1818 derivative records from 3234 primary records. [2025-10-03T22:39:02.601012] [INFO ] [MAIN ] GHLD: Loaded 4227 primary data records. [2025-10-03T22:39:02.601087] [INFO ] [MAIN ] GHI: Loaded 7159 primary data records. [2025-10-03T22:39:02.613346] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-03T22:39:02.754023] [DEBUG] [LOCAL ] GHG: Derivative data saved (1818 records). [2025-10-03T22:39:02.774484] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-03T22:39:02.835055] [INFO ] [MAIN ] Derivative Progress: 778/2073 symbols completed. GHG took 0.9s. Estimated remaining: 9m 1s. Rate: 143.7 symbols/min [2025-10-03T22:39:03.292058] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:03.293123] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 7159 primary records. [2025-10-03T22:39:03.305937] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-03T22:39:03.306235] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:39:03.307630] [INFO ] [MAIN ] GHLD: Generated 1819 derivative records from 4227 primary records. [2025-10-03T22:39:03.308073] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-03T22:39:03.336483] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-10-03T22:39:03.336852] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-03T22:39:03.339810] [INFO ] [MAIN ] Derivative Progress: 779/2073 symbols completed. GHI took 0.8s. Estimated remaining: 9m 0s. Rate: 143.7 symbols/min [2025-10-03T22:39:03.342618] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1819 records). [2025-10-03T22:39:03.342760] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-03T22:39:03.345917] [INFO ] [MAIN ] Derivative Progress: 780/2073 symbols completed. GHLD took 0.8s. Estimated remaining: 8m 59s. Rate: 143.9 symbols/min [2025-10-03T22:39:03.346478] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:03.347207] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:03.347068] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:03.366848] [DEBUG] [LOCAL ] GHM: Loaded 14245 existing records from primary storage. [2025-10-03T22:39:03.367122] [INFO ] [MAIN ] GHM: Loaded 14245 primary data records. [2025-10-03T22:39:03.723146] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-10-03T22:39:03.733614] [INFO ] [MAIN ] GHY: Loaded 21190 primary data records. [2025-10-03T22:39:03.739485] [DEBUG] [LOCAL ] GIB: Loaded 32516 existing records from primary storage. [2025-10-03T22:39:03.746286] [INFO ] [MAIN ] GIB: Loaded 32516 primary data records. [2025-10-03T22:39:04.380904] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:04.381904] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14245 primary records. [2025-10-03T22:39:04.382010] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-03T22:39:04.416490] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:04.417902] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21190 primary records. [2025-10-03T22:39:04.418265] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-03T22:39:04.419721] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-10-03T22:39:04.429143] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-03T22:39:04.437117] [INFO ] [MAIN ] Derivative Progress: 781/2073 symbols completed. GHM took 1.1s. Estimated remaining: 8m 60s. Rate: 143.6 symbols/min [2025-10-03T22:39:04.438178] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:04.453809] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:04.455228] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32516 primary records. [2025-10-03T22:39:04.455417] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-03T22:39:04.465734] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-10-03T22:39:04.465886] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-03T22:39:04.476154] [INFO ] [MAIN ] Derivative Progress: 782/2073 symbols completed. GHY took 1.1s. Estimated remaining: 8m 59s. Rate: 143.7 symbols/min [2025-10-03T22:39:04.478681] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:04.487170] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-10-03T22:39:04.487392] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-03T22:39:04.491777] [DEBUG] [LOCAL ] GIC: Loaded 13632 existing records from primary storage. [2025-10-03T22:39:04.490996] [INFO ] [MAIN ] Derivative Progress: 783/2073 symbols completed. GIB took 1.1s. Estimated remaining: 8m 58s. Rate: 143.9 symbols/min [2025-10-03T22:39:04.492182] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:04.492074] [INFO ] [MAIN ] GIC: Loaded 13632 primary data records. [2025-10-03T22:39:04.852421] [DEBUG] [LOCAL ] GIL: Loaded 44048 existing records from primary storage. [2025-10-03T22:39:04.853347] [INFO ] [MAIN ] GIL: Loaded 44048 primary data records. [2025-10-03T22:39:04.926915] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-03T22:39:04.949103] [INFO ] [MAIN ] GIS: Loaded 54452 primary data records. [2025-10-03T22:39:05.584194] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:05.587019] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13632 primary records. [2025-10-03T22:39:05.588440] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-03T22:39:05.610324] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-10-03T22:39:05.611318] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-03T22:39:05.614532] [INFO ] [MAIN ] Derivative Progress: 784/2073 symbols completed. GIC took 1.2s. Estimated remaining: 8m 59s. Rate: 143.6 symbols/min [2025-10-03T22:39:05.614769] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:05.638561] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:05.639968] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 44048 primary records. [2025-10-03T22:39:05.640233] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-03T22:39:05.688972] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-10-03T22:39:05.689323] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-03T22:39:05.692677] [INFO ] [MAIN ] Derivative Progress: 785/2073 symbols completed. GIL took 1.2s. Estimated remaining: 8m 58s. Rate: 143.8 symbols/min [2025-10-03T22:39:05.689707] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:05.693974] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54452 primary records. [2025-10-03T22:39:05.694346] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:05.694226] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-03T22:39:05.727574] [DEBUG] [LOCAL ] GKOS: Loaded 43313 existing records from primary storage. [2025-10-03T22:39:05.728260] [INFO ] [MAIN ] GKOS: Loaded 43313 primary data records. [2025-10-03T22:39:05.815668] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-10-03T22:39:05.834609] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-03T22:39:05.840819] [INFO ] [MAIN ] Derivative Progress: 786/2073 symbols completed. GIS took 1.3s. Estimated remaining: 8m 57s. Rate: 143.9 symbols/min [2025-10-03T22:39:05.841144] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:06.070965] [DEBUG] [LOCAL ] GL: Loaded 38326 existing records from primary storage. [2025-10-03T22:39:06.072199] [INFO ] [MAIN ] GL: Loaded 38326 primary data records. [2025-10-03T22:39:06.272449] [DEBUG] [LOCAL ] GLOB: Loaded 48346 existing records from primary storage. [2025-10-03T22:39:06.323562] [INFO ] [MAIN ] GLOB: Loaded 48346 primary data records. [2025-10-03T22:39:06.563139] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:06.580126] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43313 primary records. [2025-10-03T22:39:06.639443] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-03T22:39:06.791665] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-10-03T22:39:06.792407] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-03T22:39:06.795440] [INFO ] [MAIN ] Derivative Progress: 787/2073 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 57s. Rate: 143.6 symbols/min [2025-10-03T22:39:06.798343] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:06.814018] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:06.815565] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38326 primary records. [2025-10-03T22:39:06.815777] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-03T22:39:06.837825] [DEBUG] [LOCAL ] GLP: Loaded 9445 existing records from primary storage. [2025-10-03T22:39:06.838408] [INFO ] [MAIN ] GLP: Loaded 9445 primary data records. [2025-10-03T22:39:06.935816] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-10-03T22:39:06.948219] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-03T22:39:06.952044] [INFO ] [MAIN ] Derivative Progress: 788/2073 symbols completed. GL took 1.3s. Estimated remaining: 8m 56s. Rate: 143.8 symbols/min [2025-10-03T22:39:06.952354] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:06.990825] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:07.002798] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48346 primary records. [2025-10-03T22:39:07.031597] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-03T22:39:07.234622] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-10-03T22:39:07.234837] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-03T22:39:07.238342] [INFO ] [MAIN ] Derivative Progress: 789/2073 symbols completed. GLOB took 1.4s. Estimated remaining: 8m 56s. Rate: 143.8 symbols/min [2025-10-03T22:39:07.239730] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:07.293242] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:07.313988] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9445 primary records. [2025-10-03T22:39:07.315485] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-03T22:39:07.354428] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-03T22:39:07.360766] [INFO ] [MAIN ] GLW: Loaded 54416 primary data records. [2025-10-03T22:39:07.426281] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-10-03T22:39:07.457269] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-10-03T22:39:07.457411] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-03T22:39:07.488820] [INFO ] [MAIN ] GM: Loaded 54508 primary data records. [2025-10-03T22:39:07.502704] [INFO ] [MAIN ] Derivative Progress: 790/2073 symbols completed. GLP took 0.7s. Estimated remaining: 8m 55s. Rate: 143.9 symbols/min [2025-10-03T22:39:07.524798] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:08.458080] [DEBUG] [LOCAL ] GME: Loaded 54542 existing records from primary storage. [2025-10-03T22:39:08.459406] [INFO ] [MAIN ] GME: Loaded 54542 primary data records. [2025-10-03T22:39:08.848097] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:08.850353] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54416 primary records. [2025-10-03T22:39:08.850783] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-03T22:39:08.893410] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-10-03T22:39:08.894628] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:08.894180] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-03T22:39:08.895587] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54508 primary records. [2025-10-03T22:39:08.899066] [INFO ] [MAIN ] Derivative Progress: 791/2073 symbols completed. GLW took 1.9s. Estimated remaining: 8m 56s. Rate: 143.5 symbols/min [2025-10-03T22:39:08.901051] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:08.901156] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-03T22:39:08.922756] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-10-03T22:39:08.923033] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-03T22:39:08.926415] [INFO ] [MAIN ] Derivative Progress: 792/2073 symbols completed. GM took 1.7s. Estimated remaining: 8m 55s. Rate: 143.6 symbols/min [2025-10-03T22:39:08.926715] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:08.947206] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:08.948279] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54542 primary records. [2025-10-03T22:39:08.948433] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-03T22:39:08.967177] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-10-03T22:39:08.980563] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-03T22:39:08.985203] [INFO ] [MAIN ] Derivative Progress: 793/2073 symbols completed. GME took 1.5s. Estimated remaining: 8m 54s. Rate: 143.8 symbols/min [2025-10-03T22:39:09.017510] [DEBUG] [LOCAL ] GMED: Loaded 49085 existing records from primary storage. [2025-10-03T22:39:09.018424] [INFO ] [MAIN ] GMED: Loaded 49085 primary data records. [2025-10-03T22:39:09.104994] [DEBUG] [LOCAL ] GMRE: Loaded 37705 existing records from primary storage. [2025-10-03T22:39:09.137573] [INFO ] [MAIN ] GMRE: Loaded 37705 primary data records. [2025-10-03T22:39:09.754819] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:09.756434] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 49085 primary records. [2025-10-03T22:39:09.756827] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-03T22:39:09.776455] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-10-03T22:39:09.776930] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-03T22:39:09.779319] [INFO ] [MAIN ] Derivative Progress: 794/2073 symbols completed. GMED took 0.9s. Estimated remaining: 8m 54s. Rate: 143.6 symbols/min [2025-10-03T22:39:09.795987] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:09.796883] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 37705 primary records. [2025-10-03T22:39:09.796956] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-03T22:39:09.814024] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-10-03T22:39:09.814198] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-03T22:39:09.817362] [INFO ] [MAIN ] Derivative Progress: 795/2073 symbols completed. GMRE took 0.9s. Estimated remaining: 8m 53s. Rate: 143.8 symbols/min [2025-10-03T22:39:09.818357] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:09.818095] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:09.818219] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:09.840024] [DEBUG] [LOCAL ] GNE: Loaded 18024 existing records from primary storage. [2025-10-03T22:39:09.840363] [INFO ] [MAIN ] GNE: Loaded 18024 primary data records. [2025-10-03T22:39:10.247527] [DEBUG] [LOCAL ] GNK: Loaded 40862 existing records from primary storage. [2025-10-03T22:39:10.260305] [DEBUG] [LOCAL ] GNL: Loaded 47502 existing records from primary storage. [2025-10-03T22:39:10.278149] [INFO ] [MAIN ] GNL: Loaded 47502 primary data records. [2025-10-03T22:39:10.278031] [INFO ] [MAIN ] GNK: Loaded 40862 primary data records. [2025-10-03T22:39:10.966383] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:10.972259] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 18024 primary records. [2025-10-03T22:39:10.973003] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-03T22:39:10.995970] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-10-03T22:39:10.996235] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-03T22:39:11.000335] [INFO ] [MAIN ] Derivative Progress: 796/2073 symbols completed. GNE took 1.2s. Estimated remaining: 8m 54s. Rate: 143.5 symbols/min [2025-10-03T22:39:11.000852] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:11.015738] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:11.016707] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47502 primary records. [2025-10-03T22:39:11.016811] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-03T22:39:11.047406] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:11.050450] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 40862 primary records. [2025-10-03T22:39:11.050920] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-03T22:39:11.052618] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-10-03T22:39:11.053063] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-03T22:39:11.066622] [INFO ] [MAIN ] Derivative Progress: 797/2073 symbols completed. GNL took 1.2s. Estimated remaining: 8m 53s. Rate: 143.6 symbols/min [2025-10-03T22:39:11.067546] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:11.092519] [DEBUG] [LOCAL ] GNT: Loaded 8269 existing records from primary storage. [2025-10-03T22:39:11.092252] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-10-03T22:39:11.092766] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-03T22:39:11.092698] [INFO ] [MAIN ] GNT: Loaded 8269 primary data records. [2025-10-03T22:39:11.102143] [INFO ] [MAIN ] Derivative Progress: 798/2073 symbols completed. GNK took 1.3s. Estimated remaining: 8m 52s. Rate: 143.8 symbols/min [2025-10-03T22:39:11.121996] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:11.169611] [DEBUG] [LOCAL ] GNRC: Loaded 45779 existing records from primary storage. [2025-10-03T22:39:11.192754] [INFO ] [MAIN ] GNRC: Loaded 45779 primary data records. [2025-10-03T22:39:11.813913] [DEBUG] [LOCAL ] GNW: Loaded 52096 existing records from primary storage. [2025-10-03T22:39:11.824700] [INFO ] [MAIN ] GNW: Loaded 52096 primary data records. [2025-10-03T22:39:12.228122] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:12.231931] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8269 primary records. [2025-10-03T22:39:12.232963] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-03T22:39:12.267038] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:12.268957] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45779 primary records. [2025-10-03T22:39:12.269062] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-03T22:39:12.294911] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-10-03T22:39:12.293477] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-10-03T22:39:12.295137] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-03T22:39:12.298108] [INFO ] [MAIN ] Derivative Progress: 799/2073 symbols completed. GNRC took 1.3s. Estimated remaining: 8m 53s. Rate: 143.4 symbols/min [2025-10-03T22:39:12.298193] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-03T22:39:12.298377] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:12.301498] [INFO ] [MAIN ] Derivative Progress: 800/2073 symbols completed. GNT took 1.2s. Estimated remaining: 8m 52s. Rate: 143.6 symbols/min [2025-10-03T22:39:12.301799] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:12.322436] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:12.323375] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52096 primary records. [2025-10-03T22:39:12.323543] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-03T22:39:12.351673] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-10-03T22:39:12.351854] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-03T22:39:12.354972] [INFO ] [MAIN ] Derivative Progress: 801/2073 symbols completed. GNW took 1.2s. Estimated remaining: 8m 51s. Rate: 143.8 symbols/min [2025-10-03T22:39:12.365935] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:12.378568] [DEBUG] [LOCAL ] GOLF: Loaded 31654 existing records from primary storage. [2025-10-03T22:39:12.378827] [INFO ] [MAIN ] GOLF: Loaded 31654 primary data records. [2025-10-03T22:39:12.506215] [DEBUG] [LOCAL ] GOF: Loaded 43182 existing records from primary storage. [2025-10-03T22:39:12.524845] [INFO ] [MAIN ] GOF: Loaded 43182 primary data records. [2025-10-03T22:39:13.065217] [DEBUG] [LOCAL ] GOOS: Loaded 45626 existing records from primary storage. [2025-10-03T22:39:13.189849] [INFO ] [MAIN ] GOOS: Loaded 45626 primary data records. [2025-10-03T22:39:13.628793] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:13.631524] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 31654 primary records. [2025-10-03T22:39:13.632014] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-03T22:39:13.652227] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-10-03T22:39:13.652819] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-03T22:39:13.655684] [INFO ] [MAIN ] Derivative Progress: 802/2073 symbols completed. GOLF took 1.4s. Estimated remaining: 8m 52s. Rate: 143.4 symbols/min [2025-10-03T22:39:13.656597] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:13.679266] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:13.680918] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43182 primary records. [2025-10-03T22:39:13.681160] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-03T22:39:13.701761] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-10-03T22:39:13.701973] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-03T22:39:13.704851] [INFO ] [MAIN ] Derivative Progress: 803/2073 symbols completed. GOF took 1.4s. Estimated remaining: 8m 51s. Rate: 143.5 symbols/min [2025-10-03T22:39:13.705688] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:13.738068] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:13.752050] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 45626 primary records. [2025-10-03T22:39:13.752300] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-03T22:39:13.758047] [DEBUG] [LOCAL ] GOTU: Loaded 38853 existing records from primary storage. [2025-10-03T22:39:13.766265] [INFO ] [MAIN ] GOTU: Loaded 38853 primary data records. [2025-10-03T22:39:13.838571] [DEBUG] [LOCAL ] GPI: Loaded 14844 existing records from primary storage. [2025-10-03T22:39:13.866836] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-10-03T22:39:13.872350] [INFO ] [MAIN ] GPI: Loaded 14844 primary data records. [2025-10-03T22:39:13.886471] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-03T22:39:13.894095] [INFO ] [MAIN ] Derivative Progress: 804/2073 symbols completed. GOOS took 1.5s. Estimated remaining: 8m 50s. Rate: 143.6 symbols/min [2025-10-03T22:39:13.894428] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:14.118376] [DEBUG] [LOCAL ] GPJA: Loaded 4272 existing records from primary storage. [2025-10-03T22:39:14.249804] [INFO ] [MAIN ] GPJA: Loaded 4272 primary data records. [2025-10-03T22:39:14.935543] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:14.937555] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 38853 primary records. [2025-10-03T22:39:14.938585] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-03T22:39:14.971241] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:14.974217] [INFO ] [MAIN ] GPI: Generated 1820 derivative records from 14844 primary records. [2025-10-03T22:39:14.974639] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-03T22:39:14.984694] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-10-03T22:39:14.985902] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-03T22:39:14.992175] [INFO ] [MAIN ] Derivative Progress: 805/2073 symbols completed. GOTU took 1.3s. Estimated remaining: 8m 51s. Rate: 143.4 symbols/min [2025-10-03T22:39:14.993709] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:15.001239] [DEBUG] [LOCAL ] GPI: Derivative data saved (1820 records). [2025-10-03T22:39:15.001566] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-03T22:39:15.012856] [INFO ] [MAIN ] Derivative Progress: 806/2073 symbols completed. GPI took 1.3s. Estimated remaining: 8m 50s. Rate: 143.5 symbols/min [2025-10-03T22:39:15.018784] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:39:15.019780] [INFO ] [MAIN ] GPJA: Generated 1818 derivative records from 4272 primary records. [2025-10-03T22:39:15.020012] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-03T22:39:15.019914] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:15.039558] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1818 records). [2025-10-03T22:39:15.039779] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-03T22:39:15.043033] [INFO ] [MAIN ] Derivative Progress: 807/2073 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 49s. Rate: 143.7 symbols/min [2025-10-03T22:39:15.043231] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:15.083817] [DEBUG] [LOCAL ] GPMT: Loaded 26308 existing records from primary storage. [2025-10-03T22:39:15.084264] [INFO ] [MAIN ] GPMT: Loaded 26308 primary data records. [2025-10-03T22:39:15.232975] [DEBUG] [LOCAL ] GPK: Loaded 53416 existing records from primary storage. [2025-10-03T22:39:15.239744] [INFO ] [MAIN ] GPK: Loaded 53416 primary data records. [2025-10-03T22:39:15.551087] [DEBUG] [LOCAL ] GPN: Loaded 52797 existing records from primary storage. [2025-10-03T22:39:15.577365] [INFO ] [MAIN ] GPN: Loaded 52797 primary data records. [2025-10-03T22:39:16.167741] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:16.171601] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26308 primary records. [2025-10-03T22:39:16.171861] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-03T22:39:16.198975] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:16.201893] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53416 primary records. [2025-10-03T22:39:16.205321] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-03T22:39:16.205253] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-10-03T22:39:16.207871] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-03T22:39:16.224180] [INFO ] [MAIN ] Derivative Progress: 808/2073 symbols completed. GPMT took 1.2s. Estimated remaining: 8m 49s. Rate: 143.4 symbols/min [2025-10-03T22:39:16.239667] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:16.241095] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52797 primary records. [2025-10-03T22:39:16.241413] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-03T22:39:16.253222] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-10-03T22:39:16.258228] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-03T22:39:16.261315] [INFO ] [MAIN ] Derivative Progress: 809/2073 symbols completed. GPK took 1.3s. Estimated remaining: 8m 48s. Rate: 143.5 symbols/min [2025-10-03T22:39:16.265332] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-10-03T22:39:16.265445] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-03T22:39:16.268526] [INFO ] [MAIN ] Derivative Progress: 810/2073 symbols completed. GPN took 1.2s. Estimated remaining: 8m 47s. Rate: 143.7 symbols/min [2025-10-03T22:39:16.269217] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:16.269129] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:16.269408] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:16.284393] [DEBUG] [LOCAL ] GRC: Loaded 9165 existing records from primary storage. [2025-10-03T22:39:16.284672] [INFO ] [MAIN ] GRC: Loaded 9165 primary data records. [2025-10-03T22:39:16.421229] [DEBUG] [LOCAL ] GPOR: Loaded 23529 existing records from primary storage. [2025-10-03T22:39:16.442850] [INFO ] [MAIN ] GPOR: Loaded 23529 primary data records. [2025-10-03T22:39:16.485894] [DEBUG] [LOCAL ] GRBK: Loaded 27305 existing records from primary storage. [2025-10-03T22:39:16.561420] [INFO ] [MAIN ] GRBK: Loaded 27305 primary data records. [2025-10-03T22:39:17.445437] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:17.447529] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9165 primary records. [2025-10-03T22:39:17.447891] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-03T22:39:17.480992] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:17.482711] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23529 primary records. [2025-10-03T22:39:17.483516] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-03T22:39:17.485502] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-10-03T22:39:17.485691] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-03T22:39:17.490583] [INFO ] [MAIN ] Derivative Progress: 811/2073 symbols completed. GRC took 1.2s. Estimated remaining: 8m 48s. Rate: 143.4 symbols/min [2025-10-03T22:39:17.503614] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:17.521152] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:17.522977] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27305 primary records. [2025-10-03T22:39:17.523711] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-03T22:39:17.534417] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-10-03T22:39:17.540919] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-03T22:39:17.545460] [INFO ] [MAIN ] Derivative Progress: 812/2073 symbols completed. GPOR took 1.3s. Estimated remaining: 8m 47s. Rate: 143.5 symbols/min [2025-10-03T22:39:17.551773] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:17.553876] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-10-03T22:39:17.554124] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-03T22:39:17.557200] [INFO ] [MAIN ] Derivative Progress: 813/2073 symbols completed. GRBK took 1.3s. Estimated remaining: 8m 46s. Rate: 143.7 symbols/min [2025-10-03T22:39:17.557495] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:17.571965] [DEBUG] [LOCAL ] GRDN: Loaded 20872 existing records from primary storage. [2025-10-03T22:39:17.572224] [INFO ] [MAIN ] GRDN: Loaded 20872 primary data records. [2025-10-03T22:39:17.941283] [DEBUG] [LOCAL ] GRMN: Loaded 41621 existing records from primary storage. [2025-10-03T22:39:17.942227] [INFO ] [MAIN ] GRMN: Loaded 41621 primary data records. [2025-10-03T22:39:18.056838] [DEBUG] [LOCAL ] GRND: Loaded 50674 existing records from primary storage. [2025-10-03T22:39:18.083718] [INFO ] [MAIN ] GRND: Loaded 50674 primary data records. [2025-10-03T22:39:18.681177] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:18.683194] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 20872 primary records. [2025-10-03T22:39:18.683498] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-03T22:39:18.704990] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-10-03T22:39:18.707893] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-03T22:39:18.711793] [INFO ] [MAIN ] Derivative Progress: 814/2073 symbols completed. GRDN took 1.2s. Estimated remaining: 8m 47s. Rate: 143.4 symbols/min [2025-10-03T22:39:18.713325] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:18.733256] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:18.734693] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 41621 primary records. [2025-10-03T22:39:18.734906] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-03T22:39:18.781885] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:18.783987] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50674 primary records. [2025-10-03T22:39:18.784471] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-03T22:39:18.787360] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-10-03T22:39:18.799969] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-03T22:39:18.815121] [INFO ] [MAIN ] Derivative Progress: 815/2073 symbols completed. GRMN took 1.3s. Estimated remaining: 8m 46s. Rate: 143.5 symbols/min [2025-10-03T22:39:18.816689] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:18.819663] [DEBUG] [LOCAL ] GRNT: Loaded 34272 existing records from primary storage. [2025-10-03T22:39:18.820523] [INFO ] [MAIN ] GRNT: Loaded 34272 primary data records. [2025-10-03T22:39:18.881537] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-10-03T22:39:18.910210] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-03T22:39:18.918801] [DEBUG] [LOCAL ] GROV: Loaded 8965 existing records from primary storage. [2025-10-03T22:39:18.950371] [INFO ] [MAIN ] GROV: Loaded 8965 primary data records. [2025-10-03T22:39:18.953673] [INFO ] [MAIN ] Derivative Progress: 816/2073 symbols completed. GRND took 1.4s. Estimated remaining: 8m 45s. Rate: 143.6 symbols/min [2025-10-03T22:39:19.006409] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:19.354598] [DEBUG] [LOCAL ] GRX: Loaded 4787 existing records from primary storage. [2025-10-03T22:39:19.366326] [INFO ] [MAIN ] GRX: Loaded 4787 primary data records. [2025-10-03T22:39:19.916838] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:19.918309] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34272 primary records. [2025-10-03T22:39:19.918417] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-03T22:39:19.958663] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-10-03T22:39:19.959235] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-03T22:39:19.961860] [INFO ] [MAIN ] Derivative Progress: 817/2073 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 46s. Rate: 143.4 symbols/min [2025-10-03T22:39:19.962008] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:19.959166] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:19.963418] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 8965 primary records. [2025-10-03T22:39:19.964153] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-03T22:39:19.998264] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:20.000290] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4787 primary records. [2025-10-03T22:39:19.999359] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-10-03T22:39:20.000481] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-03T22:39:20.003895] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-03T22:39:20.003766] [INFO ] [MAIN ] Derivative Progress: 818/2073 symbols completed. GROV took 1.2s. Estimated remaining: 8m 45s. Rate: 143.5 symbols/min [2025-10-03T22:39:20.004332] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:20.021937] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-10-03T22:39:20.022013] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-03T22:39:20.024913] [INFO ] [MAIN ] Derivative Progress: 819/2073 symbols completed. GRX took 1.0s. Estimated remaining: 8m 44s. Rate: 143.7 symbols/min [2025-10-03T22:39:20.025149] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:20.079353] [DEBUG] [LOCAL ] GS: Loaded 52615 existing records from primary storage. [2025-10-03T22:39:20.080357] [INFO ] [MAIN ] GS: Loaded 52615 primary data records. [2025-10-03T22:39:20.169120] [DEBUG] [LOCAL ] GSBD: Loaded 39772 existing records from primary storage. [2025-10-03T22:39:20.196311] [INFO ] [MAIN ] GSBD: Loaded 39772 primary data records. [2025-10-03T22:39:20.286104] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-10-03T22:39:20.360950] [INFO ] [MAIN ] GSK: Loaded 54272 primary data records. [2025-10-03T22:39:21.106867] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:21.108265] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52615 primary records. [2025-10-03T22:39:21.108587] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-03T22:39:21.142187] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:21.144369] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-10-03T22:39:21.144543] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-03T22:39:21.148516] [INFO ] [MAIN ] Derivative Progress: 820/2073 symbols completed. GS took 1.2s. Estimated remaining: 8m 44s. Rate: 143.4 symbols/min [2025-10-03T22:39:21.149401] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 39772 primary records. [2025-10-03T22:39:21.149756] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:21.149918] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-03T22:39:21.179410] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:21.180842] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54272 primary records. [2025-10-03T22:39:21.181198] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-03T22:39:21.209025] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-10-03T22:39:21.210023] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-03T22:39:21.213434] [INFO ] [MAIN ] Derivative Progress: 821/2073 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 43s. Rate: 143.6 symbols/min [2025-10-03T22:39:21.213675] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:21.216786] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-10-03T22:39:21.216864] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-03T22:39:21.219805] [INFO ] [MAIN ] Derivative Progress: 822/2073 symbols completed. GSK took 1.2s. Estimated remaining: 8m 42s. Rate: 143.7 symbols/min [2025-10-03T22:39:21.220100] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:21.234036] [DEBUG] [LOCAL ] GSL: Loaded 33701 existing records from primary storage. [2025-10-03T22:39:21.234406] [INFO ] [MAIN ] GSL: Loaded 33701 primary data records. [2025-10-03T22:39:21.620781] [DEBUG] [LOCAL ] GTES: Loaded 51249 existing records from primary storage. [2025-10-03T22:39:21.621860] [INFO ] [MAIN ] GTES: Loaded 51249 primary data records. [2025-10-03T22:39:21.621551] [DEBUG] [LOCAL ] GTLS: Loaded 43398 existing records from primary storage. [2025-10-03T22:39:21.621986] [INFO ] [MAIN ] GTLS: Loaded 43398 primary data records. [2025-10-03T22:39:22.272559] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:22.274416] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33701 primary records. [2025-10-03T22:39:22.274622] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-03T22:39:22.293280] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-10-03T22:39:22.293395] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-03T22:39:22.296357] [INFO ] [MAIN ] Derivative Progress: 823/2073 symbols completed. GSL took 1.1s. Estimated remaining: 8m 43s. Rate: 143.5 symbols/min [2025-10-03T22:39:22.328980] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:22.330175] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51249 primary records. [2025-10-03T22:39:22.329363] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:22.330834] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43398 primary records. [2025-10-03T22:39:22.330881] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-03T22:39:22.331241] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-03T22:39:22.361045] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-10-03T22:39:22.361614] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-03T22:39:22.364879] [INFO ] [MAIN ] Derivative Progress: 824/2073 symbols completed. GTLS took 1.1s. Estimated remaining: 8m 42s. Rate: 143.6 symbols/min [2025-10-03T22:39:22.368230] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-10-03T22:39:22.368298] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-03T22:39:22.370914] [INFO ] [MAIN ] Derivative Progress: 825/2073 symbols completed. GTES took 1.2s. Estimated remaining: 8m 41s. Rate: 143.8 symbols/min [2025-10-03T22:39:22.371347] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:22.371276] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:22.371418] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:22.388511] [DEBUG] [LOCAL ] GUG: Loaded 12272 existing records from primary storage. [2025-10-03T22:39:22.388702] [INFO ] [MAIN ] GUG: Loaded 12272 primary data records. [2025-10-03T22:39:22.547729] [DEBUG] [LOCAL ] GTY: Loaded 30751 existing records from primary storage. [2025-10-03T22:39:22.621782] [INFO ] [MAIN ] GTY: Loaded 30751 primary data records. [2025-10-03T22:39:22.856323] [DEBUG] [LOCAL ] GTN: Loaded 46115 existing records from primary storage. [2025-10-03T22:39:22.862767] [INFO ] [MAIN ] GTN: Loaded 46115 primary data records. [2025-10-03T22:39:23.508225] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:23.511168] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12272 primary records. [2025-10-03T22:39:23.512469] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-03T22:39:23.537471] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-10-03T22:39:23.538964] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-03T22:39:23.541853] [INFO ] [MAIN ] Derivative Progress: 826/2073 symbols completed. GUG took 1.2s. Estimated remaining: 8m 42s. Rate: 143.5 symbols/min [2025-10-03T22:39:23.542305] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:23.560769] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:23.561794] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30751 primary records. [2025-10-03T22:39:23.561893] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-03T22:39:23.595745] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:23.598008] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 46115 primary records. [2025-10-03T22:39:23.604012] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-03T22:39:23.622756] [DEBUG] [LOCAL ] GUT: Loaded 15460 existing records from primary storage. [2025-10-03T22:39:23.623746] [INFO ] [MAIN ] GUT: Loaded 15460 primary data records. [2025-10-03T22:39:23.722388] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-10-03T22:39:23.722570] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-03T22:39:23.715191] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-10-03T22:39:23.750786] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-03T22:39:23.750691] [INFO ] [MAIN ] Derivative Progress: 827/2073 symbols completed. GTN took 1.4s. Estimated remaining: 8m 41s. Rate: 143.5 symbols/min [2025-10-03T22:39:23.754827] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:23.758017] [INFO ] [MAIN ] Derivative Progress: 828/2073 symbols completed. GTY took 1.4s. Estimated remaining: 8m 40s. Rate: 143.7 symbols/min [2025-10-03T22:39:23.758614] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:23.984639] [DEBUG] [LOCAL ] GWH: Loaded 16446 existing records from primary storage. [2025-10-03T22:39:23.993127] [INFO ] [MAIN ] GWH: Loaded 16446 primary data records. [2025-10-03T22:39:24.138632] [DEBUG] [LOCAL ] GVA: Loaded 33604 existing records from primary storage. [2025-10-03T22:39:24.168436] [INFO ] [MAIN ] GVA: Loaded 33604 primary data records. [2025-10-03T22:39:24.656351] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:24.658433] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15460 primary records. [2025-10-03T22:39:24.658601] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-03T22:39:24.696323] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-10-03T22:39:24.696961] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:24.698253] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-03T22:39:24.699185] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 16446 primary records. [2025-10-03T22:39:24.702857] [INFO ] [MAIN ] Derivative Progress: 829/2073 symbols completed. GUT took 1.2s. Estimated remaining: 8m 40s. Rate: 143.5 symbols/min [2025-10-03T22:39:24.703274] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:24.703587] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-03T22:39:24.725067] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-10-03T22:39:24.725419] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-03T22:39:24.729074] [INFO ] [MAIN ] Derivative Progress: 830/2073 symbols completed. GWH took 1.0s. Estimated remaining: 8m 39s. Rate: 143.7 symbols/min [2025-10-03T22:39:24.732503] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:24.748917] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:24.749824] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 33604 primary records. [2025-10-03T22:39:24.749964] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-03T22:39:24.782666] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-10-03T22:39:24.782869] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-03T22:39:24.786035] [INFO ] [MAIN ] Derivative Progress: 831/2073 symbols completed. GVA took 1.0s. Estimated remaining: 8m 38s. Rate: 143.8 symbols/min [2025-10-03T22:39:24.786328] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:24.794965] [DEBUG] [LOCAL ] GWW: Loaded 19715 existing records from primary storage. [2025-10-03T22:39:24.795268] [INFO ] [MAIN ] GWW: Loaded 19715 primary data records. [2025-10-03T22:39:24.902338] [DEBUG] [LOCAL ] GWRE: Loaded 41111 existing records from primary storage. [2025-10-03T22:39:24.926118] [INFO ] [MAIN ] GWRE: Loaded 41111 primary data records. [2025-10-03T22:39:25.401109] [DEBUG] [LOCAL ] GXO: Loaded 48019 existing records from primary storage. [2025-10-03T22:39:25.578720] [INFO ] [MAIN ] GXO: Loaded 48019 primary data records. [2025-10-03T22:39:25.923026] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:25.926351] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 19715 primary records. [2025-10-03T22:39:25.928284] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-03T22:39:25.960300] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-10-03T22:39:25.961106] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-03T22:39:25.960730] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:25.964510] [INFO ] [MAIN ] Derivative Progress: 832/2073 symbols completed. GWW took 1.2s. Estimated remaining: 8m 39s. Rate: 143.5 symbols/min [2025-10-03T22:39:25.965813] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 41111 primary records. [2025-10-03T22:39:25.966128] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-03T22:39:25.966321] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:25.991265] [DEBUG] [LOCAL ] GYLD: Loaded 1558 existing records from primary storage. [2025-10-03T22:39:25.992456] [INFO ] [MAIN ] GYLD: Loaded 1558 primary data records. [2025-10-03T22:39:25.988390] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-10-03T22:39:25.992802] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-03T22:39:26.016275] [INFO ] [MAIN ] Derivative Progress: 833/2073 symbols completed. GWRE took 1.3s. Estimated remaining: 8m 38s. Rate: 143.6 symbols/min [2025-10-03T22:39:26.049051] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:26.074755] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:26.086193] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 48019 primary records. [2025-10-03T22:39:26.092538] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-03T22:39:26.179163] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-10-03T22:39:26.204133] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-03T22:39:26.240682] [INFO ] [MAIN ] Derivative Progress: 834/2073 symbols completed. GXO took 1.5s. Estimated remaining: 8m 37s. Rate: 143.7 symbols/min [2025-10-03T22:39:26.367577] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:26.403369] [DEBUG] [LOCAL ] H: Loaded 45308 existing records from primary storage. [2025-10-03T22:39:26.403928] [INFO ] [MAIN ] H: Loaded 45308 primary data records. [2025-10-03T22:39:26.527825] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:39:26.551280] [INFO ] [MAIN ] GYLD: Generated 1819 derivative records from 1558 primary records. [2025-10-03T22:39:26.564056] [DEBUG] [LOCAL ] HAE: Loaded 40132 existing records from primary storage. [2025-10-03T22:39:26.562821] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-03T22:39:26.564820] [INFO ] [MAIN ] HAE: Loaded 40132 primary data records. [2025-10-03T22:39:26.915300] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1819 records). [2025-10-03T22:39:26.915776] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-03T22:39:26.924287] [INFO ] [MAIN ] Derivative Progress: 835/2073 symbols completed. GYLD took 1.0s. Estimated remaining: 8m 37s. Rate: 143.6 symbols/min [2025-10-03T22:39:26.969420] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:27.151159] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:27.152863] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45308 primary records. [2025-10-03T22:39:27.153000] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-03T22:39:27.185694] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-10-03T22:39:27.185926] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-03T22:39:27.189766] [INFO ] [MAIN ] Derivative Progress: 836/2073 symbols completed. H took 1.1s. Estimated remaining: 8m 37s. Rate: 143.7 symbols/min [2025-10-03T22:39:27.190302] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:27.212672] [DEBUG] [LOCAL ] HAFN: Loaded 43932 existing records from primary storage. [2025-10-03T22:39:27.226365] [INFO ] [MAIN ] HAFN: Loaded 43932 primary data records. [2025-10-03T22:39:27.226726] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:27.233113] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40132 primary records. [2025-10-03T22:39:27.249793] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-03T22:39:27.354817] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-10-03T22:39:27.355566] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-03T22:39:27.379954] [INFO ] [MAIN ] Derivative Progress: 837/2073 symbols completed. HAE took 1.0s. Estimated remaining: 8m 36s. Rate: 143.8 symbols/min [2025-10-03T22:39:27.390544] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:27.581577] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-03T22:39:27.591270] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-10-03T22:39:27.987609] [DEBUG] [LOCAL ] HASI: Loaded 47850 existing records from primary storage. [2025-10-03T22:39:27.986863] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:27.989354] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 43932 primary records. [2025-10-03T22:39:27.989464] [INFO ] [MAIN ] HASI: Loaded 47850 primary data records. [2025-10-03T22:39:27.989786] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-03T22:39:28.196459] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-10-03T22:39:28.318190] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-03T22:39:28.334226] [INFO ] [MAIN ] Derivative Progress: 838/2073 symbols completed. HAFN took 1.4s. Estimated remaining: 8m 36s. Rate: 143.5 symbols/min [2025-10-03T22:39:28.331335] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:28.335496] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-10-03T22:39:28.336409] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-03T22:39:28.354953] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-10-03T22:39:28.355403] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-03T22:39:28.358474] [INFO ] [MAIN ] Derivative Progress: 839/2073 symbols completed. HAL took 1.2s. Estimated remaining: 8m 35s. Rate: 143.7 symbols/min [2025-10-03T22:39:28.379013] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:28.379811] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47850 primary records. [2025-10-03T22:39:28.379877] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-03T22:39:28.396208] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-10-03T22:39:28.396370] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-03T22:39:28.400200] [INFO ] [MAIN ] Derivative Progress: 840/2073 symbols completed. HASI took 1.0s. Estimated remaining: 8m 34s. Rate: 143.9 symbols/min [2025-10-03T22:39:28.400864] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:28.400984] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:28.401151] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:28.412582] [DEBUG] [LOCAL ] HBB: Loaded 6659 existing records from primary storage. [2025-10-03T22:39:28.412850] [INFO ] [MAIN ] HBB: Loaded 6659 primary data records. [2025-10-03T22:39:28.751629] [DEBUG] [LOCAL ] HAYW: Loaded 49424 existing records from primary storage. [2025-10-03T22:39:28.752017] [INFO ] [MAIN ] HAYW: Loaded 49424 primary data records. [2025-10-03T22:39:28.922278] [DEBUG] [LOCAL ] HBI: Loaded 53763 existing records from primary storage. [2025-10-03T22:39:28.931237] [INFO ] [MAIN ] HBI: Loaded 53763 primary data records. [2025-10-03T22:39:29.393796] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:29.394774] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6659 primary records. [2025-10-03T22:39:29.395192] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-03T22:39:29.416885] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-10-03T22:39:29.417037] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-03T22:39:29.420147] [INFO ] [MAIN ] Derivative Progress: 841/2073 symbols completed. HBB took 1.0s. Estimated remaining: 8m 35s. Rate: 143.6 symbols/min [2025-10-03T22:39:29.420409] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:29.439794] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:29.440516] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49424 primary records. [2025-10-03T22:39:29.440618] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-03T22:39:29.467343] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-10-03T22:39:29.467469] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-03T22:39:29.470035] [INFO ] [MAIN ] Derivative Progress: 842/2073 symbols completed. HAYW took 1.1s. Estimated remaining: 8m 34s. Rate: 143.8 symbols/min [2025-10-03T22:39:29.470356] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:29.488874] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:29.489752] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53763 primary records. [2025-10-03T22:39:29.489945] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-03T22:39:29.521385] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-10-03T22:39:29.521766] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-03T22:39:29.526747] [INFO ] [MAIN ] Derivative Progress: 843/2073 symbols completed. HBI took 1.1s. Estimated remaining: 8m 33s. Rate: 143.9 symbols/min [2025-10-03T22:39:29.527927] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:29.544800] [DEBUG] [LOCAL ] HBM: Loaded 53680 existing records from primary storage. [2025-10-03T22:39:29.545080] [INFO ] [MAIN ] HBM: Loaded 53680 primary data records. [2025-10-03T22:39:29.684882] [DEBUG] [LOCAL ] HCA: Loaded 47538 existing records from primary storage. [2025-10-03T22:39:29.701427] [INFO ] [MAIN ] HCA: Loaded 47538 primary data records. [2025-10-03T22:39:30.068557] [DEBUG] [LOCAL ] HCC: Loaded 46016 existing records from primary storage. [2025-10-03T22:39:30.094220] [INFO ] [MAIN ] HCC: Loaded 46016 primary data records. [2025-10-03T22:39:30.588243] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:30.590151] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53680 primary records. [2025-10-03T22:39:30.590414] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-03T22:39:30.624075] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:30.625265] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47538 primary records. [2025-10-03T22:39:30.625456] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-03T22:39:30.637133] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-10-03T22:39:30.641049] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-03T22:39:30.643773] [INFO ] [MAIN ] Derivative Progress: 844/2073 symbols completed. HBM took 1.2s. Estimated remaining: 8m 33s. Rate: 143.6 symbols/min [2025-10-03T22:39:30.644331] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:30.665318] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-10-03T22:39:30.665868] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-03T22:39:30.665637] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:30.669767] [INFO ] [MAIN ] Derivative Progress: 845/2073 symbols completed. HCA took 1.2s. Estimated remaining: 8m 32s. Rate: 143.8 symbols/min [2025-10-03T22:39:30.670101] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:30.666728] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 46016 primary records. [2025-10-03T22:39:30.674406] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-03T22:39:30.694055] [DEBUG] [LOCAL ] HCI: Loaded 14103 existing records from primary storage. [2025-10-03T22:39:30.696071] [INFO ] [MAIN ] HCI: Loaded 14103 primary data records. [2025-10-03T22:39:30.698034] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-10-03T22:39:30.698122] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-03T22:39:30.711382] [INFO ] [MAIN ] Derivative Progress: 846/2073 symbols completed. HCC took 1.2s. Estimated remaining: 8m 31s. Rate: 143.9 symbols/min [2025-10-03T22:39:30.718572] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:31.057880] [DEBUG] [LOCAL ] HD: Loaded 54268 existing records from primary storage. [2025-10-03T22:39:31.058367] [INFO ] [MAIN ] HD: Loaded 54268 primary data records. [2025-10-03T22:39:31.313242] [DEBUG] [LOCAL ] HDB: Loaded 52716 existing records from primary storage. [2025-10-03T22:39:31.435718] [INFO ] [MAIN ] HDB: Loaded 52716 primary data records. [2025-10-03T22:39:31.589120] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:31.640351] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14103 primary records. [2025-10-03T22:39:31.646521] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-03T22:39:31.855247] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-10-03T22:39:31.869448] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:31.869105] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-03T22:39:31.870543] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54268 primary records. [2025-10-03T22:39:31.873826] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-03T22:39:31.873718] [INFO ] [MAIN ] Derivative Progress: 847/2073 symbols completed. HCI took 1.2s. Estimated remaining: 8m 32s. Rate: 143.6 symbols/min [2025-10-03T22:39:31.876014] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:31.897283] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-10-03T22:39:31.899662] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-03T22:39:31.903424] [INFO ] [MAIN ] Derivative Progress: 848/2073 symbols completed. HD took 1.2s. Estimated remaining: 8m 31s. Rate: 143.8 symbols/min [2025-10-03T22:39:31.903967] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:31.918613] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:31.920051] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52716 primary records. [2025-10-03T22:39:31.920132] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-03T22:39:31.950805] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-10-03T22:39:31.950975] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-03T22:39:31.954725] [INFO ] [MAIN ] Derivative Progress: 849/2073 symbols completed. HDB took 1.2s. Estimated remaining: 8m 30s. Rate: 143.9 symbols/min [2025-10-03T22:39:31.955439] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:31.974625] [DEBUG] [LOCAL ] HEQ: Loaded 6450 existing records from primary storage. [2025-10-03T22:39:31.974963] [INFO ] [MAIN ] HEQ: Loaded 6450 primary data records. [2025-10-03T22:39:32.073695] [DEBUG] [LOCAL ] HE: Loaded 49729 existing records from primary storage. [2025-10-03T22:39:32.109313] [INFO ] [MAIN ] HE: Loaded 49729 primary data records. [2025-10-03T22:39:32.102553] [DEBUG] [LOCAL ] HEI: Loaded 32420 existing records from primary storage. [2025-10-03T22:39:32.118391] [INFO ] [MAIN ] HEI: Loaded 32420 primary data records. [2025-10-03T22:39:32.957078] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:32.958558] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6450 primary records. [2025-10-03T22:39:32.958695] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-03T22:39:33.000507] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:33.006826] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 32420 primary records. [2025-10-03T22:39:33.006011] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-10-03T22:39:33.007163] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-03T22:39:33.010060] [INFO ] [MAIN ] Derivative Progress: 850/2073 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 31s. Rate: 143.7 symbols/min [2025-10-03T22:39:33.010809] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:33.010469] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-03T22:39:33.011729] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49729 primary records. [2025-10-03T22:39:33.010273] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:33.012810] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-03T22:39:33.042564] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-10-03T22:39:33.043291] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-03T22:39:33.046684] [INFO ] [MAIN ] Derivative Progress: 851/2073 symbols completed. HE took 1.2s. Estimated remaining: 8m 30s. Rate: 143.8 symbols/min [2025-10-03T22:39:33.047172] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:33.063265] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-10-03T22:39:33.063914] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-03T22:39:33.067263] [INFO ] [MAIN ] Derivative Progress: 852/2073 symbols completed. HEI took 1.2s. Estimated remaining: 8m 29s. Rate: 144.0 symbols/min [2025-10-03T22:39:33.067578] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:33.081182] [DEBUG] [LOCAL ] HFRO: Loaded 17887 existing records from primary storage. [2025-10-03T22:39:33.081513] [INFO ] [MAIN ] HFRO: Loaded 17887 primary data records. [2025-10-03T22:39:33.213356] [DEBUG] [LOCAL ] HGER: Loaded 13988 existing records from primary storage. [2025-10-03T22:39:33.246696] [INFO ] [MAIN ] HGER: Loaded 13988 primary data records. [2025-10-03T22:39:33.264427] [DEBUG] [LOCAL ] HESM: Loaded 48942 existing records from primary storage. [2025-10-03T22:39:33.310535] [INFO ] [MAIN ] HESM: Loaded 48942 primary data records. [2025-10-03T22:39:34.139376] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:34.140948] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17887 primary records. [2025-10-03T22:39:34.141120] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-03T22:39:34.161751] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-10-03T22:39:34.161978] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-03T22:39:34.164771] [INFO ] [MAIN ] Derivative Progress: 853/2073 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 29s. Rate: 143.7 symbols/min [2025-10-03T22:39:34.183206] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:34.197449] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 13988 primary records. [2025-10-03T22:39:34.196456] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:34.198463] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 48942 primary records. [2025-10-03T22:39:34.198599] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-03T22:39:34.198743] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-03T22:39:34.231586] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-10-03T22:39:34.232523] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-03T22:39:34.237155] [INFO ] [MAIN ] Derivative Progress: 854/2073 symbols completed. HESM took 1.2s. Estimated remaining: 8m 28s. Rate: 143.9 symbols/min [2025-10-03T22:39:34.233801] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-10-03T22:39:34.237553] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-03T22:39:34.240959] [INFO ] [MAIN ] Derivative Progress: 855/2073 symbols completed. HGER took 1.2s. Estimated remaining: 8m 27s. Rate: 144.0 symbols/min [2025-10-03T22:39:34.241561] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:34.241477] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:34.241403] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:34.259236] [DEBUG] [LOCAL ] HGLB: Loaded 9821 existing records from primary storage. [2025-10-03T22:39:34.259513] [INFO ] [MAIN ] HGLB: Loaded 9821 primary data records. [2025-10-03T22:39:34.310362] [DEBUG] [LOCAL ] HGTY: Loaded 13362 existing records from primary storage. [2025-10-03T22:39:34.332955] [INFO ] [MAIN ] HGTY: Loaded 13362 primary data records. [2025-10-03T22:39:34.753704] [DEBUG] [LOCAL ] HGV: Loaded 47226 existing records from primary storage. [2025-10-03T22:39:34.785095] [INFO ] [MAIN ] HGV: Loaded 47226 primary data records. [2025-10-03T22:39:35.246573] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:35.248386] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9821 primary records. [2025-10-03T22:39:35.248940] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-03T22:39:35.282282] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-10-03T22:39:35.282789] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:35.282982] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-03T22:39:35.283687] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13362 primary records. [2025-10-03T22:39:35.283990] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-03T22:39:35.286665] [INFO ] [MAIN ] Derivative Progress: 856/2073 symbols completed. HGLB took 1.0s. Estimated remaining: 8m 28s. Rate: 143.8 symbols/min [2025-10-03T22:39:35.286960] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:35.304799] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-10-03T22:39:35.304938] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-03T22:39:35.308217] [INFO ] [MAIN ] Derivative Progress: 857/2073 symbols completed. HGTY took 1.1s. Estimated remaining: 8m 27s. Rate: 143.9 symbols/min [2025-10-03T22:39:35.310931] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:35.328015] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:35.328835] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 47226 primary records. [2025-10-03T22:39:35.329018] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-03T22:39:35.365691] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-10-03T22:39:35.365860] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-03T22:39:35.366785] [DEBUG] [LOCAL ] HHH: Loaded 33147 existing records from primary storage. [2025-10-03T22:39:35.370065] [INFO ] [MAIN ] Derivative Progress: 858/2073 symbols completed. HGV took 1.1s. Estimated remaining: 8m 26s. Rate: 144.1 symbols/min [2025-10-03T22:39:35.370306] [INFO ] [MAIN ] HHH: Loaded 33147 primary data records. [2025-10-03T22:39:35.370567] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:35.506900] [DEBUG] [LOCAL ] HI: Loaded 35823 existing records from primary storage. [2025-10-03T22:39:35.518015] [INFO ] [MAIN ] HI: Loaded 35823 primary data records. [2025-10-03T22:39:36.104486] [DEBUG] [LOCAL ] HIG: Loaded 51948 existing records from primary storage. [2025-10-03T22:39:36.106294] [INFO ] [MAIN ] HIG: Loaded 51948 primary data records. [2025-10-03T22:39:36.434552] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:36.437122] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33147 primary records. [2025-10-03T22:39:36.437574] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-03T22:39:36.460432] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-10-03T22:39:36.478638] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-03T22:39:36.482914] [INFO ] [MAIN ] Derivative Progress: 859/2073 symbols completed. HHH took 1.2s. Estimated remaining: 8m 27s. Rate: 143.8 symbols/min [2025-10-03T22:39:36.483962] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:36.483836] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:36.486714] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35823 primary records. [2025-10-03T22:39:36.487083] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-03T22:39:36.507416] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-10-03T22:39:36.507736] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-03T22:39:36.511568] [INFO ] [MAIN ] Derivative Progress: 860/2073 symbols completed. HI took 1.2s. Estimated remaining: 8m 26s. Rate: 144.0 symbols/min [2025-10-03T22:39:36.511954] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:36.525737] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:36.526544] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51948 primary records. [2025-10-03T22:39:36.526611] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-03T22:39:36.552983] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-10-03T22:39:36.553135] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-03T22:39:36.556062] [INFO ] [MAIN ] Derivative Progress: 861/2073 symbols completed. HIG took 1.2s. Estimated remaining: 8m 25s. Rate: 144.1 symbols/min [2025-10-03T22:39:36.556990] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:36.568932] [DEBUG] [LOCAL ] HII: Loaded 35064 existing records from primary storage. [2025-10-03T22:39:36.569225] [INFO ] [MAIN ] HII: Loaded 35064 primary data records. [2025-10-03T22:39:36.797974] [DEBUG] [LOCAL ] HIO: Loaded 24380 existing records from primary storage. [2025-10-03T22:39:36.920789] [INFO ] [MAIN ] HIO: Loaded 24380 primary data records. [2025-10-03T22:39:36.999836] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-03T22:39:37.041696] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-10-03T22:39:37.599670] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:37.600603] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 35064 primary records. [2025-10-03T22:39:37.600795] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-03T22:39:37.619699] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-10-03T22:39:37.620285] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-03T22:39:37.623154] [INFO ] [MAIN ] Derivative Progress: 862/2073 symbols completed. HII took 1.1s. Estimated remaining: 8m 25s. Rate: 143.8 symbols/min [2025-10-03T22:39:37.623744] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:37.643355] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:37.644203] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24380 primary records. [2025-10-03T22:39:37.644332] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-03T22:39:37.689183] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-10-03T22:39:37.689529] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-03T22:39:37.689883] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:37.690316] [DEBUG] [LOCAL ] HIPO: Loaded 22331 existing records from primary storage. [2025-10-03T22:39:37.693128] [INFO ] [MAIN ] Derivative Progress: 863/2073 symbols completed. HIO took 1.1s. Estimated remaining: 8m 24s. Rate: 144.0 symbols/min [2025-10-03T22:39:37.694047] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-10-03T22:39:37.694323] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:37.694159] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-03T22:39:37.694232] [INFO ] [MAIN ] HIPO: Loaded 22331 primary data records. [2025-10-03T22:39:37.866830] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-10-03T22:39:37.895560] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-03T22:39:38.051990] [INFO ] [MAIN ] Derivative Progress: 864/2073 symbols completed. HIMS took 1.5s. Estimated remaining: 8m 24s. Rate: 144.0 symbols/min [2025-10-03T22:39:38.077536] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:38.097437] [DEBUG] [LOCAL ] HIW: Loaded 45164 existing records from primary storage. [2025-10-03T22:39:38.097824] [INFO ] [MAIN ] HIW: Loaded 45164 primary data records. [2025-10-03T22:39:38.220578] [DEBUG] [LOCAL ] HIX: Loaded 20931 existing records from primary storage. [2025-10-03T22:39:38.236911] [INFO ] [MAIN ] HIX: Loaded 20931 primary data records. [2025-10-03T22:39:38.563785] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:38.586229] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22331 primary records. [2025-10-03T22:39:38.606274] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-03T22:39:38.795113] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-10-03T22:39:38.796700] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-03T22:39:38.800687] [INFO ] [MAIN ] Derivative Progress: 865/2073 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 24s. Rate: 143.9 symbols/min [2025-10-03T22:39:38.801212] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:38.831905] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:38.833017] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45164 primary records. [2025-10-03T22:39:38.833335] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-03T22:39:38.855035] [DEBUG] [LOCAL ] HKD: Loaded 18629 existing records from primary storage. [2025-10-03T22:39:38.861587] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-10-03T22:39:38.861886] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-03T22:39:38.861770] [INFO ] [MAIN ] HKD: Loaded 18629 primary data records. [2025-10-03T22:39:38.872985] [INFO ] [MAIN ] Derivative Progress: 866/2073 symbols completed. HIW took 1.2s. Estimated remaining: 8m 23s. Rate: 144.0 symbols/min [2025-10-03T22:39:38.878899] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:38.879008] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:38.901114] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20931 primary records. [2025-10-03T22:39:38.924159] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-03T22:39:39.092938] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-10-03T22:39:39.093168] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-03T22:39:39.099293] [INFO ] [MAIN ] Derivative Progress: 867/2073 symbols completed. HIX took 1.0s. Estimated remaining: 8m 22s. Rate: 144.1 symbols/min [2025-10-03T22:39:39.099670] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:39.272772] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-10-03T22:39:39.273443] [INFO ] [MAIN ] HL: Loaded 54451 primary data records. [2025-10-03T22:39:39.455602] [DEBUG] [LOCAL ] HLF: Loaded 49195 existing records from primary storage. [2025-10-03T22:39:39.448829] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:39.460949] [INFO ] [MAIN ] HLF: Loaded 49195 primary data records. [2025-10-03T22:39:39.486060] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18629 primary records. [2025-10-03T22:39:39.494466] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-03T22:39:39.775463] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-10-03T22:39:39.776064] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-03T22:39:39.780415] [INFO ] [MAIN ] Derivative Progress: 868/2073 symbols completed. HKD took 1.0s. Estimated remaining: 8m 22s. Rate: 144.0 symbols/min [2025-10-03T22:39:40.078513] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:40.079560] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54451 primary records. [2025-10-03T22:39:40.079852] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-03T22:39:40.106242] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-10-03T22:39:40.106813] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-03T22:39:40.110601] [INFO ] [MAIN ] Derivative Progress: 869/2073 symbols completed. HL took 1.2s. Estimated remaining: 8m 22s. Rate: 144.0 symbols/min [2025-10-03T22:39:40.128734] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:40.129731] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49195 primary records. [2025-10-03T22:39:40.129797] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-03T22:39:40.146801] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-10-03T22:39:40.146883] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-03T22:39:40.150878] [INFO ] [MAIN ] Derivative Progress: 870/2073 symbols completed. HLF took 1.1s. Estimated remaining: 8m 21s. Rate: 144.2 symbols/min [2025-10-03T22:39:40.151767] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:40.151601] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:40.151679] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:40.183920] [DEBUG] [LOCAL ] HLIO: Loaded 28237 existing records from primary storage. [2025-10-03T22:39:40.192095] [INFO ] [MAIN ] HLIO: Loaded 28237 primary data records. [2025-10-03T22:39:40.327587] [DEBUG] [LOCAL ] HLLY: Loaded 33661 existing records from primary storage. [2025-10-03T22:39:40.339489] [DEBUG] [LOCAL ] HLI: Loaded 31274 existing records from primary storage. [2025-10-03T22:39:40.339604] [INFO ] [MAIN ] HLI: Loaded 31274 primary data records. [2025-10-03T22:39:40.333460] [INFO ] [MAIN ] HLLY: Loaded 33661 primary data records. [2025-10-03T22:39:41.179389] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:41.181032] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28237 primary records. [2025-10-03T22:39:41.181569] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-03T22:39:41.203085] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-10-03T22:39:41.203579] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-03T22:39:41.206402] [INFO ] [MAIN ] Derivative Progress: 871/2073 symbols completed. HLIO took 1.1s. Estimated remaining: 8m 21s. Rate: 143.9 symbols/min [2025-10-03T22:39:41.219043] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:41.221480] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:41.223898] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31274 primary records. [2025-10-03T22:39:41.224221] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-03T22:39:41.251343] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:41.255876] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33661 primary records. [2025-10-03T22:39:41.256238] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-03T22:39:41.258196] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-10-03T22:39:41.258688] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-03T22:39:41.262246] [INFO ] [MAIN ] Derivative Progress: 872/2073 symbols completed. HLI took 1.1s. Estimated remaining: 8m 20s. Rate: 144.1 symbols/min [2025-10-03T22:39:41.270983] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:41.279350] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-10-03T22:39:41.279573] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-03T22:39:41.283707] [INFO ] [MAIN ] Derivative Progress: 873/2073 symbols completed. HLLY took 1.1s. Estimated remaining: 8m 19s. Rate: 144.2 symbols/min [2025-10-03T22:39:41.283994] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:41.325679] [DEBUG] [LOCAL ] HLN: Loaded 53863 existing records from primary storage. [2025-10-03T22:39:41.326049] [INFO ] [MAIN ] HLN: Loaded 53863 primary data records. [2025-10-03T22:39:41.546743] [DEBUG] [LOCAL ] HLT: Loaded 51359 existing records from primary storage. [2025-10-03T22:39:41.574980] [DEBUG] [LOCAL ] HLX: Loaded 48451 existing records from primary storage. [2025-10-03T22:39:41.579906] [INFO ] [MAIN ] HLX: Loaded 48451 primary data records. [2025-10-03T22:39:41.568588] [INFO ] [MAIN ] HLT: Loaded 51359 primary data records. [2025-10-03T22:39:42.443340] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:42.446060] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53863 primary records. [2025-10-03T22:39:42.446371] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-03T22:39:42.464759] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-10-03T22:39:42.464883] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-03T22:39:42.467368] [INFO ] [MAIN ] Derivative Progress: 874/2073 symbols completed. HLN took 1.2s. Estimated remaining: 8m 20s. Rate: 143.9 symbols/min [2025-10-03T22:39:42.467918] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:42.489910] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:42.503160] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51359 primary records. [2025-10-03T22:39:42.503443] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-03T22:39:42.503681] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:42.505020] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48451 primary records. [2025-10-03T22:39:42.505153] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-03T22:39:42.535821] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-10-03T22:39:42.536754] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-03T22:39:42.543416] [INFO ] [MAIN ] Derivative Progress: 875/2073 symbols completed. HLX took 1.3s. Estimated remaining: 8m 19s. Rate: 144.0 symbols/min [2025-10-03T22:39:42.543747] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:42.539893] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-10-03T22:39:42.544543] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-03T22:39:42.548167] [INFO ] [MAIN ] Derivative Progress: 876/2073 symbols completed. HLT took 1.3s. Estimated remaining: 8m 18s. Rate: 144.2 symbols/min [2025-10-03T22:39:42.548612] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:42.599239] [DEBUG] [LOCAL ] HMC: Loaded 47350 existing records from primary storage. [2025-10-03T22:39:42.604283] [INFO ] [MAIN ] HMC: Loaded 47350 primary data records. [2025-10-03T22:39:42.696940] [DEBUG] [LOCAL ] HMN: Loaded 23661 existing records from primary storage. [2025-10-03T22:39:42.723377] [INFO ] [MAIN ] HMN: Loaded 23661 primary data records. [2025-10-03T22:39:43.079498] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-10-03T22:39:43.085894] [INFO ] [MAIN ] HMY: Loaded 53914 primary data records. [2025-10-03T22:39:43.659829] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:43.661875] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47350 primary records. [2025-10-03T22:39:43.662258] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-03T22:39:43.696401] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-10-03T22:39:43.696737] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-03T22:39:43.696304] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:43.699688] [INFO ] [MAIN ] Derivative Progress: 877/2073 symbols completed. HMC took 1.2s. Estimated remaining: 8m 19s. Rate: 143.9 symbols/min [2025-10-03T22:39:43.700839] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23661 primary records. [2025-10-03T22:39:43.699960] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:43.701990] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-03T22:39:43.719666] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-10-03T22:39:43.719834] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-03T22:39:43.723198] [INFO ] [MAIN ] Derivative Progress: 878/2073 symbols completed. HMN took 1.2s. Estimated remaining: 8m 18s. Rate: 144.1 symbols/min [2025-10-03T22:39:43.723493] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:43.741159] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:43.742010] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53914 primary records. [2025-10-03T22:39:43.742155] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-03T22:39:43.768210] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-10-03T22:39:43.768373] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-03T22:39:43.771946] [INFO ] [MAIN ] Derivative Progress: 879/2073 symbols completed. HMY took 1.2s. Estimated remaining: 8m 17s. Rate: 144.2 symbols/min [2025-10-03T22:39:43.772226] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:43.783173] [DEBUG] [LOCAL ] HNI: Loaded 29796 existing records from primary storage. [2025-10-03T22:39:43.783352] [INFO ] [MAIN ] HNI: Loaded 29796 primary data records. [2025-10-03T22:39:43.992326] [DEBUG] [LOCAL ] HOG: Loaded 51853 existing records from primary storage. [2025-10-03T22:39:44.015345] [INFO ] [MAIN ] HOG: Loaded 51853 primary data records. [2025-10-03T22:39:44.226724] [DEBUG] [LOCAL ] HOMB: Loaded 44129 existing records from primary storage. [2025-10-03T22:39:44.240083] [INFO ] [MAIN ] HOMB: Loaded 44129 primary data records. [2025-10-03T22:39:44.852999] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:44.854377] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29796 primary records. [2025-10-03T22:39:44.854688] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-03T22:39:44.875368] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-10-03T22:39:44.875714] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-03T22:39:44.878888] [INFO ] [MAIN ] Derivative Progress: 880/2073 symbols completed. HNI took 1.2s. Estimated remaining: 8m 17s. Rate: 143.9 symbols/min [2025-10-03T22:39:44.879094] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:44.893923] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:44.895077] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51853 primary records. [2025-10-03T22:39:44.895487] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-03T22:39:44.930377] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:44.932378] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44129 primary records. [2025-10-03T22:39:44.942708] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-03T22:39:44.931391] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-10-03T22:39:44.943277] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-03T22:39:44.946761] [INFO ] [MAIN ] Derivative Progress: 881/2073 symbols completed. HOG took 1.2s. Estimated remaining: 8m 16s. Rate: 144.1 symbols/min [2025-10-03T22:39:44.958233] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:44.962793] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-10-03T22:39:44.964087] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-03T22:39:44.967815] [INFO ] [MAIN ] Derivative Progress: 882/2073 symbols completed. HOMB took 1.2s. Estimated remaining: 8m 15s. Rate: 144.2 symbols/min [2025-10-03T22:39:44.968327] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:44.982432] [DEBUG] [LOCAL ] HOUS: Loaded 45288 existing records from primary storage. [2025-10-03T22:39:44.982723] [INFO ] [MAIN ] HOUS: Loaded 45288 primary data records. [2025-10-03T22:39:45.101914] [DEBUG] [LOCAL ] HOV: Loaded 13893 existing records from primary storage. [2025-10-03T22:39:45.118302] [INFO ] [MAIN ] HOV: Loaded 13893 primary data records. [2025-10-03T22:39:45.460161] [DEBUG] [LOCAL ] HP: Loaded 52346 existing records from primary storage. [2025-10-03T22:39:45.476468] [INFO ] [MAIN ] HP: Loaded 52346 primary data records. [2025-10-03T22:39:45.979368] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:45.980310] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 45288 primary records. [2025-10-03T22:39:45.980554] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-03T22:39:45.999107] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-10-03T22:39:45.999786] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-03T22:39:46.002616] [INFO ] [MAIN ] Derivative Progress: 883/2073 symbols completed. HOUS took 1.1s. Estimated remaining: 8m 16s. Rate: 144.0 symbols/min [2025-10-03T22:39:46.020632] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:46.021406] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 13893 primary records. [2025-10-03T22:39:46.021573] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-03T22:39:46.038303] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-10-03T22:39:46.038535] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-03T22:39:46.041468] [INFO ] [MAIN ] Derivative Progress: 884/2073 symbols completed. HOV took 1.1s. Estimated remaining: 8m 15s. Rate: 144.1 symbols/min [2025-10-03T22:39:46.057553] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:46.058236] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52346 primary records. [2025-10-03T22:39:46.058303] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-03T22:39:46.073825] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-10-03T22:39:46.073885] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-03T22:39:46.077696] [INFO ] [MAIN ] Derivative Progress: 885/2073 symbols completed. HP took 1.1s. Estimated remaining: 8m 14s. Rate: 144.3 symbols/min [2025-10-03T22:39:46.078126] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:46.078289] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:46.078197] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:46.093142] [DEBUG] [LOCAL ] HPF: Loaded 7503 existing records from primary storage. [2025-10-03T22:39:46.093330] [INFO ] [MAIN ] HPF: Loaded 7503 primary data records. [2025-10-03T22:39:46.135637] [DEBUG] [LOCAL ] HPI: Loaded 10537 existing records from primary storage. [2025-10-03T22:39:46.176303] [INFO ] [MAIN ] HPI: Loaded 10537 primary data records. [2025-10-03T22:39:46.773770] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-03T22:39:46.774210] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-10-03T22:39:47.108170] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:47.109450] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7503 primary records. [2025-10-03T22:39:47.110185] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-03T22:39:47.145019] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:47.146951] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10537 primary records. [2025-10-03T22:39:47.146143] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-10-03T22:39:47.147430] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-03T22:39:47.147508] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-03T22:39:47.150600] [INFO ] [MAIN ] Derivative Progress: 886/2073 symbols completed. HPF took 1.1s. Estimated remaining: 8m 14s. Rate: 144.0 symbols/min [2025-10-03T22:39:47.151987] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:47.170055] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-10-03T22:39:47.170699] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-03T22:39:47.174939] [INFO ] [MAIN ] Derivative Progress: 887/2073 symbols completed. HPI took 1.1s. Estimated remaining: 8m 14s. Rate: 144.2 symbols/min [2025-10-03T22:39:47.176098] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:47.191526] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:47.192566] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-10-03T22:39:47.192761] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-03T22:39:47.234316] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-10-03T22:39:47.234759] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-03T22:39:47.238292] [INFO ] [MAIN ] Derivative Progress: 888/2073 symbols completed. HPE took 1.2s. Estimated remaining: 8m 13s. Rate: 144.3 symbols/min [2025-10-03T22:39:47.238585] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:47.276851] [DEBUG] [LOCAL ] HPP: Loaded 51658 existing records from primary storage. [2025-10-03T22:39:47.277183] [INFO ] [MAIN ] HPP: Loaded 51658 primary data records. [2025-10-03T22:39:47.338809] [DEBUG] [LOCAL ] HPS: Loaded 10340 existing records from primary storage. [2025-10-03T22:39:47.353070] [INFO ] [MAIN ] HPS: Loaded 10340 primary data records. [2025-10-03T22:39:47.432434] [DEBUG] [LOCAL ] HPQ: Loaded 54447 existing records from primary storage. [2025-10-03T22:39:47.471349] [INFO ] [MAIN ] HPQ: Loaded 54447 primary data records. [2025-10-03T22:39:48.299216] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:48.300282] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51658 primary records. [2025-10-03T22:39:48.300674] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-03T22:39:48.338480] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:48.352108] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-10-03T22:39:48.352339] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-03T22:39:48.357480] [INFO ] [MAIN ] Derivative Progress: 889/2073 symbols completed. HPP took 1.2s. Estimated remaining: 8m 13s. Rate: 144.0 symbols/min [2025-10-03T22:39:48.353406] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54447 primary records. [2025-10-03T22:39:48.358477] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:48.358091] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:48.358740] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-03T22:39:48.360083] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10340 primary records. [2025-10-03T22:39:48.360664] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-03T22:39:48.390262] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-10-03T22:39:48.391979] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-03T22:39:48.395764] [INFO ] [MAIN ] Derivative Progress: 890/2073 symbols completed. HPQ took 1.2s. Estimated remaining: 8m 12s. Rate: 144.2 symbols/min [2025-10-03T22:39:48.396445] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:48.398763] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-10-03T22:39:48.398935] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-03T22:39:48.402041] [INFO ] [MAIN ] Derivative Progress: 891/2073 symbols completed. HPS took 1.2s. Estimated remaining: 8m 11s. Rate: 144.4 symbols/min [2025-10-03T22:39:48.402230] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:48.437029] [DEBUG] [LOCAL ] HQL: Loaded 16628 existing records from primary storage. [2025-10-03T22:39:48.438213] [INFO ] [MAIN ] HQL: Loaded 16628 primary data records. [2025-10-03T22:39:48.438066] [DEBUG] [LOCAL ] HQH: Loaded 25615 existing records from primary storage. [2025-10-03T22:39:48.438605] [INFO ] [MAIN ] HQH: Loaded 25615 primary data records. [2025-10-03T22:39:48.980246] [DEBUG] [LOCAL ] HR: Loaded 52706 existing records from primary storage. [2025-10-03T22:39:49.064862] [INFO ] [MAIN ] HR: Loaded 52706 primary data records. [2025-10-03T22:39:49.435449] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:49.437086] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 25615 primary records. [2025-10-03T22:39:49.437260] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-03T22:39:49.461276] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-10-03T22:39:49.475731] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-03T22:39:49.479231] [INFO ] [MAIN ] Derivative Progress: 892/2073 symbols completed. HQH took 1.1s. Estimated remaining: 8m 12s. Rate: 144.1 symbols/min [2025-10-03T22:39:49.480131] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:49.479709] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:49.481971] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 16628 primary records. [2025-10-03T22:39:49.483025] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-03T22:39:49.504630] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-10-03T22:39:49.504998] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-03T22:39:49.508448] [INFO ] [MAIN ] Derivative Progress: 893/2073 symbols completed. HQL took 1.1s. Estimated remaining: 8m 11s. Rate: 144.2 symbols/min [2025-10-03T22:39:49.508630] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:49.523341] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:49.524592] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52706 primary records. [2025-10-03T22:39:49.524820] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-03T22:39:49.549121] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-10-03T22:39:49.549459] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-03T22:39:49.553145] [INFO ] [MAIN ] Derivative Progress: 894/2073 symbols completed. HR took 1.2s. Estimated remaining: 8m 10s. Rate: 144.4 symbols/min [2025-10-03T22:39:49.553723] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:49.589362] [DEBUG] [LOCAL ] HRI: Loaded 33230 existing records from primary storage. [2025-10-03T22:39:49.590354] [INFO ] [MAIN ] HRI: Loaded 33230 primary data records. [2025-10-03T22:39:49.674263] [DEBUG] [LOCAL ] HRB: Loaded 49183 existing records from primary storage. [2025-10-03T22:39:49.707672] [INFO ] [MAIN ] HRB: Loaded 49183 primary data records. [2025-10-03T22:39:50.065614] [DEBUG] [LOCAL ] HRL: Loaded 53847 existing records from primary storage. [2025-10-03T22:39:50.091022] [INFO ] [MAIN ] HRL: Loaded 53847 primary data records. [2025-10-03T22:39:50.688676] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:50.689854] [INFO ] [MAIN ] HRI: Generated 1820 derivative records from 33230 primary records. [2025-10-03T22:39:50.690803] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-03T22:39:50.712205] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:50.719325] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49183 primary records. [2025-10-03T22:39:50.719526] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-03T22:39:50.730001] [DEBUG] [LOCAL ] HRI: Derivative data saved (1820 records). [2025-10-03T22:39:50.733734] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-03T22:39:50.736597] [INFO ] [MAIN ] Derivative Progress: 895/2073 symbols completed. HRI took 1.2s. Estimated remaining: 8m 11s. Rate: 144.1 symbols/min [2025-10-03T22:39:50.737349] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:50.757912] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:50.759408] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53847 primary records. [2025-10-03T22:39:50.759550] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-03T22:39:50.759716] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-10-03T22:39:50.760398] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-03T22:39:50.764895] [INFO ] [MAIN ] Derivative Progress: 896/2073 symbols completed. HRB took 1.3s. Estimated remaining: 8m 10s. Rate: 144.2 symbols/min [2025-10-03T22:39:50.776314] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:50.793217] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-10-03T22:39:50.793520] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-03T22:39:50.796812] [INFO ] [MAIN ] Derivative Progress: 897/2073 symbols completed. HRL took 1.2s. Estimated remaining: 8m 9s. Rate: 144.4 symbols/min [2025-10-03T22:39:50.797122] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:50.814371] [DEBUG] [LOCAL ] HRTG: Loaded 33921 existing records from primary storage. [2025-10-03T22:39:50.814594] [INFO ] [MAIN ] HRTG: Loaded 33921 primary data records. [2025-10-03T22:39:50.943259] [DEBUG] [LOCAL ] HSHP: Loaded 15437 existing records from primary storage. [2025-10-03T22:39:50.943502] [INFO ] [MAIN ] HSHP: Loaded 15437 primary data records. [2025-10-03T22:39:51.122972] [DEBUG] [LOCAL ] HSBC: Loaded 51774 existing records from primary storage. [2025-10-03T22:39:51.248127] [INFO ] [MAIN ] HSBC: Loaded 51774 primary data records. [2025-10-03T22:39:51.788105] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:51.789166] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 33921 primary records. [2025-10-03T22:39:51.791162] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-03T22:39:51.818066] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:51.819479] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15437 primary records. [2025-10-03T22:39:51.819823] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-03T22:39:51.838418] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-10-03T22:39:51.841695] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-03T22:39:51.841606] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-10-03T22:39:51.845302] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-03T22:39:51.845215] [INFO ] [MAIN ] Derivative Progress: 898/2073 symbols completed. HSHP took 1.0s. Estimated remaining: 8m 9s. Rate: 144.1 symbols/min [2025-10-03T22:39:51.848390] [INFO ] [MAIN ] Derivative Progress: 899/2073 symbols completed. HRTG took 1.1s. Estimated remaining: 8m 8s. Rate: 144.3 symbols/min [2025-10-03T22:39:51.861419] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:51.862035] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51774 primary records. [2025-10-03T22:39:51.862095] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-03T22:39:51.877577] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-10-03T22:39:51.877637] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-03T22:39:51.881687] [INFO ] [MAIN ] Derivative Progress: 900/2073 symbols completed. HSBC took 1.1s. Estimated remaining: 8m 7s. Rate: 144.5 symbols/min [2025-10-03T22:39:51.882092] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:51.882242] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:51.882188] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:51.901100] [DEBUG] [LOCAL ] HTD: Loaded 14020 existing records from primary storage. [2025-10-03T22:39:51.901251] [INFO ] [MAIN ] HTD: Loaded 14020 primary data records. [2025-10-03T22:39:52.242572] [DEBUG] [LOCAL ] HTGC: Loaded 48078 existing records from primary storage. [2025-10-03T22:39:52.242847] [INFO ] [MAIN ] HTGC: Loaded 48078 primary data records. [2025-10-03T22:39:52.362973] [DEBUG] [LOCAL ] HSY: Loaded 51044 existing records from primary storage. [2025-10-03T22:39:52.363781] [INFO ] [MAIN ] HSY: Loaded 51044 primary data records. [2025-10-03T22:39:52.926858] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:52.928233] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 14020 primary records. [2025-10-03T22:39:52.928853] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-03T22:39:52.950635] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-10-03T22:39:52.951560] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-03T22:39:52.963267] [INFO ] [MAIN ] Derivative Progress: 901/2073 symbols completed. HTD took 1.1s. Estimated remaining: 8m 8s. Rate: 144.2 symbols/min [2025-10-03T22:39:52.969001] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:52.970211] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48078 primary records. [2025-10-03T22:39:52.969356] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:52.970478] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-03T22:39:52.988349] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-10-03T22:39:52.990440] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-03T22:39:52.993716] [INFO ] [MAIN ] Derivative Progress: 902/2073 symbols completed. HTGC took 1.1s. Estimated remaining: 8m 7s. Rate: 144.3 symbols/min [2025-10-03T22:39:52.994064] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:53.008862] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:53.009688] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51044 primary records. [2025-10-03T22:39:53.009825] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-03T22:39:53.035391] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-10-03T22:39:53.036184] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-03T22:39:53.040046] [INFO ] [MAIN ] Derivative Progress: 903/2073 symbols completed. HSY took 1.2s. Estimated remaining: 8m 6s. Rate: 144.5 symbols/min [2025-10-03T22:39:53.049902] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:53.050787] [DEBUG] [LOCAL ] HTH: Loaded 32613 existing records from primary storage. [2025-10-03T22:39:53.051152] [INFO ] [MAIN ] HTH: Loaded 32613 primary data records. [2025-10-03T22:39:53.265335] [DEBUG] [LOCAL ] HUBB: Loaded 37114 existing records from primary storage. [2025-10-03T22:39:53.381041] [INFO ] [MAIN ] HUBB: Loaded 37114 primary data records. [2025-10-03T22:39:53.471136] [DEBUG] [LOCAL ] HUBS: Loaded 39955 existing records from primary storage. [2025-10-03T22:39:53.477749] [INFO ] [MAIN ] HUBS: Loaded 39955 primary data records. [2025-10-03T22:39:54.048436] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:54.050095] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 32613 primary records. [2025-10-03T22:39:54.050399] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-03T22:39:54.072559] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-10-03T22:39:54.072955] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-03T22:39:54.076497] [INFO ] [MAIN ] Derivative Progress: 904/2073 symbols completed. HTH took 1.1s. Estimated remaining: 8m 6s. Rate: 144.3 symbols/min [2025-10-03T22:39:54.076898] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:54.098297] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:54.100383] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 37114 primary records. [2025-10-03T22:39:54.101247] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-03T22:39:54.132665] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:54.136356] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 39955 primary records. [2025-10-03T22:39:54.136802] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-03T22:39:54.136617] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-10-03T22:39:54.137956] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-03T22:39:54.141513] [INFO ] [MAIN ] Derivative Progress: 905/2073 symbols completed. HUBB took 1.1s. Estimated remaining: 8m 5s. Rate: 144.4 symbols/min [2025-10-03T22:39:54.142019] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:54.160065] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-10-03T22:39:54.172402] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-03T22:39:54.176112] [INFO ] [MAIN ] Derivative Progress: 906/2073 symbols completed. HUBS took 1.1s. Estimated remaining: 8m 4s. Rate: 144.5 symbols/min [2025-10-03T22:39:54.176518] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:54.202462] [DEBUG] [LOCAL ] HUM: Loaded 49601 existing records from primary storage. [2025-10-03T22:39:54.202735] [INFO ] [MAIN ] HUM: Loaded 49601 primary data records. [2025-10-03T22:39:54.544821] [DEBUG] [LOCAL ] HUN: Loaded 53977 existing records from primary storage. [2025-10-03T22:39:54.600225] [DEBUG] [LOCAL ] HUYA: Loaded 44793 existing records from primary storage. [2025-10-03T22:39:54.609405] [INFO ] [MAIN ] HUN: Loaded 53977 primary data records. [2025-10-03T22:39:54.619057] [INFO ] [MAIN ] HUYA: Loaded 44793 primary data records. [2025-10-03T22:39:55.281439] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:55.283595] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49601 primary records. [2025-10-03T22:39:55.283884] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-03T22:39:55.310309] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-10-03T22:39:55.310930] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-03T22:39:55.322891] [INFO ] [MAIN ] Derivative Progress: 907/2073 symbols completed. HUM took 1.2s. Estimated remaining: 8m 5s. Rate: 144.3 symbols/min [2025-10-03T22:39:55.330714] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:55.328918] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:55.335397] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53977 primary records. [2025-10-03T22:39:55.335674] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-03T22:39:55.378451] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:55.381718] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44793 primary records. [2025-10-03T22:39:55.387906] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-10-03T22:39:55.388980] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-03T22:39:55.393619] [INFO ] [MAIN ] Derivative Progress: 908/2073 symbols completed. HUN took 1.3s. Estimated remaining: 8m 4s. Rate: 144.4 symbols/min [2025-10-03T22:39:55.388609] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-03T22:39:55.395244] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:55.395090] [DEBUG] [LOCAL ] HVT: Loaded 15649 existing records from primary storage. [2025-10-03T22:39:55.397694] [INFO ] [MAIN ] HVT: Loaded 15649 primary data records. [2025-10-03T22:39:55.602721] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-10-03T22:39:55.608104] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-03T22:39:55.745819] [INFO ] [MAIN ] Derivative Progress: 909/2073 symbols completed. HUYA took 1.6s. Estimated remaining: 8m 4s. Rate: 144.4 symbols/min [2025-10-03T22:39:55.746328] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:55.776998] [DEBUG] [LOCAL ] HWM: Loaded 53700 existing records from primary storage. [2025-10-03T22:39:55.777472] [INFO ] [MAIN ] HWM: Loaded 53700 primary data records. [2025-10-03T22:39:55.884698] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:55.901922] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 15649 primary records. [2025-10-03T22:39:55.913564] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-03T22:39:56.141947] [DEBUG] [LOCAL ] HXL: Loaded 46561 existing records from primary storage. [2025-10-03T22:39:56.143295] [INFO ] [MAIN ] HXL: Loaded 46561 primary data records. [2025-10-03T22:39:56.254778] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-10-03T22:39:56.258907] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-03T22:39:56.262716] [INFO ] [MAIN ] Derivative Progress: 910/2073 symbols completed. HVT took 0.9s. Estimated remaining: 8m 3s. Rate: 144.4 symbols/min [2025-10-03T22:39:56.268542] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:56.519959] [DEBUG] [LOCAL ] HY: Loaded 10055 existing records from primary storage. [2025-10-03T22:39:56.520311] [INFO ] [MAIN ] HY: Loaded 10055 primary data records. [2025-10-03T22:39:56.654737] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:56.696696] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53700 primary records. [2025-10-03T22:39:56.836577] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-03T22:39:56.866550] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-10-03T22:39:56.867278] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-03T22:39:56.870935] [INFO ] [MAIN ] Derivative Progress: 911/2073 symbols completed. HWM took 1.5s. Estimated remaining: 8m 3s. Rate: 144.3 symbols/min [2025-10-03T22:39:56.871989] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:56.893049] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:56.894594] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46561 primary records. [2025-10-03T22:39:56.897907] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-03T22:39:56.917606] [DEBUG] [LOCAL ] HYI: Loaded 9955 existing records from primary storage. [2025-10-03T22:39:56.918632] [INFO ] [MAIN ] HYI: Loaded 9955 primary data records. [2025-10-03T22:39:57.025016] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-10-03T22:39:57.040963] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-03T22:39:57.050396] [INFO ] [MAIN ] Derivative Progress: 912/2073 symbols completed. HXL took 1.3s. Estimated remaining: 8m 2s. Rate: 144.4 symbols/min [2025-10-03T22:39:57.055825] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:57.061146] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:57.123721] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10055 primary records. [2025-10-03T22:39:57.239520] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-03T22:39:57.271867] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-10-03T22:39:57.272404] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-03T22:39:57.276159] [INFO ] [MAIN ] Derivative Progress: 913/2073 symbols completed. HY took 1.0s. Estimated remaining: 8m 2s. Rate: 144.5 symbols/min [2025-10-03T22:39:57.293198] [DEBUG] [LOCAL ] HYT: Loaded 34152 existing records from primary storage. [2025-10-03T22:39:57.293504] [INFO ] [MAIN ] HYT: Loaded 34152 primary data records. [2025-10-03T22:39:57.370984] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:57.383365] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 9955 primary records. [2025-10-03T22:39:57.399609] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-03T22:39:57.562732] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-10-03T22:39:57.627247] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-03T22:39:57.630181] [INFO ] [MAIN ] Derivative Progress: 914/2073 symbols completed. HYI took 0.8s. Estimated remaining: 8m 1s. Rate: 144.5 symbols/min [2025-10-03T22:39:57.655885] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:57.656536] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 34152 primary records. [2025-10-03T22:39:57.656666] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-03T22:39:57.672889] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-10-03T22:39:57.672954] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-03T22:39:57.676229] [INFO ] [MAIN ] Derivative Progress: 915/2073 symbols completed. HYT took 0.6s. Estimated remaining: 8m 0s. Rate: 144.6 symbols/min [2025-10-03T22:39:57.677396] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:57.677566] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:57.677321] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:57.687141] [DEBUG] [LOCAL ] HYTR: Loaded 3216 existing records from primary storage. [2025-10-03T22:39:57.687437] [INFO ] [MAIN ] HYTR: Loaded 3216 primary data records. [2025-10-03T22:39:57.713636] [DEBUG] [LOCAL ] IAE: Loaded 6116 existing records from primary storage. [2025-10-03T22:39:57.761148] [INFO ] [MAIN ] IAE: Loaded 6116 primary data records. [2025-10-03T22:39:57.899623] [DEBUG] [LOCAL ] HZO: Loaded 29526 existing records from primary storage. [2025-10-03T22:39:57.968730] [INFO ] [MAIN ] HZO: Loaded 29526 primary data records. [2025-10-03T22:39:58.737339] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:39:58.738518] [INFO ] [MAIN ] HYTR: Generated 1819 derivative records from 3216 primary records. [2025-10-03T22:39:58.738814] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-03T22:39:58.757997] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1819 records). [2025-10-03T22:39:58.759038] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-03T22:39:58.761924] [INFO ] [MAIN ] Derivative Progress: 916/2073 symbols completed. HYTR took 1.1s. Estimated remaining: 8m 1s. Rate: 144.4 symbols/min [2025-10-03T22:39:58.762223] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:58.777968] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:58.779110] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6116 primary records. [2025-10-03T22:39:58.779378] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-03T22:39:58.810440] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:39:58.812189] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29526 primary records. [2025-10-03T22:39:58.812589] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-03T22:39:58.826723] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-10-03T22:39:58.828520] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-03T22:39:58.832079] [INFO ] [MAIN ] Derivative Progress: 917/2073 symbols completed. IAE took 1.2s. Estimated remaining: 8m 0s. Rate: 144.5 symbols/min [2025-10-03T22:39:58.832561] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:58.851404] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-10-03T22:39:58.851733] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-03T22:39:58.855529] [INFO ] [MAIN ] Derivative Progress: 918/2073 symbols completed. HZO took 1.2s. Estimated remaining: 7m 59s. Rate: 144.6 symbols/min [2025-10-03T22:39:58.855987] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:39:58.876896] [DEBUG] [LOCAL ] IAG: Loaded 54232 existing records from primary storage. [2025-10-03T22:39:58.877189] [INFO ] [MAIN ] IAG: Loaded 54232 primary data records. [2025-10-03T22:39:59.239713] [DEBUG] [LOCAL ] IBM: Loaded 54412 existing records from primary storage. [2025-10-03T22:39:59.254558] [INFO ] [MAIN ] IBM: Loaded 54412 primary data records. [2025-10-03T22:39:59.287540] [DEBUG] [LOCAL ] IBN: Loaded 53644 existing records from primary storage. [2025-10-03T22:39:59.293485] [INFO ] [MAIN ] IBN: Loaded 53644 primary data records. [2025-10-03T22:40:00.031210] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:00.032814] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54232 primary records. [2025-10-03T22:40:00.035297] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-03T22:40:00.070013] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-10-03T22:40:00.070193] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-03T22:40:00.074325] [INFO ] [MAIN ] Derivative Progress: 919/2073 symbols completed. IAG took 1.3s. Estimated remaining: 7m 60s. Rate: 144.3 symbols/min [2025-10-03T22:40:00.075027] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:00.116943] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:00.124357] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54412 primary records. [2025-10-03T22:40:00.131936] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-03T22:40:00.132414] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:00.133967] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53644 primary records. [2025-10-03T22:40:00.150323] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-03T22:40:00.188047] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-10-03T22:40:00.189817] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-03T22:40:00.195435] [INFO ] [MAIN ] Derivative Progress: 920/2073 symbols completed. IBM took 1.4s. Estimated remaining: 7m 59s. Rate: 144.5 symbols/min [2025-10-03T22:40:00.202405] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:00.225383] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-10-03T22:40:00.225608] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-03T22:40:00.222733] [DEBUG] [LOCAL ] IBTA: Loaded 38108 existing records from primary storage. [2025-10-03T22:40:00.232068] [INFO ] [MAIN ] Derivative Progress: 921/2073 symbols completed. IBN took 1.4s. Estimated remaining: 7m 58s. Rate: 144.6 symbols/min [2025-10-03T22:40:00.231750] [INFO ] [MAIN ] IBTA: Loaded 38108 primary data records. [2025-10-03T22:40:00.232555] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:00.557352] [DEBUG] [LOCAL ] ICL: Loaded 38938 existing records from primary storage. [2025-10-03T22:40:00.563480] [INFO ] [MAIN ] ICL: Loaded 38938 primary data records. [2025-10-03T22:40:00.676997] [DEBUG] [LOCAL ] ICE: Loaded 53782 existing records from primary storage. [2025-10-03T22:40:00.874905] [INFO ] [MAIN ] ICE: Loaded 53782 primary data records. [2025-10-03T22:40:01.607473] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:01.610037] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 38108 primary records. [2025-10-03T22:40:01.610379] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-03T22:40:01.630839] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-10-03T22:40:01.631082] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-03T22:40:01.633808] [INFO ] [MAIN ] Derivative Progress: 922/2073 symbols completed. IBTA took 1.6s. Estimated remaining: 7m 59s. Rate: 144.2 symbols/min [2025-10-03T22:40:01.634763] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:01.652861] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:01.653929] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 38938 primary records. [2025-10-03T22:40:01.654736] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-03T22:40:01.682454] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:01.684274] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53782 primary records. [2025-10-03T22:40:01.684873] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-03T22:40:01.709388] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-10-03T22:40:01.721093] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-03T22:40:01.727110] [INFO ] [MAIN ] Derivative Progress: 923/2073 symbols completed. ICL took 1.5s. Estimated remaining: 7m 58s. Rate: 144.3 symbols/min [2025-10-03T22:40:01.729029] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:01.731137] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-10-03T22:40:01.731444] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-03T22:40:01.737322] [INFO ] [MAIN ] Derivative Progress: 924/2073 symbols completed. ICE took 1.5s. Estimated remaining: 7m 57s. Rate: 144.5 symbols/min [2025-10-03T22:40:01.738664] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:01.755599] [DEBUG] [LOCAL ] IDA: Loaded 32618 existing records from primary storage. [2025-10-03T22:40:01.755981] [INFO ] [MAIN ] IDA: Loaded 32618 primary data records. [2025-10-03T22:40:01.874216] [DEBUG] [LOCAL ] IDE: Loaded 8867 existing records from primary storage. [2025-10-03T22:40:01.892053] [INFO ] [MAIN ] IDE: Loaded 8867 primary data records. [2025-10-03T22:40:01.891931] [DEBUG] [LOCAL ] IDT: Loaded 18332 existing records from primary storage. [2025-10-03T22:40:01.907721] [INFO ] [MAIN ] IDT: Loaded 18332 primary data records. [2025-10-03T22:40:02.824163] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:02.827110] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 32618 primary records. [2025-10-03T22:40:02.828429] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-03T22:40:02.843904] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:02.844887] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 18332 primary records. [2025-10-03T22:40:02.845057] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-03T22:40:02.882312] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:02.889472] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 8867 primary records. [2025-10-03T22:40:02.892591] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-10-03T22:40:02.893376] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-03T22:40:02.893220] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-10-03T22:40:02.893297] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-03T22:40:02.893572] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-03T22:40:02.897040] [INFO ] [MAIN ] Derivative Progress: 925/2073 symbols completed. IDT took 1.2s. Estimated remaining: 7m 58s. Rate: 144.2 symbols/min [2025-10-03T22:40:02.901115] [INFO ] [MAIN ] Derivative Progress: 926/2073 symbols completed. IDA took 1.3s. Estimated remaining: 7m 57s. Rate: 144.4 symbols/min [2025-10-03T22:40:02.901035] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:02.901681] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:02.920139] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-10-03T22:40:02.920442] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-03T22:40:02.923686] [INFO ] [MAIN ] Derivative Progress: 927/2073 symbols completed. IDE took 1.2s. Estimated remaining: 7m 56s. Rate: 144.5 symbols/min [2025-10-03T22:40:02.924065] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:02.961092] [DEBUG] [LOCAL ] IFN: Loaded 18598 existing records from primary storage. [2025-10-03T22:40:02.961602] [INFO ] [MAIN ] IFN: Loaded 18598 primary data records. [2025-10-03T22:40:03.078609] [DEBUG] [LOCAL ] IEX: Loaded 38871 existing records from primary storage. [2025-10-03T22:40:03.108873] [INFO ] [MAIN ] IEX: Loaded 38871 primary data records. [2025-10-03T22:40:03.133217] [DEBUG] [LOCAL ] IFF: Loaded 51736 existing records from primary storage. [2025-10-03T22:40:03.149109] [INFO ] [MAIN ] IFF: Loaded 51736 primary data records. [2025-10-03T22:40:04.034606] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:04.035789] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18598 primary records. [2025-10-03T22:40:04.035988] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-03T22:40:04.074345] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:04.074900] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-10-03T22:40:04.083693] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38871 primary records. [2025-10-03T22:40:04.088757] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-03T22:40:04.088984] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-03T22:40:04.089979] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:04.093975] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51736 primary records. [2025-10-03T22:40:04.093135] [INFO ] [MAIN ] Derivative Progress: 928/2073 symbols completed. IFN took 1.2s. Estimated remaining: 7m 56s. Rate: 144.2 symbols/min [2025-10-03T22:40:04.094113] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-03T22:40:04.127415] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-10-03T22:40:04.126542] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-10-03T22:40:04.127542] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-03T22:40:04.127690] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-03T22:40:04.131456] [INFO ] [MAIN ] Derivative Progress: 929/2073 symbols completed. IFF took 1.2s. Estimated remaining: 7m 55s. Rate: 144.4 symbols/min [2025-10-03T22:40:04.134832] [INFO ] [MAIN ] Derivative Progress: 930/2073 symbols completed. IEX took 1.2s. Estimated remaining: 7m 54s. Rate: 144.5 symbols/min [2025-10-03T22:40:04.135313] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:04.135230] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:04.135584] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:04.150879] [DEBUG] [LOCAL ] IGA: Loaded 10018 existing records from primary storage. [2025-10-03T22:40:04.151135] [INFO ] [MAIN ] IGA: Loaded 10018 primary data records. [2025-10-03T22:40:04.279329] [DEBUG] [LOCAL ] IGD: Loaded 19385 existing records from primary storage. [2025-10-03T22:40:04.288017] [INFO ] [MAIN ] IGD: Loaded 19385 primary data records. [2025-10-03T22:40:04.292805] [DEBUG] [LOCAL ] IFS: Loaded 23414 existing records from primary storage. [2025-10-03T22:40:04.398086] [INFO ] [MAIN ] IFS: Loaded 23414 primary data records. [2025-10-03T22:40:05.252854] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:05.254250] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 10018 primary records. [2025-10-03T22:40:05.255887] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-03T22:40:05.286144] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:05.290632] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19385 primary records. [2025-10-03T22:40:05.291169] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-03T22:40:05.292125] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-10-03T22:40:05.293059] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-03T22:40:05.306809] [INFO ] [MAIN ] Derivative Progress: 931/2073 symbols completed. IGA took 1.2s. Estimated remaining: 7m 55s. Rate: 144.3 symbols/min [2025-10-03T22:40:05.313931] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:05.323594] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-10-03T22:40:05.329305] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-03T22:40:05.329704] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:05.335690] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23414 primary records. [2025-10-03T22:40:05.334406] [INFO ] [MAIN ] Derivative Progress: 932/2073 symbols completed. IGD took 1.2s. Estimated remaining: 7m 54s. Rate: 144.4 symbols/min [2025-10-03T22:40:05.335941] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-03T22:40:05.336620] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:05.358322] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-10-03T22:40:05.358876] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-03T22:40:05.358676] [DEBUG] [LOCAL ] IGI: Loaded 3706 existing records from primary storage. [2025-10-03T22:40:05.364080] [INFO ] [MAIN ] Derivative Progress: 933/2073 symbols completed. IFS took 1.2s. Estimated remaining: 7m 53s. Rate: 144.5 symbols/min [2025-10-03T22:40:05.364285] [INFO ] [MAIN ] IGI: Loaded 3706 primary data records. [2025-10-03T22:40:05.385815] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:05.491219] [DEBUG] [LOCAL ] IH: Loaded 3145 existing records from primary storage. [2025-10-03T22:40:05.491838] [INFO ] [MAIN ] IH: Loaded 3145 primary data records. [2025-10-03T22:40:05.620998] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-10-03T22:40:05.749578] [INFO ] [MAIN ] IGR: Loaded 30882 primary data records. [2025-10-03T22:40:06.387629] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:06.389416] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3706 primary records. [2025-10-03T22:40:06.389752] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-03T22:40:06.410135] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-10-03T22:40:06.410237] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-03T22:40:06.413012] [INFO ] [MAIN ] Derivative Progress: 934/2073 symbols completed. IGI took 1.1s. Estimated remaining: 7m 54s. Rate: 144.3 symbols/min [2025-10-03T22:40:06.413290] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:06.431719] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:06.433367] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 3145 primary records. [2025-10-03T22:40:06.433670] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-03T22:40:06.451365] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:06.456311] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30882 primary records. [2025-10-03T22:40:06.467182] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-03T22:40:06.457016] [DEBUG] [LOCAL ] IHD: Loaded 7057 existing records from primary storage. [2025-10-03T22:40:06.472115] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-10-03T22:40:06.469536] [INFO ] [MAIN ] IHD: Loaded 7057 primary data records. [2025-10-03T22:40:06.478012] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-03T22:40:06.507088] [INFO ] [MAIN ] Derivative Progress: 935/2073 symbols completed. IH took 1.1s. Estimated remaining: 7m 53s. Rate: 144.4 symbols/min [2025-10-03T22:40:06.536934] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:06.555049] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-10-03T22:40:06.564492] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-03T22:40:06.575471] [INFO ] [MAIN ] Derivative Progress: 936/2073 symbols completed. IGR took 1.2s. Estimated remaining: 7m 52s. Rate: 144.6 symbols/min [2025-10-03T22:40:06.586948] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:06.824487] [DEBUG] [LOCAL ] IIF: Loaded 5751 existing records from primary storage. [2025-10-03T22:40:06.824709] [INFO ] [MAIN ] IIF: Loaded 5751 primary data records. [2025-10-03T22:40:06.889237] [DEBUG] [LOCAL ] IHG: Loaded 24747 existing records from primary storage. [2025-10-03T22:40:06.895474] [INFO ] [MAIN ] IHG: Loaded 24747 primary data records. [2025-10-03T22:40:07.675329] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:07.678275] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7057 primary records. [2025-10-03T22:40:07.679560] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-03T22:40:07.698885] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-10-03T22:40:07.699172] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-03T22:40:07.702264] [INFO ] [MAIN ] Derivative Progress: 937/2073 symbols completed. IHD took 1.3s. Estimated remaining: 7m 52s. Rate: 144.3 symbols/min [2025-10-03T22:40:07.703261] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:07.745553] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:07.758849] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:07.760424] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24747 primary records. [2025-10-03T22:40:07.760546] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-03T22:40:07.762214] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5751 primary records. [2025-10-03T22:40:07.759312] [DEBUG] [LOCAL ] IIIN: Loaded 16544 existing records from primary storage. [2025-10-03T22:40:07.763107] [INFO ] [MAIN ] IIIN: Loaded 16544 primary data records. [2025-10-03T22:40:07.762447] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-03T22:40:07.928087] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-10-03T22:40:07.933912] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-03T22:40:07.939898] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-10-03T22:40:07.940020] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-03T22:40:07.959022] [INFO ] [MAIN ] Derivative Progress: 938/2073 symbols completed. IIF took 1.4s. Estimated remaining: 7m 52s. Rate: 144.3 symbols/min [2025-10-03T22:40:07.987778] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:07.994400] [INFO ] [MAIN ] Derivative Progress: 939/2073 symbols completed. IHG took 1.4s. Estimated remaining: 7m 51s. Rate: 144.5 symbols/min [2025-10-03T22:40:08.013853] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:08.172699] [DEBUG] [LOCAL ] IIM: Loaded 16408 existing records from primary storage. [2025-10-03T22:40:08.173060] [INFO ] [MAIN ] IIM: Loaded 16408 primary data records. [2025-10-03T22:40:08.300799] [DEBUG] [LOCAL ] IIPR: Loaded 30310 existing records from primary storage. [2025-10-03T22:40:08.307076] [INFO ] [MAIN ] IIPR: Loaded 30310 primary data records. [2025-10-03T22:40:08.620209] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:08.649770] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16544 primary records. [2025-10-03T22:40:08.655802] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-03T22:40:08.907391] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-10-03T22:40:08.915886] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-03T22:40:08.920541] [INFO ] [MAIN ] Derivative Progress: 940/2073 symbols completed. IIIN took 1.2s. Estimated remaining: 7m 51s. Rate: 144.3 symbols/min [2025-10-03T22:40:08.921057] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:08.943360] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:08.944789] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16408 primary records. [2025-10-03T22:40:08.944946] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-03T22:40:08.978073] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-10-03T22:40:08.995428] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-03T22:40:09.000176] [INFO ] [MAIN ] Derivative Progress: 941/2073 symbols completed. IIM took 1.0s. Estimated remaining: 7m 50s. Rate: 144.4 symbols/min [2025-10-03T22:40:09.001080] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:09.000954] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:09.002299] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 30310 primary records. [2025-10-03T22:40:09.002904] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-03T22:40:09.036428] [DEBUG] [LOCAL ] IMAX: Loaded 43420 existing records from primary storage. [2025-10-03T22:40:09.037353] [INFO ] [MAIN ] IMAX: Loaded 43420 primary data records. [2025-10-03T22:40:09.038495] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-10-03T22:40:09.051060] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-03T22:40:09.075835] [INFO ] [MAIN ] Derivative Progress: 942/2073 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 49s. Rate: 144.5 symbols/min [2025-10-03T22:40:09.123683] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:09.396250] [DEBUG] [LOCAL ] INFA: Loaded 50218 existing records from primary storage. [2025-10-03T22:40:09.396582] [INFO ] [MAIN ] INFA: Loaded 50218 primary data records. [2025-10-03T22:40:09.594817] [DEBUG] [LOCAL ] INFY: Loaded 54375 existing records from primary storage. [2025-10-03T22:40:09.620064] [INFO ] [MAIN ] INFY: Loaded 54375 primary data records. [2025-10-03T22:40:10.098346] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:10.230335] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43420 primary records. [2025-10-03T22:40:10.245210] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-03T22:40:10.274871] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-10-03T22:40:10.275554] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-03T22:40:10.278756] [INFO ] [MAIN ] Derivative Progress: 943/2073 symbols completed. IMAX took 1.4s. Estimated remaining: 7m 50s. Rate: 144.3 symbols/min [2025-10-03T22:40:10.298566] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:10.300101] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 50218 primary records. [2025-10-03T22:40:10.300408] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-03T22:40:10.324295] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-10-03T22:40:10.324682] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-03T22:40:10.341990] [INFO ] [MAIN ] Derivative Progress: 944/2073 symbols completed. INFA took 1.3s. Estimated remaining: 7m 49s. Rate: 144.4 symbols/min [2025-10-03T22:40:10.343115] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:10.343925] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54375 primary records. [2025-10-03T22:40:10.343994] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-03T22:40:10.361734] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-10-03T22:40:10.361933] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-03T22:40:10.366475] [INFO ] [MAIN ] Derivative Progress: 945/2073 symbols completed. INFY took 1.2s. Estimated remaining: 7m 48s. Rate: 144.5 symbols/min [2025-10-03T22:40:10.367150] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:10.367218] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:10.367092] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:10.432257] [DEBUG] [LOCAL ] INGM: Loaded 29093 existing records from primary storage. [2025-10-03T22:40:10.432687] [INFO ] [MAIN ] INGM: Loaded 29093 primary data records. [2025-10-03T22:40:10.565997] [DEBUG] [LOCAL ] INGR: Loaded 33949 existing records from primary storage. [2025-10-03T22:40:10.565344] [DEBUG] [LOCAL ] ING: Loaded 51453 existing records from primary storage. [2025-10-03T22:40:10.574693] [INFO ] [MAIN ] INGR: Loaded 33949 primary data records. [2025-10-03T22:40:10.579674] [INFO ] [MAIN ] ING: Loaded 51453 primary data records. [2025-10-03T22:40:11.507229] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:11.510027] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29093 primary records. [2025-10-03T22:40:11.510240] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-03T22:40:11.533871] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-10-03T22:40:11.547424] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-03T22:40:11.550572] [INFO ] [MAIN ] Derivative Progress: 946/2073 symbols completed. INGM took 1.2s. Estimated remaining: 7m 49s. Rate: 144.3 symbols/min [2025-10-03T22:40:11.551876] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:11.551555] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:11.554448] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51453 primary records. [2025-10-03T22:40:11.556509] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-03T22:40:11.582480] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:11.586900] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 33949 primary records. [2025-10-03T22:40:11.587925] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-03T22:40:11.592309] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-10-03T22:40:11.593199] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-03T22:40:11.604056] [INFO ] [MAIN ] Derivative Progress: 947/2073 symbols completed. ING took 1.2s. Estimated remaining: 7m 48s. Rate: 144.4 symbols/min [2025-10-03T22:40:11.608958] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:11.618390] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-10-03T22:40:11.618691] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-03T22:40:11.622320] [INFO ] [MAIN ] Derivative Progress: 948/2073 symbols completed. INGR took 1.3s. Estimated remaining: 7m 47s. Rate: 144.5 symbols/min [2025-10-03T22:40:11.622677] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:11.688769] [DEBUG] [LOCAL ] INN: Loaded 42281 existing records from primary storage. [2025-10-03T22:40:11.689587] [DEBUG] [LOCAL ] INSP: Loaded 37804 existing records from primary storage. [2025-10-03T22:40:11.699727] [INFO ] [MAIN ] INSP: Loaded 37804 primary data records. [2025-10-03T22:40:11.700125] [INFO ] [MAIN ] INN: Loaded 42281 primary data records. [2025-10-03T22:40:11.907475] [DEBUG] [LOCAL ] INSW: Loaded 40456 existing records from primary storage. [2025-10-03T22:40:11.941810] [INFO ] [MAIN ] INSW: Loaded 40456 primary data records. [2025-10-03T22:40:12.828913] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:12.830906] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42281 primary records. [2025-10-03T22:40:12.829733] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:12.831226] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-03T22:40:12.833608] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 37804 primary records. [2025-10-03T22:40:12.842413] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-03T22:40:12.883924] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-10-03T22:40:12.884904] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-03T22:40:12.888932] [INFO ] [MAIN ] Derivative Progress: 949/2073 symbols completed. INN took 1.3s. Estimated remaining: 7m 48s. Rate: 144.2 symbols/min [2025-10-03T22:40:12.884671] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:12.889303] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:12.890947] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40456 primary records. [2025-10-03T22:40:12.891371] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-03T22:40:12.894414] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-10-03T22:40:12.895013] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-03T22:40:12.898623] [INFO ] [MAIN ] Derivative Progress: 950/2073 symbols completed. INSP took 1.3s. Estimated remaining: 7m 47s. Rate: 144.4 symbols/min [2025-10-03T22:40:12.907797] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:12.918040] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-10-03T22:40:12.918249] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-03T22:40:12.921856] [INFO ] [MAIN ] Derivative Progress: 951/2073 symbols completed. INSW took 1.3s. Estimated remaining: 7m 46s. Rate: 144.5 symbols/min [2025-10-03T22:40:12.922259] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:12.962051] [DEBUG] [LOCAL ] INVX: Loaded 29430 existing records from primary storage. [2025-10-03T22:40:12.962238] [INFO ] [MAIN ] INVX: Loaded 29430 primary data records. [2025-10-03T22:40:13.090895] [DEBUG] [LOCAL ] INVH: Loaded 53907 existing records from primary storage. [2025-10-03T22:40:13.095264] [INFO ] [MAIN ] INVH: Loaded 53907 primary data records. [2025-10-03T22:40:13.462898] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-03T22:40:13.474839] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-10-03T22:40:14.116245] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:14.120195] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29430 primary records. [2025-10-03T22:40:14.122278] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-03T22:40:14.152006] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:14.159390] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53907 primary records. [2025-10-03T22:40:14.162289] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-03T22:40:14.162153] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-10-03T22:40:14.164845] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-03T22:40:14.168773] [INFO ] [MAIN ] Derivative Progress: 952/2073 symbols completed. INVX took 1.3s. Estimated remaining: 7m 46s. Rate: 144.2 symbols/min [2025-10-03T22:40:14.189931] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:14.195206] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:14.198751] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-10-03T22:40:14.198999] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-03T22:40:14.225948] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-10-03T22:40:14.226275] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-10-03T22:40:14.226408] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-03T22:40:14.229795] [INFO ] [MAIN ] Derivative Progress: 953/2073 symbols completed. INVH took 1.3s. Estimated remaining: 7m 46s. Rate: 144.3 symbols/min [2025-10-03T22:40:14.226610] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-03T22:40:14.230058] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:14.237733] [INFO ] [MAIN ] Derivative Progress: 954/2073 symbols completed. IONQ took 1.3s. Estimated remaining: 7m 45s. Rate: 144.5 symbols/min [2025-10-03T22:40:14.238636] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:14.295681] [DEBUG] [LOCAL ] IOT: Loaded 54251 existing records from primary storage. [2025-10-03T22:40:14.296224] [INFO ] [MAIN ] IOT: Loaded 54251 primary data records. [2025-10-03T22:40:14.522316] [DEBUG] [LOCAL ] IPG: Loaded 54109 existing records from primary storage. [2025-10-03T22:40:14.529215] [INFO ] [MAIN ] IPG: Loaded 54109 primary data records. [2025-10-03T22:40:14.714901] [DEBUG] [LOCAL ] IP: Loaded 54091 existing records from primary storage. [2025-10-03T22:40:14.761671] [INFO ] [MAIN ] IP: Loaded 54091 primary data records. [2025-10-03T22:40:15.497563] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:15.499694] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54251 primary records. [2025-10-03T22:40:15.500379] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-03T22:40:15.541744] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:15.546073] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-10-03T22:40:15.546234] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-03T22:40:15.545370] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54109 primary records. [2025-10-03T22:40:15.548910] [INFO ] [MAIN ] Derivative Progress: 955/2073 symbols completed. IOT took 1.4s. Estimated remaining: 7m 45s. Rate: 144.2 symbols/min [2025-10-03T22:40:15.546401] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-03T22:40:15.549326] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:15.572480] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:15.578585] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54091 primary records. [2025-10-03T22:40:15.578746] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-03T22:40:15.586721] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-10-03T22:40:15.587036] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-03T22:40:15.590453] [INFO ] [MAIN ] Derivative Progress: 956/2073 symbols completed. IPG took 1.4s. Estimated remaining: 7m 44s. Rate: 144.3 symbols/min [2025-10-03T22:40:15.602097] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:15.623940] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-10-03T22:40:15.624147] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-03T22:40:15.624699] [DEBUG] [LOCAL ] IPI: Loaded 21849 existing records from primary storage. [2025-10-03T22:40:15.628572] [INFO ] [MAIN ] Derivative Progress: 957/2073 symbols completed. IP took 1.4s. Estimated remaining: 7m 44s. Rate: 144.4 symbols/min [2025-10-03T22:40:15.629050] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:15.629311] [INFO ] [MAIN ] IPI: Loaded 21849 primary data records. [2025-10-03T22:40:15.740218] [DEBUG] [LOCAL ] IQI: Loaded 18347 existing records from primary storage. [2025-10-03T22:40:15.763572] [INFO ] [MAIN ] IQI: Loaded 18347 primary data records. [2025-10-03T22:40:16.344614] [DEBUG] [LOCAL ] IQV: Loaded 50838 existing records from primary storage. [2025-10-03T22:40:16.368938] [INFO ] [MAIN ] IQV: Loaded 50838 primary data records. [2025-10-03T22:40:16.719950] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:16.723178] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21849 primary records. [2025-10-03T22:40:16.725289] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-03T22:40:16.752788] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:16.754285] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18347 primary records. [2025-10-03T22:40:16.754470] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-03T22:40:16.779911] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-10-03T22:40:16.780589] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-03T22:40:16.780384] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-10-03T22:40:16.783610] [INFO ] [MAIN ] Derivative Progress: 958/2073 symbols completed. IPI took 1.2s. Estimated remaining: 7m 44s. Rate: 144.2 symbols/min [2025-10-03T22:40:16.784546] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-03T22:40:16.788712] [INFO ] [MAIN ] Derivative Progress: 959/2073 symbols completed. IQI took 1.2s. Estimated remaining: 7m 43s. Rate: 144.3 symbols/min [2025-10-03T22:40:16.806273] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:16.806957] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 50838 primary records. [2025-10-03T22:40:16.807022] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-03T22:40:16.823709] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-10-03T22:40:16.823780] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-03T22:40:16.827401] [INFO ] [MAIN ] Derivative Progress: 960/2073 symbols completed. IQV took 1.2s. Estimated remaining: 7m 42s. Rate: 144.4 symbols/min [2025-10-03T22:40:16.828089] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:16.828353] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:16.828438] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:16.859597] [DEBUG] [LOCAL ] IRS: Loaded 22375 existing records from primary storage. [2025-10-03T22:40:16.859975] [INFO ] [MAIN ] IRS: Loaded 22375 primary data records. [2025-10-03T22:40:17.260531] [DEBUG] [LOCAL ] IRM: Loaded 50029 existing records from primary storage. [2025-10-03T22:40:17.275625] [INFO ] [MAIN ] IRM: Loaded 50029 primary data records. [2025-10-03T22:40:17.276422] [DEBUG] [LOCAL ] IR: Loaded 53466 existing records from primary storage. [2025-10-03T22:40:17.287960] [INFO ] [MAIN ] IR: Loaded 53466 primary data records. [2025-10-03T22:40:17.932870] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:17.935795] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 22375 primary records. [2025-10-03T22:40:17.936089] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-03T22:40:17.958764] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-10-03T22:40:17.959913] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-03T22:40:17.963371] [INFO ] [MAIN ] Derivative Progress: 961/2073 symbols completed. IRS took 1.1s. Estimated remaining: 7m 43s. Rate: 144.2 symbols/min [2025-10-03T22:40:17.963998] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:17.978211] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:17.979467] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 50029 primary records. [2025-10-03T22:40:17.980516] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-03T22:40:18.005903] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:18.009925] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53466 primary records. [2025-10-03T22:40:18.010324] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-03T22:40:18.029555] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-10-03T22:40:18.030157] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-03T22:40:18.034228] [INFO ] [MAIN ] Derivative Progress: 962/2073 symbols completed. IR took 1.2s. Estimated remaining: 7m 42s. Rate: 144.3 symbols/min [2025-10-03T22:40:18.035062] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:18.037403] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-10-03T22:40:18.037512] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-03T22:40:18.039862] [INFO ] [MAIN ] Derivative Progress: 963/2073 symbols completed. IRM took 1.2s. Estimated remaining: 7m 41s. Rate: 144.5 symbols/min [2025-10-03T22:40:18.040047] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:18.069752] [DEBUG] [LOCAL ] ISD: Loaded 15880 existing records from primary storage. [2025-10-03T22:40:18.070772] [INFO ] [MAIN ] ISD: Loaded 15880 primary data records. [2025-10-03T22:40:18.195343] [DEBUG] [LOCAL ] IRT: Loaded 51140 existing records from primary storage. [2025-10-03T22:40:18.206675] [INFO ] [MAIN ] IRT: Loaded 51140 primary data records. [2025-10-03T22:40:18.345759] [DEBUG] [LOCAL ] IT: Loaded 42648 existing records from primary storage. [2025-10-03T22:40:18.469685] [INFO ] [MAIN ] IT: Loaded 42648 primary data records. [2025-10-03T22:40:19.116122] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:19.117983] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 15880 primary records. [2025-10-03T22:40:19.119021] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-03T22:40:19.156566] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:19.158335] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51140 primary records. [2025-10-03T22:40:19.158996] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-03T22:40:19.175631] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-10-03T22:40:19.177906] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-03T22:40:19.180586] [INFO ] [MAIN ] Derivative Progress: 964/2073 symbols completed. ISD took 1.1s. Estimated remaining: 7m 41s. Rate: 144.2 symbols/min [2025-10-03T22:40:19.181829] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:19.184510] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-10-03T22:40:19.184798] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-03T22:40:19.188306] [INFO ] [MAIN ] Derivative Progress: 965/2073 symbols completed. IRT took 1.2s. Estimated remaining: 7m 41s. Rate: 144.3 symbols/min [2025-10-03T22:40:19.191795] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:19.205911] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:19.206754] [INFO ] [MAIN ] IT: Generated 1820 derivative records from 42648 primary records. [2025-10-03T22:40:19.206907] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-03T22:40:19.235836] [DEBUG] [LOCAL ] IT: Derivative data saved (1820 records). [2025-10-03T22:40:19.235917] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-03T22:40:19.239330] [INFO ] [MAIN ] Derivative Progress: 966/2073 symbols completed. IT took 1.2s. Estimated remaining: 7m 40s. Rate: 144.5 symbols/min [2025-10-03T22:40:19.239670] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:19.262387] [DEBUG] [LOCAL ] ITGR: Loaded 31755 existing records from primary storage. [2025-10-03T22:40:19.262726] [INFO ] [MAIN ] ITGR: Loaded 31755 primary data records. [2025-10-03T22:40:19.365064] [DEBUG] [LOCAL ] ITT: Loaded 33181 existing records from primary storage. [2025-10-03T22:40:19.390529] [INFO ] [MAIN ] ITT: Loaded 33181 primary data records. [2025-10-03T22:40:19.748155] [DEBUG] [LOCAL ] ITW: Loaded 46423 existing records from primary storage. [2025-10-03T22:40:19.764513] [INFO ] [MAIN ] ITW: Loaded 46423 primary data records. [2025-10-03T22:40:20.311209] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:20.312710] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:20.314496] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33181 primary records. [2025-10-03T22:40:20.313902] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31755 primary records. [2025-10-03T22:40:20.314986] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-03T22:40:20.315060] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-03T22:40:20.354909] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-10-03T22:40:20.356046] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-03T22:40:20.361034] [INFO ] [MAIN ] Derivative Progress: 967/2073 symbols completed. ITT took 1.2s. Estimated remaining: 7m 40s. Rate: 144.2 symbols/min [2025-10-03T22:40:20.354817] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-10-03T22:40:20.361606] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:20.361884] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-03T22:40:20.365239] [INFO ] [MAIN ] Derivative Progress: 968/2073 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 39s. Rate: 144.4 symbols/min [2025-10-03T22:40:20.365565] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:20.381117] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:20.382236] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46423 primary records. [2025-10-03T22:40:20.382370] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-03T22:40:20.401204] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-10-03T22:40:20.401329] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-03T22:40:20.414367] [INFO ] [MAIN ] Derivative Progress: 969/2073 symbols completed. ITW took 1.2s. Estimated remaining: 7m 38s. Rate: 144.5 symbols/min [2025-10-03T22:40:20.414667] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:20.438638] [DEBUG] [LOCAL ] IVT: Loaded 31154 existing records from primary storage. [2025-10-03T22:40:20.439005] [INFO ] [MAIN ] IVT: Loaded 31154 primary data records. [2025-10-03T22:40:20.561064] [DEBUG] [LOCAL ] IVR: Loaded 48643 existing records from primary storage. [2025-10-03T22:40:20.576956] [INFO ] [MAIN ] IVR: Loaded 48643 primary data records. [2025-10-03T22:40:21.025364] [DEBUG] [LOCAL ] IVZ: Loaded 53906 existing records from primary storage. [2025-10-03T22:40:21.144480] [INFO ] [MAIN ] IVZ: Loaded 53906 primary data records. [2025-10-03T22:40:21.481244] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:21.483990] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31154 primary records. [2025-10-03T22:40:21.484355] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-03T22:40:21.518193] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:21.520175] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48643 primary records. [2025-10-03T22:40:21.521495] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-03T22:40:21.523229] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-10-03T22:40:21.534482] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-03T22:40:21.538762] [INFO ] [MAIN ] Derivative Progress: 970/2073 symbols completed. IVT took 1.2s. Estimated remaining: 7m 39s. Rate: 144.2 symbols/min [2025-10-03T22:40:21.539154] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:21.543867] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-10-03T22:40:21.543955] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-03T22:40:21.546950] [INFO ] [MAIN ] Derivative Progress: 971/2073 symbols completed. IVR took 1.2s. Estimated remaining: 7m 38s. Rate: 144.4 symbols/min [2025-10-03T22:40:21.547191] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:21.565217] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:21.565992] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53906 primary records. [2025-10-03T22:40:21.566119] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-03T22:40:21.591346] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-10-03T22:40:21.591508] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-03T22:40:21.595041] [INFO ] [MAIN ] Derivative Progress: 972/2073 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 37s. Rate: 144.5 symbols/min [2025-10-03T22:40:21.603480] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:21.604703] [DEBUG] [LOCAL ] IX: Loaded 22726 existing records from primary storage. [2025-10-03T22:40:21.604934] [INFO ] [MAIN ] IX: Loaded 22726 primary data records. [2025-10-03T22:40:21.748068] [DEBUG] [LOCAL ] J: Loaded 40756 existing records from primary storage. [2025-10-03T22:40:21.772330] [INFO ] [MAIN ] J: Loaded 40756 primary data records. [2025-10-03T22:40:22.065471] [DEBUG] [LOCAL ] JBGS: Loaded 42986 existing records from primary storage. [2025-10-03T22:40:22.140031] [INFO ] [MAIN ] JBGS: Loaded 42986 primary data records. [2025-10-03T22:40:22.666121] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:22.668082] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22726 primary records. [2025-10-03T22:40:22.668288] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-03T22:40:22.702388] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:22.704010] [INFO ] [MAIN ] J: Generated 1820 derivative records from 40756 primary records. [2025-10-03T22:40:22.704392] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-03T22:40:22.714250] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-10-03T22:40:22.717873] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-03T22:40:22.721595] [INFO ] [MAIN ] Derivative Progress: 973/2073 symbols completed. IX took 1.2s. Estimated remaining: 7m 37s. Rate: 144.3 symbols/min [2025-10-03T22:40:22.725869] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-10-03T22:40:22.727562] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-03T22:40:22.731360] [INFO ] [MAIN ] Derivative Progress: 974/2073 symbols completed. J took 1.2s. Estimated remaining: 7m 37s. Rate: 144.4 symbols/min [2025-10-03T22:40:22.744423] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:22.745036] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 42986 primary records. [2025-10-03T22:40:22.745107] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-03T22:40:22.761521] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-10-03T22:40:22.761605] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-03T22:40:22.765417] [INFO ] [MAIN ] Derivative Progress: 975/2073 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 36s. Rate: 144.6 symbols/min [2025-10-03T22:40:22.765933] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:22.766051] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:22.766175] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:22.810892] [DEBUG] [LOCAL ] JBND: Loaded 26559 existing records from primary storage. [2025-10-03T22:40:22.811155] [INFO ] [MAIN ] JBND: Loaded 26559 primary data records. [2025-10-03T22:40:22.922534] [DEBUG] [LOCAL ] JBL: Loaded 49138 existing records from primary storage. [2025-10-03T22:40:22.935454] [INFO ] [MAIN ] JBL: Loaded 49138 primary data records. [2025-10-03T22:40:23.108490] [DEBUG] [LOCAL ] JBI: Loaded 44153 existing records from primary storage. [2025-10-03T22:40:23.147922] [INFO ] [MAIN ] JBI: Loaded 44153 primary data records. [2025-10-03T22:40:23.878227] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:23.879549] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 26559 primary records. [2025-10-03T22:40:23.880250] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-03T22:40:23.914989] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:23.917640] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49138 primary records. [2025-10-03T22:40:23.918787] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-03T22:40:23.921682] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-10-03T22:40:23.922183] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-03T22:40:23.924598] [INFO ] [MAIN ] Derivative Progress: 976/2073 symbols completed. JBND took 1.2s. Estimated remaining: 7m 36s. Rate: 144.3 symbols/min [2025-10-03T22:40:23.924973] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:23.956994] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:23.958105] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 44153 primary records. [2025-10-03T22:40:23.958789] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-03T22:40:23.986273] [DEBUG] [LOCAL ] JCE: Loaded 6994 existing records from primary storage. [2025-10-03T22:40:23.986738] [INFO ] [MAIN ] JCE: Loaded 6994 primary data records. [2025-10-03T22:40:23.987582] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-10-03T22:40:24.025944] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-03T22:40:24.042106] [INFO ] [MAIN ] Derivative Progress: 977/2073 symbols completed. JBI took 1.3s. Estimated remaining: 7m 35s. Rate: 144.4 symbols/min [2025-10-03T22:40:24.026135] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-10-03T22:40:24.071170] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-03T22:40:24.098297] [INFO ] [MAIN ] Derivative Progress: 978/2073 symbols completed. JBL took 1.3s. Estimated remaining: 7m 35s. Rate: 144.5 symbols/min [2025-10-03T22:40:24.090943] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:24.099170] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:24.357536] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:24.358624] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 6994 primary records. [2025-10-03T22:40:24.372695] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-03T22:40:24.390082] [DEBUG] [LOCAL ] JEF: Loaded 50784 existing records from primary storage. [2025-10-03T22:40:24.390552] [INFO ] [MAIN ] JEF: Loaded 50784 primary data records. [2025-10-03T22:40:24.398364] [DEBUG] [LOCAL ] JCI: Loaded 54318 existing records from primary storage. [2025-10-03T22:40:24.436068] [INFO ] [MAIN ] JCI: Loaded 54318 primary data records. [2025-10-03T22:40:24.628411] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-10-03T22:40:24.660605] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-03T22:40:24.680541] [INFO ] [MAIN ] Derivative Progress: 979/2073 symbols completed. JCE took 0.8s. Estimated remaining: 7m 34s. Rate: 144.5 symbols/min [2025-10-03T22:40:24.681240] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:25.128237] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:25.127347] [DEBUG] [LOCAL ] JELD: Loaded 46721 existing records from primary storage. [2025-10-03T22:40:25.128571] [INFO ] [MAIN ] JELD: Loaded 46721 primary data records. [2025-10-03T22:40:25.129723] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50784 primary records. [2025-10-03T22:40:25.135129] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-03T22:40:25.235419] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:25.269140] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54318 primary records. [2025-10-03T22:40:25.270346] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-03T22:40:25.270226] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-10-03T22:40:25.274064] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-03T22:40:25.276809] [INFO ] [MAIN ] Derivative Progress: 980/2073 symbols completed. JEF took 1.2s. Estimated remaining: 7m 34s. Rate: 144.4 symbols/min [2025-10-03T22:40:25.283297] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:25.500102] [DEBUG] [LOCAL ] JEQ: Loaded 8975 existing records from primary storage. [2025-10-03T22:40:25.500937] [INFO ] [MAIN ] JEQ: Loaded 8975 primary data records. [2025-10-03T22:40:25.535071] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-10-03T22:40:25.560998] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-03T22:40:25.592481] [INFO ] [MAIN ] Derivative Progress: 981/2073 symbols completed. JCI took 1.5s. Estimated remaining: 7m 34s. Rate: 144.4 symbols/min [2025-10-03T22:40:25.618437] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:25.848869] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:25.850250] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46721 primary records. [2025-10-03T22:40:25.850504] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-03T22:40:25.887386] [DEBUG] [LOCAL ] JFR: Loaded 31302 existing records from primary storage. [2025-10-03T22:40:25.888423] [INFO ] [MAIN ] JFR: Loaded 31302 primary data records. [2025-10-03T22:40:25.888585] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-10-03T22:40:25.893821] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-03T22:40:25.913065] [INFO ] [MAIN ] Derivative Progress: 982/2073 symbols completed. JELD took 1.2s. Estimated remaining: 7m 33s. Rate: 144.5 symbols/min [2025-10-03T22:40:25.960110] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:26.101545] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:26.127559] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 8975 primary records. [2025-10-03T22:40:26.198803] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-03T22:40:26.224987] [DEBUG] [LOCAL ] JGH: Loaded 11242 existing records from primary storage. [2025-10-03T22:40:26.225192] [INFO ] [MAIN ] JGH: Loaded 11242 primary data records. [2025-10-03T22:40:26.366812] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-10-03T22:40:26.378158] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-03T22:40:26.431579] [INFO ] [MAIN ] Derivative Progress: 983/2073 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 33s. Rate: 144.4 symbols/min [2025-10-03T22:40:26.547953] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:26.570032] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:26.570989] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 31302 primary records. [2025-10-03T22:40:26.571263] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-03T22:40:26.588895] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-10-03T22:40:26.589144] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-03T22:40:26.591507] [INFO ] [MAIN ] Derivative Progress: 984/2073 symbols completed. JFR took 1.0s. Estimated remaining: 7m 32s. Rate: 144.5 symbols/min [2025-10-03T22:40:26.591805] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:26.612404] [DEBUG] [LOCAL ] JHI: Loaded 3638 existing records from primary storage. [2025-10-03T22:40:26.612575] [INFO ] [MAIN ] JHI: Loaded 3638 primary data records. [2025-10-03T22:40:26.677474] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:26.749250] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 11242 primary records. [2025-10-03T22:40:26.767113] [DEBUG] [LOCAL ] JHG: Loaded 48335 existing records from primary storage. [2025-10-03T22:40:26.767314] [INFO ] [MAIN ] JHG: Loaded 48335 primary data records. [2025-10-03T22:40:26.767396] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-03T22:40:27.214047] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-10-03T22:40:27.214673] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-03T22:40:27.217567] [INFO ] [MAIN ] Derivative Progress: 985/2073 symbols completed. JGH took 1.3s. Estimated remaining: 7m 32s. Rate: 144.4 symbols/min [2025-10-03T22:40:27.332805] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:27.343723] [DEBUG] [LOCAL ] JHS: Loaded 2882 existing records from primary storage. [2025-10-03T22:40:27.344887] [INFO ] [MAIN ] JHS: Loaded 2882 primary data records. [2025-10-03T22:40:27.516096] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:27.569922] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3638 primary records. [2025-10-03T22:40:27.570275] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-03T22:40:27.731761] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:27.735374] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48335 primary records. [2025-10-03T22:40:27.736854] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-03T22:40:27.753452] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-10-03T22:40:27.756846] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-03T22:40:27.759558] [INFO ] [MAIN ] Derivative Progress: 986/2073 symbols completed. JHI took 1.2s. Estimated remaining: 7m 32s. Rate: 144.4 symbols/min [2025-10-03T22:40:27.759814] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:27.761508] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-10-03T22:40:27.763085] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-03T22:40:27.766335] [INFO ] [MAIN ] Derivative Progress: 987/2073 symbols completed. JHG took 1.2s. Estimated remaining: 7m 31s. Rate: 144.5 symbols/min [2025-10-03T22:40:27.766767] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:27.788988] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:27.794530] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2882 primary records. [2025-10-03T22:40:27.794731] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-03T22:40:27.814282] [DEBUG] [LOCAL ] JILL: Loaded 16861 existing records from primary storage. [2025-10-03T22:40:27.815266] [INFO ] [MAIN ] JILL: Loaded 16861 primary data records. [2025-10-03T22:40:27.892375] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-10-03T22:40:27.913886] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-03T22:40:27.922235] [INFO ] [MAIN ] Derivative Progress: 988/2073 symbols completed. JHS took 0.6s. Estimated remaining: 7m 30s. Rate: 144.6 symbols/min [2025-10-03T22:40:27.987956] [DEBUG] [LOCAL ] JHX: Loaded 52661 existing records from primary storage. [2025-10-03T22:40:28.009898] [INFO ] [MAIN ] JHX: Loaded 52661 primary data records. [2025-10-03T22:40:28.494829] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:28.496969] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16861 primary records. [2025-10-03T22:40:28.497271] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-03T22:40:28.516285] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-10-03T22:40:28.516497] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-03T22:40:28.519483] [INFO ] [MAIN ] Derivative Progress: 989/2073 symbols completed. JILL took 0.8s. Estimated remaining: 7m 30s. Rate: 144.6 symbols/min [2025-10-03T22:40:28.537325] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:28.538046] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 52661 primary records. [2025-10-03T22:40:28.538110] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-03T22:40:28.554506] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-10-03T22:40:28.554578] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-03T22:40:28.557967] [INFO ] [MAIN ] Derivative Progress: 990/2073 symbols completed. JHX took 0.8s. Estimated remaining: 7m 29s. Rate: 144.7 symbols/min [2025-10-03T22:40:28.558810] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:28.558734] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:28.559042] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:28.569373] [DEBUG] [LOCAL ] JLS: Loaded 4193 existing records from primary storage. [2025-10-03T22:40:28.569594] [INFO ] [MAIN ] JLS: Loaded 4193 primary data records. [2025-10-03T22:40:28.740753] [DEBUG] [LOCAL ] JLL: Loaded 31853 existing records from primary storage. [2025-10-03T22:40:28.761635] [INFO ] [MAIN ] JLL: Loaded 31853 primary data records. [2025-10-03T22:40:29.099461] [DEBUG] [LOCAL ] JKS: Loaded 40657 existing records from primary storage. [2025-10-03T22:40:29.104458] [INFO ] [MAIN ] JKS: Loaded 40657 primary data records. [2025-10-03T22:40:29.669747] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:29.671562] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4193 primary records. [2025-10-03T22:40:29.671857] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-03T22:40:29.706134] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:29.709287] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 31853 primary records. [2025-10-03T22:40:29.709739] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-03T22:40:29.712852] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-10-03T22:40:29.713236] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-03T22:40:29.716497] [INFO ] [MAIN ] Derivative Progress: 991/2073 symbols completed. JLS took 1.2s. Estimated remaining: 7m 29s. Rate: 144.4 symbols/min [2025-10-03T22:40:29.724481] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:29.736200] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-10-03T22:40:29.737856] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-03T22:40:29.740845] [INFO ] [MAIN ] Derivative Progress: 992/2073 symbols completed. JLL took 1.2s. Estimated remaining: 7m 29s. Rate: 144.6 symbols/min [2025-10-03T22:40:29.741083] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:29.756692] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:29.757732] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40657 primary records. [2025-10-03T22:40:29.757821] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-03T22:40:29.776446] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-10-03T22:40:29.776699] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-03T22:40:29.779785] [INFO ] [MAIN ] Derivative Progress: 993/2073 symbols completed. JKS took 1.2s. Estimated remaining: 7m 28s. Rate: 144.7 symbols/min [2025-10-03T22:40:29.780037] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:29.837613] [DEBUG] [LOCAL ] JMIA: Loaded 51428 existing records from primary storage. [2025-10-03T22:40:29.837934] [INFO ] [MAIN ] JMIA: Loaded 51428 primary data records. [2025-10-03T22:40:29.984635] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-03T22:40:29.990224] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-10-03T22:40:30.151553] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-10-03T22:40:30.166827] [INFO ] [MAIN ] JOBY: Loaded 54579 primary data records. [2025-10-03T22:40:30.916631] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:30.917553] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51428 primary records. [2025-10-03T22:40:30.920761] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-03T22:40:30.952195] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-10-03T22:40:30.953298] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:30.952831] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-03T22:40:30.955664] [INFO ] [MAIN ] Derivative Progress: 994/2073 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 28s. Rate: 144.4 symbols/min [2025-10-03T22:40:30.956964] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-10-03T22:40:30.955925] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:30.957276] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-03T22:40:30.988455] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:30.989969] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54579 primary records. [2025-10-03T22:40:30.990371] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-03T22:40:30.992236] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-10-03T22:40:30.998096] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-03T22:40:31.001113] [INFO ] [MAIN ] Derivative Progress: 995/2073 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 27s. Rate: 144.6 symbols/min [2025-10-03T22:40:31.008550] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:31.026233] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-10-03T22:40:31.026852] [DEBUG] [LOCAL ] JOE: Loaded 24485 existing records from primary storage. [2025-10-03T22:40:31.026956] [INFO ] [MAIN ] JOE: Loaded 24485 primary data records. [2025-10-03T22:40:31.028761] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-03T22:40:31.068793] [INFO ] [MAIN ] Derivative Progress: 996/2073 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 27s. Rate: 144.7 symbols/min [2025-10-03T22:40:31.124156] [DEBUG] [LOCAL ] JOF: Loaded 7072 existing records from primary storage. [2025-10-03T22:40:31.123865] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:31.142088] [INFO ] [MAIN ] JOF: Loaded 7072 primary data records. [2025-10-03T22:40:31.681365] [DEBUG] [LOCAL ] JPC: Loaded 37668 existing records from primary storage. [2025-10-03T22:40:31.681751] [INFO ] [MAIN ] JPC: Loaded 37668 primary data records. [2025-10-03T22:40:32.015478] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:32.017036] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24485 primary records. [2025-10-03T22:40:32.018126] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-03T22:40:32.052393] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-10-03T22:40:32.053133] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:32.053257] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-03T22:40:32.057103] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 7072 primary records. [2025-10-03T22:40:32.056090] [INFO ] [MAIN ] Derivative Progress: 997/2073 symbols completed. JOE took 1.1s. Estimated remaining: 7m 27s. Rate: 144.5 symbols/min [2025-10-03T22:40:32.057575] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-03T22:40:32.067332] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:32.076710] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-10-03T22:40:32.079365] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-03T22:40:32.082670] [INFO ] [MAIN ] Derivative Progress: 998/2073 symbols completed. JOF took 1.1s. Estimated remaining: 7m 26s. Rate: 144.6 symbols/min [2025-10-03T22:40:32.082970] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:32.097208] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:32.098091] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37668 primary records. [2025-10-03T22:40:32.098191] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-03T22:40:32.114263] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-10-03T22:40:32.114421] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-03T22:40:32.116999] [INFO ] [MAIN ] Derivative Progress: 999/2073 symbols completed. JPC took 1.0s. Estimated remaining: 7m 25s. Rate: 144.8 symbols/min [2025-10-03T22:40:32.117224] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:32.155410] [DEBUG] [LOCAL ] JRI: Loaded 15135 existing records from primary storage. [2025-10-03T22:40:32.155602] [INFO ] [MAIN ] JRI: Loaded 15135 primary data records. [2025-10-03T22:40:32.276572] [DEBUG] [LOCAL ] JQC: Loaded 34960 existing records from primary storage. [2025-10-03T22:40:32.289101] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-03T22:40:32.289269] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-10-03T22:40:32.289362] [INFO ] [MAIN ] JQC: Loaded 34960 primary data records. [2025-10-03T22:40:33.217955] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:33.218961] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15135 primary records. [2025-10-03T22:40:33.221022] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-03T22:40:33.253610] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:33.267346] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-10-03T22:40:33.268810] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:33.268262] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34960 primary records. [2025-10-03T22:40:33.269798] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-03T22:40:33.269720] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-10-03T22:40:33.269012] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-03T22:40:33.270918] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-03T22:40:33.273630] [INFO ] [MAIN ] Derivative Progress: 1000/2073 symbols completed. JRI took 1.2s. Estimated remaining: 7m 26s. Rate: 144.5 symbols/min [2025-10-03T22:40:33.274554] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:33.305926] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-10-03T22:40:33.306036] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-03T22:40:33.308815] [INFO ] [MAIN ] Derivative Progress: 1001/2073 symbols completed. JPM took 1.2s. Estimated remaining: 7m 25s. Rate: 144.6 symbols/min [2025-10-03T22:40:33.309070] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:33.310778] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-10-03T22:40:33.313885] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-03T22:40:33.318588] [INFO ] [MAIN ] Derivative Progress: 1002/2073 symbols completed. JQC took 1.2s. Estimated remaining: 7m 24s. Rate: 144.8 symbols/min [2025-10-03T22:40:33.319007] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:33.325577] [DEBUG] [LOCAL ] JRS: Loaded 11561 existing records from primary storage. [2025-10-03T22:40:33.325756] [INFO ] [MAIN ] JRS: Loaded 11561 primary data records. [2025-10-03T22:40:33.738956] [DEBUG] [LOCAL ] JXN: Loaded 46137 existing records from primary storage. [2025-10-03T22:40:33.740124] [DEBUG] [LOCAL ] K: Loaded 50735 existing records from primary storage. [2025-10-03T22:40:33.741872] [INFO ] [MAIN ] K: Loaded 50735 primary data records. [2025-10-03T22:40:33.741984] [INFO ] [MAIN ] JXN: Loaded 46137 primary data records. [2025-10-03T22:40:34.436353] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:34.448463] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11561 primary records. [2025-10-03T22:40:34.448674] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-03T22:40:34.468945] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-10-03T22:40:34.469348] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-03T22:40:34.472525] [INFO ] [MAIN ] Derivative Progress: 1003/2073 symbols completed. JRS took 1.2s. Estimated remaining: 7m 24s. Rate: 144.5 symbols/min [2025-10-03T22:40:34.513423] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:34.514945] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50735 primary records. [2025-10-03T22:40:34.513828] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:34.515948] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 46137 primary records. [2025-10-03T22:40:34.515130] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-03T22:40:34.516952] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-03T22:40:34.545116] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-10-03T22:40:34.546811] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-03T22:40:34.549982] [INFO ] [MAIN ] Derivative Progress: 1004/2073 symbols completed. K took 1.2s. Estimated remaining: 7m 23s. Rate: 144.6 symbols/min [2025-10-03T22:40:34.552270] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-10-03T22:40:34.552378] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-03T22:40:34.555568] [INFO ] [MAIN ] Derivative Progress: 1005/2073 symbols completed. JXN took 1.2s. Estimated remaining: 7m 23s. Rate: 144.8 symbols/min [2025-10-03T22:40:34.556441] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:34.556304] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:34.556141] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:34.574534] [DEBUG] [LOCAL ] KAI: Loaded 13475 existing records from primary storage. [2025-10-03T22:40:34.574773] [INFO ] [MAIN ] KAI: Loaded 13475 primary data records. [2025-10-03T22:40:34.710308] [DEBUG] [LOCAL ] KB: Loaded 24181 existing records from primary storage. [2025-10-03T22:40:34.746375] [INFO ] [MAIN ] KB: Loaded 24181 primary data records. [2025-10-03T22:40:34.795782] [DEBUG] [LOCAL ] KAR: Loaded 40570 existing records from primary storage. [2025-10-03T22:40:34.879601] [INFO ] [MAIN ] KAR: Loaded 40570 primary data records. [2025-10-03T22:40:35.732192] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:35.733632] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13475 primary records. [2025-10-03T22:40:35.733806] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-03T22:40:35.755964] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-10-03T22:40:35.756722] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-03T22:40:35.759421] [INFO ] [MAIN ] Derivative Progress: 1006/2073 symbols completed. KAI took 1.2s. Estimated remaining: 7m 23s. Rate: 144.5 symbols/min [2025-10-03T22:40:35.760080] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:35.775765] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:35.776822] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 24181 primary records. [2025-10-03T22:40:35.777148] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-03T22:40:35.798823] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-10-03T22:40:35.799452] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-03T22:40:35.810140] [INFO ] [MAIN ] Derivative Progress: 1007/2073 symbols completed. KB took 1.3s. Estimated remaining: 7m 22s. Rate: 144.6 symbols/min [2025-10-03T22:40:35.820968] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:35.822019] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:35.822982] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40570 primary records. [2025-10-03T22:40:35.823116] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-03T22:40:35.844937] [DEBUG] [LOCAL ] KBDC: Loaded 21640 existing records from primary storage. [2025-10-03T22:40:35.845681] [INFO ] [MAIN ] KBDC: Loaded 21640 primary data records. [2025-10-03T22:40:35.954990] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-10-03T22:40:35.966532] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-03T22:40:35.971287] [INFO ] [MAIN ] Derivative Progress: 1008/2073 symbols completed. KAR took 1.4s. Estimated remaining: 7m 22s. Rate: 144.7 symbols/min [2025-10-03T22:40:35.976977] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:36.221987] [DEBUG] [LOCAL ] KBH: Loaded 49576 existing records from primary storage. [2025-10-03T22:40:36.222806] [INFO ] [MAIN ] KBH: Loaded 49576 primary data records. [2025-10-03T22:40:36.480855] [DEBUG] [LOCAL ] KBR: Loaded 48697 existing records from primary storage. [2025-10-03T22:40:36.489408] [INFO ] [MAIN ] KBR: Loaded 48697 primary data records. [2025-10-03T22:40:36.775722] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:36.792484] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 21640 primary records. [2025-10-03T22:40:36.825345] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-03T22:40:36.997369] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-10-03T22:40:36.998351] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-03T22:40:37.001949] [INFO ] [MAIN ] Derivative Progress: 1009/2073 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 22s. Rate: 144.5 symbols/min [2025-10-03T22:40:37.002291] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:37.022121] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:37.023155] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49576 primary records. [2025-10-03T22:40:37.023324] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-03T22:40:37.042009] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-10-03T22:40:37.042246] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-03T22:40:37.045633] [INFO ] [MAIN ] Derivative Progress: 1010/2073 symbols completed. KBH took 1.2s. Estimated remaining: 7m 21s. Rate: 144.6 symbols/min [2025-10-03T22:40:37.045997] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:37.060503] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:37.061405] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48697 primary records. [2025-10-03T22:40:37.061564] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-03T22:40:37.095016] [DEBUG] [LOCAL ] KEN: Loaded 4758 existing records from primary storage. [2025-10-03T22:40:37.095975] [INFO ] [MAIN ] KEN: Loaded 4758 primary data records. [2025-10-03T22:40:37.153235] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-10-03T22:40:37.174380] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-03T22:40:37.204180] [INFO ] [MAIN ] Derivative Progress: 1011/2073 symbols completed. KBR took 1.2s. Estimated remaining: 7m 20s. Rate: 144.7 symbols/min [2025-10-03T22:40:37.218830] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:37.235610] [DEBUG] [LOCAL ] KD: Loaded 53067 existing records from primary storage. [2025-10-03T22:40:37.275423] [INFO ] [MAIN ] KD: Loaded 53067 primary data records. [2025-10-03T22:40:37.664386] [DEBUG] [LOCAL ] KEP: Loaded 31512 existing records from primary storage. [2025-10-03T22:40:37.664815] [INFO ] [MAIN ] KEP: Loaded 31512 primary data records. [2025-10-03T22:40:38.129338] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:38.132135] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4758 primary records. [2025-10-03T22:40:38.132348] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-03T22:40:38.165787] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-10-03T22:40:38.166421] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-03T22:40:38.168132] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:38.172524] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53067 primary records. [2025-10-03T22:40:38.172988] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-03T22:40:38.171205] [INFO ] [MAIN ] Derivative Progress: 1012/2073 symbols completed. KEN took 1.1s. Estimated remaining: 7m 20s. Rate: 144.5 symbols/min [2025-10-03T22:40:38.173593] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:38.196547] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-10-03T22:40:38.196810] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-03T22:40:38.199920] [INFO ] [MAIN ] Derivative Progress: 1013/2073 symbols completed. KD took 1.2s. Estimated remaining: 7m 20s. Rate: 144.7 symbols/min [2025-10-03T22:40:38.213100] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:38.213903] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:38.215359] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 31512 primary records. [2025-10-03T22:40:38.215446] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-03T22:40:38.247377] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-10-03T22:40:38.247605] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-03T22:40:38.251157] [INFO ] [MAIN ] Derivative Progress: 1014/2073 symbols completed. KEP took 1.0s. Estimated remaining: 7m 19s. Rate: 144.8 symbols/min [2025-10-03T22:40:38.251527] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:38.270010] [DEBUG] [LOCAL ] KF: Loaded 2509 existing records from primary storage. [2025-10-03T22:40:38.270391] [INFO ] [MAIN ] KF: Loaded 2509 primary data records. [2025-10-03T22:40:38.282759] [DEBUG] [LOCAL ] KEX: Loaded 38713 existing records from primary storage. [2025-10-03T22:40:38.283003] [INFO ] [MAIN ] KEX: Loaded 38713 primary data records. [2025-10-03T22:40:38.596323] [DEBUG] [LOCAL ] KEYS: Loaded 43769 existing records from primary storage. [2025-10-03T22:40:38.618860] [INFO ] [MAIN ] KEYS: Loaded 43769 primary data records. [2025-10-03T22:40:39.353961] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:39.356061] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 38713 primary records. [2025-10-03T22:40:39.356278] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-03T22:40:39.369479] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:39.370331] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2509 primary records. [2025-10-03T22:40:39.370426] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-03T22:40:39.399954] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-10-03T22:40:39.403190] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-03T22:40:39.406242] [INFO ] [MAIN ] Derivative Progress: 1015/2073 symbols completed. KF took 1.2s. Estimated remaining: 7m 19s. Rate: 144.5 symbols/min [2025-10-03T22:40:39.406470] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:39.410860] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-10-03T22:40:39.423258] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-03T22:40:39.426845] [INFO ] [MAIN ] Derivative Progress: 1016/2073 symbols completed. KEX took 1.3s. Estimated remaining: 7m 18s. Rate: 144.7 symbols/min [2025-10-03T22:40:39.427199] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:39.427669] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:39.428521] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 43769 primary records. [2025-10-03T22:40:39.428728] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-03T22:40:39.446337] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-10-03T22:40:39.449173] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-03T22:40:39.452537] [INFO ] [MAIN ] Derivative Progress: 1017/2073 symbols completed. KEYS took 1.2s. Estimated remaining: 7m 18s. Rate: 144.8 symbols/min [2025-10-03T22:40:39.452839] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:39.464015] [DEBUG] [LOCAL ] KFS: Loaded 8567 existing records from primary storage. [2025-10-03T22:40:39.464240] [INFO ] [MAIN ] KFS: Loaded 8567 primary data records. [2025-10-03T22:40:39.518344] [DEBUG] [LOCAL ] KFRC: Loaded 19888 existing records from primary storage. [2025-10-03T22:40:39.562329] [INFO ] [MAIN ] KFRC: Loaded 19888 primary data records. [2025-10-03T22:40:39.762456] [DEBUG] [LOCAL ] KFY: Loaded 30424 existing records from primary storage. [2025-10-03T22:40:39.783748] [INFO ] [MAIN ] KFY: Loaded 30424 primary data records. [2025-10-03T22:40:40.501681] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:40:40.504212] [INFO ] [MAIN ] KFS: Generated 1819 derivative records from 8567 primary records. [2025-10-03T22:40:40.505396] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-03T22:40:40.523820] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:40.535722] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 19888 primary records. [2025-10-03T22:40:40.536436] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-03T22:40:40.559206] [DEBUG] [LOCAL ] KFS: Derivative data saved (1819 records). [2025-10-03T22:40:40.560268] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-03T22:40:40.563381] [INFO ] [MAIN ] Derivative Progress: 1018/2073 symbols completed. KFS took 1.1s. Estimated remaining: 7m 18s. Rate: 144.6 symbols/min [2025-10-03T22:40:40.563678] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-10-03T22:40:40.563924] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-03T22:40:40.568233] [INFO ] [MAIN ] Derivative Progress: 1019/2073 symbols completed. KFRC took 1.2s. Estimated remaining: 7m 17s. Rate: 144.7 symbols/min [2025-10-03T22:40:40.581346] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:40.581999] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 30424 primary records. [2025-10-03T22:40:40.582063] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-03T22:40:40.597751] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-10-03T22:40:40.597859] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-03T22:40:40.602015] [INFO ] [MAIN ] Derivative Progress: 1020/2073 symbols completed. KFY took 1.1s. Estimated remaining: 7m 16s. Rate: 144.8 symbols/min [2025-10-03T22:40:40.602430] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:40.602578] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:40.602538] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:40.652524] [DEBUG] [LOCAL ] KGS: Loaded 46368 existing records from primary storage. [2025-10-03T22:40:40.652916] [INFO ] [MAIN ] KGS: Loaded 46368 primary data records. [2025-10-03T22:40:41.011861] [DEBUG] [LOCAL ] KIM: Loaded 53806 existing records from primary storage. [2025-10-03T22:40:41.025349] [INFO ] [MAIN ] KIM: Loaded 53806 primary data records. [2025-10-03T22:40:41.049457] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-03T22:40:41.072118] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-10-03T22:40:41.725582] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:41.727317] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46368 primary records. [2025-10-03T22:40:41.728308] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-03T22:40:41.746328] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-10-03T22:40:41.746614] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-03T22:40:41.749957] [INFO ] [MAIN ] Derivative Progress: 1021/2073 symbols completed. KGS took 1.1s. Estimated remaining: 7m 17s. Rate: 144.6 symbols/min [2025-10-03T22:40:41.750506] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:41.772972] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:41.791764] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:41.791462] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53806 primary records. [2025-10-03T22:40:41.792525] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-10-03T22:40:41.792749] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-03T22:40:41.791961] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-03T22:40:41.826606] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-10-03T22:40:41.830568] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-03T22:40:41.834232] [INFO ] [MAIN ] Derivative Progress: 1022/2073 symbols completed. KGC took 1.2s. Estimated remaining: 7m 16s. Rate: 144.7 symbols/min [2025-10-03T22:40:41.834852] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:41.835771] [DEBUG] [LOCAL ] KIO: Loaded 21612 existing records from primary storage. [2025-10-03T22:40:41.837400] [INFO ] [MAIN ] KIO: Loaded 21612 primary data records. [2025-10-03T22:40:41.906469] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-10-03T22:40:41.912397] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-03T22:40:41.927262] [INFO ] [MAIN ] Derivative Progress: 1023/2073 symbols completed. KIM took 1.3s. Estimated remaining: 7m 15s. Rate: 144.8 symbols/min [2025-10-03T22:40:41.939841] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:42.166311] [DEBUG] [LOCAL ] KKRS: Loaded 5753 existing records from primary storage. [2025-10-03T22:40:42.180553] [INFO ] [MAIN ] KKRS: Loaded 5753 primary data records. [2025-10-03T22:40:42.311933] [DEBUG] [LOCAL ] KKR: Loaded 54280 existing records from primary storage. [2025-10-03T22:40:42.312178] [INFO ] [MAIN ] KKR: Loaded 54280 primary data records. [2025-10-03T22:40:42.855384] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:42.857313] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21612 primary records. [2025-10-03T22:40:42.857777] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-03T22:40:42.878169] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-10-03T22:40:42.878435] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-03T22:40:42.881703] [INFO ] [MAIN ] Derivative Progress: 1024/2073 symbols completed. KIO took 1.1s. Estimated remaining: 7m 15s. Rate: 144.6 symbols/min [2025-10-03T22:40:42.882350] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:42.903156] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:42.904678] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5753 primary records. [2025-10-03T22:40:42.904867] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-03T22:40:42.951613] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:42.952893] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54280 primary records. [2025-10-03T22:40:42.953933] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-03T22:40:42.958457] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-10-03T22:40:42.975527] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-03T22:40:42.981170] [INFO ] [MAIN ] Derivative Progress: 1025/2073 symbols completed. KKRS took 1.0s. Estimated remaining: 7m 14s. Rate: 144.7 symbols/min [2025-10-03T22:40:42.984209] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:42.989689] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-10-03T22:40:42.988143] [DEBUG] [LOCAL ] KLC: Loaded 37278 existing records from primary storage. [2025-10-03T22:40:42.990017] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-03T22:40:42.993173] [INFO ] [MAIN ] Derivative Progress: 1026/2073 symbols completed. KKR took 1.2s. Estimated remaining: 7m 14s. Rate: 144.9 symbols/min [2025-10-03T22:40:42.993275] [INFO ] [MAIN ] KLC: Loaded 37278 primary data records. [2025-10-03T22:40:42.993570] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:43.076041] [DEBUG] [LOCAL ] KMPB: Loaded 3810 existing records from primary storage. [2025-10-03T22:40:43.088101] [INFO ] [MAIN ] KMPB: Loaded 3810 primary data records. [2025-10-03T22:40:43.533777] [DEBUG] [LOCAL ] KMPR: Loaded 39497 existing records from primary storage. [2025-10-03T22:40:43.553548] [INFO ] [MAIN ] KMPR: Loaded 39497 primary data records. [2025-10-03T22:40:44.012287] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:44.014690] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37278 primary records. [2025-10-03T22:40:44.015043] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-03T22:40:44.046332] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-10-03T22:40:44.047107] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:40:44.047435] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-03T22:40:44.048257] [INFO ] [MAIN ] KMPB: Generated 1819 derivative records from 3810 primary records. [2025-10-03T22:40:44.048396] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-03T22:40:44.050945] [INFO ] [MAIN ] Derivative Progress: 1027/2073 symbols completed. KLC took 1.2s. Estimated remaining: 7m 14s. Rate: 144.7 symbols/min [2025-10-03T22:40:44.051163] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:44.078661] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1819 records). [2025-10-03T22:40:44.083424] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-03T22:40:44.086760] [INFO ] [MAIN ] Derivative Progress: 1028/2073 symbols completed. KMPB took 1.1s. Estimated remaining: 7m 13s. Rate: 144.8 symbols/min [2025-10-03T22:40:44.087111] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:44.087310] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:44.091705] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 39497 primary records. [2025-10-03T22:40:44.092225] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-03T22:40:44.110006] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-10-03T22:40:44.110150] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-03T22:40:44.113475] [INFO ] [MAIN ] Derivative Progress: 1029/2073 symbols completed. KMPR took 1.1s. Estimated remaining: 7m 12s. Rate: 144.9 symbols/min [2025-10-03T22:40:44.113778] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:44.145692] [DEBUG] [LOCAL ] KMT: Loaded 43553 existing records from primary storage. [2025-10-03T22:40:44.145939] [INFO ] [MAIN ] KMT: Loaded 43553 primary data records. [2025-10-03T22:40:44.347742] [DEBUG] [LOCAL ] KMX: Loaded 53938 existing records from primary storage. [2025-10-03T22:40:44.388237] [INFO ] [MAIN ] KMX: Loaded 53938 primary data records. [2025-10-03T22:40:44.388910] [DEBUG] [LOCAL ] KN: Loaded 39160 existing records from primary storage. [2025-10-03T22:40:44.509897] [INFO ] [MAIN ] KN: Loaded 39160 primary data records. [2025-10-03T22:40:45.149783] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:45.151192] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43553 primary records. [2025-10-03T22:40:45.151416] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-03T22:40:45.175031] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-10-03T22:40:45.175216] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-03T22:40:45.177485] [INFO ] [MAIN ] Derivative Progress: 1030/2073 symbols completed. KMT took 1.1s. Estimated remaining: 7m 13s. Rate: 144.7 symbols/min [2025-10-03T22:40:45.177888] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:45.196260] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:45.205742] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53938 primary records. [2025-10-03T22:40:45.205971] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-03T22:40:45.212734] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:45.213954] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39160 primary records. [2025-10-03T22:40:45.222239] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-03T22:40:45.257261] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-10-03T22:40:45.258035] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-03T22:40:45.263137] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-10-03T22:40:45.261630] [INFO ] [MAIN ] Derivative Progress: 1031/2073 symbols completed. KN took 1.1s. Estimated remaining: 7m 12s. Rate: 144.8 symbols/min [2025-10-03T22:40:45.263325] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:45.263596] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-03T22:40:45.266627] [INFO ] [MAIN ] Derivative Progress: 1032/2073 symbols completed. KMX took 1.2s. Estimated remaining: 7m 11s. Rate: 144.9 symbols/min [2025-10-03T22:40:45.266927] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:45.283814] [DEBUG] [LOCAL ] KNF: Loaded 36421 existing records from primary storage. [2025-10-03T22:40:45.284113] [INFO ] [MAIN ] KNF: Loaded 36421 primary data records. [2025-10-03T22:40:45.356974] [DEBUG] [LOCAL ] KNOP: Loaded 10576 existing records from primary storage. [2025-10-03T22:40:45.357158] [INFO ] [MAIN ] KNOP: Loaded 10576 primary data records. [2025-10-03T22:40:45.480214] [DEBUG] [LOCAL ] KNSL: Loaded 18503 existing records from primary storage. [2025-10-03T22:40:45.502941] [INFO ] [MAIN ] KNSL: Loaded 18503 primary data records. [2025-10-03T22:40:46.343604] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:46.345473] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10576 primary records. [2025-10-03T22:40:46.345923] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-03T22:40:46.390509] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:46.391349] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:46.392201] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36421 primary records. [2025-10-03T22:40:46.392819] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-03T22:40:46.393406] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18503 primary records. [2025-10-03T22:40:46.394849] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-03T22:40:46.421825] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-10-03T22:40:46.424461] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-03T22:40:46.428934] [INFO ] [MAIN ] Derivative Progress: 1033/2073 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 11s. Rate: 144.7 symbols/min [2025-10-03T22:40:46.430965] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-10-03T22:40:46.431070] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-03T22:40:46.434607] [INFO ] [MAIN ] Derivative Progress: 1034/2073 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 10s. Rate: 144.8 symbols/min [2025-10-03T22:40:46.436466] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-10-03T22:40:46.436535] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-03T22:40:46.439634] [INFO ] [MAIN ] Derivative Progress: 1035/2073 symbols completed. KNF took 1.3s. Estimated remaining: 7m 10s. Rate: 145.0 symbols/min [2025-10-03T22:40:46.440243] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:46.440395] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:46.440166] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:46.523627] [DEBUG] [LOCAL ] KNX: Loaded 53368 existing records from primary storage. [2025-10-03T22:40:46.535770] [INFO ] [MAIN ] KNX: Loaded 53368 primary data records. [2025-10-03T22:40:46.574970] [DEBUG] [LOCAL ] KODK: Loaded 44096 existing records from primary storage. [2025-10-03T22:40:46.583052] [INFO ] [MAIN ] KODK: Loaded 44096 primary data records. [2025-10-03T22:40:46.732884] [DEBUG] [LOCAL ] KNTK: Loaded 46914 existing records from primary storage. [2025-10-03T22:40:46.751621] [INFO ] [MAIN ] KNTK: Loaded 46914 primary data records. [2025-10-03T22:40:47.606155] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:47.606531] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:47.607732] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53368 primary records. [2025-10-03T22:40:47.608908] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44096 primary records. [2025-10-03T22:40:47.609177] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-03T22:40:47.609110] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-03T22:40:47.643688] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-10-03T22:40:47.651951] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-03T22:40:47.655016] [INFO ] [MAIN ] Derivative Progress: 1036/2073 symbols completed. KODK took 1.2s. Estimated remaining: 7m 10s. Rate: 144.7 symbols/min [2025-10-03T22:40:47.660890] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:47.655102] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-10-03T22:40:47.661903] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 46914 primary records. [2025-10-03T22:40:47.660524] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:47.662175] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-03T22:40:47.662051] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-03T22:40:47.666114] [INFO ] [MAIN ] Derivative Progress: 1037/2073 symbols completed. KNX took 1.2s. Estimated remaining: 7m 9s. Rate: 144.8 symbols/min [2025-10-03T22:40:47.666507] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:47.689231] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-10-03T22:40:47.689461] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-03T22:40:47.693012] [INFO ] [MAIN ] Derivative Progress: 1038/2073 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 8s. Rate: 145.0 symbols/min [2025-10-03T22:40:47.693433] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:47.708384] [DEBUG] [LOCAL ] KOP: Loaded 17879 existing records from primary storage. [2025-10-03T22:40:47.709388] [INFO ] [MAIN ] KOP: Loaded 17879 primary data records. [2025-10-03T22:40:47.787131] [DEBUG] [LOCAL ] KOF: Loaded 26587 existing records from primary storage. [2025-10-03T22:40:47.777463] [DEBUG] [LOCAL ] KORE: Loaded 2043 existing records from primary storage. [2025-10-03T22:40:47.804184] [INFO ] [MAIN ] KOF: Loaded 26587 primary data records. [2025-10-03T22:40:47.804310] [INFO ] [MAIN ] KORE: Loaded 2043 primary data records. [2025-10-03T22:40:48.762312] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:48.762031] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:48.764133] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 17879 primary records. [2025-10-03T22:40:48.763463] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2043 primary records. [2025-10-03T22:40:48.764349] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-03T22:40:48.762696] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:48.764252] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-03T22:40:48.766044] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26587 primary records. [2025-10-03T22:40:48.766853] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-03T22:40:48.802766] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-10-03T22:40:48.803700] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-03T22:40:48.805130] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-10-03T22:40:48.810967] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-03T22:40:48.810900] [INFO ] [MAIN ] Derivative Progress: 1039/2073 symbols completed. KORE took 1.1s. Estimated remaining: 7m 9s. Rate: 144.7 symbols/min [2025-10-03T22:40:48.814777] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:48.822192] [INFO ] [MAIN ] Derivative Progress: 1040/2073 symbols completed. KOP took 1.1s. Estimated remaining: 7m 8s. Rate: 144.9 symbols/min [2025-10-03T22:40:48.822997] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:48.822081] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-10-03T22:40:48.823513] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-03T22:40:48.827017] [INFO ] [MAIN ] Derivative Progress: 1041/2073 symbols completed. KOF took 1.2s. Estimated remaining: 7m 7s. Rate: 145.0 symbols/min [2025-10-03T22:40:48.827350] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:48.913884] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-03T22:40:48.914099] [INFO ] [MAIN ] KR: Loaded 54461 primary data records. [2025-10-03T22:40:49.047279] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-10-03T22:40:49.051801] [INFO ] [MAIN ] KOS: Loaded 53828 primary data records. [2025-10-03T22:40:49.147098] [DEBUG] [LOCAL ] KRC: Loaded 48988 existing records from primary storage. [2025-10-03T22:40:49.313683] [INFO ] [MAIN ] KRC: Loaded 48988 primary data records. [2025-10-03T22:40:49.975038] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:49.976367] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54461 primary records. [2025-10-03T22:40:49.978469] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-03T22:40:50.007483] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:50.009077] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53828 primary records. [2025-10-03T22:40:50.009307] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-03T22:40:50.031058] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-10-03T22:40:50.033739] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-03T22:40:50.036798] [INFO ] [MAIN ] Derivative Progress: 1042/2073 symbols completed. KR took 1.2s. Estimated remaining: 7m 7s. Rate: 144.7 symbols/min [2025-10-03T22:40:50.037204] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:50.039379] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-10-03T22:40:50.047118] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-03T22:40:50.055499] [INFO ] [MAIN ] Derivative Progress: 1043/2073 symbols completed. KOS took 1.2s. Estimated remaining: 7m 7s. Rate: 144.9 symbols/min [2025-10-03T22:40:50.052481] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:50.056629] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:50.056523] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 48988 primary records. [2025-10-03T22:40:50.057145] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-03T22:40:50.074031] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-10-03T22:40:50.074199] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-03T22:40:50.077569] [INFO ] [MAIN ] Derivative Progress: 1044/2073 symbols completed. KRC took 1.3s. Estimated remaining: 7m 6s. Rate: 145.0 symbols/min [2025-10-03T22:40:50.078029] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:50.128223] [DEBUG] [LOCAL ] KRO: Loaded 26399 existing records from primary storage. [2025-10-03T22:40:50.128594] [INFO ] [MAIN ] KRO: Loaded 26399 primary data records. [2025-10-03T22:40:50.267887] [DEBUG] [LOCAL ] KREF: Loaded 38174 existing records from primary storage. [2025-10-03T22:40:50.274779] [INFO ] [MAIN ] KREF: Loaded 38174 primary data records. [2025-10-03T22:40:50.274617] [DEBUG] [LOCAL ] KRG: Loaded 49885 existing records from primary storage. [2025-10-03T22:40:50.285446] [INFO ] [MAIN ] KRG: Loaded 49885 primary data records. [2025-10-03T22:40:51.163622] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:51.165110] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26399 primary records. [2025-10-03T22:40:51.165701] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-03T22:40:51.184093] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-10-03T22:40:51.184473] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-03T22:40:51.186726] [INFO ] [MAIN ] Derivative Progress: 1045/2073 symbols completed. KRO took 1.1s. Estimated remaining: 7m 6s. Rate: 144.8 symbols/min [2025-10-03T22:40:51.187060] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:51.208252] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:51.209333] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49885 primary records. [2025-10-03T22:40:51.209477] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-03T22:40:51.237706] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:51.239440] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 38174 primary records. [2025-10-03T22:40:51.239951] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-03T22:40:51.267768] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-10-03T22:40:51.269022] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-03T22:40:51.272257] [INFO ] [MAIN ] Derivative Progress: 1046/2073 symbols completed. KRG took 1.2s. Estimated remaining: 7m 5s. Rate: 144.9 symbols/min [2025-10-03T22:40:51.272533] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:51.286575] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-10-03T22:40:51.287693] [DEBUG] [LOCAL ] KRP: Loaded 37479 existing records from primary storage. [2025-10-03T22:40:51.287919] [INFO ] [MAIN ] KRP: Loaded 37479 primary data records. [2025-10-03T22:40:51.287815] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-03T22:40:51.292219] [INFO ] [MAIN ] Derivative Progress: 1047/2073 symbols completed. KREF took 1.3s. Estimated remaining: 7m 5s. Rate: 145.0 symbols/min [2025-10-03T22:40:51.292741] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:51.725686] [DEBUG] [LOCAL ] KSS: Loaded 54381 existing records from primary storage. [2025-10-03T22:40:51.725990] [INFO ] [MAIN ] KSS: Loaded 54381 primary data records. [2025-10-03T22:40:51.763189] [DEBUG] [LOCAL ] KT: Loaded 46344 existing records from primary storage. [2025-10-03T22:40:51.787790] [INFO ] [MAIN ] KT: Loaded 46344 primary data records. [2025-10-03T22:40:52.428517] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:52.431035] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 37479 primary records. [2025-10-03T22:40:52.431555] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-03T22:40:52.467196] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-10-03T22:40:52.468206] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-03T22:40:52.468095] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:52.471142] [INFO ] [MAIN ] Derivative Progress: 1048/2073 symbols completed. KRP took 1.3s. Estimated remaining: 7m 5s. Rate: 144.8 symbols/min [2025-10-03T22:40:52.472582] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54381 primary records. [2025-10-03T22:40:52.474077] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-03T22:40:52.497484] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:52.500252] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46344 primary records. [2025-10-03T22:40:52.503181] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-03T22:40:52.523078] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-10-03T22:40:52.523759] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-03T22:40:52.527782] [INFO ] [MAIN ] Derivative Progress: 1049/2073 symbols completed. KT took 1.2s. Estimated remaining: 7m 4s. Rate: 144.9 symbols/min [2025-10-03T22:40:52.529774] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-10-03T22:40:52.529841] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-03T22:40:52.532080] [INFO ] [MAIN ] Derivative Progress: 1050/2073 symbols completed. KSS took 1.3s. Estimated remaining: 7m 3s. Rate: 145.0 symbols/min [2025-10-03T22:40:52.532791] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:52.532737] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:52.533356] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:52.551185] [DEBUG] [LOCAL ] KTF: Loaded 12698 existing records from primary storage. [2025-10-03T22:40:52.551337] [INFO ] [MAIN ] KTF: Loaded 12698 primary data records. [2025-10-03T22:40:52.944321] [DEBUG] [LOCAL ] KTB: Loaded 41546 existing records from primary storage. [2025-10-03T22:40:52.941822] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-03T22:40:52.945627] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-10-03T22:40:52.946178] [INFO ] [MAIN ] KTB: Loaded 41546 primary data records. [2025-10-03T22:40:53.662053] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:53.663152] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 12698 primary records. [2025-10-03T22:40:53.663238] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-03T22:40:53.771778] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-10-03T22:40:53.807781] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-03T22:40:53.842308] [INFO ] [MAIN ] Derivative Progress: 1051/2073 symbols completed. KTF took 1.3s. Estimated remaining: 7m 4s. Rate: 144.7 symbols/min [2025-10-03T22:40:53.867370] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:53.909845] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:53.911889] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-10-03T22:40:53.912474] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-03T22:40:53.939695] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-10-03T22:40:53.955405] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-03T22:40:53.970351] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:53.975301] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41546 primary records. [2025-10-03T22:40:53.973826] [INFO ] [MAIN ] Derivative Progress: 1052/2073 symbols completed. KVUE took 1.4s. Estimated remaining: 7m 3s. Rate: 144.8 symbols/min [2025-10-03T22:40:53.975533] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-03T22:40:53.975877] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:54.014424] [DEBUG] [LOCAL ] KVYO: Loaded 50847 existing records from primary storage. [2025-10-03T22:40:54.015189] [INFO ] [MAIN ] KVYO: Loaded 50847 primary data records. [2025-10-03T22:40:54.069589] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-10-03T22:40:54.083923] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-03T22:40:54.126835] [INFO ] [MAIN ] Derivative Progress: 1053/2073 symbols completed. KTB took 1.6s. Estimated remaining: 7m 2s. Rate: 144.9 symbols/min [2025-10-03T22:40:54.165681] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:54.241775] [DEBUG] [LOCAL ] KW: Loaded 41133 existing records from primary storage. [2025-10-03T22:40:54.253275] [INFO ] [MAIN ] KW: Loaded 41133 primary data records. [2025-10-03T22:40:54.439342] [DEBUG] [LOCAL ] KWR: Loaded 16741 existing records from primary storage. [2025-10-03T22:40:54.570365] [INFO ] [MAIN ] KWR: Loaded 16741 primary data records. [2025-10-03T22:40:55.214272] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:55.215344] [INFO ] [MAIN ] KVYO: Generated 1820 derivative records from 50847 primary records. [2025-10-03T22:40:55.216761] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-03T22:40:55.250979] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1820 records). [2025-10-03T22:40:55.251795] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:55.251847] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-03T22:40:55.254366] [INFO ] [MAIN ] Derivative Progress: 1054/2073 symbols completed. KVYO took 1.4s. Estimated remaining: 7m 3s. Rate: 144.7 symbols/min [2025-10-03T22:40:55.255329] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41133 primary records. [2025-10-03T22:40:55.255537] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:55.255431] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-03T22:40:55.287568] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:55.289590] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16741 primary records. [2025-10-03T22:40:55.290537] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-03T22:40:55.301275] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-10-03T22:40:55.306163] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-03T22:40:55.319024] [INFO ] [MAIN ] Derivative Progress: 1055/2073 symbols completed. KW took 1.3s. Estimated remaining: 7m 2s. Rate: 144.8 symbols/min [2025-10-03T22:40:55.321802] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:55.322891] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-10-03T22:40:55.323176] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-03T22:40:55.327132] [INFO ] [MAIN ] Derivative Progress: 1056/2073 symbols completed. KWR took 1.2s. Estimated remaining: 7m 1s. Rate: 144.9 symbols/min [2025-10-03T22:40:55.327561] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:55.342634] [DEBUG] [LOCAL ] KYN: Loaded 30355 existing records from primary storage. [2025-10-03T22:40:55.342974] [INFO ] [MAIN ] KYN: Loaded 30355 primary data records. [2025-10-03T22:40:55.699912] [DEBUG] [LOCAL ] L: Loaded 41625 existing records from primary storage. [2025-10-03T22:40:55.714753] [INFO ] [MAIN ] L: Loaded 41625 primary data records. [2025-10-03T22:40:55.737931] [DEBUG] [LOCAL ] LAC: Loaded 53142 existing records from primary storage. [2025-10-03T22:40:55.773149] [INFO ] [MAIN ] LAC: Loaded 53142 primary data records. [2025-10-03T22:40:56.392400] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:56.394043] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30355 primary records. [2025-10-03T22:40:56.394885] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-03T22:40:56.416612] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-10-03T22:40:56.416980] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-03T22:40:56.419778] [INFO ] [MAIN ] Derivative Progress: 1057/2073 symbols completed. KYN took 1.2s. Estimated remaining: 7m 1s. Rate: 144.7 symbols/min [2025-10-03T22:40:56.420223] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:56.440909] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:56.454434] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41625 primary records. [2025-10-03T22:40:56.453726] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:56.454564] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-03T22:40:56.455223] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53142 primary records. [2025-10-03T22:40:56.455987] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-03T22:40:56.498599] [DEBUG] [LOCAL ] LAD: Loaded 23804 existing records from primary storage. [2025-10-03T22:40:56.500273] [INFO ] [MAIN ] LAD: Loaded 23804 primary data records. [2025-10-03T22:40:56.500809] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-10-03T22:40:56.501508] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-03T22:40:56.515242] [INFO ] [MAIN ] Derivative Progress: 1058/2073 symbols completed. L took 1.2s. Estimated remaining: 7m 1s. Rate: 144.8 symbols/min [2025-10-03T22:40:56.512953] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-10-03T22:40:56.546401] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-03T22:40:56.555602] [INFO ] [MAIN ] Derivative Progress: 1059/2073 symbols completed. LAC took 1.2s. Estimated remaining: 6m 60s. Rate: 144.9 symbols/min [2025-10-03T22:40:56.541102] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:56.587092] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:56.814273] [DEBUG] [LOCAL ] LANV: Loaded 2868 existing records from primary storage. [2025-10-03T22:40:56.815177] [INFO ] [MAIN ] LANV: Loaded 2868 primary data records. [2025-10-03T22:40:57.148746] [DEBUG] [LOCAL ] LADR: Loaded 39456 existing records from primary storage. [2025-10-03T22:40:57.149754] [INFO ] [MAIN ] LADR: Loaded 39456 primary data records. [2025-10-03T22:40:57.330894] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:57.353948] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 23804 primary records. [2025-10-03T22:40:57.477470] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-03T22:40:57.513671] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:57.515875] [INFO ] [MAIN ] LANV: Generated 1820 derivative records from 2868 primary records. [2025-10-03T22:40:57.516367] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-03T22:40:57.518050] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-10-03T22:40:57.518306] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-03T22:40:57.526491] [INFO ] [MAIN ] Derivative Progress: 1060/2073 symbols completed. LAD took 1.1s. Estimated remaining: 6m 60s. Rate: 144.7 symbols/min [2025-10-03T22:40:57.531345] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:57.535197] [DEBUG] [LOCAL ] LANV: Derivative data saved (1820 records). [2025-10-03T22:40:57.535464] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-03T22:40:57.538793] [INFO ] [MAIN ] Derivative Progress: 1061/2073 symbols completed. LANV took 1.0s. Estimated remaining: 6m 59s. Rate: 144.9 symbols/min [2025-10-03T22:40:57.539196] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:57.567564] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:57.567218] [DEBUG] [LOCAL ] LAW: Loaded 14355 existing records from primary storage. [2025-10-03T22:40:57.567769] [INFO ] [MAIN ] LAW: Loaded 14355 primary data records. [2025-10-03T22:40:57.573908] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39456 primary records. [2025-10-03T22:40:57.622802] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-03T22:40:57.719397] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-10-03T22:40:57.719783] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-03T22:40:57.748079] [INFO ] [MAIN ] Derivative Progress: 1062/2073 symbols completed. LADR took 1.2s. Estimated remaining: 6m 59s. Rate: 144.9 symbols/min [2025-10-03T22:40:57.779722] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:57.955830] [DEBUG] [LOCAL ] LAZ: Loaded 45487 existing records from primary storage. [2025-10-03T22:40:57.956938] [INFO ] [MAIN ] LAZ: Loaded 45487 primary data records. [2025-10-03T22:40:58.356534] [DEBUG] [LOCAL ] LB: Loaded 38337 existing records from primary storage. [2025-10-03T22:40:58.356943] [INFO ] [MAIN ] LB: Loaded 38337 primary data records. [2025-10-03T22:40:58.527541] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:58.573956] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14355 primary records. [2025-10-03T22:40:58.589148] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-03T22:40:58.741702] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-10-03T22:40:58.742917] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-03T22:40:58.745955] [INFO ] [MAIN ] Derivative Progress: 1063/2073 symbols completed. LAW took 1.2s. Estimated remaining: 6m 59s. Rate: 144.7 symbols/min [2025-10-03T22:40:58.764229] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:58.765107] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45487 primary records. [2025-10-03T22:40:58.765215] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-03T22:40:58.783462] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-10-03T22:40:58.783670] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-03T22:40:58.788887] [INFO ] [MAIN ] Derivative Progress: 1064/2073 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 58s. Rate: 144.9 symbols/min [2025-10-03T22:40:58.804856] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:58.805547] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38337 primary records. [2025-10-03T22:40:58.805614] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-03T22:40:58.821736] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-10-03T22:40:58.821800] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-03T22:40:58.824879] [INFO ] [MAIN ] Derivative Progress: 1065/2073 symbols completed. LB took 1.0s. Estimated remaining: 6m 57s. Rate: 145.0 symbols/min [2025-10-03T22:40:58.825436] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:58.825348] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:58.825557] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:58.862457] [DEBUG] [LOCAL ] LCII: Loaded 28309 existing records from primary storage. [2025-10-03T22:40:58.862761] [INFO ] [MAIN ] LCII: Loaded 28309 primary data records. [2025-10-03T22:40:59.024503] [DEBUG] [LOCAL ] LC: Loaded 48516 existing records from primary storage. [2025-10-03T22:40:59.035768] [DEBUG] [LOCAL ] LBRT: Loaded 53687 existing records from primary storage. [2025-10-03T22:40:59.035890] [INFO ] [MAIN ] LC: Loaded 48516 primary data records. [2025-10-03T22:40:59.065343] [INFO ] [MAIN ] LBRT: Loaded 53687 primary data records. [2025-10-03T22:40:59.926390] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:59.928397] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 28309 primary records. [2025-10-03T22:40:59.928703] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-03T22:40:59.955734] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-10-03T22:40:59.956256] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-03T22:40:59.962993] [INFO ] [MAIN ] Derivative Progress: 1066/2073 symbols completed. LCII took 1.1s. Estimated remaining: 6m 57s. Rate: 144.7 symbols/min [2025-10-03T22:40:59.963934] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:40:59.988592] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:59.994771] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48516 primary records. [2025-10-03T22:40:59.995126] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:40:59.995476] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-03T22:40:59.996295] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53687 primary records. [2025-10-03T22:40:59.996907] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-03T22:41:00.031368] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-10-03T22:41:00.031768] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-03T22:41:00.045973] [INFO ] [MAIN ] Derivative Progress: 1067/2073 symbols completed. LC took 1.2s. Estimated remaining: 6m 57s. Rate: 144.8 symbols/min [2025-10-03T22:41:00.046417] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:00.049268] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-10-03T22:41:00.049518] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-03T22:41:00.053119] [INFO ] [MAIN ] Derivative Progress: 1068/2073 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 56s. Rate: 145.0 symbols/min [2025-10-03T22:41:00.053514] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:00.072938] [DEBUG] [LOCAL ] LDI: Loaded 44902 existing records from primary storage. [2025-10-03T22:41:00.073292] [INFO ] [MAIN ] LDI: Loaded 44902 primary data records. [2025-10-03T22:41:00.190932] [DEBUG] [LOCAL ] LDP: Loaded 13110 existing records from primary storage. [2025-10-03T22:41:00.203597] [INFO ] [MAIN ] LDP: Loaded 13110 primary data records. [2025-10-03T22:41:00.374495] [DEBUG] [LOCAL ] LDOS: Loaded 46250 existing records from primary storage. [2025-10-03T22:41:00.414714] [INFO ] [MAIN ] LDOS: Loaded 46250 primary data records. [2025-10-03T22:41:01.158885] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:01.160226] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 44902 primary records. [2025-10-03T22:41:01.160344] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-03T22:41:01.198452] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-10-03T22:41:01.199261] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-03T22:41:01.203162] [INFO ] [MAIN ] Derivative Progress: 1069/2073 symbols completed. LDI took 1.2s. Estimated remaining: 6m 56s. Rate: 144.7 symbols/min [2025-10-03T22:41:01.199027] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:01.203435] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:01.205063] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13110 primary records. [2025-10-03T22:41:01.205208] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-03T22:41:01.228055] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-10-03T22:41:01.228497] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-03T22:41:01.246470] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:01.245938] [INFO ] [MAIN ] Derivative Progress: 1070/2073 symbols completed. LDP took 1.2s. Estimated remaining: 6m 55s. Rate: 144.9 symbols/min [2025-10-03T22:41:01.246936] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:01.248072] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 46250 primary records. [2025-10-03T22:41:01.248851] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-03T22:41:01.270154] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-10-03T22:41:01.270461] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-03T22:41:01.273887] [INFO ] [MAIN ] Derivative Progress: 1071/2073 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 55s. Rate: 145.0 symbols/min [2025-10-03T22:41:01.286227] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:01.308080] [DEBUG] [LOCAL ] LEA: Loaded 42367 existing records from primary storage. [2025-10-03T22:41:01.321456] [INFO ] [MAIN ] LEA: Loaded 42367 primary data records. [2025-10-03T22:41:01.468240] [DEBUG] [LOCAL ] LEG: Loaded 50956 existing records from primary storage. [2025-10-03T22:41:01.485220] [INFO ] [MAIN ] LEG: Loaded 50956 primary data records. [2025-10-03T22:41:01.846407] [DEBUG] [LOCAL ] LEN: Loaded 53950 existing records from primary storage. [2025-10-03T22:41:01.882711] [INFO ] [MAIN ] LEN: Loaded 53950 primary data records. [2025-10-03T22:41:02.512618] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:02.514257] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42367 primary records. [2025-10-03T22:41:02.514521] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-03T22:41:02.548171] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:02.549977] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 50956 primary records. [2025-10-03T22:41:02.550195] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-03T22:41:02.551969] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-10-03T22:41:02.562674] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-03T22:41:02.565499] [INFO ] [MAIN ] Derivative Progress: 1072/2073 symbols completed. LEA took 1.4s. Estimated remaining: 6m 55s. Rate: 144.7 symbols/min [2025-10-03T22:41:02.566389] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:02.574200] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-10-03T22:41:02.574403] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-03T22:41:02.577035] [INFO ] [MAIN ] Derivative Progress: 1073/2073 symbols completed. LEG took 1.3s. Estimated remaining: 6m 54s. Rate: 144.8 symbols/min [2025-10-03T22:41:02.577406] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:02.591677] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:02.592607] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53950 primary records. [2025-10-03T22:41:02.597143] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-03T22:41:02.618900] [DEBUG] [LOCAL ] LEO: Loaded 17457 existing records from primary storage. [2025-10-03T22:41:02.619539] [INFO ] [MAIN ] LEO: Loaded 17457 primary data records. [2025-10-03T22:41:02.704426] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-10-03T22:41:02.716233] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-03T22:41:02.745058] [INFO ] [MAIN ] Derivative Progress: 1074/2073 symbols completed. LEN took 1.5s. Estimated remaining: 6m 54s. Rate: 144.9 symbols/min [2025-10-03T22:41:02.763211] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:02.999129] [DEBUG] [LOCAL ] LEVI: Loaded 52330 existing records from primary storage. [2025-10-03T22:41:03.003585] [INFO ] [MAIN ] LEVI: Loaded 52330 primary data records. [2025-10-03T22:41:03.082828] [DEBUG] [LOCAL ] LFT: Loaded 18523 existing records from primary storage. [2025-10-03T22:41:03.106264] [INFO ] [MAIN ] LFT: Loaded 18523 primary data records. [2025-10-03T22:41:03.699609] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:03.700547] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17457 primary records. [2025-10-03T22:41:03.700638] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-03T22:41:03.719197] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-10-03T22:41:03.719678] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-03T22:41:03.722788] [INFO ] [MAIN ] Derivative Progress: 1075/2073 symbols completed. LEO took 1.2s. Estimated remaining: 6m 54s. Rate: 144.7 symbols/min [2025-10-03T22:41:03.723632] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:03.753692] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:41:03.755190] [INFO ] [MAIN ] LEVI: Generated 1819 derivative records from 52330 primary records. [2025-10-03T22:41:03.755373] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-03T22:41:03.773869] [DEBUG] [LOCAL ] LGI: Loaded 9934 existing records from primary storage. [2025-10-03T22:41:03.774867] [INFO ] [MAIN ] LGI: Loaded 9934 primary data records. [2025-10-03T22:41:03.869303] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1819 records). [2025-10-03T22:41:03.880274] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-03T22:41:03.883130] [INFO ] [MAIN ] Derivative Progress: 1076/2073 symbols completed. LEVI took 1.3s. Estimated remaining: 6m 53s. Rate: 144.8 symbols/min [2025-10-03T22:41:03.894436] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:03.924429] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:03.930862] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18523 primary records. [2025-10-03T22:41:03.936144] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-03T22:41:04.186445] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-10-03T22:41:04.197527] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-03T22:41:04.201069] [INFO ] [MAIN ] Derivative Progress: 1077/2073 symbols completed. LFT took 1.4s. Estimated remaining: 6m 53s. Rate: 144.8 symbols/min [2025-10-03T22:41:04.201701] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:04.219838] [DEBUG] [LOCAL ] LH: Loaded 38370 existing records from primary storage. [2025-10-03T22:41:04.220512] [INFO ] [MAIN ] LH: Loaded 38370 primary data records. [2025-10-03T22:41:04.431069] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:04.454245] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 9934 primary records. [2025-10-03T22:41:04.454375] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-03T22:41:04.609618] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-10-03T22:41:04.609804] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-03T22:41:04.612448] [INFO ] [MAIN ] Derivative Progress: 1078/2073 symbols completed. LGI took 0.9s. Estimated remaining: 6m 52s. Rate: 144.8 symbols/min [2025-10-03T22:41:04.608603] [DEBUG] [LOCAL ] LHX: Loaded 49316 existing records from primary storage. [2025-10-03T22:41:04.612824] [INFO ] [MAIN ] LHX: Loaded 49316 primary data records. [2025-10-03T22:41:04.997989] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:04.999220] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38370 primary records. [2025-10-03T22:41:04.999309] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-03T22:41:05.018876] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-10-03T22:41:05.019210] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-03T22:41:05.022301] [INFO ] [MAIN ] Derivative Progress: 1079/2073 symbols completed. LH took 1.1s. Estimated remaining: 6m 52s. Rate: 144.8 symbols/min [2025-10-03T22:41:05.038464] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:05.039113] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49316 primary records. [2025-10-03T22:41:05.039178] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-03T22:41:05.057373] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-10-03T22:41:05.057449] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-03T22:41:05.059867] [INFO ] [MAIN ] Derivative Progress: 1080/2073 symbols completed. LHX took 0.9s. Estimated remaining: 6m 51s. Rate: 145.0 symbols/min [2025-10-03T22:41:05.060281] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:05.060400] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:05.060837] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:05.076848] [DEBUG] [LOCAL ] LITB: Loaded 4388 existing records from primary storage. [2025-10-03T22:41:05.077467] [INFO ] [MAIN ] LITB: Loaded 4388 primary data records. [2025-10-03T22:41:05.449669] [DEBUG] [LOCAL ] LII: Loaded 28404 existing records from primary storage. [2025-10-03T22:41:05.451976] [DEBUG] [LOCAL ] LION: Loaded 45007 existing records from primary storage. [2025-10-03T22:41:05.452116] [INFO ] [MAIN ] LII: Loaded 28404 primary data records. [2025-10-03T22:41:05.452371] [INFO ] [MAIN ] LION: Loaded 45007 primary data records. [2025-10-03T22:41:06.196361] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:06.198398] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4388 primary records. [2025-10-03T22:41:06.198719] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-03T22:41:06.220168] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-10-03T22:41:06.221069] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-03T22:41:06.223619] [INFO ] [MAIN ] Derivative Progress: 1081/2073 symbols completed. LITB took 1.2s. Estimated remaining: 6m 51s. Rate: 144.7 symbols/min [2025-10-03T22:41:06.223849] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:06.244492] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:06.245906] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 45007 primary records. [2025-10-03T22:41:06.246157] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-03T22:41:06.266336] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-10-03T22:41:06.266701] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-03T22:41:06.270177] [INFO ] [MAIN ] Derivative Progress: 1082/2073 symbols completed. LION took 1.2s. Estimated remaining: 6m 51s. Rate: 144.8 symbols/min [2025-10-03T22:41:06.270516] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:06.289497] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:06.290462] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28404 primary records. [2025-10-03T22:41:06.290528] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-03T22:41:06.307347] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-10-03T22:41:06.307507] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-03T22:41:06.311406] [INFO ] [MAIN ] Derivative Progress: 1083/2073 symbols completed. LII took 1.3s. Estimated remaining: 6m 50s. Rate: 145.0 symbols/min [2025-10-03T22:41:06.311622] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:06.367053] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-10-03T22:41:06.367347] [INFO ] [MAIN ] LLY: Loaded 54064 primary data records. [2025-10-03T22:41:06.505805] [DEBUG] [LOCAL ] LMND: Loaded 52640 existing records from primary storage. [2025-10-03T22:41:06.516750] [INFO ] [MAIN ] LMND: Loaded 52640 primary data records. [2025-10-03T22:41:06.681506] [DEBUG] [LOCAL ] LMT: Loaded 50509 existing records from primary storage. [2025-10-03T22:41:06.697991] [INFO ] [MAIN ] LMT: Loaded 50509 primary data records. [2025-10-03T22:41:07.462786] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:07.463887] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54064 primary records. [2025-10-03T22:41:07.464141] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-03T22:41:07.490518] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-10-03T22:41:07.505022] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:07.504610] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-03T22:41:07.507910] [INFO ] [MAIN ] Derivative Progress: 1084/2073 symbols completed. LLY took 1.3s. Estimated remaining: 6m 50s. Rate: 144.7 symbols/min [2025-10-03T22:41:07.509167] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52640 primary records. [2025-10-03T22:41:07.510012] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-03T22:41:07.509784] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:07.546743] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:07.548564] [INFO ] [MAIN ] LMT: Generated 1820 derivative records from 50509 primary records. [2025-10-03T22:41:07.549102] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-03T22:41:07.550177] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-10-03T22:41:07.550757] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-03T22:41:07.555043] [INFO ] [MAIN ] Derivative Progress: 1085/2073 symbols completed. LMND took 1.3s. Estimated remaining: 6m 49s. Rate: 144.8 symbols/min [2025-10-03T22:41:07.555298] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:07.575521] [DEBUG] [LOCAL ] LMT: Derivative data saved (1820 records). [2025-10-03T22:41:07.579261] [DEBUG] [LOCAL ] LND: Loaded 4994 existing records from primary storage. [2025-10-03T22:41:07.579605] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-03T22:41:07.579851] [INFO ] [MAIN ] LND: Loaded 4994 primary data records. [2025-10-03T22:41:07.584209] [INFO ] [MAIN ] Derivative Progress: 1086/2073 symbols completed. LMT took 1.3s. Estimated remaining: 6m 49s. Rate: 145.0 symbols/min [2025-10-03T22:41:07.584686] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:07.756355] [DEBUG] [LOCAL ] LNC: Loaded 52378 existing records from primary storage. [2025-10-03T22:41:07.767159] [INFO ] [MAIN ] LNC: Loaded 52378 primary data records. [2025-10-03T22:41:08.198254] [DEBUG] [LOCAL ] LNG: Loaded 52089 existing records from primary storage. [2025-10-03T22:41:08.320549] [INFO ] [MAIN ] LNG: Loaded 52089 primary data records. [2025-10-03T22:41:08.703014] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:08.704427] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 4994 primary records. [2025-10-03T22:41:08.705850] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-03T22:41:08.742468] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:08.743575] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52378 primary records. [2025-10-03T22:41:08.745027] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-03T22:41:08.747094] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-10-03T22:41:08.748278] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-03T22:41:08.751661] [INFO ] [MAIN ] Derivative Progress: 1087/2073 symbols completed. LND took 1.2s. Estimated remaining: 6m 49s. Rate: 144.7 symbols/min [2025-10-03T22:41:08.752341] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:08.779627] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-10-03T22:41:08.781008] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-03T22:41:08.805638] [INFO ] [MAIN ] Derivative Progress: 1088/2073 symbols completed. LNC took 1.3s. Estimated remaining: 6m 48s. Rate: 144.8 symbols/min [2025-10-03T22:41:08.787976] [DEBUG] [LOCAL ] LNN: Loaded 11340 existing records from primary storage. [2025-10-03T22:41:08.807157] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:08.807351] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:08.809103] [INFO ] [MAIN ] LNN: Loaded 11340 primary data records. [2025-10-03T22:41:08.808623] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52089 primary records. [2025-10-03T22:41:08.809339] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-03T22:41:08.971742] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-10-03T22:41:09.031800] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-03T22:41:09.041012] [INFO ] [MAIN ] Derivative Progress: 1089/2073 symbols completed. LNG took 1.5s. Estimated remaining: 6m 47s. Rate: 144.9 symbols/min [2025-10-03T22:41:09.103429] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:09.228231] [DEBUG] [LOCAL ] LOAR: Loaded 42186 existing records from primary storage. [2025-10-03T22:41:09.228606] [INFO ] [MAIN ] LOAR: Loaded 42186 primary data records. [2025-10-03T22:41:09.436523] [DEBUG] [LOCAL ] LOB: Loaded 27738 existing records from primary storage. [2025-10-03T22:41:09.556063] [INFO ] [MAIN ] LOB: Loaded 27738 primary data records. [2025-10-03T22:41:09.743229] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:09.774893] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11340 primary records. [2025-10-03T22:41:09.881064] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-03T22:41:09.918191] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-10-03T22:41:09.920551] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-03T22:41:09.923159] [INFO ] [MAIN ] Derivative Progress: 1090/2073 symbols completed. LNN took 1.2s. Estimated remaining: 6m 47s. Rate: 144.7 symbols/min [2025-10-03T22:41:09.924180] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:09.938690] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:09.940025] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42186 primary records. [2025-10-03T22:41:09.940430] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-03T22:41:09.972958] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-10-03T22:41:09.971177] [DEBUG] [LOCAL ] LOCL: Loaded 3659 existing records from primary storage. [2025-10-03T22:41:09.973397] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-03T22:41:09.973555] [INFO ] [MAIN ] LOCL: Loaded 3659 primary data records. [2025-10-03T22:41:09.989168] [INFO ] [MAIN ] Derivative Progress: 1091/2073 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 47s. Rate: 144.8 symbols/min [2025-10-03T22:41:10.015668] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:10.126720] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:10.150093] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27738 primary records. [2025-10-03T22:41:10.159140] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-03T22:41:10.329052] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-10-03T22:41:10.329827] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-03T22:41:10.334067] [INFO ] [MAIN ] Derivative Progress: 1092/2073 symbols completed. LOB took 1.2s. Estimated remaining: 6m 46s. Rate: 144.9 symbols/min [2025-10-03T22:41:10.343519] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:10.346745] [DEBUG] [LOCAL ] LOMA: Loaded 32578 existing records from primary storage. [2025-10-03T22:41:10.346943] [INFO ] [MAIN ] LOMA: Loaded 32578 primary data records. [2025-10-03T22:41:10.700240] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:10.701215] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3659 primary records. [2025-10-03T22:41:10.701334] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-03T22:41:10.732676] [DEBUG] [LOCAL ] LOW: Loaded 53704 existing records from primary storage. [2025-10-03T22:41:10.736565] [INFO ] [MAIN ] LOW: Loaded 53704 primary data records. [2025-10-03T22:41:10.737264] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-10-03T22:41:10.749079] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-03T22:41:10.777755] [INFO ] [MAIN ] Derivative Progress: 1093/2073 symbols completed. LOCL took 0.9s. Estimated remaining: 6m 46s. Rate: 144.9 symbols/min [2025-10-03T22:41:11.060490] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:11.061470] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32578 primary records. [2025-10-03T22:41:11.061617] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-03T22:41:11.080497] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-10-03T22:41:11.081521] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-03T22:41:11.084495] [INFO ] [MAIN ] Derivative Progress: 1094/2073 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 45s. Rate: 144.9 symbols/min [2025-10-03T22:41:11.102333] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:11.103004] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53704 primary records. [2025-10-03T22:41:11.103069] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-03T22:41:11.120488] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-10-03T22:41:11.120557] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-03T22:41:11.122849] [INFO ] [MAIN ] Derivative Progress: 1095/2073 symbols completed. LOW took 0.8s. Estimated remaining: 6m 45s. Rate: 145.0 symbols/min [2025-10-03T22:41:11.123293] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:11.123509] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:11.124728] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:11.163224] [DEBUG] [LOCAL ] LPL: Loaded 27029 existing records from primary storage. [2025-10-03T22:41:11.163382] [INFO ] [MAIN ] LPL: Loaded 27029 primary data records. [2025-10-03T22:41:11.277867] [DEBUG] [LOCAL ] LPG: Loaded 40441 existing records from primary storage. [2025-10-03T22:41:11.298861] [INFO ] [MAIN ] LPG: Loaded 40441 primary data records. [2025-10-03T22:41:11.400172] [DEBUG] [LOCAL ] LPX: Loaded 40238 existing records from primary storage. [2025-10-03T22:41:11.429520] [INFO ] [MAIN ] LPX: Loaded 40238 primary data records. [2025-10-03T22:41:12.219582] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:12.221000] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 27029 primary records. [2025-10-03T22:41:12.221283] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-03T22:41:12.240258] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-10-03T22:41:12.240508] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-03T22:41:12.243026] [INFO ] [MAIN ] Derivative Progress: 1096/2073 symbols completed. LPL took 1.1s. Estimated remaining: 6m 45s. Rate: 144.8 symbols/min [2025-10-03T22:41:12.243443] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:12.262439] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:12.263561] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40441 primary records. [2025-10-03T22:41:12.263773] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-03T22:41:12.299117] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-10-03T22:41:12.299579] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:12.300028] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-03T22:41:12.304558] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40238 primary records. [2025-10-03T22:41:12.303609] [INFO ] [MAIN ] Derivative Progress: 1097/2073 symbols completed. LPG took 1.2s. Estimated remaining: 6m 44s. Rate: 144.9 symbols/min [2025-10-03T22:41:12.314458] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:12.314282] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-03T22:41:12.347774] [DEBUG] [LOCAL ] LRN: Loaded 40253 existing records from primary storage. [2025-10-03T22:41:12.348245] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-10-03T22:41:12.348617] [INFO ] [MAIN ] LRN: Loaded 40253 primary data records. [2025-10-03T22:41:12.348754] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-03T22:41:12.352207] [INFO ] [MAIN ] Derivative Progress: 1098/2073 symbols completed. LPX took 1.2s. Estimated remaining: 6m 43s. Rate: 145.0 symbols/min [2025-10-03T22:41:12.364102] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:12.583530] [DEBUG] [LOCAL ] LSPD: Loaded 43487 existing records from primary storage. [2025-10-03T22:41:12.711183] [INFO ] [MAIN ] LSPD: Loaded 43487 primary data records. [2025-10-03T22:41:12.804175] [DEBUG] [LOCAL ] LTC: Loaded 30653 existing records from primary storage. [2025-10-03T22:41:12.832484] [INFO ] [MAIN ] LTC: Loaded 30653 primary data records. [2025-10-03T22:41:13.447944] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:13.449377] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40253 primary records. [2025-10-03T22:41:13.449837] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-03T22:41:13.469501] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-10-03T22:41:13.469871] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-03T22:41:13.472496] [INFO ] [MAIN ] Derivative Progress: 1099/2073 symbols completed. LRN took 1.2s. Estimated remaining: 6m 44s. Rate: 144.8 symbols/min [2025-10-03T22:41:13.473034] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:13.492841] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:13.494109] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43487 primary records. [2025-10-03T22:41:13.494327] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-03T22:41:13.511904] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-10-03T22:41:13.512440] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-03T22:41:13.515314] [INFO ] [MAIN ] Derivative Progress: 1100/2073 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 43s. Rate: 144.9 symbols/min [2025-10-03T22:41:13.515684] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:13.532563] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:13.533353] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30653 primary records. [2025-10-03T22:41:13.533468] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-03T22:41:13.563993] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-10-03T22:41:13.564057] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-03T22:41:13.567431] [INFO ] [MAIN ] Derivative Progress: 1101/2073 symbols completed. LTC took 1.2s. Estimated remaining: 6m 42s. Rate: 145.0 symbols/min [2025-10-03T22:41:13.567986] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:13.592432] [DEBUG] [LOCAL ] LTH: Loaded 52466 existing records from primary storage. [2025-10-03T22:41:13.592848] [INFO ] [MAIN ] LTH: Loaded 52466 primary data records. [2025-10-03T22:41:13.702136] [DEBUG] [LOCAL ] LTM: Loaded 37673 existing records from primary storage. [2025-10-03T22:41:13.720904] [INFO ] [MAIN ] LTM: Loaded 37673 primary data records. [2025-10-03T22:41:14.091618] [DEBUG] [LOCAL ] LU: Loaded 49698 existing records from primary storage. [2025-10-03T22:41:14.130003] [INFO ] [MAIN ] LU: Loaded 49698 primary data records. [2025-10-03T22:41:14.624840] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:14.626904] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52466 primary records. [2025-10-03T22:41:14.627295] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-03T22:41:14.649334] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-10-03T22:41:14.650445] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-03T22:41:14.662284] [INFO ] [MAIN ] Derivative Progress: 1102/2073 symbols completed. LTH took 1.2s. Estimated remaining: 6m 42s. Rate: 144.8 symbols/min [2025-10-03T22:41:14.667676] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:14.669071] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:14.670144] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 37673 primary records. [2025-10-03T22:41:14.670296] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-03T22:41:14.690440] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-10-03T22:41:14.691437] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-03T22:41:14.694686] [INFO ] [MAIN ] Derivative Progress: 1103/2073 symbols completed. LTM took 1.2s. Estimated remaining: 6m 42s. Rate: 144.9 symbols/min [2025-10-03T22:41:14.694954] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:14.714873] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:14.715878] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49698 primary records. [2025-10-03T22:41:14.716009] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-03T22:41:14.741341] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-10-03T22:41:14.742265] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-03T22:41:14.742091] [DEBUG] [LOCAL ] LUCK: Loaded 24969 existing records from primary storage. [2025-10-03T22:41:14.742360] [INFO ] [MAIN ] LUCK: Loaded 24969 primary data records. [2025-10-03T22:41:14.745119] [INFO ] [MAIN ] Derivative Progress: 1104/2073 symbols completed. LU took 1.2s. Estimated remaining: 6m 41s. Rate: 145.0 symbols/min [2025-10-03T22:41:14.745314] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:15.109748] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-10-03T22:41:15.110759] [INFO ] [MAIN ] LUMN: Loaded 54414 primary data records. [2025-10-03T22:41:15.338164] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-03T22:41:15.345299] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-10-03T22:41:15.678119] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:15.693440] [INFO ] [MAIN ] LUCK: Generated 1820 derivative records from 24969 primary records. [2025-10-03T22:41:15.693549] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-03T22:41:15.869238] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1820 records). [2025-10-03T22:41:15.869813] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-03T22:41:15.873965] [INFO ] [MAIN ] Derivative Progress: 1105/2073 symbols completed. LUCK took 1.2s. Estimated remaining: 6m 41s. Rate: 144.8 symbols/min [2025-10-03T22:41:15.874393] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:15.896192] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:15.897110] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54414 primary records. [2025-10-03T22:41:15.897341] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-03T22:41:15.914490] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-10-03T22:41:15.914822] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-03T22:41:15.918452] [INFO ] [MAIN ] Derivative Progress: 1106/2073 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 40s. Rate: 144.9 symbols/min [2025-10-03T22:41:15.918619] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:15.950081] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:15.950959] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-10-03T22:41:15.951035] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-03T22:41:15.992493] [DEBUG] [LOCAL ] LVWR: Loaded 18043 existing records from primary storage. [2025-10-03T22:41:15.993845] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-10-03T22:41:15.993947] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-03T22:41:15.994036] [INFO ] [MAIN ] LVWR: Loaded 18043 primary data records. [2025-10-03T22:41:15.996818] [INFO ] [MAIN ] Derivative Progress: 1107/2073 symbols completed. LUV took 1.3s. Estimated remaining: 6m 40s. Rate: 145.0 symbols/min [2025-10-03T22:41:16.003529] [DEBUG] [LOCAL ] LVS: Loaded 54343 existing records from primary storage. [2025-10-03T22:41:16.010139] [INFO ] [MAIN ] LVS: Loaded 54343 primary data records. [2025-10-03T22:41:15.997101] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:16.677332] [DEBUG] [LOCAL ] LW: Loaded 51931 existing records from primary storage. [2025-10-03T22:41:16.678583] [INFO ] [MAIN ] LW: Loaded 51931 primary data records. [2025-10-03T22:41:16.848638] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:16.895690] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 18043 primary records. [2025-10-03T22:41:16.896018] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-03T22:41:17.053470] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-10-03T22:41:17.053869] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-03T22:41:17.052353] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:17.055177] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54343 primary records. [2025-10-03T22:41:17.055704] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-03T22:41:17.058688] [INFO ] [MAIN ] Derivative Progress: 1108/2073 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 40s. Rate: 144.8 symbols/min [2025-10-03T22:41:17.077664] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-10-03T22:41:17.077804] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-03T22:41:17.080721] [INFO ] [MAIN ] Derivative Progress: 1109/2073 symbols completed. LVS took 1.2s. Estimated remaining: 6m 39s. Rate: 145.0 symbols/min [2025-10-03T22:41:17.099010] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:17.099625] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51931 primary records. [2025-10-03T22:41:17.099713] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-03T22:41:17.115907] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-10-03T22:41:17.115974] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-03T22:41:17.118480] [INFO ] [MAIN ] Derivative Progress: 1110/2073 symbols completed. LW took 1.1s. Estimated remaining: 6m 38s. Rate: 145.1 symbols/min [2025-10-03T22:41:17.119097] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:17.119039] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:17.119226] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:17.145613] [DEBUG] [LOCAL ] LXFR: Loaded 17050 existing records from primary storage. [2025-10-03T22:41:17.145789] [INFO ] [MAIN ] LXFR: Loaded 17050 primary data records. [2025-10-03T22:41:17.297734] [DEBUG] [LOCAL ] LXU: Loaded 32152 existing records from primary storage. [2025-10-03T22:41:17.377638] [INFO ] [MAIN ] LXU: Loaded 32152 primary data records. [2025-10-03T22:41:17.384957] [DEBUG] [LOCAL ] LXP: Loaded 51444 existing records from primary storage. [2025-10-03T22:41:17.579237] [INFO ] [MAIN ] LXP: Loaded 51444 primary data records. [2025-10-03T22:41:18.220958] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:18.222324] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 17050 primary records. [2025-10-03T22:41:18.222616] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-03T22:41:18.242283] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-10-03T22:41:18.242560] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-03T22:41:18.245334] [INFO ] [MAIN ] Derivative Progress: 1111/2073 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 38s. Rate: 144.9 symbols/min [2025-10-03T22:41:18.245827] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:18.280321] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:18.281571] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51444 primary records. [2025-10-03T22:41:18.280829] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:18.282340] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32152 primary records. [2025-10-03T22:41:18.282681] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-03T22:41:18.282515] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-03T22:41:18.345546] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-10-03T22:41:18.346056] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-03T22:41:18.349441] [INFO ] [MAIN ] Derivative Progress: 1112/2073 symbols completed. LXP took 1.2s. Estimated remaining: 6m 38s. Rate: 145.0 symbols/min [2025-10-03T22:41:18.349941] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:18.355346] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-10-03T22:41:18.355541] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-03T22:41:18.358701] [INFO ] [MAIN ] Derivative Progress: 1113/2073 symbols completed. LXU took 1.2s. Estimated remaining: 6m 37s. Rate: 145.1 symbols/min [2025-10-03T22:41:18.359219] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:18.414767] [DEBUG] [LOCAL ] LYB: Loaded 54382 existing records from primary storage. [2025-10-03T22:41:18.415085] [INFO ] [MAIN ] LYB: Loaded 54382 primary data records. [2025-10-03T22:41:18.628435] [DEBUG] [LOCAL ] LYG: Loaded 53556 existing records from primary storage. [2025-10-03T22:41:18.658912] [INFO ] [MAIN ] LYG: Loaded 53556 primary data records. [2025-10-03T22:41:18.702325] [DEBUG] [LOCAL ] LYV: Loaded 51873 existing records from primary storage. [2025-10-03T22:41:18.829337] [INFO ] [MAIN ] LYV: Loaded 51873 primary data records. [2025-10-03T22:41:19.435858] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:19.436954] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54382 primary records. [2025-10-03T22:41:19.438637] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-03T22:41:19.460454] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-10-03T22:41:19.474740] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-03T22:41:19.477490] [INFO ] [MAIN ] Derivative Progress: 1114/2073 symbols completed. LYB took 1.2s. Estimated remaining: 6m 37s. Rate: 144.9 symbols/min [2025-10-03T22:41:19.478755] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:19.479524] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51873 primary records. [2025-10-03T22:41:19.479924] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-03T22:41:19.479857] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:19.513582] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:19.515708] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53556 primary records. [2025-10-03T22:41:19.516080] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-03T22:41:19.535358] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-10-03T22:41:19.536053] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-03T22:41:19.539135] [INFO ] [MAIN ] Derivative Progress: 1115/2073 symbols completed. LYG took 1.2s. Estimated remaining: 6m 36s. Rate: 145.0 symbols/min [2025-10-03T22:41:19.540140] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-10-03T22:41:19.539975] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:19.540313] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-03T22:41:19.546889] [INFO ] [MAIN ] Derivative Progress: 1116/2073 symbols completed. LYV took 1.2s. Estimated remaining: 6m 36s. Rate: 145.1 symbols/min [2025-10-03T22:41:19.547370] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:19.575769] [DEBUG] [LOCAL ] LZB: Loaded 35982 existing records from primary storage. [2025-10-03T22:41:19.575971] [INFO ] [MAIN ] LZB: Loaded 35982 primary data records. [2025-10-03T22:41:19.592820] [DEBUG] [LOCAL ] LZM: Loaded 14413 existing records from primary storage. [2025-10-03T22:41:19.618611] [INFO ] [MAIN ] LZM: Loaded 14413 primary data records. [2025-10-03T22:41:20.258606] [DEBUG] [LOCAL ] M: Loaded 54314 existing records from primary storage. [2025-10-03T22:41:20.259274] [INFO ] [MAIN ] M: Loaded 54314 primary data records. [2025-10-03T22:41:20.584354] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:20.585683] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 35982 primary records. [2025-10-03T22:41:20.585853] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-03T22:41:20.619192] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:20.618892] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-10-03T22:41:20.620102] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 14413 primary records. [2025-10-03T22:41:20.620491] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-03T22:41:20.624547] [INFO ] [MAIN ] Derivative Progress: 1117/2073 symbols completed. LZB took 1.1s. Estimated remaining: 6m 36s. Rate: 144.9 symbols/min [2025-10-03T22:41:20.624868] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-03T22:41:20.624799] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:20.644236] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-10-03T22:41:20.644377] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-03T22:41:20.647458] [INFO ] [MAIN ] Derivative Progress: 1118/2073 symbols completed. LZM took 1.1s. Estimated remaining: 6m 35s. Rate: 145.0 symbols/min [2025-10-03T22:41:20.647953] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:20.667388] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:20.668325] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54314 primary records. [2025-10-03T22:41:20.668988] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-03T22:41:20.691626] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-10-03T22:41:20.692005] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-03T22:41:20.695239] [INFO ] [MAIN ] Derivative Progress: 1119/2073 symbols completed. M took 1.1s. Estimated remaining: 6m 34s. Rate: 145.1 symbols/min [2025-10-03T22:41:20.695467] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:20.741826] [DEBUG] [LOCAL ] MAA: Loaded 43243 existing records from primary storage. [2025-10-03T22:41:20.756765] [INFO ] [MAIN ] MAA: Loaded 43243 primary data records. [2025-10-03T22:41:20.793389] [DEBUG] [LOCAL ] MA: Loaded 53281 existing records from primary storage. [2025-10-03T22:41:20.826989] [INFO ] [MAIN ] MA: Loaded 53281 primary data records. [2025-10-03T22:41:21.394981] [DEBUG] [LOCAL ] MAC: Loaded 50400 existing records from primary storage. [2025-10-03T22:41:21.395193] [INFO ] [MAIN ] MAC: Loaded 50400 primary data records. [2025-10-03T22:41:21.785104] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:21.786462] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43243 primary records. [2025-10-03T22:41:21.786894] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-03T22:41:21.806493] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-10-03T22:41:21.808381] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-03T22:41:21.811288] [INFO ] [MAIN ] Derivative Progress: 1120/2073 symbols completed. MAA took 1.2s. Estimated remaining: 6m 35s. Rate: 144.9 symbols/min [2025-10-03T22:41:21.812759] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:21.826807] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:21.827684] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53281 primary records. [2025-10-03T22:41:21.827917] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-03T22:41:21.849450] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-10-03T22:41:21.849789] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-03T22:41:21.852699] [INFO ] [MAIN ] Derivative Progress: 1121/2073 symbols completed. MA took 1.2s. Estimated remaining: 6m 34s. Rate: 145.0 symbols/min [2025-10-03T22:41:21.866531] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:21.867373] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:21.868597] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50400 primary records. [2025-10-03T22:41:21.877597] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-03T22:41:21.894928] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-10-03T22:41:21.895315] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-03T22:41:21.907923] [INFO ] [MAIN ] Derivative Progress: 1122/2073 symbols completed. MAC took 1.2s. Estimated remaining: 6m 33s. Rate: 145.1 symbols/min [2025-10-03T22:41:21.909818] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:21.911328] [DEBUG] [LOCAL ] MAGN: Loaded 35600 existing records from primary storage. [2025-10-03T22:41:21.911471] [INFO ] [MAIN ] MAGN: Loaded 35600 primary data records. [2025-10-03T22:41:22.145188] [DEBUG] [LOCAL ] MAIN: Loaded 41732 existing records from primary storage. [2025-10-03T22:41:22.266002] [INFO ] [MAIN ] MAIN: Loaded 41732 primary data records. [2025-10-03T22:41:22.317508] [DEBUG] [LOCAL ] MAN: Loaded 44133 existing records from primary storage. [2025-10-03T22:41:22.336707] [INFO ] [MAIN ] MAN: Loaded 44133 primary data records. [2025-10-03T22:41:22.920451] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:22.921760] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 35600 primary records. [2025-10-03T22:41:22.922011] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-03T22:41:22.958361] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:22.961252] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 41732 primary records. [2025-10-03T22:41:22.961568] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-03T22:41:22.962027] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-10-03T22:41:22.973550] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-03T22:41:22.980508] [INFO ] [MAIN ] Derivative Progress: 1123/2073 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 33s. Rate: 144.9 symbols/min [2025-10-03T22:41:22.995092] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:22.996376] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44133 primary records. [2025-10-03T22:41:22.996469] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-03T22:41:23.014790] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-10-03T22:41:23.014889] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-03T22:41:23.018039] [INFO ] [MAIN ] Derivative Progress: 1124/2073 symbols completed. MAN took 1.1s. Estimated remaining: 6m 33s. Rate: 145.0 symbols/min [2025-10-03T22:41:23.019060] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-10-03T22:41:23.019223] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-03T22:41:23.021815] [INFO ] [MAIN ] Derivative Progress: 1125/2073 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 32s. Rate: 145.2 symbols/min [2025-10-03T22:41:23.022295] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:23.022409] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:23.022686] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:23.097312] [DEBUG] [LOCAL ] MATV: Loaded 37127 existing records from primary storage. [2025-10-03T22:41:23.097550] [INFO ] [MAIN ] MATV: Loaded 37127 primary data records. [2025-10-03T22:41:23.189067] [DEBUG] [LOCAL ] MANU: Loaded 27150 existing records from primary storage. [2025-10-03T22:41:23.207936] [INFO ] [MAIN ] MANU: Loaded 27150 primary data records. [2025-10-03T22:41:23.247573] [DEBUG] [LOCAL ] MAS: Loaded 53080 existing records from primary storage. [2025-10-03T22:41:23.383179] [INFO ] [MAIN ] MAS: Loaded 53080 primary data records. [2025-10-03T22:41:24.104318] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:24.105377] [INFO ] [MAIN ] MATV: Generated 1820 derivative records from 37127 primary records. [2025-10-03T22:41:24.105872] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-03T22:41:24.130686] [DEBUG] [LOCAL ] MATV: Derivative data saved (1820 records). [2025-10-03T22:41:24.139434] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-03T22:41:24.143132] [INFO ] [MAIN ] Derivative Progress: 1126/2073 symbols completed. MATV took 1.1s. Estimated remaining: 6m 32s. Rate: 145.0 symbols/min [2025-10-03T22:41:24.148264] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:24.149045] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:24.149867] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27150 primary records. [2025-10-03T22:41:24.151033] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-03T22:41:24.179855] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:24.180989] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53080 primary records. [2025-10-03T22:41:24.181303] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-03T22:41:24.190347] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-10-03T22:41:24.190479] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-03T22:41:24.196927] [INFO ] [MAIN ] Derivative Progress: 1127/2073 symbols completed. MANU took 1.2s. Estimated remaining: 6m 31s. Rate: 145.1 symbols/min [2025-10-03T22:41:24.197351] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:24.213632] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-10-03T22:41:24.213946] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-03T22:41:24.216904] [INFO ] [MAIN ] Derivative Progress: 1128/2073 symbols completed. MAS took 1.2s. Estimated remaining: 6m 31s. Rate: 145.2 symbols/min [2025-10-03T22:41:24.217334] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:24.239469] [DEBUG] [LOCAL ] MATX: Loaded 31889 existing records from primary storage. [2025-10-03T22:41:24.239716] [INFO ] [MAIN ] MATX: Loaded 31889 primary data records. [2025-10-03T22:41:24.379782] [DEBUG] [LOCAL ] MAX: Loaded 31182 existing records from primary storage. [2025-10-03T22:41:24.414705] [INFO ] [MAIN ] MAX: Loaded 31182 primary data records. [2025-10-03T22:41:24.607764] [DEBUG] [LOCAL ] MBC: Loaded 43945 existing records from primary storage. [2025-10-03T22:41:24.635924] [INFO ] [MAIN ] MBC: Loaded 43945 primary data records. [2025-10-03T22:41:25.208964] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:25.210188] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 31889 primary records. [2025-10-03T22:41:25.210789] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-03T22:41:25.246693] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:25.248928] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31182 primary records. [2025-10-03T22:41:25.249891] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-10-03T22:41:25.249733] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-03T22:41:25.250496] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-03T22:41:25.261791] [INFO ] [MAIN ] Derivative Progress: 1129/2073 symbols completed. MATX took 1.1s. Estimated remaining: 6m 31s. Rate: 145.0 symbols/min [2025-10-03T22:41:25.262081] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:25.286286] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:25.288012] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 43945 primary records. [2025-10-03T22:41:25.288807] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-03T22:41:25.313054] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-10-03T22:41:25.313983] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-03T22:41:25.316957] [INFO ] [MAIN ] Derivative Progress: 1130/2073 symbols completed. MAX took 1.1s. Estimated remaining: 6m 30s. Rate: 145.1 symbols/min [2025-10-03T22:41:25.317424] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:25.329626] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-10-03T22:41:25.329933] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-03T22:41:25.332885] [INFO ] [MAIN ] Derivative Progress: 1131/2073 symbols completed. MBC took 1.1s. Estimated remaining: 6m 29s. Rate: 145.2 symbols/min [2025-10-03T22:41:25.333261] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:25.344790] [DEBUG] [LOCAL ] MBI: Loaded 24622 existing records from primary storage. [2025-10-03T22:41:25.345072] [INFO ] [MAIN ] MBI: Loaded 24622 primary data records. [2025-10-03T22:41:25.469493] [DEBUG] [LOCAL ] MCB: Loaded 11506 existing records from primary storage. [2025-10-03T22:41:25.469776] [INFO ] [MAIN ] MCB: Loaded 11506 primary data records. [2025-10-03T22:41:25.844920] [DEBUG] [LOCAL ] MC: Loaded 44681 existing records from primary storage. [2025-10-03T22:41:25.851600] [INFO ] [MAIN ] MC: Loaded 44681 primary data records. [2025-10-03T22:41:26.393270] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:26.394596] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24622 primary records. [2025-10-03T22:41:26.394850] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-03T22:41:26.431604] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-10-03T22:41:26.432345] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-03T22:41:26.432117] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:26.435483] [INFO ] [MAIN ] Derivative Progress: 1132/2073 symbols completed. MBI took 1.2s. Estimated remaining: 6m 29s. Rate: 145.0 symbols/min [2025-10-03T22:41:26.436306] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11506 primary records. [2025-10-03T22:41:26.437074] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-03T22:41:26.436783] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:26.460791] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-10-03T22:41:26.468885] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-03T22:41:26.471894] [INFO ] [MAIN ] Derivative Progress: 1133/2073 symbols completed. MCB took 1.1s. Estimated remaining: 6m 29s. Rate: 145.1 symbols/min [2025-10-03T22:41:26.481973] [DEBUG] [LOCAL ] MCI: Loaded 6499 existing records from primary storage. [2025-10-03T22:41:26.482477] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:26.483241] [INFO ] [MAIN ] MCI: Loaded 6499 primary data records. [2025-10-03T22:41:26.482354] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:26.484098] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44681 primary records. [2025-10-03T22:41:26.496087] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-03T22:41:26.619838] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-10-03T22:41:26.635545] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-03T22:41:26.645243] [INFO ] [MAIN ] Derivative Progress: 1134/2073 symbols completed. MC took 1.3s. Estimated remaining: 6m 28s. Rate: 145.2 symbols/min [2025-10-03T22:41:26.677346] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:26.837143] [DEBUG] [LOCAL ] MCN: Loaded 8300 existing records from primary storage. [2025-10-03T22:41:26.837701] [INFO ] [MAIN ] MCN: Loaded 8300 primary data records. [2025-10-03T22:41:26.967365] [DEBUG] [LOCAL ] MCK: Loaded 39685 existing records from primary storage. [2025-10-03T22:41:26.988433] [INFO ] [MAIN ] MCK: Loaded 39685 primary data records. [2025-10-03T22:41:27.361569] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:27.366942] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6499 primary records. [2025-10-03T22:41:27.484214] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-03T22:41:27.505822] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-10-03T22:41:27.506839] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-03T22:41:27.509625] [INFO ] [MAIN ] Derivative Progress: 1135/2073 symbols completed. MCI took 1.1s. Estimated remaining: 6m 28s. Rate: 145.1 symbols/min [2025-10-03T22:41:27.510272] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:27.542736] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:27.543860] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8300 primary records. [2025-10-03T22:41:27.557768] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-03T22:41:27.558437] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:27.560288] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39685 primary records. [2025-10-03T22:41:27.560488] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-03T22:41:27.605118] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-10-03T22:41:27.606409] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-03T22:41:27.611187] [INFO ] [MAIN ] Derivative Progress: 1136/2073 symbols completed. MCK took 1.1s. Estimated remaining: 6m 27s. Rate: 145.2 symbols/min [2025-10-03T22:41:27.622281] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:27.626109] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-10-03T22:41:27.626257] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-03T22:41:27.629956] [INFO ] [MAIN ] Derivative Progress: 1137/2073 symbols completed. MCN took 1.0s. Estimated remaining: 6m 27s. Rate: 145.3 symbols/min [2025-10-03T22:41:27.630300] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:27.631778] [DEBUG] [LOCAL ] MCO: Loaded 39892 existing records from primary storage. [2025-10-03T22:41:27.631932] [INFO ] [MAIN ] MCO: Loaded 39892 primary data records. [2025-10-03T22:41:27.716930] [DEBUG] [LOCAL ] MCR: Loaded 8848 existing records from primary storage. [2025-10-03T22:41:27.733246] [INFO ] [MAIN ] MCR: Loaded 8848 primary data records. [2025-10-03T22:41:27.863431] [DEBUG] [LOCAL ] MCS: Loaded 21303 existing records from primary storage. [2025-10-03T22:41:27.899428] [INFO ] [MAIN ] MCS: Loaded 21303 primary data records. [2025-10-03T22:41:28.688137] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:28.690219] [INFO ] [MAIN ] MCO: Generated 1820 derivative records from 39892 primary records. [2025-10-03T22:41:28.698093] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-03T22:41:28.703692] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:28.705439] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 8848 primary records. [2025-10-03T22:41:28.714341] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-03T22:41:28.738202] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-10-03T22:41:28.738397] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-03T22:41:28.741509] [INFO ] [MAIN ] Derivative Progress: 1138/2073 symbols completed. MCR took 1.1s. Estimated remaining: 6m 27s. Rate: 145.1 symbols/min [2025-10-03T22:41:28.755332] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:28.756515] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21303 primary records. [2025-10-03T22:41:28.757204] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-03T22:41:28.758284] [DEBUG] [LOCAL ] MCO: Derivative data saved (1820 records). [2025-10-03T22:41:28.758630] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-03T22:41:28.761541] [INFO ] [MAIN ] Derivative Progress: 1139/2073 symbols completed. MCO took 1.3s. Estimated remaining: 6m 26s. Rate: 145.2 symbols/min [2025-10-03T22:41:28.777027] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-10-03T22:41:28.777097] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-03T22:41:28.780280] [INFO ] [MAIN ] Derivative Progress: 1140/2073 symbols completed. MCS took 1.1s. Estimated remaining: 6m 25s. Rate: 145.3 symbols/min [2025-10-03T22:41:28.780679] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:28.780834] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:28.781246] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:28.792126] [DEBUG] [LOCAL ] MDST: Loaded 5772 existing records from primary storage. [2025-10-03T22:41:28.792301] [INFO ] [MAIN ] MDST: Loaded 5772 primary data records. [2025-10-03T22:41:28.914298] [DEBUG] [LOCAL ] MCY: Loaded 24734 existing records from primary storage. [2025-10-03T22:41:28.915066] [INFO ] [MAIN ] MCY: Loaded 24734 primary data records. [2025-10-03T22:41:29.239573] [DEBUG] [LOCAL ] MD: Loaded 38895 existing records from primary storage. [2025-10-03T22:41:29.245234] [INFO ] [MAIN ] MD: Loaded 38895 primary data records. [2025-10-03T22:41:29.855364] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:29.857200] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5772 primary records. [2025-10-03T22:41:29.857539] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-03T22:41:29.874978] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-10-03T22:41:29.875741] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-03T22:41:29.878303] [INFO ] [MAIN ] Derivative Progress: 1141/2073 symbols completed. MDST took 1.1s. Estimated remaining: 6m 25s. Rate: 145.1 symbols/min [2025-10-03T22:41:29.879382] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:29.900253] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:29.901634] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 24734 primary records. [2025-10-03T22:41:29.901854] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-03T22:41:29.936989] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-10-03T22:41:29.937684] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:29.937757] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-03T22:41:29.941013] [INFO ] [MAIN ] Derivative Progress: 1142/2073 symbols completed. MCY took 1.2s. Estimated remaining: 6m 25s. Rate: 145.2 symbols/min [2025-10-03T22:41:29.942283] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 38895 primary records. [2025-10-03T22:41:29.941231] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:29.942473] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-03T22:41:29.976177] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-10-03T22:41:29.976474] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-03T22:41:29.979569] [INFO ] [MAIN ] Derivative Progress: 1143/2073 symbols completed. MD took 1.2s. Estimated remaining: 6m 24s. Rate: 145.3 symbols/min [2025-10-03T22:41:29.980025] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:30.000510] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-03T22:41:30.000963] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-10-03T22:41:30.127984] [DEBUG] [LOCAL ] MEC: Loaded 16493 existing records from primary storage. [2025-10-03T22:41:30.128244] [INFO ] [MAIN ] MEC: Loaded 16493 primary data records. [2025-10-03T22:41:30.447319] [DEBUG] [LOCAL ] MDU: Loaded 48708 existing records from primary storage. [2025-10-03T22:41:30.462924] [INFO ] [MAIN ] MDU: Loaded 48708 primary data records. [2025-10-03T22:41:31.021175] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:31.022701] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-10-03T22:41:31.022852] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-03T22:41:31.060130] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:31.059835] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-10-03T22:41:31.061121] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-03T22:41:31.061029] [INFO ] [MAIN ] MEC: Generated 1820 derivative records from 16493 primary records. [2025-10-03T22:41:31.064053] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-03T22:41:31.063906] [INFO ] [MAIN ] Derivative Progress: 1144/2073 symbols completed. MDT took 1.2s. Estimated remaining: 6m 24s. Rate: 145.1 symbols/min [2025-10-03T22:41:31.065005] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:31.085714] [DEBUG] [LOCAL ] MEC: Derivative data saved (1820 records). [2025-10-03T22:41:31.085975] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-03T22:41:31.089159] [INFO ] [MAIN ] Derivative Progress: 1145/2073 symbols completed. MEC took 1.1s. Estimated remaining: 6m 23s. Rate: 145.2 symbols/min [2025-10-03T22:41:31.089721] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:31.110319] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:31.111765] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48708 primary records. [2025-10-03T22:41:31.111970] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-03T22:41:31.138989] [DEBUG] [LOCAL ] MED: Loaded 21777 existing records from primary storage. [2025-10-03T22:41:31.139471] [INFO ] [MAIN ] MED: Loaded 21777 primary data records. [2025-10-03T22:41:31.212295] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-10-03T22:41:31.241020] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-03T22:41:31.249622] [INFO ] [MAIN ] Derivative Progress: 1146/2073 symbols completed. MDU took 1.3s. Estimated remaining: 6m 23s. Rate: 145.3 symbols/min [2025-10-03T22:41:31.257346] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:31.347466] [DEBUG] [LOCAL ] MEG: Loaded 32328 existing records from primary storage. [2025-10-03T22:41:31.480232] [INFO ] [MAIN ] MEG: Loaded 32328 primary data records. [2025-10-03T22:41:31.580142] [DEBUG] [LOCAL ] MEGI: Loaded 20332 existing records from primary storage. [2025-10-03T22:41:31.588591] [INFO ] [MAIN ] MEGI: Loaded 20332 primary data records. [2025-10-03T22:41:32.182164] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:32.184105] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 21777 primary records. [2025-10-03T22:41:32.185551] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-03T22:41:32.204504] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-10-03T22:41:32.204775] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-03T22:41:32.207173] [INFO ] [MAIN ] Derivative Progress: 1147/2073 symbols completed. MED took 1.1s. Estimated remaining: 6m 23s. Rate: 145.1 symbols/min [2025-10-03T22:41:32.207570] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:32.225904] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:32.228462] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32328 primary records. [2025-10-03T22:41:32.229365] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-03T22:41:32.243566] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:32.255761] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20332 primary records. [2025-10-03T22:41:32.264900] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-03T22:41:32.283461] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-10-03T22:41:32.293095] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-03T22:41:32.296843] [INFO ] [MAIN ] Derivative Progress: 1148/2073 symbols completed. MEG took 1.2s. Estimated remaining: 6m 22s. Rate: 145.2 symbols/min [2025-10-03T22:41:32.297309] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:32.299353] [DEBUG] [LOCAL ] MEI: Loaded 32495 existing records from primary storage. [2025-10-03T22:41:32.300251] [INFO ] [MAIN ] MEI: Loaded 32495 primary data records. [2025-10-03T22:41:32.300608] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-10-03T22:41:32.322306] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-03T22:41:32.335855] [INFO ] [MAIN ] Derivative Progress: 1149/2073 symbols completed. MEGI took 1.1s. Estimated remaining: 6m 21s. Rate: 145.4 symbols/min [2025-10-03T22:41:32.348353] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:32.678538] [DEBUG] [LOCAL ] MET: Loaded 54091 existing records from primary storage. [2025-10-03T22:41:32.679206] [INFO ] [MAIN ] MET: Loaded 54091 primary data records. [2025-10-03T22:41:32.807989] [DEBUG] [LOCAL ] MFA: Loaded 46145 existing records from primary storage. [2025-10-03T22:41:32.809950] [INFO ] [MAIN ] MFA: Loaded 46145 primary data records. [2025-10-03T22:41:33.131613] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:33.147061] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32495 primary records. [2025-10-03T22:41:33.147638] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-03T22:41:33.360629] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-10-03T22:41:33.361284] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-03T22:41:33.363974] [INFO ] [MAIN ] Derivative Progress: 1150/2073 symbols completed. MEI took 1.2s. Estimated remaining: 6m 21s. Rate: 145.2 symbols/min [2025-10-03T22:41:33.364277] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:33.372825] [DEBUG] [LOCAL ] MFAN: Loaded 4303 existing records from primary storage. [2025-10-03T22:41:33.373895] [INFO ] [MAIN ] MFAN: Loaded 4303 primary data records. [2025-10-03T22:41:33.742733] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:33.746506] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54091 primary records. [2025-10-03T22:41:33.746866] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-03T22:41:33.773250] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:33.777393] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-10-03T22:41:33.778346] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46145 primary records. [2025-10-03T22:41:33.778627] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-03T22:41:33.778756] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-03T22:41:33.782050] [INFO ] [MAIN ] Derivative Progress: 1151/2073 symbols completed. MET took 1.5s. Estimated remaining: 6m 21s. Rate: 145.2 symbols/min [2025-10-03T22:41:33.789992] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:33.799772] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-10-03T22:41:33.801224] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-03T22:41:33.803950] [DEBUG] [LOCAL ] MFAO: Loaded 3886 existing records from primary storage. [2025-10-03T22:41:33.804152] [INFO ] [MAIN ] MFAO: Loaded 3886 primary data records. [2025-10-03T22:41:33.807094] [INFO ] [MAIN ] Derivative Progress: 1152/2073 symbols completed. MFA took 1.5s. Estimated remaining: 6m 20s. Rate: 145.3 symbols/min [2025-10-03T22:41:33.807627] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:34.132206] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:41:34.133923] [INFO ] [MAIN ] MFAN: Generated 1818 derivative records from 4303 primary records. [2025-10-03T22:41:34.134298] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-03T22:41:34.168629] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1818 records). [2025-10-03T22:41:34.169156] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-03T22:41:34.172490] [INFO ] [MAIN ] Derivative Progress: 1153/2073 symbols completed. MFAN took 0.8s. Estimated remaining: 6m 20s. Rate: 145.3 symbols/min [2025-10-03T22:41:34.189237] [DEBUG] [LOCAL ] MFC: Loaded 51889 existing records from primary storage. [2025-10-03T22:41:34.189560] [INFO ] [MAIN ] MFC: Loaded 51889 primary data records. [2025-10-03T22:41:34.366113] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:41:34.386384] [INFO ] [MAIN ] MFAO: Generated 1819 derivative records from 3886 primary records. [2025-10-03T22:41:34.500672] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-03T22:41:34.518554] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1819 records). [2025-10-03T22:41:34.518829] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-03T22:41:34.521741] [INFO ] [MAIN ] Derivative Progress: 1154/2073 symbols completed. MFAO took 0.7s. Estimated remaining: 6m 19s. Rate: 145.3 symbols/min [2025-10-03T22:41:34.541406] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:34.542043] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 51889 primary records. [2025-10-03T22:41:34.542106] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-03T22:41:34.557607] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-10-03T22:41:34.557693] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-03T22:41:34.560143] [INFO ] [MAIN ] Derivative Progress: 1155/2073 symbols completed. MFC took 0.8s. Estimated remaining: 6m 19s. Rate: 145.4 symbols/min [2025-10-03T22:41:34.560905] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:34.561085] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:34.561025] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:34.580720] [DEBUG] [LOCAL ] MFM: Loaded 14967 existing records from primary storage. [2025-10-03T22:41:34.575819] [DEBUG] [LOCAL ] MFSG: Loaded 5487 existing records from primary storage. [2025-10-03T22:41:34.580871] [INFO ] [MAIN ] MFSG: Loaded 5487 primary data records. [2025-10-03T22:41:34.580953] [INFO ] [MAIN ] MFM: Loaded 14967 primary data records. [2025-10-03T22:41:35.206216] [DEBUG] [LOCAL ] MFG: Loaded 49937 existing records from primary storage. [2025-10-03T22:41:35.220729] [INFO ] [MAIN ] MFG: Loaded 49937 primary data records. [2025-10-03T22:41:35.565747] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:35.566717] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14967 primary records. [2025-10-03T22:41:35.567879] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:41:35.568508] [INFO ] [MAIN ] MFSG: Generated 1819 derivative records from 5487 primary records. [2025-10-03T22:41:35.567347] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-03T22:41:35.569233] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-03T22:41:35.597596] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1819 records). [2025-10-03T22:41:35.597998] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-03T22:41:35.601298] [INFO ] [MAIN ] Derivative Progress: 1156/2073 symbols completed. MFSG took 1.0s. Estimated remaining: 6m 19s. Rate: 145.2 symbols/min [2025-10-03T22:41:35.601735] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:35.602982] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-10-03T22:41:35.603673] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-03T22:41:35.606178] [INFO ] [MAIN ] Derivative Progress: 1157/2073 symbols completed. MFM took 1.0s. Estimated remaining: 6m 18s. Rate: 145.4 symbols/min [2025-10-03T22:41:35.606506] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:35.630622] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:35.630316] [DEBUG] [LOCAL ] MFSV: Loaded 2639 existing records from primary storage. [2025-10-03T22:41:35.631462] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 49937 primary records. [2025-10-03T22:41:35.630831] [INFO ] [MAIN ] MFSV: Loaded 2639 primary data records. [2025-10-03T22:41:35.635596] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-03T22:41:35.658794] [DEBUG] [LOCAL ] MFSI: Loaded 11669 existing records from primary storage. [2025-10-03T22:41:35.695440] [INFO ] [MAIN ] MFSI: Loaded 11669 primary data records. [2025-10-03T22:41:35.852551] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-10-03T22:41:35.900860] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-03T22:41:35.926894] [INFO ] [MAIN ] Derivative Progress: 1158/2073 symbols completed. MFG took 1.4s. Estimated remaining: 6m 18s. Rate: 145.4 symbols/min [2025-10-03T22:41:36.102116] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:36.300892] [DEBUG] [LOCAL ] MG: Loaded 16608 existing records from primary storage. [2025-10-03T22:41:36.301394] [INFO ] [MAIN ] MG: Loaded 16608 primary data records. [2025-10-03T22:41:36.583337] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:41:36.629468] [INFO ] [MAIN ] MFSV: Generated 1818 derivative records from 2639 primary records. [2025-10-03T22:41:36.629805] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-03T22:41:36.659351] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:41:36.659924] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1818 records). [2025-10-03T22:41:36.660222] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-03T22:41:36.660957] [INFO ] [MAIN ] MFSI: Generated 1819 derivative records from 11669 primary records. [2025-10-03T22:41:36.663955] [INFO ] [MAIN ] Derivative Progress: 1159/2073 symbols completed. MFSV took 1.1s. Estimated remaining: 6m 17s. Rate: 145.3 symbols/min [2025-10-03T22:41:36.664288] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:36.664467] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-03T22:41:36.684878] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1819 records). [2025-10-03T22:41:36.684978] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-03T22:41:36.687256] [INFO ] [MAIN ] Derivative Progress: 1160/2073 symbols completed. MFSI took 1.1s. Estimated remaining: 6m 17s. Rate: 145.4 symbols/min [2025-10-03T22:41:36.687599] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:36.697293] [DEBUG] [LOCAL ] MGF: Loaded 4313 existing records from primary storage. [2025-10-03T22:41:36.698696] [INFO ] [MAIN ] MGF: Loaded 4313 primary data records. [2025-10-03T22:41:36.803519] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:36.835496] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16608 primary records. [2025-10-03T22:41:36.839467] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-03T22:41:36.949593] [DEBUG] [LOCAL ] MGA: Loaded 51428 existing records from primary storage. [2025-10-03T22:41:36.988703] [INFO ] [MAIN ] MGA: Loaded 51428 primary data records. [2025-10-03T22:41:37.171808] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-10-03T22:41:37.190675] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-03T22:41:37.194003] [INFO ] [MAIN ] Derivative Progress: 1161/2073 symbols completed. MG took 1.1s. Estimated remaining: 6m 16s. Rate: 145.4 symbols/min [2025-10-03T22:41:37.194739] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:37.418566] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:37.419516] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4313 primary records. [2025-10-03T22:41:37.419908] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-03T22:41:37.449832] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-10-03T22:41:37.450145] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-03T22:41:37.452850] [INFO ] [MAIN ] Derivative Progress: 1162/2073 symbols completed. MGF took 0.8s. Estimated remaining: 6m 16s. Rate: 145.4 symbols/min [2025-10-03T22:41:37.453382] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:37.474956] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-10-03T22:41:37.476057] [INFO ] [MAIN ] MGM: Loaded 54387 primary data records. [2025-10-03T22:41:37.479217] [DEBUG] [LOCAL ] MGR: Loaded 5687 existing records from primary storage. [2025-10-03T22:41:37.511994] [INFO ] [MAIN ] MGR: Loaded 5687 primary data records. [2025-10-03T22:41:37.528158] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:37.588313] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51428 primary records. [2025-10-03T22:41:37.634722] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-03T22:41:38.043856] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-10-03T22:41:38.044179] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-03T22:41:38.163396] [INFO ] [MAIN ] Derivative Progress: 1163/2073 symbols completed. MGA took 1.5s. Estimated remaining: 6m 16s. Rate: 145.3 symbols/min [2025-10-03T22:41:38.164461] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:38.181613] [DEBUG] [LOCAL ] MGRB: Loaded 4092 existing records from primary storage. [2025-10-03T22:41:38.182285] [INFO ] [MAIN ] MGRB: Loaded 4092 primary data records. [2025-10-03T22:41:38.490082] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:38.499704] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54387 primary records. [2025-10-03T22:41:38.512808] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-03T22:41:38.513622] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:38.515423] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5687 primary records. [2025-10-03T22:41:38.515723] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-03T22:41:38.549348] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-10-03T22:41:38.550000] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-03T22:41:38.552857] [INFO ] [MAIN ] Derivative Progress: 1164/2073 symbols completed. MGM took 1.4s. Estimated remaining: 6m 15s. Rate: 145.4 symbols/min [2025-10-03T22:41:38.553568] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:38.553444] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-10-03T22:41:38.554121] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-03T22:41:38.557582] [INFO ] [MAIN ] Derivative Progress: 1165/2073 symbols completed. MGR took 1.1s. Estimated remaining: 6m 14s. Rate: 145.5 symbols/min [2025-10-03T22:41:38.558224] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:38.562219] [DEBUG] [LOCAL ] MGRD: Loaded 2257 existing records from primary storage. [2025-10-03T22:41:38.562411] [INFO ] [MAIN ] MGRD: Loaded 2257 primary data records. [2025-10-03T22:41:38.670968] [DEBUG] [LOCAL ] MGRE: Loaded 6744 existing records from primary storage. [2025-10-03T22:41:38.683235] [INFO ] [MAIN ] MGRE: Loaded 6744 primary data records. [2025-10-03T22:41:38.769977] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:38.831176] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4092 primary records. [2025-10-03T22:41:38.841569] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-03T22:41:39.230447] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-10-03T22:41:39.230739] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-03T22:41:39.233326] [INFO ] [MAIN ] Derivative Progress: 1166/2073 symbols completed. MGRB took 1.1s. Estimated remaining: 6m 14s. Rate: 145.4 symbols/min [2025-10-03T22:41:39.234113] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:39.265950] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:39.267008] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2257 primary records. [2025-10-03T22:41:39.267214] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-03T22:41:39.287557] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:39.289774] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6744 primary records. [2025-10-03T22:41:39.292954] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-03T22:41:39.323498] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-10-03T22:41:39.323977] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-03T22:41:39.326899] [INFO ] [MAIN ] Derivative Progress: 1167/2073 symbols completed. MGRD took 0.8s. Estimated remaining: 6m 14s. Rate: 145.5 symbols/min [2025-10-03T22:41:39.329746] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:39.329931] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-10-03T22:41:39.330128] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-03T22:41:39.333867] [INFO ] [MAIN ] Derivative Progress: 1168/2073 symbols completed. MGRE took 0.8s. Estimated remaining: 6m 13s. Rate: 145.6 symbols/min [2025-10-03T22:41:39.356538] [DEBUG] [LOCAL ] MGY: Loaded 53185 existing records from primary storage. [2025-10-03T22:41:39.356797] [INFO ] [MAIN ] MGY: Loaded 53185 primary data records. [2025-10-03T22:41:39.449466] [DEBUG] [LOCAL ] MHD: Loaded 12685 existing records from primary storage. [2025-10-03T22:41:39.473509] [INFO ] [MAIN ] MHD: Loaded 12685 primary data records. [2025-10-03T22:41:40.056157] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:40.057155] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53185 primary records. [2025-10-03T22:41:40.057335] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-03T22:41:40.086225] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:40.087782] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12685 primary records. [2025-10-03T22:41:40.088784] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-03T22:41:40.091217] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-10-03T22:41:40.091510] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-03T22:41:40.101422] [INFO ] [MAIN ] Derivative Progress: 1169/2073 symbols completed. MGY took 0.9s. Estimated remaining: 6m 13s. Rate: 145.5 symbols/min [2025-10-03T22:41:40.109788] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-10-03T22:41:40.109861] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-03T22:41:40.112452] [INFO ] [MAIN ] Derivative Progress: 1170/2073 symbols completed. MHD took 0.8s. Estimated remaining: 6m 12s. Rate: 145.6 symbols/min [2025-10-03T22:41:40.112867] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:40.112986] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:40.113128] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:40.134795] [DEBUG] [LOCAL ] MHF: Loaded 8774 existing records from primary storage. [2025-10-03T22:41:40.135096] [DEBUG] [LOCAL ] MHN: Loaded 7680 existing records from primary storage. [2025-10-03T22:41:40.135376] [INFO ] [MAIN ] MHN: Loaded 7680 primary data records. [2025-10-03T22:41:40.135458] [INFO ] [MAIN ] MHF: Loaded 8774 primary data records. [2025-10-03T22:41:40.456424] [DEBUG] [LOCAL ] MHK: Loaded 42739 existing records from primary storage. [2025-10-03T22:41:40.466949] [INFO ] [MAIN ] MHK: Loaded 42739 primary data records. [2025-10-03T22:41:41.111839] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:41.113465] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8774 primary records. [2025-10-03T22:41:41.113794] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-03T22:41:41.128123] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:41.139006] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7680 primary records. [2025-10-03T22:41:41.139840] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-03T22:41:41.144185] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-10-03T22:41:41.145371] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-03T22:41:41.148215] [INFO ] [MAIN ] Derivative Progress: 1171/2073 symbols completed. MHF took 1.0s. Estimated remaining: 6m 12s. Rate: 145.4 symbols/min [2025-10-03T22:41:41.155620] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:41.168854] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-10-03T22:41:41.169891] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-03T22:41:41.172345] [INFO ] [MAIN ] Derivative Progress: 1172/2073 symbols completed. MHN took 1.1s. Estimated remaining: 6m 11s. Rate: 145.6 symbols/min [2025-10-03T22:41:41.172612] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:41.186412] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:41.193253] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 42739 primary records. [2025-10-03T22:41:41.193609] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-03T22:41:41.224995] [DEBUG] [LOCAL ] MHO: Loaded 24193 existing records from primary storage. [2025-10-03T22:41:41.226981] [INFO ] [MAIN ] MHO: Loaded 24193 primary data records. [2025-10-03T22:41:41.232589] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-10-03T22:41:41.223718] [DEBUG] [LOCAL ] MIN: Loaded 13511 existing records from primary storage. [2025-10-03T22:41:41.265673] [INFO ] [MAIN ] MIN: Loaded 13511 primary data records. [2025-10-03T22:41:41.265860] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-03T22:41:41.276082] [INFO ] [MAIN ] Derivative Progress: 1173/2073 symbols completed. MHK took 1.2s. Estimated remaining: 6m 11s. Rate: 145.7 symbols/min [2025-10-03T22:41:41.301738] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:41.909296] [DEBUG] [LOCAL ] MIR: Loaded 51798 existing records from primary storage. [2025-10-03T22:41:41.909681] [INFO ] [MAIN ] MIR: Loaded 51798 primary data records. [2025-10-03T22:41:42.029430] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:42.042166] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24193 primary records. [2025-10-03T22:41:42.042338] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-03T22:41:42.129903] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:42.238212] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13511 primary records. [2025-10-03T22:41:42.251745] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-03T22:41:42.255159] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-10-03T22:41:42.261792] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-03T22:41:42.269676] [INFO ] [MAIN ] Derivative Progress: 1174/2073 symbols completed. MHO took 1.1s. Estimated remaining: 6m 11s. Rate: 145.5 symbols/min [2025-10-03T22:41:42.270595] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:42.277262] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-10-03T22:41:42.280569] [DEBUG] [LOCAL ] MITP: Loaded 2419 existing records from primary storage. [2025-10-03T22:41:42.280721] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-03T22:41:42.280794] [INFO ] [MAIN ] MITP: Loaded 2419 primary data records. [2025-10-03T22:41:42.283187] [INFO ] [MAIN ] Derivative Progress: 1175/2073 symbols completed. MIN took 1.1s. Estimated remaining: 6m 10s. Rate: 145.6 symbols/min [2025-10-03T22:41:42.320600] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:42.608722] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:42.610144] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 51798 primary records. [2025-10-03T22:41:42.610372] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-03T22:41:42.631632] [DEBUG] [LOCAL ] MITT: Loaded 23184 existing records from primary storage. [2025-10-03T22:41:42.633393] [INFO ] [MAIN ] MITT: Loaded 23184 primary data records. [2025-10-03T22:41:42.706747] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-10-03T22:41:42.724543] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-03T22:41:42.732328] [INFO ] [MAIN ] Derivative Progress: 1176/2073 symbols completed. MIR took 1.4s. Estimated remaining: 6m 10s. Rate: 145.6 symbols/min [2025-10-03T22:41:42.732492] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:42.951583] [DEBUG] [LOCAL ] MIY: Loaded 6099 existing records from primary storage. [2025-10-03T22:41:42.966028] [INFO ] [MAIN ] MIY: Loaded 6099 primary data records. [2025-10-03T22:41:43.089769] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:43.090839] [INFO ] [MAIN ] MITP: Generated 1820 derivative records from 2419 primary records. [2025-10-03T22:41:43.106852] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-03T22:41:43.302742] [DEBUG] [LOCAL ] MITP: Derivative data saved (1820 records). [2025-10-03T22:41:43.304677] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-03T22:41:43.308671] [INFO ] [MAIN ] Derivative Progress: 1177/2073 symbols completed. MITP took 1.0s. Estimated remaining: 6m 9s. Rate: 145.5 symbols/min [2025-10-03T22:41:43.310785] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:43.326130] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:43.327445] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23184 primary records. [2025-10-03T22:41:43.327783] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-03T22:41:43.348995] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-10-03T22:41:43.349282] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-03T22:41:43.351687] [INFO ] [MAIN ] Derivative Progress: 1178/2073 symbols completed. MITT took 1.0s. Estimated remaining: 6m 9s. Rate: 145.6 symbols/min [2025-10-03T22:41:43.359681] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:43.365526] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:43.366237] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6099 primary records. [2025-10-03T22:41:43.366369] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-03T22:41:43.396209] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-10-03T22:41:43.396377] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-03T22:41:43.399161] [INFO ] [MAIN ] Derivative Progress: 1179/2073 symbols completed. MIY took 0.7s. Estimated remaining: 6m 8s. Rate: 145.8 symbols/min [2025-10-03T22:41:43.399423] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:43.425341] [DEBUG] [LOCAL ] MKC: Loaded 53215 existing records from primary storage. [2025-10-03T22:41:43.425674] [INFO ] [MAIN ] MKC: Loaded 53215 primary data records. [2025-10-03T22:41:43.543239] [DEBUG] [LOCAL ] MKL: Loaded 34507 existing records from primary storage. [2025-10-03T22:41:43.592946] [INFO ] [MAIN ] MKL: Loaded 34507 primary data records. [2025-10-03T22:41:43.892386] [DEBUG] [LOCAL ] MLI: Loaded 44149 existing records from primary storage. [2025-10-03T22:41:43.903404] [INFO ] [MAIN ] MLI: Loaded 44149 primary data records. [2025-10-03T22:41:44.448515] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:44.449678] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53215 primary records. [2025-10-03T22:41:44.450840] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-03T22:41:44.487119] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:44.488600] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-10-03T22:41:44.489500] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34507 primary records. [2025-10-03T22:41:44.490818] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-03T22:41:44.490920] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-03T22:41:44.495690] [INFO ] [MAIN ] Derivative Progress: 1180/2073 symbols completed. MKC took 1.2s. Estimated remaining: 6m 8s. Rate: 145.6 symbols/min [2025-10-03T22:41:44.496018] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:44.511401] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:44.523631] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44149 primary records. [2025-10-03T22:41:44.528051] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-10-03T22:41:44.528201] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-03T22:41:44.528318] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-03T22:41:44.530716] [INFO ] [MAIN ] Derivative Progress: 1181/2073 symbols completed. MKL took 1.2s. Estimated remaining: 6m 7s. Rate: 145.7 symbols/min [2025-10-03T22:41:44.531300] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:44.548343] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-10-03T22:41:44.548541] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-03T22:41:44.551519] [INFO ] [MAIN ] Derivative Progress: 1182/2073 symbols completed. MLI took 1.2s. Estimated remaining: 6m 7s. Rate: 145.8 symbols/min [2025-10-03T22:41:44.551824] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:44.573094] [DEBUG] [LOCAL ] MLP: Loaded 3014 existing records from primary storage. [2025-10-03T22:41:44.573365] [INFO ] [MAIN ] MLP: Loaded 3014 primary data records. [2025-10-03T22:41:44.670912] [DEBUG] [LOCAL ] MLNK: Loaded 25866 existing records from primary storage. [2025-10-03T22:41:44.676807] [DEBUG] [LOCAL ] MLM: Loaded 30361 existing records from primary storage. [2025-10-03T22:41:44.689106] [INFO ] [MAIN ] MLNK: Loaded 25866 primary data records. [2025-10-03T22:41:44.700994] [INFO ] [MAIN ] MLM: Loaded 30361 primary data records. [2025-10-03T22:41:45.646129] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:41:45.647300] [INFO ] [MAIN ] MLP: Generated 1818 derivative records from 3014 primary records. [2025-10-03T22:41:45.647405] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-03T22:41:45.676920] [DEBUG] [LOCAL ] MLP: Derivative data saved (1818 records). [2025-10-03T22:41:45.679055] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-03T22:41:45.695780] [INFO ] [MAIN ] Derivative Progress: 1183/2073 symbols completed. MLP took 1.1s. Estimated remaining: 6m 7s. Rate: 145.6 symbols/min [2025-10-03T22:41:45.696908] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:45.710764] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 25866 primary records. [2025-10-03T22:41:45.709875] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:45.710858] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-03T22:41:45.711780] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 30361 primary records. [2025-10-03T22:41:45.711880] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-03T22:41:45.740995] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-10-03T22:41:45.741345] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-03T22:41:45.744321] [INFO ] [MAIN ] Derivative Progress: 1184/2073 symbols completed. MLNK took 1.2s. Estimated remaining: 6m 6s. Rate: 145.7 symbols/min [2025-10-03T22:41:45.748075] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-10-03T22:41:45.748208] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-03T22:41:45.751245] [INFO ] [MAIN ] Derivative Progress: 1185/2073 symbols completed. MLM took 1.3s. Estimated remaining: 6m 5s. Rate: 145.8 symbols/min [2025-10-03T22:41:45.751934] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:45.752043] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:45.751860] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:45.771322] [DEBUG] [LOCAL ] MLR: Loaded 12615 existing records from primary storage. [2025-10-03T22:41:45.776326] [INFO ] [MAIN ] MLR: Loaded 12615 primary data records. [2025-10-03T22:41:45.776221] [DEBUG] [LOCAL ] MMD: Loaded 11497 existing records from primary storage. [2025-10-03T22:41:45.798531] [INFO ] [MAIN ] MMD: Loaded 11497 primary data records. [2025-10-03T22:41:46.282054] [DEBUG] [LOCAL ] MMC: Loaded 52557 existing records from primary storage. [2025-10-03T22:41:46.335822] [INFO ] [MAIN ] MMC: Loaded 52557 primary data records. [2025-10-03T22:41:46.803407] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:46.805375] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12615 primary records. [2025-10-03T22:41:46.805545] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-03T22:41:46.838692] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:46.840202] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11497 primary records. [2025-10-03T22:41:46.840399] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-03T22:41:46.855884] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-10-03T22:41:46.857556] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-03T22:41:46.861808] [INFO ] [MAIN ] Derivative Progress: 1186/2073 symbols completed. MLR took 1.1s. Estimated remaining: 6m 6s. Rate: 145.6 symbols/min [2025-10-03T22:41:46.862075] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:46.879915] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-10-03T22:41:46.880022] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-03T22:41:46.879324] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:46.880816] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52557 primary records. [2025-10-03T22:41:46.883516] [INFO ] [MAIN ] Derivative Progress: 1187/2073 symbols completed. MMD took 1.1s. Estimated remaining: 6m 5s. Rate: 145.7 symbols/min [2025-10-03T22:41:46.880980] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-03T22:41:46.883723] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:46.909595] [DEBUG] [LOCAL ] MMI: Loaded 15364 existing records from primary storage. [2025-10-03T22:41:46.910022] [INFO ] [MAIN ] MMI: Loaded 15364 primary data records. [2025-10-03T22:41:46.968724] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-10-03T22:41:47.007356] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-03T22:41:47.021179] [INFO ] [MAIN ] Derivative Progress: 1188/2073 symbols completed. MMC took 1.3s. Estimated remaining: 6m 4s. Rate: 145.8 symbols/min [2025-10-03T22:41:47.037531] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:47.270176] [DEBUG] [LOCAL ] MMM: Loaded 53938 existing records from primary storage. [2025-10-03T22:41:47.270678] [INFO ] [MAIN ] MMM: Loaded 53938 primary data records. [2025-10-03T22:41:47.370954] [DEBUG] [LOCAL ] MMS: Loaded 34400 existing records from primary storage. [2025-10-03T22:41:47.385261] [INFO ] [MAIN ] MMS: Loaded 34400 primary data records. [2025-10-03T22:41:47.760820] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:47.772687] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15364 primary records. [2025-10-03T22:41:47.791949] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-03T22:41:47.972402] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-10-03T22:41:47.973181] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-03T22:41:47.975885] [INFO ] [MAIN ] Derivative Progress: 1189/2073 symbols completed. MMI took 1.1s. Estimated remaining: 6m 4s. Rate: 145.6 symbols/min [2025-10-03T22:41:47.976191] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:48.004668] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:48.006028] [DEBUG] [LOCAL ] MMT: Loaded 10895 existing records from primary storage. [2025-10-03T22:41:48.006786] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53938 primary records. [2025-10-03T22:41:48.006925] [INFO ] [MAIN ] MMT: Loaded 10895 primary data records. [2025-10-03T22:41:48.018169] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-03T22:41:48.136867] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:48.161686] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34400 primary records. [2025-10-03T22:41:48.162345] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-10-03T22:41:48.167561] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-03T22:41:48.182765] [INFO ] [MAIN ] Derivative Progress: 1190/2073 symbols completed. MMM took 1.3s. Estimated remaining: 6m 4s. Rate: 145.7 symbols/min [2025-10-03T22:41:48.191524] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:48.215102] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-03T22:41:48.356726] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-10-03T22:41:48.357721] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-03T22:41:48.360857] [INFO ] [MAIN ] Derivative Progress: 1191/2073 symbols completed. MMS took 1.3s. Estimated remaining: 6m 3s. Rate: 145.7 symbols/min [2025-10-03T22:41:48.361601] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:48.369099] [DEBUG] [LOCAL ] MMU: Loaded 17040 existing records from primary storage. [2025-10-03T22:41:48.369296] [INFO ] [MAIN ] MMU: Loaded 17040 primary data records. [2025-10-03T22:41:48.559261] [DEBUG] [LOCAL ] MNR: Loaded 24792 existing records from primary storage. [2025-10-03T22:41:48.579254] [INFO ] [MAIN ] MNR: Loaded 24792 primary data records. [2025-10-03T22:41:48.742012] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:48.782023] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10895 primary records. [2025-10-03T22:41:48.814291] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-03T22:41:49.031030] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-10-03T22:41:49.031508] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-03T22:41:49.035054] [INFO ] [MAIN ] Derivative Progress: 1192/2073 symbols completed. MMT took 1.1s. Estimated remaining: 6m 3s. Rate: 145.7 symbols/min [2025-10-03T22:41:49.035493] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:49.055012] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:49.056066] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17040 primary records. [2025-10-03T22:41:49.056381] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-03T22:41:49.101204] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-10-03T22:41:49.101496] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-03T22:41:49.104190] [INFO ] [MAIN ] Derivative Progress: 1193/2073 symbols completed. MMU took 0.9s. Estimated remaining: 6m 2s. Rate: 145.8 symbols/min [2025-10-03T22:41:49.104532] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:49.131363] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:49.132131] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 24792 primary records. [2025-10-03T22:41:49.132335] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-03T22:41:49.159037] [DEBUG] [LOCAL ] MNSO: Loaded 45106 existing records from primary storage. [2025-10-03T22:41:49.162157] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-10-03T22:41:49.162384] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-03T22:41:49.165927] [INFO ] [MAIN ] MNSO: Loaded 45106 primary data records. [2025-10-03T22:41:49.165799] [INFO ] [MAIN ] Derivative Progress: 1194/2073 symbols completed. MNR took 0.8s. Estimated remaining: 6m 2s. Rate: 145.9 symbols/min [2025-10-03T22:41:49.166302] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:49.343321] [DEBUG] [LOCAL ] MOD: Loaded 45809 existing records from primary storage. [2025-10-03T22:41:49.422828] [INFO ] [MAIN ] MOD: Loaded 45809 primary data records. [2025-10-03T22:41:49.716009] [DEBUG] [LOCAL ] MODG: Loaded 52282 existing records from primary storage. [2025-10-03T22:41:49.749862] [INFO ] [MAIN ] MODG: Loaded 52282 primary data records. [2025-10-03T22:41:50.088631] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:50.118518] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 45106 primary records. [2025-10-03T22:41:50.132020] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-03T22:41:50.308379] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-10-03T22:41:50.309579] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-03T22:41:50.314459] [INFO ] [MAIN ] Derivative Progress: 1195/2073 symbols completed. MNSO took 1.3s. Estimated remaining: 6m 2s. Rate: 145.7 symbols/min [2025-10-03T22:41:50.317061] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:50.336858] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:50.338142] [INFO ] [MAIN ] MOD: Generated 1820 derivative records from 45809 primary records. [2025-10-03T22:41:50.338407] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-03T22:41:50.358854] [DEBUG] [LOCAL ] MOD: Derivative data saved (1820 records). [2025-10-03T22:41:50.359955] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-03T22:41:50.362511] [INFO ] [MAIN ] Derivative Progress: 1196/2073 symbols completed. MOD took 1.3s. Estimated remaining: 6m 1s. Rate: 145.8 symbols/min [2025-10-03T22:41:50.362824] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:50.382508] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:50.383552] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52282 primary records. [2025-10-03T22:41:50.383733] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-03T22:41:50.414078] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-10-03T22:41:50.427336] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-03T22:41:50.430950] [INFO ] [MAIN ] Derivative Progress: 1197/2073 symbols completed. MODG took 1.3s. Estimated remaining: 6m 0s. Rate: 145.9 symbols/min [2025-10-03T22:41:50.442229] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:50.445063] [DEBUG] [LOCAL ] MOH: Loaded 42386 existing records from primary storage. [2025-10-03T22:41:50.445272] [INFO ] [MAIN ] MOH: Loaded 42386 primary data records. [2025-10-03T22:41:50.572327] [DEBUG] [LOCAL ] MOS: Loaded 54279 existing records from primary storage. [2025-10-03T22:41:50.572706] [INFO ] [MAIN ] MOS: Loaded 54279 primary data records. [2025-10-03T22:41:50.769174] [DEBUG] [LOCAL ] MOV: Loaded 22246 existing records from primary storage. [2025-10-03T22:41:50.886239] [INFO ] [MAIN ] MOV: Loaded 22246 primary data records. [2025-10-03T22:41:51.437028] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:51.438169] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 42386 primary records. [2025-10-03T22:41:51.438415] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-03T22:41:51.473552] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-10-03T22:41:51.474143] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-03T22:41:51.477306] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:51.477071] [INFO ] [MAIN ] Derivative Progress: 1198/2073 symbols completed. MOH took 1.2s. Estimated remaining: 6m 0s. Rate: 145.7 symbols/min [2025-10-03T22:41:51.480618] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54279 primary records. [2025-10-03T22:41:51.480869] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-03T22:41:51.502487] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:51.505790] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22246 primary records. [2025-10-03T22:41:51.507080] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-03T22:41:51.521822] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-10-03T22:41:51.522330] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-03T22:41:51.525006] [INFO ] [MAIN ] Derivative Progress: 1199/2073 symbols completed. MOS took 1.2s. Estimated remaining: 5m 60s. Rate: 145.8 symbols/min [2025-10-03T22:41:51.528836] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-10-03T22:41:51.528900] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-03T22:41:51.531594] [INFO ] [MAIN ] Derivative Progress: 1200/2073 symbols completed. MOV took 1.1s. Estimated remaining: 5m 59s. Rate: 145.9 symbols/min [2025-10-03T22:41:51.532207] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:51.532091] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:51.532300] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:51.542453] [DEBUG] [LOCAL ] MPA: Loaded 5349 existing records from primary storage. [2025-10-03T22:41:51.542731] [INFO ] [MAIN ] MPA: Loaded 5349 primary data records. [2025-10-03T22:41:51.952835] [DEBUG] [LOCAL ] MP: Loaded 54456 existing records from primary storage. [2025-10-03T22:41:51.952032] [DEBUG] [LOCAL ] MPC: Loaded 52839 existing records from primary storage. [2025-10-03T22:41:51.953045] [INFO ] [MAIN ] MP: Loaded 54456 primary data records. [2025-10-03T22:41:51.953232] [INFO ] [MAIN ] MPC: Loaded 52839 primary data records. [2025-10-03T22:41:52.566790] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:52.576534] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5349 primary records. [2025-10-03T22:41:52.577613] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-03T22:41:52.596390] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-10-03T22:41:52.597216] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-03T22:41:52.599827] [INFO ] [MAIN ] Derivative Progress: 1201/2073 symbols completed. MPA took 1.1s. Estimated remaining: 5m 59s. Rate: 145.7 symbols/min [2025-10-03T22:41:52.600064] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:52.629370] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:52.642804] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54456 primary records. [2025-10-03T22:41:52.643091] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-03T22:41:52.643447] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:52.645347] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52839 primary records. [2025-10-03T22:41:52.652695] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-03T22:41:52.689793] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-10-03T22:41:52.690465] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-03T22:41:52.693281] [INFO ] [MAIN ] Derivative Progress: 1202/2073 symbols completed. MP took 1.2s. Estimated remaining: 5m 58s. Rate: 145.8 symbols/min [2025-10-03T22:41:52.693953] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:52.711538] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-10-03T22:41:52.711724] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-03T22:41:52.712908] [DEBUG] [LOCAL ] MPLX: Loaded 51499 existing records from primary storage. [2025-10-03T22:41:52.717282] [INFO ] [MAIN ] MPLX: Loaded 51499 primary data records. [2025-10-03T22:41:52.717156] [INFO ] [MAIN ] Derivative Progress: 1203/2073 symbols completed. MPC took 1.2s. Estimated remaining: 5m 58s. Rate: 145.9 symbols/min [2025-10-03T22:41:52.738589] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:52.771569] [DEBUG] [LOCAL ] MPV: Loaded 4992 existing records from primary storage. [2025-10-03T22:41:52.788115] [INFO ] [MAIN ] MPV: Loaded 4992 primary data records. [2025-10-03T22:41:53.375497] [DEBUG] [LOCAL ] MPW: Loaded 54270 existing records from primary storage. [2025-10-03T22:41:53.376889] [INFO ] [MAIN ] MPW: Loaded 54270 primary data records. [2025-10-03T22:41:53.766723] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:53.769549] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:53.769104] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51499 primary records. [2025-10-03T22:41:53.769736] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-03T22:41:53.770503] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 4992 primary records. [2025-10-03T22:41:53.771984] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-03T22:41:53.809620] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-10-03T22:41:53.813429] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-10-03T22:41:53.813623] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-03T22:41:53.816552] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-03T22:41:53.816350] [INFO ] [MAIN ] Derivative Progress: 1204/2073 symbols completed. MPV took 1.1s. Estimated remaining: 5m 58s. Rate: 145.7 symbols/min [2025-10-03T22:41:53.819807] [INFO ] [MAIN ] Derivative Progress: 1205/2073 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 57s. Rate: 145.8 symbols/min [2025-10-03T22:41:53.819699] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:53.820164] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:53.829445] [DEBUG] [LOCAL ] MPX: Loaded 4118 existing records from primary storage. [2025-10-03T22:41:53.832835] [INFO ] [MAIN ] MPX: Loaded 4118 primary data records. [2025-10-03T22:41:53.872765] [DEBUG] [LOCAL ] MQT: Loaded 8841 existing records from primary storage. [2025-10-03T22:41:53.897542] [INFO ] [MAIN ] MQT: Loaded 8841 primary data records. [2025-10-03T22:41:53.955176] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:54.056230] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54270 primary records. [2025-10-03T22:41:54.078621] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-03T22:41:54.505104] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-10-03T22:41:54.506045] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-03T22:41:54.509431] [INFO ] [MAIN ] Derivative Progress: 1206/2073 symbols completed. MPW took 1.8s. Estimated remaining: 5m 57s. Rate: 145.8 symbols/min [2025-10-03T22:41:54.510115] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:54.545267] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:54.564503] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4118 primary records. [2025-10-03T22:41:54.565252] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-03T22:41:54.565168] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:54.566725] [DEBUG] [LOCAL ] MQY: Loaded 17389 existing records from primary storage. [2025-10-03T22:41:54.573783] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8841 primary records. [2025-10-03T22:41:54.577609] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-03T22:41:54.577719] [INFO ] [MAIN ] MQY: Loaded 17389 primary data records. [2025-10-03T22:41:54.651989] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-10-03T22:41:54.672747] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-03T22:41:54.675349] [INFO ] [MAIN ] Derivative Progress: 1207/2073 symbols completed. MPX took 0.9s. Estimated remaining: 5m 56s. Rate: 145.8 symbols/min [2025-10-03T22:41:54.686121] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:54.692028] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-10-03T22:41:54.704409] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-03T22:41:54.707096] [INFO ] [MAIN ] Derivative Progress: 1208/2073 symbols completed. MQT took 0.9s. Estimated remaining: 5m 56s. Rate: 145.9 symbols/min [2025-10-03T22:41:54.720060] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:54.939255] [DEBUG] [LOCAL ] MSA: Loaded 19110 existing records from primary storage. [2025-10-03T22:41:54.939779] [INFO ] [MAIN ] MSA: Loaded 19110 primary data records. [2025-10-03T22:41:55.061012] [DEBUG] [LOCAL ] MRC: Loaded 37897 existing records from primary storage. [2025-10-03T22:41:55.062018] [INFO ] [MAIN ] MRC: Loaded 37897 primary data records. [2025-10-03T22:41:55.406539] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:55.432352] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 17389 primary records. [2025-10-03T22:41:55.450346] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-03T22:41:55.658385] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-10-03T22:41:55.660524] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-03T22:41:55.663694] [INFO ] [MAIN ] Derivative Progress: 1209/2073 symbols completed. MQY took 1.2s. Estimated remaining: 5m 56s. Rate: 145.8 symbols/min [2025-10-03T22:41:55.664392] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:55.692534] [DEBUG] [LOCAL ] MSB: Loaded 7924 existing records from primary storage. [2025-10-03T22:41:55.689107] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:55.693513] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 19110 primary records. [2025-10-03T22:41:55.693722] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-03T22:41:55.694916] [INFO ] [MAIN ] MSB: Loaded 7924 primary data records. [2025-10-03T22:41:55.810083] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:55.828477] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 37897 primary records. [2025-10-03T22:41:55.831039] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-03T22:41:55.838107] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-10-03T22:41:55.854113] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-03T22:41:55.925543] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-10-03T22:41:55.925439] [INFO ] [MAIN ] Derivative Progress: 1210/2073 symbols completed. MSA took 1.2s. Estimated remaining: 5m 55s. Rate: 145.8 symbols/min [2025-10-03T22:41:56.049819] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:56.049627] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-03T22:41:56.053971] [INFO ] [MAIN ] Derivative Progress: 1211/2073 symbols completed. MRC took 1.4s. Estimated remaining: 5m 54s. Rate: 145.9 symbols/min [2025-10-03T22:41:56.054527] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:56.078224] [DEBUG] [LOCAL ] MSD: Loaded 16204 existing records from primary storage. [2025-10-03T22:41:56.078481] [INFO ] [MAIN ] MSD: Loaded 16204 primary data records. [2025-10-03T22:41:56.137321] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:56.186253] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7924 primary records. [2025-10-03T22:41:56.187211] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-03T22:41:56.257729] [DEBUG] [LOCAL ] MSCI: Loaded 34977 existing records from primary storage. [2025-10-03T22:41:56.251558] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-10-03T22:41:56.285541] [INFO ] [MAIN ] MSCI: Loaded 34977 primary data records. [2025-10-03T22:41:56.276697] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-03T22:41:56.295677] [INFO ] [MAIN ] Derivative Progress: 1212/2073 symbols completed. MSB took 0.6s. Estimated remaining: 5m 54s. Rate: 146.0 symbols/min [2025-10-03T22:41:56.421728] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:56.809263] [DEBUG] [LOCAL ] MSDL: Loaded 38862 existing records from primary storage. [2025-10-03T22:41:56.808261] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:56.810744] [INFO ] [MAIN ] MSDL: Loaded 38862 primary data records. [2025-10-03T22:41:56.811691] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 16204 primary records. [2025-10-03T22:41:56.812080] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-03T22:41:56.907709] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-10-03T22:41:56.913276] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-03T22:41:56.915937] [INFO ] [MAIN ] Derivative Progress: 1213/2073 symbols completed. MSD took 0.9s. Estimated remaining: 5m 54s. Rate: 145.9 symbols/min [2025-10-03T22:41:57.030175] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:57.036467] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 34977 primary records. [2025-10-03T22:41:57.036590] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-03T22:41:57.172293] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-10-03T22:41:57.172697] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-03T22:41:57.174922] [INFO ] [MAIN ] Derivative Progress: 1214/2073 symbols completed. MSCI took 1.1s. Estimated remaining: 5m 53s. Rate: 145.9 symbols/min [2025-10-03T22:41:57.196453] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:41:57.197152] [INFO ] [MAIN ] MSDL: Generated 1819 derivative records from 38862 primary records. [2025-10-03T22:41:57.197216] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-03T22:41:57.214402] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1819 records). [2025-10-03T22:41:57.214481] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-03T22:41:57.216919] [INFO ] [MAIN ] Derivative Progress: 1215/2073 symbols completed. MSDL took 0.8s. Estimated remaining: 5m 52s. Rate: 146.0 symbols/min [2025-10-03T22:41:57.217431] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:57.217611] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:57.217535] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:57.245913] [DEBUG] [LOCAL ] MSGS: Loaded 17502 existing records from primary storage. [2025-10-03T22:41:57.246067] [INFO ] [MAIN ] MSGS: Loaded 17502 primary data records. [2025-10-03T22:41:57.357184] [DEBUG] [LOCAL ] MSGE: Loaded 27381 existing records from primary storage. [2025-10-03T22:41:57.368322] [INFO ] [MAIN ] MSGE: Loaded 27381 primary data records. [2025-10-03T22:41:57.692158] [DEBUG] [LOCAL ] MSI: Loaded 40771 existing records from primary storage. [2025-10-03T22:41:57.714519] [INFO ] [MAIN ] MSI: Loaded 40771 primary data records. [2025-10-03T22:41:58.247758] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:58.249019] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17502 primary records. [2025-10-03T22:41:58.261468] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-03T22:41:58.263528] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:58.275521] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27381 primary records. [2025-10-03T22:41:58.280041] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-10-03T22:41:58.279750] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-03T22:41:58.280190] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-03T22:41:58.282824] [INFO ] [MAIN ] Derivative Progress: 1216/2073 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 53s. Rate: 145.9 symbols/min [2025-10-03T22:41:58.283012] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:58.316258] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:58.317965] [INFO ] [MAIN ] MSI: Generated 1820 derivative records from 40771 primary records. [2025-10-03T22:41:58.318146] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-10-03T22:41:58.318328] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-03T22:41:58.318260] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-03T22:41:58.321283] [INFO ] [MAIN ] Derivative Progress: 1217/2073 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 52s. Rate: 146.0 symbols/min [2025-10-03T22:41:58.321722] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:58.341151] [DEBUG] [LOCAL ] MSI: Derivative data saved (1820 records). [2025-10-03T22:41:58.350629] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-03T22:41:58.353666] [INFO ] [MAIN ] Derivative Progress: 1218/2073 symbols completed. MSI took 1.1s. Estimated remaining: 5m 51s. Rate: 146.1 symbols/min [2025-10-03T22:41:58.354014] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:58.370747] [DEBUG] [LOCAL ] MSM: Loaded 35994 existing records from primary storage. [2025-10-03T22:41:58.371413] [INFO ] [MAIN ] MSM: Loaded 35994 primary data records. [2025-10-03T22:41:58.714001] [DEBUG] [LOCAL ] MT: Loaded 51346 existing records from primary storage. [2025-10-03T22:41:58.732968] [INFO ] [MAIN ] MT: Loaded 51346 primary data records. [2025-10-03T22:41:58.770731] [DEBUG] [LOCAL ] MTAL: Loaded 37135 existing records from primary storage. [2025-10-03T22:41:58.790531] [INFO ] [MAIN ] MTAL: Loaded 37135 primary data records. [2025-10-03T22:41:59.374698] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:59.376999] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 35994 primary records. [2025-10-03T22:41:59.377558] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-03T22:41:59.400352] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-10-03T22:41:59.400686] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-03T22:41:59.405444] [INFO ] [MAIN ] Derivative Progress: 1219/2073 symbols completed. MSM took 1.1s. Estimated remaining: 5m 51s. Rate: 145.9 symbols/min [2025-10-03T22:41:59.407289] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:59.422917] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:59.423993] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51346 primary records. [2025-10-03T22:41:59.424116] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-03T22:41:59.438161] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:41:59.446501] [INFO ] [MAIN ] MTAL: Generated 1820 derivative records from 37135 primary records. [2025-10-03T22:41:59.447908] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-10-03T22:41:59.455820] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-10-03T22:41:59.456009] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-03T22:41:59.458185] [INFO ] [MAIN ] Derivative Progress: 1220/2073 symbols completed. MT took 1.1s. Estimated remaining: 5m 51s. Rate: 146.0 symbols/min [2025-10-03T22:41:59.458399] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:59.477255] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1820 records). [2025-10-03T22:41:59.477565] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-10-03T22:41:59.480372] [INFO ] [MAIN ] Derivative Progress: 1221/2073 symbols completed. MTAL took 1.1s. Estimated remaining: 5m 50s. Rate: 146.1 symbols/min [2025-10-03T22:41:59.480772] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:41:59.508272] [DEBUG] [LOCAL ] MTD: Loaded 15389 existing records from primary storage. [2025-10-03T22:41:59.508440] [INFO ] [MAIN ] MTD: Loaded 15389 primary data records. [2025-10-03T22:41:59.637771] [DEBUG] [LOCAL ] MTB: Loaded 47340 existing records from primary storage. [2025-10-03T22:41:59.638343] [INFO ] [MAIN ] MTB: Loaded 47340 primary data records. [2025-10-03T22:42:00.019296] [DEBUG] [LOCAL ] MTDR: Loaded 52341 existing records from primary storage. [2025-10-03T22:42:00.061233] [INFO ] [MAIN ] MTDR: Loaded 52341 primary data records. [2025-10-03T22:42:00.546052] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:00.547300] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15389 primary records. [2025-10-03T22:42:00.547767] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-03T22:42:00.568330] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-10-03T22:42:00.569609] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-03T22:42:00.572620] [INFO ] [MAIN ] Derivative Progress: 1222/2073 symbols completed. MTD took 1.1s. Estimated remaining: 5m 50s. Rate: 145.9 symbols/min [2025-10-03T22:42:00.574137] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:00.591163] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:00.592326] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47340 primary records. [2025-10-03T22:42:00.592818] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-03T22:42:00.632257] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:00.631826] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-10-03T22:42:00.632519] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-03T22:42:00.635849] [INFO ] [MAIN ] Derivative Progress: 1223/2073 symbols completed. MTB took 1.2s. Estimated remaining: 5m 49s. Rate: 146.0 symbols/min [2025-10-03T22:42:00.636092] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:00.633427] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52341 primary records. [2025-10-03T22:42:00.636776] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-03T22:42:00.669590] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-10-03T22:42:00.670864] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-03T22:42:00.673851] [INFO ] [MAIN ] Derivative Progress: 1224/2073 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 49s. Rate: 146.1 symbols/min [2025-10-03T22:42:00.688572] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:00.690379] [DEBUG] [LOCAL ] MTG: Loaded 52017 existing records from primary storage. [2025-10-03T22:42:00.690724] [INFO ] [MAIN ] MTG: Loaded 52017 primary data records. [2025-10-03T22:42:01.026996] [DEBUG] [LOCAL ] MTH: Loaded 44160 existing records from primary storage. [2025-10-03T22:42:01.027275] [INFO ] [MAIN ] MTH: Loaded 44160 primary data records. [2025-10-03T22:42:01.120173] [DEBUG] [LOCAL ] MTN: Loaded 39695 existing records from primary storage. [2025-10-03T22:42:01.146614] [INFO ] [MAIN ] MTN: Loaded 39695 primary data records. [2025-10-03T22:42:01.718274] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:01.720372] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 52017 primary records. [2025-10-03T22:42:01.720468] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-03T22:42:01.740995] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-10-03T22:42:01.742922] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-03T22:42:01.748105] [INFO ] [MAIN ] Derivative Progress: 1225/2073 symbols completed. MTG took 1.2s. Estimated remaining: 5m 49s. Rate: 145.9 symbols/min [2025-10-03T22:42:01.750228] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:01.765398] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:01.766241] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44160 primary records. [2025-10-03T22:42:01.766440] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-03T22:42:01.784022] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-10-03T22:42:01.789416] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-03T22:42:01.792857] [INFO ] [MAIN ] Derivative Progress: 1226/2073 symbols completed. MTH took 1.2s. Estimated remaining: 5m 48s. Rate: 146.0 symbols/min [2025-10-03T22:42:01.794295] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:01.818449] [DEBUG] [LOCAL ] MTRN: Loaded 18300 existing records from primary storage. [2025-10-03T22:42:01.818798] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:01.819049] [INFO ] [MAIN ] MTRN: Loaded 18300 primary data records. [2025-10-03T22:42:01.819773] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 39695 primary records. [2025-10-03T22:42:01.819960] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-03T22:42:01.959297] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-10-03T22:42:01.959908] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-03T22:42:01.973741] [INFO ] [MAIN ] Derivative Progress: 1227/2073 symbols completed. MTN took 1.3s. Estimated remaining: 5m 47s. Rate: 146.1 symbols/min [2025-10-03T22:42:01.991818] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:02.054164] [DEBUG] [LOCAL ] MTUS: Loaded 28494 existing records from primary storage. [2025-10-03T22:42:02.175719] [INFO ] [MAIN ] MTUS: Loaded 28494 primary data records. [2025-10-03T22:42:02.368558] [DEBUG] [LOCAL ] MTW: Loaded 26848 existing records from primary storage. [2025-10-03T22:42:02.394825] [INFO ] [MAIN ] MTW: Loaded 26848 primary data records. [2025-10-03T22:42:02.845176] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:02.847091] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18300 primary records. [2025-10-03T22:42:02.847522] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-03T22:42:02.870507] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-10-03T22:42:02.871630] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-03T22:42:02.874536] [INFO ] [MAIN ] Derivative Progress: 1228/2073 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 47s. Rate: 146.0 symbols/min [2025-10-03T22:42:02.896349] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:02.897863] [INFO ] [MAIN ] MTUS: Generated 1820 derivative records from 28494 primary records. [2025-10-03T22:42:02.897977] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-03T22:42:02.925558] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1820 records). [2025-10-03T22:42:02.925962] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-03T22:42:02.929098] [INFO ] [MAIN ] Derivative Progress: 1229/2073 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 47s. Rate: 146.1 symbols/min [2025-10-03T22:42:02.947029] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:02.947875] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 26848 primary records. [2025-10-03T22:42:02.947965] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-03T22:42:02.967225] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-10-03T22:42:02.967379] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-03T22:42:02.970174] [INFO ] [MAIN ] Derivative Progress: 1230/2073 symbols completed. MTW took 1.0s. Estimated remaining: 5m 46s. Rate: 146.2 symbols/min [2025-10-03T22:42:02.970837] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:02.970739] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:02.971703] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:02.995689] [DEBUG] [LOCAL ] MUA: Loaded 12468 existing records from primary storage. [2025-10-03T22:42:02.995930] [INFO ] [MAIN ] MUA: Loaded 12468 primary data records. [2025-10-03T22:42:03.072199] [DEBUG] [LOCAL ] MTX: Loaded 23006 existing records from primary storage. [2025-10-03T22:42:03.089144] [INFO ] [MAIN ] MTX: Loaded 23006 primary data records. [2025-10-03T22:42:03.369554] [DEBUG] [LOCAL ] MTZ: Loaded 43701 existing records from primary storage. [2025-10-03T22:42:03.396922] [INFO ] [MAIN ] MTZ: Loaded 43701 primary data records. [2025-10-03T22:42:04.322126] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:04.323244] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 12468 primary records. [2025-10-03T22:42:04.324017] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-03T22:42:04.344982] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-10-03T22:42:04.345150] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-03T22:42:04.347764] [INFO ] [MAIN ] Derivative Progress: 1231/2073 symbols completed. MUA took 1.4s. Estimated remaining: 5m 46s. Rate: 145.9 symbols/min [2025-10-03T22:42:04.348314] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:04.362303] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:04.364323] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 23006 primary records. [2025-10-03T22:42:04.364678] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-03T22:42:04.381327] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-10-03T22:42:04.381538] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-03T22:42:04.384712] [INFO ] [MAIN ] Derivative Progress: 1232/2073 symbols completed. MTX took 1.4s. Estimated remaining: 5m 46s. Rate: 146.0 symbols/min [2025-10-03T22:42:04.384987] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:04.401863] [DEBUG] [LOCAL ] MUC: Loaded 20852 existing records from primary storage. [2025-10-03T22:42:04.402106] [INFO ] [MAIN ] MUC: Loaded 20852 primary data records. [2025-10-03T22:42:04.487105] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:04.504598] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 43701 primary records. [2025-10-03T22:42:04.526225] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-03T22:42:04.526469] [DEBUG] [LOCAL ] MUE: Loaded 12061 existing records from primary storage. [2025-10-03T22:42:04.553451] [INFO ] [MAIN ] MUE: Loaded 12061 primary data records. [2025-10-03T22:42:04.820472] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-10-03T22:42:04.833373] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-03T22:42:04.853688] [INFO ] [MAIN ] Derivative Progress: 1233/2073 symbols completed. MTZ took 1.9s. Estimated remaining: 5m 45s. Rate: 146.0 symbols/min [2025-10-03T22:42:04.875339] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:05.078521] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:05.079368] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 20852 primary records. [2025-10-03T22:42:05.079796] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-03T22:42:05.112187] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-10-03T22:42:05.113912] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-03T22:42:05.116364] [INFO ] [MAIN ] Derivative Progress: 1234/2073 symbols completed. MUC took 0.8s. Estimated remaining: 5m 45s. Rate: 146.0 symbols/min [2025-10-03T22:42:05.116786] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:05.131081] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:05.131914] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12061 primary records. [2025-10-03T22:42:05.132058] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-03T22:42:05.164818] [DEBUG] [LOCAL ] MUFG: Loaded 53304 existing records from primary storage. [2025-10-03T22:42:05.167417] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-10-03T22:42:05.165996] [INFO ] [MAIN ] MUFG: Loaded 53304 primary data records. [2025-10-03T22:42:05.167556] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-03T22:42:05.175311] [INFO ] [MAIN ] Derivative Progress: 1235/2073 symbols completed. MUE took 0.8s. Estimated remaining: 5m 44s. Rate: 146.1 symbols/min [2025-10-03T22:42:05.207375] [DEBUG] [LOCAL ] MUJ: Loaded 13667 existing records from primary storage. [2025-10-03T22:42:05.229915] [INFO ] [MAIN ] MUJ: Loaded 13667 primary data records. [2025-10-03T22:42:05.219411] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:05.848261] [DEBUG] [LOCAL ] MUR: Loaded 53698 existing records from primary storage. [2025-10-03T22:42:05.849433] [INFO ] [MAIN ] MUR: Loaded 53698 primary data records. [2025-10-03T22:42:06.187764] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:06.189316] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53304 primary records. [2025-10-03T22:42:06.197373] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-03T22:42:06.204140] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:06.218586] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 13667 primary records. [2025-10-03T22:42:06.219022] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-03T22:42:06.223432] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-10-03T22:42:06.223513] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-03T22:42:06.237961] [INFO ] [MAIN ] Derivative Progress: 1236/2073 symbols completed. MUFG took 1.4s. Estimated remaining: 5m 44s. Rate: 145.9 symbols/min [2025-10-03T22:42:06.239037] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:06.243812] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-10-03T22:42:06.243973] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-03T22:42:06.246632] [INFO ] [MAIN ] Derivative Progress: 1237/2073 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 43s. Rate: 146.1 symbols/min [2025-10-03T22:42:06.246895] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:06.266090] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:06.273235] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53698 primary records. [2025-10-03T22:42:06.273519] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-03T22:42:06.298493] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-10-03T22:42:06.299716] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-03T22:42:06.303494] [DEBUG] [LOCAL ] MUSA: Loaded 24978 existing records from primary storage. [2025-10-03T22:42:06.302592] [INFO ] [MAIN ] Derivative Progress: 1238/2073 symbols completed. MUR took 1.1s. Estimated remaining: 5m 43s. Rate: 146.2 symbols/min [2025-10-03T22:42:06.303838] [INFO ] [MAIN ] MUSA: Loaded 24978 primary data records. [2025-10-03T22:42:06.303778] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:06.446283] [DEBUG] [LOCAL ] MVF: Loaded 13294 existing records from primary storage. [2025-10-03T22:42:06.474746] [DEBUG] [LOCAL ] MUX: Loaded 43578 existing records from primary storage. [2025-10-03T22:42:06.480030] [INFO ] [MAIN ] MUX: Loaded 43578 primary data records. [2025-10-03T22:42:06.458046] [INFO ] [MAIN ] MVF: Loaded 13294 primary data records. [2025-10-03T22:42:07.301074] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:07.302229] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 24978 primary records. [2025-10-03T22:42:07.302507] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-03T22:42:07.350465] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-10-03T22:42:07.350390] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:07.350637] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-03T22:42:07.349802] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:07.352022] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 13294 primary records. [2025-10-03T22:42:07.354369] [INFO ] [MAIN ] Derivative Progress: 1239/2073 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 43s. Rate: 146.0 symbols/min [2025-10-03T22:42:07.351371] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 43578 primary records. [2025-10-03T22:42:07.354739] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-03T22:42:07.354624] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:07.354513] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-03T22:42:07.388292] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-10-03T22:42:07.387900] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-10-03T22:42:07.392148] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-03T22:42:07.392434] [DEBUG] [LOCAL ] MVO: Loaded 9019 existing records from primary storage. [2025-10-03T22:42:07.395244] [INFO ] [MAIN ] Derivative Progress: 1240/2073 symbols completed. MVF took 1.1s. Estimated remaining: 5m 42s. Rate: 146.1 symbols/min [2025-10-03T22:42:07.392224] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-03T22:42:07.398019] [INFO ] [MAIN ] Derivative Progress: 1241/2073 symbols completed. MUX took 1.2s. Estimated remaining: 5m 41s. Rate: 146.2 symbols/min [2025-10-03T22:42:07.398266] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:07.395441] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:07.398468] [INFO ] [MAIN ] MVO: Loaded 9019 primary data records. [2025-10-03T22:42:07.558043] [DEBUG] [LOCAL ] MVT: Loaded 10367 existing records from primary storage. [2025-10-03T22:42:07.591030] [INFO ] [MAIN ] MVT: Loaded 10367 primary data records. [2025-10-03T22:42:08.084194] [DEBUG] [LOCAL ] MWA: Loaded 47219 existing records from primary storage. [2025-10-03T22:42:08.084750] [INFO ] [MAIN ] MWA: Loaded 47219 primary data records. [2025-10-03T22:42:08.403868] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:08.405457] [INFO ] [MAIN ] MVO: Generated 1820 derivative records from 9019 primary records. [2025-10-03T22:42:08.406555] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-03T22:42:08.427182] [DEBUG] [LOCAL ] MVO: Derivative data saved (1820 records). [2025-10-03T22:42:08.427635] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-03T22:42:08.430246] [INFO ] [MAIN ] Derivative Progress: 1242/2073 symbols completed. MVO took 1.1s. Estimated remaining: 5m 41s. Rate: 146.0 symbols/min [2025-10-03T22:42:08.430413] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:08.445897] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:08.447040] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10367 primary records. [2025-10-03T22:42:08.447310] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-03T22:42:08.463789] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-10-03T22:42:08.464082] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-03T22:42:08.467789] [INFO ] [MAIN ] Derivative Progress: 1243/2073 symbols completed. MVT took 1.1s. Estimated remaining: 5m 41s. Rate: 146.1 symbols/min [2025-10-03T22:42:08.491463] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:08.492243] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 47219 primary records. [2025-10-03T22:42:08.492329] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-03T22:42:08.510428] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-10-03T22:42:08.510536] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-03T22:42:08.513787] [INFO ] [MAIN ] Derivative Progress: 1244/2073 symbols completed. MWA took 1.1s. Estimated remaining: 5m 40s. Rate: 146.2 symbols/min [2025-10-03T22:42:08.530807] [DEBUG] [LOCAL ] MX: Loaded 22993 existing records from primary storage. [2025-10-03T22:42:08.531046] [INFO ] [MAIN ] MX: Loaded 22993 primary data records. [2025-10-03T22:42:08.877262] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:08.878024] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 22993 primary records. [2025-10-03T22:42:08.878094] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-03T22:42:08.895167] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-10-03T22:42:08.895350] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-03T22:42:08.897940] [INFO ] [MAIN ] Derivative Progress: 1245/2073 symbols completed. MX took 0.5s. Estimated remaining: 5m 40s. Rate: 146.2 symbols/min [2025-10-03T22:42:08.899148] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:08.899023] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:08.898857] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:08.910102] [DEBUG] [LOCAL ] MXF: Loaded 5813 existing records from primary storage. [2025-10-03T22:42:08.910288] [INFO ] [MAIN ] MXF: Loaded 5813 primary data records. [2025-10-03T22:42:09.039623] [DEBUG] [LOCAL ] MYD: Loaded 13877 existing records from primary storage. [2025-10-03T22:42:09.060977] [INFO ] [MAIN ] MYD: Loaded 13877 primary data records. [2025-10-03T22:42:09.123460] [DEBUG] [LOCAL ] MYE: Loaded 24865 existing records from primary storage. [2025-10-03T22:42:09.325003] [INFO ] [MAIN ] MYE: Loaded 24865 primary data records. [2025-10-03T22:42:09.932127] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:09.933198] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5813 primary records. [2025-10-03T22:42:09.933408] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-03T22:42:09.963556] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:09.967162] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13877 primary records. [2025-10-03T22:42:09.968831] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-03T22:42:09.995977] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:09.992550] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-10-03T22:42:09.999966] [INFO ] [MAIN ] MYE: Generated 1820 derivative records from 24865 primary records. [2025-10-03T22:42:10.001090] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-10-03T22:42:10.001191] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-03T22:42:09.998918] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-03T22:42:10.000063] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-03T22:42:10.003627] [INFO ] [MAIN ] Derivative Progress: 1246/2073 symbols completed. MYD took 1.1s. Estimated remaining: 5m 40s. Rate: 146.0 symbols/min [2025-10-03T22:42:10.003818] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:10.006285] [INFO ] [MAIN ] Derivative Progress: 1247/2073 symbols completed. MXF took 1.1s. Estimated remaining: 5m 39s. Rate: 146.2 symbols/min [2025-10-03T22:42:10.007499] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:10.024564] [DEBUG] [LOCAL ] MYE: Derivative data saved (1820 records). [2025-10-03T22:42:10.024824] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-03T22:42:10.030075] [INFO ] [MAIN ] Derivative Progress: 1248/2073 symbols completed. MYE took 1.1s. Estimated remaining: 5m 38s. Rate: 146.3 symbols/min [2025-10-03T22:42:10.030344] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:10.035620] [DEBUG] [LOCAL ] MYN: Loaded 10083 existing records from primary storage. [2025-10-03T22:42:10.035855] [INFO ] [MAIN ] MYN: Loaded 10083 primary data records. [2025-10-03T22:42:10.135499] [DEBUG] [LOCAL ] MYI: Loaded 19693 existing records from primary storage. [2025-10-03T22:42:10.135767] [INFO ] [MAIN ] MYI: Loaded 19693 primary data records. [2025-10-03T22:42:10.379343] [DEBUG] [LOCAL ] NABL: Loaded 39908 existing records from primary storage. [2025-10-03T22:42:10.534523] [INFO ] [MAIN ] NABL: Loaded 39908 primary data records. [2025-10-03T22:42:11.059215] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:11.058858] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:11.060166] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19693 primary records. [2025-10-03T22:42:11.060340] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-03T22:42:11.061599] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10083 primary records. [2025-10-03T22:42:11.063526] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-03T22:42:11.093105] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-10-03T22:42:11.093555] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-03T22:42:11.096439] [INFO ] [MAIN ] Derivative Progress: 1249/2073 symbols completed. MYN took 1.1s. Estimated remaining: 5m 38s. Rate: 146.1 symbols/min [2025-10-03T22:42:11.096820] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:11.101478] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-10-03T22:42:11.103608] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-03T22:42:11.106318] [INFO ] [MAIN ] Derivative Progress: 1250/2073 symbols completed. MYI took 1.1s. Estimated remaining: 5m 38s. Rate: 146.2 symbols/min [2025-10-03T22:42:11.107394] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:11.121816] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:11.122769] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 39908 primary records. [2025-10-03T22:42:11.123016] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-03T22:42:11.146604] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-10-03T22:42:11.154045] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-03T22:42:11.157899] [INFO ] [MAIN ] Derivative Progress: 1251/2073 symbols completed. NABL took 1.1s. Estimated remaining: 5m 37s. Rate: 146.3 symbols/min [2025-10-03T22:42:11.158139] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:11.159316] [DEBUG] [LOCAL ] NAC: Loaded 25229 existing records from primary storage. [2025-10-03T22:42:11.159554] [INFO ] [MAIN ] NAC: Loaded 25229 primary data records. [2025-10-03T22:42:11.269957] [DEBUG] [LOCAL ] NAN: Loaded 8941 existing records from primary storage. [2025-10-03T22:42:11.282263] [INFO ] [MAIN ] NAN: Loaded 8941 primary data records. [2025-10-03T22:42:11.441690] [DEBUG] [LOCAL ] NAD: Loaded 34402 existing records from primary storage. [2025-10-03T22:42:11.463697] [INFO ] [MAIN ] NAD: Loaded 34402 primary data records. [2025-10-03T22:42:12.191927] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:12.194194] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 25229 primary records. [2025-10-03T22:42:12.194377] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-03T22:42:12.219361] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:12.220541] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 8941 primary records. [2025-10-03T22:42:12.221889] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-03T22:42:12.242604] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-10-03T22:42:12.243798] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-03T22:42:12.246515] [INFO ] [MAIN ] Derivative Progress: 1252/2073 symbols completed. NAC took 1.1s. Estimated remaining: 5m 37s. Rate: 146.1 symbols/min [2025-10-03T22:42:12.246943] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:12.247947] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-10-03T22:42:12.248387] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-03T22:42:12.259130] [INFO ] [MAIN ] Derivative Progress: 1253/2073 symbols completed. NAN took 1.1s. Estimated remaining: 5m 37s. Rate: 146.2 symbols/min [2025-10-03T22:42:12.264740] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:12.264836] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:12.265808] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34402 primary records. [2025-10-03T22:42:12.266094] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-03T22:42:12.286799] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-10-03T22:42:12.287101] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-03T22:42:12.290813] [INFO ] [MAIN ] Derivative Progress: 1254/2073 symbols completed. NAD took 1.2s. Estimated remaining: 5m 36s. Rate: 146.3 symbols/min [2025-10-03T22:42:12.291166] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:12.306731] [DEBUG] [LOCAL ] NAZ: Loaded 2674 existing records from primary storage. [2025-10-03T22:42:12.307076] [INFO ] [MAIN ] NAZ: Loaded 2674 primary data records. [2025-10-03T22:42:12.438786] [DEBUG] [LOCAL ] NATL: Loaded 32994 existing records from primary storage. [2025-10-03T22:42:12.442851] [INFO ] [MAIN ] NATL: Loaded 32994 primary data records. [2025-10-03T22:42:12.700623] [DEBUG] [LOCAL ] NAT: Loaded 49921 existing records from primary storage. [2025-10-03T22:42:12.773832] [INFO ] [MAIN ] NAT: Loaded 49921 primary data records. [2025-10-03T22:42:13.318851] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:42:13.321255] [INFO ] [MAIN ] NAZ: Generated 1819 derivative records from 2674 primary records. [2025-10-03T22:42:13.322055] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-03T22:42:13.349526] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:13.352823] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1819 records). [2025-10-03T22:42:13.353696] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 32994 primary records. [2025-10-03T22:42:13.353924] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-03T22:42:13.356637] [INFO ] [MAIN ] Derivative Progress: 1255/2073 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 36s. Rate: 146.1 symbols/min [2025-10-03T22:42:13.354139] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-03T22:42:13.356841] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:13.377979] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-10-03T22:42:13.378295] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-03T22:42:13.381093] [INFO ] [MAIN ] Derivative Progress: 1256/2073 symbols completed. NATL took 1.1s. Estimated remaining: 5m 35s. Rate: 146.2 symbols/min [2025-10-03T22:42:13.381305] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:13.388722] [DEBUG] [LOCAL ] NBB: Loaded 9215 existing records from primary storage. [2025-10-03T22:42:13.388948] [INFO ] [MAIN ] NBB: Loaded 9215 primary data records. [2025-10-03T22:42:13.471687] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:13.488607] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49921 primary records. [2025-10-03T22:42:13.511219] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-03T22:42:13.584300] [DEBUG] [LOCAL ] NBHC: Loaded 23679 existing records from primary storage. [2025-10-03T22:42:13.606783] [INFO ] [MAIN ] NBHC: Loaded 23679 primary data records. [2025-10-03T22:42:13.836761] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-10-03T22:42:13.837549] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-03T22:42:13.868599] [INFO ] [MAIN ] Derivative Progress: 1257/2073 symbols completed. NAT took 1.6s. Estimated remaining: 5m 35s. Rate: 146.2 symbols/min [2025-10-03T22:42:13.880971] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:14.123382] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:14.133852] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 9215 primary records. [2025-10-03T22:42:14.134889] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-03T22:42:14.145006] [DEBUG] [LOCAL ] NBR: Loaded 34980 existing records from primary storage. [2025-10-03T22:42:14.149545] [INFO ] [MAIN ] NBR: Loaded 34980 primary data records. [2025-10-03T22:42:14.250880] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-10-03T22:42:14.262344] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-03T22:42:14.265328] [INFO ] [MAIN ] Derivative Progress: 1258/2073 symbols completed. NBB took 0.9s. Estimated remaining: 5m 34s. Rate: 146.2 symbols/min [2025-10-03T22:42:14.494839] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:14.495614] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 23679 primary records. [2025-10-03T22:42:14.495783] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-03T22:42:14.516671] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-10-03T22:42:14.517900] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-03T22:42:14.520972] [INFO ] [MAIN ] Derivative Progress: 1259/2073 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 34s. Rate: 146.3 symbols/min [2025-10-03T22:42:14.539486] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:14.540164] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 34980 primary records. [2025-10-03T22:42:14.540227] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-03T22:42:14.556174] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-10-03T22:42:14.556258] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-03T22:42:14.559396] [INFO ] [MAIN ] Derivative Progress: 1260/2073 symbols completed. NBR took 0.7s. Estimated remaining: 5m 33s. Rate: 146.4 symbols/min [2025-10-03T22:42:14.559864] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:14.560190] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:14.560879] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:14.567863] [DEBUG] [LOCAL ] NC: Loaded 1954 existing records from primary storage. [2025-10-03T22:42:14.568096] [INFO ] [MAIN ] NC: Loaded 1954 primary data records. [2025-10-03T22:42:14.654441] [DEBUG] [LOCAL ] NCA: Loaded 10346 existing records from primary storage. [2025-10-03T22:42:14.676116] [INFO ] [MAIN ] NCA: Loaded 10346 primary data records. [2025-10-03T22:42:14.821120] [DEBUG] [LOCAL ] NCDL: Loaded 21949 existing records from primary storage. [2025-10-03T22:42:14.839059] [INFO ] [MAIN ] NCDL: Loaded 21949 primary data records. [2025-10-03T22:42:15.532924] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:15.534510] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1954 primary records. [2025-10-03T22:42:15.542453] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-03T22:42:15.548834] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:15.550461] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10346 primary records. [2025-10-03T22:42:15.556489] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-03T22:42:15.580683] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-10-03T22:42:15.582639] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-03T22:42:15.585376] [INFO ] [MAIN ] Derivative Progress: 1261/2073 symbols completed. NC took 1.0s. Estimated remaining: 5m 33s. Rate: 146.2 symbols/min [2025-10-03T22:42:15.586555] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:15.600177] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-10-03T22:42:15.606543] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-03T22:42:15.609964] [INFO ] [MAIN ] Derivative Progress: 1262/2073 symbols completed. NCA took 1.0s. Estimated remaining: 5m 33s. Rate: 146.3 symbols/min [2025-10-03T22:42:15.610768] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:15.611254] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:15.612591] [INFO ] [MAIN ] NCDL: Generated 1820 derivative records from 21949 primary records. [2025-10-03T22:42:15.612846] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-03T22:42:15.636872] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1820 records). [2025-10-03T22:42:15.637069] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-03T22:42:15.640046] [INFO ] [MAIN ] Derivative Progress: 1263/2073 symbols completed. NCDL took 1.1s. Estimated remaining: 5m 32s. Rate: 146.4 symbols/min [2025-10-03T22:42:15.640416] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:15.647194] [DEBUG] [LOCAL ] NCZ: Loaded 12247 existing records from primary storage. [2025-10-03T22:42:15.652907] [DEBUG] [LOCAL ] NCV: Loaded 13987 existing records from primary storage. [2025-10-03T22:42:15.653057] [INFO ] [MAIN ] NCZ: Loaded 12247 primary data records. [2025-10-03T22:42:15.664526] [INFO ] [MAIN ] NCV: Loaded 13987 primary data records. [2025-10-03T22:42:15.813397] [DEBUG] [LOCAL ] NDMO: Loaded 17210 existing records from primary storage. [2025-10-03T22:42:15.856703] [INFO ] [MAIN ] NDMO: Loaded 17210 primary data records. [2025-10-03T22:42:16.699880] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:16.701450] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 13987 primary records. [2025-10-03T22:42:16.701726] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-03T22:42:16.727010] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:16.733518] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 12247 primary records. [2025-10-03T22:42:16.736468] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-03T22:42:16.737873] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-10-03T22:42:16.738508] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-03T22:42:16.742077] [INFO ] [MAIN ] Derivative Progress: 1264/2073 symbols completed. NCV took 1.2s. Estimated remaining: 5m 32s. Rate: 146.2 symbols/min [2025-10-03T22:42:16.742309] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:16.769569] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:16.770807] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 17210 primary records. [2025-10-03T22:42:16.771544] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-03T22:42:16.792054] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-10-03T22:42:16.792454] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-03T22:42:16.795765] [INFO ] [MAIN ] Derivative Progress: 1265/2073 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 31s. Rate: 146.3 symbols/min [2025-10-03T22:42:16.798435] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-10-03T22:42:16.797323] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:16.798699] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-03T22:42:16.804657] [INFO ] [MAIN ] Derivative Progress: 1266/2073 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 31s. Rate: 146.4 symbols/min [2025-10-03T22:42:16.805035] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:16.844949] [DEBUG] [LOCAL ] NE: Loaded 53111 existing records from primary storage. [2025-10-03T22:42:16.845258] [INFO ] [MAIN ] NE: Loaded 53111 primary data records. [2025-10-03T22:42:17.009494] [DEBUG] [LOCAL ] NEA: Loaded 35947 existing records from primary storage. [2025-10-03T22:42:17.020635] [INFO ] [MAIN ] NEA: Loaded 35947 primary data records. [2025-10-03T22:42:17.302198] [DEBUG] [LOCAL ] NET: Loaded 53750 existing records from primary storage. [2025-10-03T22:42:17.308619] [INFO ] [MAIN ] NET: Loaded 53750 primary data records. [2025-10-03T22:42:17.925935] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:17.929893] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53111 primary records. [2025-10-03T22:42:17.930625] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-03T22:42:17.944987] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:17.954356] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35947 primary records. [2025-10-03T22:42:17.957564] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-03T22:42:17.977488] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-10-03T22:42:17.977706] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-03T22:42:17.981235] [INFO ] [MAIN ] Derivative Progress: 1267/2073 symbols completed. NEA took 1.2s. Estimated remaining: 5m 31s. Rate: 146.2 symbols/min [2025-10-03T22:42:17.982619] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:17.984771] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-10-03T22:42:17.985529] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-03T22:42:17.988816] [INFO ] [MAIN ] Derivative Progress: 1268/2073 symbols completed. NE took 1.2s. Estimated remaining: 5m 30s. Rate: 146.3 symbols/min [2025-10-03T22:42:17.989050] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:18.003308] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:42:18.004424] [INFO ] [MAIN ] NET: Generated 1819 derivative records from 53750 primary records. [2025-10-03T22:42:18.004514] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-03T22:42:18.025685] [DEBUG] [LOCAL ] NET: Derivative data saved (1819 records). [2025-10-03T22:42:18.029629] [DEBUG] [LOCAL ] NEU: Loaded 8405 existing records from primary storage. [2025-10-03T22:42:18.029757] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-03T22:42:18.029825] [INFO ] [MAIN ] NEU: Loaded 8405 primary data records. [2025-10-03T22:42:18.033133] [INFO ] [MAIN ] Derivative Progress: 1269/2073 symbols completed. NET took 1.2s. Estimated remaining: 5m 29s. Rate: 146.4 symbols/min [2025-10-03T22:42:18.048090] [DEBUG] [LOCAL ] NEXA: Loaded 4449 existing records from primary storage. [2025-10-03T22:42:18.052768] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:18.069053] [INFO ] [MAIN ] NEXA: Loaded 4449 primary data records. [2025-10-03T22:42:18.697578] [DEBUG] [LOCAL ] NFG: Loaded 39126 existing records from primary storage. [2025-10-03T22:42:18.698464] [INFO ] [MAIN ] NFG: Loaded 39126 primary data records. [2025-10-03T22:42:19.045872] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:19.047420] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8405 primary records. [2025-10-03T22:42:19.047612] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-03T22:42:19.078938] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:19.081247] [INFO ] [MAIN ] NEXA: Generated 1820 derivative records from 4449 primary records. [2025-10-03T22:42:19.081826] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-03T22:42:19.098899] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-10-03T22:42:19.100365] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-03T22:42:19.103608] [INFO ] [MAIN ] Derivative Progress: 1270/2073 symbols completed. NEU took 1.1s. Estimated remaining: 5m 29s. Rate: 146.2 symbols/min [2025-10-03T22:42:19.104426] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:19.111305] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1820 records). [2025-10-03T22:42:19.111673] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-03T22:42:19.114625] [INFO ] [MAIN ] Derivative Progress: 1271/2073 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 29s. Rate: 146.4 symbols/min [2025-10-03T22:42:19.114917] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:19.129602] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:19.130565] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39126 primary records. [2025-10-03T22:42:19.130764] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-03T22:42:19.154294] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-10-03T22:42:19.154440] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-03T22:42:19.157568] [INFO ] [MAIN ] Derivative Progress: 1272/2073 symbols completed. NFG took 1.1s. Estimated remaining: 5m 28s. Rate: 146.5 symbols/min [2025-10-03T22:42:19.158610] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:19.167200] [DEBUG] [LOCAL ] NFJ: Loaded 20735 existing records from primary storage. [2025-10-03T22:42:19.167274] [INFO ] [MAIN ] NFJ: Loaded 20735 primary data records. [2025-10-03T22:42:19.361309] [DEBUG] [LOCAL ] NGG: Loaded 46850 existing records from primary storage. [2025-10-03T22:42:19.398157] [INFO ] [MAIN ] NGG: Loaded 46850 primary data records. [2025-10-03T22:42:19.398019] [DEBUG] [LOCAL ] NGL: Loaded 30563 existing records from primary storage. [2025-10-03T22:42:19.402162] [INFO ] [MAIN ] NGL: Loaded 30563 primary data records. [2025-10-03T22:42:20.227461] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:20.230228] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20735 primary records. [2025-10-03T22:42:20.231092] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-03T22:42:20.250795] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-10-03T22:42:20.250917] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-03T22:42:20.253612] [INFO ] [MAIN ] Derivative Progress: 1273/2073 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 28s. Rate: 146.3 symbols/min [2025-10-03T22:42:20.274965] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:20.288928] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30563 primary records. [2025-10-03T22:42:20.289314] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:20.289441] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-03T22:42:20.290313] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 46850 primary records. [2025-10-03T22:42:20.291159] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-03T22:42:20.315880] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-10-03T22:42:20.320258] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-03T22:42:20.323573] [INFO ] [MAIN ] Derivative Progress: 1274/2073 symbols completed. NGL took 1.2s. Estimated remaining: 5m 28s. Rate: 146.4 symbols/min [2025-10-03T22:42:20.326499] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-10-03T22:42:20.326795] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-03T22:42:20.330287] [INFO ] [MAIN ] Derivative Progress: 1275/2073 symbols completed. NGG took 1.2s. Estimated remaining: 5m 27s. Rate: 146.5 symbols/min [2025-10-03T22:42:20.330739] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:20.330933] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:20.330876] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:20.352189] [DEBUG] [LOCAL ] NGS: Loaded 11679 existing records from primary storage. [2025-10-03T22:42:20.352330] [INFO ] [MAIN ] NGS: Loaded 11679 primary data records. [2025-10-03T22:42:20.478196] [DEBUG] [LOCAL ] NGVC: Loaded 22666 existing records from primary storage. [2025-10-03T22:42:20.478702] [DEBUG] [LOCAL ] NGVT: Loaded 24460 existing records from primary storage. [2025-10-03T22:42:20.479075] [INFO ] [MAIN ] NGVT: Loaded 24460 primary data records. [2025-10-03T22:42:20.479599] [INFO ] [MAIN ] NGVC: Loaded 22666 primary data records. [2025-10-03T22:42:21.357191] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:21.359789] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11679 primary records. [2025-10-03T22:42:21.360573] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-03T22:42:21.389691] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:21.391062] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24460 primary records. [2025-10-03T22:42:21.399030] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-03T22:42:21.406503] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:21.407161] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 22666 primary records. [2025-10-03T22:42:21.407971] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-03T22:42:21.409328] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-10-03T22:42:21.409848] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-03T22:42:21.420442] [INFO ] [MAIN ] Derivative Progress: 1276/2073 symbols completed. NGS took 1.1s. Estimated remaining: 5m 27s. Rate: 146.3 symbols/min [2025-10-03T22:42:21.438441] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:21.442266] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-10-03T22:42:21.442899] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-03T22:42:21.445956] [INFO ] [MAIN ] Derivative Progress: 1277/2073 symbols completed. NGVC took 1.1s. Estimated remaining: 5m 26s. Rate: 146.4 symbols/min [2025-10-03T22:42:21.446219] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:21.449582] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-10-03T22:42:21.449719] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-03T22:42:21.453068] [INFO ] [MAIN ] Derivative Progress: 1278/2073 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 26s. Rate: 146.5 symbols/min [2025-10-03T22:42:21.453619] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:21.468479] [DEBUG] [LOCAL ] NIC: Loaded 9103 existing records from primary storage. [2025-10-03T22:42:21.468793] [INFO ] [MAIN ] NIC: Loaded 9103 primary data records. [2025-10-03T22:42:21.588631] [DEBUG] [LOCAL ] NHI: Loaded 22136 existing records from primary storage. [2025-10-03T22:42:21.592963] [DEBUG] [LOCAL ] NIE: Loaded 12087 existing records from primary storage. [2025-10-03T22:42:21.593081] [INFO ] [MAIN ] NIE: Loaded 12087 primary data records. [2025-10-03T22:42:21.593479] [INFO ] [MAIN ] NHI: Loaded 22136 primary data records. [2025-10-03T22:42:22.513462] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:22.514848] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9103 primary records. [2025-10-03T22:42:22.515965] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-03T22:42:22.553257] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:22.559118] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:22.560133] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22136 primary records. [2025-10-03T22:42:22.560917] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-03T22:42:22.561542] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 12087 primary records. [2025-10-03T22:42:22.562908] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-03T22:42:22.591903] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-10-03T22:42:22.594274] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-03T22:42:22.597261] [INFO ] [MAIN ] Derivative Progress: 1279/2073 symbols completed. NIC took 1.2s. Estimated remaining: 5m 26s. Rate: 146.3 symbols/min [2025-10-03T22:42:22.597731] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:22.593953] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-10-03T22:42:22.597989] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-03T22:42:22.607027] [INFO ] [MAIN ] Derivative Progress: 1280/2073 symbols completed. NIE took 1.2s. Estimated remaining: 5m 25s. Rate: 146.4 symbols/min [2025-10-03T22:42:22.608484] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:22.615954] [DEBUG] [LOCAL ] NIM: Loaded 4097 existing records from primary storage. [2025-10-03T22:42:22.616969] [INFO ] [MAIN ] NIM: Loaded 4097 primary data records. [2025-10-03T22:42:22.616855] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-10-03T22:42:22.641701] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-03T22:42:22.660514] [INFO ] [MAIN ] Derivative Progress: 1281/2073 symbols completed. NHI took 1.2s. Estimated remaining: 5m 24s. Rate: 146.5 symbols/min [2025-10-03T22:42:22.666061] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:22.815235] [DEBUG] [LOCAL ] NINE: Loaded 28549 existing records from primary storage. [2025-10-03T22:42:22.835324] [INFO ] [MAIN ] NINE: Loaded 28549 primary data records. [2025-10-03T22:42:23.295402] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-03T22:42:23.295720] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-10-03T22:42:23.630744] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:23.632114] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 4097 primary records. [2025-10-03T22:42:23.632453] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-03T22:42:23.668769] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:23.668349] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-10-03T22:42:23.671173] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28549 primary records. [2025-10-03T22:42:23.671388] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-03T22:42:23.671312] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-03T22:42:23.674015] [INFO ] [MAIN ] Derivative Progress: 1282/2073 symbols completed. NIM took 1.1s. Estimated remaining: 5m 24s. Rate: 146.3 symbols/min [2025-10-03T22:42:23.675463] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:23.697143] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-10-03T22:42:23.697373] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-03T22:42:23.700565] [INFO ] [MAIN ] Derivative Progress: 1283/2073 symbols completed. NINE took 1.1s. Estimated remaining: 5m 24s. Rate: 146.5 symbols/min [2025-10-03T22:42:23.713393] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:23.714077] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:23.715252] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-10-03T22:42:23.715321] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-03T22:42:23.745936] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-10-03T22:42:23.746177] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-03T22:42:23.748910] [INFO ] [MAIN ] Derivative Progress: 1284/2073 symbols completed. NIO took 1.1s. Estimated remaining: 5m 23s. Rate: 146.6 symbols/min [2025-10-03T22:42:23.749245] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:23.756544] [DEBUG] [LOCAL ] NKX: Loaded 13878 existing records from primary storage. [2025-10-03T22:42:23.756846] [INFO ] [MAIN ] NKX: Loaded 13878 primary data records. [2025-10-03T22:42:23.812210] [DEBUG] [LOCAL ] NJR: Loaded 38713 existing records from primary storage. [2025-10-03T22:42:23.852849] [INFO ] [MAIN ] NJR: Loaded 38713 primary data records. [2025-10-03T22:42:23.987068] [DEBUG] [LOCAL ] NLOP: Loaded 11886 existing records from primary storage. [2025-10-03T22:42:24.068213] [INFO ] [MAIN ] NLOP: Loaded 11886 primary data records. [2025-10-03T22:42:24.802456] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:24.805163] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13878 primary records. [2025-10-03T22:42:24.805901] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-03T22:42:24.833101] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:24.837300] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38713 primary records. [2025-10-03T22:42:24.837998] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-10-03T22:42:24.838365] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-03T22:42:24.838432] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-03T22:42:24.840898] [INFO ] [MAIN ] Derivative Progress: 1285/2073 symbols completed. NKX took 1.1s. Estimated remaining: 5m 23s. Rate: 146.4 symbols/min [2025-10-03T22:42:24.843111] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:24.872949] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:24.874733] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 11886 primary records. [2025-10-03T22:42:24.875328] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-03T22:42:24.875948] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-10-03T22:42:24.877157] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-03T22:42:24.889046] [INFO ] [MAIN ] Derivative Progress: 1286/2073 symbols completed. NJR took 1.2s. Estimated remaining: 5m 22s. Rate: 146.5 symbols/min [2025-10-03T22:42:24.895826] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:24.896890] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-10-03T22:42:24.896972] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-03T22:42:24.900196] [INFO ] [MAIN ] Derivative Progress: 1287/2073 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 22s. Rate: 146.6 symbols/min [2025-10-03T22:42:24.900430] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:24.916091] [DEBUG] [LOCAL ] NMAI: Loaded 13073 existing records from primary storage. [2025-10-03T22:42:24.916297] [INFO ] [MAIN ] NMAI: Loaded 13073 primary data records. [2025-10-03T22:42:25.050291] [DEBUG] [LOCAL ] NMCO: Loaded 17047 existing records from primary storage. [2025-10-03T22:42:25.055406] [INFO ] [MAIN ] NMCO: Loaded 17047 primary data records. [2025-10-03T22:42:25.261228] [DEBUG] [LOCAL ] NLY: Loaded 54355 existing records from primary storage. [2025-10-03T22:42:25.261524] [INFO ] [MAIN ] NLY: Loaded 54355 primary data records. [2025-10-03T22:42:25.976054] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:25.987793] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13073 primary records. [2025-10-03T22:42:25.995176] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-03T22:42:25.995545] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:25.996956] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 17047 primary records. [2025-10-03T22:42:25.997287] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-03T22:42:26.047888] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:26.049210] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-10-03T22:42:26.050292] [INFO ] [MAIN ] NLY: Generated 1820 derivative records from 54355 primary records. [2025-10-03T22:42:26.050758] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-03T22:42:26.050681] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-03T22:42:26.055685] [INFO ] [MAIN ] Derivative Progress: 1288/2073 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 22s. Rate: 146.4 symbols/min [2025-10-03T22:42:26.056310] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-10-03T22:42:26.056767] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-03T22:42:26.070858] [INFO ] [MAIN ] Derivative Progress: 1289/2073 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 21s. Rate: 146.5 symbols/min [2025-10-03T22:42:26.075395] [DEBUG] [LOCAL ] NLY: Derivative data saved (1820 records). [2025-10-03T22:42:26.075465] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-03T22:42:26.078359] [INFO ] [MAIN ] Derivative Progress: 1290/2073 symbols completed. NLY took 1.2s. Estimated remaining: 5m 20s. Rate: 146.6 symbols/min [2025-10-03T22:42:26.078970] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:26.078860] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:26.079071] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:26.087896] [DEBUG] [LOCAL ] NMI: Loaded 4096 existing records from primary storage. [2025-10-03T22:42:26.088169] [INFO ] [MAIN ] NMI: Loaded 4096 primary data records. [2025-10-03T22:42:26.180913] [DEBUG] [LOCAL ] NMG: Loaded 8496 existing records from primary storage. [2025-10-03T22:42:26.203963] [INFO ] [MAIN ] NMG: Loaded 8496 primary data records. [2025-10-03T22:42:26.244030] [DEBUG] [LOCAL ] NMM: Loaded 14505 existing records from primary storage. [2025-10-03T22:42:26.272858] [INFO ] [MAIN ] NMM: Loaded 14505 primary data records. [2025-10-03T22:42:27.066308] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:27.067314] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4096 primary records. [2025-10-03T22:42:27.069069] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-03T22:42:27.094951] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:27.096290] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 8496 primary records. [2025-10-03T22:42:27.096985] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-03T22:42:27.113931] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-10-03T22:42:27.114500] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-03T22:42:27.117274] [INFO ] [MAIN ] Derivative Progress: 1291/2073 symbols completed. NMI took 1.0s. Estimated remaining: 5m 20s. Rate: 146.4 symbols/min [2025-10-03T22:42:27.117592] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:27.122615] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-10-03T22:42:27.122921] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-03T22:42:27.125908] [INFO ] [MAIN ] Derivative Progress: 1292/2073 symbols completed. NMG took 1.0s. Estimated remaining: 5m 20s. Rate: 146.5 symbols/min [2025-10-03T22:42:27.126351] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:27.140078] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:27.140877] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14505 primary records. [2025-10-03T22:42:27.141786] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-03T22:42:27.157033] [DEBUG] [LOCAL ] NMS: Loaded 2885 existing records from primary storage. [2025-10-03T22:42:27.157898] [INFO ] [MAIN ] NMS: Loaded 2885 primary data records. [2025-10-03T22:42:27.173274] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-10-03T22:42:27.190703] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-03T22:42:27.207032] [INFO ] [MAIN ] Derivative Progress: 1293/2073 symbols completed. NMM took 1.1s. Estimated remaining: 5m 19s. Rate: 146.6 symbols/min [2025-10-03T22:42:27.254556] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:27.293390] [DEBUG] [LOCAL ] NMR: Loaded 35491 existing records from primary storage. [2025-10-03T22:42:27.293678] [INFO ] [MAIN ] NMR: Loaded 35491 primary data records. [2025-10-03T22:42:27.518878] [DEBUG] [LOCAL ] NMT: Loaded 2905 existing records from primary storage. [2025-10-03T22:42:27.588489] [INFO ] [MAIN ] NMT: Loaded 2905 primary data records. [2025-10-03T22:42:28.186001] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:28.187078] [INFO ] [MAIN ] NMS: Generated 1820 derivative records from 2885 primary records. [2025-10-03T22:42:28.187600] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-03T22:42:28.207367] [DEBUG] [LOCAL ] NMS: Derivative data saved (1820 records). [2025-10-03T22:42:28.220673] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-03T22:42:28.225206] [INFO ] [MAIN ] Derivative Progress: 1294/2073 symbols completed. NMS took 1.1s. Estimated remaining: 5m 19s. Rate: 146.4 symbols/min [2025-10-03T22:42:28.226317] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:28.226770] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:28.228126] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 35491 primary records. [2025-10-03T22:42:28.228327] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-03T22:42:28.251110] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:28.257865] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2905 primary records. [2025-10-03T22:42:28.259347] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-03T22:42:28.259252] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-10-03T22:42:28.260346] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-03T22:42:28.263704] [INFO ] [MAIN ] Derivative Progress: 1295/2073 symbols completed. NMR took 1.1s. Estimated remaining: 5m 19s. Rate: 146.5 symbols/min [2025-10-03T22:42:28.283447] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:28.295714] [DEBUG] [LOCAL ] NMZ: Loaded 22014 existing records from primary storage. [2025-10-03T22:42:28.298028] [INFO ] [MAIN ] NMZ: Loaded 22014 primary data records. [2025-10-03T22:42:28.297870] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-10-03T22:42:28.310260] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-03T22:42:28.322851] [INFO ] [MAIN ] Derivative Progress: 1296/2073 symbols completed. NMT took 1.1s. Estimated remaining: 5m 18s. Rate: 146.6 symbols/min [2025-10-03T22:42:28.338856] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:28.389078] [DEBUG] [LOCAL ] NNI: Loaded 10353 existing records from primary storage. [2025-10-03T22:42:28.411867] [INFO ] [MAIN ] NNI: Loaded 10353 primary data records. [2025-10-03T22:42:28.960095] [DEBUG] [LOCAL ] NNN: Loaded 49066 existing records from primary storage. [2025-10-03T22:42:28.960405] [INFO ] [MAIN ] NNN: Loaded 49066 primary data records. [2025-10-03T22:42:29.303332] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:29.304314] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 22014 primary records. [2025-10-03T22:42:29.304827] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-03T22:42:29.328073] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-10-03T22:42:29.336591] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-03T22:42:29.344988] [INFO ] [MAIN ] Derivative Progress: 1297/2073 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 18s. Rate: 146.5 symbols/min [2025-10-03T22:42:29.345242] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:29.345604] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:29.347417] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10353 primary records. [2025-10-03T22:42:29.348049] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-03T22:42:29.369780] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-10-03T22:42:29.370205] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-03T22:42:29.373610] [INFO ] [MAIN ] Derivative Progress: 1298/2073 symbols completed. NNI took 1.1s. Estimated remaining: 5m 17s. Rate: 146.6 symbols/min [2025-10-03T22:42:29.378101] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:29.377446] [DEBUG] [LOCAL ] NNY: Loaded 5784 existing records from primary storage. [2025-10-03T22:42:29.378745] [INFO ] [MAIN ] NNY: Loaded 5784 primary data records. [2025-10-03T22:42:29.531144] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:29.571206] [DEBUG] [LOCAL ] NOA: Loaded 16385 existing records from primary storage. [2025-10-03T22:42:29.570701] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 49066 primary records. [2025-10-03T22:42:29.594705] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-03T22:42:29.594786] [INFO ] [MAIN ] NOA: Loaded 16385 primary data records. [2025-10-03T22:42:29.836713] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-10-03T22:42:29.852115] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-03T22:42:29.855138] [INFO ] [MAIN ] Derivative Progress: 1299/2073 symbols completed. NNN took 1.5s. Estimated remaining: 5m 17s. Rate: 146.6 symbols/min [2025-10-03T22:42:29.873746] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:30.139740] [DEBUG] [LOCAL ] NOAH: Loaded 20616 existing records from primary storage. [2025-10-03T22:42:30.140232] [INFO ] [MAIN ] NOAH: Loaded 20616 primary data records. [2025-10-03T22:42:30.285462] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:30.302218] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5784 primary records. [2025-10-03T22:42:30.302455] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-03T22:42:30.491602] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-10-03T22:42:30.491797] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-03T22:42:30.494707] [INFO ] [MAIN ] Derivative Progress: 1300/2073 symbols completed. NNY took 1.1s. Estimated remaining: 5m 17s. Rate: 146.5 symbols/min [2025-10-03T22:42:30.496160] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:30.519241] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:30.520308] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16385 primary records. [2025-10-03T22:42:30.520630] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-03T22:42:30.551466] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-10-03T22:42:30.564634] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-03T22:42:30.567917] [INFO ] [MAIN ] Derivative Progress: 1301/2073 symbols completed. NOA took 1.2s. Estimated remaining: 5m 16s. Rate: 146.6 symbols/min [2025-10-03T22:42:30.568392] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:30.568168] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:42:30.569407] [INFO ] [MAIN ] NOAH: Generated 1819 derivative records from 20616 primary records. [2025-10-03T22:42:30.569986] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-03T22:42:30.597257] [DEBUG] [LOCAL ] NOC: Loaded 42554 existing records from primary storage. [2025-10-03T22:42:30.598180] [INFO ] [MAIN ] NOC: Loaded 42554 primary data records. [2025-10-03T22:42:30.668000] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1819 records). [2025-10-03T22:42:30.680251] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-03T22:42:30.694046] [INFO ] [MAIN ] Derivative Progress: 1302/2073 symbols completed. NOAH took 0.8s. Estimated remaining: 5m 15s. Rate: 146.7 symbols/min [2025-10-03T22:42:30.713346] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:30.949287] [DEBUG] [LOCAL ] NOG: Loaded 51954 existing records from primary storage. [2025-10-03T22:42:30.950245] [INFO ] [MAIN ] NOG: Loaded 51954 primary data records. [2025-10-03T22:42:31.283990] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-10-03T22:42:31.299848] [INFO ] [MAIN ] NOK: Loaded 54401 primary data records. [2025-10-03T22:42:31.442341] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:31.466937] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 42554 primary records. [2025-10-03T22:42:31.475854] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-03T22:42:31.646499] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-10-03T22:42:31.647408] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-03T22:42:31.650847] [INFO ] [MAIN ] Derivative Progress: 1303/2073 symbols completed. NOC took 1.2s. Estimated remaining: 5m 15s. Rate: 146.5 symbols/min [2025-10-03T22:42:31.669202] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:31.670265] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 51954 primary records. [2025-10-03T22:42:31.670443] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-03T22:42:31.690957] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-10-03T22:42:31.691108] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-03T22:42:31.694402] [INFO ] [MAIN ] Derivative Progress: 1304/2073 symbols completed. NOG took 1.1s. Estimated remaining: 5m 15s. Rate: 146.6 symbols/min [2025-10-03T22:42:31.707373] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:31.708088] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54401 primary records. [2025-10-03T22:42:31.708164] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-03T22:42:31.723542] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-10-03T22:42:31.723602] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-03T22:42:31.726205] [INFO ] [MAIN ] Derivative Progress: 1305/2073 symbols completed. NOK took 1.0s. Estimated remaining: 5m 14s. Rate: 146.7 symbols/min [2025-10-03T22:42:31.726788] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:31.726716] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:31.726637] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:31.811490] [DEBUG] [LOCAL ] NOTE: Loaded 42206 existing records from primary storage. [2025-10-03T22:42:31.812389] [INFO ] [MAIN ] NOTE: Loaded 42206 primary data records. [2025-10-03T22:42:31.904041] [DEBUG] [LOCAL ] NOMD: Loaded 42192 existing records from primary storage. [2025-10-03T22:42:31.925688] [INFO ] [MAIN ] NOMD: Loaded 42192 primary data records. [2025-10-03T22:42:31.957297] [DEBUG] [LOCAL ] NOV: Loaded 53958 existing records from primary storage. [2025-10-03T22:42:31.979986] [INFO ] [MAIN ] NOV: Loaded 53958 primary data records. [2025-10-03T22:42:32.834242] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:32.835594] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 42206 primary records. [2025-10-03T22:42:32.835879] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-03T22:42:32.860728] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-10-03T22:42:32.861158] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-03T22:42:32.870964] [INFO ] [MAIN ] Derivative Progress: 1306/2073 symbols completed. NOTE took 1.1s. Estimated remaining: 5m 14s. Rate: 146.5 symbols/min [2025-10-03T22:42:32.871224] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:32.890391] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:32.890156] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:32.891351] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 42192 primary records. [2025-10-03T22:42:32.891500] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-03T22:42:32.893202] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53958 primary records. [2025-10-03T22:42:32.893600] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-03T22:42:32.927186] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-10-03T22:42:32.927871] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-03T22:42:32.931848] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-10-03T22:42:32.940737] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-03T22:42:32.940622] [INFO ] [MAIN ] Derivative Progress: 1307/2073 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 13s. Rate: 146.6 symbols/min [2025-10-03T22:42:32.942098] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:32.945811] [INFO ] [MAIN ] Derivative Progress: 1308/2073 symbols completed. NOV took 1.2s. Estimated remaining: 5m 13s. Rate: 146.7 symbols/min [2025-10-03T22:42:32.942672] [DEBUG] [LOCAL ] NPCT: Loaded 17236 existing records from primary storage. [2025-10-03T22:42:32.946023] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:32.946908] [INFO ] [MAIN ] NPCT: Loaded 17236 primary data records. [2025-10-03T22:42:33.062401] [DEBUG] [LOCAL ] NPFD: Loaded 9999 existing records from primary storage. [2025-10-03T22:42:33.066096] [DEBUG] [LOCAL ] NPK: Loaded 8174 existing records from primary storage. [2025-10-03T22:42:33.066238] [INFO ] [MAIN ] NPFD: Loaded 9999 primary data records. [2025-10-03T22:42:33.066360] [INFO ] [MAIN ] NPK: Loaded 8174 primary data records. [2025-10-03T22:42:33.978816] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:33.979768] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 17236 primary records. [2025-10-03T22:42:33.979920] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-03T22:42:34.008153] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:34.010453] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8174 primary records. [2025-10-03T22:42:34.010878] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-03T22:42:34.036224] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:34.040363] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 9999 primary records. [2025-10-03T22:42:34.041123] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-03T22:42:34.043044] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-10-03T22:42:34.047012] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-10-03T22:42:34.047182] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-03T22:42:34.043594] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-03T22:42:34.050268] [INFO ] [MAIN ] Derivative Progress: 1309/2073 symbols completed. NPCT took 1.2s. Estimated remaining: 5m 13s. Rate: 146.5 symbols/min [2025-10-03T22:42:34.065769] [INFO ] [MAIN ] Derivative Progress: 1310/2073 symbols completed. NPK took 1.1s. Estimated remaining: 5m 12s. Rate: 146.6 symbols/min [2025-10-03T22:42:34.062879] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:34.069391] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:34.071327] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-10-03T22:42:34.071693] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-03T22:42:34.074994] [INFO ] [MAIN ] Derivative Progress: 1311/2073 symbols completed. NPFD took 1.1s. Estimated remaining: 5m 12s. Rate: 146.8 symbols/min [2025-10-03T22:42:34.075552] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:34.082994] [DEBUG] [LOCAL ] NPV: Loaded 5112 existing records from primary storage. [2025-10-03T22:42:34.083151] [INFO ] [MAIN ] NPV: Loaded 5112 primary data records. [2025-10-03T22:42:34.187040] [DEBUG] [LOCAL ] NPO: Loaded 13251 existing records from primary storage. [2025-10-03T22:42:34.205041] [INFO ] [MAIN ] NPO: Loaded 13251 primary data records. [2025-10-03T22:42:34.536837] [DEBUG] [LOCAL ] NPWR: Loaded 43483 existing records from primary storage. [2025-10-03T22:42:34.561436] [INFO ] [MAIN ] NPWR: Loaded 43483 primary data records. [2025-10-03T22:42:35.118374] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:35.119710] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5112 primary records. [2025-10-03T22:42:35.119964] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-03T22:42:35.153612] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-10-03T22:42:35.154966] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-03T22:42:35.154869] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:35.156207] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13251 primary records. [2025-10-03T22:42:35.161219] [INFO ] [MAIN ] Derivative Progress: 1312/2073 symbols completed. NPV took 1.1s. Estimated remaining: 5m 12s. Rate: 146.6 symbols/min [2025-10-03T22:42:35.161530] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:35.161680] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-03T22:42:35.184776] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:35.189922] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 43483 primary records. [2025-10-03T22:42:35.193305] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-03T22:42:35.219727] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-10-03T22:42:35.217356] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-10-03T22:42:35.219846] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-10-03T22:42:35.220025] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-03T22:42:35.223347] [INFO ] [MAIN ] Derivative Progress: 1313/2073 symbols completed. NPO took 1.2s. Estimated remaining: 5m 11s. Rate: 146.7 symbols/min [2025-10-03T22:42:35.223487] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-03T22:42:35.226390] [INFO ] [MAIN ] NQP: Loaded 9406 primary data records. [2025-10-03T22:42:35.226542] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:35.226770] [INFO ] [MAIN ] Derivative Progress: 1314/2073 symbols completed. NPWR took 1.2s. Estimated remaining: 5m 10s. Rate: 146.8 symbols/min [2025-10-03T22:42:35.232818] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:35.367086] [DEBUG] [LOCAL ] NREF: Loaded 7980 existing records from primary storage. [2025-10-03T22:42:35.367303] [INFO ] [MAIN ] NREF: Loaded 7980 primary data records. [2025-10-03T22:42:35.509050] [DEBUG] [LOCAL ] NRDY: Loaded 33172 existing records from primary storage. [2025-10-03T22:42:35.566529] [INFO ] [MAIN ] NRDY: Loaded 33172 primary data records. [2025-10-03T22:42:36.278310] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:36.279693] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9406 primary records. [2025-10-03T22:42:36.280769] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-03T22:42:36.311055] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:36.315197] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7980 primary records. [2025-10-03T22:42:36.316173] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-03T22:42:36.318353] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-10-03T22:42:36.325974] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-03T22:42:36.328478] [INFO ] [MAIN ] Derivative Progress: 1315/2073 symbols completed. NQP took 1.2s. Estimated remaining: 5m 10s. Rate: 146.6 symbols/min [2025-10-03T22:42:36.345691] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:36.347013] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:36.348638] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33172 primary records. [2025-10-03T22:42:36.348908] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-03T22:42:36.363854] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-10-03T22:42:36.364399] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-03T22:42:36.367697] [INFO ] [MAIN ] Derivative Progress: 1316/2073 symbols completed. NREF took 1.1s. Estimated remaining: 5m 10s. Rate: 146.7 symbols/min [2025-10-03T22:42:36.368317] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:36.372450] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-10-03T22:42:36.372522] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-03T22:42:36.375548] [INFO ] [MAIN ] Derivative Progress: 1317/2073 symbols completed. NRDY took 1.1s. Estimated remaining: 5m 9s. Rate: 146.8 symbols/min [2025-10-03T22:42:36.375973] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:36.391994] [DEBUG] [LOCAL ] NRP: Loaded 4144 existing records from primary storage. [2025-10-03T22:42:36.392306] [INFO ] [MAIN ] NRP: Loaded 4144 primary data records. [2025-10-03T22:42:36.476273] [DEBUG] [LOCAL ] NRK: Loaded 20250 existing records from primary storage. [2025-10-03T22:42:36.512221] [INFO ] [MAIN ] NRK: Loaded 20250 primary data records. [2025-10-03T22:42:36.619153] [DEBUG] [LOCAL ] NRGV: Loaded 44114 existing records from primary storage. [2025-10-03T22:42:36.631216] [INFO ] [MAIN ] NRGV: Loaded 44114 primary data records. [2025-10-03T22:42:37.390108] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:37.391158] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4144 primary records. [2025-10-03T22:42:37.391460] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-03T22:42:37.439939] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-10-03T22:42:37.440351] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:37.441001] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-03T22:42:37.441882] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 20250 primary records. [2025-10-03T22:42:37.444167] [INFO ] [MAIN ] Derivative Progress: 1318/2073 symbols completed. NRP took 1.1s. Estimated remaining: 5m 9s. Rate: 146.6 symbols/min [2025-10-03T22:42:37.440833] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:37.445273] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 44114 primary records. [2025-10-03T22:42:37.445345] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-03T22:42:37.446110] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-03T22:42:37.475425] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-10-03T22:42:37.475522] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-03T22:42:37.478872] [INFO ] [MAIN ] Derivative Progress: 1319/2073 symbols completed. NRGV took 1.1s. Estimated remaining: 5m 8s. Rate: 146.7 symbols/min [2025-10-03T22:42:37.481754] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-10-03T22:42:37.481829] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-03T22:42:37.484820] [INFO ] [MAIN ] Derivative Progress: 1320/2073 symbols completed. NRK took 1.1s. Estimated remaining: 5m 8s. Rate: 146.8 symbols/min [2025-10-03T22:42:37.485292] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:37.485398] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:37.485227] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:37.494167] [DEBUG] [LOCAL ] NRUC: Loaded 3117 existing records from primary storage. [2025-10-03T22:42:37.494421] [INFO ] [MAIN ] NRUC: Loaded 3117 primary data records. [2025-10-03T22:42:37.497551] [DEBUG] [LOCAL ] NRT: Loaded 5039 existing records from primary storage. [2025-10-03T22:42:37.515138] [INFO ] [MAIN ] NRT: Loaded 5039 primary data records. [2025-10-03T22:42:37.960511] [DEBUG] [LOCAL ] NSA: Loaded 45345 existing records from primary storage. [2025-10-03T22:42:38.075116] [INFO ] [MAIN ] NSA: Loaded 45345 primary data records. [2025-10-03T22:42:38.590088] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:38.591718] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3117 primary records. [2025-10-03T22:42:38.590572] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:38.592859] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-03T22:42:38.592716] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 5039 primary records. [2025-10-03T22:42:38.594065] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-03T22:42:38.625557] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-10-03T22:42:38.625715] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-03T22:42:38.629543] [INFO ] [MAIN ] Derivative Progress: 1321/2073 symbols completed. NRT took 1.1s. Estimated remaining: 5m 8s. Rate: 146.6 symbols/min [2025-10-03T22:42:38.629889] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:38.626151] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-10-03T22:42:38.630278] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-03T22:42:38.635786] [INFO ] [MAIN ] Derivative Progress: 1322/2073 symbols completed. NRUC took 1.2s. Estimated remaining: 5m 7s. Rate: 146.7 symbols/min [2025-10-03T22:42:38.636216] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:38.653569] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:38.654376] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45345 primary records. [2025-10-03T22:42:38.654535] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-03T22:42:38.677594] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-10-03T22:42:38.685400] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-03T22:42:38.688669] [INFO ] [MAIN ] Derivative Progress: 1323/2073 symbols completed. NSA took 1.2s. Estimated remaining: 5m 6s. Rate: 146.8 symbols/min [2025-10-03T22:42:38.688982] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:38.697537] [DEBUG] [LOCAL ] NTB: Loaded 20445 existing records from primary storage. [2025-10-03T22:42:38.697749] [INFO ] [MAIN ] NTB: Loaded 20445 primary data records. [2025-10-03T22:42:38.811109] [DEBUG] [LOCAL ] NSP: Loaded 35539 existing records from primary storage. [2025-10-03T22:42:38.815282] [INFO ] [MAIN ] NSP: Loaded 35539 primary data records. [2025-10-03T22:42:39.377089] [DEBUG] [LOCAL ] NTR: Loaded 53344 existing records from primary storage. [2025-10-03T22:42:39.377328] [INFO ] [MAIN ] NTR: Loaded 53344 primary data records. [2025-10-03T22:42:39.723003] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:39.723997] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 20445 primary records. [2025-10-03T22:42:39.725675] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-03T22:42:39.754086] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:39.755685] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 35539 primary records. [2025-10-03T22:42:39.755889] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-03T22:42:39.775901] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-10-03T22:42:39.776797] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-03T22:42:39.779755] [INFO ] [MAIN ] Derivative Progress: 1324/2073 symbols completed. NTB took 1.1s. Estimated remaining: 5m 6s. Rate: 146.6 symbols/min [2025-10-03T22:42:39.780856] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:39.780954] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-10-03T22:42:39.781056] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-03T22:42:39.784713] [INFO ] [MAIN ] Derivative Progress: 1325/2073 symbols completed. NSP took 1.2s. Estimated remaining: 5m 6s. Rate: 146.8 symbols/min [2025-10-03T22:42:39.785119] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:39.804954] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:39.805804] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53344 primary records. [2025-10-03T22:42:39.805939] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-03T22:42:39.834016] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-10-03T22:42:39.834170] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-03T22:42:39.837040] [INFO ] [MAIN ] Derivative Progress: 1326/2073 symbols completed. NTR took 1.1s. Estimated remaining: 5m 5s. Rate: 146.9 symbols/min [2025-10-03T22:42:39.837326] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:39.867633] [DEBUG] [LOCAL ] NTST: Loaded 44169 existing records from primary storage. [2025-10-03T22:42:39.867993] [INFO ] [MAIN ] NTST: Loaded 44169 primary data records. [2025-10-03T22:42:40.001050] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-10-03T22:42:40.007082] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-10-03T22:42:40.338841] [DEBUG] [LOCAL ] NUS: Loaded 36927 existing records from primary storage. [2025-10-03T22:42:40.350138] [INFO ] [MAIN ] NUS: Loaded 36927 primary data records. [2025-10-03T22:42:40.894634] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:40.896767] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44169 primary records. [2025-10-03T22:42:40.896972] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-03T22:42:40.934248] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:40.935107] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-10-03T22:42:40.935893] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-03T22:42:40.935795] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-10-03T22:42:40.936400] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-03T22:42:40.939063] [INFO ] [MAIN ] Derivative Progress: 1327/2073 symbols completed. NTST took 1.2s. Estimated remaining: 5m 5s. Rate: 146.7 symbols/min [2025-10-03T22:42:40.939410] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:40.981237] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:40.980927] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-10-03T22:42:40.981405] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-03T22:42:40.982169] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 36927 primary records. [2025-10-03T22:42:40.982290] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-03T22:42:40.985984] [INFO ] [MAIN ] Derivative Progress: 1328/2073 symbols completed. NU took 1.2s. Estimated remaining: 5m 5s. Rate: 146.8 symbols/min [2025-10-03T22:42:40.993218] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:41.006783] [DEBUG] [LOCAL ] NUV: Loaded 23989 existing records from primary storage. [2025-10-03T22:42:41.007631] [INFO ] [MAIN ] NUV: Loaded 23989 primary data records. [2025-10-03T22:42:41.109991] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-10-03T22:42:41.110184] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-03T22:42:41.117511] [INFO ] [MAIN ] Derivative Progress: 1329/2073 symbols completed. NUS took 1.3s. Estimated remaining: 5m 4s. Rate: 146.8 symbols/min [2025-10-03T22:42:41.118237] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:41.345725] [DEBUG] [LOCAL ] NUW: Loaded 7367 existing records from primary storage. [2025-10-03T22:42:41.345947] [INFO ] [MAIN ] NUW: Loaded 7367 primary data records. [2025-10-03T22:42:41.452308] [DEBUG] [LOCAL ] NUVB: Loaded 52012 existing records from primary storage. [2025-10-03T22:42:41.470191] [INFO ] [MAIN ] NUVB: Loaded 52012 primary data records. [2025-10-03T22:42:42.055560] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:42.056604] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 23989 primary records. [2025-10-03T22:42:42.056913] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-03T22:42:42.080151] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-10-03T22:42:42.080730] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-03T22:42:42.083068] [INFO ] [MAIN ] Derivative Progress: 1330/2073 symbols completed. NUV took 1.1s. Estimated remaining: 5m 4s. Rate: 146.7 symbols/min [2025-10-03T22:42:42.083244] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:42.101380] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:42.103962] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7367 primary records. [2025-10-03T22:42:42.104153] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-03T22:42:42.129915] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:42.135059] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-10-03T22:42:42.142816] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 52012 primary records. [2025-10-03T22:42:42.143072] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-03T22:42:42.146076] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-03T22:42:42.145964] [INFO ] [MAIN ] Derivative Progress: 1331/2073 symbols completed. NUW took 1.0s. Estimated remaining: 5m 3s. Rate: 146.8 symbols/min [2025-10-03T22:42:42.147044] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:42.169989] [DEBUG] [LOCAL ] NVG: Loaded 27892 existing records from primary storage. [2025-10-03T22:42:42.170262] [INFO ] [MAIN ] NVG: Loaded 27892 primary data records. [2025-10-03T22:42:42.276576] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-10-03T22:42:42.287711] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-03T22:42:42.314897] [INFO ] [MAIN ] Derivative Progress: 1332/2073 symbols completed. NUVB took 1.3s. Estimated remaining: 5m 3s. Rate: 146.8 symbols/min [2025-10-03T22:42:42.339681] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:42.340549] [DEBUG] [LOCAL ] NVGS: Loaded 30976 existing records from primary storage. [2025-10-03T22:42:42.379505] [INFO ] [MAIN ] NVGS: Loaded 30976 primary data records. [2025-10-03T22:42:42.707432] [DEBUG] [LOCAL ] NVR: Loaded 18866 existing records from primary storage. [2025-10-03T22:42:42.713129] [INFO ] [MAIN ] NVR: Loaded 18866 primary data records. [2025-10-03T22:42:43.020323] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:43.043732] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27892 primary records. [2025-10-03T22:42:43.043959] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-03T22:42:43.186813] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-10-03T22:42:43.195031] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-03T22:42:43.202777] [INFO ] [MAIN ] Derivative Progress: 1333/2073 symbols completed. NVG took 1.1s. Estimated remaining: 5m 3s. Rate: 146.7 symbols/min [2025-10-03T22:42:43.203527] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:43.204336] [INFO ] [MAIN ] NVGS: Generated 1820 derivative records from 30976 primary records. [2025-10-03T22:42:43.204603] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-03T22:42:43.224544] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1820 records). [2025-10-03T22:42:43.225500] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-03T22:42:43.229343] [INFO ] [MAIN ] Derivative Progress: 1334/2073 symbols completed. NVGS took 1.1s. Estimated remaining: 5m 2s. Rate: 146.8 symbols/min [2025-10-03T22:42:43.242310] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:43.242982] [INFO ] [MAIN ] NVR: Generated 1820 derivative records from 18866 primary records. [2025-10-03T22:42:43.243046] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-03T22:42:43.259932] [DEBUG] [LOCAL ] NVR: Derivative data saved (1820 records). [2025-10-03T22:42:43.260114] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-03T22:42:43.263253] [INFO ] [MAIN ] Derivative Progress: 1335/2073 symbols completed. NVR took 0.9s. Estimated remaining: 5m 1s. Rate: 146.9 symbols/min [2025-10-03T22:42:43.263784] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:43.263991] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:43.263921] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:43.334558] [DEBUG] [LOCAL ] NVRI: Loaded 39400 existing records from primary storage. [2025-10-03T22:42:43.334797] [INFO ] [MAIN ] NVRI: Loaded 39400 primary data records. [2025-10-03T22:42:43.473104] [DEBUG] [LOCAL ] NVST: Loaded 52348 existing records from primary storage. [2025-10-03T22:42:43.472324] [DEBUG] [LOCAL ] NVS: Loaded 52306 existing records from primary storage. [2025-10-03T22:42:43.478985] [INFO ] [MAIN ] NVS: Loaded 52306 primary data records. [2025-10-03T22:42:43.484174] [INFO ] [MAIN ] NVST: Loaded 52348 primary data records. [2025-10-03T22:42:44.409392] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:44.410914] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39400 primary records. [2025-10-03T22:42:44.411396] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-03T22:42:44.431783] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-10-03T22:42:44.432217] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-03T22:42:44.435081] [INFO ] [MAIN ] Derivative Progress: 1336/2073 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 1s. Rate: 146.7 symbols/min [2025-10-03T22:42:44.449911] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:44.450495] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:44.451728] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52306 primary records. [2025-10-03T22:42:44.451867] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-03T22:42:44.465866] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:44.474774] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52348 primary records. [2025-10-03T22:42:44.480188] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-03T22:42:44.503948] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-10-03T22:42:44.504720] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-03T22:42:44.508483] [INFO ] [MAIN ] Derivative Progress: 1337/2073 symbols completed. NVS took 1.2s. Estimated remaining: 5m 1s. Rate: 146.8 symbols/min [2025-10-03T22:42:44.509143] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:44.514937] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-10-03T22:42:44.515188] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-03T22:42:44.518492] [INFO ] [MAIN ] Derivative Progress: 1338/2073 symbols completed. NVST took 1.3s. Estimated remaining: 5m 0s. Rate: 146.9 symbols/min [2025-10-03T22:42:44.519096] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:44.560037] [DEBUG] [LOCAL ] NVT: Loaded 52261 existing records from primary storage. [2025-10-03T22:42:44.567235] [INFO ] [MAIN ] NVT: Loaded 52261 primary data records. [2025-10-03T22:42:44.659214] [DEBUG] [LOCAL ] NWN: Loaded 27050 existing records from primary storage. [2025-10-03T22:42:44.682091] [INFO ] [MAIN ] NWN: Loaded 27050 primary data records. [2025-10-03T22:42:45.066431] [DEBUG] [LOCAL ] NWG: Loaded 52239 existing records from primary storage. [2025-10-03T22:42:45.099920] [INFO ] [MAIN ] NWG: Loaded 52239 primary data records. [2025-10-03T22:42:45.616725] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:45.618735] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52261 primary records. [2025-10-03T22:42:45.619113] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-03T22:42:45.655288] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:45.657684] [INFO ] [MAIN ] NWN: Generated 1820 derivative records from 27050 primary records. [2025-10-03T22:42:45.658392] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-03T22:42:45.668854] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-10-03T22:42:45.670836] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-03T22:42:45.677608] [INFO ] [MAIN ] Derivative Progress: 1339/2073 symbols completed. NVT took 1.2s. Estimated remaining: 5m 0s. Rate: 146.7 symbols/min [2025-10-03T22:42:45.678133] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:45.696124] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:45.697798] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52239 primary records. [2025-10-03T22:42:45.698224] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-03T22:42:45.699942] [DEBUG] [LOCAL ] NWN: Derivative data saved (1820 records). [2025-10-03T22:42:45.700407] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-03T22:42:45.703856] [INFO ] [MAIN ] Derivative Progress: 1340/2073 symbols completed. NWN took 1.2s. Estimated remaining: 4m 60s. Rate: 146.8 symbols/min [2025-10-03T22:42:45.711744] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:45.726028] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-10-03T22:42:45.726370] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-03T22:42:45.729896] [INFO ] [MAIN ] Derivative Progress: 1341/2073 symbols completed. NWG took 1.2s. Estimated remaining: 4m 59s. Rate: 146.9 symbols/min [2025-10-03T22:42:45.730274] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:45.743774] [DEBUG] [LOCAL ] NXC: Loaded 4226 existing records from primary storage. [2025-10-03T22:42:45.743910] [INFO ] [MAIN ] NXC: Loaded 4226 primary data records. [2025-10-03T22:42:45.889930] [DEBUG] [LOCAL ] NXDT: Loaded 16344 existing records from primary storage. [2025-10-03T22:42:45.867851] [DEBUG] [LOCAL ] NX: Loaded 33616 existing records from primary storage. [2025-10-03T22:42:45.931606] [INFO ] [MAIN ] NXDT: Loaded 16344 primary data records. [2025-10-03T22:42:45.934236] [INFO ] [MAIN ] NX: Loaded 33616 primary data records. [2025-10-03T22:42:46.816265] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:46.818218] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4226 primary records. [2025-10-03T22:42:46.818499] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-03T22:42:46.845402] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-10-03T22:42:46.846152] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-03T22:42:46.875795] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:46.857801] [INFO ] [MAIN ] Derivative Progress: 1342/2073 symbols completed. NXC took 1.1s. Estimated remaining: 4m 59s. Rate: 146.7 symbols/min [2025-10-03T22:42:46.876634] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:46.878357] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33616 primary records. [2025-10-03T22:42:46.879377] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 16344 primary records. [2025-10-03T22:42:46.877253] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:46.879704] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-03T22:42:46.879594] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-03T22:42:46.913236] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-10-03T22:42:46.913677] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-03T22:42:46.916942] [INFO ] [MAIN ] Derivative Progress: 1343/2073 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 58s. Rate: 146.8 symbols/min [2025-10-03T22:42:46.917742] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:46.921504] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-10-03T22:42:46.921958] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-03T22:42:46.927190] [INFO ] [MAIN ] Derivative Progress: 1344/2073 symbols completed. NX took 1.2s. Estimated remaining: 4m 58s. Rate: 146.9 symbols/min [2025-10-03T22:42:46.927744] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:46.939853] [DEBUG] [LOCAL ] NXG: Loaded 10573 existing records from primary storage. [2025-10-03T22:42:46.940013] [INFO ] [MAIN ] NXG: Loaded 10573 primary data records. [2025-10-03T22:42:47.098269] [DEBUG] [LOCAL ] NXJ: Loaded 15143 existing records from primary storage. [2025-10-03T22:42:47.108944] [INFO ] [MAIN ] NXJ: Loaded 15143 primary data records. [2025-10-03T22:42:47.115294] [DEBUG] [LOCAL ] NXE: Loaded 53770 existing records from primary storage. [2025-10-03T22:42:47.174217] [INFO ] [MAIN ] NXE: Loaded 53770 primary data records. [2025-10-03T22:42:47.995881] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:47.997448] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10573 primary records. [2025-10-03T22:42:47.997921] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-03T22:42:48.041884] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:48.046616] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-10-03T22:42:48.047603] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15143 primary records. [2025-10-03T22:42:48.048284] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-03T22:42:48.048493] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-03T22:42:48.051186] [INFO ] [MAIN ] Derivative Progress: 1345/2073 symbols completed. NXG took 1.1s. Estimated remaining: 4m 58s. Rate: 146.7 symbols/min [2025-10-03T22:42:48.051382] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:48.084729] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:48.087466] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53770 primary records. [2025-10-03T22:42:48.089537] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-03T22:42:48.093334] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-10-03T22:42:48.101862] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-03T22:42:48.107921] [INFO ] [MAIN ] Derivative Progress: 1346/2073 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 57s. Rate: 146.8 symbols/min [2025-10-03T22:42:48.113487] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:48.114624] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-10-03T22:42:48.117943] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-10-03T22:42:48.118301] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-03T22:42:48.118421] [INFO ] [MAIN ] NXN: Loaded 2339 primary data records. [2025-10-03T22:42:48.121812] [INFO ] [MAIN ] Derivative Progress: 1347/2073 symbols completed. NXE took 1.2s. Estimated remaining: 4m 56s. Rate: 146.9 symbols/min [2025-10-03T22:42:48.141095] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:48.262170] [DEBUG] [LOCAL ] NXP: Loaded 12677 existing records from primary storage. [2025-10-03T22:42:48.275576] [INFO ] [MAIN ] NXP: Loaded 12677 primary data records. [2025-10-03T22:42:48.657055] [DEBUG] [LOCAL ] NXRT: Loaded 19242 existing records from primary storage. [2025-10-03T22:42:48.657796] [INFO ] [MAIN ] NXRT: Loaded 19242 primary data records. [2025-10-03T22:42:49.192783] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:49.194442] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2339 primary records. [2025-10-03T22:42:49.194551] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-03T22:42:49.227784] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-10-03T22:42:49.227942] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-03T22:42:49.230463] [INFO ] [MAIN ] Derivative Progress: 1348/2073 symbols completed. NXN took 1.2s. Estimated remaining: 4m 56s. Rate: 146.7 symbols/min [2025-10-03T22:42:49.234170] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:49.235286] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12677 primary records. [2025-10-03T22:42:49.235442] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-03T22:42:49.249874] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:49.250628] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19242 primary records. [2025-10-03T22:42:49.251072] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-03T22:42:49.281046] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-10-03T22:42:49.282408] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-03T22:42:49.286236] [INFO ] [MAIN ] Derivative Progress: 1349/2073 symbols completed. NXP took 1.2s. Estimated remaining: 4m 56s. Rate: 146.8 symbols/min [2025-10-03T22:42:49.283297] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-10-03T22:42:49.286363] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-03T22:42:49.289623] [INFO ] [MAIN ] Derivative Progress: 1350/2073 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 55s. Rate: 146.9 symbols/min [2025-10-03T22:42:49.290069] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:49.290166] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:49.290246] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:49.329401] [DEBUG] [LOCAL ] NZF: Loaded 29526 existing records from primary storage. [2025-10-03T22:42:49.343456] [INFO ] [MAIN ] NZF: Loaded 29526 primary data records. [2025-10-03T22:42:49.519817] [DEBUG] [LOCAL ] NYT: Loaded 50552 existing records from primary storage. [2025-10-03T22:42:49.540260] [INFO ] [MAIN ] NYT: Loaded 50552 primary data records. [2025-10-03T22:42:49.526559] [DEBUG] [LOCAL ] OBDC: Loaded 52438 existing records from primary storage. [2025-10-03T22:42:49.587759] [INFO ] [MAIN ] OBDC: Loaded 52438 primary data records. [2025-10-03T22:42:50.414508] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:50.415566] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29526 primary records. [2025-10-03T22:42:50.415965] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-03T22:42:50.454696] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:50.456803] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-10-03T22:42:50.457596] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52438 primary records. [2025-10-03T22:42:50.458527] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-03T22:42:50.461041] [INFO ] [MAIN ] Derivative Progress: 1351/2073 symbols completed. NZF took 1.2s. Estimated remaining: 4m 55s. Rate: 146.7 symbols/min [2025-10-03T22:42:50.461289] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-03T22:42:50.461460] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:50.489466] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:50.496543] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50552 primary records. [2025-10-03T22:42:50.496837] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-10-03T22:42:50.497146] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-03T22:42:50.497282] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-03T22:42:50.500613] [INFO ] [MAIN ] Derivative Progress: 1352/2073 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 55s. Rate: 146.8 symbols/min [2025-10-03T22:42:50.501924] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:50.528411] [DEBUG] [LOCAL ] OBK: Loaded 16319 existing records from primary storage. [2025-10-03T22:42:50.529632] [INFO ] [MAIN ] OBK: Loaded 16319 primary data records. [2025-10-03T22:42:50.542575] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-10-03T22:42:50.574815] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-03T22:42:50.591503] [INFO ] [MAIN ] Derivative Progress: 1353/2073 symbols completed. NYT took 1.3s. Estimated remaining: 4m 54s. Rate: 146.9 symbols/min [2025-10-03T22:42:50.612783] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:50.864013] [DEBUG] [LOCAL ] OCFT: Loaded 8222 existing records from primary storage. [2025-10-03T22:42:50.865168] [INFO ] [MAIN ] OCFT: Loaded 8222 primary data records. [2025-10-03T22:42:50.991904] [DEBUG] [LOCAL ] OC: Loaded 45253 existing records from primary storage. [2025-10-03T22:42:51.008172] [INFO ] [MAIN ] OC: Loaded 45253 primary data records. [2025-10-03T22:42:51.534778] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:51.536332] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16319 primary records. [2025-10-03T22:42:51.536690] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-03T22:42:51.556619] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-10-03T22:42:51.556959] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-03T22:42:51.559521] [INFO ] [MAIN ] Derivative Progress: 1354/2073 symbols completed. OBK took 1.1s. Estimated remaining: 4m 54s. Rate: 146.8 symbols/min [2025-10-03T22:42:51.560189] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:51.581923] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:51.584629] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 8222 primary records. [2025-10-03T22:42:51.584770] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-03T22:42:51.589474] [DEBUG] [LOCAL ] ODC: Loaded 8504 existing records from primary storage. [2025-10-03T22:42:51.609163] [INFO ] [MAIN ] ODC: Loaded 8504 primary data records. [2025-10-03T22:42:51.625341] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:51.651995] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45253 primary records. [2025-10-03T22:42:51.662624] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-10-03T22:42:51.662793] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-03T22:42:51.675137] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-03T22:42:51.686896] [INFO ] [MAIN ] Derivative Progress: 1355/2073 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 53s. Rate: 146.9 symbols/min [2025-10-03T22:42:51.699601] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:51.818120] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-10-03T22:42:51.924821] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-03T22:42:51.954904] [INFO ] [MAIN ] Derivative Progress: 1356/2073 symbols completed. OC took 1.5s. Estimated remaining: 4m 53s. Rate: 146.9 symbols/min [2025-10-03T22:42:51.955377] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:51.969252] [DEBUG] [LOCAL ] ODV: Loaded 27495 existing records from primary storage. [2025-10-03T22:42:51.970104] [INFO ] [MAIN ] ODV: Loaded 27495 primary data records. [2025-10-03T22:42:52.342761] [DEBUG] [LOCAL ] OEC: Loaded 37501 existing records from primary storage. [2025-10-03T22:42:52.343082] [INFO ] [MAIN ] OEC: Loaded 37501 primary data records. [2025-10-03T22:42:52.495176] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:52.515325] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8504 primary records. [2025-10-03T22:42:52.533522] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-03T22:42:52.711893] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:52.713952] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 27495 primary records. [2025-10-03T22:42:52.713129] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-10-03T22:42:52.714187] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-03T22:42:52.714309] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-03T22:42:52.717478] [INFO ] [MAIN ] Derivative Progress: 1357/2073 symbols completed. ODC took 1.2s. Estimated remaining: 4m 53s. Rate: 146.8 symbols/min [2025-10-03T22:42:52.725361] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:52.737119] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-10-03T22:42:52.737723] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-03T22:42:52.740993] [INFO ] [MAIN ] Derivative Progress: 1358/2073 symbols completed. ODV took 1.0s. Estimated remaining: 4m 52s. Rate: 146.9 symbols/min [2025-10-03T22:42:52.741209] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:52.765427] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:52.773180] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37501 primary records. [2025-10-03T22:42:52.773723] [DEBUG] [LOCAL ] OFG: Loaded 21781 existing records from primary storage. [2025-10-03T22:42:52.773366] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-03T22:42:52.774244] [INFO ] [MAIN ] OFG: Loaded 21781 primary data records. [2025-10-03T22:42:53.000749] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-10-03T22:42:53.107900] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-03T22:42:53.119570] [DEBUG] [LOCAL ] OGE: Loaded 47004 existing records from primary storage. [2025-10-03T22:42:53.123478] [INFO ] [MAIN ] Derivative Progress: 1359/2073 symbols completed. OEC took 1.2s. Estimated remaining: 4m 52s. Rate: 146.9 symbols/min [2025-10-03T22:42:53.123890] [INFO ] [MAIN ] OGE: Loaded 47004 primary data records. [2025-10-03T22:42:53.124023] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:53.507369] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:53.508363] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 21781 primary records. [2025-10-03T22:42:53.509842] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-03T22:42:53.509714] [DEBUG] [LOCAL ] OGN: Loaded 53867 existing records from primary storage. [2025-10-03T22:42:53.519630] [INFO ] [MAIN ] OGN: Loaded 53867 primary data records. [2025-10-03T22:42:53.642520] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-10-03T22:42:53.646451] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-03T22:42:53.649517] [INFO ] [MAIN ] Derivative Progress: 1360/2073 symbols completed. OFG took 0.9s. Estimated remaining: 4m 51s. Rate: 146.9 symbols/min [2025-10-03T22:42:53.649828] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:53.681629] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:53.715888] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 47004 primary records. [2025-10-03T22:42:53.744520] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-03T22:42:53.893549] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-10-03T22:42:53.893871] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-03T22:42:53.905282] [INFO ] [MAIN ] Derivative Progress: 1361/2073 symbols completed. OGE took 1.2s. Estimated remaining: 4m 51s. Rate: 146.9 symbols/min [2025-10-03T22:42:53.905857] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:53.922002] [DEBUG] [LOCAL ] OGS: Loaded 34630 existing records from primary storage. [2025-10-03T22:42:53.922571] [INFO ] [MAIN ] OGS: Loaded 34630 primary data records. [2025-10-03T22:42:54.295486] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:54.322854] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53867 primary records. [2025-10-03T22:42:54.323857] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-03T22:42:54.355961] [DEBUG] [LOCAL ] OHI: Loaded 52709 existing records from primary storage. [2025-10-03T22:42:54.359301] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-10-03T22:42:54.359520] [INFO ] [MAIN ] OHI: Loaded 52709 primary data records. [2025-10-03T22:42:54.359828] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-03T22:42:54.362665] [INFO ] [MAIN ] Derivative Progress: 1362/2073 symbols completed. OGN took 1.2s. Estimated remaining: 4m 50s. Rate: 146.9 symbols/min [2025-10-03T22:42:54.381983] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:54.767751] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:54.768604] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34630 primary records. [2025-10-03T22:42:54.768698] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-03T22:42:54.786351] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-10-03T22:42:54.786979] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-03T22:42:54.790334] [INFO ] [MAIN ] Derivative Progress: 1363/2073 symbols completed. OGS took 1.1s. Estimated remaining: 4m 50s. Rate: 146.9 symbols/min [2025-10-03T22:42:54.805837] [DEBUG] [LOCAL ] OI: Loaded 47791 existing records from primary storage. [2025-10-03T22:42:54.807203] [INFO ] [MAIN ] OI: Loaded 47791 primary data records. [2025-10-03T22:42:55.130763] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:55.145742] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52709 primary records. [2025-10-03T22:42:55.146850] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-03T22:42:55.167262] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-10-03T22:42:55.167356] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-03T22:42:55.171421] [INFO ] [MAIN ] Derivative Progress: 1364/2073 symbols completed. OHI took 1.3s. Estimated remaining: 4m 50s. Rate: 146.9 symbols/min [2025-10-03T22:42:55.190010] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:55.190702] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 47791 primary records. [2025-10-03T22:42:55.190773] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-03T22:42:55.207168] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-10-03T22:42:55.207248] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-03T22:42:55.209759] [INFO ] [MAIN ] Derivative Progress: 1365/2073 symbols completed. OI took 0.8s. Estimated remaining: 4m 49s. Rate: 147.0 symbols/min [2025-10-03T22:42:55.210245] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:55.210952] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:55.210811] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:55.227956] [DEBUG] [LOCAL ] OIA: Loaded 13898 existing records from primary storage. [2025-10-03T22:42:55.228183] [INFO ] [MAIN ] OIA: Loaded 13898 primary data records. [2025-10-03T22:42:55.584034] [DEBUG] [LOCAL ] OIS: Loaded 40930 existing records from primary storage. [2025-10-03T22:42:55.585293] [DEBUG] [LOCAL ] OII: Loaded 43127 existing records from primary storage. [2025-10-03T22:42:55.585749] [INFO ] [MAIN ] OII: Loaded 43127 primary data records. [2025-10-03T22:42:55.585821] [INFO ] [MAIN ] OIS: Loaded 40930 primary data records. [2025-10-03T22:42:56.415052] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:56.417682] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 13898 primary records. [2025-10-03T22:42:56.418171] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-03T22:42:56.450908] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-10-03T22:42:56.451306] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-03T22:42:56.454892] [INFO ] [MAIN ] Derivative Progress: 1366/2073 symbols completed. OIA took 1.2s. Estimated remaining: 4m 49s. Rate: 146.8 symbols/min [2025-10-03T22:42:56.455310] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:56.505790] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:56.507852] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 40930 primary records. [2025-10-03T22:42:56.508016] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-03T22:42:56.506680] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:56.510188] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 43127 primary records. [2025-10-03T22:42:56.510781] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-03T22:42:56.551745] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-10-03T22:42:56.575817] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-03T22:42:56.579950] [INFO ] [MAIN ] Derivative Progress: 1367/2073 symbols completed. OII took 1.4s. Estimated remaining: 4m 48s. Rate: 146.9 symbols/min [2025-10-03T22:42:56.581289] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:56.586772] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-10-03T22:42:56.587212] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-03T22:42:56.590972] [INFO ] [MAIN ] Derivative Progress: 1368/2073 symbols completed. OIS took 1.4s. Estimated remaining: 4m 48s. Rate: 147.0 symbols/min [2025-10-03T22:42:56.591289] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:56.611810] [DEBUG] [LOCAL ] OKE: Loaded 54317 existing records from primary storage. [2025-10-03T22:42:56.612187] [INFO ] [MAIN ] OKE: Loaded 54317 primary data records. [2025-10-03T22:42:56.690483] [DEBUG] [LOCAL ] OLP: Loaded 10054 existing records from primary storage. [2025-10-03T22:42:56.713873] [INFO ] [MAIN ] OLP: Loaded 10054 primary data records. [2025-10-03T22:42:57.148605] [DEBUG] [LOCAL ] OLN: Loaded 52549 existing records from primary storage. [2025-10-03T22:42:57.149208] [INFO ] [MAIN ] OLN: Loaded 52549 primary data records. [2025-10-03T22:42:57.682869] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:57.684769] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54317 primary records. [2025-10-03T22:42:57.686689] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-03T22:42:57.704367] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:57.716719] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 10054 primary records. [2025-10-03T22:42:57.717244] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-03T22:42:57.749599] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-10-03T22:42:57.750851] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:57.752326] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52549 primary records. [2025-10-03T22:42:57.752432] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-03T22:42:57.752517] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-03T22:42:57.756438] [INFO ] [MAIN ] Derivative Progress: 1369/2073 symbols completed. OKE took 1.3s. Estimated remaining: 4m 48s. Rate: 146.8 symbols/min [2025-10-03T22:42:57.765944] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:57.769790] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-10-03T22:42:57.769938] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-03T22:42:57.773130] [INFO ] [MAIN ] Derivative Progress: 1370/2073 symbols completed. OLP took 1.2s. Estimated remaining: 4m 47s. Rate: 146.9 symbols/min [2025-10-03T22:42:57.773816] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:57.779399] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-10-03T22:42:57.779536] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-03T22:42:57.782556] [INFO ] [MAIN ] Derivative Progress: 1371/2073 symbols completed. OLN took 1.2s. Estimated remaining: 4m 47s. Rate: 147.0 symbols/min [2025-10-03T22:42:57.782822] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:57.850223] [DEBUG] [LOCAL ] OMF: Loaded 46922 existing records from primary storage. [2025-10-03T22:42:57.850519] [INFO ] [MAIN ] OMF: Loaded 46922 primary data records. [2025-10-03T22:42:57.967866] [DEBUG] [LOCAL ] OMC: Loaded 54069 existing records from primary storage. [2025-10-03T22:42:57.981963] [DEBUG] [LOCAL ] OMI: Loaded 46558 existing records from primary storage. [2025-10-03T22:42:57.985727] [INFO ] [MAIN ] OMI: Loaded 46558 primary data records. [2025-10-03T22:42:57.986191] [INFO ] [MAIN ] OMC: Loaded 54069 primary data records. [2025-10-03T22:42:58.884202] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:58.885971] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 46922 primary records. [2025-10-03T22:42:58.886073] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-03T22:42:58.916063] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:58.917564] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46558 primary records. [2025-10-03T22:42:58.917713] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-03T22:42:58.945533] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:42:58.947375] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54069 primary records. [2025-10-03T22:42:58.948494] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-10-03T22:42:58.947907] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-03T22:42:58.948870] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-03T22:42:58.951538] [INFO ] [MAIN ] Derivative Progress: 1372/2073 symbols completed. OMF took 1.2s. Estimated remaining: 4m 47s. Rate: 146.8 symbols/min [2025-10-03T22:42:58.952944] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:58.966427] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-10-03T22:42:58.967196] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-03T22:42:58.970924] [INFO ] [MAIN ] Derivative Progress: 1373/2073 symbols completed. OMI took 1.2s. Estimated remaining: 4m 46s. Rate: 146.9 symbols/min [2025-10-03T22:42:58.971165] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:58.975974] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-10-03T22:42:58.976132] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-03T22:42:58.979100] [INFO ] [MAIN ] Derivative Progress: 1374/2073 symbols completed. OMC took 1.2s. Estimated remaining: 4m 45s. Rate: 147.0 symbols/min [2025-10-03T22:42:58.979356] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:42:59.010889] [DEBUG] [LOCAL ] ONL: Loaded 30810 existing records from primary storage. [2025-10-03T22:42:59.018111] [INFO ] [MAIN ] ONL: Loaded 30810 primary data records. [2025-10-03T22:42:59.018517] [DEBUG] [LOCAL ] ONTF: Loaded 22832 existing records from primary storage. [2025-10-03T22:42:59.018712] [INFO ] [MAIN ] ONTF: Loaded 22832 primary data records. [2025-10-03T22:42:59.319029] [DEBUG] [LOCAL ] ONON: Loaded 54393 existing records from primary storage. [2025-10-03T22:42:59.334545] [INFO ] [MAIN ] ONON: Loaded 54393 primary data records. [2025-10-03T22:43:00.018595] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:00.023938] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:00.024882] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 30810 primary records. [2025-10-03T22:43:00.025788] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 22832 primary records. [2025-10-03T22:43:00.026188] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-03T22:43:00.028073] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-03T22:43:00.059048] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-10-03T22:43:00.060293] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-03T22:43:00.063271] [INFO ] [MAIN ] Derivative Progress: 1375/2073 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 45s. Rate: 146.8 symbols/min [2025-10-03T22:43:00.064145] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:00.065340] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-10-03T22:43:00.065928] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-03T22:43:00.068298] [INFO ] [MAIN ] Derivative Progress: 1376/2073 symbols completed. ONL took 1.1s. Estimated remaining: 4m 45s. Rate: 146.9 symbols/min [2025-10-03T22:43:00.068809] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:00.085634] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:00.086398] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54393 primary records. [2025-10-03T22:43:00.086527] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-03T22:43:00.117683] [DEBUG] [LOCAL ] OOMA: Loaded 19059 existing records from primary storage. [2025-10-03T22:43:00.118542] [INFO ] [MAIN ] OOMA: Loaded 19059 primary data records. [2025-10-03T22:43:00.119218] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-10-03T22:43:00.140720] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-03T22:43:00.169875] [INFO ] [MAIN ] Derivative Progress: 1377/2073 symbols completed. ONON took 1.2s. Estimated remaining: 4m 44s. Rate: 147.0 symbols/min [2025-10-03T22:43:00.181578] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:00.286686] [DEBUG] [LOCAL ] ONTO: Loaded 47395 existing records from primary storage. [2025-10-03T22:43:00.311505] [INFO ] [MAIN ] ONTO: Loaded 47395 primary data records. [2025-10-03T22:43:00.534663] [DEBUG] [LOCAL ] OPAD: Loaded 22500 existing records from primary storage. [2025-10-03T22:43:00.550339] [INFO ] [MAIN ] OPAD: Loaded 22500 primary data records. [2025-10-03T22:43:01.173733] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:01.174951] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 19059 primary records. [2025-10-03T22:43:01.175638] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-03T22:43:01.195730] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-10-03T22:43:01.196387] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-03T22:43:01.198589] [INFO ] [MAIN ] Derivative Progress: 1378/2073 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 44s. Rate: 146.8 symbols/min [2025-10-03T22:43:01.222872] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:01.229736] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47395 primary records. [2025-10-03T22:43:01.229844] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-03T22:43:01.257396] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:43:01.259719] [INFO ] [MAIN ] OPAD: Generated 1819 derivative records from 22500 primary records. [2025-10-03T22:43:01.260527] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-03T22:43:01.282029] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-10-03T22:43:01.282513] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-03T22:43:01.285629] [INFO ] [MAIN ] Derivative Progress: 1379/2073 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 43s. Rate: 146.9 symbols/min [2025-10-03T22:43:01.290259] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1819 records). [2025-10-03T22:43:01.290458] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-03T22:43:01.294253] [INFO ] [MAIN ] Derivative Progress: 1380/2073 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 43s. Rate: 147.0 symbols/min [2025-10-03T22:43:01.294868] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:01.294946] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:01.294780] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:01.312230] [DEBUG] [LOCAL ] OPP: Loaded 11836 existing records from primary storage. [2025-10-03T22:43:01.312390] [INFO ] [MAIN ] OPP: Loaded 11836 primary data records. [2025-10-03T22:43:01.635740] [DEBUG] [LOCAL ] OR: Loaded 46875 existing records from primary storage. [2025-10-03T22:43:01.704367] [DEBUG] [LOCAL ] OPFI: Loaded 47102 existing records from primary storage. [2025-10-03T22:43:01.710129] [INFO ] [MAIN ] OPFI: Loaded 47102 primary data records. [2025-10-03T22:43:01.719136] [INFO ] [MAIN ] OR: Loaded 46875 primary data records. [2025-10-03T22:43:02.430831] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:02.432423] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 11836 primary records. [2025-10-03T22:43:02.434306] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-03T22:43:02.459406] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-10-03T22:43:02.459946] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-03T22:43:02.462451] [INFO ] [MAIN ] Derivative Progress: 1381/2073 symbols completed. OPP took 1.2s. Estimated remaining: 4m 43s. Rate: 146.8 symbols/min [2025-10-03T22:43:02.462865] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:02.480448] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:02.483038] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 47102 primary records. [2025-10-03T22:43:02.483395] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-03T22:43:02.498867] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:02.500897] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 46875 primary records. [2025-10-03T22:43:02.513296] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-03T22:43:02.555923] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-10-03T22:43:02.557099] [DEBUG] [LOCAL ] ORA: Loaded 33070 existing records from primary storage. [2025-10-03T22:43:02.558450] [INFO ] [MAIN ] ORA: Loaded 33070 primary data records. [2025-10-03T22:43:02.558599] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-03T22:43:02.573470] [INFO ] [MAIN ] Derivative Progress: 1382/2073 symbols completed. OPFI took 1.3s. Estimated remaining: 4m 42s. Rate: 146.9 symbols/min [2025-10-03T22:43:02.584483] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:02.558117] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-10-03T22:43:02.599535] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-03T22:43:02.614827] [INFO ] [MAIN ] Derivative Progress: 1383/2073 symbols completed. OR took 1.3s. Estimated remaining: 4m 42s. Rate: 147.0 symbols/min [2025-10-03T22:43:02.621713] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:03.028123] [DEBUG] [LOCAL ] ORN: Loaded 31360 existing records from primary storage. [2025-10-03T22:43:03.028468] [INFO ] [MAIN ] ORN: Loaded 31360 primary data records. [2025-10-03T22:43:03.154600] [DEBUG] [LOCAL ] ORC: Loaded 53146 existing records from primary storage. [2025-10-03T22:43:03.158110] [INFO ] [MAIN ] ORC: Loaded 53146 primary data records. [2025-10-03T22:43:03.566442] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:03.691353] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33070 primary records. [2025-10-03T22:43:03.692851] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-03T22:43:03.720107] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-10-03T22:43:03.720684] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-03T22:43:03.723045] [INFO ] [MAIN ] Derivative Progress: 1384/2073 symbols completed. ORA took 1.3s. Estimated remaining: 4m 42s. Rate: 146.8 symbols/min [2025-10-03T22:43:03.724072] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:03.740487] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:03.742191] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31360 primary records. [2025-10-03T22:43:03.742514] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-03T22:43:03.777765] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:03.780000] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53146 primary records. [2025-10-03T22:43:03.780748] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-03T22:43:03.780567] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-10-03T22:43:03.781344] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-03T22:43:03.786140] [INFO ] [MAIN ] Derivative Progress: 1385/2073 symbols completed. ORN took 1.2s. Estimated remaining: 4m 41s. Rate: 146.9 symbols/min [2025-10-03T22:43:03.786438] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:03.803464] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-10-03T22:43:03.803727] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-03T22:43:03.806630] [INFO ] [MAIN ] Derivative Progress: 1386/2073 symbols completed. ORC took 1.2s. Estimated remaining: 4m 40s. Rate: 147.0 symbols/min [2025-10-03T22:43:03.806987] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:03.852975] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-10-03T22:43:03.853411] [INFO ] [MAIN ] OSCR: Loaded 54502 primary data records. [2025-10-03T22:43:04.219853] [DEBUG] [LOCAL ] OUT: Loaded 48517 existing records from primary storage. [2025-10-03T22:43:04.230463] [DEBUG] [LOCAL ] OTIS: Loaded 53475 existing records from primary storage. [2025-10-03T22:43:04.230759] [INFO ] [MAIN ] OTIS: Loaded 53475 primary data records. [2025-10-03T22:43:04.230875] [INFO ] [MAIN ] OUT: Loaded 48517 primary data records. [2025-10-03T22:43:04.907569] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:04.909082] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54502 primary records. [2025-10-03T22:43:04.910160] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-03T22:43:04.934052] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-10-03T22:43:04.934416] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-03T22:43:04.937580] [INFO ] [MAIN ] Derivative Progress: 1387/2073 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 40s. Rate: 146.8 symbols/min [2025-10-03T22:43:04.938147] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:04.969666] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:04.975682] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48517 primary records. [2025-10-03T22:43:04.976228] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-03T22:43:04.976027] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:04.978153] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53475 primary records. [2025-10-03T22:43:04.985938] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-03T22:43:04.996587] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-10-03T22:43:04.996866] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-03T22:43:05.006439] [INFO ] [MAIN ] Derivative Progress: 1388/2073 symbols completed. OUT took 1.2s. Estimated remaining: 4m 40s. Rate: 146.9 symbols/min [2025-10-03T22:43:05.007792] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:05.030283] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-10-03T22:43:05.030460] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-03T22:43:05.035231] [INFO ] [MAIN ] Derivative Progress: 1389/2073 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 39s. Rate: 147.0 symbols/min [2025-10-03T22:43:05.035615] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:05.061078] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-10-03T22:43:05.061411] [INFO ] [MAIN ] OVV: Loaded 54295 primary data records. [2025-10-03T22:43:05.155944] [DEBUG] [LOCAL ] OWLT: Loaded 8992 existing records from primary storage. [2025-10-03T22:43:05.179038] [INFO ] [MAIN ] OWLT: Loaded 8992 primary data records. [2025-10-03T22:43:05.375893] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-10-03T22:43:05.379697] [INFO ] [MAIN ] OWL: Loaded 54335 primary data records. [2025-10-03T22:43:06.149839] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:06.150335] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:06.153168] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 8992 primary records. [2025-10-03T22:43:06.153574] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-03T22:43:06.151881] [INFO ] [MAIN ] OVV: Generated 1820 derivative records from 54295 primary records. [2025-10-03T22:43:06.154348] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-03T22:43:06.205473] [DEBUG] [LOCAL ] OVV: Derivative data saved (1820 records). [2025-10-03T22:43:06.205362] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:06.206121] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-03T22:43:06.209172] [INFO ] [MAIN ] Derivative Progress: 1390/2073 symbols completed. OVV took 1.3s. Estimated remaining: 4m 39s. Rate: 146.8 symbols/min [2025-10-03T22:43:06.210810] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54335 primary records. [2025-10-03T22:43:06.211351] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:06.210942] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-03T22:43:06.213130] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-10-03T22:43:06.214277] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-03T22:43:06.218669] [INFO ] [MAIN ] Derivative Progress: 1391/2073 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 39s. Rate: 146.9 symbols/min [2025-10-03T22:43:06.230628] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:06.235905] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-10-03T22:43:06.236764] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-03T22:43:06.239738] [INFO ] [MAIN ] Derivative Progress: 1392/2073 symbols completed. OWL took 1.2s. Estimated remaining: 4m 38s. Rate: 147.0 symbols/min [2025-10-03T22:43:06.240332] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:06.266138] [DEBUG] [LOCAL ] PAC: Loaded 11760 existing records from primary storage. [2025-10-03T22:43:06.266314] [INFO ] [MAIN ] PAC: Loaded 11760 primary data records. [2025-10-03T22:43:06.357345] [DEBUG] [LOCAL ] OXM: Loaded 33720 existing records from primary storage. [2025-10-03T22:43:06.368594] [INFO ] [MAIN ] OXM: Loaded 33720 primary data records. [2025-10-03T22:43:06.810819] [DEBUG] [LOCAL ] PAAS: Loaded 54384 existing records from primary storage. [2025-10-03T22:43:06.818949] [INFO ] [MAIN ] PAAS: Loaded 54384 primary data records. [2025-10-03T22:43:07.362744] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:07.364175] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11760 primary records. [2025-10-03T22:43:07.364352] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-03T22:43:07.392375] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:07.395280] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 33720 primary records. [2025-10-03T22:43:07.398449] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-10-03T22:43:07.398740] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-03T22:43:07.399038] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-03T22:43:07.402723] [INFO ] [MAIN ] Derivative Progress: 1393/2073 symbols completed. PAC took 1.2s. Estimated remaining: 4m 38s. Rate: 146.8 symbols/min [2025-10-03T22:43:07.419725] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-10-03T22:43:07.420671] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-03T22:43:07.424509] [INFO ] [MAIN ] Derivative Progress: 1394/2073 symbols completed. OXM took 1.2s. Estimated remaining: 4m 37s. Rate: 146.9 symbols/min [2025-10-03T22:43:07.438468] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:07.439099] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54384 primary records. [2025-10-03T22:43:07.439353] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-03T22:43:07.456308] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-10-03T22:43:07.456375] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-03T22:43:07.460056] [INFO ] [MAIN ] Derivative Progress: 1395/2073 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 37s. Rate: 147.0 symbols/min [2025-10-03T22:43:07.460717] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:07.460621] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:07.460524] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:07.516629] [DEBUG] [LOCAL ] PACK: Loaded 32354 existing records from primary storage. [2025-10-03T22:43:07.518412] [INFO ] [MAIN ] PACK: Loaded 32354 primary data records. [2025-10-03T22:43:07.530987] [DEBUG] [LOCAL ] PAG: Loaded 21976 existing records from primary storage. [2025-10-03T22:43:07.565210] [INFO ] [MAIN ] PAG: Loaded 21976 primary data records. [2025-10-03T22:43:07.693723] [DEBUG] [LOCAL ] PACS: Loaded 34910 existing records from primary storage. [2025-10-03T22:43:07.723112] [INFO ] [MAIN ] PACS: Loaded 34910 primary data records. [2025-10-03T22:43:08.569367] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:43:08.581506] [INFO ] [MAIN ] PACK: Generated 1819 derivative records from 32354 primary records. [2025-10-03T22:43:08.587133] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-03T22:43:08.587782] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:08.603079] [INFO ] [MAIN ] PAG: Generated 1820 derivative records from 21976 primary records. [2025-10-03T22:43:08.603376] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:08.610583] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-03T22:43:08.612046] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 34910 primary records. [2025-10-03T22:43:08.614188] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-03T22:43:08.650079] [DEBUG] [LOCAL ] PACK: Derivative data saved (1819 records). [2025-10-03T22:43:08.655910] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-03T22:43:08.655823] [DEBUG] [LOCAL ] PAG: Derivative data saved (1820 records). [2025-10-03T22:43:08.658775] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-03T22:43:08.658638] [INFO ] [MAIN ] Derivative Progress: 1396/2073 symbols completed. PACK took 1.2s. Estimated remaining: 4m 37s. Rate: 146.8 symbols/min [2025-10-03T22:43:08.663337] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:08.663467] [INFO ] [MAIN ] Derivative Progress: 1397/2073 symbols completed. PAG took 1.2s. Estimated remaining: 4m 36s. Rate: 146.9 symbols/min [2025-10-03T22:43:08.665928] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-10-03T22:43:08.666040] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:08.666191] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-03T22:43:08.669481] [INFO ] [MAIN ] Derivative Progress: 1398/2073 symbols completed. PACS took 1.2s. Estimated remaining: 4m 36s. Rate: 147.0 symbols/min [2025-10-03T22:43:08.669992] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:08.675550] [DEBUG] [LOCAL ] PAI: Loaded 2707 existing records from primary storage. [2025-10-03T22:43:08.676088] [INFO ] [MAIN ] PAI: Loaded 2707 primary data records. [2025-10-03T22:43:08.980971] [DEBUG] [LOCAL ] PAM: Loaded 28652 existing records from primary storage. [2025-10-03T22:43:09.034827] [INFO ] [MAIN ] PAM: Loaded 28652 primary data records. [2025-10-03T22:43:09.130560] [DEBUG] [LOCAL ] PAGS: Loaded 53489 existing records from primary storage. [2025-10-03T22:43:09.144736] [INFO ] [MAIN ] PAGS: Loaded 53489 primary data records. [2025-10-03T22:43:09.805153] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:09.807182] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2707 primary records. [2025-10-03T22:43:09.807488] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-03T22:43:09.830386] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-10-03T22:43:09.830844] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-03T22:43:09.834812] [INFO ] [MAIN ] Derivative Progress: 1399/2073 symbols completed. PAI took 1.2s. Estimated remaining: 4m 35s. Rate: 146.8 symbols/min [2025-10-03T22:43:09.835266] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:09.855589] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:09.856402] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 28652 primary records. [2025-10-03T22:43:09.856545] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-03T22:43:09.874904] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-10-03T22:43:09.875143] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-03T22:43:09.885953] [INFO ] [MAIN ] Derivative Progress: 1400/2073 symbols completed. PAM took 1.2s. Estimated remaining: 4m 35s. Rate: 146.9 symbols/min [2025-10-03T22:43:09.886173] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:09.892473] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:09.893189] [INFO ] [MAIN ] PAGS: Generated 1820 derivative records from 53489 primary records. [2025-10-03T22:43:09.893254] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-03T22:43:09.919918] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1820 records). [2025-10-03T22:43:09.920065] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-03T22:43:09.922726] [INFO ] [MAIN ] Derivative Progress: 1401/2073 symbols completed. PAGS took 1.3s. Estimated remaining: 4m 34s. Rate: 147.0 symbols/min [2025-10-03T22:43:09.923578] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:09.937338] [DEBUG] [LOCAL ] PAR: Loaded 33393 existing records from primary storage. [2025-10-03T22:43:09.937598] [INFO ] [MAIN ] PAR: Loaded 33393 primary data records. [2025-10-03T22:43:10.286896] [DEBUG] [LOCAL ] PARR: Loaded 49031 existing records from primary storage. [2025-10-03T22:43:10.287234] [INFO ] [MAIN ] PARR: Loaded 49031 primary data records. [2025-10-03T22:43:10.414075] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-10-03T22:43:10.418945] [INFO ] [MAIN ] PATH: Loaded 54457 primary data records. [2025-10-03T22:43:10.974561] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:10.976065] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 33393 primary records. [2025-10-03T22:43:10.976622] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-03T22:43:10.995753] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-10-03T22:43:10.996216] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-03T22:43:10.999273] [INFO ] [MAIN ] Derivative Progress: 1402/2073 symbols completed. PAR took 1.2s. Estimated remaining: 4m 34s. Rate: 146.8 symbols/min [2025-10-03T22:43:10.999866] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:11.018017] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:11.018791] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 49031 primary records. [2025-10-03T22:43:11.019094] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-03T22:43:11.055487] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:11.056803] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54457 primary records. [2025-10-03T22:43:11.057177] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-03T22:43:11.058190] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-10-03T22:43:11.065763] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-03T22:43:11.066147] [DEBUG] [LOCAL ] PAXS: Loaded 21046 existing records from primary storage. [2025-10-03T22:43:11.068174] [INFO ] [MAIN ] Derivative Progress: 1403/2073 symbols completed. PARR took 1.2s. Estimated remaining: 4m 34s. Rate: 146.9 symbols/min [2025-10-03T22:43:11.068355] [INFO ] [MAIN ] PAXS: Loaded 21046 primary data records. [2025-10-03T22:43:11.079999] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:11.277604] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-10-03T22:43:11.297927] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-03T22:43:11.300882] [INFO ] [MAIN ] Derivative Progress: 1404/2073 symbols completed. PATH took 1.4s. Estimated remaining: 4m 33s. Rate: 147.0 symbols/min [2025-10-03T22:43:11.301164] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:11.435113] [DEBUG] [LOCAL ] PAY: Loaded 38592 existing records from primary storage. [2025-10-03T22:43:11.435462] [INFO ] [MAIN ] PAY: Loaded 38592 primary data records. [2025-10-03T22:43:11.812479] [DEBUG] [LOCAL ] PAYC: Loaded 36933 existing records from primary storage. [2025-10-03T22:43:11.821991] [INFO ] [MAIN ] PAYC: Loaded 36933 primary data records. [2025-10-03T22:43:11.946998] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:11.988337] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21046 primary records. [2025-10-03T22:43:12.033711] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-03T22:43:12.161083] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-10-03T22:43:12.162575] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-03T22:43:12.165751] [INFO ] [MAIN ] Derivative Progress: 1405/2073 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 33s. Rate: 146.8 symbols/min [2025-10-03T22:43:12.167413] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:12.183829] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:12.185971] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 38592 primary records. [2025-10-03T22:43:12.186171] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-03T22:43:12.205949] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-10-03T22:43:12.207542] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-03T22:43:12.210279] [INFO ] [MAIN ] Derivative Progress: 1406/2073 symbols completed. PAY took 1.1s. Estimated remaining: 4m 32s. Rate: 146.9 symbols/min [2025-10-03T22:43:12.210780] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:12.225142] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:12.225923] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36933 primary records. [2025-10-03T22:43:12.226046] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-03T22:43:12.253211] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-10-03T22:43:12.253430] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-03T22:43:12.256468] [INFO ] [MAIN ] Derivative Progress: 1407/2073 symbols completed. PAYC took 1.0s. Estimated remaining: 4m 32s. Rate: 147.0 symbols/min [2025-10-03T22:43:12.269437] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:12.271967] [DEBUG] [LOCAL ] PB: Loaded 42171 existing records from primary storage. [2025-10-03T22:43:12.272340] [INFO ] [MAIN ] PB: Loaded 42171 primary data records. [2025-10-03T22:43:12.591192] [DEBUG] [LOCAL ] PBA: Loaded 49592 existing records from primary storage. [2025-10-03T22:43:12.605163] [INFO ] [MAIN ] PBA: Loaded 49592 primary data records. [2025-10-03T22:43:12.793492] [DEBUG] [LOCAL ] PBF: Loaded 53892 existing records from primary storage. [2025-10-03T22:43:12.821377] [INFO ] [MAIN ] PBF: Loaded 53892 primary data records. [2025-10-03T22:43:13.270105] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:13.281219] [INFO ] [MAIN ] PB: Generated 1820 derivative records from 42171 primary records. [2025-10-03T22:43:13.281677] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-03T22:43:13.305382] [DEBUG] [LOCAL ] PB: Derivative data saved (1820 records). [2025-10-03T22:43:13.305811] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-03T22:43:13.317576] [INFO ] [MAIN ] Derivative Progress: 1408/2073 symbols completed. PB took 1.2s. Estimated remaining: 4m 32s. Rate: 146.9 symbols/min [2025-10-03T22:43:13.323908] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:13.324883] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49592 primary records. [2025-10-03T22:43:13.325031] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-03T22:43:13.347705] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-10-03T22:43:13.348199] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-03T22:43:13.350827] [INFO ] [MAIN ] Derivative Progress: 1409/2073 symbols completed. PBA took 1.1s. Estimated remaining: 4m 31s. Rate: 147.0 symbols/min [2025-10-03T22:43:13.363825] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:13.364524] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53892 primary records. [2025-10-03T22:43:13.364587] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-03T22:43:13.381157] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-10-03T22:43:13.381271] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-03T22:43:13.385585] [INFO ] [MAIN ] Derivative Progress: 1410/2073 symbols completed. PBF took 1.1s. Estimated remaining: 4m 31s. Rate: 147.0 symbols/min [2025-10-03T22:43:13.386075] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:13.386232] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:13.386705] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:13.445820] [DEBUG] [LOCAL ] PBH: Loaded 32356 existing records from primary storage. [2025-10-03T22:43:13.446049] [INFO ] [MAIN ] PBH: Loaded 32356 primary data records. [2025-10-03T22:43:13.620618] [DEBUG] [LOCAL ] PBR: Loaded 54491 existing records from primary storage. [2025-10-03T22:43:13.619449] [DEBUG] [LOCAL ] PBI: Loaded 50683 existing records from primary storage. [2025-10-03T22:43:13.626167] [INFO ] [MAIN ] PBR: Loaded 54491 primary data records. [2025-10-03T22:43:13.646286] [INFO ] [MAIN ] PBI: Loaded 50683 primary data records. [2025-10-03T22:43:14.460582] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:14.461442] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 32356 primary records. [2025-10-03T22:43:14.461749] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-03T22:43:14.508029] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:14.508480] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-10-03T22:43:14.509170] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54491 primary records. [2025-10-03T22:43:14.509389] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-03T22:43:14.509305] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-03T22:43:14.507504] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:14.512227] [INFO ] [MAIN ] Derivative Progress: 1411/2073 symbols completed. PBH took 1.1s. Estimated remaining: 4m 30s. Rate: 146.9 symbols/min [2025-10-03T22:43:14.513121] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:14.513005] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50683 primary records. [2025-10-03T22:43:14.514206] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-03T22:43:14.542556] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-10-03T22:43:14.543718] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-03T22:43:14.546702] [INFO ] [MAIN ] Derivative Progress: 1412/2073 symbols completed. PBI took 1.2s. Estimated remaining: 4m 30s. Rate: 147.0 symbols/min [2025-10-03T22:43:14.547367] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:14.554317] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-10-03T22:43:14.554391] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-03T22:43:14.557260] [INFO ] [MAIN ] Derivative Progress: 1413/2073 symbols completed. PBR took 1.2s. Estimated remaining: 4m 29s. Rate: 147.1 symbols/min [2025-10-03T22:43:14.557583] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:14.567085] [DEBUG] [LOCAL ] PBT: Loaded 17494 existing records from primary storage. [2025-10-03T22:43:14.569225] [INFO ] [MAIN ] PBT: Loaded 17494 primary data records. [2025-10-03T22:43:14.644687] [DEBUG] [LOCAL ] PCF: Loaded 9033 existing records from primary storage. [2025-10-03T22:43:14.682695] [INFO ] [MAIN ] PCF: Loaded 9033 primary data records. [2025-10-03T22:43:14.682590] [DEBUG] [LOCAL ] PCM: Loaded 6801 existing records from primary storage. [2025-10-03T22:43:14.703706] [INFO ] [MAIN ] PCM: Loaded 6801 primary data records. [2025-10-03T22:43:15.572890] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:15.574503] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17494 primary records. [2025-10-03T22:43:15.576851] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-03T22:43:15.621730] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-10-03T22:43:15.622120] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:15.622978] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6801 primary records. [2025-10-03T22:43:15.622220] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-03T22:43:15.625327] [INFO ] [MAIN ] Derivative Progress: 1414/2073 symbols completed. PBT took 1.1s. Estimated remaining: 4m 29s. Rate: 146.9 symbols/min [2025-10-03T22:43:15.625870] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:15.625458] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-03T22:43:15.626067] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:15.627966] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 9033 primary records. [2025-10-03T22:43:15.634804] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-03T22:43:15.658775] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-10-03T22:43:15.659355] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-03T22:43:15.662677] [INFO ] [MAIN ] Derivative Progress: 1415/2073 symbols completed. PCF took 1.1s. Estimated remaining: 4m 29s. Rate: 147.0 symbols/min [2025-10-03T22:43:15.662765] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-10-03T22:43:15.663129] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:15.663019] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-03T22:43:15.666055] [INFO ] [MAIN ] Derivative Progress: 1416/2073 symbols completed. PCM took 1.1s. Estimated remaining: 4m 28s. Rate: 147.1 symbols/min [2025-10-03T22:43:15.666611] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:15.691600] [DEBUG] [LOCAL ] PCN: Loaded 24844 existing records from primary storage. [2025-10-03T22:43:15.691946] [INFO ] [MAIN ] PCN: Loaded 24844 primary data records. [2025-10-03T22:43:15.729208] [DEBUG] [LOCAL ] PCQ: Loaded 12462 existing records from primary storage. [2025-10-03T22:43:15.749868] [INFO ] [MAIN ] PCQ: Loaded 12462 primary data records. [2025-10-03T22:43:16.021614] [DEBUG] [LOCAL ] PCOR: Loaded 48706 existing records from primary storage. [2025-10-03T22:43:16.022128] [INFO ] [MAIN ] PCOR: Loaded 48706 primary data records. [2025-10-03T22:43:16.704335] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:16.706175] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 24844 primary records. [2025-10-03T22:43:16.706480] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-03T22:43:16.704962] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:16.707339] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12462 primary records. [2025-10-03T22:43:16.708352] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-03T22:43:16.742031] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-10-03T22:43:16.744077] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-03T22:43:16.746721] [INFO ] [MAIN ] Derivative Progress: 1417/2073 symbols completed. PCN took 1.1s. Estimated remaining: 4m 28s. Rate: 146.9 symbols/min [2025-10-03T22:43:16.744225] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-10-03T22:43:16.747949] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:16.748046] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-03T22:43:16.752039] [INFO ] [MAIN ] Derivative Progress: 1418/2073 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 27s. Rate: 147.0 symbols/min [2025-10-03T22:43:16.765860] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:16.765495] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:16.766824] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48706 primary records. [2025-10-03T22:43:16.767070] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-03T22:43:16.785533] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-10-03T22:43:16.785822] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-03T22:43:16.793158] [INFO ] [MAIN ] Derivative Progress: 1419/2073 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 27s. Rate: 147.1 symbols/min [2025-10-03T22:43:16.793734] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:16.870795] [DEBUG] [LOCAL ] PDI: Loaded 50810 existing records from primary storage. [2025-10-03T22:43:16.871037] [INFO ] [MAIN ] PDI: Loaded 50810 primary data records. [2025-10-03T22:43:16.973688] [DEBUG] [LOCAL ] PD: Loaded 48630 existing records from primary storage. [2025-10-03T22:43:16.985196] [INFO ] [MAIN ] PD: Loaded 48630 primary data records. [2025-10-03T22:43:17.039996] [DEBUG] [LOCAL ] PDM: Loaded 40131 existing records from primary storage. [2025-10-03T22:43:17.073233] [INFO ] [MAIN ] PDM: Loaded 40131 primary data records. [2025-10-03T22:43:17.944791] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:17.946523] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 50810 primary records. [2025-10-03T22:43:17.954713] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-03T22:43:17.961595] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:17.983033] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48630 primary records. [2025-10-03T22:43:17.983620] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-03T22:43:18.021007] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-10-03T22:43:18.023713] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-03T22:43:18.027133] [INFO ] [MAIN ] Derivative Progress: 1420/2073 symbols completed. PDI took 1.3s. Estimated remaining: 4m 27s. Rate: 146.9 symbols/min [2025-10-03T22:43:18.023322] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:18.028812] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40131 primary records. [2025-10-03T22:43:18.029260] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:18.029332] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-03T22:43:18.031225] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-10-03T22:43:18.032097] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-03T22:43:18.036752] [INFO ] [MAIN ] Derivative Progress: 1421/2073 symbols completed. PD took 1.3s. Estimated remaining: 4m 26s. Rate: 147.0 symbols/min [2025-10-03T22:43:18.038536] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:18.069951] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-10-03T22:43:18.070220] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-03T22:43:18.091169] [INFO ] [MAIN ] Derivative Progress: 1422/2073 symbols completed. PDM took 1.3s. Estimated remaining: 4m 26s. Rate: 147.1 symbols/min [2025-10-03T22:43:18.092192] [DEBUG] [LOCAL ] PDS: Loaded 17809 existing records from primary storage. [2025-10-03T22:43:18.092500] [INFO ] [MAIN ] PDS: Loaded 17809 primary data records. [2025-10-03T22:43:18.115051] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:18.217382] [DEBUG] [LOCAL ] PDO: Loaded 31781 existing records from primary storage. [2025-10-03T22:43:18.217636] [INFO ] [MAIN ] PDO: Loaded 31781 primary data records. [2025-10-03T22:43:18.416993] [DEBUG] [LOCAL ] PDT: Loaded 17673 existing records from primary storage. [2025-10-03T22:43:18.544280] [INFO ] [MAIN ] PDT: Loaded 17673 primary data records. [2025-10-03T22:43:19.090009] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:19.091454] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 17809 primary records. [2025-10-03T22:43:19.091710] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-03T22:43:19.112341] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-10-03T22:43:19.112913] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-03T22:43:19.127789] [INFO ] [MAIN ] Derivative Progress: 1423/2073 symbols completed. PDS took 1.1s. Estimated remaining: 4m 25s. Rate: 146.9 symbols/min [2025-10-03T22:43:19.128918] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:19.129760] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 31781 primary records. [2025-10-03T22:43:19.129917] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-03T22:43:19.160594] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:19.161708] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17673 primary records. [2025-10-03T22:43:19.161789] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-03T22:43:19.163155] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-10-03T22:43:19.163384] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-03T22:43:19.172972] [INFO ] [MAIN ] Derivative Progress: 1424/2073 symbols completed. PDO took 1.1s. Estimated remaining: 4m 25s. Rate: 147.0 symbols/min [2025-10-03T22:43:19.180920] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-10-03T22:43:19.180984] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-03T22:43:19.183916] [INFO ] [MAIN ] Derivative Progress: 1425/2073 symbols completed. PDT took 1.1s. Estimated remaining: 4m 24s. Rate: 147.1 symbols/min [2025-10-03T22:43:19.184323] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:19.184409] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:19.184566] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:19.204728] [DEBUG] [LOCAL ] PDX: Loaded 14525 existing records from primary storage. [2025-10-03T22:43:19.205018] [INFO ] [MAIN ] PDX: Loaded 14525 primary data records. [2025-10-03T22:43:19.440007] [DEBUG] [LOCAL ] PEN: Loaded 30624 existing records from primary storage. [2025-10-03T22:43:19.547038] [INFO ] [MAIN ] PEN: Loaded 30624 primary data records. [2025-10-03T22:43:19.561068] [DEBUG] [LOCAL ] PEB: Loaded 51395 existing records from primary storage. [2025-10-03T22:43:19.582977] [INFO ] [MAIN ] PEB: Loaded 51395 primary data records. [2025-10-03T22:43:20.259968] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:20.261082] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14525 primary records. [2025-10-03T22:43:20.261371] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-03T22:43:20.285733] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-10-03T22:43:20.286218] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-03T22:43:20.289079] [INFO ] [MAIN ] Derivative Progress: 1426/2073 symbols completed. PDX took 1.1s. Estimated remaining: 4m 24s. Rate: 147.0 symbols/min [2025-10-03T22:43:20.289491] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:20.309177] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:20.314915] [INFO ] [MAIN ] PEN: Generated 1820 derivative records from 30624 primary records. [2025-10-03T22:43:20.315717] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-03T22:43:20.356137] [DEBUG] [LOCAL ] PEO: Loaded 11227 existing records from primary storage. [2025-10-03T22:43:20.341561] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:20.357327] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51395 primary records. [2025-10-03T22:43:20.358816] [INFO ] [MAIN ] PEO: Loaded 11227 primary data records. [2025-10-03T22:43:20.358747] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-03T22:43:20.463057] [DEBUG] [LOCAL ] PEN: Derivative data saved (1820 records). [2025-10-03T22:43:20.477271] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-03T22:43:20.484280] [INFO ] [MAIN ] Derivative Progress: 1427/2073 symbols completed. PEN took 1.3s. Estimated remaining: 4m 24s. Rate: 147.0 symbols/min [2025-10-03T22:43:20.484976] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:20.570481] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-10-03T22:43:20.678679] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-03T22:43:20.691245] [INFO ] [MAIN ] Derivative Progress: 1428/2073 symbols completed. PEB took 1.5s. Estimated remaining: 4m 23s. Rate: 147.1 symbols/min [2025-10-03T22:43:20.691580] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:20.699452] [DEBUG] [LOCAL ] PERF: Loaded 14240 existing records from primary storage. [2025-10-03T22:43:20.699966] [INFO ] [MAIN ] PERF: Loaded 14240 primary data records. [2025-10-03T22:43:20.794404] [DEBUG] [LOCAL ] PFD: Loaded 5226 existing records from primary storage. [2025-10-03T22:43:20.807126] [INFO ] [MAIN ] PFD: Loaded 5226 primary data records. [2025-10-03T22:43:21.350212] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:21.352396] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 11227 primary records. [2025-10-03T22:43:21.355638] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-03T22:43:21.380020] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-10-03T22:43:21.380225] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-03T22:43:21.382820] [INFO ] [MAIN ] Derivative Progress: 1429/2073 symbols completed. PEO took 1.1s. Estimated remaining: 4m 23s. Rate: 147.0 symbols/min [2025-10-03T22:43:21.383108] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:21.405012] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:21.406340] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14240 primary records. [2025-10-03T22:43:21.406541] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-03T22:43:21.443275] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:21.446371] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5226 primary records. [2025-10-03T22:43:21.447584] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-10-03T22:43:21.448128] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-03T22:43:21.448044] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-03T22:43:21.452243] [INFO ] [MAIN ] Derivative Progress: 1430/2073 symbols completed. PERF took 1.0s. Estimated remaining: 4m 22s. Rate: 147.1 symbols/min [2025-10-03T22:43:21.453099] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:21.483055] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-10-03T22:43:21.483283] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-03T22:43:21.486184] [INFO ] [MAIN ] Derivative Progress: 1431/2073 symbols completed. PFD took 0.8s. Estimated remaining: 4m 22s. Rate: 147.2 symbols/min [2025-10-03T22:43:21.486478] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:21.491679] [DEBUG] [LOCAL ] PFH: Loaded 6882 existing records from primary storage. [2025-10-03T22:43:21.491851] [INFO ] [MAIN ] PFH: Loaded 6882 primary data records. [2025-10-03T22:43:21.629383] [DEBUG] [LOCAL ] PFGC: Loaded 47509 existing records from primary storage. [2025-10-03T22:43:21.629630] [INFO ] [MAIN ] PFGC: Loaded 47509 primary data records. [2025-10-03T22:43:21.628192] [DEBUG] [LOCAL ] PFL: Loaded 13879 existing records from primary storage. [2025-10-03T22:43:21.667760] [INFO ] [MAIN ] PFL: Loaded 13879 primary data records. [2025-10-03T22:43:22.610690] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:22.613186] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6882 primary records. [2025-10-03T22:43:22.613483] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-03T22:43:22.649897] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:22.653064] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47509 primary records. [2025-10-03T22:43:22.653252] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-03T22:43:22.668148] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:22.667388] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-10-03T22:43:22.678132] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 13879 primary records. [2025-10-03T22:43:22.678256] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-03T22:43:22.677999] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-03T22:43:22.687407] [INFO ] [MAIN ] Derivative Progress: 1432/2073 symbols completed. PFH took 1.2s. Estimated remaining: 4m 22s. Rate: 147.0 symbols/min [2025-10-03T22:43:22.701550] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-10-03T22:43:22.702428] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-03T22:43:22.707036] [INFO ] [MAIN ] Derivative Progress: 1433/2073 symbols completed. PFGC took 1.3s. Estimated remaining: 4m 21s. Rate: 147.1 symbols/min [2025-10-03T22:43:22.706625] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:22.708571] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:22.710380] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-10-03T22:43:22.711206] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-03T22:43:22.714413] [INFO ] [MAIN ] Derivative Progress: 1434/2073 symbols completed. PFL took 1.2s. Estimated remaining: 4m 21s. Rate: 147.2 symbols/min [2025-10-03T22:43:22.716938] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:22.729962] [DEBUG] [LOCAL ] PFO: Loaded 6032 existing records from primary storage. [2025-10-03T22:43:22.739830] [INFO ] [MAIN ] PFO: Loaded 6032 primary data records. [2025-10-03T22:43:22.790746] [DEBUG] [LOCAL ] PFN: Loaded 22188 existing records from primary storage. [2025-10-03T22:43:22.820801] [INFO ] [MAIN ] PFN: Loaded 22188 primary data records. [2025-10-03T22:43:23.172333] [DEBUG] [LOCAL ] PFLT: Loaded 44496 existing records from primary storage. [2025-10-03T22:43:23.181569] [INFO ] [MAIN ] PFLT: Loaded 44496 primary data records. [2025-10-03T22:43:23.779326] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:23.782040] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 6032 primary records. [2025-10-03T22:43:23.783434] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-03T22:43:23.815576] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:23.816114] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-10-03T22:43:23.817172] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 22188 primary records. [2025-10-03T22:43:23.817509] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-03T22:43:23.817421] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-03T22:43:23.821040] [INFO ] [MAIN ] Derivative Progress: 1435/2073 symbols completed. PFO took 1.1s. Estimated remaining: 4m 20s. Rate: 147.0 symbols/min [2025-10-03T22:43:23.823803] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:23.859304] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:23.861191] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44496 primary records. [2025-10-03T22:43:23.861551] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-03T22:43:23.864619] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-10-03T22:43:23.864741] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-03T22:43:23.876037] [INFO ] [MAIN ] Derivative Progress: 1436/2073 symbols completed. PFN took 1.2s. Estimated remaining: 4m 20s. Rate: 147.1 symbols/min [2025-10-03T22:43:23.876282] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:23.888825] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-10-03T22:43:23.889018] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-03T22:43:23.892279] [INFO ] [MAIN ] Derivative Progress: 1437/2073 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 19s. Rate: 147.2 symbols/min [2025-10-03T22:43:23.904750] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:23.914092] [DEBUG] [LOCAL ] PGP: Loaded 5609 existing records from primary storage. [2025-10-03T22:43:23.922179] [INFO ] [MAIN ] PGP: Loaded 5609 primary data records. [2025-10-03T22:43:24.053354] [DEBUG] [LOCAL ] PFS: Loaded 36112 existing records from primary storage. [2025-10-03T22:43:24.062710] [INFO ] [MAIN ] PFS: Loaded 36112 primary data records. [2025-10-03T22:43:24.063250] [DEBUG] [LOCAL ] PFSI: Loaded 29124 existing records from primary storage. [2025-10-03T22:43:24.084395] [INFO ] [MAIN ] PFSI: Loaded 29124 primary data records. [2025-10-03T22:43:24.972570] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:24.974276] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5609 primary records. [2025-10-03T22:43:24.974682] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-03T22:43:25.019758] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:25.027342] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36112 primary records. [2025-10-03T22:43:25.027701] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-03T22:43:25.040762] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-10-03T22:43:25.042749] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-03T22:43:25.048410] [INFO ] [MAIN ] Derivative Progress: 1438/2073 symbols completed. PGP took 1.1s. Estimated remaining: 4m 19s. Rate: 147.0 symbols/min [2025-10-03T22:43:25.058395] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:25.062828] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29124 primary records. [2025-10-03T22:43:25.067676] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-03T22:43:25.067504] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-10-03T22:43:25.069021] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-03T22:43:25.072667] [INFO ] [MAIN ] Derivative Progress: 1439/2073 symbols completed. PFS took 1.2s. Estimated remaining: 4m 19s. Rate: 147.1 symbols/min [2025-10-03T22:43:25.097539] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-10-03T22:43:25.097767] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-03T22:43:25.101809] [INFO ] [MAIN ] Derivative Progress: 1440/2073 symbols completed. PFSI took 1.2s. Estimated remaining: 4m 18s. Rate: 147.2 symbols/min [2025-10-03T22:43:25.102513] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:25.102445] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:25.102755] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:25.116265] [DEBUG] [LOCAL ] PGZ: Loaded 5549 existing records from primary storage. [2025-10-03T22:43:25.116699] [INFO ] [MAIN ] PGZ: Loaded 5549 primary data records. [2025-10-03T22:43:25.344576] [DEBUG] [LOCAL ] PH: Loaded 38442 existing records from primary storage. [2025-10-03T22:43:25.491311] [DEBUG] [LOCAL ] PGRE: Loaded 47369 existing records from primary storage. [2025-10-03T22:43:25.381286] [INFO ] [MAIN ] PH: Loaded 38442 primary data records. [2025-10-03T22:43:25.496684] [INFO ] [MAIN ] PGRE: Loaded 47369 primary data records. [2025-10-03T22:43:26.186595] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:26.188105] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5549 primary records. [2025-10-03T22:43:26.188546] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-03T22:43:26.207147] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-10-03T22:43:26.207364] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-03T22:43:26.210187] [INFO ] [MAIN ] Derivative Progress: 1441/2073 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 18s. Rate: 147.0 symbols/min [2025-10-03T22:43:26.210681] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:26.233665] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:26.246596] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:26.247426] [INFO ] [MAIN ] PH: Generated 1820 derivative records from 38442 primary records. [2025-10-03T22:43:26.248128] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47369 primary records. [2025-10-03T22:43:26.248408] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-03T22:43:26.252360] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-03T22:43:26.252957] [DEBUG] [LOCAL ] PHD: Loaded 10840 existing records from primary storage. [2025-10-03T22:43:26.254030] [INFO ] [MAIN ] PHD: Loaded 10840 primary data records. [2025-10-03T22:43:26.370700] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-10-03T22:43:26.390624] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-03T22:43:26.410499] [INFO ] [MAIN ] Derivative Progress: 1442/2073 symbols completed. PGRE took 1.3s. Estimated remaining: 4m 17s. Rate: 147.1 symbols/min [2025-10-03T22:43:26.415938] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:26.476812] [DEBUG] [LOCAL ] PH: Derivative data saved (1820 records). [2025-10-03T22:43:26.598254] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-03T22:43:26.601120] [INFO ] [MAIN ] Derivative Progress: 1443/2073 symbols completed. PH took 1.5s. Estimated remaining: 4m 17s. Rate: 147.1 symbols/min [2025-10-03T22:43:26.601429] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:26.622001] [DEBUG] [LOCAL ] PHI: Loaded 15378 existing records from primary storage. [2025-10-03T22:43:26.623285] [INFO ] [MAIN ] PHI: Loaded 15378 primary data records. [2025-10-03T22:43:26.716526] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:26.761039] [INFO ] [MAIN ] PHD: Generated 1820 derivative records from 10840 primary records. [2025-10-03T22:43:26.774052] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-03T22:43:26.773941] [DEBUG] [LOCAL ] PHG: Loaded 46644 existing records from primary storage. [2025-10-03T22:43:26.780729] [INFO ] [MAIN ] PHG: Loaded 46644 primary data records. [2025-10-03T22:43:27.106852] [DEBUG] [LOCAL ] PHD: Derivative data saved (1820 records). [2025-10-03T22:43:27.112962] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-03T22:43:27.115814] [INFO ] [MAIN ] Derivative Progress: 1444/2073 symbols completed. PHD took 0.9s. Estimated remaining: 4m 17s. Rate: 147.1 symbols/min [2025-10-03T22:43:27.126746] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:27.348836] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:27.349610] [DEBUG] [LOCAL ] PHIN: Loaded 33036 existing records from primary storage. [2025-10-03T22:43:27.350861] [INFO ] [MAIN ] PHIN: Loaded 33036 primary data records. [2025-10-03T22:43:27.351870] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15378 primary records. [2025-10-03T22:43:27.352330] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-03T22:43:27.512559] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-10-03T22:43:27.562739] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-03T22:43:27.562528] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:27.567453] [INFO ] [MAIN ] PHG: Generated 1820 derivative records from 46644 primary records. [2025-10-03T22:43:27.566115] [INFO ] [MAIN ] Derivative Progress: 1445/2073 symbols completed. PHI took 1.0s. Estimated remaining: 4m 16s. Rate: 147.1 symbols/min [2025-10-03T22:43:27.567606] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-03T22:43:27.577720] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:27.743009] [DEBUG] [LOCAL ] PHG: Derivative data saved (1820 records). [2025-10-03T22:43:27.744502] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-03T22:43:27.748544] [INFO ] [MAIN ] Derivative Progress: 1446/2073 symbols completed. PHG took 1.3s. Estimated remaining: 4m 16s. Rate: 147.1 symbols/min [2025-10-03T22:43:27.748808] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:27.775582] [DEBUG] [LOCAL ] PHK: Loaded 26746 existing records from primary storage. [2025-10-03T22:43:27.776272] [INFO ] [MAIN ] PHK: Loaded 26746 primary data records. [2025-10-03T22:43:27.886802] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:27.914141] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 33036 primary records. [2025-10-03T22:43:27.935131] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-03T22:43:28.146573] [DEBUG] [LOCAL ] PHR: Loaded 37977 existing records from primary storage. [2025-10-03T22:43:28.167734] [INFO ] [MAIN ] PHR: Loaded 37977 primary data records. [2025-10-03T22:43:28.285380] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-10-03T22:43:28.367524] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-03T22:43:28.376491] [INFO ] [MAIN ] Derivative Progress: 1447/2073 symbols completed. PHIN took 1.2s. Estimated remaining: 4m 15s. Rate: 147.1 symbols/min [2025-10-03T22:43:28.498013] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:28.520595] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:28.522297] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 26746 primary records. [2025-10-03T22:43:28.522411] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-03T22:43:28.547146] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-10-03T22:43:28.547369] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-03T22:43:28.551162] [INFO ] [MAIN ] Derivative Progress: 1448/2073 symbols completed. PHK took 1.0s. Estimated remaining: 4m 15s. Rate: 147.1 symbols/min [2025-10-03T22:43:28.551616] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:28.586414] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:28.587418] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 37977 primary records. [2025-10-03T22:43:28.590871] [DEBUG] [LOCAL ] PIM: Loaded 4831 existing records from primary storage. [2025-10-03T22:43:28.591024] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-03T22:43:28.591306] [INFO ] [MAIN ] PIM: Loaded 4831 primary data records. [2025-10-03T22:43:28.738632] [DEBUG] [LOCAL ] PII: Loaded 49663 existing records from primary storage. [2025-10-03T22:43:28.740719] [INFO ] [MAIN ] PII: Loaded 49663 primary data records. [2025-10-03T22:43:28.774168] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-10-03T22:43:28.801680] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-03T22:43:28.821458] [INFO ] [MAIN ] Derivative Progress: 1449/2073 symbols completed. PHR took 1.1s. Estimated remaining: 4m 14s. Rate: 147.2 symbols/min [2025-10-03T22:43:28.859360] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:29.301232] [DEBUG] [LOCAL ] PINE: Loaded 14278 existing records from primary storage. [2025-10-03T22:43:29.302019] [INFO ] [MAIN ] PINE: Loaded 14278 primary data records. [2025-10-03T22:43:29.646585] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:29.647637] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4831 primary records. [2025-10-03T22:43:29.648628] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-03T22:43:29.672211] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-10-03T22:43:29.672419] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-03T22:43:29.675197] [INFO ] [MAIN ] Derivative Progress: 1450/2073 symbols completed. PIM took 1.1s. Estimated remaining: 4m 14s. Rate: 147.1 symbols/min [2025-10-03T22:43:29.675614] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:29.689732] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:29.691354] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 49663 primary records. [2025-10-03T22:43:29.691668] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-03T22:43:29.712580] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-10-03T22:43:29.725458] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-03T22:43:29.725760] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:29.729944] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14278 primary records. [2025-10-03T22:43:29.728935] [INFO ] [MAIN ] Derivative Progress: 1451/2073 symbols completed. PII took 1.2s. Estimated remaining: 4m 14s. Rate: 147.1 symbols/min [2025-10-03T22:43:29.730102] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-03T22:43:29.731095] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:29.748834] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-10-03T22:43:29.749087] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-03T22:43:29.752151] [INFO ] [MAIN ] Derivative Progress: 1452/2073 symbols completed. PINE took 0.9s. Estimated remaining: 4m 13s. Rate: 147.2 symbols/min [2025-10-03T22:43:29.752488] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:29.766064] [DEBUG] [LOCAL ] PIPR: Loaded 14998 existing records from primary storage. [2025-10-03T22:43:29.766566] [INFO ] [MAIN ] PIPR: Loaded 14998 primary data records. [2025-10-03T22:43:29.919876] [DEBUG] [LOCAL ] PJT: Loaded 21887 existing records from primary storage. [2025-10-03T22:43:29.920361] [INFO ] [MAIN ] PJT: Loaded 21887 primary data records. [2025-10-03T22:43:29.921692] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-10-03T22:43:29.954559] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-10-03T22:43:30.798408] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:30.799630] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 14998 primary records. [2025-10-03T22:43:30.799779] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-03T22:43:30.833445] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:30.834283] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 21887 primary records. [2025-10-03T22:43:30.834465] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-03T22:43:30.833615] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-10-03T22:43:30.844987] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-03T22:43:30.850186] [INFO ] [MAIN ] Derivative Progress: 1453/2073 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 13s. Rate: 147.1 symbols/min [2025-10-03T22:43:30.868468] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:30.869681] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-10-03T22:43:30.869996] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-03T22:43:30.880342] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-10-03T22:43:30.883019] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-03T22:43:30.886020] [INFO ] [MAIN ] Derivative Progress: 1454/2073 symbols completed. PJT took 1.1s. Estimated remaining: 4m 12s. Rate: 147.2 symbols/min [2025-10-03T22:43:30.890680] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-10-03T22:43:30.890749] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-03T22:43:30.893605] [INFO ] [MAIN ] Derivative Progress: 1455/2073 symbols completed. PINS took 1.2s. Estimated remaining: 4m 12s. Rate: 147.3 symbols/min [2025-10-03T22:43:30.894225] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:30.894302] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:30.894437] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:30.916992] [DEBUG] [LOCAL ] PKE: Loaded 13281 existing records from primary storage. [2025-10-03T22:43:30.917273] [INFO ] [MAIN ] PKE: Loaded 13281 primary data records. [2025-10-03T22:43:30.989139] [DEBUG] [LOCAL ] PKST: Loaded 19053 existing records from primary storage. [2025-10-03T22:43:31.007111] [INFO ] [MAIN ] PKST: Loaded 19053 primary data records. [2025-10-03T22:43:31.253743] [DEBUG] [LOCAL ] PK: Loaded 53584 existing records from primary storage. [2025-10-03T22:43:31.396435] [INFO ] [MAIN ] PK: Loaded 53584 primary data records. [2025-10-03T22:43:32.040075] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:43:32.041448] [INFO ] [MAIN ] PKE: Generated 1819 derivative records from 13281 primary records. [2025-10-03T22:43:32.041670] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-03T22:43:32.074965] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:32.077982] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 19053 primary records. [2025-10-03T22:43:32.078297] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-03T22:43:32.094461] [DEBUG] [LOCAL ] PKE: Derivative data saved (1819 records). [2025-10-03T22:43:32.095934] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-03T22:43:32.099177] [INFO ] [MAIN ] Derivative Progress: 1456/2073 symbols completed. PKE took 1.2s. Estimated remaining: 4m 12s. Rate: 147.1 symbols/min [2025-10-03T22:43:32.099336] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:32.118868] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:32.119954] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-10-03T22:43:32.120118] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-03T22:43:32.121062] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53584 primary records. [2025-10-03T22:43:32.124077] [INFO ] [MAIN ] Derivative Progress: 1457/2073 symbols completed. PKST took 1.2s. Estimated remaining: 4m 11s. Rate: 147.2 symbols/min [2025-10-03T22:43:32.124383] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:32.124484] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-03T22:43:32.158542] [DEBUG] [LOCAL ] PKX: Loaded 24566 existing records from primary storage. [2025-10-03T22:43:32.159225] [INFO ] [MAIN ] PKX: Loaded 24566 primary data records. [2025-10-03T22:43:32.171749] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-10-03T22:43:32.198294] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-03T22:43:32.209154] [INFO ] [MAIN ] Derivative Progress: 1458/2073 symbols completed. PK took 1.3s. Estimated remaining: 4m 11s. Rate: 147.2 symbols/min [2025-10-03T22:43:32.222007] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:32.505848] [DEBUG] [LOCAL ] PL: Loaded 53911 existing records from primary storage. [2025-10-03T22:43:32.506279] [INFO ] [MAIN ] PL: Loaded 53911 primary data records. [2025-10-03T22:43:32.672186] [DEBUG] [LOCAL ] PLD: Loaded 54213 existing records from primary storage. [2025-10-03T22:43:32.718772] [INFO ] [MAIN ] PLD: Loaded 54213 primary data records. [2025-10-03T22:43:32.980867] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:32.993088] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 24566 primary records. [2025-10-03T22:43:33.015464] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-03T22:43:33.184884] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-10-03T22:43:33.185404] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-03T22:43:33.188228] [INFO ] [MAIN ] Derivative Progress: 1459/2073 symbols completed. PKX took 1.1s. Estimated remaining: 4m 10s. Rate: 147.1 symbols/min [2025-10-03T22:43:33.188568] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:33.202582] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:33.203305] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53911 primary records. [2025-10-03T22:43:33.203385] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-03T22:43:33.223568] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-10-03T22:43:33.223778] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-03T22:43:33.227296] [INFO ] [MAIN ] Derivative Progress: 1460/2073 symbols completed. PL took 1.1s. Estimated remaining: 4m 10s. Rate: 147.2 symbols/min [2025-10-03T22:43:33.228250] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:33.259247] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:33.260413] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54213 primary records. [2025-10-03T22:43:33.260539] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-03T22:43:33.306707] [DEBUG] [LOCAL ] PLOW: Loaded 20552 existing records from primary storage. [2025-10-03T22:43:33.307259] [INFO ] [MAIN ] PLOW: Loaded 20552 primary data records. [2025-10-03T22:43:33.345989] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-10-03T22:43:33.402769] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-03T22:43:33.440318] [DEBUG] [LOCAL ] PLNT: Loaded 48933 existing records from primary storage. [2025-10-03T22:43:33.456433] [INFO ] [MAIN ] PLNT: Loaded 48933 primary data records. [2025-10-03T22:43:33.439471] [INFO ] [MAIN ] Derivative Progress: 1461/2073 symbols completed. PLD took 1.2s. Estimated remaining: 4m 9s. Rate: 147.2 symbols/min [2025-10-03T22:43:33.461857] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:34.013916] [DEBUG] [LOCAL ] PLYM: Loaded 34055 existing records from primary storage. [2025-10-03T22:43:34.014305] [INFO ] [MAIN ] PLYM: Loaded 34055 primary data records. [2025-10-03T22:43:34.364433] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:34.366623] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20552 primary records. [2025-10-03T22:43:34.366979] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-03T22:43:34.402722] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:34.404867] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 48933 primary records. [2025-10-03T22:43:34.405185] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-03T22:43:34.407692] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-10-03T22:43:34.417403] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-03T22:43:34.419701] [INFO ] [MAIN ] Derivative Progress: 1462/2073 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 9s. Rate: 147.1 symbols/min [2025-10-03T22:43:34.420056] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:34.431514] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-10-03T22:43:34.431671] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-03T22:43:34.434544] [INFO ] [MAIN ] Derivative Progress: 1463/2073 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 9s. Rate: 147.2 symbols/min [2025-10-03T22:43:34.434982] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:34.452848] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:34.453757] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 34055 primary records. [2025-10-03T22:43:34.453865] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-03T22:43:34.485429] [DEBUG] [LOCAL ] PML: Loaded 21631 existing records from primary storage. [2025-10-03T22:43:34.485604] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-10-03T22:43:34.485767] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-03T22:43:34.485853] [INFO ] [MAIN ] PML: Loaded 21631 primary data records. [2025-10-03T22:43:34.488958] [INFO ] [MAIN ] Derivative Progress: 1464/2073 symbols completed. PLYM took 1.0s. Estimated remaining: 4m 8s. Rate: 147.3 symbols/min [2025-10-03T22:43:34.489248] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:34.716949] [DEBUG] [LOCAL ] PM: Loaded 54447 existing records from primary storage. [2025-10-03T22:43:34.715180] [DEBUG] [LOCAL ] PMM: Loaded 10993 existing records from primary storage. [2025-10-03T22:43:34.834836] [INFO ] [MAIN ] PM: Loaded 54447 primary data records. [2025-10-03T22:43:34.835187] [INFO ] [MAIN ] PMM: Loaded 10993 primary data records. [2025-10-03T22:43:35.498381] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:35.499887] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 21631 primary records. [2025-10-03T22:43:35.500019] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-03T22:43:35.527840] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-10-03T22:43:35.554509] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-03T22:43:35.555144] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:35.556099] [INFO ] [MAIN ] PM: Generated 1820 derivative records from 54447 primary records. [2025-10-03T22:43:35.558553] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-03T22:43:35.554783] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:35.560091] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10993 primary records. [2025-10-03T22:43:35.558469] [INFO ] [MAIN ] Derivative Progress: 1465/2073 symbols completed. PML took 1.1s. Estimated remaining: 4m 8s. Rate: 147.1 symbols/min [2025-10-03T22:43:35.560568] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-03T22:43:35.560975] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:35.600792] [DEBUG] [LOCAL ] PMO: Loaded 10606 existing records from primary storage. [2025-10-03T22:43:35.602016] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-10-03T22:43:35.602297] [INFO ] [MAIN ] PMO: Loaded 10606 primary data records. [2025-10-03T22:43:35.602464] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-03T22:43:35.605722] [INFO ] [MAIN ] Derivative Progress: 1466/2073 symbols completed. PMM took 1.1s. Estimated remaining: 4m 7s. Rate: 147.2 symbols/min [2025-10-03T22:43:35.606209] [DEBUG] [LOCAL ] PM: Derivative data saved (1820 records). [2025-10-03T22:43:35.611775] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-03T22:43:35.611630] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:35.614833] [INFO ] [MAIN ] Derivative Progress: 1467/2073 symbols completed. PM took 1.2s. Estimated remaining: 4m 7s. Rate: 147.3 symbols/min [2025-10-03T22:43:35.641379] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:35.939696] [DEBUG] [LOCAL ] PNNT: Loaded 33359 existing records from primary storage. [2025-10-03T22:43:35.939937] [INFO ] [MAIN ] PNNT: Loaded 33359 primary data records. [2025-10-03T22:43:36.041536] [DEBUG] [LOCAL ] PMT: Loaded 40904 existing records from primary storage. [2025-10-03T22:43:36.058541] [INFO ] [MAIN ] PMT: Loaded 40904 primary data records. [2025-10-03T22:43:36.656225] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:36.657665] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10606 primary records. [2025-10-03T22:43:36.659331] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-03T22:43:36.691225] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:36.693131] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33359 primary records. [2025-10-03T22:43:36.693824] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-03T22:43:36.696238] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-10-03T22:43:36.703889] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-03T22:43:36.712415] [INFO ] [MAIN ] Derivative Progress: 1468/2073 symbols completed. PMO took 1.2s. Estimated remaining: 4m 7s. Rate: 147.1 symbols/min [2025-10-03T22:43:36.727286] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:36.728806] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 40904 primary records. [2025-10-03T22:43:36.729370] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-03T22:43:36.745178] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-10-03T22:43:36.745794] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-03T22:43:36.748684] [INFO ] [MAIN ] Derivative Progress: 1469/2073 symbols completed. PNNT took 1.1s. Estimated remaining: 4m 6s. Rate: 147.2 symbols/min [2025-10-03T22:43:36.751477] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-10-03T22:43:36.751555] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-03T22:43:36.754722] [INFO ] [MAIN ] Derivative Progress: 1470/2073 symbols completed. PMT took 1.1s. Estimated remaining: 4m 6s. Rate: 147.3 symbols/min [2025-10-03T22:43:36.755234] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:36.755157] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:36.755506] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:36.834534] [DEBUG] [LOCAL ] POST: Loaded 39260 existing records from primary storage. [2025-10-03T22:43:36.836805] [INFO ] [MAIN ] POST: Loaded 39260 primary data records. [2025-10-03T22:43:36.836659] [DEBUG] [LOCAL ] POR: Loaded 47696 existing records from primary storage. [2025-10-03T22:43:36.843729] [INFO ] [MAIN ] POR: Loaded 47696 primary data records. [2025-10-03T22:43:36.946491] [DEBUG] [LOCAL ] PNW: Loaded 46446 existing records from primary storage. [2025-10-03T22:43:36.983291] [INFO ] [MAIN ] PNW: Loaded 46446 primary data records. [2025-10-03T22:43:37.814590] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:37.815976] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47696 primary records. [2025-10-03T22:43:37.816307] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-03T22:43:37.847754] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:37.848410] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39260 primary records. [2025-10-03T22:43:37.848721] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-03T22:43:37.876479] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-10-03T22:43:37.879851] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-03T22:43:37.879776] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:37.881993] [INFO ] [MAIN ] Derivative Progress: 1471/2073 symbols completed. POR took 1.1s. Estimated remaining: 4m 5s. Rate: 147.1 symbols/min [2025-10-03T22:43:37.883210] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46446 primary records. [2025-10-03T22:43:37.886621] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-03T22:43:37.886276] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:37.888918] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-10-03T22:43:37.889305] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-03T22:43:37.899010] [INFO ] [MAIN ] Derivative Progress: 1472/2073 symbols completed. POST took 1.1s. Estimated remaining: 4m 5s. Rate: 147.2 symbols/min [2025-10-03T22:43:37.899245] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:37.907983] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-10-03T22:43:37.908197] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-03T22:43:37.911388] [INFO ] [MAIN ] Derivative Progress: 1473/2073 symbols completed. PNW took 1.2s. Estimated remaining: 4m 4s. Rate: 147.3 symbols/min [2025-10-03T22:43:37.911787] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:37.927110] [DEBUG] [LOCAL ] PPT: Loaded 20416 existing records from primary storage. [2025-10-03T22:43:37.927250] [INFO ] [MAIN ] PPT: Loaded 20416 primary data records. [2025-10-03T22:43:38.224599] [DEBUG] [LOCAL ] PPG: Loaded 51413 existing records from primary storage. [2025-10-03T22:43:38.309035] [INFO ] [MAIN ] PPG: Loaded 51413 primary data records. [2025-10-03T22:43:38.438387] [DEBUG] [LOCAL ] PR: Loaded 54390 existing records from primary storage. [2025-10-03T22:43:38.444051] [INFO ] [MAIN ] PR: Loaded 54390 primary data records. [2025-10-03T22:43:38.999183] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:39.001459] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20416 primary records. [2025-10-03T22:43:39.001863] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-03T22:43:39.026019] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-10-03T22:43:39.026408] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-03T22:43:39.037229] [INFO ] [MAIN ] Derivative Progress: 1474/2073 symbols completed. PPT took 1.1s. Estimated remaining: 4m 4s. Rate: 147.2 symbols/min [2025-10-03T22:43:39.042328] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:39.043563] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:39.044834] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51413 primary records. [2025-10-03T22:43:39.045420] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-03T22:43:39.080340] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:39.080906] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-10-03T22:43:39.081086] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-03T22:43:39.081891] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54390 primary records. [2025-10-03T22:43:39.087857] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-03T22:43:39.087970] [INFO ] [MAIN ] Derivative Progress: 1475/2073 symbols completed. PPG took 1.2s. Estimated remaining: 4m 4s. Rate: 147.2 symbols/min [2025-10-03T22:43:39.089627] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:39.116990] [DEBUG] [LOCAL ] PRCS: Loaded 2779 existing records from primary storage. [2025-10-03T22:43:39.117387] [INFO ] [MAIN ] PRCS: Loaded 2779 primary data records. [2025-10-03T22:43:39.237052] [DEBUG] [LOCAL ] PRA: Loaded 35566 existing records from primary storage. [2025-10-03T22:43:39.241005] [INFO ] [MAIN ] PRA: Loaded 35566 primary data records. [2025-10-03T22:43:39.240859] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-10-03T22:43:39.241197] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-03T22:43:39.244469] [INFO ] [MAIN ] Derivative Progress: 1476/2073 symbols completed. PR took 1.3s. Estimated remaining: 4m 3s. Rate: 147.3 symbols/min [2025-10-03T22:43:39.287504] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:39.786045] [DEBUG] [LOCAL ] PRG: Loaded 30280 existing records from primary storage. [2025-10-03T22:43:39.786296] [INFO ] [MAIN ] PRG: Loaded 30280 primary data records. [2025-10-03T22:43:39.989276] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-03T22:43:40.158625] [INFO ] [MAIN ] PRCS: Generated 1818 derivative records from 2779 primary records. [2025-10-03T22:43:40.159913] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-03T22:43:40.192163] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:40.193804] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35566 primary records. [2025-10-03T22:43:40.194696] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-03T22:43:40.197760] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1818 records). [2025-10-03T22:43:40.205288] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-03T22:43:40.209011] [INFO ] [MAIN ] Derivative Progress: 1477/2073 symbols completed. PRCS took 1.1s. Estimated remaining: 4m 3s. Rate: 147.2 symbols/min [2025-10-03T22:43:40.215572] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:40.218587] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-10-03T22:43:40.218838] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-03T22:43:40.221851] [INFO ] [MAIN ] Derivative Progress: 1478/2073 symbols completed. PRA took 1.2s. Estimated remaining: 4m 2s. Rate: 147.3 symbols/min [2025-10-03T22:43:40.222449] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:40.232836] [DEBUG] [LOCAL ] PRH: Loaded 4837 existing records from primary storage. [2025-10-03T22:43:40.233071] [INFO ] [MAIN ] PRH: Loaded 4837 primary data records. [2025-10-03T22:43:40.304301] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:40.325983] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30280 primary records. [2025-10-03T22:43:40.336468] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-03T22:43:40.459608] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-10-03T22:43:40.576584] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-03T22:43:40.581460] [INFO ] [MAIN ] Derivative Progress: 1479/2073 symbols completed. PRG took 1.3s. Estimated remaining: 4m 2s. Rate: 147.3 symbols/min [2025-10-03T22:43:40.595761] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:40.597035] [DEBUG] [LOCAL ] PRGO: Loaded 47657 existing records from primary storage. [2025-10-03T22:43:40.598033] [INFO ] [MAIN ] PRGO: Loaded 47657 primary data records. [2025-10-03T22:43:40.794865] [DEBUG] [LOCAL ] PRI: Loaded 18492 existing records from primary storage. [2025-10-03T22:43:40.828263] [INFO ] [MAIN ] PRI: Loaded 18492 primary data records. [2025-10-03T22:43:41.142021] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:41.197502] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4837 primary records. [2025-10-03T22:43:41.220955] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-03T22:43:41.384624] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-10-03T22:43:41.385432] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-03T22:43:41.388120] [INFO ] [MAIN ] Derivative Progress: 1480/2073 symbols completed. PRH took 1.2s. Estimated remaining: 4m 2s. Rate: 147.2 symbols/min [2025-10-03T22:43:41.390148] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:41.408016] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:41.408879] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47657 primary records. [2025-10-03T22:43:41.409381] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-03T22:43:41.428116] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-10-03T22:43:41.428471] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-03T22:43:41.432410] [INFO ] [MAIN ] Derivative Progress: 1481/2073 symbols completed. PRGO took 1.2s. Estimated remaining: 4m 1s. Rate: 147.3 symbols/min [2025-10-03T22:43:41.433029] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:41.449920] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:41.461888] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18492 primary records. [2025-10-03T22:43:41.462103] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-03T22:43:41.479089] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-10-03T22:43:41.480105] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-03T22:43:41.483137] [INFO ] [MAIN ] Derivative Progress: 1482/2073 symbols completed. PRI took 0.9s. Estimated remaining: 4m 1s. Rate: 147.4 symbols/min [2025-10-03T22:43:41.483424] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:41.499447] [DEBUG] [LOCAL ] PRIM: Loaded 45009 existing records from primary storage. [2025-10-03T22:43:41.508409] [INFO ] [MAIN ] PRIM: Loaded 45009 primary data records. [2025-10-03T22:43:41.645571] [DEBUG] [LOCAL ] PRKS: Loaded 43142 existing records from primary storage. [2025-10-03T22:43:41.651484] [INFO ] [MAIN ] PRKS: Loaded 43142 primary data records. [2025-10-03T22:43:41.780692] [DEBUG] [LOCAL ] PRLB: Loaded 20678 existing records from primary storage. [2025-10-03T22:43:41.947194] [INFO ] [MAIN ] PRLB: Loaded 20678 primary data records. [2025-10-03T22:43:42.595330] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:42.596782] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 45009 primary records. [2025-10-03T22:43:42.596889] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-03T22:43:42.636372] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-10-03T22:43:42.635044] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:42.636541] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-03T22:43:42.640566] [INFO ] [MAIN ] Derivative Progress: 1483/2073 symbols completed. PRIM took 1.3s. Estimated remaining: 4m 1s. Rate: 147.2 symbols/min [2025-10-03T22:43:42.637445] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43142 primary records. [2025-10-03T22:43:42.641862] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-03T22:43:42.675086] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:42.677007] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 20678 primary records. [2025-10-03T22:43:42.677373] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-03T22:43:42.680439] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-10-03T22:43:42.687772] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-03T22:43:42.698334] [INFO ] [MAIN ] Derivative Progress: 1484/2073 symbols completed. PRKS took 1.3s. Estimated remaining: 3m 60s. Rate: 147.3 symbols/min [2025-10-03T22:43:42.703986] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-10-03T22:43:42.704224] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-03T22:43:42.708385] [INFO ] [MAIN ] Derivative Progress: 1485/2073 symbols completed. PRLB took 1.2s. Estimated remaining: 3m 59s. Rate: 147.4 symbols/min [2025-10-03T22:43:42.709073] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:42.709331] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:42.709254] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:42.780047] [DEBUG] [LOCAL ] PRO: Loaded 38992 existing records from primary storage. [2025-10-03T22:43:42.781116] [INFO ] [MAIN ] PRO: Loaded 38992 primary data records. [2025-10-03T22:43:42.817909] [DEBUG] [LOCAL ] PRM: Loaded 45329 existing records from primary storage. [2025-10-03T22:43:42.857151] [INFO ] [MAIN ] PRM: Loaded 45329 primary data records. [2025-10-03T22:43:42.944521] [DEBUG] [LOCAL ] PRMB: Loaded 53910 existing records from primary storage. [2025-10-03T22:43:43.012011] [INFO ] [MAIN ] PRMB: Loaded 53910 primary data records. [2025-10-03T22:43:43.883539] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:43.887103] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45329 primary records. [2025-10-03T22:43:43.887767] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-03T22:43:43.905767] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:43.916032] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 38992 primary records. [2025-10-03T22:43:43.916261] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-03T22:43:43.943045] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-10-03T22:43:43.945301] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-03T22:43:43.948614] [INFO ] [MAIN ] Derivative Progress: 1486/2073 symbols completed. PRM took 1.2s. Estimated remaining: 3m 59s. Rate: 147.2 symbols/min [2025-10-03T22:43:43.957206] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:43.963851] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:43.966675] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-10-03T22:43:43.967750] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-03T22:43:43.971046] [INFO ] [MAIN ] Derivative Progress: 1487/2073 symbols completed. PRO took 1.3s. Estimated remaining: 3m 59s. Rate: 147.3 symbols/min [2025-10-03T22:43:43.968547] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53910 primary records. [2025-10-03T22:43:43.971176] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-03T22:43:43.971370] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:43.991014] [DEBUG] [LOCAL ] PRT: Loaded 5333 existing records from primary storage. [2025-10-03T22:43:43.994902] [INFO ] [MAIN ] PRT: Loaded 5333 primary data records. [2025-10-03T22:43:44.001209] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-10-03T22:43:44.022338] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-03T22:43:44.056467] [INFO ] [MAIN ] Derivative Progress: 1488/2073 symbols completed. PRMB took 1.3s. Estimated remaining: 3m 58s. Rate: 147.3 symbols/min [2025-10-03T22:43:44.061792] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:44.433047] [DEBUG] [LOCAL ] PRU: Loaded 52123 existing records from primary storage. [2025-10-03T22:43:44.433955] [INFO ] [MAIN ] PRU: Loaded 52123 primary data records. [2025-10-03T22:43:44.543173] [DEBUG] [LOCAL ] PSA: Loaded 42296 existing records from primary storage. [2025-10-03T22:43:44.564473] [INFO ] [MAIN ] PSA: Loaded 42296 primary data records. [2025-10-03T22:43:45.143507] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:45.160721] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5333 primary records. [2025-10-03T22:43:45.163251] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-03T22:43:45.184323] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-10-03T22:43:45.184764] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-03T22:43:45.187250] [INFO ] [MAIN ] Derivative Progress: 1489/2073 symbols completed. PRT took 1.2s. Estimated remaining: 3m 58s. Rate: 147.2 symbols/min [2025-10-03T22:43:45.187989] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:45.212977] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:45.217030] [DEBUG] [LOCAL ] PSBD: Loaded 7287 existing records from primary storage. [2025-10-03T22:43:45.217856] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52123 primary records. [2025-10-03T22:43:45.218305] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-03T22:43:45.218248] [INFO ] [MAIN ] PSBD: Loaded 7287 primary data records. [2025-10-03T22:43:45.373258] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-10-03T22:43:45.401836] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-03T22:43:45.455351] [INFO ] [MAIN ] Derivative Progress: 1490/2073 symbols completed. PRU took 1.5s. Estimated remaining: 3m 58s. Rate: 147.2 symbols/min [2025-10-03T22:43:45.447934] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:45.495771] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42296 primary records. [2025-10-03T22:43:45.494739] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:45.567562] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-03T22:43:45.600353] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-10-03T22:43:45.600759] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-03T22:43:45.604587] [INFO ] [MAIN ] Derivative Progress: 1491/2073 symbols completed. PSA took 1.5s. Estimated remaining: 3m 57s. Rate: 147.3 symbols/min [2025-10-03T22:43:45.611262] [DEBUG] [LOCAL ] PSF: Loaded 7060 existing records from primary storage. [2025-10-03T22:43:45.611424] [INFO ] [MAIN ] PSF: Loaded 7060 primary data records. [2025-10-03T22:43:45.611575] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:45.981524] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:43:45.982743] [INFO ] [MAIN ] PSBD: Generated 1819 derivative records from 7287 primary records. [2025-10-03T22:43:45.982879] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-03T22:43:45.984462] [DEBUG] [LOCAL ] PSFE: Loaded 30388 existing records from primary storage. [2025-10-03T22:43:45.985794] [INFO ] [MAIN ] PSFE: Loaded 30388 primary data records. [2025-10-03T22:43:46.130601] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1819 records). [2025-10-03T22:43:46.130912] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-03T22:43:46.149777] [INFO ] [MAIN ] Derivative Progress: 1492/2073 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 57s. Rate: 147.2 symbols/min [2025-10-03T22:43:46.174444] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:46.359821] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:46.362562] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 7060 primary records. [2025-10-03T22:43:46.363617] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-03T22:43:46.385433] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-10-03T22:43:46.397625] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-03T22:43:46.401587] [INFO ] [MAIN ] Derivative Progress: 1493/2073 symbols completed. PSF took 0.9s. Estimated remaining: 3m 56s. Rate: 147.3 symbols/min [2025-10-03T22:43:46.402563] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:46.437958] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:46.438864] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 30388 primary records. [2025-10-03T22:43:46.439067] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-03T22:43:46.440069] [DEBUG] [LOCAL ] PSN: Loaded 46674 existing records from primary storage. [2025-10-03T22:43:46.441137] [INFO ] [MAIN ] PSN: Loaded 46674 primary data records. [2025-10-03T22:43:46.525287] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-10-03T22:43:46.537312] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-03T22:43:46.544974] [INFO ] [MAIN ] Derivative Progress: 1494/2073 symbols completed. PSFE took 0.9s. Estimated remaining: 3m 56s. Rate: 147.3 symbols/min [2025-10-03T22:43:46.578227] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:46.674243] [DEBUG] [LOCAL ] PSO: Loaded 37454 existing records from primary storage. [2025-10-03T22:43:46.824337] [INFO ] [MAIN ] PSO: Loaded 37454 primary data records. [2025-10-03T22:43:46.984243] [DEBUG] [LOCAL ] PSQH: Loaded 35362 existing records from primary storage. [2025-10-03T22:43:47.022432] [INFO ] [MAIN ] PSQH: Loaded 35362 primary data records. [2025-10-03T22:43:47.501803] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:47.502840] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 46674 primary records. [2025-10-03T22:43:47.503102] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-03T22:43:47.522974] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-10-03T22:43:47.523436] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-03T22:43:47.526432] [INFO ] [MAIN ] Derivative Progress: 1495/2073 symbols completed. PSN took 1.4s. Estimated remaining: 3m 56s. Rate: 147.2 symbols/min [2025-10-03T22:43:47.528721] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:47.549285] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:47.550473] [INFO ] [MAIN ] PSO: Generated 1820 derivative records from 37454 primary records. [2025-10-03T22:43:47.550599] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-03T22:43:47.571353] [DEBUG] [LOCAL ] PSO: Derivative data saved (1820 records). [2025-10-03T22:43:47.572433] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-03T22:43:47.575178] [INFO ] [MAIN ] Derivative Progress: 1496/2073 symbols completed. PSO took 1.2s. Estimated remaining: 3m 55s. Rate: 147.3 symbols/min [2025-10-03T22:43:47.575963] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:47.596080] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:47.596890] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35362 primary records. [2025-10-03T22:43:47.597238] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-03T22:43:47.646559] [DEBUG] [LOCAL ] PSTL: Loaded 20371 existing records from primary storage. [2025-10-03T22:43:47.647893] [INFO ] [MAIN ] PSTL: Loaded 20371 primary data records. [2025-10-03T22:43:47.648013] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-10-03T22:43:47.694086] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-03T22:43:47.721199] [INFO ] [MAIN ] Derivative Progress: 1497/2073 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 55s. Rate: 147.3 symbols/min [2025-10-03T22:43:47.780462] [DEBUG] [LOCAL ] PSTG: Loaded 53615 existing records from primary storage. [2025-10-03T22:43:47.779414] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:47.781195] [INFO ] [MAIN ] PSTG: Loaded 53615 primary data records. [2025-10-03T22:43:48.415012] [DEBUG] [LOCAL ] PSX: Loaded 53881 existing records from primary storage. [2025-10-03T22:43:48.415994] [INFO ] [MAIN ] PSX: Loaded 53881 primary data records. [2025-10-03T22:43:48.581413] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:48.608333] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20371 primary records. [2025-10-03T22:43:48.628540] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-03T22:43:48.717515] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-10-03T22:43:48.708831] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:48.787170] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53615 primary records. [2025-10-03T22:43:48.785694] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-03T22:43:49.004082] [INFO ] [MAIN ] Derivative Progress: 1498/2073 symbols completed. PSTL took 1.4s. Estimated remaining: 3m 55s. Rate: 147.1 symbols/min [2025-10-03T22:43:49.015533] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-03T22:43:49.061230] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-10-03T22:43:49.061433] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-03T22:43:49.065098] [INFO ] [MAIN ] Derivative Progress: 1499/2073 symbols completed. PSTG took 1.5s. Estimated remaining: 3m 54s. Rate: 147.2 symbols/min [2025-10-03T22:43:49.090178] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:49.091035] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53881 primary records. [2025-10-03T22:43:49.091105] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-03T22:43:49.116693] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-10-03T22:43:49.116906] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-03T22:43:49.125472] [INFO ] [MAIN ] Derivative Progress: 1500/2073 symbols completed. PSX took 1.3s. Estimated remaining: 3m 53s. Rate: 147.3 symbols/min [2025-10-03T22:43:49.126612] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:49.126474] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:49.127092] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:49.163931] [DEBUG] [LOCAL ] PTA: Loaded 15164 existing records from primary storage. [2025-10-03T22:43:49.164341] [INFO ] [MAIN ] PTA: Loaded 15164 primary data records. [2025-10-03T22:43:49.359881] [DEBUG] [LOCAL ] PTY: Loaded 37828 existing records from primary storage. [2025-10-03T22:43:49.373686] [INFO ] [MAIN ] PTY: Loaded 37828 primary data records. [2025-10-03T22:43:49.396896] [DEBUG] [LOCAL ] PUK: Loaded 45329 existing records from primary storage. [2025-10-03T22:43:49.506588] [INFO ] [MAIN ] PUK: Loaded 45329 primary data records. [2025-10-03T22:43:50.290343] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:50.292103] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15164 primary records. [2025-10-03T22:43:50.292425] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-03T22:43:50.331247] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:50.332373] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-10-03T22:43:50.333184] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 37828 primary records. [2025-10-03T22:43:50.332484] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-03T22:43:50.333285] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-03T22:43:50.336042] [INFO ] [MAIN ] Derivative Progress: 1501/2073 symbols completed. PTA took 1.2s. Estimated remaining: 3m 53s. Rate: 147.1 symbols/min [2025-10-03T22:43:50.336688] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:50.367910] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:50.369552] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45329 primary records. [2025-10-03T22:43:50.369637] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-03T22:43:50.384204] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-10-03T22:43:50.384679] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-03T22:43:50.387393] [INFO ] [MAIN ] Derivative Progress: 1502/2073 symbols completed. PTY took 1.3s. Estimated remaining: 3m 53s. Rate: 147.2 symbols/min [2025-10-03T22:43:50.387874] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:50.394548] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-10-03T22:43:50.394741] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-03T22:43:50.397538] [INFO ] [MAIN ] Derivative Progress: 1503/2073 symbols completed. PUK took 1.3s. Estimated remaining: 3m 52s. Rate: 147.3 symbols/min [2025-10-03T22:43:50.397691] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:50.401753] [DEBUG] [LOCAL ] PVL: Loaded 4798 existing records from primary storage. [2025-10-03T22:43:50.401958] [INFO ] [MAIN ] PVL: Loaded 4798 primary data records. [2025-10-03T22:43:50.537835] [DEBUG] [LOCAL ] PVH: Loaded 51026 existing records from primary storage. [2025-10-03T22:43:50.548552] [INFO ] [MAIN ] PVH: Loaded 51026 primary data records. [2025-10-03T22:43:50.947026] [DEBUG] [LOCAL ] PWR: Loaded 47641 existing records from primary storage. [2025-10-03T22:43:51.105438] [INFO ] [MAIN ] PWR: Loaded 47641 primary data records. [2025-10-03T22:43:51.430275] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:51.431691] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4798 primary records. [2025-10-03T22:43:51.431898] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-03T22:43:51.463603] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:51.464455] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-10-03T22:43:51.465180] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 51026 primary records. [2025-10-03T22:43:51.465356] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-03T22:43:51.465434] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-03T22:43:51.468466] [INFO ] [MAIN ] Derivative Progress: 1504/2073 symbols completed. PVL took 1.1s. Estimated remaining: 3m 52s. Rate: 147.1 symbols/min [2025-10-03T22:43:51.468640] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:51.486280] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-10-03T22:43:51.486387] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-03T22:43:51.489114] [INFO ] [MAIN ] Derivative Progress: 1505/2073 symbols completed. PVH took 1.2s. Estimated remaining: 3m 52s. Rate: 147.2 symbols/min [2025-10-03T22:43:51.489476] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:51.509589] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:51.519130] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 47641 primary records. [2025-10-03T22:43:51.519389] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-03T22:43:51.550266] [DEBUG] [LOCAL ] PX: Loaded 34896 existing records from primary storage. [2025-10-03T22:43:51.551180] [INFO ] [MAIN ] PX: Loaded 34896 primary data records. [2025-10-03T22:43:51.630972] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-10-03T22:43:51.631116] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-03T22:43:51.634470] [INFO ] [MAIN ] Derivative Progress: 1506/2073 symbols completed. PWR took 1.2s. Estimated remaining: 3m 51s. Rate: 147.3 symbols/min [2025-10-03T22:43:51.630883] [DEBUG] [LOCAL ] QD: Loaded 28286 existing records from primary storage. [2025-10-03T22:43:51.634635] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:51.641558] [INFO ] [MAIN ] QD: Loaded 28286 primary data records. [2025-10-03T22:43:52.211505] [DEBUG] [LOCAL ] QGEN: Loaded 49814 existing records from primary storage. [2025-10-03T22:43:52.212101] [INFO ] [MAIN ] QGEN: Loaded 49814 primary data records. [2025-10-03T22:43:52.528801] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:52.529833] [INFO ] [MAIN ] PX: Generated 1820 derivative records from 34896 primary records. [2025-10-03T22:43:52.530072] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-03T22:43:52.563398] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:52.564589] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28286 primary records. [2025-10-03T22:43:52.565838] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-03T22:43:52.566861] [DEBUG] [LOCAL ] PX: Derivative data saved (1820 records). [2025-10-03T22:43:52.568340] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-03T22:43:52.581058] [INFO ] [MAIN ] Derivative Progress: 1507/2073 symbols completed. PX took 1.1s. Estimated remaining: 3m 51s. Rate: 147.1 symbols/min [2025-10-03T22:43:52.581619] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:52.589929] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-10-03T22:43:52.590218] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-03T22:43:52.593269] [INFO ] [MAIN ] Derivative Progress: 1508/2073 symbols completed. QD took 1.1s. Estimated remaining: 3m 50s. Rate: 147.2 symbols/min [2025-10-03T22:43:52.593566] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:52.612369] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:52.613151] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49814 primary records. [2025-10-03T22:43:52.613217] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-03T22:43:52.629788] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-10-03T22:43:52.630001] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-03T22:43:52.633604] [INFO ] [MAIN ] Derivative Progress: 1509/2073 symbols completed. QGEN took 1.0s. Estimated remaining: 3m 50s. Rate: 147.3 symbols/min [2025-10-03T22:43:52.633918] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:52.700229] [DEBUG] [LOCAL ] QS: Loaded 54523 existing records from primary storage. [2025-10-03T22:43:52.701736] [INFO ] [MAIN ] QS: Loaded 54523 primary data records. [2025-10-03T22:43:52.703194] [DEBUG] [LOCAL ] QSR: Loaded 53202 existing records from primary storage. [2025-10-03T22:43:52.742378] [INFO ] [MAIN ] QSR: Loaded 53202 primary data records. [2025-10-03T22:43:52.947552] [DEBUG] [LOCAL ] QTWO: Loaded 39720 existing records from primary storage. [2025-10-03T22:43:52.968417] [INFO ] [MAIN ] QTWO: Loaded 39720 primary data records. [2025-10-03T22:43:53.734138] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:53.733859] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:53.735939] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53202 primary records. [2025-10-03T22:43:53.736040] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-03T22:43:53.735573] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54523 primary records. [2025-10-03T22:43:53.737406] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-03T22:43:53.766216] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-10-03T22:43:53.766446] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-03T22:43:53.769579] [INFO ] [MAIN ] Derivative Progress: 1510/2073 symbols completed. QS took 1.2s. Estimated remaining: 3m 50s. Rate: 147.1 symbols/min [2025-10-03T22:43:53.769902] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:53.776392] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-10-03T22:43:53.776736] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-03T22:43:53.778838] [INFO ] [MAIN ] Derivative Progress: 1511/2073 symbols completed. QSR took 1.2s. Estimated remaining: 3m 49s. Rate: 147.2 symbols/min [2025-10-03T22:43:53.779084] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:53.793225] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:53.794040] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 39720 primary records. [2025-10-03T22:43:53.794146] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-03T22:43:53.829370] [DEBUG] [LOCAL ] QVCC: Loaded 9027 existing records from primary storage. [2025-10-03T22:43:53.824837] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-10-03T22:43:53.829542] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-03T22:43:53.832448] [INFO ] [MAIN ] Derivative Progress: 1512/2073 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 48s. Rate: 147.3 symbols/min [2025-10-03T22:43:53.833315] [DEBUG] [LOCAL ] QUAD: Loaded 23662 existing records from primary storage. [2025-10-03T22:43:53.832622] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:53.833507] [INFO ] [MAIN ] QVCC: Loaded 9027 primary data records. [2025-10-03T22:43:53.833675] [INFO ] [MAIN ] QUAD: Loaded 23662 primary data records. [2025-10-03T22:43:54.037819] [DEBUG] [LOCAL ] QVCD: Loaded 4578 existing records from primary storage. [2025-10-03T22:43:54.048511] [INFO ] [MAIN ] QVCD: Loaded 4578 primary data records. [2025-10-03T22:43:54.788680] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:54.804034] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9027 primary records. [2025-10-03T22:43:54.804984] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:54.805143] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-03T22:43:54.807373] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23662 primary records. [2025-10-03T22:43:54.809489] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-03T22:43:54.855046] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:54.857323] [INFO ] [MAIN ] QVCD: Generated 1820 derivative records from 4578 primary records. [2025-10-03T22:43:54.858537] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-03T22:43:54.869071] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-10-03T22:43:54.872005] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-03T22:43:54.872081] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-10-03T22:43:54.875048] [INFO ] [MAIN ] Derivative Progress: 1513/2073 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 48s. Rate: 147.2 symbols/min [2025-10-03T22:43:54.878423] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-03T22:43:54.880501] [INFO ] [MAIN ] Derivative Progress: 1514/2073 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 48s. Rate: 147.3 symbols/min [2025-10-03T22:43:54.884123] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1820 records). [2025-10-03T22:43:54.884234] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-03T22:43:54.887355] [INFO ] [MAIN ] Derivative Progress: 1515/2073 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 47s. Rate: 147.4 symbols/min [2025-10-03T22:43:54.887789] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:54.887900] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:54.887982] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:54.920434] [DEBUG] [LOCAL ] RA: Loaded 22099 existing records from primary storage. [2025-10-03T22:43:54.920579] [INFO ] [MAIN ] RA: Loaded 22099 primary data records. [2025-10-03T22:43:55.018206] [DEBUG] [LOCAL ] R: Loaded 29355 existing records from primary storage. [2025-10-03T22:43:55.045780] [INFO ] [MAIN ] R: Loaded 29355 primary data records. [2025-10-03T22:43:55.259790] [DEBUG] [LOCAL ] QXO: Loaded 54046 existing records from primary storage. [2025-10-03T22:43:55.400863] [INFO ] [MAIN ] QXO: Loaded 54046 primary data records. [2025-10-03T22:43:55.963627] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:55.964635] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22099 primary records. [2025-10-03T22:43:55.964936] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-03T22:43:56.003139] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:56.007522] [INFO ] [MAIN ] R: Generated 1820 derivative records from 29355 primary records. [2025-10-03T22:43:56.008441] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-03T22:43:56.024188] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-10-03T22:43:56.032319] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-03T22:43:56.040411] [INFO ] [MAIN ] Derivative Progress: 1516/2073 symbols completed. RA took 1.2s. Estimated remaining: 3m 47s. Rate: 147.2 symbols/min [2025-10-03T22:43:56.040963] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:56.043233] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:56.045239] [INFO ] [MAIN ] QXO: Generated 1820 derivative records from 54046 primary records. [2025-10-03T22:43:56.045822] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-03T22:43:56.048248] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-10-03T22:43:56.048486] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-03T22:43:56.051699] [INFO ] [MAIN ] Derivative Progress: 1517/2073 symbols completed. R took 1.2s. Estimated remaining: 3m 46s. Rate: 147.3 symbols/min [2025-10-03T22:43:56.059452] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:56.070718] [DEBUG] [LOCAL ] QXO: Derivative data saved (1820 records). [2025-10-03T22:43:56.070996] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-03T22:43:56.074215] [INFO ] [MAIN ] Derivative Progress: 1518/2073 symbols completed. QXO took 1.2s. Estimated remaining: 3m 46s. Rate: 147.4 symbols/min [2025-10-03T22:43:56.074595] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:56.156235] [DEBUG] [LOCAL ] RAMP: Loaded 38075 existing records from primary storage. [2025-10-03T22:43:56.157908] [DEBUG] [LOCAL ] RACE: Loaded 33057 existing records from primary storage. [2025-10-03T22:43:56.158229] [INFO ] [MAIN ] RACE: Loaded 33057 primary data records. [2025-10-03T22:43:56.158286] [INFO ] [MAIN ] RAMP: Loaded 38075 primary data records. [2025-10-03T22:43:56.466318] [DEBUG] [LOCAL ] RBA: Loaded 46530 existing records from primary storage. [2025-10-03T22:43:56.518188] [INFO ] [MAIN ] RBA: Loaded 46530 primary data records. [2025-10-03T22:43:57.237477] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:57.231069] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:57.239930] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38075 primary records. [2025-10-03T22:43:57.240893] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33057 primary records. [2025-10-03T22:43:57.241037] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-03T22:43:57.241138] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-03T22:43:57.255798] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:57.274873] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46530 primary records. [2025-10-03T22:43:57.275180] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-03T22:43:57.303482] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-10-03T22:43:57.303801] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-03T22:43:57.310461] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-10-03T22:43:57.309695] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-10-03T22:43:57.309591] [INFO ] [MAIN ] Derivative Progress: 1519/2073 symbols completed. RACE took 1.3s. Estimated remaining: 3m 46s. Rate: 147.2 symbols/min [2025-10-03T22:43:57.310707] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-03T22:43:57.313867] [INFO ] [MAIN ] Derivative Progress: 1520/2073 symbols completed. RBA took 1.2s. Estimated remaining: 3m 45s. Rate: 147.3 symbols/min [2025-10-03T22:43:57.310865] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-03T22:43:57.310979] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:57.314029] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:57.316849] [INFO ] [MAIN ] Derivative Progress: 1521/2073 symbols completed. RAMP took 1.3s. Estimated remaining: 3m 45s. Rate: 147.4 symbols/min [2025-10-03T22:43:57.317368] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:57.329181] [DEBUG] [LOCAL ] RBOT: Loaded 5519 existing records from primary storage. [2025-10-03T22:43:57.329507] [INFO ] [MAIN ] RBOT: Loaded 5519 primary data records. [2025-10-03T22:43:57.422065] [DEBUG] [LOCAL ] RBC: Loaded 15487 existing records from primary storage. [2025-10-03T22:43:57.444370] [INFO ] [MAIN ] RBC: Loaded 15487 primary data records. [2025-10-03T22:43:57.841263] [DEBUG] [LOCAL ] RBRK: Loaded 53907 existing records from primary storage. [2025-10-03T22:43:57.865972] [INFO ] [MAIN ] RBRK: Loaded 53907 primary data records. [2025-10-03T22:43:58.319417] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:58.320980] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 5519 primary records. [2025-10-03T22:43:58.321361] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-03T22:43:58.357023] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:58.359497] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15487 primary records. [2025-10-03T22:43:58.360242] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-03T22:43:58.373826] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-10-03T22:43:58.377582] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-03T22:43:58.381420] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-10-03T22:43:58.384089] [INFO ] [MAIN ] Derivative Progress: 1522/2073 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 45s. Rate: 147.2 symbols/min [2025-10-03T22:43:58.384406] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:58.384719] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-03T22:43:58.389289] [INFO ] [MAIN ] Derivative Progress: 1523/2073 symbols completed. RBC took 1.1s. Estimated remaining: 3m 44s. Rate: 147.3 symbols/min [2025-10-03T22:43:58.391597] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:58.407542] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:58.408311] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53907 primary records. [2025-10-03T22:43:58.408484] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-03T22:43:58.426751] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-10-03T22:43:58.426828] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-03T22:43:58.429916] [INFO ] [MAIN ] Derivative Progress: 1524/2073 symbols completed. RBRK took 1.1s. Estimated remaining: 3m 43s. Rate: 147.4 symbols/min [2025-10-03T22:43:58.430138] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:58.475234] [DEBUG] [LOCAL ] RC: Loaded 49655 existing records from primary storage. [2025-10-03T22:43:58.479911] [INFO ] [MAIN ] RC: Loaded 49655 primary data records. [2025-10-03T22:43:58.480736] [DEBUG] [LOCAL ] RCS: Loaded 11877 existing records from primary storage. [2025-10-03T22:43:58.480985] [INFO ] [MAIN ] RCS: Loaded 11877 primary data records. [2025-10-03T22:43:58.602437] [DEBUG] [LOCAL ] RCI: Loaded 49304 existing records from primary storage. [2025-10-03T22:43:58.630758] [INFO ] [MAIN ] RCI: Loaded 49304 primary data records. [2025-10-03T22:43:59.541503] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:59.542781] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49655 primary records. [2025-10-03T22:43:59.543198] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-03T22:43:59.575361] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:59.579538] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 11877 primary records. [2025-10-03T22:43:59.581302] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-03T22:43:59.603736] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-10-03T22:43:59.608689] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:43:59.608788] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-03T22:43:59.614745] [INFO ] [MAIN ] Derivative Progress: 1525/2073 symbols completed. RC took 1.2s. Estimated remaining: 3m 43s. Rate: 147.2 symbols/min [2025-10-03T22:43:59.617574] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49304 primary records. [2025-10-03T22:43:59.615913] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:59.620085] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-03T22:43:59.619855] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-10-03T22:43:59.620506] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-03T22:43:59.626347] [INFO ] [MAIN ] Derivative Progress: 1526/2073 symbols completed. RCS took 1.2s. Estimated remaining: 3m 43s. Rate: 147.3 symbols/min [2025-10-03T22:43:59.638496] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:59.643810] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-10-03T22:43:59.644004] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-03T22:43:59.647713] [INFO ] [MAIN ] Derivative Progress: 1527/2073 symbols completed. RCI took 1.3s. Estimated remaining: 3m 42s. Rate: 147.4 symbols/min [2025-10-03T22:43:59.648181] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:43:59.712591] [DEBUG] [LOCAL ] RCUS: Loaded 43030 existing records from primary storage. [2025-10-03T22:43:59.712987] [INFO ] [MAIN ] RCUS: Loaded 43030 primary data records. [2025-10-03T22:43:59.875316] [DEBUG] [LOCAL ] RDN: Loaded 45683 existing records from primary storage. [2025-10-03T22:43:59.905619] [INFO ] [MAIN ] RDN: Loaded 45683 primary data records. [2025-10-03T22:43:59.956195] [DEBUG] [LOCAL ] RDW: Loaded 52824 existing records from primary storage. [2025-10-03T22:44:00.140542] [INFO ] [MAIN ] RDW: Loaded 52824 primary data records. [2025-10-03T22:44:00.722068] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:00.723099] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43030 primary records. [2025-10-03T22:44:00.723260] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-03T22:44:00.744099] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-10-03T22:44:00.744464] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-03T22:44:00.746424] [INFO ] [MAIN ] Derivative Progress: 1528/2073 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 42s. Rate: 147.2 symbols/min [2025-10-03T22:44:00.760712] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:00.761469] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45683 primary records. [2025-10-03T22:44:00.761615] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-03T22:44:00.792263] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-10-03T22:44:00.792357] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-03T22:44:00.791997] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:00.793084] [INFO ] [MAIN ] RDW: Generated 1820 derivative records from 52824 primary records. [2025-10-03T22:44:00.795998] [INFO ] [MAIN ] Derivative Progress: 1529/2073 symbols completed. RDN took 1.2s. Estimated remaining: 3m 42s. Rate: 147.3 symbols/min [2025-10-03T22:44:00.796110] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-03T22:44:00.812374] [DEBUG] [LOCAL ] RDW: Derivative data saved (1820 records). [2025-10-03T22:44:00.812445] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-03T22:44:00.815502] [INFO ] [MAIN ] Derivative Progress: 1530/2073 symbols completed. RDW took 1.2s. Estimated remaining: 3m 41s. Rate: 147.4 symbols/min [2025-10-03T22:44:00.816094] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:00.816166] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:00.816617] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:00.881911] [DEBUG] [LOCAL ] RERE: Loaded 41747 existing records from primary storage. [2025-10-03T22:44:00.882180] [INFO ] [MAIN ] RERE: Loaded 41747 primary data records. [2025-10-03T22:44:01.008994] [DEBUG] [LOCAL ] RDY: Loaded 47521 existing records from primary storage. [2025-10-03T22:44:01.017451] [INFO ] [MAIN ] RDY: Loaded 47521 primary data records. [2025-10-03T22:44:01.060409] [DEBUG] [LOCAL ] RELX: Loaded 48642 existing records from primary storage. [2025-10-03T22:44:01.105847] [INFO ] [MAIN ] RELX: Loaded 48642 primary data records. [2025-10-03T22:44:01.921505] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:01.922449] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41747 primary records. [2025-10-03T22:44:01.922632] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-03T22:44:01.952620] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:01.954231] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47521 primary records. [2025-10-03T22:44:01.954551] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-03T22:44:01.971317] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-10-03T22:44:01.971679] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-03T22:44:01.974722] [INFO ] [MAIN ] Derivative Progress: 1531/2073 symbols completed. RERE took 1.2s. Estimated remaining: 3m 41s. Rate: 147.2 symbols/min [2025-10-03T22:44:01.975012] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:01.990905] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:01.991918] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 48642 primary records. [2025-10-03T22:44:01.992107] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-03T22:44:02.007025] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-10-03T22:44:02.007421] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-03T22:44:02.010902] [INFO ] [MAIN ] Derivative Progress: 1532/2073 symbols completed. RDY took 1.2s. Estimated remaining: 3m 40s. Rate: 147.3 symbols/min [2025-10-03T22:44:02.011315] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:02.016777] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-10-03T22:44:02.016918] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-03T22:44:02.020505] [INFO ] [MAIN ] Derivative Progress: 1533/2073 symbols completed. RELX took 1.2s. Estimated remaining: 3m 40s. Rate: 147.4 symbols/min [2025-10-03T22:44:02.020774] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:02.059183] [DEBUG] [LOCAL ] REX: Loaded 14424 existing records from primary storage. [2025-10-03T22:44:02.059364] [INFO ] [MAIN ] REX: Loaded 14424 primary data records. [2025-10-03T22:44:02.196208] [DEBUG] [LOCAL ] RES: Loaded 48031 existing records from primary storage. [2025-10-03T22:44:02.229481] [INFO ] [MAIN ] RES: Loaded 48031 primary data records. [2025-10-03T22:44:02.309946] [DEBUG] [LOCAL ] REVG: Loaded 41293 existing records from primary storage. [2025-10-03T22:44:02.461844] [INFO ] [MAIN ] REVG: Loaded 41293 primary data records. [2025-10-03T22:44:03.095597] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:03.097587] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14424 primary records. [2025-10-03T22:44:03.097944] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-03T22:44:03.125561] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-10-03T22:44:03.125954] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-03T22:44:03.128988] [INFO ] [MAIN ] Derivative Progress: 1534/2073 symbols completed. REX took 1.1s. Estimated remaining: 3m 40s. Rate: 147.2 symbols/min [2025-10-03T22:44:03.129287] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:03.157170] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:03.158280] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 41293 primary records. [2025-10-03T22:44:03.158491] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:03.159493] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 48031 primary records. [2025-10-03T22:44:03.158781] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-03T22:44:03.159603] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-03T22:44:03.191761] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-10-03T22:44:03.192249] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-03T22:44:03.195573] [INFO ] [MAIN ] Derivative Progress: 1535/2073 symbols completed. REVG took 1.2s. Estimated remaining: 3m 39s. Rate: 147.3 symbols/min [2025-10-03T22:44:03.196067] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:03.198632] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-10-03T22:44:03.198725] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-03T22:44:03.201610] [INFO ] [MAIN ] Derivative Progress: 1536/2073 symbols completed. RES took 1.2s. Estimated remaining: 3m 39s. Rate: 147.4 symbols/min [2025-10-03T22:44:03.201944] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:03.245551] [DEBUG] [LOCAL ] REXR: Loaded 52834 existing records from primary storage. [2025-10-03T22:44:03.257862] [INFO ] [MAIN ] REXR: Loaded 52834 primary data records. [2025-10-03T22:44:03.395209] [DEBUG] [LOCAL ] REZI: Loaded 47649 existing records from primary storage. [2025-10-03T22:44:03.401323] [INFO ] [MAIN ] REZI: Loaded 47649 primary data records. [2025-10-03T22:44:03.591578] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-10-03T22:44:03.775512] [INFO ] [MAIN ] RF: Loaded 54410 primary data records. [2025-10-03T22:44:04.322400] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:04.323824] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52834 primary records. [2025-10-03T22:44:04.324344] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-03T22:44:04.359925] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:04.360801] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-10-03T22:44:04.361935] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47649 primary records. [2025-10-03T22:44:04.361067] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-03T22:44:04.362057] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-03T22:44:04.364340] [INFO ] [MAIN ] Derivative Progress: 1537/2073 symbols completed. REXR took 1.2s. Estimated remaining: 3m 38s. Rate: 147.2 symbols/min [2025-10-03T22:44:04.365164] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:04.385768] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-10-03T22:44:04.398959] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-03T22:44:04.405089] [INFO ] [MAIN ] Derivative Progress: 1538/2073 symbols completed. REZI took 1.2s. Estimated remaining: 3m 38s. Rate: 147.3 symbols/min [2025-10-03T22:44:04.405397] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:04.406394] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:04.407282] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54410 primary records. [2025-10-03T22:44:04.407547] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-03T22:44:04.414101] [DEBUG] [LOCAL ] RFI: Loaded 10606 existing records from primary storage. [2025-10-03T22:44:04.423067] [INFO ] [MAIN ] RFI: Loaded 10606 primary data records. [2025-10-03T22:44:04.496368] [DEBUG] [LOCAL ] RFL: Loaded 11269 existing records from primary storage. [2025-10-03T22:44:04.502290] [INFO ] [MAIN ] RFL: Loaded 11269 primary data records. [2025-10-03T22:44:04.626994] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-10-03T22:44:04.674536] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-03T22:44:04.678681] [INFO ] [MAIN ] Derivative Progress: 1539/2073 symbols completed. RF took 1.5s. Estimated remaining: 3m 37s. Rate: 147.4 symbols/min [2025-10-03T22:44:04.684523] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:04.887902] [DEBUG] [LOCAL ] RFM: Loaded 4209 existing records from primary storage. [2025-10-03T22:44:05.037710] [INFO ] [MAIN ] RFM: Loaded 4209 primary data records. [2025-10-03T22:44:05.542666] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:05.556502] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11269 primary records. [2025-10-03T22:44:05.556930] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-03T22:44:05.556873] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:05.566498] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10606 primary records. [2025-10-03T22:44:05.566829] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-03T22:44:05.589992] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-10-03T22:44:05.591277] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-03T22:44:05.593815] [INFO ] [MAIN ] Derivative Progress: 1540/2073 symbols completed. RFI took 1.2s. Estimated remaining: 3m 37s. Rate: 147.2 symbols/min [2025-10-03T22:44:05.594212] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:05.595797] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-10-03T22:44:05.596169] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-03T22:44:05.599559] [INFO ] [MAIN ] Derivative Progress: 1541/2073 symbols completed. RFL took 1.2s. Estimated remaining: 3m 37s. Rate: 147.3 symbols/min [2025-10-03T22:44:05.602354] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:05.618861] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:05.619865] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4209 primary records. [2025-10-03T22:44:05.620021] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-03T22:44:05.625445] [DEBUG] [LOCAL ] RFMZ: Loaded 8851 existing records from primary storage. [2025-10-03T22:44:05.625868] [INFO ] [MAIN ] RFMZ: Loaded 8851 primary data records. [2025-10-03T22:44:05.769542] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-10-03T22:44:05.821271] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-03T22:44:05.842465] [INFO ] [MAIN ] Derivative Progress: 1542/2073 symbols completed. RFM took 1.2s. Estimated remaining: 3m 36s. Rate: 147.4 symbols/min [2025-10-03T22:44:05.846281] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:05.847769] [DEBUG] [LOCAL ] RGA: Loaded 30097 existing records from primary storage. [2025-10-03T22:44:05.965283] [INFO ] [MAIN ] RGA: Loaded 30097 primary data records. [2025-10-03T22:44:06.106532] [DEBUG] [LOCAL ] RGR: Loaded 20929 existing records from primary storage. [2025-10-03T22:44:06.119002] [INFO ] [MAIN ] RGR: Loaded 20929 primary data records. [2025-10-03T22:44:06.647735] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:44:06.650269] [INFO ] [MAIN ] RFMZ: Generated 1819 derivative records from 8851 primary records. [2025-10-03T22:44:06.650491] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-03T22:44:06.670138] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1819 records). [2025-10-03T22:44:06.670461] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-03T22:44:06.673514] [INFO ] [MAIN ] Derivative Progress: 1543/2073 symbols completed. RFMZ took 1.1s. Estimated remaining: 3m 36s. Rate: 147.3 symbols/min [2025-10-03T22:44:06.698416] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:06.699618] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 30097 primary records. [2025-10-03T22:44:06.699922] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-03T22:44:06.735002] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-10-03T22:44:06.735116] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-03T22:44:06.737930] [INFO ] [MAIN ] Derivative Progress: 1544/2073 symbols completed. RGA took 1.1s. Estimated remaining: 3m 35s. Rate: 147.4 symbols/min [2025-10-03T22:44:06.734561] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:06.738878] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 20929 primary records. [2025-10-03T22:44:06.738956] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-03T22:44:06.755729] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-10-03T22:44:06.755800] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-03T22:44:06.759677] [INFO ] [MAIN ] Derivative Progress: 1545/2073 symbols completed. RGR took 0.9s. Estimated remaining: 3m 35s. Rate: 147.4 symbols/min [2025-10-03T22:44:06.760192] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:06.760388] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:06.760501] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:06.767684] [DEBUG] [LOCAL ] RGT: Loaded 2794 existing records from primary storage. [2025-10-03T22:44:06.768015] [INFO ] [MAIN ] RGT: Loaded 2794 primary data records. [2025-10-03T22:44:07.213795] [DEBUG] [LOCAL ] RHI: Loaded 49999 existing records from primary storage. [2025-10-03T22:44:07.214724] [DEBUG] [LOCAL ] RH: Loaded 48202 existing records from primary storage. [2025-10-03T22:44:07.215873] [INFO ] [MAIN ] RHI: Loaded 49999 primary data records. [2025-10-03T22:44:07.216568] [INFO ] [MAIN ] RH: Loaded 48202 primary data records. [2025-10-03T22:44:07.888023] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:07.889159] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2794 primary records. [2025-10-03T22:44:07.889835] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-03T22:44:07.908337] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-10-03T22:44:07.908539] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-03T22:44:07.911370] [INFO ] [MAIN ] Derivative Progress: 1546/2073 symbols completed. RGT took 1.2s. Estimated remaining: 3m 35s. Rate: 147.3 symbols/min [2025-10-03T22:44:07.912747] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:07.931114] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:07.932102] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 48202 primary records. [2025-10-03T22:44:07.932278] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-03T22:44:07.963689] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:07.964786] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 49999 primary records. [2025-10-03T22:44:07.964927] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-03T22:44:07.977961] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-10-03T22:44:07.978457] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-03T22:44:07.981280] [INFO ] [MAIN ] Derivative Progress: 1547/2073 symbols completed. RH took 1.2s. Estimated remaining: 3m 34s. Rate: 147.4 symbols/min [2025-10-03T22:44:07.982396] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:07.995860] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-10-03T22:44:07.995944] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-03T22:44:07.998768] [INFO ] [MAIN ] Derivative Progress: 1548/2073 symbols completed. RHI took 1.2s. Estimated remaining: 3m 34s. Rate: 147.4 symbols/min [2025-10-03T22:44:07.998977] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:08.013136] [DEBUG] [LOCAL ] RHP: Loaded 41824 existing records from primary storage. [2025-10-03T22:44:08.013305] [INFO ] [MAIN ] RHP: Loaded 41824 primary data records. [2025-10-03T22:44:08.371153] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-10-03T22:44:08.385024] [INFO ] [MAIN ] RIG: Loaded 54450 primary data records. [2025-10-03T22:44:08.413538] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-10-03T22:44:08.421180] [INFO ] [MAIN ] RIO: Loaded 54173 primary data records. [2025-10-03T22:44:09.056919] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:09.058305] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 41824 primary records. [2025-10-03T22:44:09.058986] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-03T22:44:09.084205] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-10-03T22:44:09.084719] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-03T22:44:09.088484] [INFO ] [MAIN ] Derivative Progress: 1549/2073 symbols completed. RHP took 1.2s. Estimated remaining: 3m 33s. Rate: 147.3 symbols/min [2025-10-03T22:44:09.088850] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:09.102823] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:09.103858] [INFO ] [MAIN ] RIO: Generated 1820 derivative records from 54173 primary records. [2025-10-03T22:44:09.104077] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-03T22:44:09.137845] [DEBUG] [LOCAL ] RIO: Derivative data saved (1820 records). [2025-10-03T22:44:09.137991] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-03T22:44:09.141218] [INFO ] [MAIN ] Derivative Progress: 1550/2073 symbols completed. RIO took 1.1s. Estimated remaining: 3m 33s. Rate: 147.4 symbols/min [2025-10-03T22:44:09.141818] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:09.142169] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:09.143239] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54450 primary records. [2025-10-03T22:44:09.143585] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-03T22:44:09.180537] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-10-03T22:44:09.180821] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-03T22:44:09.183685] [INFO ] [MAIN ] Derivative Progress: 1551/2073 symbols completed. RIG took 1.2s. Estimated remaining: 3m 32s. Rate: 147.5 symbols/min [2025-10-03T22:44:09.183982] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:09.190926] [DEBUG] [LOCAL ] RIV: Loaded 12542 existing records from primary storage. [2025-10-03T22:44:09.191104] [INFO ] [MAIN ] RIV: Loaded 12542 primary data records. [2025-10-03T22:44:09.313909] [DEBUG] [LOCAL ] RITM: Loaded 53610 existing records from primary storage. [2025-10-03T22:44:09.325048] [INFO ] [MAIN ] RITM: Loaded 53610 primary data records. [2025-10-03T22:44:09.961747] [DEBUG] [LOCAL ] RJF: Loaded 47609 existing records from primary storage. [2025-10-03T22:44:09.963179] [INFO ] [MAIN ] RJF: Loaded 47609 primary data records. [2025-10-03T22:44:10.296174] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:10.298839] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 12542 primary records. [2025-10-03T22:44:10.299879] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-03T22:44:10.335677] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:10.338531] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53610 primary records. [2025-10-03T22:44:10.339000] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-03T22:44:10.343568] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-10-03T22:44:10.357223] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-03T22:44:10.360708] [INFO ] [MAIN ] Derivative Progress: 1552/2073 symbols completed. RIV took 1.2s. Estimated remaining: 3m 32s. Rate: 147.3 symbols/min [2025-10-03T22:44:10.361774] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:10.369484] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-10-03T22:44:10.369753] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-03T22:44:10.372882] [INFO ] [MAIN ] Derivative Progress: 1553/2073 symbols completed. RITM took 1.3s. Estimated remaining: 3m 32s. Rate: 147.4 symbols/min [2025-10-03T22:44:10.373351] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:10.388010] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:10.389419] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47609 primary records. [2025-10-03T22:44:10.389514] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-03T22:44:10.408623] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-10-03T22:44:10.408838] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-03T22:44:10.411805] [INFO ] [MAIN ] Derivative Progress: 1554/2073 symbols completed. RJF took 1.2s. Estimated remaining: 3m 31s. Rate: 147.5 symbols/min [2025-10-03T22:44:10.412167] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:10.485972] [DEBUG] [LOCAL ] RL: Loaded 41526 existing records from primary storage. [2025-10-03T22:44:10.501191] [INFO ] [MAIN ] RL: Loaded 41526 primary data records. [2025-10-03T22:44:10.534350] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-10-03T22:44:10.547241] [INFO ] [MAIN ] RKT: Loaded 54501 primary data records. [2025-10-03T22:44:10.671687] [DEBUG] [LOCAL ] RLI: Loaded 34136 existing records from primary storage. [2025-10-03T22:44:10.697210] [INFO ] [MAIN ] RLI: Loaded 34136 primary data records. [2025-10-03T22:44:11.485447] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:11.488255] [INFO ] [MAIN ] RL: Generated 1820 derivative records from 41526 primary records. [2025-10-03T22:44:11.488356] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-03T22:44:11.517737] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:11.520135] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54501 primary records. [2025-10-03T22:44:11.528024] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-03T22:44:11.536349] [DEBUG] [LOCAL ] RL: Derivative data saved (1820 records). [2025-10-03T22:44:11.536786] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-03T22:44:11.536274] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:11.540233] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 34136 primary records. [2025-10-03T22:44:11.539397] [INFO ] [MAIN ] Derivative Progress: 1555/2073 symbols completed. RL took 1.2s. Estimated remaining: 3m 31s. Rate: 147.3 symbols/min [2025-10-03T22:44:11.547678] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-03T22:44:11.547856] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:11.571777] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-10-03T22:44:11.572132] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-03T22:44:11.575192] [INFO ] [MAIN ] Derivative Progress: 1556/2073 symbols completed. RLI took 1.2s. Estimated remaining: 3m 30s. Rate: 147.4 symbols/min [2025-10-03T22:44:11.577006] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-10-03T22:44:11.577144] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:11.577399] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-03T22:44:11.580471] [INFO ] [MAIN ] Derivative Progress: 1557/2073 symbols completed. RKT took 1.2s. Estimated remaining: 3m 30s. Rate: 147.5 symbols/min [2025-10-03T22:44:11.580761] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:11.609769] [DEBUG] [LOCAL ] RLTY: Loaded 11318 existing records from primary storage. [2025-10-03T22:44:11.609991] [INFO ] [MAIN ] RLTY: Loaded 11318 primary data records. [2025-10-03T22:44:11.731609] [DEBUG] [LOCAL ] RLJ: Loaded 48812 existing records from primary storage. [2025-10-03T22:44:11.752674] [INFO ] [MAIN ] RLJ: Loaded 48812 primary data records. [2025-10-03T22:44:12.106157] [DEBUG] [LOCAL ] RLX: Loaded 48956 existing records from primary storage. [2025-10-03T22:44:12.106452] [INFO ] [MAIN ] RLX: Loaded 48956 primary data records. [2025-10-03T22:44:12.662501] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:12.664403] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11318 primary records. [2025-10-03T22:44:12.666332] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-03T22:44:12.694593] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:12.696888] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 48812 primary records. [2025-10-03T22:44:12.696994] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-03T22:44:12.714366] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-10-03T22:44:12.715823] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-03T22:44:12.718517] [INFO ] [MAIN ] Derivative Progress: 1558/2073 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 30s. Rate: 147.3 symbols/min [2025-10-03T22:44:12.737590] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-10-03T22:44:12.737467] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:12.738569] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48956 primary records. [2025-10-03T22:44:12.738689] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-03T22:44:12.738802] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-03T22:44:12.741853] [INFO ] [MAIN ] Derivative Progress: 1559/2073 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 29s. Rate: 147.4 symbols/min [2025-10-03T22:44:12.758270] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-10-03T22:44:12.758338] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-03T22:44:12.761251] [INFO ] [MAIN ] Derivative Progress: 1560/2073 symbols completed. RLX took 1.2s. Estimated remaining: 3m 29s. Rate: 147.5 symbols/min [2025-10-03T22:44:12.761742] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:12.761910] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:12.763030] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:12.770785] [DEBUG] [LOCAL ] RMI: Loaded 4750 existing records from primary storage. [2025-10-03T22:44:12.771012] [INFO ] [MAIN ] RMI: Loaded 4750 primary data records. [2025-10-03T22:44:12.860252] [DEBUG] [LOCAL ] RM: Loaded 7730 existing records from primary storage. [2025-10-03T22:44:12.871415] [INFO ] [MAIN ] RM: Loaded 7730 primary data records. [2025-10-03T22:44:13.266222] [DEBUG] [LOCAL ] RMD: Loaded 42565 existing records from primary storage. [2025-10-03T22:44:13.415736] [INFO ] [MAIN ] RMD: Loaded 42565 primary data records. [2025-10-03T22:44:13.821065] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:13.824589] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4750 primary records. [2025-10-03T22:44:13.825452] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-03T22:44:13.847551] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:13.852604] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7730 primary records. [2025-10-03T22:44:13.855184] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-03T22:44:13.871143] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-10-03T22:44:13.871306] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-03T22:44:13.874570] [INFO ] [MAIN ] Derivative Progress: 1561/2073 symbols completed. RMI took 1.1s. Estimated remaining: 3m 29s. Rate: 147.3 symbols/min [2025-10-03T22:44:13.876406] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:13.881486] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-10-03T22:44:13.883250] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-03T22:44:13.886534] [INFO ] [MAIN ] Derivative Progress: 1562/2073 symbols completed. RM took 1.1s. Estimated remaining: 3m 28s. Rate: 147.4 symbols/min [2025-10-03T22:44:13.886788] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:13.903827] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:13.904580] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 42565 primary records. [2025-10-03T22:44:13.904723] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-03T22:44:13.910522] [DEBUG] [LOCAL ] RMM: Loaded 10691 existing records from primary storage. [2025-10-03T22:44:13.918337] [INFO ] [MAIN ] RMM: Loaded 10691 primary data records. [2025-10-03T22:44:13.973368] [DEBUG] [LOCAL ] RMMZ: Loaded 4894 existing records from primary storage. [2025-10-03T22:44:13.998192] [INFO ] [MAIN ] RMMZ: Loaded 4894 primary data records. [2025-10-03T22:44:14.090952] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-10-03T22:44:14.102002] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-03T22:44:14.136631] [INFO ] [MAIN ] Derivative Progress: 1563/2073 symbols completed. RMD took 1.4s. Estimated remaining: 3m 28s. Rate: 147.4 symbols/min [2025-10-03T22:44:14.157526] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:14.622673] [DEBUG] [LOCAL ] RMT: Loaded 17594 existing records from primary storage. [2025-10-03T22:44:14.623050] [INFO ] [MAIN ] RMT: Loaded 17594 primary data records. [2025-10-03T22:44:14.992431] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:14.992930] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-03T22:44:14.995512] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10691 primary records. [2025-10-03T22:44:14.994075] [INFO ] [MAIN ] RMMZ: Generated 1817 derivative records from 4894 primary records. [2025-10-03T22:44:14.995773] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-03T22:44:14.998842] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-03T22:44:15.025895] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-10-03T22:44:15.029235] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-03T22:44:15.032571] [INFO ] [MAIN ] Derivative Progress: 1564/2073 symbols completed. RMM took 1.2s. Estimated remaining: 3m 27s. Rate: 147.3 symbols/min [2025-10-03T22:44:15.033544] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:15.037991] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1817 records). [2025-10-03T22:44:15.038337] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-03T22:44:15.041197] [INFO ] [MAIN ] Derivative Progress: 1565/2073 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 27s. Rate: 147.4 symbols/min [2025-10-03T22:44:15.042884] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:15.059030] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:15.059903] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17594 primary records. [2025-10-03T22:44:15.060058] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-03T22:44:15.077465] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-10-03T22:44:15.077544] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-03T22:44:15.080724] [INFO ] [MAIN ] Derivative Progress: 1566/2073 symbols completed. RMT took 0.9s. Estimated remaining: 3m 26s. Rate: 147.5 symbols/min [2025-10-03T22:44:15.081031] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:15.107896] [DEBUG] [LOCAL ] RNGR: Loaded 20656 existing records from primary storage. [2025-10-03T22:44:15.108124] [INFO ] [MAIN ] RNGR: Loaded 20656 primary data records. [2025-10-03T22:44:15.216695] [DEBUG] [LOCAL ] RNP: Loaded 16151 existing records from primary storage. [2025-10-03T22:44:15.222073] [INFO ] [MAIN ] RNP: Loaded 16151 primary data records. [2025-10-03T22:44:15.265116] [DEBUG] [LOCAL ] RNG: Loaded 48745 existing records from primary storage. [2025-10-03T22:44:15.275685] [INFO ] [MAIN ] RNG: Loaded 48745 primary data records. [2025-10-03T22:44:16.211533] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:16.212953] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 20656 primary records. [2025-10-03T22:44:16.213579] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-03T22:44:16.251121] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:16.267324] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 16151 primary records. [2025-10-03T22:44:16.268441] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-03T22:44:16.268328] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:16.270546] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-10-03T22:44:16.270738] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-03T22:44:16.271876] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48745 primary records. [2025-10-03T22:44:16.274868] [INFO ] [MAIN ] Derivative Progress: 1567/2073 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 26s. Rate: 147.3 symbols/min [2025-10-03T22:44:16.272037] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-03T22:44:16.283513] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:16.312569] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-10-03T22:44:16.313180] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-10-03T22:44:16.313457] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-03T22:44:16.313693] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-03T22:44:16.316870] [INFO ] [MAIN ] Derivative Progress: 1568/2073 symbols completed. RNP took 1.2s. Estimated remaining: 3m 26s. Rate: 147.4 symbols/min [2025-10-03T22:44:16.317051] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:16.323236] [INFO ] [MAIN ] Derivative Progress: 1569/2073 symbols completed. RNG took 1.3s. Estimated remaining: 3m 25s. Rate: 147.5 symbols/min [2025-10-03T22:44:16.324009] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:16.359932] [DEBUG] [LOCAL ] RNR: Loaded 34345 existing records from primary storage. [2025-10-03T22:44:16.360295] [INFO ] [MAIN ] RNR: Loaded 34345 primary data records. [2025-10-03T22:44:16.494119] [DEBUG] [LOCAL ] ROG: Loaded 23154 existing records from primary storage. [2025-10-03T22:44:16.498671] [INFO ] [MAIN ] ROG: Loaded 23154 primary data records. [2025-10-03T22:44:16.792222] [DEBUG] [LOCAL ] RNST: Loaded 37572 existing records from primary storage. [2025-10-03T22:44:16.818638] [INFO ] [MAIN ] RNST: Loaded 37572 primary data records. [2025-10-03T22:44:17.428168] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:17.429316] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 34345 primary records. [2025-10-03T22:44:17.437987] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-03T22:44:17.447057] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:17.460210] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 23154 primary records. [2025-10-03T22:44:17.461022] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-03T22:44:17.481727] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-10-03T22:44:17.484577] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-10-03T22:44:17.485068] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-03T22:44:17.485427] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-03T22:44:17.489041] [INFO ] [MAIN ] Derivative Progress: 1570/2073 symbols completed. ROG took 1.2s. Estimated remaining: 3m 25s. Rate: 147.3 symbols/min [2025-10-03T22:44:17.492316] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:17.494093] [INFO ] [MAIN ] Derivative Progress: 1571/2073 symbols completed. RNR took 1.2s. Estimated remaining: 3m 24s. Rate: 147.4 symbols/min [2025-10-03T22:44:17.495401] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:17.511131] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:17.511992] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 37572 primary records. [2025-10-03T22:44:17.512226] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-03T22:44:17.530161] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-10-03T22:44:17.530336] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-03T22:44:17.533614] [INFO ] [MAIN ] Derivative Progress: 1572/2073 symbols completed. RNST took 1.2s. Estimated remaining: 3m 24s. Rate: 147.5 symbols/min [2025-10-03T22:44:17.534009] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:17.583485] [DEBUG] [LOCAL ] ROK: Loaded 44301 existing records from primary storage. [2025-10-03T22:44:17.583834] [INFO ] [MAIN ] ROK: Loaded 44301 primary data records. [2025-10-03T22:44:17.727880] [DEBUG] [LOCAL ] RPM: Loaded 42177 existing records from primary storage. [2025-10-03T22:44:17.726556] [DEBUG] [LOCAL ] ROL: Loaded 51042 existing records from primary storage. [2025-10-03T22:44:17.728223] [INFO ] [MAIN ] RPM: Loaded 42177 primary data records. [2025-10-03T22:44:17.728353] [INFO ] [MAIN ] ROL: Loaded 51042 primary data records. [2025-10-03T22:44:18.634374] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:18.635870] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 44301 primary records. [2025-10-03T22:44:18.636261] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-03T22:44:18.658411] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-10-03T22:44:18.658826] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-03T22:44:18.675563] [INFO ] [MAIN ] Derivative Progress: 1573/2073 symbols completed. ROK took 1.2s. Estimated remaining: 3m 24s. Rate: 147.3 symbols/min [2025-10-03T22:44:18.676434] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:18.677608] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51042 primary records. [2025-10-03T22:44:18.677765] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-03T22:44:18.691835] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:18.692881] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 42177 primary records. [2025-10-03T22:44:18.700163] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-03T22:44:18.725383] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-10-03T22:44:18.725515] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-03T22:44:18.728887] [INFO ] [MAIN ] Derivative Progress: 1574/2073 symbols completed. ROL took 1.2s. Estimated remaining: 3m 23s. Rate: 147.4 symbols/min [2025-10-03T22:44:18.730092] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-10-03T22:44:18.730160] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-03T22:44:18.733069] [INFO ] [MAIN ] Derivative Progress: 1575/2073 symbols completed. RPM took 1.2s. Estimated remaining: 3m 23s. Rate: 147.5 symbols/min [2025-10-03T22:44:18.733544] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:18.733790] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:18.733600] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:18.759753] [DEBUG] [LOCAL ] RPT: Loaded 19194 existing records from primary storage. [2025-10-03T22:44:18.760005] [INFO ] [MAIN ] RPT: Loaded 19194 primary data records. [2025-10-03T22:44:18.893411] [DEBUG] [LOCAL ] RQI: Loaded 29489 existing records from primary storage. [2025-10-03T22:44:18.902925] [INFO ] [MAIN ] RQI: Loaded 29489 primary data records. [2025-10-03T22:44:19.329088] [DEBUG] [LOCAL ] RRC: Loaded 53576 existing records from primary storage. [2025-10-03T22:44:19.460262] [INFO ] [MAIN ] RRC: Loaded 53576 primary data records. [2025-10-03T22:44:19.797419] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:19.798900] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19194 primary records. [2025-10-03T22:44:19.799384] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-03T22:44:19.832725] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:19.836009] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29489 primary records. [2025-10-03T22:44:19.837134] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-03T22:44:19.848778] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-10-03T22:44:19.852992] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-03T22:44:19.859584] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-10-03T22:44:19.858745] [INFO ] [MAIN ] Derivative Progress: 1576/2073 symbols completed. RPT took 1.1s. Estimated remaining: 3m 22s. Rate: 147.3 symbols/min [2025-10-03T22:44:19.860035] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:19.859801] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-03T22:44:19.866456] [INFO ] [MAIN ] Derivative Progress: 1577/2073 symbols completed. RQI took 1.1s. Estimated remaining: 3m 22s. Rate: 147.4 symbols/min [2025-10-03T22:44:19.866813] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:19.884451] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:19.885433] [INFO ] [MAIN ] RRC: Generated 1820 derivative records from 53576 primary records. [2025-10-03T22:44:19.886748] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-03T22:44:19.898777] [DEBUG] [LOCAL ] RSF: Loaded 4294 existing records from primary storage. [2025-10-03T22:44:19.903311] [INFO ] [MAIN ] RSF: Loaded 4294 primary data records. [2025-10-03T22:44:19.965893] [DEBUG] [LOCAL ] RRC: Derivative data saved (1820 records). [2025-10-03T22:44:19.980189] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-03T22:44:20.017396] [INFO ] [MAIN ] Derivative Progress: 1578/2073 symbols completed. RRC took 1.3s. Estimated remaining: 3m 21s. Rate: 147.5 symbols/min [2025-10-03T22:44:20.029956] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:20.269008] [DEBUG] [LOCAL ] RRX: Loaded 41590 existing records from primary storage. [2025-10-03T22:44:20.269631] [INFO ] [MAIN ] RRX: Loaded 41590 primary data records. [2025-10-03T22:44:20.617374] [DEBUG] [LOCAL ] RSG: Loaded 48147 existing records from primary storage. [2025-10-03T22:44:20.617977] [INFO ] [MAIN ] RSG: Loaded 48147 primary data records. [2025-10-03T22:44:20.742966] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:20.824747] [INFO ] [MAIN ] RSF: Generated 1820 derivative records from 4294 primary records. [2025-10-03T22:44:20.931149] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-03T22:44:20.968186] [DEBUG] [LOCAL ] RSF: Derivative data saved (1820 records). [2025-10-03T22:44:20.968555] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-03T22:44:20.983089] [INFO ] [MAIN ] Derivative Progress: 1579/2073 symbols completed. RSF took 1.1s. Estimated remaining: 3m 21s. Rate: 147.4 symbols/min [2025-10-03T22:44:20.984452] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:20.985358] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41590 primary records. [2025-10-03T22:44:20.984583] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:20.985937] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-03T22:44:21.005480] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-10-03T22:44:21.005770] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-03T22:44:21.008893] [INFO ] [MAIN ] Derivative Progress: 1580/2073 symbols completed. RRX took 1.1s. Estimated remaining: 3m 21s. Rate: 147.4 symbols/min [2025-10-03T22:44:21.009420] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:21.027094] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:21.028063] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48147 primary records. [2025-10-03T22:44:21.028144] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-03T22:44:21.045128] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-10-03T22:44:21.045391] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-03T22:44:21.048475] [INFO ] [MAIN ] Derivative Progress: 1581/2073 symbols completed. RSG took 1.0s. Estimated remaining: 3m 20s. Rate: 147.5 symbols/min [2025-10-03T22:44:21.059002] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:21.087695] [DEBUG] [LOCAL ] RSI: Loaded 47575 existing records from primary storage. [2025-10-03T22:44:21.088023] [INFO ] [MAIN ] RSI: Loaded 47575 primary data records. [2025-10-03T22:44:21.200825] [DEBUG] [LOCAL ] RSKD: Loaded 33954 existing records from primary storage. [2025-10-03T22:44:21.214295] [INFO ] [MAIN ] RSKD: Loaded 33954 primary data records. [2025-10-03T22:44:21.417895] [DEBUG] [LOCAL ] RTO: Loaded 40642 existing records from primary storage. [2025-10-03T22:44:21.548395] [INFO ] [MAIN ] RTO: Loaded 40642 primary data records. [2025-10-03T22:44:22.170201] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:22.172205] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47575 primary records. [2025-10-03T22:44:22.172308] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-03T22:44:22.202401] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:22.204183] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 33954 primary records. [2025-10-03T22:44:22.204945] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-03T22:44:22.215946] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-10-03T22:44:22.216270] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-03T22:44:22.218555] [INFO ] [MAIN ] Derivative Progress: 1582/2073 symbols completed. RSI took 1.2s. Estimated remaining: 3m 20s. Rate: 147.4 symbols/min [2025-10-03T22:44:22.223218] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:22.240228] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-10-03T22:44:22.245432] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-03T22:44:22.249329] [INFO ] [MAIN ] Derivative Progress: 1583/2073 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 19s. Rate: 147.4 symbols/min [2025-10-03T22:44:22.249560] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:22.249974] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:22.251238] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 40642 primary records. [2025-10-03T22:44:22.251313] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-03T22:44:22.274561] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-10-03T22:44:22.274744] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-03T22:44:22.277783] [INFO ] [MAIN ] Derivative Progress: 1584/2073 symbols completed. RTO took 1.2s. Estimated remaining: 3m 19s. Rate: 147.5 symbols/min [2025-10-03T22:44:22.278039] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:22.335636] [DEBUG] [LOCAL ] RTX: Loaded 54484 existing records from primary storage. [2025-10-03T22:44:22.335998] [INFO ] [MAIN ] RTX: Loaded 54484 primary data records. [2025-10-03T22:44:22.427938] [DEBUG] [LOCAL ] RVT: Loaded 26927 existing records from primary storage. [2025-10-03T22:44:22.460217] [INFO ] [MAIN ] RVT: Loaded 26927 primary data records. [2025-10-03T22:44:22.475726] [DEBUG] [LOCAL ] RVLV: Loaded 48281 existing records from primary storage. [2025-10-03T22:44:22.490972] [INFO ] [MAIN ] RVLV: Loaded 48281 primary data records. [2025-10-03T22:44:23.318087] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:23.319328] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54484 primary records. [2025-10-03T22:44:23.319669] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-03T22:44:23.349961] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-10-03T22:44:23.355497] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:23.355605] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-03T22:44:23.358276] [INFO ] [MAIN ] Derivative Progress: 1585/2073 symbols completed. RTX took 1.1s. Estimated remaining: 3m 19s. Rate: 147.4 symbols/min [2025-10-03T22:44:23.359184] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 26927 primary records. [2025-10-03T22:44:23.359515] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:23.359402] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-03T22:44:23.394013] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:23.394479] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-10-03T22:44:23.395563] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48281 primary records. [2025-10-03T22:44:23.394820] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-03T22:44:23.398537] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-03T22:44:23.398412] [INFO ] [MAIN ] Derivative Progress: 1586/2073 symbols completed. RVT took 1.1s. Estimated remaining: 3m 18s. Rate: 147.5 symbols/min [2025-10-03T22:44:23.398868] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:23.416494] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-10-03T22:44:23.416687] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-03T22:44:23.419894] [INFO ] [MAIN ] Derivative Progress: 1587/2073 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 18s. Rate: 147.5 symbols/min [2025-10-03T22:44:23.420191] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:23.473574] [DEBUG] [LOCAL ] RVTY: Loaded 48261 existing records from primary storage. [2025-10-03T22:44:23.473908] [INFO ] [MAIN ] RVTY: Loaded 48261 primary data records. [2025-10-03T22:44:23.623943] [DEBUG] [LOCAL ] RWT: Loaded 41431 existing records from primary storage. [2025-10-03T22:44:23.643290] [INFO ] [MAIN ] RWT: Loaded 41431 primary data records. [2025-10-03T22:44:23.686354] [DEBUG] [LOCAL ] RXO: Loaded 48570 existing records from primary storage. [2025-10-03T22:44:23.760198] [INFO ] [MAIN ] RXO: Loaded 48570 primary data records. [2025-10-03T22:44:24.525538] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:24.526531] [INFO ] [MAIN ] RVTY: Generated 1820 derivative records from 48261 primary records. [2025-10-03T22:44:24.526897] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-03T22:44:24.562077] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:24.563624] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41431 primary records. [2025-10-03T22:44:24.563886] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-03T22:44:24.563833] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1820 records). [2025-10-03T22:44:24.564107] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-03T22:44:24.566673] [INFO ] [MAIN ] Derivative Progress: 1588/2073 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 17s. Rate: 147.4 symbols/min [2025-10-03T22:44:24.586870] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:24.591083] [INFO ] [MAIN ] RXO: Generated 1820 derivative records from 48570 primary records. [2025-10-03T22:44:24.592839] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-03T22:44:24.603178] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-10-03T22:44:24.606530] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-03T22:44:24.609627] [INFO ] [MAIN ] Derivative Progress: 1589/2073 symbols completed. RWT took 1.2s. Estimated remaining: 3m 17s. Rate: 147.5 symbols/min [2025-10-03T22:44:24.613815] [DEBUG] [LOCAL ] RXO: Derivative data saved (1820 records). [2025-10-03T22:44:24.613876] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-03T22:44:24.617848] [INFO ] [MAIN ] Derivative Progress: 1590/2073 symbols completed. RXO took 1.2s. Estimated remaining: 3m 16s. Rate: 147.6 symbols/min [2025-10-03T22:44:24.618396] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:24.618473] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:24.618596] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:24.664409] [DEBUG] [LOCAL ] RYAM: Loaded 35553 existing records from primary storage. [2025-10-03T22:44:24.664739] [INFO ] [MAIN ] RYAM: Loaded 35553 primary data records. [2025-10-03T22:44:24.792319] [DEBUG] [LOCAL ] RYAN: Loaded 45175 existing records from primary storage. [2025-10-03T22:44:24.796133] [INFO ] [MAIN ] RYAN: Loaded 45175 primary data records. [2025-10-03T22:44:24.978617] [DEBUG] [LOCAL ] RY: Loaded 48550 existing records from primary storage. [2025-10-03T22:44:25.119237] [INFO ] [MAIN ] RY: Loaded 48550 primary data records. [2025-10-03T22:44:25.679274] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:25.680608] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35553 primary records. [2025-10-03T22:44:25.688337] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-03T22:44:25.702199] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:25.712223] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-10-03T22:44:25.709437] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 45175 primary records. [2025-10-03T22:44:25.713067] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-03T22:44:25.715724] [INFO ] [MAIN ] Derivative Progress: 1591/2073 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 16s. Rate: 147.4 symbols/min [2025-10-03T22:44:25.716184] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:25.716797] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-03T22:44:25.734336] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-10-03T22:44:25.734677] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-03T22:44:25.737592] [INFO ] [MAIN ] Derivative Progress: 1592/2073 symbols completed. RYAN took 1.1s. Estimated remaining: 3m 16s. Rate: 147.5 symbols/min [2025-10-03T22:44:25.737777] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:25.762215] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:25.763293] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48550 primary records. [2025-10-03T22:44:25.763535] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-03T22:44:25.786408] [DEBUG] [LOCAL ] RYI: Loaded 21847 existing records from primary storage. [2025-10-03T22:44:25.788492] [INFO ] [MAIN ] RYI: Loaded 21847 primary data records. [2025-10-03T22:44:25.829761] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-10-03T22:44:25.850962] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-03T22:44:25.904407] [INFO ] [MAIN ] Derivative Progress: 1593/2073 symbols completed. RY took 1.3s. Estimated remaining: 3m 15s. Rate: 147.5 symbols/min [2025-10-03T22:44:25.917445] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:26.161978] [DEBUG] [LOCAL ] RYN: Loaded 46225 existing records from primary storage. [2025-10-03T22:44:26.170857] [DEBUG] [LOCAL ] RZB: Loaded 6252 existing records from primary storage. [2025-10-03T22:44:26.171181] [INFO ] [MAIN ] RZB: Loaded 6252 primary data records. [2025-10-03T22:44:26.171266] [INFO ] [MAIN ] RYN: Loaded 46225 primary data records. [2025-10-03T22:44:26.866401] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:26.867896] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21847 primary records. [2025-10-03T22:44:26.868084] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-03T22:44:26.886324] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-10-03T22:44:26.886681] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-03T22:44:26.889117] [INFO ] [MAIN ] Derivative Progress: 1594/2073 symbols completed. RYI took 1.2s. Estimated remaining: 3m 15s. Rate: 147.4 symbols/min [2025-10-03T22:44:26.889835] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:26.910470] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:26.911462] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6252 primary records. [2025-10-03T22:44:26.915142] [DEBUG] [LOCAL ] RZC: Loaded 6845 existing records from primary storage. [2025-10-03T22:44:26.915279] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-03T22:44:26.916034] [INFO ] [MAIN ] RZC: Loaded 6845 primary data records. [2025-10-03T22:44:26.988832] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-10-03T22:44:26.998724] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-03T22:44:27.013546] [INFO ] [MAIN ] Derivative Progress: 1595/2073 symbols completed. RZB took 1.1s. Estimated remaining: 3m 14s. Rate: 147.5 symbols/min [2025-10-03T22:44:27.019035] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:27.061906] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:27.074297] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46225 primary records. [2025-10-03T22:44:27.095430] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-03T22:44:27.284182] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-10-03T22:44:27.284660] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-03T22:44:27.288563] [INFO ] [MAIN ] Derivative Progress: 1596/2073 symbols completed. RYN took 1.6s. Estimated remaining: 3m 14s. Rate: 147.5 symbols/min [2025-10-03T22:44:27.289024] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:27.325792] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:27.326551] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6845 primary records. [2025-10-03T22:44:27.326742] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-03T22:44:27.357199] [DEBUG] [LOCAL ] S: Loaded 54312 existing records from primary storage. [2025-10-03T22:44:27.368562] [INFO ] [MAIN ] S: Loaded 54312 primary data records. [2025-10-03T22:44:27.370782] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-10-03T22:44:27.392887] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-03T22:44:27.395286] [INFO ] [MAIN ] Derivative Progress: 1597/2073 symbols completed. RZC took 0.5s. Estimated remaining: 3m 14s. Rate: 147.6 symbols/min [2025-10-03T22:44:27.406226] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:27.498199] [DEBUG] [LOCAL ] SA: Loaded 44164 existing records from primary storage. [2025-10-03T22:44:27.498568] [INFO ] [MAIN ] SA: Loaded 44164 primary data records. [2025-10-03T22:44:27.551970] [DEBUG] [LOCAL ] SABA: Loaded 9395 existing records from primary storage. [2025-10-03T22:44:27.580522] [INFO ] [MAIN ] SABA: Loaded 9395 primary data records. [2025-10-03T22:44:28.407875] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:28.409156] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54312 primary records. [2025-10-03T22:44:28.409453] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-03T22:44:28.427399] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-10-03T22:44:28.427674] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-03T22:44:28.430159] [INFO ] [MAIN ] Derivative Progress: 1598/2073 symbols completed. S took 1.4s. Estimated remaining: 3m 13s. Rate: 147.4 symbols/min [2025-10-03T22:44:28.430517] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:28.463600] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:28.465526] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 44164 primary records. [2025-10-03T22:44:28.464624] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:28.465759] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-03T22:44:28.466456] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9395 primary records. [2025-10-03T22:44:28.466678] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-03T22:44:28.495477] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-10-03T22:44:28.504209] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-03T22:44:28.507606] [INFO ] [MAIN ] Derivative Progress: 1599/2073 symbols completed. SABA took 1.1s. Estimated remaining: 3m 13s. Rate: 147.5 symbols/min [2025-10-03T22:44:28.507968] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:28.513525] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-10-03T22:44:28.522538] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-03T22:44:28.525593] [INFO ] [MAIN ] Derivative Progress: 1600/2073 symbols completed. SA took 1.2s. Estimated remaining: 3m 12s. Rate: 147.6 symbols/min [2025-10-03T22:44:28.525874] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:28.527064] [DEBUG] [LOCAL ] SAFE: Loaded 30539 existing records from primary storage. [2025-10-03T22:44:28.527592] [INFO ] [MAIN ] SAFE: Loaded 30539 primary data records. [2025-10-03T22:44:28.645241] [DEBUG] [LOCAL ] SAH: Loaded 22154 existing records from primary storage. [2025-10-03T22:44:28.676841] [INFO ] [MAIN ] SAH: Loaded 22154 primary data records. [2025-10-03T22:44:28.893900] [DEBUG] [LOCAL ] SAM: Loaded 21716 existing records from primary storage. [2025-10-03T22:44:28.925416] [INFO ] [MAIN ] SAM: Loaded 21716 primary data records. [2025-10-03T22:44:29.522362] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:29.523592] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30539 primary records. [2025-10-03T22:44:29.523838] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-03T22:44:29.555753] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:29.557526] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 22154 primary records. [2025-10-03T22:44:29.558312] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-03T22:44:29.561074] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-10-03T22:44:29.561977] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-03T22:44:29.572774] [INFO ] [MAIN ] Derivative Progress: 1601/2073 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 12s. Rate: 147.4 symbols/min [2025-10-03T22:44:29.581896] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:29.589790] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-10-03T22:44:29.589949] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-03T22:44:29.592874] [INFO ] [MAIN ] Derivative Progress: 1602/2073 symbols completed. SAH took 1.1s. Estimated remaining: 3m 12s. Rate: 147.5 symbols/min [2025-10-03T22:44:29.597811] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:29.599268] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:29.600019] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21716 primary records. [2025-10-03T22:44:29.600082] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-03T22:44:29.621327] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-10-03T22:44:29.621593] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-03T22:44:29.624690] [INFO ] [MAIN ] Derivative Progress: 1603/2073 symbols completed. SAM took 1.1s. Estimated remaining: 3m 11s. Rate: 147.6 symbols/min [2025-10-03T22:44:29.690826] [DEBUG] [LOCAL ] SAN: Loaded 53758 existing records from primary storage. [2025-10-03T22:44:29.691034] [INFO ] [MAIN ] SAN: Loaded 53758 primary data records. [2025-10-03T22:44:29.691763] [DEBUG] [LOCAL ] SAND: Loaded 52561 existing records from primary storage. [2025-10-03T22:44:29.723572] [INFO ] [MAIN ] SAND: Loaded 52561 primary data records. [2025-10-03T22:44:30.354064] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:30.367021] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53758 primary records. [2025-10-03T22:44:30.367267] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:30.367941] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52561 primary records. [2025-10-03T22:44:30.368022] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-03T22:44:30.368093] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-03T22:44:30.397020] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-10-03T22:44:30.397639] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-03T22:44:30.400686] [INFO ] [MAIN ] Derivative Progress: 1604/2073 symbols completed. SAN took 0.8s. Estimated remaining: 3m 11s. Rate: 147.5 symbols/min [2025-10-03T22:44:30.403315] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-10-03T22:44:30.403381] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-03T22:44:30.405409] [INFO ] [MAIN ] Derivative Progress: 1605/2073 symbols completed. SAND took 0.8s. Estimated remaining: 3m 10s. Rate: 147.6 symbols/min [2025-10-03T22:44:30.405931] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:30.405846] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:30.405781] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:30.429601] [DEBUG] [LOCAL ] SAR: Loaded 16503 existing records from primary storage. [2025-10-03T22:44:30.429788] [INFO ] [MAIN ] SAR: Loaded 16503 primary data records. [2025-10-03T22:44:30.810768] [DEBUG] [LOCAL ] SARO: Loaded 49327 existing records from primary storage. [2025-10-03T22:44:30.811874] [DEBUG] [LOCAL ] SAP: Loaded 50718 existing records from primary storage. [2025-10-03T22:44:30.811955] [INFO ] [MAIN ] SARO: Loaded 49327 primary data records. [2025-10-03T22:44:30.812216] [INFO ] [MAIN ] SAP: Loaded 50718 primary data records. [2025-10-03T22:44:31.503311] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:31.505596] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 16503 primary records. [2025-10-03T22:44:31.505963] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-03T22:44:31.532536] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-10-03T22:44:31.532722] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-03T22:44:31.537332] [INFO ] [MAIN ] Derivative Progress: 1606/2073 symbols completed. SAR took 1.1s. Estimated remaining: 3m 10s. Rate: 147.5 symbols/min [2025-10-03T22:44:31.538891] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:31.576141] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:31.578109] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49327 primary records. [2025-10-03T22:44:31.578819] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-03T22:44:31.579319] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:31.581428] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50718 primary records. [2025-10-03T22:44:31.590595] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-03T22:44:31.627464] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-10-03T22:44:31.628548] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-03T22:44:31.631363] [INFO ] [MAIN ] Derivative Progress: 1607/2073 symbols completed. SARO took 1.2s. Estimated remaining: 3m 10s. Rate: 147.5 symbols/min [2025-10-03T22:44:31.631829] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:31.648913] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-10-03T22:44:31.649106] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-03T22:44:31.652315] [INFO ] [MAIN ] Derivative Progress: 1608/2073 symbols completed. SAP took 1.2s. Estimated remaining: 3m 9s. Rate: 147.6 symbols/min [2025-10-03T22:44:31.652617] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:31.654615] [DEBUG] [LOCAL ] SB: Loaded 33642 existing records from primary storage. [2025-10-03T22:44:31.654947] [INFO ] [MAIN ] SB: Loaded 33642 primary data records. [2025-10-03T22:44:31.755282] [DEBUG] [LOCAL ] SBI: Loaded 7638 existing records from primary storage. [2025-10-03T22:44:31.789245] [INFO ] [MAIN ] SBI: Loaded 7638 primary data records. [2025-10-03T22:44:32.134674] [DEBUG] [LOCAL ] SBH: Loaded 50518 existing records from primary storage. [2025-10-03T22:44:32.146550] [INFO ] [MAIN ] SBH: Loaded 50518 primary data records. [2025-10-03T22:44:32.782001] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:32.784165] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33642 primary records. [2025-10-03T22:44:32.789114] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-03T22:44:32.819820] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:32.822389] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7638 primary records. [2025-10-03T22:44:32.823096] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-03T22:44:32.844771] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-10-03T22:44:32.848470] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-03T22:44:32.851857] [INFO ] [MAIN ] Derivative Progress: 1609/2073 symbols completed. SB took 1.3s. Estimated remaining: 3m 9s. Rate: 147.4 symbols/min [2025-10-03T22:44:32.852769] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:32.853871] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-10-03T22:44:32.854272] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-03T22:44:32.858710] [INFO ] [MAIN ] Derivative Progress: 1610/2073 symbols completed. SBI took 1.2s. Estimated remaining: 3m 8s. Rate: 147.5 symbols/min [2025-10-03T22:44:32.859242] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:32.881201] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:32.882437] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50518 primary records. [2025-10-03T22:44:32.882710] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-03T22:44:32.912799] [DEBUG] [LOCAL ] SBR: Loaded 7573 existing records from primary storage. [2025-10-03T22:44:32.913765] [INFO ] [MAIN ] SBR: Loaded 7573 primary data records. [2025-10-03T22:44:32.938782] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-10-03T22:44:32.939186] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-03T22:44:32.960300] [INFO ] [MAIN ] Derivative Progress: 1611/2073 symbols completed. SBH took 1.3s. Estimated remaining: 3m 8s. Rate: 147.6 symbols/min [2025-10-03T22:44:32.989879] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:33.289598] [DEBUG] [LOCAL ] SBS: Loaded 50163 existing records from primary storage. [2025-10-03T22:44:33.291051] [DEBUG] [LOCAL ] SBSI: Loaded 15017 existing records from primary storage. [2025-10-03T22:44:33.290620] [INFO ] [MAIN ] SBS: Loaded 50163 primary data records. [2025-10-03T22:44:33.291342] [INFO ] [MAIN ] SBSI: Loaded 15017 primary data records. [2025-10-03T22:44:33.966867] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:33.968426] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7573 primary records. [2025-10-03T22:44:33.969042] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-03T22:44:33.993564] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-10-03T22:44:33.994209] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-03T22:44:33.996810] [INFO ] [MAIN ] Derivative Progress: 1612/2073 symbols completed. SBR took 1.1s. Estimated remaining: 3m 8s. Rate: 147.5 symbols/min [2025-10-03T22:44:33.999016] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:34.015506] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:34.016501] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50163 primary records. [2025-10-03T22:44:34.016629] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-03T22:44:34.049316] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:34.051041] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 15017 primary records. [2025-10-03T22:44:34.052697] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-10-03T22:44:34.051628] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-03T22:44:34.053820] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-03T22:44:34.056286] [INFO ] [MAIN ] Derivative Progress: 1613/2073 symbols completed. SBS took 1.2s. Estimated remaining: 3m 7s. Rate: 147.5 symbols/min [2025-10-03T22:44:34.056558] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:34.093126] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-10-03T22:44:34.093399] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-03T22:44:34.096629] [INFO ] [MAIN ] Derivative Progress: 1614/2073 symbols completed. SBSI took 1.1s. Estimated remaining: 3m 7s. Rate: 147.6 symbols/min [2025-10-03T22:44:34.097012] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:34.120306] [DEBUG] [LOCAL ] SBSW: Loaded 53812 existing records from primary storage. [2025-10-03T22:44:34.120784] [INFO ] [MAIN ] SBSW: Loaded 53812 primary data records. [2025-10-03T22:44:34.250061] [DEBUG] [LOCAL ] SCD: Loaded 13029 existing records from primary storage. [2025-10-03T22:44:34.276699] [INFO ] [MAIN ] SCD: Loaded 13029 primary data records. [2025-10-03T22:44:34.406940] [DEBUG] [LOCAL ] SCCO: Loaded 50173 existing records from primary storage. [2025-10-03T22:44:34.475146] [INFO ] [MAIN ] SCCO: Loaded 50173 primary data records. [2025-10-03T22:44:35.221707] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:35.223791] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53812 primary records. [2025-10-03T22:44:35.223934] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-03T22:44:35.253294] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:35.255298] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 13029 primary records. [2025-10-03T22:44:35.255848] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-03T22:44:35.271246] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-10-03T22:44:35.274171] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-03T22:44:35.277075] [INFO ] [MAIN ] Derivative Progress: 1615/2073 symbols completed. SBSW took 1.3s. Estimated remaining: 3m 6s. Rate: 147.4 symbols/min [2025-10-03T22:44:35.278121] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:35.302964] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:35.305346] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50173 primary records. [2025-10-03T22:44:35.305693] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-03T22:44:35.307008] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-10-03T22:44:35.307126] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-03T22:44:35.310244] [INFO ] [MAIN ] Derivative Progress: 1616/2073 symbols completed. SCD took 1.2s. Estimated remaining: 3m 6s. Rate: 147.5 symbols/min [2025-10-03T22:44:35.327227] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:35.336275] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-10-03T22:44:35.336506] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-03T22:44:35.340526] [INFO ] [MAIN ] Derivative Progress: 1617/2073 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 5s. Rate: 147.6 symbols/min [2025-10-03T22:44:35.340779] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:35.388193] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-03T22:44:35.388874] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-10-03T22:44:35.395779] [DEBUG] [LOCAL ] SCL: Loaded 15145 existing records from primary storage. [2025-10-03T22:44:35.411795] [INFO ] [MAIN ] SCL: Loaded 15145 primary data records. [2025-10-03T22:44:35.677196] [DEBUG] [LOCAL ] SCI: Loaded 47113 existing records from primary storage. [2025-10-03T22:44:35.688293] [INFO ] [MAIN ] SCI: Loaded 47113 primary data records. [2025-10-03T22:44:36.430678] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:36.444053] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-10-03T22:44:36.445206] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:36.446138] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15145 primary records. [2025-10-03T22:44:36.445432] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-03T22:44:36.446413] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-03T22:44:36.494760] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:36.496683] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47113 primary records. [2025-10-03T22:44:36.497617] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-03T22:44:36.498190] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-10-03T22:44:36.499567] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-03T22:44:36.502165] [INFO ] [MAIN ] Derivative Progress: 1618/2073 symbols completed. SCHW took 1.2s. Estimated remaining: 3m 5s. Rate: 147.4 symbols/min [2025-10-03T22:44:36.502596] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-10-03T22:44:36.503062] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-03T22:44:36.506040] [INFO ] [MAIN ] Derivative Progress: 1619/2073 symbols completed. SCL took 1.2s. Estimated remaining: 3m 5s. Rate: 147.5 symbols/min [2025-10-03T22:44:36.521228] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-10-03T22:44:36.521295] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-03T22:44:36.524067] [INFO ] [MAIN ] Derivative Progress: 1620/2073 symbols completed. SCI took 1.2s. Estimated remaining: 3m 4s. Rate: 147.6 symbols/min [2025-10-03T22:44:36.524530] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:36.524743] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:36.524844] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:36.582630] [DEBUG] [LOCAL ] SCM: Loaded 20092 existing records from primary storage. [2025-10-03T22:44:36.583451] [INFO ] [MAIN ] SCM: Loaded 20092 primary data records. [2025-10-03T22:44:36.583343] [DEBUG] [LOCAL ] SD: Loaded 29193 existing records from primary storage. [2025-10-03T22:44:36.583798] [INFO ] [MAIN ] SD: Loaded 29193 primary data records. [2025-10-03T22:44:36.818101] [DEBUG] [LOCAL ] SCS: Loaded 44100 existing records from primary storage. [2025-10-03T22:44:36.861422] [INFO ] [MAIN ] SCS: Loaded 44100 primary data records. [2025-10-03T22:44:37.627328] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:37.631398] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29193 primary records. [2025-10-03T22:44:37.631725] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-03T22:44:37.645702] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:37.657958] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20092 primary records. [2025-10-03T22:44:37.658086] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-03T22:44:37.694423] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-10-03T22:44:37.694633] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-03T22:44:37.695131] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:37.697909] [INFO ] [MAIN ] Derivative Progress: 1621/2073 symbols completed. SD took 1.2s. Estimated remaining: 3m 4s. Rate: 147.4 symbols/min [2025-10-03T22:44:37.689782] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-10-03T22:44:37.699063] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 44100 primary records. [2025-10-03T22:44:37.698093] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-03T22:44:37.699236] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-03T22:44:37.698221] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:37.702998] [INFO ] [MAIN ] Derivative Progress: 1622/2073 symbols completed. SCM took 1.2s. Estimated remaining: 3m 3s. Rate: 147.5 symbols/min [2025-10-03T22:44:37.703160] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:37.719260] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-10-03T22:44:37.719480] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-03T22:44:37.722467] [INFO ] [MAIN ] Derivative Progress: 1623/2073 symbols completed. SCS took 1.2s. Estimated remaining: 3m 3s. Rate: 147.6 symbols/min [2025-10-03T22:44:37.722900] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:37.739719] [DEBUG] [LOCAL ] SDHY: Loaded 10731 existing records from primary storage. [2025-10-03T22:44:37.735632] [DEBUG] [LOCAL ] SDHC: Loaded 10487 existing records from primary storage. [2025-10-03T22:44:37.740001] [INFO ] [MAIN ] SDHY: Loaded 10731 primary data records. [2025-10-03T22:44:37.739935] [INFO ] [MAIN ] SDHC: Loaded 10487 primary data records. [2025-10-03T22:44:38.371971] [DEBUG] [LOCAL ] SDRL: Loaded 42190 existing records from primary storage. [2025-10-03T22:44:38.372343] [INFO ] [MAIN ] SDRL: Loaded 42190 primary data records. [2025-10-03T22:44:38.769197] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:38.770633] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10487 primary records. [2025-10-03T22:44:38.770764] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-03T22:44:38.769595] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:38.772369] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 10731 primary records. [2025-10-03T22:44:38.772785] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-03T22:44:38.801506] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-10-03T22:44:38.803107] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-03T22:44:38.806143] [INFO ] [MAIN ] Derivative Progress: 1624/2073 symbols completed. SDHC took 1.1s. Estimated remaining: 3m 3s. Rate: 147.5 symbols/min [2025-10-03T22:44:38.806306] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:38.811769] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-10-03T22:44:38.812877] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-03T22:44:38.815401] [INFO ] [MAIN ] Derivative Progress: 1625/2073 symbols completed. SDHY took 1.1s. Estimated remaining: 3m 2s. Rate: 147.6 symbols/min [2025-10-03T22:44:38.815662] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:38.831812] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:38.832636] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42190 primary records. [2025-10-03T22:44:38.832732] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-03T22:44:38.851960] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-10-03T22:44:38.852108] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-03T22:44:38.855037] [INFO ] [MAIN ] Derivative Progress: 1626/2073 symbols completed. SDRL took 1.1s. Estimated remaining: 3m 2s. Rate: 147.6 symbols/min [2025-10-03T22:44:38.855281] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:38.898121] [DEBUG] [LOCAL ] SEG: Loaded 13766 existing records from primary storage. [2025-10-03T22:44:38.898269] [INFO ] [MAIN ] SEG: Loaded 13766 primary data records. [2025-10-03T22:44:39.035800] [DEBUG] [LOCAL ] SE: Loaded 54129 existing records from primary storage. [2025-10-03T22:44:39.039953] [INFO ] [MAIN ] SE: Loaded 54129 primary data records. [2025-10-03T22:44:39.046172] [DEBUG] [LOCAL ] SEE: Loaded 48990 existing records from primary storage. [2025-10-03T22:44:39.051532] [INFO ] [MAIN ] SEE: Loaded 48990 primary data records. [2025-10-03T22:44:39.876342] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:39.877984] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 13766 primary records. [2025-10-03T22:44:39.878202] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-03T22:44:39.898126] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-10-03T22:44:39.898381] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-03T22:44:39.900835] [INFO ] [MAIN ] Derivative Progress: 1627/2073 symbols completed. SEG took 1.0s. Estimated remaining: 3m 1s. Rate: 147.5 symbols/min [2025-10-03T22:44:39.901095] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:39.918052] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:39.919102] [INFO ] [MAIN ] SE: Generated 1820 derivative records from 54129 primary records. [2025-10-03T22:44:39.919255] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-03T22:44:39.944858] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:39.946354] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 48990 primary records. [2025-10-03T22:44:39.947580] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-03T22:44:39.953061] [DEBUG] [LOCAL ] SE: Derivative data saved (1820 records). [2025-10-03T22:44:39.964450] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-03T22:44:39.968517] [INFO ] [MAIN ] Derivative Progress: 1628/2073 symbols completed. SE took 1.2s. Estimated remaining: 3m 1s. Rate: 147.6 symbols/min [2025-10-03T22:44:39.968898] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:39.984148] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-10-03T22:44:39.984304] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-03T22:44:39.986988] [INFO ] [MAIN ] Derivative Progress: 1629/2073 symbols completed. SEE took 1.2s. Estimated remaining: 3m 0s. Rate: 147.7 symbols/min [2025-10-03T22:44:39.987303] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:40.007110] [DEBUG] [LOCAL ] SEI: Loaded 50431 existing records from primary storage. [2025-10-03T22:44:40.007697] [INFO ] [MAIN ] SEI: Loaded 50431 primary data records. [2025-10-03T22:44:40.242914] [DEBUG] [LOCAL ] SEM: Loaded 43391 existing records from primary storage. [2025-10-03T22:44:40.246636] [DEBUG] [LOCAL ] SEMR: Loaded 42290 existing records from primary storage. [2025-10-03T22:44:40.365508] [INFO ] [MAIN ] SEMR: Loaded 42290 primary data records. [2025-10-03T22:44:40.365614] [INFO ] [MAIN ] SEM: Loaded 43391 primary data records. [2025-10-03T22:44:41.194101] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:41.195352] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50431 primary records. [2025-10-03T22:44:41.195850] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-03T22:44:41.225351] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-10-03T22:44:41.225526] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-03T22:44:41.233190] [INFO ] [MAIN ] Derivative Progress: 1630/2073 symbols completed. SEI took 1.3s. Estimated remaining: 3m 0s. Rate: 147.5 symbols/min [2025-10-03T22:44:41.247306] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:41.257566] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:41.260544] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42290 primary records. [2025-10-03T22:44:41.261892] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-03T22:44:41.298427] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:41.302290] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43391 primary records. [2025-10-03T22:44:41.302965] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-03T22:44:41.308509] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-10-03T22:44:41.324896] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-03T22:44:41.331551] [INFO ] [MAIN ] Derivative Progress: 1631/2073 symbols completed. SEMR took 1.3s. Estimated remaining: 2m 60s. Rate: 147.5 symbols/min [2025-10-03T22:44:41.332467] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:41.341999] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-10-03T22:44:41.342447] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-03T22:44:41.347226] [INFO ] [MAIN ] Derivative Progress: 1632/2073 symbols completed. SEM took 1.4s. Estimated remaining: 2m 59s. Rate: 147.6 symbols/min [2025-10-03T22:44:41.347834] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:41.375579] [DEBUG] [LOCAL ] SFB: Loaded 4170 existing records from primary storage. [2025-10-03T22:44:41.376758] [INFO ] [MAIN ] SFB: Loaded 4170 primary data records. [2025-10-03T22:44:41.532912] [DEBUG] [LOCAL ] SES: Loaded 52336 existing records from primary storage. [2025-10-03T22:44:41.569629] [INFO ] [MAIN ] SES: Loaded 52336 primary data records. [2025-10-03T22:44:41.771664] [DEBUG] [LOCAL ] SF: Loaded 42143 existing records from primary storage. [2025-10-03T22:44:41.819367] [INFO ] [MAIN ] SF: Loaded 42143 primary data records. [2025-10-03T22:44:42.553494] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:42.554730] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4170 primary records. [2025-10-03T22:44:42.554941] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-03T22:44:42.574065] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-10-03T22:44:42.574274] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-03T22:44:42.584515] [INFO ] [MAIN ] Derivative Progress: 1633/2073 symbols completed. SFB took 1.2s. Estimated remaining: 2m 59s. Rate: 147.4 symbols/min [2025-10-03T22:44:42.590625] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:42.591846] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52336 primary records. [2025-10-03T22:44:42.591928] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-03T22:44:42.623338] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-10-03T22:44:42.622121] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:42.624150] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-03T22:44:42.626869] [INFO ] [MAIN ] Derivative Progress: 1634/2073 symbols completed. SES took 1.4s. Estimated remaining: 2m 59s. Rate: 147.5 symbols/min [2025-10-03T22:44:42.624102] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42143 primary records. [2025-10-03T22:44:42.626994] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-03T22:44:42.642836] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-10-03T22:44:42.642898] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-03T22:44:42.645754] [INFO ] [MAIN ] Derivative Progress: 1635/2073 symbols completed. SF took 1.3s. Estimated remaining: 2m 58s. Rate: 147.6 symbols/min [2025-10-03T22:44:42.646183] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:42.646260] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:42.646394] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:42.680524] [DEBUG] [LOCAL ] SFBS: Loaded 21398 existing records from primary storage. [2025-10-03T22:44:42.680719] [INFO ] [MAIN ] SFBS: Loaded 21398 primary data records. [2025-10-03T22:44:43.078338] [DEBUG] [LOCAL ] SGHC: Loaded 46831 existing records from primary storage. [2025-10-03T22:44:43.078535] [INFO ] [MAIN ] SGHC: Loaded 46831 primary data records. [2025-10-03T22:44:43.079911] [DEBUG] [LOCAL ] SG: Loaded 54228 existing records from primary storage. [2025-10-03T22:44:43.080697] [INFO ] [MAIN ] SG: Loaded 54228 primary data records. [2025-10-03T22:44:43.737726] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:43.739525] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21398 primary records. [2025-10-03T22:44:43.740677] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-03T22:44:43.759501] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-10-03T22:44:43.759920] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-03T22:44:43.762809] [INFO ] [MAIN ] Derivative Progress: 1636/2073 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 58s. Rate: 147.5 symbols/min [2025-10-03T22:44:43.763165] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:43.784565] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:43.785858] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54228 primary records. [2025-10-03T22:44:43.791001] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-03T22:44:43.792464] [DEBUG] [LOCAL ] SGU: Loaded 6770 existing records from primary storage. [2025-10-03T22:44:43.792824] [INFO ] [MAIN ] SGU: Loaded 6770 primary data records. [2025-10-03T22:44:43.864624] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:43.887106] [INFO ] [MAIN ] SGHC: Generated 1820 derivative records from 46831 primary records. [2025-10-03T22:44:43.887216] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-03T22:44:43.948373] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1820 records). [2025-10-03T22:44:43.949702] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-03T22:44:43.968023] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-10-03T22:44:43.962345] [INFO ] [MAIN ] Derivative Progress: 1637/2073 symbols completed. SGHC took 1.3s. Estimated remaining: 2m 57s. Rate: 147.5 symbols/min [2025-10-03T22:44:43.994490] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-03T22:44:43.994322] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:44.018859] [INFO ] [MAIN ] Derivative Progress: 1638/2073 symbols completed. SG took 1.4s. Estimated remaining: 2m 57s. Rate: 147.6 symbols/min [2025-10-03T22:44:44.040922] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:44.208335] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:44.209412] [INFO ] [MAIN ] SGU: Generated 1820 derivative records from 6770 primary records. [2025-10-03T22:44:44.209718] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-03T22:44:44.232210] [DEBUG] [LOCAL ] SHCO: Loaded 26144 existing records from primary storage. [2025-10-03T22:44:44.233281] [INFO ] [MAIN ] SHCO: Loaded 26144 primary data records. [2025-10-03T22:44:44.295246] [DEBUG] [LOCAL ] SHAK: Loaded 49652 existing records from primary storage. [2025-10-03T22:44:44.300898] [INFO ] [MAIN ] SHAK: Loaded 49652 primary data records. [2025-10-03T22:44:44.306743] [DEBUG] [LOCAL ] SGU: Derivative data saved (1820 records). [2025-10-03T22:44:44.320871] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-03T22:44:44.323245] [INFO ] [MAIN ] Derivative Progress: 1639/2073 symbols completed. SGU took 0.6s. Estimated remaining: 2m 56s. Rate: 147.6 symbols/min [2025-10-03T22:44:44.342217] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:44.999905] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-10-03T22:44:45.000264] [INFO ] [MAIN ] SHEL: Loaded 54451 primary data records. [2025-10-03T22:44:45.219558] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:45.328355] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 26144 primary records. [2025-10-03T22:44:45.342381] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-03T22:44:45.356421] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:45.357616] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49652 primary records. [2025-10-03T22:44:45.365466] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-03T22:44:45.389333] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-10-03T22:44:45.390208] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-03T22:44:45.392867] [INFO ] [MAIN ] Derivative Progress: 1640/2073 symbols completed. SHCO took 1.4s. Estimated remaining: 2m 56s. Rate: 147.5 symbols/min [2025-10-03T22:44:45.393879] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:45.396544] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-10-03T22:44:45.396706] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-03T22:44:45.399800] [INFO ] [MAIN ] Derivative Progress: 1641/2073 symbols completed. SHAK took 1.4s. Estimated remaining: 2m 56s. Rate: 147.5 symbols/min [2025-10-03T22:44:45.400331] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:45.434237] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:45.435378] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54451 primary records. [2025-10-03T22:44:45.435583] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-03T22:44:45.458035] [DEBUG] [LOCAL ] SHG: Loaded 26900 existing records from primary storage. [2025-10-03T22:44:45.459029] [INFO ] [MAIN ] SHG: Loaded 26900 primary data records. [2025-10-03T22:44:45.506067] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-10-03T22:44:45.540600] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-03T22:44:45.579392] [INFO ] [MAIN ] Derivative Progress: 1642/2073 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 55s. Rate: 147.6 symbols/min [2025-10-03T22:44:45.593739] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:45.598048] [DEBUG] [LOCAL ] SHO: Loaded 50371 existing records from primary storage. [2025-10-03T22:44:45.598707] [INFO ] [MAIN ] SHO: Loaded 50371 primary data records. [2025-10-03T22:44:45.706613] [DEBUG] [LOCAL ] SHOC: Loaded 3520 existing records from primary storage. [2025-10-03T22:44:45.769269] [INFO ] [MAIN ] SHOC: Loaded 3520 primary data records. [2025-10-03T22:44:46.453697] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:46.455408] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 26900 primary records. [2025-10-03T22:44:46.455622] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-03T22:44:46.486223] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:46.488151] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50371 primary records. [2025-10-03T22:44:46.488324] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-03T22:44:46.505885] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-10-03T22:44:46.507499] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-03T22:44:46.509826] [INFO ] [MAIN ] Derivative Progress: 1643/2073 symbols completed. SHG took 1.1s. Estimated remaining: 2m 55s. Rate: 147.5 symbols/min [2025-10-03T22:44:46.517759] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:46.524469] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:44:46.526865] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-10-03T22:44:46.527626] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3520 primary records. [2025-10-03T22:44:46.528125] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-03T22:44:46.530636] [INFO ] [MAIN ] Derivative Progress: 1644/2073 symbols completed. SHO took 1.1s. Estimated remaining: 2m 54s. Rate: 147.6 symbols/min [2025-10-03T22:44:46.530889] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-03T22:44:46.530968] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:46.547751] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-10-03T22:44:46.548005] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-03T22:44:46.551083] [INFO ] [MAIN ] Derivative Progress: 1645/2073 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 54s. Rate: 147.6 symbols/min [2025-10-03T22:44:46.551323] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:46.598975] [DEBUG] [LOCAL ] SID: Loaded 42878 existing records from primary storage. [2025-10-03T22:44:46.608702] [INFO ] [MAIN ] SID: Loaded 42878 primary data records. [2025-10-03T22:44:46.734137] [DEBUG] [LOCAL ] SHW: Loaded 51050 existing records from primary storage. [2025-10-03T22:44:46.750908] [DEBUG] [LOCAL ] SIG: Loaded 46801 existing records from primary storage. [2025-10-03T22:44:46.751113] [INFO ] [MAIN ] SIG: Loaded 46801 primary data records. [2025-10-03T22:44:46.750008] [INFO ] [MAIN ] SHW: Loaded 51050 primary data records. [2025-10-03T22:44:47.676134] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:47.678149] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 42878 primary records. [2025-10-03T22:44:47.678370] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-03T22:44:47.709028] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:47.710369] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51050 primary records. [2025-10-03T22:44:47.710585] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-03T22:44:47.725670] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:44:47.727158] [INFO ] [MAIN ] SIG: Generated 1819 derivative records from 46801 primary records. [2025-10-03T22:44:47.734419] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-03T22:44:47.739283] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-10-03T22:44:47.740531] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-03T22:44:47.755228] [INFO ] [MAIN ] Derivative Progress: 1646/2073 symbols completed. SID took 1.2s. Estimated remaining: 2m 54s. Rate: 147.5 symbols/min [2025-10-03T22:44:47.756710] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:47.762787] [DEBUG] [LOCAL ] SIG: Derivative data saved (1819 records). [2025-10-03T22:44:47.763786] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-03T22:44:47.767174] [INFO ] [MAIN ] Derivative Progress: 1647/2073 symbols completed. SIG took 1.2s. Estimated remaining: 2m 53s. Rate: 147.6 symbols/min [2025-10-03T22:44:47.767889] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:47.769275] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-10-03T22:44:47.769368] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-03T22:44:47.772696] [INFO ] [MAIN ] Derivative Progress: 1648/2073 symbols completed. SHW took 1.3s. Estimated remaining: 2m 53s. Rate: 147.6 symbols/min [2025-10-03T22:44:47.793494] [DEBUG] [LOCAL ] SII: Loaded 23889 existing records from primary storage. [2025-10-03T22:44:47.793638] [INFO ] [MAIN ] SII: Loaded 23889 primary data records. [2025-10-03T22:44:47.936831] [DEBUG] [LOCAL ] SILA: Loaded 31215 existing records from primary storage. [2025-10-03T22:44:47.947283] [INFO ] [MAIN ] SILA: Loaded 31215 primary data records. [2025-10-03T22:44:48.469393] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:48.470405] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 23889 primary records. [2025-10-03T22:44:48.470601] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-03T22:44:48.487292] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-10-03T22:44:48.489533] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-03T22:44:48.491685] [INFO ] [MAIN ] Derivative Progress: 1649/2073 symbols completed. SII took 0.7s. Estimated remaining: 2m 52s. Rate: 147.6 symbols/min [2025-10-03T22:44:48.504686] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:48.505295] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31215 primary records. [2025-10-03T22:44:48.505357] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-03T22:44:48.521014] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-10-03T22:44:48.521075] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-03T22:44:48.523572] [INFO ] [MAIN ] Derivative Progress: 1650/2073 symbols completed. SILA took 0.8s. Estimated remaining: 2m 52s. Rate: 147.7 symbols/min [2025-10-03T22:44:48.524067] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:48.524008] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:48.524588] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:48.619015] [DEBUG] [LOCAL ] SITC: Loaded 42184 existing records from primary storage. [2025-10-03T22:44:48.619357] [INFO ] [MAIN ] SITC: Loaded 42184 primary data records. [2025-10-03T22:44:48.620071] [DEBUG] [LOCAL ] SJM: Loaded 50853 existing records from primary storage. [2025-10-03T22:44:48.632751] [INFO ] [MAIN ] SJM: Loaded 50853 primary data records. [2025-10-03T22:44:48.780669] [DEBUG] [LOCAL ] SITE: Loaded 35569 existing records from primary storage. [2025-10-03T22:44:48.796351] [INFO ] [MAIN ] SITE: Loaded 35569 primary data records. [2025-10-03T22:44:49.677764] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:49.680285] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42184 primary records. [2025-10-03T22:44:49.680512] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-03T22:44:49.707202] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:49.710384] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50853 primary records. [2025-10-03T22:44:49.711588] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-10-03T22:44:49.711873] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-03T22:44:49.712123] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-03T22:44:49.714373] [INFO ] [MAIN ] Derivative Progress: 1651/2073 symbols completed. SITC took 1.2s. Estimated remaining: 2m 52s. Rate: 147.5 symbols/min [2025-10-03T22:44:49.714857] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:49.749107] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:49.756612] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35569 primary records. [2025-10-03T22:44:49.757313] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-03T22:44:49.780952] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-10-03T22:44:49.784704] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-03T22:44:49.785410] [DEBUG] [LOCAL ] SJT: Loaded 22695 existing records from primary storage. [2025-10-03T22:44:49.787828] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-10-03T22:44:49.792810] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-03T22:44:49.792708] [INFO ] [MAIN ] Derivative Progress: 1652/2073 symbols completed. SJM took 1.3s. Estimated remaining: 2m 51s. Rate: 147.6 symbols/min [2025-10-03T22:44:49.796257] [INFO ] [MAIN ] Derivative Progress: 1653/2073 symbols completed. SITE took 1.3s. Estimated remaining: 2m 51s. Rate: 147.6 symbols/min [2025-10-03T22:44:49.796154] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:49.796620] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:49.796980] [INFO ] [MAIN ] SJT: Loaded 22695 primary data records. [2025-10-03T22:44:49.915780] [DEBUG] [LOCAL ] SKIL: Loaded 6547 existing records from primary storage. [2025-10-03T22:44:49.921115] [INFO ] [MAIN ] SKIL: Loaded 6547 primary data records. [2025-10-03T22:44:50.259495] [DEBUG] [LOCAL ] SKE: Loaded 36657 existing records from primary storage. [2025-10-03T22:44:50.260140] [INFO ] [MAIN ] SKE: Loaded 36657 primary data records. [2025-10-03T22:44:50.832786] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:50.834138] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22695 primary records. [2025-10-03T22:44:50.834241] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-03T22:44:50.867557] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-10-03T22:44:50.868624] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-03T22:44:50.870872] [INFO ] [MAIN ] Derivative Progress: 1654/2073 symbols completed. SJT took 1.2s. Estimated remaining: 2m 50s. Rate: 147.5 symbols/min [2025-10-03T22:44:50.868529] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:50.872204] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:50.872007] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6547 primary records. [2025-10-03T22:44:50.872699] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-03T22:44:50.914563] [DEBUG] [LOCAL ] SKLZ: Loaded 11895 existing records from primary storage. [2025-10-03T22:44:50.914234] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:50.915824] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 36657 primary records. [2025-10-03T22:44:50.916151] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-03T22:44:50.914997] [INFO ] [MAIN ] SKLZ: Loaded 11895 primary data records. [2025-10-03T22:44:50.923104] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-10-03T22:44:50.930259] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-03T22:44:50.938125] [INFO ] [MAIN ] Derivative Progress: 1655/2073 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 50s. Rate: 147.6 symbols/min [2025-10-03T22:44:50.981225] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:51.055355] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-10-03T22:44:51.066273] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-03T22:44:51.108694] [INFO ] [MAIN ] Derivative Progress: 1656/2073 symbols completed. SKE took 1.3s. Estimated remaining: 2m 49s. Rate: 147.6 symbols/min [2025-10-03T22:44:51.152664] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:51.319385] [DEBUG] [LOCAL ] SKM: Loaded 35367 existing records from primary storage. [2025-10-03T22:44:51.320576] [INFO ] [MAIN ] SKM: Loaded 35367 primary data records. [2025-10-03T22:44:51.673983] [DEBUG] [LOCAL ] SKT: Loaded 43120 existing records from primary storage. [2025-10-03T22:44:51.675193] [INFO ] [MAIN ] SKT: Loaded 43120 primary data records. [2025-10-03T22:44:51.743538] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:51.795092] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 11895 primary records. [2025-10-03T22:44:51.810011] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-03T22:44:52.037146] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-10-03T22:44:52.038308] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-03T22:44:52.040862] [INFO ] [MAIN ] Derivative Progress: 1657/2073 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 49s. Rate: 147.5 symbols/min [2025-10-03T22:44:52.047361] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:52.058158] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:52.059505] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35367 primary records. [2025-10-03T22:44:52.059616] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-03T22:44:52.079333] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-10-03T22:44:52.079832] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-03T22:44:52.082960] [INFO ] [MAIN ] Derivative Progress: 1658/2073 symbols completed. SKM took 1.1s. Estimated remaining: 2m 49s. Rate: 147.6 symbols/min [2025-10-03T22:44:52.083256] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:52.099680] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:52.100413] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43120 primary records. [2025-10-03T22:44:52.100524] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-03T22:44:52.122937] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-10-03T22:44:52.123057] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-03T22:44:52.125822] [INFO ] [MAIN ] Derivative Progress: 1659/2073 symbols completed. SKT took 1.0s. Estimated remaining: 2m 48s. Rate: 147.7 symbols/min [2025-10-03T22:44:52.126096] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:52.145770] [DEBUG] [LOCAL ] SKYH: Loaded 16789 existing records from primary storage. [2025-10-03T22:44:52.146003] [INFO ] [MAIN ] SKYH: Loaded 16789 primary data records. [2025-10-03T22:44:52.267551] [DEBUG] [LOCAL ] SKY: Loaded 38237 existing records from primary storage. [2025-10-03T22:44:52.268241] [INFO ] [MAIN ] SKY: Loaded 38237 primary data records. [2025-10-03T22:44:52.669001] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-10-03T22:44:52.694714] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-10-03T22:44:53.201012] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:53.202260] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16789 primary records. [2025-10-03T22:44:53.202579] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-03T22:44:53.224625] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-10-03T22:44:53.224867] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-03T22:44:53.227318] [INFO ] [MAIN ] Derivative Progress: 1660/2073 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 48s. Rate: 147.5 symbols/min [2025-10-03T22:44:53.239988] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:53.242419] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:53.243368] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38237 primary records. [2025-10-03T22:44:53.243720] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-03T22:44:53.273269] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-10-03T22:44:53.278379] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-03T22:44:53.282064] [INFO ] [MAIN ] Derivative Progress: 1661/2073 symbols completed. SKY took 1.2s. Estimated remaining: 2m 47s. Rate: 147.6 symbols/min [2025-10-03T22:44:53.278714] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:53.283169] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-10-03T22:44:53.282245] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:53.283501] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-03T22:44:53.311204] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-10-03T22:44:53.322772] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-03T22:44:53.325939] [INFO ] [MAIN ] Derivative Progress: 1662/2073 symbols completed. SLB took 1.2s. Estimated remaining: 2m 47s. Rate: 147.7 symbols/min [2025-10-03T22:44:53.326233] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:53.327361] [DEBUG] [LOCAL ] SLF: Loaded 39218 existing records from primary storage. [2025-10-03T22:44:53.327595] [INFO ] [MAIN ] SLF: Loaded 39218 primary data records. [2025-10-03T22:44:53.725603] [DEBUG] [LOCAL ] SLG: Loaded 45832 existing records from primary storage. [2025-10-03T22:44:53.728013] [INFO ] [MAIN ] SLG: Loaded 45832 primary data records. [2025-10-03T22:44:53.728831] [DEBUG] [LOCAL ] SLGN: Loaded 41038 existing records from primary storage. [2025-10-03T22:44:53.751453] [INFO ] [MAIN ] SLGN: Loaded 41038 primary data records. [2025-10-03T22:44:54.402259] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:54.403512] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39218 primary records. [2025-10-03T22:44:54.403814] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-03T22:44:54.429157] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-10-03T22:44:54.429501] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-03T22:44:54.432148] [INFO ] [MAIN ] Derivative Progress: 1663/2073 symbols completed. SLF took 1.2s. Estimated remaining: 2m 47s. Rate: 147.5 symbols/min [2025-10-03T22:44:54.452529] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:54.455003] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41038 primary records. [2025-10-03T22:44:54.455257] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-03T22:44:54.478590] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:54.483770] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 45832 primary records. [2025-10-03T22:44:54.484350] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-03T22:44:54.504559] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-10-03T22:44:54.504304] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-10-03T22:44:54.504707] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-03T22:44:54.507115] [INFO ] [MAIN ] Derivative Progress: 1664/2073 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 46s. Rate: 147.6 symbols/min [2025-10-03T22:44:54.507344] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-03T22:44:54.511109] [INFO ] [MAIN ] Derivative Progress: 1665/2073 symbols completed. SLG took 1.2s. Estimated remaining: 2m 46s. Rate: 147.7 symbols/min [2025-10-03T22:44:54.511464] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:54.511579] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:54.511681] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:54.548011] [DEBUG] [LOCAL ] SLVM: Loaded 28511 existing records from primary storage. [2025-10-03T22:44:54.548223] [INFO ] [MAIN ] SLVM: Loaded 28511 primary data records. [2025-10-03T22:44:54.762518] [DEBUG] [LOCAL ] SM: Loaded 53098 existing records from primary storage. [2025-10-03T22:44:54.784287] [INFO ] [MAIN ] SM: Loaded 53098 primary data records. [2025-10-03T22:44:54.927315] [DEBUG] [LOCAL ] SLQT: Loaded 44168 existing records from primary storage. [2025-10-03T22:44:54.944810] [INFO ] [MAIN ] SLQT: Loaded 44168 primary data records. [2025-10-03T22:44:55.612413] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:55.614117] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28511 primary records. [2025-10-03T22:44:55.614308] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-03T22:44:55.647727] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:55.649027] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53098 primary records. [2025-10-03T22:44:55.649486] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-03T22:44:55.651736] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-10-03T22:44:55.651832] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-03T22:44:55.654361] [INFO ] [MAIN ] Derivative Progress: 1666/2073 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 46s. Rate: 147.5 symbols/min [2025-10-03T22:44:55.666361] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:55.689075] [DEBUG] [LOCAL ] SMBK: Loaded 8281 existing records from primary storage. [2025-10-03T22:44:55.695445] [INFO ] [MAIN ] SMBK: Loaded 8281 primary data records. [2025-10-03T22:44:55.695098] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-10-03T22:44:55.701401] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-03T22:44:55.695869] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:55.736959] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44168 primary records. [2025-10-03T22:44:55.736048] [INFO ] [MAIN ] Derivative Progress: 1667/2073 symbols completed. SM took 1.2s. Estimated remaining: 2m 45s. Rate: 147.6 symbols/min [2025-10-03T22:44:55.744545] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-03T22:44:55.757505] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:55.828439] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-10-03T22:44:55.828678] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-03T22:44:55.842891] [INFO ] [MAIN ] Derivative Progress: 1668/2073 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 45s. Rate: 147.7 symbols/min [2025-10-03T22:44:55.853742] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:55.887117] [DEBUG] [LOCAL ] SMC: Loaded 11572 existing records from primary storage. [2025-10-03T22:44:55.916044] [INFO ] [MAIN ] SMC: Loaded 11572 primary data records. [2025-10-03T22:44:56.373692] [DEBUG] [LOCAL ] SMFG: Loaded 48805 existing records from primary storage. [2025-10-03T22:44:56.375080] [INFO ] [MAIN ] SMFG: Loaded 48805 primary data records. [2025-10-03T22:44:56.603124] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:56.725931] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8281 primary records. [2025-10-03T22:44:56.727105] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-03T22:44:56.743402] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:56.745089] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11572 primary records. [2025-10-03T22:44:56.756630] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-03T22:44:56.776503] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-10-03T22:44:56.776787] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-03T22:44:56.781227] [INFO ] [MAIN ] Derivative Progress: 1669/2073 symbols completed. SMC took 1.0s. Estimated remaining: 2m 44s. Rate: 147.5 symbols/min [2025-10-03T22:44:56.782330] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:56.785324] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-10-03T22:44:56.785520] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-03T22:44:56.789236] [INFO ] [MAIN ] Derivative Progress: 1670/2073 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 44s. Rate: 147.6 symbols/min [2025-10-03T22:44:56.790865] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:56.821970] [DEBUG] [LOCAL ] SMHI: Loaded 13294 existing records from primary storage. [2025-10-03T22:44:56.821632] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:56.822849] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48805 primary records. [2025-10-03T22:44:56.822112] [INFO ] [MAIN ] SMHI: Loaded 13294 primary data records. [2025-10-03T22:44:56.822993] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-03T22:44:56.952357] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-10-03T22:44:56.973974] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-03T22:44:56.982068] [INFO ] [MAIN ] Derivative Progress: 1671/2073 symbols completed. SMFG took 1.1s. Estimated remaining: 2m 43s. Rate: 147.7 symbols/min [2025-10-03T22:44:56.995363] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:57.049582] [DEBUG] [LOCAL ] SMG: Loaded 44276 existing records from primary storage. [2025-10-03T22:44:57.171587] [INFO ] [MAIN ] SMG: Loaded 44276 primary data records. [2025-10-03T22:44:57.295832] [DEBUG] [LOCAL ] SMP: Loaded 19514 existing records from primary storage. [2025-10-03T22:44:57.328170] [INFO ] [MAIN ] SMP: Loaded 19514 primary data records. [2025-10-03T22:44:57.883916] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:57.884895] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 13294 primary records. [2025-10-03T22:44:57.885151] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-03T22:44:57.907825] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-10-03T22:44:57.909054] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-03T22:44:57.911634] [INFO ] [MAIN ] Derivative Progress: 1672/2073 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 43s. Rate: 147.6 symbols/min [2025-10-03T22:44:57.911975] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:57.986374] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:57.986009] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:57.988188] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44276 primary records. [2025-10-03T22:44:57.987449] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19514 primary records. [2025-10-03T22:44:57.988395] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-03T22:44:57.989342] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-03T22:44:58.019370] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-10-03T22:44:58.020701] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-03T22:44:58.043207] [INFO ] [MAIN ] Derivative Progress: 1673/2073 symbols completed. SMG took 1.3s. Estimated remaining: 2m 43s. Rate: 147.6 symbols/min [2025-10-03T22:44:58.043965] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:58.046786] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-10-03T22:44:58.046980] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-03T22:44:58.053110] [INFO ] [MAIN ] Derivative Progress: 1674/2073 symbols completed. SMP took 1.1s. Estimated remaining: 2m 42s. Rate: 147.7 symbols/min [2025-10-03T22:44:58.053364] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:58.075292] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-10-03T22:44:58.075614] [INFO ] [MAIN ] SMR: Loaded 54577 primary data records. [2025-10-03T22:44:58.440599] [DEBUG] [LOCAL ] SMWB: Loaded 32764 existing records from primary storage. [2025-10-03T22:44:58.441442] [INFO ] [MAIN ] SMWB: Loaded 32764 primary data records. [2025-10-03T22:44:58.442261] [DEBUG] [LOCAL ] SMRT: Loaded 44495 existing records from primary storage. [2025-10-03T22:44:58.447842] [INFO ] [MAIN ] SMRT: Loaded 44495 primary data records. [2025-10-03T22:44:59.098791] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:59.102249] [INFO ] [MAIN ] SMR: Generated 1820 derivative records from 54577 primary records. [2025-10-03T22:44:59.102772] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-03T22:44:59.126881] [DEBUG] [LOCAL ] SMR: Derivative data saved (1820 records). [2025-10-03T22:44:59.129428] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-03T22:44:59.132588] [INFO ] [MAIN ] Derivative Progress: 1675/2073 symbols completed. SMR took 1.2s. Estimated remaining: 2m 42s. Rate: 147.6 symbols/min [2025-10-03T22:44:59.133022] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:59.150141] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:59.151333] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 32764 primary records. [2025-10-03T22:44:59.151678] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-03T22:44:59.172825] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:44:59.174951] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44495 primary records. [2025-10-03T22:44:59.175143] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-03T22:44:59.196944] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-10-03T22:44:59.197439] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-03T22:44:59.201190] [INFO ] [MAIN ] Derivative Progress: 1676/2073 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 41s. Rate: 147.6 symbols/min [2025-10-03T22:44:59.201894] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:59.204683] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-10-03T22:44:59.204795] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-03T22:44:59.207355] [INFO ] [MAIN ] Derivative Progress: 1677/2073 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 41s. Rate: 147.7 symbols/min [2025-10-03T22:44:59.207678] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:44:59.248344] [DEBUG] [LOCAL ] SN: Loaded 50488 existing records from primary storage. [2025-10-03T22:44:59.257226] [INFO ] [MAIN ] SN: Loaded 50488 primary data records. [2025-10-03T22:44:59.370181] [DEBUG] [LOCAL ] SNA: Loaded 26187 existing records from primary storage. [2025-10-03T22:44:59.370524] [INFO ] [MAIN ] SNA: Loaded 26187 primary data records. [2025-10-03T22:44:59.778891] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-03T22:44:59.790669] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-10-03T22:45:00.349440] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:00.351356] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50488 primary records. [2025-10-03T22:45:00.352567] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-03T22:45:00.388891] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-10-03T22:45:00.389585] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:00.389741] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-03T22:45:00.392660] [INFO ] [MAIN ] Derivative Progress: 1678/2073 symbols completed. SN took 1.3s. Estimated remaining: 2m 41s. Rate: 147.6 symbols/min [2025-10-03T22:45:00.393496] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 26187 primary records. [2025-10-03T22:45:00.394128] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-03T22:45:00.414716] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-10-03T22:45:00.414808] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-03T22:45:00.417428] [INFO ] [MAIN ] Derivative Progress: 1679/2073 symbols completed. SNA took 1.2s. Estimated remaining: 2m 40s. Rate: 147.6 symbols/min [2025-10-03T22:45:00.431067] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:00.431824] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-10-03T22:45:00.431891] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-03T22:45:00.448491] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-10-03T22:45:00.448554] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-03T22:45:00.452352] [INFO ] [MAIN ] Derivative Progress: 1680/2073 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 40s. Rate: 147.7 symbols/min [2025-10-03T22:45:00.453055] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:00.453363] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:00.453963] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:00.461342] [DEBUG] [LOCAL ] SNDA: Loaded 4571 existing records from primary storage. [2025-10-03T22:45:00.461748] [INFO ] [MAIN ] SNDA: Loaded 4571 primary data records. [2025-10-03T22:45:00.826635] [DEBUG] [LOCAL ] SNN: Loaded 44843 existing records from primary storage. [2025-10-03T22:45:00.827376] [DEBUG] [LOCAL ] SNDR: Loaded 41416 existing records from primary storage. [2025-10-03T22:45:00.828502] [INFO ] [MAIN ] SNN: Loaded 44843 primary data records. [2025-10-03T22:45:00.828637] [INFO ] [MAIN ] SNDR: Loaded 41416 primary data records. [2025-10-03T22:45:01.605470] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:01.607416] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4571 primary records. [2025-10-03T22:45:01.607996] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-03T22:45:01.626839] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-10-03T22:45:01.627281] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-03T22:45:01.631110] [INFO ] [MAIN ] Derivative Progress: 1681/2073 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 39s. Rate: 147.6 symbols/min [2025-10-03T22:45:01.631952] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:01.655260] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:01.656342] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 44843 primary records. [2025-10-03T22:45:01.657406] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-03T22:45:01.694961] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:01.695854] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41416 primary records. [2025-10-03T22:45:01.694515] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-10-03T22:45:01.696054] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-03T22:45:01.696131] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-03T22:45:01.699727] [INFO ] [MAIN ] Derivative Progress: 1682/2073 symbols completed. SNN took 1.2s. Estimated remaining: 2m 39s. Rate: 147.6 symbols/min [2025-10-03T22:45:01.700030] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:01.732633] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-10-03T22:45:01.732828] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-03T22:45:01.737302] [INFO ] [MAIN ] Derivative Progress: 1683/2073 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 38s. Rate: 147.7 symbols/min [2025-10-03T22:45:01.737776] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:01.763637] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-10-03T22:45:01.764351] [INFO ] [MAIN ] SNOW: Loaded 54371 primary data records. [2025-10-03T22:45:01.977517] [DEBUG] [LOCAL ] SNV: Loaded 49620 existing records from primary storage. [2025-10-03T22:45:01.993553] [INFO ] [MAIN ] SNV: Loaded 49620 primary data records. [2025-10-03T22:45:02.139831] [DEBUG] [LOCAL ] SNX: Loaded 40653 existing records from primary storage. [2025-10-03T22:45:02.173441] [INFO ] [MAIN ] SNX: Loaded 40653 primary data records. [2025-10-03T22:45:02.966945] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:02.968236] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54371 primary records. [2025-10-03T22:45:02.968344] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-03T22:45:02.988251] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-10-03T22:45:02.989221] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-03T22:45:02.993154] [INFO ] [MAIN ] Derivative Progress: 1684/2073 symbols completed. SNOW took 1.4s. Estimated remaining: 2m 38s. Rate: 147.5 symbols/min [2025-10-03T22:45:02.995378] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:03.011362] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:03.012368] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49620 primary records. [2025-10-03T22:45:03.014340] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-03T22:45:03.032115] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-10-03T22:45:03.044966] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-03T22:45:03.048231] [INFO ] [MAIN ] Derivative Progress: 1685/2073 symbols completed. SNV took 1.3s. Estimated remaining: 2m 38s. Rate: 147.6 symbols/min [2025-10-03T22:45:03.048708] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:03.048828] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:03.049751] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40653 primary records. [2025-10-03T22:45:03.050397] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-03T22:45:03.069143] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-10-03T22:45:03.069419] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-03T22:45:03.072557] [INFO ] [MAIN ] Derivative Progress: 1686/2073 symbols completed. SNX took 1.3s. Estimated remaining: 2m 37s. Rate: 147.7 symbols/min [2025-10-03T22:45:03.073365] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:03.133416] [DEBUG] [LOCAL ] SO: Loaded 54386 existing records from primary storage. [2025-10-03T22:45:03.133986] [INFO ] [MAIN ] SO: Loaded 54386 primary data records. [2025-10-03T22:45:03.134595] [DEBUG] [LOCAL ] SOBO: Loaded 40076 existing records from primary storage. [2025-10-03T22:45:03.146117] [INFO ] [MAIN ] SOBO: Loaded 40076 primary data records. [2025-10-03T22:45:03.546984] [DEBUG] [LOCAL ] SOC: Loaded 51206 existing records from primary storage. [2025-10-03T22:45:03.796262] [INFO ] [MAIN ] SOC: Loaded 51206 primary data records. [2025-10-03T22:45:04.292845] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:04.294470] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:04.296796] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40076 primary records. [2025-10-03T22:45:04.297104] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-03T22:45:04.296711] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54386 primary records. [2025-10-03T22:45:04.298395] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-03T22:45:04.333463] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-10-03T22:45:04.334836] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-03T22:45:04.338780] [INFO ] [MAIN ] Derivative Progress: 1687/2073 symbols completed. SO took 1.3s. Estimated remaining: 2m 37s. Rate: 147.5 symbols/min [2025-10-03T22:45:04.339617] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:04.344563] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-10-03T22:45:04.344732] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-03T22:45:04.348633] [INFO ] [MAIN ] Derivative Progress: 1688/2073 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 37s. Rate: 147.6 symbols/min [2025-10-03T22:45:04.348956] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:04.354831] [DEBUG] [LOCAL ] SOJC: Loaded 5079 existing records from primary storage. [2025-10-03T22:45:04.358007] [INFO ] [MAIN ] SOJC: Loaded 5079 primary data records. [2025-10-03T22:45:04.459996] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:04.476311] [DEBUG] [LOCAL ] SOJD: Loaded 13256 existing records from primary storage. [2025-10-03T22:45:04.495151] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51206 primary records. [2025-10-03T22:45:04.495381] [INFO ] [MAIN ] SOJD: Loaded 13256 primary data records. [2025-10-03T22:45:04.495487] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-03T22:45:04.766855] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-10-03T22:45:04.782719] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-03T22:45:04.880604] [INFO ] [MAIN ] Derivative Progress: 1689/2073 symbols completed. SOC took 1.8s. Estimated remaining: 2m 36s. Rate: 147.6 symbols/min [2025-10-03T22:45:04.887413] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:05.105345] [DEBUG] [LOCAL ] SOJE: Loaded 9451 existing records from primary storage. [2025-10-03T22:45:05.105574] [INFO ] [MAIN ] SOJE: Loaded 9451 primary data records. [2025-10-03T22:45:05.455060] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:05.456478] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 5079 primary records. [2025-10-03T22:45:05.458130] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-03T22:45:05.493529] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:05.498600] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13256 primary records. [2025-10-03T22:45:05.501047] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-03T22:45:05.503503] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-10-03T22:45:05.512880] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-03T22:45:05.524941] [INFO ] [MAIN ] Derivative Progress: 1690/2073 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 36s. Rate: 147.5 symbols/min [2025-10-03T22:45:05.526116] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:05.528026] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-10-03T22:45:05.528355] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-03T22:45:05.534299] [INFO ] [MAIN ] Derivative Progress: 1691/2073 symbols completed. SOJD took 1.2s. Estimated remaining: 2m 35s. Rate: 147.6 symbols/min [2025-10-03T22:45:05.535079] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:05.560930] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:05.562283] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9451 primary records. [2025-10-03T22:45:05.562826] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-03T22:45:05.584612] [DEBUG] [LOCAL ] SOL: Loaded 13504 existing records from primary storage. [2025-10-03T22:45:05.585458] [INFO ] [MAIN ] SOL: Loaded 13504 primary data records. [2025-10-03T22:45:05.688734] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-10-03T22:45:05.716893] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-03T22:45:05.748027] [INFO ] [MAIN ] Derivative Progress: 1692/2073 symbols completed. SOJE took 0.9s. Estimated remaining: 2m 35s. Rate: 147.6 symbols/min [2025-10-03T22:45:05.749581] [DEBUG] [LOCAL ] SOLV: Loaded 44593 existing records from primary storage. [2025-10-03T22:45:05.749735] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:05.756048] [INFO ] [MAIN ] SOLV: Loaded 44593 primary data records. [2025-10-03T22:45:06.448835] [DEBUG] [LOCAL ] SONY: Loaded 54137 existing records from primary storage. [2025-10-03T22:45:06.450335] [INFO ] [MAIN ] SONY: Loaded 54137 primary data records. [2025-10-03T22:45:06.637257] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:06.682053] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13504 primary records. [2025-10-03T22:45:06.682718] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-03T22:45:06.850137] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:06.852887] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44593 primary records. [2025-10-03T22:45:06.854038] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-03T22:45:06.856741] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-10-03T22:45:06.865803] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-03T22:45:06.869258] [INFO ] [MAIN ] Derivative Progress: 1693/2073 symbols completed. SOL took 1.3s. Estimated remaining: 2m 35s. Rate: 147.5 symbols/min [2025-10-03T22:45:06.881501] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-10-03T22:45:06.881693] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-03T22:45:06.886144] [INFO ] [MAIN ] Derivative Progress: 1694/2073 symbols completed. SOLV took 1.4s. Estimated remaining: 2m 34s. Rate: 147.6 symbols/min [2025-10-03T22:45:06.906431] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:06.907431] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54137 primary records. [2025-10-03T22:45:06.907503] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-03T22:45:06.925215] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-10-03T22:45:06.925362] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-03T22:45:06.929758] [INFO ] [MAIN ] Derivative Progress: 1695/2073 symbols completed. SONY took 1.2s. Estimated remaining: 2m 34s. Rate: 147.6 symbols/min [2025-10-03T22:45:06.930704] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:06.930590] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:06.930500] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:06.939606] [DEBUG] [LOCAL ] SOR: Loaded 2899 existing records from primary storage. [2025-10-03T22:45:06.939870] [INFO ] [MAIN ] SOR: Loaded 2899 primary data records. [2025-10-03T22:45:07.042240] [DEBUG] [LOCAL ] SOS: Loaded 8947 existing records from primary storage. [2025-10-03T22:45:07.062991] [INFO ] [MAIN ] SOS: Loaded 8947 primary data records. [2025-10-03T22:45:07.424762] [DEBUG] [LOCAL ] SPB: Loaded 34451 existing records from primary storage. [2025-10-03T22:45:07.435684] [INFO ] [MAIN ] SPB: Loaded 34451 primary data records. [2025-10-03T22:45:08.017324] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-10-03T22:45:08.019073] [INFO ] [MAIN ] SOR: Generated 1815 derivative records from 2899 primary records. [2025-10-03T22:45:08.019806] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-03T22:45:08.052895] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:08.052564] [DEBUG] [LOCAL ] SOR: Derivative data saved (1815 records). [2025-10-03T22:45:08.054104] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-03T22:45:08.056783] [INFO ] [MAIN ] Derivative Progress: 1696/2073 symbols completed. SOR took 1.1s. Estimated remaining: 2m 33s. Rate: 147.5 symbols/min [2025-10-03T22:45:08.053849] [INFO ] [MAIN ] SOS: Generated 1819 derivative records from 8947 primary records. [2025-10-03T22:45:08.057004] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-03T22:45:08.057393] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:08.089532] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:08.091027] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34451 primary records. [2025-10-03T22:45:08.091204] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-03T22:45:08.092933] [DEBUG] [LOCAL ] SOS: Derivative data saved (1819 records). [2025-10-03T22:45:08.093371] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-03T22:45:08.096494] [INFO ] [MAIN ] Derivative Progress: 1697/2073 symbols completed. SOS took 1.2s. Estimated remaining: 2m 33s. Rate: 147.6 symbols/min [2025-10-03T22:45:08.104088] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:08.129879] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-10-03T22:45:08.133996] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-03T22:45:08.137028] [INFO ] [MAIN ] Derivative Progress: 1698/2073 symbols completed. SPB took 1.2s. Estimated remaining: 2m 32s. Rate: 147.6 symbols/min [2025-10-03T22:45:08.133898] [DEBUG] [LOCAL ] SPE: Loaded 6406 existing records from primary storage. [2025-10-03T22:45:08.137355] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:08.137569] [INFO ] [MAIN ] SPE: Loaded 6406 primary data records. [2025-10-03T22:45:08.258711] [DEBUG] [LOCAL ] SPCE: Loaded 50695 existing records from primary storage. [2025-10-03T22:45:08.259003] [INFO ] [MAIN ] SPCE: Loaded 50695 primary data records. [2025-10-03T22:45:08.827088] [DEBUG] [LOCAL ] SPG: Loaded 51014 existing records from primary storage. [2025-10-03T22:45:08.829138] [INFO ] [MAIN ] SPG: Loaded 51014 primary data records. [2025-10-03T22:45:09.179031] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:09.178519] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:09.181324] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50695 primary records. [2025-10-03T22:45:09.181597] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-03T22:45:09.180335] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6406 primary records. [2025-10-03T22:45:09.181797] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-03T22:45:09.211021] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-10-03T22:45:09.212232] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-03T22:45:09.215658] [INFO ] [MAIN ] Derivative Progress: 1699/2073 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 32s. Rate: 147.5 symbols/min [2025-10-03T22:45:09.216187] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:09.220560] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-10-03T22:45:09.220731] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-03T22:45:09.223448] [INFO ] [MAIN ] Derivative Progress: 1700/2073 symbols completed. SPE took 1.1s. Estimated remaining: 2m 32s. Rate: 147.6 symbols/min [2025-10-03T22:45:09.223820] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:09.241025] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:09.241864] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 51014 primary records. [2025-10-03T22:45:09.242040] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-03T22:45:09.268971] [DEBUG] [LOCAL ] SPH: Loaded 17666 existing records from primary storage. [2025-10-03T22:45:09.269462] [INFO ] [MAIN ] SPH: Loaded 17666 primary data records. [2025-10-03T22:45:09.312798] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-10-03T22:45:09.337546] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-03T22:45:09.361474] [INFO ] [MAIN ] Derivative Progress: 1701/2073 symbols completed. SPG took 1.2s. Estimated remaining: 2m 31s. Rate: 147.6 symbols/min [2025-10-03T22:45:09.367040] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:09.423711] [DEBUG] [LOCAL ] SPGI: Loaded 46480 existing records from primary storage. [2025-10-03T22:45:09.435342] [INFO ] [MAIN ] SPGI: Loaded 46480 primary data records. [2025-10-03T22:45:09.753332] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-10-03T22:45:09.775279] [INFO ] [MAIN ] SPHR: Loaded 40745 primary data records. [2025-10-03T22:45:10.380345] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:10.381191] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 17666 primary records. [2025-10-03T22:45:10.381364] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-03T22:45:10.399357] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-10-03T22:45:10.400368] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-03T22:45:10.403491] [INFO ] [MAIN ] Derivative Progress: 1702/2073 symbols completed. SPH took 1.2s. Estimated remaining: 2m 31s. Rate: 147.5 symbols/min [2025-10-03T22:45:10.404092] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:10.422943] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:10.424246] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46480 primary records. [2025-10-03T22:45:10.424331] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-03T22:45:10.443205] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-10-03T22:45:10.443830] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-03T22:45:10.446465] [INFO ] [MAIN ] Derivative Progress: 1703/2073 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 30s. Rate: 147.6 symbols/min [2025-10-03T22:45:10.446665] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:10.474518] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:10.485931] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 40745 primary records. [2025-10-03T22:45:10.486039] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-03T22:45:10.490468] [DEBUG] [LOCAL ] SPMC: Loaded 5451 existing records from primary storage. [2025-10-03T22:45:10.491068] [INFO ] [MAIN ] SPMC: Loaded 5451 primary data records. [2025-10-03T22:45:10.492268] [DEBUG] [LOCAL ] SPIR: Loaded 37723 existing records from primary storage. [2025-10-03T22:45:10.523120] [INFO ] [MAIN ] SPIR: Loaded 37723 primary data records. [2025-10-03T22:45:10.773933] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-10-03T22:45:10.836208] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-03T22:45:11.093221] [INFO ] [MAIN ] Derivative Progress: 1704/2073 symbols completed. SPHR took 1.7s. Estimated remaining: 2m 30s. Rate: 147.5 symbols/min [2025-10-03T22:45:11.115769] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:11.173419] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:11.182524] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:11.184123] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 37723 primary records. [2025-10-03T22:45:11.184751] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5451 primary records. [2025-10-03T22:45:11.184911] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-03T22:45:11.184960] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-03T22:45:11.185864] [DEBUG] [LOCAL ] SPNT: Loaded 35308 existing records from primary storage. [2025-10-03T22:45:11.186134] [INFO ] [MAIN ] SPNT: Loaded 35308 primary data records. [2025-10-03T22:45:11.283700] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-10-03T22:45:11.296982] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-03T22:45:11.300179] [INFO ] [MAIN ] Derivative Progress: 1705/2073 symbols completed. SPIR took 0.9s. Estimated remaining: 2m 30s. Rate: 147.6 symbols/min [2025-10-03T22:45:11.311177] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-10-03T22:45:11.322191] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:11.322099] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-03T22:45:11.325463] [INFO ] [MAIN ] Derivative Progress: 1706/2073 symbols completed. SPMC took 0.9s. Estimated remaining: 2m 29s. Rate: 147.7 symbols/min [2025-10-03T22:45:11.325730] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:11.573567] [DEBUG] [LOCAL ] SPR: Loaded 41819 existing records from primary storage. [2025-10-03T22:45:11.589873] [INFO ] [MAIN ] SPR: Loaded 41819 primary data records. [2025-10-03T22:45:11.592206] [DEBUG] [LOCAL ] SPOT: Loaded 51295 existing records from primary storage. [2025-10-03T22:45:11.624020] [INFO ] [MAIN ] SPOT: Loaded 51295 primary data records. [2025-10-03T22:45:11.695171] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:11.702860] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35308 primary records. [2025-10-03T22:45:11.765947] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-03T22:45:12.070894] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-10-03T22:45:12.119068] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-03T22:45:12.245115] [INFO ] [MAIN ] Derivative Progress: 1707/2073 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 29s. Rate: 147.5 symbols/min [2025-10-03T22:45:12.246405] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:12.289798] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:12.290511] [DEBUG] [LOCAL ] SPXC: Loaded 23726 existing records from primary storage. [2025-10-03T22:45:12.292279] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41819 primary records. [2025-10-03T22:45:12.294062] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-03T22:45:12.294212] [INFO ] [MAIN ] SPXC: Loaded 23726 primary data records. [2025-10-03T22:45:12.375476] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:12.397757] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51295 primary records. [2025-10-03T22:45:12.403277] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-03T22:45:12.454698] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-10-03T22:45:12.455323] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-03T22:45:12.469003] [INFO ] [MAIN ] Derivative Progress: 1708/2073 symbols completed. SPOT took 1.1s. Estimated remaining: 2m 28s. Rate: 147.6 symbols/min [2025-10-03T22:45:12.469671] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-10-03T22:45:12.475187] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-03T22:45:12.508237] [INFO ] [MAIN ] Derivative Progress: 1709/2073 symbols completed. SPR took 1.2s. Estimated remaining: 2m 28s. Rate: 147.7 symbols/min [2025-10-03T22:45:12.693351] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:12.694089] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23726 primary records. [2025-10-03T22:45:12.694154] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-03T22:45:12.710186] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-10-03T22:45:12.710323] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-03T22:45:12.712792] [INFO ] [MAIN ] Derivative Progress: 1710/2073 symbols completed. SPXC took 0.5s. Estimated remaining: 2m 27s. Rate: 147.7 symbols/min [2025-10-03T22:45:12.713558] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:12.713480] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:12.713943] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:12.729042] [DEBUG] [LOCAL ] SPXX: Loaded 9387 existing records from primary storage. [2025-10-03T22:45:12.729211] [INFO ] [MAIN ] SPXX: Loaded 9387 primary data records. [2025-10-03T22:45:12.853419] [DEBUG] [LOCAL ] SQNS: Loaded 26708 existing records from primary storage. [2025-10-03T22:45:12.884446] [INFO ] [MAIN ] SQNS: Loaded 26708 primary data records. [2025-10-03T22:45:13.180423] [DEBUG] [LOCAL ] SQM: Loaded 49334 existing records from primary storage. [2025-10-03T22:45:13.184728] [INFO ] [MAIN ] SQM: Loaded 49334 primary data records. [2025-10-03T22:45:13.720151] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:13.721735] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9387 primary records. [2025-10-03T22:45:13.721973] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-03T22:45:13.743055] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-10-03T22:45:13.743911] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-03T22:45:13.746541] [INFO ] [MAIN ] Derivative Progress: 1711/2073 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 27s. Rate: 147.6 symbols/min [2025-10-03T22:45:13.747218] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:13.762049] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:13.762887] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 26708 primary records. [2025-10-03T22:45:13.763060] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-03T22:45:13.780073] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-10-03T22:45:13.780348] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-03T22:45:13.785231] [INFO ] [MAIN ] Derivative Progress: 1712/2073 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 27s. Rate: 147.6 symbols/min [2025-10-03T22:45:13.787959] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:13.811277] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:13.812612] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49334 primary records. [2025-10-03T22:45:13.812825] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-03T22:45:13.840905] [DEBUG] [LOCAL ] SR: Loaded 33250 existing records from primary storage. [2025-10-03T22:45:13.841692] [INFO ] [MAIN ] SR: Loaded 33250 primary data records. [2025-10-03T22:45:13.881232] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-10-03T22:45:13.915944] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-03T22:45:13.937187] [INFO ] [MAIN ] Derivative Progress: 1713/2073 symbols completed. SQM took 1.2s. Estimated remaining: 2m 26s. Rate: 147.7 symbols/min [2025-10-03T22:45:13.953704] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:14.191984] [DEBUG] [LOCAL ] SRE: Loaded 54200 existing records from primary storage. [2025-10-03T22:45:14.192253] [INFO ] [MAIN ] SRE: Loaded 54200 primary data records. [2025-10-03T22:45:14.193011] [DEBUG] [LOCAL ] SREA: Loaded 10524 existing records from primary storage. [2025-10-03T22:45:14.206323] [INFO ] [MAIN ] SREA: Loaded 10524 primary data records. [2025-10-03T22:45:14.915939] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:14.917513] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33250 primary records. [2025-10-03T22:45:14.917948] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-03T22:45:14.941861] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-10-03T22:45:14.943126] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-03T22:45:14.946583] [INFO ] [MAIN ] Derivative Progress: 1714/2073 symbols completed. SR took 1.2s. Estimated remaining: 2m 26s. Rate: 147.6 symbols/min [2025-10-03T22:45:14.947033] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:14.974857] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:14.976794] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54200 primary records. [2025-10-03T22:45:14.975632] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:14.977848] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10524 primary records. [2025-10-03T22:45:14.977962] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-03T22:45:14.978199] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-03T22:45:15.011566] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-10-03T22:45:15.013410] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-03T22:45:15.017375] [INFO ] [MAIN ] Derivative Progress: 1715/2073 symbols completed. SREA took 1.1s. Estimated remaining: 2m 25s. Rate: 147.6 symbols/min [2025-10-03T22:45:15.020198] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:15.021299] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-10-03T22:45:15.022022] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-03T22:45:15.026580] [INFO ] [MAIN ] Derivative Progress: 1716/2073 symbols completed. SRE took 1.2s. Estimated remaining: 2m 25s. Rate: 147.7 symbols/min [2025-10-03T22:45:15.027037] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:15.058310] [DEBUG] [LOCAL ] SRFM: Loaded 37523 existing records from primary storage. [2025-10-03T22:45:15.058552] [INFO ] [MAIN ] SRFM: Loaded 37523 primary data records. [2025-10-03T22:45:15.140213] [DEBUG] [LOCAL ] SRG: Loaded 15721 existing records from primary storage. [2025-10-03T22:45:15.157744] [INFO ] [MAIN ] SRG: Loaded 15721 primary data records. [2025-10-03T22:45:15.270417] [DEBUG] [LOCAL ] SRI: Loaded 27468 existing records from primary storage. [2025-10-03T22:45:15.366683] [INFO ] [MAIN ] SRI: Loaded 27468 primary data records. [2025-10-03T22:45:16.070501] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:16.071382] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 37523 primary records. [2025-10-03T22:45:16.071578] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-03T22:45:16.107688] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-10-03T22:45:16.107275] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:16.107902] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-03T22:45:16.110444] [INFO ] [MAIN ] Derivative Progress: 1717/2073 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 25s. Rate: 147.6 symbols/min [2025-10-03T22:45:16.111562] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 15721 primary records. [2025-10-03T22:45:16.111888] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-03T22:45:16.110626] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:16.147445] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-10-03T22:45:16.148076] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:16.151535] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-03T22:45:16.152396] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 27468 primary records. [2025-10-03T22:45:16.155485] [INFO ] [MAIN ] Derivative Progress: 1718/2073 symbols completed. SRG took 1.1s. Estimated remaining: 2m 24s. Rate: 147.7 symbols/min [2025-10-03T22:45:16.155681] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-03T22:45:16.152607] [DEBUG] [LOCAL ] SRV: Loaded 7463 existing records from primary storage. [2025-10-03T22:45:16.156813] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:16.164966] [INFO ] [MAIN ] SRV: Loaded 7463 primary data records. [2025-10-03T22:45:16.254973] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-10-03T22:45:16.276397] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-03T22:45:16.279591] [INFO ] [MAIN ] Derivative Progress: 1719/2073 symbols completed. SRI took 1.3s. Estimated remaining: 2m 24s. Rate: 147.7 symbols/min [2025-10-03T22:45:16.279855] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:16.546354] [DEBUG] [LOCAL ] SSB: Loaded 43234 existing records from primary storage. [2025-10-03T22:45:16.547714] [INFO ] [MAIN ] SSB: Loaded 43234 primary data records. [2025-10-03T22:45:16.548669] [DEBUG] [LOCAL ] SSD: Loaded 22774 existing records from primary storage. [2025-10-03T22:45:16.549034] [INFO ] [MAIN ] SSD: Loaded 22774 primary data records. [2025-10-03T22:45:17.221043] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:17.222531] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7463 primary records. [2025-10-03T22:45:17.222794] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-03T22:45:17.245342] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-10-03T22:45:17.245673] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-03T22:45:17.248429] [INFO ] [MAIN ] Derivative Progress: 1720/2073 symbols completed. SRV took 1.1s. Estimated remaining: 2m 23s. Rate: 147.6 symbols/min [2025-10-03T22:45:17.249211] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:17.268173] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:17.269022] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22774 primary records. [2025-10-03T22:45:17.269548] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-03T22:45:17.303779] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:17.314315] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-10-03T22:45:17.314557] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-03T22:45:17.318250] [INFO ] [MAIN ] Derivative Progress: 1721/2073 symbols completed. SSD took 1.0s. Estimated remaining: 2m 23s. Rate: 147.7 symbols/min [2025-10-03T22:45:17.318480] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:17.315630] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43234 primary records. [2025-10-03T22:45:17.319093] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-03T22:45:17.350903] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-10-03T22:45:17.351117] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-03T22:45:17.354059] [INFO ] [MAIN ] Derivative Progress: 1722/2073 symbols completed. SSB took 1.2s. Estimated remaining: 2m 23s. Rate: 147.8 symbols/min [2025-10-03T22:45:17.355168] [DEBUG] [LOCAL ] SSL: Loaded 41734 existing records from primary storage. [2025-10-03T22:45:17.355323] [INFO ] [MAIN ] SSL: Loaded 41734 primary data records. [2025-10-03T22:45:17.355449] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:17.398719] [DEBUG] [LOCAL ] SST: Loaded 12007 existing records from primary storage. [2025-10-03T22:45:17.426984] [INFO ] [MAIN ] SST: Loaded 12007 primary data records. [2025-10-03T22:45:17.739735] [DEBUG] [LOCAL ] SSTK: Loaded 26287 existing records from primary storage. [2025-10-03T22:45:17.890107] [INFO ] [MAIN ] SSTK: Loaded 26287 primary data records. [2025-10-03T22:45:18.341296] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:18.343731] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 12007 primary records. [2025-10-03T22:45:18.342868] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:18.344092] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-03T22:45:18.345491] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41734 primary records. [2025-10-03T22:45:18.345991] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-03T22:45:18.380012] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-10-03T22:45:18.380455] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-03T22:45:18.380369] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-10-03T22:45:18.382950] [INFO ] [MAIN ] Derivative Progress: 1723/2073 symbols completed. SST took 1.1s. Estimated remaining: 2m 22s. Rate: 147.6 symbols/min [2025-10-03T22:45:18.383207] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-03T22:45:18.387676] [INFO ] [MAIN ] Derivative Progress: 1724/2073 symbols completed. SSL took 1.1s. Estimated remaining: 2m 22s. Rate: 147.7 symbols/min [2025-10-03T22:45:18.400535] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:18.401134] [INFO ] [MAIN ] SSTK: Generated 1819 derivative records from 26287 primary records. [2025-10-03T22:45:18.401196] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-03T22:45:18.416661] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1819 records). [2025-10-03T22:45:18.416732] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-03T22:45:18.419624] [INFO ] [MAIN ] Derivative Progress: 1725/2073 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 21s. Rate: 147.8 symbols/min [2025-10-03T22:45:18.420208] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:18.420282] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:18.420454] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:18.440514] [DEBUG] [LOCAL ] STC: Loaded 17664 existing records from primary storage. [2025-10-03T22:45:18.440915] [INFO ] [MAIN ] STC: Loaded 17664 primary data records. [2025-10-03T22:45:18.843556] [DEBUG] [LOCAL ] ST: Loaded 50469 existing records from primary storage. [2025-10-03T22:45:18.859533] [INFO ] [MAIN ] ST: Loaded 50469 primary data records. [2025-10-03T22:45:18.860556] [DEBUG] [LOCAL ] STAG: Loaded 50828 existing records from primary storage. [2025-10-03T22:45:18.893565] [INFO ] [MAIN ] STAG: Loaded 50828 primary data records. [2025-10-03T22:45:19.533222] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:19.535471] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17664 primary records. [2025-10-03T22:45:19.535978] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-03T22:45:19.558893] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-10-03T22:45:19.559325] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-03T22:45:19.562998] [INFO ] [MAIN ] Derivative Progress: 1726/2073 symbols completed. STC took 1.1s. Estimated remaining: 2m 21s. Rate: 147.6 symbols/min [2025-10-03T22:45:19.571242] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:19.577095] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:19.577934] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50469 primary records. [2025-10-03T22:45:19.578037] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-03T22:45:19.598900] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-10-03T22:45:19.599142] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-03T22:45:19.602171] [INFO ] [MAIN ] Derivative Progress: 1727/2073 symbols completed. ST took 1.2s. Estimated remaining: 2m 21s. Rate: 147.7 symbols/min [2025-10-03T22:45:19.602560] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:19.616372] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:19.617558] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50828 primary records. [2025-10-03T22:45:19.617627] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-03T22:45:19.642976] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-10-03T22:45:19.643265] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-03T22:45:19.646097] [INFO ] [MAIN ] Derivative Progress: 1728/2073 symbols completed. STAG took 1.2s. Estimated remaining: 2m 20s. Rate: 147.8 symbols/min [2025-10-03T22:45:19.646435] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:19.665582] [DEBUG] [LOCAL ] STE: Loaded 35887 existing records from primary storage. [2025-10-03T22:45:19.665921] [INFO ] [MAIN ] STE: Loaded 35887 primary data records. [2025-10-03T22:45:19.771598] [DEBUG] [LOCAL ] STEL: Loaded 23455 existing records from primary storage. [2025-10-03T22:45:19.777155] [INFO ] [MAIN ] STEL: Loaded 23455 primary data records. [2025-10-03T22:45:20.198713] [DEBUG] [LOCAL ] STEM: Loaded 39914 existing records from primary storage. [2025-10-03T22:45:20.226119] [INFO ] [MAIN ] STEM: Loaded 39914 primary data records. [2025-10-03T22:45:20.753479] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:20.756547] [INFO ] [MAIN ] STE: Generated 1819 derivative records from 35887 primary records. [2025-10-03T22:45:20.757750] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-03T22:45:20.785692] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:20.787311] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 23455 primary records. [2025-10-03T22:45:20.787854] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-03T22:45:20.805520] [DEBUG] [LOCAL ] STE: Derivative data saved (1819 records). [2025-10-03T22:45:20.806806] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-03T22:45:20.809800] [INFO ] [MAIN ] Derivative Progress: 1729/2073 symbols completed. STE took 1.2s. Estimated remaining: 2m 20s. Rate: 147.6 symbols/min [2025-10-03T22:45:20.811741] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:20.829829] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:20.831363] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 39914 primary records. [2025-10-03T22:45:20.831441] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-03T22:45:20.845175] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-10-03T22:45:20.851046] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-03T22:45:20.862292] [INFO ] [MAIN ] Derivative Progress: 1730/2073 symbols completed. STEL took 1.3s. Estimated remaining: 2m 19s. Rate: 147.7 symbols/min [2025-10-03T22:45:20.863831] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-10-03T22:45:20.864201] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:20.864825] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-03T22:45:20.867903] [INFO ] [MAIN ] Derivative Progress: 1731/2073 symbols completed. STEM took 1.2s. Estimated remaining: 2m 19s. Rate: 147.8 symbols/min [2025-10-03T22:45:20.864044] [DEBUG] [LOCAL ] STEW: Loaded 16303 existing records from primary storage. [2025-10-03T22:45:20.868242] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:20.868886] [INFO ] [MAIN ] STEW: Loaded 16303 primary data records. [2025-10-03T22:45:20.956360] [DEBUG] [LOCAL ] STK: Loaded 9573 existing records from primary storage. [2025-10-03T22:45:20.983957] [INFO ] [MAIN ] STK: Loaded 9573 primary data records. [2025-10-03T22:45:21.542962] [DEBUG] [LOCAL ] STLA: Loaded 54321 existing records from primary storage. [2025-10-03T22:45:21.543220] [INFO ] [MAIN ] STLA: Loaded 54321 primary data records. [2025-10-03T22:45:21.869500] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:21.870766] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16303 primary records. [2025-10-03T22:45:21.871913] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-03T22:45:21.905895] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-10-03T22:45:21.906878] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:21.907215] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-03T22:45:21.910913] [INFO ] [MAIN ] Derivative Progress: 1732/2073 symbols completed. STEW took 1.1s. Estimated remaining: 2m 19s. Rate: 147.6 symbols/min [2025-10-03T22:45:21.908071] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9573 primary records. [2025-10-03T22:45:21.911448] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:21.911697] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-03T22:45:21.930366] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-10-03T22:45:21.930797] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-03T22:45:21.933710] [INFO ] [MAIN ] Derivative Progress: 1733/2073 symbols completed. STK took 1.1s. Estimated remaining: 2m 18s. Rate: 147.7 symbols/min [2025-10-03T22:45:21.933909] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:21.951260] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:21.952060] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54321 primary records. [2025-10-03T22:45:21.952174] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-03T22:45:21.975304] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-10-03T22:45:21.982155] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-03T22:45:21.983638] [DEBUG] [LOCAL ] STN: Loaded 23107 existing records from primary storage. [2025-10-03T22:45:21.986491] [INFO ] [MAIN ] Derivative Progress: 1734/2073 symbols completed. STLA took 1.1s. Estimated remaining: 2m 18s. Rate: 147.8 symbols/min [2025-10-03T22:45:21.986793] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:21.986663] [INFO ] [MAIN ] STN: Loaded 23107 primary data records. [2025-10-03T22:45:22.213301] [DEBUG] [LOCAL ] STM: Loaded 54355 existing records from primary storage. [2025-10-03T22:45:22.337704] [INFO ] [MAIN ] STM: Loaded 54355 primary data records. [2025-10-03T22:45:22.486766] [DEBUG] [LOCAL ] STNG: Loaded 44344 existing records from primary storage. [2025-10-03T22:45:22.516042] [INFO ] [MAIN ] STNG: Loaded 44344 primary data records. [2025-10-03T22:45:23.057828] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:23.058785] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23107 primary records. [2025-10-03T22:45:23.058882] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-03T22:45:23.077805] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-10-03T22:45:23.078071] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-03T22:45:23.080331] [INFO ] [MAIN ] Derivative Progress: 1735/2073 symbols completed. STN took 1.1s. Estimated remaining: 2m 17s. Rate: 147.7 symbols/min [2025-10-03T22:45:23.080621] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:23.101012] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:23.104679] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54355 primary records. [2025-10-03T22:45:23.104938] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-03T22:45:23.122318] [DEBUG] [LOCAL ] STRV: Loaded 11517 existing records from primary storage. [2025-10-03T22:45:23.126436] [INFO ] [MAIN ] STRV: Loaded 11517 primary data records. [2025-10-03T22:45:23.140838] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-10-03T22:45:23.172972] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-03T22:45:23.196317] [INFO ] [MAIN ] Derivative Progress: 1736/2073 symbols completed. STM took 1.3s. Estimated remaining: 2m 17s. Rate: 147.7 symbols/min [2025-10-03T22:45:23.209394] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:23.237828] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:23.249904] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44344 primary records. [2025-10-03T22:45:23.250101] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-03T22:45:23.468745] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-10-03T22:45:23.470264] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-03T22:45:23.473629] [INFO ] [MAIN ] Derivative Progress: 1737/2073 symbols completed. STNG took 1.5s. Estimated remaining: 2m 16s. Rate: 147.7 symbols/min [2025-10-03T22:45:23.473957] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:23.534572] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:23.535705] [DEBUG] [LOCAL ] STT: Loaded 51691 existing records from primary storage. [2025-10-03T22:45:23.536736] [INFO ] [MAIN ] STRV: Generated 1820 derivative records from 11517 primary records. [2025-10-03T22:45:23.544903] [INFO ] [MAIN ] STT: Loaded 51691 primary data records. [2025-10-03T22:45:23.545040] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-03T22:45:23.545625] [DEBUG] [LOCAL ] STVN: Loaded 26608 existing records from primary storage. [2025-10-03T22:45:23.563629] [INFO ] [MAIN ] STVN: Loaded 26608 primary data records. [2025-10-03T22:45:23.789609] [DEBUG] [LOCAL ] STRV: Derivative data saved (1820 records). [2025-10-03T22:45:23.790545] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-03T22:45:23.834545] [INFO ] [MAIN ] Derivative Progress: 1738/2073 symbols completed. STRV took 0.8s. Estimated remaining: 2m 16s. Rate: 147.8 symbols/min [2025-10-03T22:45:24.243798] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:24.243520] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:24.244583] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51691 primary records. [2025-10-03T22:45:24.244693] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-03T22:45:24.245256] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26608 primary records. [2025-10-03T22:45:24.245914] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-03T22:45:24.275418] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-10-03T22:45:24.276552] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-03T22:45:24.276482] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-10-03T22:45:24.276695] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-03T22:45:24.279250] [INFO ] [MAIN ] Derivative Progress: 1739/2073 symbols completed. STT took 1.1s. Estimated remaining: 2m 16s. Rate: 147.7 symbols/min [2025-10-03T22:45:24.281884] [INFO ] [MAIN ] Derivative Progress: 1740/2073 symbols completed. STVN took 0.8s. Estimated remaining: 2m 15s. Rate: 147.8 symbols/min [2025-10-03T22:45:24.282454] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:24.282604] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:24.283446] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:24.288408] [DEBUG] [LOCAL ] STXD: Loaded 1298 existing records from primary storage. [2025-10-03T22:45:24.290622] [DEBUG] [LOCAL ] STXE: Loaded 2216 existing records from primary storage. [2025-10-03T22:45:24.290761] [INFO ] [MAIN ] STXD: Loaded 1298 primary data records. [2025-10-03T22:45:24.290843] [INFO ] [MAIN ] STXE: Loaded 2216 primary data records. [2025-10-03T22:45:24.994785] [DEBUG] [LOCAL ] STWD: Loaded 52646 existing records from primary storage. [2025-10-03T22:45:24.995811] [INFO ] [MAIN ] STWD: Loaded 52646 primary data records. [2025-10-03T22:45:25.331723] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:25.333079] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2216 primary records. [2025-10-03T22:45:25.333254] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-03T22:45:25.356529] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:25.360881] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1298 primary records. [2025-10-03T22:45:25.364728] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-10-03T22:45:25.365569] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-03T22:45:25.366975] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-03T22:45:25.369797] [INFO ] [MAIN ] Derivative Progress: 1741/2073 symbols completed. STXE took 1.1s. Estimated remaining: 2m 15s. Rate: 147.7 symbols/min [2025-10-03T22:45:25.381575] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:25.385895] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-10-03T22:45:25.386142] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-03T22:45:25.389303] [INFO ] [MAIN ] Derivative Progress: 1742/2073 symbols completed. STXD took 1.1s. Estimated remaining: 2m 14s. Rate: 147.8 symbols/min [2025-10-03T22:45:25.390095] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:25.395768] [DEBUG] [LOCAL ] STXG: Loaded 2533 existing records from primary storage. [2025-10-03T22:45:25.398986] [DEBUG] [LOCAL ] STXK: Loaded 1503 existing records from primary storage. [2025-10-03T22:45:25.400309] [INFO ] [MAIN ] STXK: Loaded 1503 primary data records. [2025-10-03T22:45:25.400416] [INFO ] [MAIN ] STXG: Loaded 2533 primary data records. [2025-10-03T22:45:25.593485] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:25.643009] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52646 primary records. [2025-10-03T22:45:25.643293] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-03T22:45:26.074114] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-10-03T22:45:26.075781] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-03T22:45:26.078566] [INFO ] [MAIN ] Derivative Progress: 1743/2073 symbols completed. STWD took 1.8s. Estimated remaining: 2m 14s. Rate: 147.7 symbols/min [2025-10-03T22:45:26.079193] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:26.088924] [DEBUG] [LOCAL ] STXT: Loaded 2568 existing records from primary storage. [2025-10-03T22:45:26.089332] [INFO ] [MAIN ] STXT: Loaded 2568 primary data records. [2025-10-03T22:45:26.475507] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:26.503635] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2533 primary records. [2025-10-03T22:45:26.504024] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:26.504859] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-03T22:45:26.505561] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1503 primary records. [2025-10-03T22:45:26.506132] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-03T22:45:26.535008] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-10-03T22:45:26.535139] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-03T22:45:26.538042] [INFO ] [MAIN ] Derivative Progress: 1744/2073 symbols completed. STXK took 1.1s. Estimated remaining: 2m 14s. Rate: 147.7 symbols/min [2025-10-03T22:45:26.538548] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:26.543923] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-10-03T22:45:26.544184] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-03T22:45:26.547053] [INFO ] [MAIN ] Derivative Progress: 1745/2073 symbols completed. STXG took 1.2s. Estimated remaining: 2m 13s. Rate: 147.8 symbols/min [2025-10-03T22:45:26.547724] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:26.566918] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:45:26.567617] [INFO ] [MAIN ] STXT: Generated 1819 derivative records from 2568 primary records. [2025-10-03T22:45:26.567881] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-03T22:45:26.601739] [DEBUG] [LOCAL ] STXT: Derivative data saved (1819 records). [2025-10-03T22:45:26.601894] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-03T22:45:26.604521] [INFO ] [MAIN ] Derivative Progress: 1746/2073 symbols completed. STXT took 0.5s. Estimated remaining: 2m 13s. Rate: 147.9 symbols/min [2025-10-03T22:45:26.604771] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:26.642913] [DEBUG] [LOCAL ] STZ: Loaded 53064 existing records from primary storage. [2025-10-03T22:45:26.643183] [INFO ] [MAIN ] STZ: Loaded 53064 primary data records. [2025-10-03T22:45:26.773579] [DEBUG] [LOCAL ] SU: Loaded 54223 existing records from primary storage. [2025-10-03T22:45:26.785506] [INFO ] [MAIN ] SU: Loaded 54223 primary data records. [2025-10-03T22:45:26.944731] [DEBUG] [LOCAL ] SUI: Loaded 42248 existing records from primary storage. [2025-10-03T22:45:26.968459] [INFO ] [MAIN ] SUI: Loaded 42248 primary data records. [2025-10-03T22:45:27.641618] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:27.643292] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53064 primary records. [2025-10-03T22:45:27.644453] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-03T22:45:27.685670] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-10-03T22:45:27.685536] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:27.699078] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-03T22:45:27.703191] [INFO ] [MAIN ] Derivative Progress: 1747/2073 symbols completed. STZ took 1.2s. Estimated remaining: 2m 12s. Rate: 147.7 symbols/min [2025-10-03T22:45:27.700304] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54223 primary records. [2025-10-03T22:45:27.703575] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:27.700742] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:27.704243] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-03T22:45:27.705730] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42248 primary records. [2025-10-03T22:45:27.706594] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-03T22:45:27.743298] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-10-03T22:45:27.743850] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-03T22:45:27.747018] [INFO ] [MAIN ] Derivative Progress: 1748/2073 symbols completed. SU took 1.2s. Estimated remaining: 2m 12s. Rate: 147.8 symbols/min [2025-10-03T22:45:27.747846] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-10-03T22:45:27.757908] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:27.758173] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-03T22:45:27.761668] [INFO ] [MAIN ] Derivative Progress: 1749/2073 symbols completed. SUI took 1.2s. Estimated remaining: 2m 11s. Rate: 147.9 symbols/min [2025-10-03T22:45:27.762051] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:27.778236] [DEBUG] [LOCAL ] SUN: Loaded 38153 existing records from primary storage. [2025-10-03T22:45:27.778485] [INFO ] [MAIN ] SUN: Loaded 38153 primary data records. [2025-10-03T22:45:28.128600] [DEBUG] [LOCAL ] SUPV: Loaded 48056 existing records from primary storage. [2025-10-03T22:45:28.141703] [INFO ] [MAIN ] SUPV: Loaded 48056 primary data records. [2025-10-03T22:45:28.153970] [DEBUG] [LOCAL ] SUZ: Loaded 46242 existing records from primary storage. [2025-10-03T22:45:28.180094] [INFO ] [MAIN ] SUZ: Loaded 46242 primary data records. [2025-10-03T22:45:28.850398] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:28.852511] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 38153 primary records. [2025-10-03T22:45:28.853050] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-03T22:45:28.877128] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-10-03T22:45:28.878370] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-03T22:45:28.894577] [INFO ] [MAIN ] Derivative Progress: 1750/2073 symbols completed. SUN took 1.2s. Estimated remaining: 2m 11s. Rate: 147.7 symbols/min [2025-10-03T22:45:28.895204] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:28.895539] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:28.896492] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46242 primary records. [2025-10-03T22:45:28.896980] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-03T22:45:28.925200] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:28.927003] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 48056 primary records. [2025-10-03T22:45:28.927364] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-03T22:45:28.929252] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-10-03T22:45:28.929751] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-03T22:45:28.936136] [INFO ] [MAIN ] Derivative Progress: 1751/2073 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 11s. Rate: 147.8 symbols/min [2025-10-03T22:45:28.948089] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:28.965612] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-10-03T22:45:28.965865] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-03T22:45:28.968183] [INFO ] [MAIN ] Derivative Progress: 1752/2073 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 10s. Rate: 147.9 symbols/min [2025-10-03T22:45:28.968476] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:28.988345] [DEBUG] [LOCAL ] SVV: Loaded 40338 existing records from primary storage. [2025-10-03T22:45:28.988609] [INFO ] [MAIN ] SVV: Loaded 40338 primary data records. [2025-10-03T22:45:29.343475] [DEBUG] [LOCAL ] SW: Loaded 53942 existing records from primary storage. [2025-10-03T22:45:29.357005] [INFO ] [MAIN ] SW: Loaded 53942 primary data records. [2025-10-03T22:45:29.416814] [DEBUG] [LOCAL ] SWK: Loaded 53135 existing records from primary storage. [2025-10-03T22:45:29.454939] [INFO ] [MAIN ] SWK: Loaded 53135 primary data records. [2025-10-03T22:45:30.046304] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:30.047629] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40338 primary records. [2025-10-03T22:45:30.048501] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-03T22:45:30.071959] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-10-03T22:45:30.072164] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-03T22:45:30.074815] [INFO ] [MAIN ] Derivative Progress: 1753/2073 symbols completed. SVV took 1.2s. Estimated remaining: 2m 10s. Rate: 147.7 symbols/min [2025-10-03T22:45:30.092829] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:30.093786] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53942 primary records. [2025-10-03T22:45:30.094038] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-03T22:45:30.117350] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-10-03T22:45:30.130569] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-03T22:45:30.132901] [INFO ] [MAIN ] Derivative Progress: 1754/2073 symbols completed. SW took 1.2s. Estimated remaining: 2m 10s. Rate: 147.8 symbols/min [2025-10-03T22:45:30.130492] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:30.134019] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53135 primary records. [2025-10-03T22:45:30.134087] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-03T22:45:30.150069] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-10-03T22:45:30.150191] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-03T22:45:30.152770] [INFO ] [MAIN ] Derivative Progress: 1755/2073 symbols completed. SWK took 1.2s. Estimated remaining: 2m 9s. Rate: 147.9 symbols/min [2025-10-03T22:45:30.153417] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:30.153306] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:30.153519] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:30.163173] [DEBUG] [LOCAL ] SWZ: Loaded 6092 existing records from primary storage. [2025-10-03T22:45:30.163424] [INFO ] [MAIN ] SWZ: Loaded 6092 primary data records. [2025-10-03T22:45:30.357741] [DEBUG] [LOCAL ] SWX: Loaded 31444 existing records from primary storage. [2025-10-03T22:45:30.395300] [INFO ] [MAIN ] SWX: Loaded 31444 primary data records. [2025-10-03T22:45:30.590143] [DEBUG] [LOCAL ] SXC: Loaded 42071 existing records from primary storage. [2025-10-03T22:45:30.606223] [INFO ] [MAIN ] SXC: Loaded 42071 primary data records. [2025-10-03T22:45:31.268169] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:31.269715] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6092 primary records. [2025-10-03T22:45:31.269973] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-03T22:45:31.291997] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-10-03T22:45:31.292279] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-03T22:45:31.294887] [INFO ] [MAIN ] Derivative Progress: 1756/2073 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 9s. Rate: 147.7 symbols/min [2025-10-03T22:45:31.296027] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:31.312846] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:31.313857] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31444 primary records. [2025-10-03T22:45:31.313991] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-03T22:45:31.354595] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:31.354717] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-10-03T22:45:31.354992] [DEBUG] [LOCAL ] SXI: Loaded 11760 existing records from primary storage. [2025-10-03T22:45:31.355952] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42071 primary records. [2025-10-03T22:45:31.356324] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-03T22:45:31.356255] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-03T22:45:31.359174] [INFO ] [MAIN ] Derivative Progress: 1757/2073 symbols completed. SWX took 1.2s. Estimated remaining: 2m 8s. Rate: 147.8 symbols/min [2025-10-03T22:45:31.359819] [INFO ] [MAIN ] SXI: Loaded 11760 primary data records. [2025-10-03T22:45:31.360289] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:31.387830] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-10-03T22:45:31.397936] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-03T22:45:31.437295] [INFO ] [MAIN ] Derivative Progress: 1758/2073 symbols completed. SXC took 1.3s. Estimated remaining: 2m 8s. Rate: 147.9 symbols/min [2025-10-03T22:45:31.485628] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:31.705286] [DEBUG] [LOCAL ] SXT: Loaded 29985 existing records from primary storage. [2025-10-03T22:45:31.705635] [INFO ] [MAIN ] SXT: Loaded 29985 primary data records. [2025-10-03T22:45:32.064173] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-10-03T22:45:32.066159] [INFO ] [MAIN ] SYF: Loaded 54222 primary data records. [2025-10-03T22:45:32.173176] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:32.188578] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11760 primary records. [2025-10-03T22:45:32.192369] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-03T22:45:32.420858] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-10-03T22:45:32.421992] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-03T22:45:32.424302] [INFO ] [MAIN ] Derivative Progress: 1759/2073 symbols completed. SXI took 1.1s. Estimated remaining: 2m 8s. Rate: 147.7 symbols/min [2025-10-03T22:45:32.424553] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:32.443639] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:32.444881] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 29985 primary records. [2025-10-03T22:45:32.445075] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-03T22:45:32.464919] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-10-03T22:45:32.466063] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-03T22:45:32.470209] [INFO ] [MAIN ] Derivative Progress: 1760/2073 symbols completed. SXT took 1.1s. Estimated remaining: 2m 7s. Rate: 147.8 symbols/min [2025-10-03T22:45:32.470628] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:32.484429] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:32.485224] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54222 primary records. [2025-10-03T22:45:32.485408] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-03T22:45:32.513211] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-10-03T22:45:32.513459] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-03T22:45:32.516212] [INFO ] [MAIN ] Derivative Progress: 1761/2073 symbols completed. SYF took 1.0s. Estimated remaining: 2m 7s. Rate: 147.9 symbols/min [2025-10-03T22:45:32.517174] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:32.531841] [DEBUG] [LOCAL ] SYK: Loaded 47617 existing records from primary storage. [2025-10-03T22:45:32.532057] [INFO ] [MAIN ] SYK: Loaded 47617 primary data records. [2025-10-03T22:45:32.887044] [DEBUG] [LOCAL ] SYY: Loaded 53996 existing records from primary storage. [2025-10-03T22:45:32.915174] [INFO ] [MAIN ] SYY: Loaded 53996 primary data records. [2025-10-03T22:45:33.053737] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-03T22:45:33.098193] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-10-03T22:45:33.583940] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:33.584888] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47617 primary records. [2025-10-03T22:45:33.585302] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-03T22:45:33.610339] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-10-03T22:45:33.611186] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-03T22:45:33.614638] [INFO ] [MAIN ] Derivative Progress: 1762/2073 symbols completed. SYK took 1.2s. Estimated remaining: 2m 6s. Rate: 147.7 symbols/min [2025-10-03T22:45:33.616411] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:33.630523] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:33.631385] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 53996 primary records. [2025-10-03T22:45:33.631922] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-03T22:45:33.656058] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-10-03T22:45:33.656714] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-03T22:45:33.659808] [INFO ] [MAIN ] Derivative Progress: 1763/2073 symbols completed. SYY took 1.2s. Estimated remaining: 2m 6s. Rate: 147.8 symbols/min [2025-10-03T22:45:33.668437] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:33.674505] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:33.685577] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-10-03T22:45:33.685937] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-03T22:45:33.704025] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-10-03T22:45:33.718131] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-03T22:45:33.721366] [INFO ] [MAIN ] Derivative Progress: 1764/2073 symbols completed. T took 1.2s. Estimated remaining: 2m 5s. Rate: 147.9 symbols/min [2025-10-03T22:45:33.721736] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:33.726341] [DEBUG] [LOCAL ] TAC: Loaded 43221 existing records from primary storage. [2025-10-03T22:45:33.726621] [INFO ] [MAIN ] TAC: Loaded 43221 primary data records. [2025-10-03T22:45:34.078047] [DEBUG] [LOCAL ] TAK: Loaded 50548 existing records from primary storage. [2025-10-03T22:45:34.078303] [INFO ] [MAIN ] TAK: Loaded 50548 primary data records. [2025-10-03T22:45:34.205350] [DEBUG] [LOCAL ] TAL: Loaded 52687 existing records from primary storage. [2025-10-03T22:45:34.248462] [INFO ] [MAIN ] TAL: Loaded 52687 primary data records. [2025-10-03T22:45:34.795622] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:34.797208] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43221 primary records. [2025-10-03T22:45:34.798190] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-03T22:45:34.821473] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-10-03T22:45:34.834271] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-03T22:45:34.836998] [INFO ] [MAIN ] Derivative Progress: 1765/2073 symbols completed. TAC took 1.2s. Estimated remaining: 2m 5s. Rate: 147.7 symbols/min [2025-10-03T22:45:34.837440] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:34.838369] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50548 primary records. [2025-10-03T22:45:34.838801] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-03T22:45:34.838897] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:34.857767] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-10-03T22:45:34.860096] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-03T22:45:34.863433] [INFO ] [MAIN ] Derivative Progress: 1766/2073 symbols completed. TAK took 1.2s. Estimated remaining: 2m 5s. Rate: 147.8 symbols/min [2025-10-03T22:45:34.863939] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:34.877859] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:34.878628] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52687 primary records. [2025-10-03T22:45:34.878824] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-03T22:45:34.898266] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-10-03T22:45:34.898619] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-03T22:45:34.901189] [INFO ] [MAIN ] Derivative Progress: 1767/2073 symbols completed. TAL took 1.2s. Estimated remaining: 2m 4s. Rate: 147.9 symbols/min [2025-10-03T22:45:34.901359] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:34.930674] [DEBUG] [LOCAL ] TBB: Loaded 11836 existing records from primary storage. [2025-10-03T22:45:34.930842] [INFO ] [MAIN ] TBB: Loaded 11836 primary data records. [2025-10-03T22:45:35.066826] [DEBUG] [LOCAL ] TALO: Loaded 51515 existing records from primary storage. [2025-10-03T22:45:35.071302] [INFO ] [MAIN ] TALO: Loaded 51515 primary data records. [2025-10-03T22:45:35.253247] [DEBUG] [LOCAL ] TAP: Loaded 53666 existing records from primary storage. [2025-10-03T22:45:35.374378] [INFO ] [MAIN ] TAP: Loaded 53666 primary data records. [2025-10-03T22:45:35.927070] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:35.929858] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11836 primary records. [2025-10-03T22:45:35.930252] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-03T22:45:35.951169] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-10-03T22:45:35.951382] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-03T22:45:35.966606] [INFO ] [MAIN ] Derivative Progress: 1768/2073 symbols completed. TBB took 1.1s. Estimated remaining: 2m 4s. Rate: 147.8 symbols/min [2025-10-03T22:45:35.967530] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:35.968432] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51515 primary records. [2025-10-03T22:45:35.968679] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-03T22:45:36.000182] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-10-03T22:45:36.000103] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:36.000336] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-03T22:45:36.001059] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53666 primary records. [2025-10-03T22:45:36.003436] [INFO ] [MAIN ] Derivative Progress: 1769/2073 symbols completed. TALO took 1.2s. Estimated remaining: 2m 3s. Rate: 147.8 symbols/min [2025-10-03T22:45:36.001147] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-03T22:45:36.019358] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-10-03T22:45:36.019423] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-03T22:45:36.021993] [INFO ] [MAIN ] Derivative Progress: 1770/2073 symbols completed. TAP took 1.2s. Estimated remaining: 2m 3s. Rate: 147.9 symbols/min [2025-10-03T22:45:36.022510] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:36.022597] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:36.022421] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:36.030295] [DEBUG] [LOCAL ] TBN: Loaded 3742 existing records from primary storage. [2025-10-03T22:45:36.030428] [INFO ] [MAIN ] TBN: Loaded 3742 primary data records. [2025-10-03T22:45:36.402112] [DEBUG] [LOCAL ] TD: Loaded 53053 existing records from primary storage. [2025-10-03T22:45:36.401269] [DEBUG] [LOCAL ] TBBB: Loaded 36157 existing records from primary storage. [2025-10-03T22:45:36.402486] [INFO ] [MAIN ] TBBB: Loaded 36157 primary data records. [2025-10-03T22:45:36.402606] [INFO ] [MAIN ] TD: Loaded 53053 primary data records. [2025-10-03T22:45:37.120022] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-03T22:45:37.121107] [INFO ] [MAIN ] TBN: Generated 1817 derivative records from 3742 primary records. [2025-10-03T22:45:37.124126] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-03T22:45:37.139422] [DEBUG] [LOCAL ] TBN: Derivative data saved (1817 records). [2025-10-03T22:45:37.139794] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-03T22:45:37.142469] [INFO ] [MAIN ] Derivative Progress: 1771/2073 symbols completed. TBN took 1.1s. Estimated remaining: 2m 3s. Rate: 147.8 symbols/min [2025-10-03T22:45:37.142792] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:37.177515] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:37.177244] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:37.178674] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53053 primary records. [2025-10-03T22:45:37.179520] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36157 primary records. [2025-10-03T22:45:37.179623] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-03T22:45:37.179757] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-03T22:45:37.212538] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-10-03T22:45:37.222455] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-03T22:45:37.224964] [INFO ] [MAIN ] Derivative Progress: 1772/2073 symbols completed. TD took 1.2s. Estimated remaining: 2m 2s. Rate: 147.8 symbols/min [2025-10-03T22:45:37.225576] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:37.227172] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-10-03T22:45:37.227268] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-03T22:45:37.233500] [INFO ] [MAIN ] Derivative Progress: 1773/2073 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 2s. Rate: 147.9 symbols/min [2025-10-03T22:45:37.233742] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:37.251739] [DEBUG] [LOCAL ] TDC: Loaded 47312 existing records from primary storage. [2025-10-03T22:45:37.255263] [DEBUG] [LOCAL ] TDF: Loaded 6491 existing records from primary storage. [2025-10-03T22:45:37.255445] [INFO ] [MAIN ] TDF: Loaded 6491 primary data records. [2025-10-03T22:45:37.260967] [INFO ] [MAIN ] TDC: Loaded 47312 primary data records. [2025-10-03T22:45:37.524815] [DEBUG] [LOCAL ] TDG: Loaded 22334 existing records from primary storage. [2025-10-03T22:45:37.563133] [INFO ] [MAIN ] TDG: Loaded 22334 primary data records. [2025-10-03T22:45:38.221405] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:38.224119] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47312 primary records. [2025-10-03T22:45:38.224523] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-03T22:45:38.256193] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:38.265112] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6491 primary records. [2025-10-03T22:45:38.270326] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-03T22:45:38.270234] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-10-03T22:45:38.270508] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-03T22:45:38.274669] [INFO ] [MAIN ] Derivative Progress: 1774/2073 symbols completed. TDC took 1.1s. Estimated remaining: 2m 1s. Rate: 147.8 symbols/min [2025-10-03T22:45:38.275026] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:38.275144] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:38.276069] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22334 primary records. [2025-10-03T22:45:38.276939] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-03T22:45:38.306994] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-10-03T22:45:38.307380] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-03T22:45:38.310023] [INFO ] [MAIN ] Derivative Progress: 1775/2073 symbols completed. TDF took 1.1s. Estimated remaining: 2m 1s. Rate: 147.9 symbols/min [2025-10-03T22:45:38.310310] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:38.313629] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-10-03T22:45:38.313729] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-03T22:45:38.316004] [INFO ] [MAIN ] Derivative Progress: 1776/2073 symbols completed. TDG took 1.1s. Estimated remaining: 2m 0s. Rate: 147.9 symbols/min [2025-10-03T22:45:38.316175] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:38.407108] [DEBUG] [LOCAL ] TDS: Loaded 43412 existing records from primary storage. [2025-10-03T22:45:38.419677] [INFO ] [MAIN ] TDS: Loaded 43412 primary data records. [2025-10-03T22:45:38.421062] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-10-03T22:45:38.433022] [INFO ] [MAIN ] TDOC: Loaded 54125 primary data records. [2025-10-03T22:45:38.443475] [DEBUG] [LOCAL ] TDW: Loaded 45933 existing records from primary storage. [2025-10-03T22:45:38.459429] [INFO ] [MAIN ] TDW: Loaded 45933 primary data records. [2025-10-03T22:45:39.438894] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:39.439786] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43412 primary records. [2025-10-03T22:45:39.439955] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-03T22:45:39.470869] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-10-03T22:45:39.470760] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:39.473121] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 45933 primary records. [2025-10-03T22:45:39.473348] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-03T22:45:39.475392] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-03T22:45:39.475323] [INFO ] [MAIN ] Derivative Progress: 1777/2073 symbols completed. TDS took 1.2s. Estimated remaining: 2m 0s. Rate: 147.8 symbols/min [2025-10-03T22:45:39.476453] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:39.505713] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-10-03T22:45:39.506136] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-03T22:45:39.508916] [INFO ] [MAIN ] Derivative Progress: 1778/2073 symbols completed. TDW took 1.2s. Estimated remaining: 1m 60s. Rate: 147.9 symbols/min [2025-10-03T22:45:39.509429] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:39.509626] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:39.510957] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54125 primary records. [2025-10-03T22:45:39.511141] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-03T22:45:39.549127] [DEBUG] [LOCAL ] TDY: Loaded 22797 existing records from primary storage. [2025-10-03T22:45:39.549829] [INFO ] [MAIN ] TDY: Loaded 22797 primary data records. [2025-10-03T22:45:39.550740] [DEBUG] [LOCAL ] TEAF: Loaded 7714 existing records from primary storage. [2025-10-03T22:45:39.551089] [INFO ] [MAIN ] TEAF: Loaded 7714 primary data records. [2025-10-03T22:45:39.585019] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-10-03T22:45:39.600399] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-03T22:45:39.646716] [INFO ] [MAIN ] Derivative Progress: 1779/2073 symbols completed. TDOC took 1.4s. Estimated remaining: 1m 59s. Rate: 147.9 symbols/min [2025-10-03T22:45:39.662883] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:40.206974] [DEBUG] [LOCAL ] TECK: Loaded 54210 existing records from primary storage. [2025-10-03T22:45:40.207932] [INFO ] [MAIN ] TECK: Loaded 54210 primary data records. [2025-10-03T22:45:40.411578] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:40.428231] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7714 primary records. [2025-10-03T22:45:40.532082] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-03T22:45:40.546273] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:40.547403] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22797 primary records. [2025-10-03T22:45:40.548024] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-03T22:45:40.578931] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-10-03T22:45:40.580113] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-03T22:45:40.582479] [INFO ] [MAIN ] Derivative Progress: 1780/2073 symbols completed. TDY took 1.1s. Estimated remaining: 1m 59s. Rate: 147.8 symbols/min [2025-10-03T22:45:40.582663] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:40.587132] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-10-03T22:45:40.587283] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-03T22:45:40.589721] [INFO ] [MAIN ] Derivative Progress: 1781/2073 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 58s. Rate: 147.9 symbols/min [2025-10-03T22:45:40.590030] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:40.610425] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:40.611352] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54210 primary records. [2025-10-03T22:45:40.611554] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-03T22:45:40.646712] [DEBUG] [LOCAL ] TEI: Loaded 21500 existing records from primary storage. [2025-10-03T22:45:40.647537] [INFO ] [MAIN ] TEI: Loaded 21500 primary data records. [2025-10-03T22:45:40.681035] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-10-03T22:45:40.686381] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-03T22:45:40.717183] [INFO ] [MAIN ] Derivative Progress: 1782/2073 symbols completed. TECK took 1.1s. Estimated remaining: 1m 58s. Rate: 148.0 symbols/min [2025-10-03T22:45:40.744451] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:40.763960] [DEBUG] [LOCAL ] TEF: Loaded 37912 existing records from primary storage. [2025-10-03T22:45:40.767327] [INFO ] [MAIN ] TEF: Loaded 37912 primary data records. [2025-10-03T22:45:41.363028] [DEBUG] [LOCAL ] TEL: Loaded 51844 existing records from primary storage. [2025-10-03T22:45:41.363896] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:41.364638] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 21500 primary records. [2025-10-03T22:45:41.363573] [INFO ] [MAIN ] TEL: Loaded 51844 primary data records. [2025-10-03T22:45:41.364936] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-03T22:45:41.589030] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-10-03T22:45:41.589639] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:41.708793] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-03T22:45:41.709853] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37912 primary records. [2025-10-03T22:45:41.712169] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-03T22:45:41.711957] [INFO ] [MAIN ] Derivative Progress: 1783/2073 symbols completed. TEI took 1.1s. Estimated remaining: 1m 58s. Rate: 147.8 symbols/min [2025-10-03T22:45:41.732017] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-10-03T22:45:41.732685] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-03T22:45:41.735197] [INFO ] [MAIN ] Derivative Progress: 1784/2073 symbols completed. TEF took 1.2s. Estimated remaining: 1m 57s. Rate: 147.9 symbols/min [2025-10-03T22:45:41.754947] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:41.755536] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51844 primary records. [2025-10-03T22:45:41.755600] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-03T22:45:41.771578] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-10-03T22:45:41.771659] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-03T22:45:41.774355] [INFO ] [MAIN ] Derivative Progress: 1785/2073 symbols completed. TEL took 1.0s. Estimated remaining: 1m 57s. Rate: 148.0 symbols/min [2025-10-03T22:45:41.774887] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:41.774778] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:41.774997] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:41.817119] [DEBUG] [LOCAL ] TEO: Loaded 22391 existing records from primary storage. [2025-10-03T22:45:41.817437] [INFO ] [MAIN ] TEO: Loaded 22391 primary data records. [2025-10-03T22:45:41.936989] [DEBUG] [LOCAL ] TEN: Loaded 31002 existing records from primary storage. [2025-10-03T22:45:41.940747] [INFO ] [MAIN ] TEN: Loaded 31002 primary data records. [2025-10-03T22:45:42.328260] [DEBUG] [LOCAL ] TEVA: Loaded 54412 existing records from primary storage. [2025-10-03T22:45:42.354217] [INFO ] [MAIN ] TEVA: Loaded 54412 primary data records. [2025-10-03T22:45:42.875184] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:42.875742] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:42.876486] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 31002 primary records. [2025-10-03T22:45:42.877621] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22391 primary records. [2025-10-03T22:45:42.878489] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-03T22:45:42.878547] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-03T22:45:42.909287] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-10-03T22:45:42.911525] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-03T22:45:42.915765] [INFO ] [MAIN ] Derivative Progress: 1786/2073 symbols completed. TEO took 1.1s. Estimated remaining: 1m 56s. Rate: 147.8 symbols/min [2025-10-03T22:45:42.916055] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:42.916976] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-10-03T22:45:42.917239] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-03T22:45:42.919696] [INFO ] [MAIN ] Derivative Progress: 1787/2073 symbols completed. TEN took 1.1s. Estimated remaining: 1m 56s. Rate: 147.9 symbols/min [2025-10-03T22:45:42.920348] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:42.938221] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:42.939326] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54412 primary records. [2025-10-03T22:45:42.939494] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-03T22:45:42.963083] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-10-03T22:45:42.966765] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-03T22:45:42.969397] [INFO ] [MAIN ] Derivative Progress: 1788/2073 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 56s. Rate: 148.0 symbols/min [2025-10-03T22:45:42.969715] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:43.017520] [DEBUG] [LOCAL ] TEX: Loaded 44788 existing records from primary storage. [2025-10-03T22:45:43.018526] [INFO ] [MAIN ] TEX: Loaded 44788 primary data records. [2025-10-03T22:45:43.115006] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-03T22:45:43.127386] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-10-03T22:45:43.315569] [DEBUG] [LOCAL ] TFII: Loaded 34124 existing records from primary storage. [2025-10-03T22:45:43.472031] [INFO ] [MAIN ] TFII: Loaded 34124 primary data records. [2025-10-03T22:45:44.018584] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:44.019446] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 44788 primary records. [2025-10-03T22:45:44.019542] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-03T22:45:44.039350] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-10-03T22:45:44.040284] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-03T22:45:44.042835] [INFO ] [MAIN ] Derivative Progress: 1789/2073 symbols completed. TEX took 1.1s. Estimated remaining: 1m 55s. Rate: 147.9 symbols/min [2025-10-03T22:45:44.043302] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:44.057439] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:44.060331] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-10-03T22:45:44.061187] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-03T22:45:44.087177] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:44.089072] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 34124 primary records. [2025-10-03T22:45:44.089707] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-03T22:45:44.107209] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-10-03T22:45:44.110887] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-03T22:45:44.113275] [INFO ] [MAIN ] Derivative Progress: 1790/2073 symbols completed. TFC took 1.2s. Estimated remaining: 1m 55s. Rate: 147.9 symbols/min [2025-10-03T22:45:44.114837] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:44.126633] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-10-03T22:45:44.128233] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-03T22:45:44.128748] [DEBUG] [LOCAL ] TFIN: Loaded 23791 existing records from primary storage. [2025-10-03T22:45:44.132637] [INFO ] [MAIN ] Derivative Progress: 1791/2073 symbols completed. TFII took 1.2s. Estimated remaining: 1m 54s. Rate: 148.0 symbols/min [2025-10-03T22:45:44.133036] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:44.133212] [INFO ] [MAIN ] TFIN: Loaded 23791 primary data records. [2025-10-03T22:45:44.483582] [DEBUG] [LOCAL ] TFPM: Loaded 38599 existing records from primary storage. [2025-10-03T22:45:44.483948] [INFO ] [MAIN ] TFPM: Loaded 38599 primary data records. [2025-10-03T22:45:44.509471] [DEBUG] [LOCAL ] TFX: Loaded 37698 existing records from primary storage. [2025-10-03T22:45:44.515294] [INFO ] [MAIN ] TFX: Loaded 37698 primary data records. [2025-10-03T22:45:45.223110] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:45.225324] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23791 primary records. [2025-10-03T22:45:45.225460] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-03T22:45:45.250530] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-10-03T22:45:45.251179] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-03T22:45:45.253932] [INFO ] [MAIN ] Derivative Progress: 1792/2073 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 54s. Rate: 147.9 symbols/min [2025-10-03T22:45:45.255215] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:45.293010] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:45.292700] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:45.299108] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 37698 primary records. [2025-10-03T22:45:45.299451] [DEBUG] [LOCAL ] TG: Loaded 10546 existing records from primary storage. [2025-10-03T22:45:45.298461] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 38599 primary records. [2025-10-03T22:45:45.299552] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-03T22:45:45.300631] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-03T22:45:45.300574] [INFO ] [MAIN ] TG: Loaded 10546 primary data records. [2025-10-03T22:45:45.454435] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-10-03T22:45:45.476401] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-03T22:45:45.481687] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-10-03T22:45:45.532368] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-03T22:45:45.541828] [INFO ] [MAIN ] Derivative Progress: 1793/2073 symbols completed. TFX took 1.4s. Estimated remaining: 1m 54s. Rate: 147.9 symbols/min [2025-10-03T22:45:45.544516] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:45.601306] [INFO ] [MAIN ] Derivative Progress: 1794/2073 symbols completed. TFPM took 1.4s. Estimated remaining: 1m 53s. Rate: 148.0 symbols/min [2025-10-03T22:45:45.675989] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:45.705753] [DEBUG] [LOCAL ] TGLS: Loaded 28366 existing records from primary storage. [2025-10-03T22:45:45.706225] [INFO ] [MAIN ] TGLS: Loaded 28366 primary data records. [2025-10-03T22:45:45.816632] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:45.837064] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10546 primary records. [2025-10-03T22:45:45.849410] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-03T22:45:45.967259] [DEBUG] [LOCAL ] TGNA: Loaded 49393 existing records from primary storage. [2025-10-03T22:45:46.071819] [INFO ] [MAIN ] TGNA: Loaded 49393 primary data records. [2025-10-03T22:45:46.100849] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-10-03T22:45:46.116065] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-03T22:45:46.123584] [INFO ] [MAIN ] Derivative Progress: 1795/2073 symbols completed. TG took 0.9s. Estimated remaining: 1m 53s. Rate: 147.9 symbols/min [2025-10-03T22:45:46.124996] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:46.515386] [DEBUG] [LOCAL ] TGS: Loaded 33439 existing records from primary storage. [2025-10-03T22:45:46.516587] [INFO ] [MAIN ] TGS: Loaded 33439 primary data records. [2025-10-03T22:45:46.635695] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:46.640107] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 28366 primary records. [2025-10-03T22:45:46.640497] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-03T22:45:46.736745] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-10-03T22:45:46.839066] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-03T22:45:46.855697] [INFO ] [MAIN ] Derivative Progress: 1796/2073 symbols completed. TGLS took 1.3s. Estimated remaining: 1m 52s. Rate: 147.9 symbols/min [2025-10-03T22:45:46.856031] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:46.878015] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:46.878921] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49393 primary records. [2025-10-03T22:45:46.879081] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-03T22:45:46.897980] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-10-03T22:45:46.898281] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-03T22:45:46.900692] [INFO ] [MAIN ] Derivative Progress: 1797/2073 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 52s. Rate: 147.9 symbols/min [2025-10-03T22:45:46.901205] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:46.932364] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:46.933194] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33439 primary records. [2025-10-03T22:45:46.933317] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-03T22:45:46.967769] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-10-03T22:45:46.968299] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-10-03T22:45:46.968589] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-10-03T22:45:46.968932] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-03T22:45:46.983273] [INFO ] [MAIN ] Derivative Progress: 1798/2073 symbols completed. TGS took 0.9s. Estimated remaining: 1m 51s. Rate: 148.0 symbols/min [2025-10-03T22:45:47.325352] [DEBUG] [LOCAL ] THC: Loaded 48248 existing records from primary storage. [2025-10-03T22:45:47.333914] [INFO ] [MAIN ] THC: Loaded 48248 primary data records. [2025-10-03T22:45:47.654908] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:47.656797] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-10-03T22:45:47.656989] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-03T22:45:47.674671] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-10-03T22:45:47.674828] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-03T22:45:47.677607] [INFO ] [MAIN ] Derivative Progress: 1799/2073 symbols completed. TGT took 0.8s. Estimated remaining: 1m 51s. Rate: 147.9 symbols/min [2025-10-03T22:45:47.694123] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:47.694785] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 48248 primary records. [2025-10-03T22:45:47.694848] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-03T22:45:47.711183] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-10-03T22:45:47.711248] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-03T22:45:47.713669] [INFO ] [MAIN ] Derivative Progress: 1800/2073 symbols completed. THC took 0.8s. Estimated remaining: 1m 51s. Rate: 148.0 symbols/min [2025-10-03T22:45:47.714252] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:47.714523] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:47.714382] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:47.721568] [DEBUG] [LOCAL ] THLV: Loaded 1560 existing records from primary storage. [2025-10-03T22:45:47.724338] [INFO ] [MAIN ] THLV: Loaded 1560 primary data records. [2025-10-03T22:45:47.724198] [DEBUG] [LOCAL ] THIR: Loaded 2246 existing records from primary storage. [2025-10-03T22:45:47.724511] [INFO ] [MAIN ] THIR: Loaded 2246 primary data records. [2025-10-03T22:45:47.968833] [DEBUG] [LOCAL ] THG: Loaded 21946 existing records from primary storage. [2025-10-03T22:45:47.974174] [INFO ] [MAIN ] THG: Loaded 21946 primary data records. [2025-10-03T22:45:48.706859] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7804 incomplete bins [2025-10-03T22:45:48.712872] [INFO ] [MAIN ] THIR: Generated 1810 derivative records from 2246 primary records. [2025-10-03T22:45:48.713467] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-10-03T22:45:48.714566] [INFO ] [MAIN ] THLV: Generated 1814 derivative records from 1560 primary records. [2025-10-03T22:45:48.713862] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-03T22:45:48.715902] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-03T22:45:48.741554] [DEBUG] [LOCAL ] THIR: Derivative data saved (1810 records). [2025-10-03T22:45:48.743073] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-03T22:45:48.746030] [INFO ] [MAIN ] Derivative Progress: 1801/2073 symbols completed. THIR took 1.0s. Estimated remaining: 1m 50s. Rate: 147.9 symbols/min [2025-10-03T22:45:48.747260] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:48.763351] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:48.765481] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 21946 primary records. [2025-10-03T22:45:48.766137] [DEBUG] [LOCAL ] THLV: Derivative data saved (1814 records). [2025-10-03T22:45:48.766346] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-03T22:45:48.767428] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-03T22:45:48.769696] [INFO ] [MAIN ] Derivative Progress: 1802/2073 symbols completed. THLV took 1.1s. Estimated remaining: 1m 50s. Rate: 148.0 symbols/min [2025-10-03T22:45:48.770275] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:48.792630] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-10-03T22:45:48.793367] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-03T22:45:48.796108] [INFO ] [MAIN ] Derivative Progress: 1803/2073 symbols completed. THG took 1.1s. Estimated remaining: 1m 49s. Rate: 148.0 symbols/min [2025-10-03T22:45:48.796331] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:48.852751] [DEBUG] [LOCAL ] THR: Loaded 20079 existing records from primary storage. [2025-10-03T22:45:48.851522] [DEBUG] [LOCAL ] THO: Loaded 42481 existing records from primary storage. [2025-10-03T22:45:48.844706] [DEBUG] [LOCAL ] THQ: Loaded 25426 existing records from primary storage. [2025-10-03T22:45:48.852928] [INFO ] [MAIN ] THO: Loaded 42481 primary data records. [2025-10-03T22:45:48.853043] [INFO ] [MAIN ] THR: Loaded 20079 primary data records. [2025-10-03T22:45:48.853192] [INFO ] [MAIN ] THQ: Loaded 25426 primary data records. [2025-10-03T22:45:49.832456] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:49.845944] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20079 primary records. [2025-10-03T22:45:49.853559] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-03T22:45:49.854460] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:49.859876] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:49.860423] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 42481 primary records. [2025-10-03T22:45:49.861225] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 25426 primary records. [2025-10-03T22:45:49.868450] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-03T22:45:49.861316] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-03T22:45:49.903110] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-10-03T22:45:49.903433] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-03T22:45:49.905942] [INFO ] [MAIN ] Derivative Progress: 1804/2073 symbols completed. THR took 1.1s. Estimated remaining: 1m 49s. Rate: 147.9 symbols/min [2025-10-03T22:45:49.906359] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:49.911586] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-10-03T22:45:49.911928] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-03T22:45:49.912670] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-10-03T22:45:49.915362] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-03T22:45:49.915170] [INFO ] [MAIN ] Derivative Progress: 1805/2073 symbols completed. THQ took 1.1s. Estimated remaining: 1m 49s. Rate: 148.0 symbols/min [2025-10-03T22:45:49.918040] [INFO ] [MAIN ] Derivative Progress: 1806/2073 symbols completed. THO took 1.2s. Estimated remaining: 1m 48s. Rate: 148.1 symbols/min [2025-10-03T22:45:49.915521] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:49.918297] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:49.948488] [DEBUG] [LOCAL ] THW: Loaded 19744 existing records from primary storage. [2025-10-03T22:45:49.949357] [INFO ] [MAIN ] THW: Loaded 19744 primary data records. [2025-10-03T22:45:50.005376] [DEBUG] [LOCAL ] THS: Loaded 38862 existing records from primary storage. [2025-10-03T22:45:50.051756] [INFO ] [MAIN ] THS: Loaded 38862 primary data records. [2025-10-03T22:45:50.238820] [DEBUG] [LOCAL ] TIMB: Loaded 36490 existing records from primary storage. [2025-10-03T22:45:50.267309] [INFO ] [MAIN ] TIMB: Loaded 36490 primary data records. [2025-10-03T22:45:50.991290] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:50.993067] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19744 primary records. [2025-10-03T22:45:50.993964] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-03T22:45:51.026828] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:51.031071] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38862 primary records. [2025-10-03T22:45:51.031256] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-03T22:45:51.031348] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-10-03T22:45:51.031539] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-03T22:45:51.034107] [INFO ] [MAIN ] Derivative Progress: 1807/2073 symbols completed. THW took 1.1s. Estimated remaining: 1m 48s. Rate: 147.9 symbols/min [2025-10-03T22:45:51.034298] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:51.048408] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:51.061546] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 36490 primary records. [2025-10-03T22:45:51.062110] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-03T22:45:51.069002] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-10-03T22:45:51.069386] [DEBUG] [LOCAL ] TISI: Loaded 3792 existing records from primary storage. [2025-10-03T22:45:51.076679] [INFO ] [MAIN ] TISI: Loaded 3792 primary data records. [2025-10-03T22:45:51.076776] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-03T22:45:51.089208] [INFO ] [MAIN ] Derivative Progress: 1808/2073 symbols completed. THS took 1.2s. Estimated remaining: 1m 47s. Rate: 148.0 symbols/min [2025-10-03T22:45:51.118634] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:51.189734] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-10-03T22:45:51.202724] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-03T22:45:51.205287] [INFO ] [MAIN ] Derivative Progress: 1809/2073 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 47s. Rate: 148.0 symbols/min [2025-10-03T22:45:51.216370] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:51.445281] [DEBUG] [LOCAL ] TIXT: Loaded 32057 existing records from primary storage. [2025-10-03T22:45:51.446053] [INFO ] [MAIN ] TIXT: Loaded 32057 primary data records. [2025-10-03T22:45:51.785732] [DEBUG] [LOCAL ] TJX: Loaded 54448 existing records from primary storage. [2025-10-03T22:45:51.786991] [INFO ] [MAIN ] TJX: Loaded 54448 primary data records. [2025-10-03T22:45:51.896514] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:51.925252] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3792 primary records. [2025-10-03T22:45:51.925795] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-03T22:45:52.204307] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-10-03T22:45:52.204846] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-03T22:45:52.208072] [INFO ] [MAIN ] Derivative Progress: 1810/2073 symbols completed. TISI took 1.2s. Estimated remaining: 1m 47s. Rate: 147.9 symbols/min [2025-10-03T22:45:52.208518] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:52.226448] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:52.228072] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 32057 primary records. [2025-10-03T22:45:52.228281] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-03T22:45:52.250610] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-10-03T22:45:52.250999] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-03T22:45:52.254296] [INFO ] [MAIN ] Derivative Progress: 1811/2073 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 46s. Rate: 148.0 symbols/min [2025-10-03T22:45:52.255224] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:52.291287] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:52.292412] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54448 primary records. [2025-10-03T22:45:52.292578] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-03T22:45:52.339408] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-10-03T22:45:52.341864] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-03T22:45:52.345573] [INFO ] [MAIN ] Derivative Progress: 1812/2073 symbols completed. TJX took 1.1s. Estimated remaining: 1m 46s. Rate: 148.1 symbols/min [2025-10-03T22:45:52.346007] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:52.358898] [DEBUG] [LOCAL ] TK: Loaded 39948 existing records from primary storage. [2025-10-03T22:45:52.359967] [INFO ] [MAIN ] TK: Loaded 39948 primary data records. [2025-10-03T22:45:52.452498] [DEBUG] [LOCAL ] TKC: Loaded 39672 existing records from primary storage. [2025-10-03T22:45:52.474625] [INFO ] [MAIN ] TKC: Loaded 39672 primary data records. [2025-10-03T22:45:52.920174] [DEBUG] [LOCAL ] TKO: Loaded 44733 existing records from primary storage. [2025-10-03T22:45:52.972912] [INFO ] [MAIN ] TKO: Loaded 44733 primary data records. [2025-10-03T22:45:53.757376] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:53.758967] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 39672 primary records. [2025-10-03T22:45:53.759675] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-03T22:45:53.761515] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:53.763071] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 39948 primary records. [2025-10-03T22:45:53.773339] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-03T22:45:53.795031] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-10-03T22:45:53.801381] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-03T22:45:53.804970] [INFO ] [MAIN ] Derivative Progress: 1813/2073 symbols completed. TKC took 1.5s. Estimated remaining: 1m 46s. Rate: 147.9 symbols/min [2025-10-03T22:45:53.811188] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-10-03T22:45:53.812894] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-03T22:45:53.815441] [INFO ] [MAIN ] Derivative Progress: 1814/2073 symbols completed. TK took 1.6s. Estimated remaining: 1m 45s. Rate: 147.9 symbols/min [2025-10-03T22:45:53.829130] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:53.829761] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44733 primary records. [2025-10-03T22:45:53.829840] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-03T22:45:53.846440] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-10-03T22:45:53.846537] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-03T22:45:53.849976] [INFO ] [MAIN ] Derivative Progress: 1815/2073 symbols completed. TKO took 1.5s. Estimated remaining: 1m 45s. Rate: 148.0 symbols/min [2025-10-03T22:45:53.850632] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:53.850552] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:53.850756] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:53.878905] [DEBUG] [LOCAL ] TLYS: Loaded 16659 existing records from primary storage. [2025-10-03T22:45:53.879106] [INFO ] [MAIN ] TLYS: Loaded 16659 primary data records. [2025-10-03T22:45:54.051776] [DEBUG] [LOCAL ] TKR: Loaded 40606 existing records from primary storage. [2025-10-03T22:45:54.067974] [INFO ] [MAIN ] TKR: Loaded 40606 primary data records. [2025-10-03T22:45:54.356256] [DEBUG] [LOCAL ] TLK: Loaded 39755 existing records from primary storage. [2025-10-03T22:45:54.388169] [INFO ] [MAIN ] TLK: Loaded 39755 primary data records. [2025-10-03T22:45:54.915479] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:54.917086] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 16659 primary records. [2025-10-03T22:45:54.917958] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-03T22:45:54.939260] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:54.945350] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40606 primary records. [2025-10-03T22:45:54.947625] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-03T22:45:54.949694] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-10-03T22:45:54.957990] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-03T22:45:54.963078] [INFO ] [MAIN ] Derivative Progress: 1816/2073 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 44s. Rate: 147.9 symbols/min [2025-10-03T22:45:54.968627] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-10-03T22:45:54.963503] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:54.968792] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-03T22:45:54.972174] [INFO ] [MAIN ] Derivative Progress: 1817/2073 symbols completed. TKR took 1.1s. Estimated remaining: 1m 44s. Rate: 147.9 symbols/min [2025-10-03T22:45:54.972639] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:54.987925] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:54.988684] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 39755 primary records. [2025-10-03T22:45:54.988803] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-03T22:45:55.006338] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-10-03T22:45:55.006730] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-03T22:45:55.009351] [INFO ] [MAIN ] Derivative Progress: 1818/2073 symbols completed. TLK took 1.2s. Estimated remaining: 1m 43s. Rate: 148.0 symbols/min [2025-10-03T22:45:55.009732] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:55.046397] [DEBUG] [LOCAL ] TM: Loaded 36801 existing records from primary storage. [2025-10-03T22:45:55.060778] [INFO ] [MAIN ] TM: Loaded 36801 primary data records. [2025-10-03T22:45:55.254007] [DEBUG] [LOCAL ] TME: Loaded 53971 existing records from primary storage. [2025-10-03T22:45:55.254614] [DEBUG] [LOCAL ] TMHC: Loaded 45995 existing records from primary storage. [2025-10-03T22:45:55.293902] [INFO ] [MAIN ] TME: Loaded 53971 primary data records. [2025-10-03T22:45:55.299818] [INFO ] [MAIN ] TMHC: Loaded 45995 primary data records. [2025-10-03T22:45:56.207546] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:56.208666] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36801 primary records. [2025-10-03T22:45:56.209121] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-03T22:45:56.226758] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-10-03T22:45:56.227006] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-03T22:45:56.229190] [INFO ] [MAIN ] Derivative Progress: 1819/2073 symbols completed. TM took 1.3s. Estimated remaining: 1m 43s. Rate: 147.9 symbols/min [2025-10-03T22:45:56.229517] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:56.263530] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:56.263207] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:56.264410] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 45995 primary records. [2025-10-03T22:45:56.265197] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53971 primary records. [2025-10-03T22:45:56.265267] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-03T22:45:56.265981] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-03T22:45:56.307978] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-10-03T22:45:56.308076] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-10-03T22:45:56.308315] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-03T22:45:56.311092] [INFO ] [MAIN ] Derivative Progress: 1820/2073 symbols completed. TMHC took 1.3s. Estimated remaining: 1m 43s. Rate: 147.9 symbols/min [2025-10-03T22:45:56.311342] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-03T22:45:56.311517] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:56.314354] [INFO ] [MAIN ] Derivative Progress: 1821/2073 symbols completed. TME took 1.3s. Estimated remaining: 1m 42s. Rate: 148.0 symbols/min [2025-10-03T22:45:56.315063] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:56.353761] [DEBUG] [LOCAL ] TNC: Loaded 15048 existing records from primary storage. [2025-10-03T22:45:56.360587] [INFO ] [MAIN ] TNC: Loaded 15048 primary data records. [2025-10-03T22:45:56.425975] [DEBUG] [LOCAL ] TMO: Loaded 53122 existing records from primary storage. [2025-10-03T22:45:56.447023] [INFO ] [MAIN ] TMO: Loaded 53122 primary data records. [2025-10-03T22:45:56.584117] [DEBUG] [LOCAL ] TNET: Loaded 28898 existing records from primary storage. [2025-10-03T22:45:56.606115] [INFO ] [MAIN ] TNET: Loaded 28898 primary data records. [2025-10-03T22:45:57.384125] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:57.385314] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 15048 primary records. [2025-10-03T22:45:57.385486] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-03T22:45:57.399688] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:57.409673] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53122 primary records. [2025-10-03T22:45:57.409779] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-03T22:45:57.441354] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:57.447388] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 28898 primary records. [2025-10-03T22:45:57.448571] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-10-03T22:45:57.448722] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-03T22:45:57.448065] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-03T22:45:57.452173] [INFO ] [MAIN ] Derivative Progress: 1822/2073 symbols completed. TNC took 1.1s. Estimated remaining: 1m 42s. Rate: 147.9 symbols/min [2025-10-03T22:45:57.452928] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:57.474423] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-10-03T22:45:57.474697] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-03T22:45:57.473870] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-10-03T22:45:57.478142] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-03T22:45:57.477900] [INFO ] [MAIN ] Derivative Progress: 1823/2073 symbols completed. TMO took 1.2s. Estimated remaining: 1m 41s. Rate: 147.9 symbols/min [2025-10-03T22:45:57.481301] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:57.481496] [INFO ] [MAIN ] Derivative Progress: 1824/2073 symbols completed. TNET took 1.2s. Estimated remaining: 1m 41s. Rate: 148.0 symbols/min [2025-10-03T22:45:57.482172] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:57.522998] [DEBUG] [LOCAL ] TNK: Loaded 35616 existing records from primary storage. [2025-10-03T22:45:57.523194] [INFO ] [MAIN ] TNK: Loaded 35616 primary data records. [2025-10-03T22:45:57.695585] [DEBUG] [LOCAL ] TNL: Loaded 42274 existing records from primary storage. [2025-10-03T22:45:57.768521] [INFO ] [MAIN ] TNL: Loaded 42274 primary data records. [2025-10-03T22:45:57.774534] [DEBUG] [LOCAL ] TOL: Loaded 51534 existing records from primary storage. [2025-10-03T22:45:57.780260] [INFO ] [MAIN ] TOL: Loaded 51534 primary data records. [2025-10-03T22:45:58.626322] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:58.627238] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35616 primary records. [2025-10-03T22:45:58.627438] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-03T22:45:58.647122] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-10-03T22:45:58.647251] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-03T22:45:58.649353] [INFO ] [MAIN ] Derivative Progress: 1825/2073 symbols completed. TNK took 1.2s. Estimated remaining: 1m 41s. Rate: 147.9 symbols/min [2025-10-03T22:45:58.650062] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:58.671341] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:58.672532] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51534 primary records. [2025-10-03T22:45:58.673670] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-03T22:45:58.707370] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:58.709973] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42274 primary records. [2025-10-03T22:45:58.709115] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-10-03T22:45:58.710173] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-03T22:45:58.710231] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-03T22:45:58.712983] [INFO ] [MAIN ] Derivative Progress: 1826/2073 symbols completed. TOL took 1.2s. Estimated remaining: 1m 40s. Rate: 147.9 symbols/min [2025-10-03T22:45:58.713153] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:58.747417] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-10-03T22:45:58.747571] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-03T22:45:58.750711] [INFO ] [MAIN ] Derivative Progress: 1827/2073 symbols completed. TNL took 1.3s. Estimated remaining: 1m 40s. Rate: 148.0 symbols/min [2025-10-03T22:45:58.751089] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:58.779032] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-10-03T22:45:58.779327] [INFO ] [MAIN ] TOST: Loaded 54461 primary data records. [2025-10-03T22:45:58.822008] [DEBUG] [LOCAL ] TPB: Loaded 25596 existing records from primary storage. [2025-10-03T22:45:58.845332] [INFO ] [MAIN ] TPB: Loaded 25596 primary data records. [2025-10-03T22:45:59.343411] [DEBUG] [LOCAL ] TPC: Loaded 39333 existing records from primary storage. [2025-10-03T22:45:59.354948] [INFO ] [MAIN ] TPC: Loaded 39333 primary data records. [2025-10-03T22:45:59.888771] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:59.890639] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54461 primary records. [2025-10-03T22:45:59.891398] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-03T22:45:59.927665] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-10-03T22:45:59.928108] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-03T22:45:59.931117] [INFO ] [MAIN ] Derivative Progress: 1828/2073 symbols completed. TOST took 1.3s. Estimated remaining: 1m 39s. Rate: 147.8 symbols/min [2025-10-03T22:45:59.928727] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:59.932258] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 25596 primary records. [2025-10-03T22:45:59.932511] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-03T22:45:59.957562] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-10-03T22:45:59.967612] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-03T22:45:59.967547] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:45:59.970328] [INFO ] [MAIN ] Derivative Progress: 1829/2073 symbols completed. TPB took 1.3s. Estimated remaining: 1m 39s. Rate: 147.9 symbols/min [2025-10-03T22:45:59.971339] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39333 primary records. [2025-10-03T22:45:59.971440] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-03T22:45:59.989636] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-10-03T22:45:59.989797] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-03T22:45:59.992757] [INFO ] [MAIN ] Derivative Progress: 1830/2073 symbols completed. TPC took 1.2s. Estimated remaining: 1m 39s. Rate: 148.0 symbols/min [2025-10-03T22:45:59.993329] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:59.993439] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:45:59.993534] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:00.024579] [DEBUG] [LOCAL ] TPVG: Loaded 27322 existing records from primary storage. [2025-10-03T22:46:00.024939] [INFO ] [MAIN ] TPVG: Loaded 27322 primary data records. [2025-10-03T22:46:00.362776] [DEBUG] [LOCAL ] TPH: Loaded 45572 existing records from primary storage. [2025-10-03T22:46:00.387083] [INFO ] [MAIN ] TPH: Loaded 45572 primary data records. [2025-10-03T22:46:00.409800] [DEBUG] [LOCAL ] TPR: Loaded 54234 existing records from primary storage. [2025-10-03T22:46:00.435115] [INFO ] [MAIN ] TPR: Loaded 54234 primary data records. [2025-10-03T22:46:01.042620] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:01.044001] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27322 primary records. [2025-10-03T22:46:01.044574] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-03T22:46:01.071057] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-10-03T22:46:01.071506] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-03T22:46:01.074687] [INFO ] [MAIN ] Derivative Progress: 1831/2073 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 38s. Rate: 147.9 symbols/min [2025-10-03T22:46:01.074968] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:01.089120] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:01.090580] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45572 primary records. [2025-10-03T22:46:01.090962] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-03T22:46:01.116986] [DEBUG] [LOCAL ] TPYP: Loaded 8005 existing records from primary storage. [2025-10-03T22:46:01.132191] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:01.131785] [INFO ] [MAIN ] TPYP: Loaded 8005 primary data records. [2025-10-03T22:46:01.133780] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54234 primary records. [2025-10-03T22:46:01.139108] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-03T22:46:01.154622] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-10-03T22:46:01.155613] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-03T22:46:01.164418] [INFO ] [MAIN ] Derivative Progress: 1832/2073 symbols completed. TPH took 1.2s. Estimated remaining: 1m 38s. Rate: 147.9 symbols/min [2025-10-03T22:46:01.169825] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:01.290322] [DEBUG] [LOCAL ] TPZ: Loaded 4989 existing records from primary storage. [2025-10-03T22:46:01.301506] [INFO ] [MAIN ] TPZ: Loaded 4989 primary data records. [2025-10-03T22:46:01.383950] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-10-03T22:46:01.454701] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-03T22:46:01.604676] [INFO ] [MAIN ] Derivative Progress: 1833/2073 symbols completed. TPR took 1.6s. Estimated remaining: 1m 37s. Rate: 147.9 symbols/min [2025-10-03T22:46:01.625790] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:01.850455] [DEBUG] [LOCAL ] TR: Loaded 18821 existing records from primary storage. [2025-10-03T22:46:01.851228] [INFO ] [MAIN ] TR: Loaded 18821 primary data records. [2025-10-03T22:46:02.227040] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:46:02.228029] [INFO ] [MAIN ] TPYP: Generated 1819 derivative records from 8005 primary records. [2025-10-03T22:46:02.228407] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-03T22:46:02.251495] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1819 records). [2025-10-03T22:46:02.264858] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-03T22:46:02.265329] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:46:02.268449] [INFO ] [MAIN ] Derivative Progress: 1834/2073 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 37s. Rate: 147.9 symbols/min [2025-10-03T22:46:02.269519] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 4989 primary records. [2025-10-03T22:46:02.270179] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-03T22:46:02.269780] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:02.300011] [DEBUG] [LOCAL ] TRAK: Loaded 9541 existing records from primary storage. [2025-10-03T22:46:02.299740] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-10-03T22:46:02.300251] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-03T22:46:02.303349] [INFO ] [MAIN ] Derivative Progress: 1835/2073 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 37s. Rate: 147.9 symbols/min [2025-10-03T22:46:02.303632] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:02.300334] [INFO ] [MAIN ] TRAK: Loaded 9541 primary data records. [2025-10-03T22:46:02.329363] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:02.352286] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 18821 primary records. [2025-10-03T22:46:02.365537] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-03T22:46:02.462098] [DEBUG] [LOCAL ] TRC: Loaded 15954 existing records from primary storage. [2025-10-03T22:46:02.463029] [INFO ] [MAIN ] TRC: Loaded 15954 primary data records. [2025-10-03T22:46:02.526223] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-10-03T22:46:02.603867] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-03T22:46:02.619155] [INFO ] [MAIN ] Derivative Progress: 1836/2073 symbols completed. TR took 1.0s. Estimated remaining: 1m 36s. Rate: 148.0 symbols/min [2025-10-03T22:46:02.646343] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:03.087023] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:03.088242] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9541 primary records. [2025-10-03T22:46:03.102519] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-03T22:46:03.107061] [DEBUG] [LOCAL ] TREX: Loaded 50660 existing records from primary storage. [2025-10-03T22:46:03.114357] [INFO ] [MAIN ] TREX: Loaded 50660 primary data records. [2025-10-03T22:46:03.137100] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-10-03T22:46:03.163528] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-03T22:46:03.172596] [INFO ] [MAIN ] Derivative Progress: 1837/2073 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 36s. Rate: 147.9 symbols/min [2025-10-03T22:46:03.184199] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:03.256549] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:03.282558] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 15954 primary records. [2025-10-03T22:46:03.300756] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-03T22:46:03.559673] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-10-03T22:46:03.560315] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-03T22:46:03.563452] [INFO ] [MAIN ] Derivative Progress: 1838/2073 symbols completed. TRC took 1.3s. Estimated remaining: 1m 35s. Rate: 147.9 symbols/min [2025-10-03T22:46:03.564122] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:03.585025] [DEBUG] [LOCAL ] TRGP: Loaded 51445 existing records from primary storage. [2025-10-03T22:46:03.585489] [INFO ] [MAIN ] TRGP: Loaded 51445 primary data records. [2025-10-03T22:46:03.778368] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:03.792402] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50660 primary records. [2025-10-03T22:46:03.798158] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-03T22:46:03.800068] [DEBUG] [LOCAL ] TRN: Loaded 37474 existing records from primary storage. [2025-10-03T22:46:03.932763] [INFO ] [MAIN ] TRN: Loaded 37474 primary data records. [2025-10-03T22:46:04.115879] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-10-03T22:46:04.143918] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-03T22:46:04.168037] [INFO ] [MAIN ] Derivative Progress: 1839/2073 symbols completed. TREX took 1.5s. Estimated remaining: 1m 35s. Rate: 147.9 symbols/min [2025-10-03T22:46:04.192572] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:04.396543] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:04.398303] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51445 primary records. [2025-10-03T22:46:04.398868] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-03T22:46:04.418792] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-10-03T22:46:04.419326] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-03T22:46:04.422451] [INFO ] [MAIN ] Derivative Progress: 1840/2073 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 35s. Rate: 147.9 symbols/min [2025-10-03T22:46:04.423049] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:04.454146] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:04.455012] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37474 primary records. [2025-10-03T22:46:04.455154] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-03T22:46:04.488030] [DEBUG] [LOCAL ] TRNO: Loaded 44565 existing records from primary storage. [2025-10-03T22:46:04.490142] [INFO ] [MAIN ] TRNO: Loaded 44565 primary data records. [2025-10-03T22:46:04.491292] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-10-03T22:46:04.514182] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-03T22:46:04.560584] [INFO ] [MAIN ] Derivative Progress: 1841/2073 symbols completed. TRN took 1.0s. Estimated remaining: 1m 34s. Rate: 148.0 symbols/min [2025-10-03T22:46:04.573446] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:04.851903] [DEBUG] [LOCAL ] TROX: Loaded 52644 existing records from primary storage. [2025-10-03T22:46:04.852195] [INFO ] [MAIN ] TROX: Loaded 52644 primary data records. [2025-10-03T22:46:05.103802] [DEBUG] [LOCAL ] TRP: Loaded 52867 existing records from primary storage. [2025-10-03T22:46:05.218297] [INFO ] [MAIN ] TRP: Loaded 52867 primary data records. [2025-10-03T22:46:05.562693] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:05.563938] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44565 primary records. [2025-10-03T22:46:05.564247] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-03T22:46:05.587903] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-10-03T22:46:05.588215] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-03T22:46:05.590865] [INFO ] [MAIN ] Derivative Progress: 1842/2073 symbols completed. TRNO took 1.4s. Estimated remaining: 1m 34s. Rate: 147.8 symbols/min [2025-10-03T22:46:05.599814] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:05.606965] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:05.607773] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52644 primary records. [2025-10-03T22:46:05.607904] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-03T22:46:05.626074] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-10-03T22:46:05.627108] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-03T22:46:05.630210] [INFO ] [MAIN ] Derivative Progress: 1843/2073 symbols completed. TROX took 1.2s. Estimated remaining: 1m 33s. Rate: 147.9 symbols/min [2025-10-03T22:46:05.645745] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:05.646496] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52867 primary records. [2025-10-03T22:46:05.646576] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-03T22:46:05.671604] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-10-03T22:46:05.671803] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-03T22:46:05.674565] [INFO ] [MAIN ] Derivative Progress: 1844/2073 symbols completed. TRP took 1.1s. Estimated remaining: 1m 33s. Rate: 148.0 symbols/min [2025-10-03T22:46:05.686240] [DEBUG] [LOCAL ] TRTX: Loaded 38021 existing records from primary storage. [2025-10-03T22:46:05.686329] [INFO ] [MAIN ] TRTX: Loaded 38021 primary data records. [2025-10-03T22:46:05.992919] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:05.993563] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 38021 primary records. [2025-10-03T22:46:05.993627] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-03T22:46:06.009951] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-10-03T22:46:06.010066] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-03T22:46:06.012314] [INFO ] [MAIN ] Derivative Progress: 1845/2073 symbols completed. TRTX took 0.4s. Estimated remaining: 1m 32s. Rate: 148.0 symbols/min [2025-10-03T22:46:06.013095] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:06.013194] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:06.013267] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:06.110309] [DEBUG] [LOCAL ] TS: Loaded 52451 existing records from primary storage. [2025-10-03T22:46:06.123546] [DEBUG] [LOCAL ] TRV: Loaded 48438 existing records from primary storage. [2025-10-03T22:46:06.124741] [INFO ] [MAIN ] TRV: Loaded 48438 primary data records. [2025-10-03T22:46:06.124876] [INFO ] [MAIN ] TS: Loaded 52451 primary data records. [2025-10-03T22:46:06.157414] [DEBUG] [LOCAL ] TRU: Loaded 52018 existing records from primary storage. [2025-10-03T22:46:06.188817] [INFO ] [MAIN ] TRU: Loaded 52018 primary data records. [2025-10-03T22:46:07.113709] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:07.127430] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52451 primary records. [2025-10-03T22:46:07.128981] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-03T22:46:07.129414] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:07.130147] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 48438 primary records. [2025-10-03T22:46:07.131177] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-03T22:46:07.151225] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:07.155902] [INFO ] [MAIN ] TRU: Generated 1820 derivative records from 52018 primary records. [2025-10-03T22:46:07.156970] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-03T22:46:07.184271] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-10-03T22:46:07.184587] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-03T22:46:07.187020] [INFO ] [MAIN ] Derivative Progress: 1846/2073 symbols completed. TS took 1.2s. Estimated remaining: 1m 32s. Rate: 147.9 symbols/min [2025-10-03T22:46:07.187614] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:07.195216] [DEBUG] [LOCAL ] TRU: Derivative data saved (1820 records). [2025-10-03T22:46:07.195318] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-03T22:46:07.197969] [INFO ] [MAIN ] Derivative Progress: 1847/2073 symbols completed. TRU took 1.2s. Estimated remaining: 1m 32s. Rate: 147.9 symbols/min [2025-10-03T22:46:07.198132] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:07.194902] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-10-03T22:46:07.198364] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-03T22:46:07.201154] [INFO ] [MAIN ] Derivative Progress: 1848/2073 symbols completed. TRV took 1.2s. Estimated remaining: 1m 31s. Rate: 148.0 symbols/min [2025-10-03T22:46:07.201618] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:07.219906] [DEBUG] [LOCAL ] TSI: Loaded 7412 existing records from primary storage. [2025-10-03T22:46:07.220139] [INFO ] [MAIN ] TSI: Loaded 7412 primary data records. [2025-10-03T22:46:07.331825] [DEBUG] [LOCAL ] TSE: Loaded 28482 existing records from primary storage. [2025-10-03T22:46:07.351732] [INFO ] [MAIN ] TSE: Loaded 28482 primary data records. [2025-10-03T22:46:07.553583] [DEBUG] [LOCAL ] TSLX: Loaded 35786 existing records from primary storage. [2025-10-03T22:46:07.672507] [INFO ] [MAIN ] TSLX: Loaded 35786 primary data records. [2025-10-03T22:46:08.265159] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:08.267279] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 7412 primary records. [2025-10-03T22:46:08.269399] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-03T22:46:08.296596] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:08.297890] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 28482 primary records. [2025-10-03T22:46:08.298253] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-03T22:46:08.299500] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-10-03T22:46:08.299771] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-03T22:46:08.301820] [INFO ] [MAIN ] Derivative Progress: 1849/2073 symbols completed. TSI took 1.1s. Estimated remaining: 1m 31s. Rate: 147.9 symbols/min [2025-10-03T22:46:08.309036] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:08.338300] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:08.339733] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 35786 primary records. [2025-10-03T22:46:08.340733] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-03T22:46:08.340577] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-10-03T22:46:08.340864] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-03T22:46:08.344110] [INFO ] [MAIN ] Derivative Progress: 1850/2073 symbols completed. TSE took 1.2s. Estimated remaining: 1m 30s. Rate: 147.9 symbols/min [2025-10-03T22:46:08.344619] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:08.361232] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-10-03T22:46:08.361355] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-03T22:46:08.364135] [INFO ] [MAIN ] Derivative Progress: 1851/2073 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 30s. Rate: 148.0 symbols/min [2025-10-03T22:46:08.364553] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:08.396136] [DEBUG] [LOCAL ] TSQ: Loaded 12138 existing records from primary storage. [2025-10-03T22:46:08.396278] [INFO ] [MAIN ] TSQ: Loaded 12138 primary data records. [2025-10-03T22:46:08.530194] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-03T22:46:08.536223] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-10-03T22:46:08.847347] [DEBUG] [LOCAL ] TSN: Loaded 53681 existing records from primary storage. [2025-10-03T22:46:08.853204] [INFO ] [MAIN ] TSN: Loaded 53681 primary data records. [2025-10-03T22:46:09.396300] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:09.397298] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 12138 primary records. [2025-10-03T22:46:09.397533] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-03T22:46:09.431772] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:09.432467] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-10-03T22:46:09.433207] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-10-03T22:46:09.433316] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-03T22:46:09.436053] [INFO ] [MAIN ] Derivative Progress: 1852/2073 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 30s. Rate: 147.9 symbols/min [2025-10-03T22:46:09.436317] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-03T22:46:09.436449] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:09.470102] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:09.472597] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53681 primary records. [2025-10-03T22:46:09.472872] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-03T22:46:09.483206] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-10-03T22:46:09.486688] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-03T22:46:09.489898] [INFO ] [MAIN ] Derivative Progress: 1853/2073 symbols completed. TSM took 1.2s. Estimated remaining: 1m 29s. Rate: 148.0 symbols/min [2025-10-03T22:46:09.491043] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:09.502693] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-10-03T22:46:09.503012] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-03T22:46:09.505818] [INFO ] [MAIN ] Derivative Progress: 1854/2073 symbols completed. TSN took 1.2s. Estimated remaining: 1m 29s. Rate: 148.0 symbols/min [2025-10-03T22:46:09.506138] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:09.559480] [DEBUG] [LOCAL ] TT: Loaded 48324 existing records from primary storage. [2025-10-03T22:46:09.559817] [INFO ] [MAIN ] TT: Loaded 48324 primary data records. [2025-10-03T22:46:09.717938] [DEBUG] [LOCAL ] TTC: Loaded 42669 existing records from primary storage. [2025-10-03T22:46:09.745277] [INFO ] [MAIN ] TTC: Loaded 42669 primary data records. [2025-10-03T22:46:09.976001] [DEBUG] [LOCAL ] TTE: Loaded 52372 existing records from primary storage. [2025-10-03T22:46:09.989768] [INFO ] [MAIN ] TTE: Loaded 52372 primary data records. [2025-10-03T22:46:10.631748] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:10.633299] [INFO ] [MAIN ] TT: Generated 1820 derivative records from 48324 primary records. [2025-10-03T22:46:10.633721] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-03T22:46:10.667089] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:10.668612] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 42669 primary records. [2025-10-03T22:46:10.672042] [DEBUG] [LOCAL ] TT: Derivative data saved (1820 records). [2025-10-03T22:46:10.670942] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-03T22:46:10.672403] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-03T22:46:10.675193] [INFO ] [MAIN ] Derivative Progress: 1855/2073 symbols completed. TT took 1.2s. Estimated remaining: 1m 28s. Rate: 147.9 symbols/min [2025-10-03T22:46:10.675960] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:10.697081] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:10.702122] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52372 primary records. [2025-10-03T22:46:10.704283] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-03T22:46:10.715363] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-10-03T22:46:10.719782] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-03T22:46:10.723709] [INFO ] [MAIN ] Derivative Progress: 1856/2073 symbols completed. TTC took 1.2s. Estimated remaining: 1m 28s. Rate: 148.0 symbols/min [2025-10-03T22:46:10.725204] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:10.728620] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-10-03T22:46:10.729330] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-03T22:46:10.732263] [INFO ] [MAIN ] Derivative Progress: 1857/2073 symbols completed. TTE took 1.2s. Estimated remaining: 1m 28s. Rate: 148.0 symbols/min [2025-10-03T22:46:10.732553] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:10.773009] [DEBUG] [LOCAL ] TTI: Loaded 46351 existing records from primary storage. [2025-10-03T22:46:10.773899] [INFO ] [MAIN ] TTI: Loaded 46351 primary data records. [2025-10-03T22:46:11.129020] [DEBUG] [LOCAL ] TUYA: Loaded 46846 existing records from primary storage. [2025-10-03T22:46:11.145144] [INFO ] [MAIN ] TUYA: Loaded 46846 primary data records. [2025-10-03T22:46:11.157975] [DEBUG] [LOCAL ] TU: Loaded 50545 existing records from primary storage. [2025-10-03T22:46:11.179620] [INFO ] [MAIN ] TU: Loaded 50545 primary data records. [2025-10-03T22:46:11.856468] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:11.857730] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 46351 primary records. [2025-10-03T22:46:11.858010] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-03T22:46:11.882501] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-10-03T22:46:11.884591] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-03T22:46:11.887692] [INFO ] [MAIN ] Derivative Progress: 1858/2073 symbols completed. TTI took 1.2s. Estimated remaining: 1m 27s. Rate: 147.9 symbols/min [2025-10-03T22:46:11.902742] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:11.904914] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 46846 primary records. [2025-10-03T22:46:11.905965] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-03T22:46:11.929718] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:11.936810] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50545 primary records. [2025-10-03T22:46:11.936902] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-03T22:46:11.939696] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-10-03T22:46:11.940346] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-03T22:46:11.950006] [INFO ] [MAIN ] Derivative Progress: 1859/2073 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 27s. Rate: 148.0 symbols/min [2025-10-03T22:46:11.958470] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-10-03T22:46:11.958579] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-03T22:46:11.961104] [INFO ] [MAIN ] Derivative Progress: 1860/2073 symbols completed. TU took 1.2s. Estimated remaining: 1m 26s. Rate: 148.0 symbols/min [2025-10-03T22:46:11.961776] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:11.961638] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:11.961983] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:11.971060] [DEBUG] [LOCAL ] TVC: Loaded 3363 existing records from primary storage. [2025-10-03T22:46:11.974003] [INFO ] [MAIN ] TVC: Loaded 3363 primary data records. [2025-10-03T22:46:11.973858] [DEBUG] [LOCAL ] TVE: Loaded 2809 existing records from primary storage. [2025-10-03T22:46:11.979438] [INFO ] [MAIN ] TVE: Loaded 2809 primary data records. [2025-10-03T22:46:12.422924] [DEBUG] [LOCAL ] TV: Loaded 43081 existing records from primary storage. [2025-10-03T22:46:12.697439] [INFO ] [MAIN ] TV: Loaded 43081 primary data records. [2025-10-03T22:46:13.067163] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7798 incomplete bins [2025-10-03T22:46:13.068379] [INFO ] [MAIN ] TVE: Generated 1816 derivative records from 2809 primary records. [2025-10-03T22:46:13.068598] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-03T22:46:13.083355] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7798 incomplete bins [2025-10-03T22:46:13.095284] [INFO ] [MAIN ] TVC: Generated 1816 derivative records from 3363 primary records. [2025-10-03T22:46:13.096960] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-03T22:46:13.117295] [DEBUG] [LOCAL ] TVE: Derivative data saved (1816 records). [2025-10-03T22:46:13.116871] [DEBUG] [LOCAL ] TVC: Derivative data saved (1816 records). [2025-10-03T22:46:13.117519] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-03T22:46:13.120744] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-03T22:46:13.120603] [INFO ] [MAIN ] Derivative Progress: 1861/2073 symbols completed. TVC took 1.2s. Estimated remaining: 1m 26s. Rate: 147.9 symbols/min [2025-10-03T22:46:13.121137] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:13.123263] [INFO ] [MAIN ] Derivative Progress: 1862/2073 symbols completed. TVE took 1.2s. Estimated remaining: 1m 26s. Rate: 148.0 symbols/min [2025-10-03T22:46:13.123585] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:13.140882] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:13.141600] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 43081 primary records. [2025-10-03T22:46:13.141731] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-03T22:46:13.158510] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-10-03T22:46:13.158692] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-03T22:46:13.164437] [INFO ] [MAIN ] Derivative Progress: 1863/2073 symbols completed. TV took 1.2s. Estimated remaining: 1m 25s. Rate: 148.0 symbols/min [2025-10-03T22:46:13.164742] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:13.181242] [DEBUG] [LOCAL ] TWN: Loaded 3275 existing records from primary storage. [2025-10-03T22:46:13.181478] [INFO ] [MAIN ] TWN: Loaded 3275 primary data records. [2025-10-03T22:46:13.352789] [DEBUG] [LOCAL ] TWI: Loaded 34741 existing records from primary storage. [2025-10-03T22:46:13.412958] [DEBUG] [LOCAL ] TWLO: Loaded 53490 existing records from primary storage. [2025-10-03T22:46:13.413067] [INFO ] [MAIN ] TWI: Loaded 34741 primary data records. [2025-10-03T22:46:13.418828] [INFO ] [MAIN ] TWLO: Loaded 53490 primary data records. [2025-10-03T22:46:14.233514] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:14.234922] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3275 primary records. [2025-10-03T22:46:14.235565] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-03T22:46:14.254848] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-10-03T22:46:14.255343] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-03T22:46:14.265204] [INFO ] [MAIN ] Derivative Progress: 1864/2073 symbols completed. TWN took 1.1s. Estimated remaining: 1m 25s. Rate: 147.9 symbols/min [2025-10-03T22:46:14.271575] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:14.271858] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:14.273001] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34741 primary records. [2025-10-03T22:46:14.273222] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-03T22:46:14.307365] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-10-03T22:46:14.307854] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:14.308708] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-03T22:46:14.311780] [INFO ] [MAIN ] Derivative Progress: 1865/2073 symbols completed. TWI took 1.2s. Estimated remaining: 1m 24s. Rate: 148.0 symbols/min [2025-10-03T22:46:14.308609] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53490 primary records. [2025-10-03T22:46:14.312053] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:14.312319] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-03T22:46:14.331063] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-10-03T22:46:14.331208] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-03T22:46:14.333881] [INFO ] [MAIN ] Derivative Progress: 1866/2073 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 24s. Rate: 148.0 symbols/min [2025-10-03T22:46:14.334092] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:14.364459] [DEBUG] [LOCAL ] TX: Loaded 23810 existing records from primary storage. [2025-10-03T22:46:14.365701] [INFO ] [MAIN ] TX: Loaded 23810 primary data records. [2025-10-03T22:46:14.438175] [DEBUG] [LOCAL ] TWO: Loaded 49084 existing records from primary storage. [2025-10-03T22:46:14.458859] [INFO ] [MAIN ] TWO: Loaded 49084 primary data records. [2025-10-03T22:46:14.921679] [DEBUG] [LOCAL ] TXNM: Loaded 44016 existing records from primary storage. [2025-10-03T22:46:14.941485] [INFO ] [MAIN ] TXNM: Loaded 44016 primary data records. [2025-10-03T22:46:15.393427] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:15.395867] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23810 primary records. [2025-10-03T22:46:15.399075] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-03T22:46:15.414308] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:15.431558] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49084 primary records. [2025-10-03T22:46:15.431831] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-03T22:46:15.430605] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-10-03T22:46:15.432259] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-03T22:46:15.434700] [INFO ] [MAIN ] Derivative Progress: 1867/2073 symbols completed. TX took 1.1s. Estimated remaining: 1m 24s. Rate: 147.9 symbols/min [2025-10-03T22:46:15.435688] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:15.470225] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-10-03T22:46:15.470555] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:15.470792] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-03T22:46:15.471668] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44016 primary records. [2025-10-03T22:46:15.474505] [INFO ] [MAIN ] Derivative Progress: 1868/2073 symbols completed. TWO took 1.2s. Estimated remaining: 1m 23s. Rate: 148.0 symbols/min [2025-10-03T22:46:15.474730] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-03T22:46:15.480372] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:15.502800] [DEBUG] [LOCAL ] TXO: Loaded 19183 existing records from primary storage. [2025-10-03T22:46:15.503780] [INFO ] [MAIN ] TXO: Loaded 19183 primary data records. [2025-10-03T22:46:15.505567] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-10-03T22:46:15.510905] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-03T22:46:15.551941] [INFO ] [MAIN ] Derivative Progress: 1869/2073 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 23s. Rate: 148.0 symbols/min [2025-10-03T22:46:15.590416] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:15.659784] [DEBUG] [LOCAL ] TY: Loaded 7611 existing records from primary storage. [2025-10-03T22:46:15.690116] [INFO ] [MAIN ] TY: Loaded 7611 primary data records. [2025-10-03T22:46:15.917516] [DEBUG] [LOCAL ] TXT: Loaded 50433 existing records from primary storage. [2025-10-03T22:46:15.930899] [INFO ] [MAIN ] TXT: Loaded 50433 primary data records. [2025-10-03T22:46:16.541309] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:16.542395] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 19183 primary records. [2025-10-03T22:46:16.542804] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-03T22:46:16.560608] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-10-03T22:46:16.564434] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-03T22:46:16.566843] [INFO ] [MAIN ] Derivative Progress: 1870/2073 symbols completed. TXO took 1.1s. Estimated remaining: 1m 22s. Rate: 147.9 symbols/min [2025-10-03T22:46:16.567113] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:16.580786] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:16.581623] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7611 primary records. [2025-10-03T22:46:16.581946] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-03T22:46:16.605198] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-10-03T22:46:16.610859] [DEBUG] [LOCAL ] TYG: Loaded 14306 existing records from primary storage. [2025-10-03T22:46:16.610578] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-03T22:46:16.611000] [INFO ] [MAIN ] TYG: Loaded 14306 primary data records. [2025-10-03T22:46:16.613677] [INFO ] [MAIN ] Derivative Progress: 1871/2073 symbols completed. TY took 1.0s. Estimated remaining: 1m 22s. Rate: 148.0 symbols/min [2025-10-03T22:46:16.671101] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:16.671752] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:16.695278] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50433 primary records. [2025-10-03T22:46:16.714383] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-03T22:46:16.853926] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-10-03T22:46:16.854254] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-03T22:46:16.984565] [INFO ] [MAIN ] Derivative Progress: 1872/2073 symbols completed. TXT took 1.5s. Estimated remaining: 1m 21s. Rate: 148.0 symbols/min [2025-10-03T22:46:17.011733] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:17.012616] [DEBUG] [LOCAL ] TYL: Loaded 22473 existing records from primary storage. [2025-10-03T22:46:17.013340] [INFO ] [MAIN ] TYL: Loaded 22473 primary data records. [2025-10-03T22:46:17.370902] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-03T22:46:17.379840] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-10-03T22:46:17.385862] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:17.408788] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14306 primary records. [2025-10-03T22:46:17.444562] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-03T22:46:17.594077] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-10-03T22:46:17.704238] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-03T22:46:17.715799] [INFO ] [MAIN ] Derivative Progress: 1873/2073 symbols completed. TYG took 1.1s. Estimated remaining: 1m 21s. Rate: 147.9 symbols/min [2025-10-03T22:46:17.733569] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:17.734770] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22473 primary records. [2025-10-03T22:46:17.735121] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-03T22:46:17.753350] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-10-03T22:46:17.753509] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-03T22:46:17.756189] [INFO ] [MAIN ] Derivative Progress: 1874/2073 symbols completed. TYL took 1.1s. Estimated remaining: 1m 21s. Rate: 148.0 symbols/min [2025-10-03T22:46:17.774083] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:17.774670] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-10-03T22:46:17.774735] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-03T22:46:17.791405] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-10-03T22:46:17.791470] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-03T22:46:17.793952] [INFO ] [MAIN ] Derivative Progress: 1875/2073 symbols completed. U took 0.8s. Estimated remaining: 1m 20s. Rate: 148.1 symbols/min [2025-10-03T22:46:17.794374] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:17.794541] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:17.794476] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:17.803107] [DEBUG] [LOCAL ] UAN: Loaded 5475 existing records from primary storage. [2025-10-03T22:46:17.803244] [INFO ] [MAIN ] UAN: Loaded 5475 primary data records. [2025-10-03T22:46:18.182046] [DEBUG] [LOCAL ] UA: Loaded 51215 existing records from primary storage. [2025-10-03T22:46:18.183025] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-10-03T22:46:18.183815] [INFO ] [MAIN ] UA: Loaded 51215 primary data records. [2025-10-03T22:46:18.184182] [INFO ] [MAIN ] UAA: Loaded 54287 primary data records. [2025-10-03T22:46:18.886802] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:18.888862] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5475 primary records. [2025-10-03T22:46:18.889833] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-03T22:46:18.909094] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-10-03T22:46:18.909257] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-03T22:46:18.911902] [INFO ] [MAIN ] Derivative Progress: 1876/2073 symbols completed. UAN took 1.1s. Estimated remaining: 1m 20s. Rate: 147.9 symbols/min [2025-10-03T22:46:18.912624] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:18.930208] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:18.931236] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54287 primary records. [2025-10-03T22:46:18.932458] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-03T22:46:18.964330] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:18.964890] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-10-03T22:46:18.965907] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-03T22:46:18.965701] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51215 primary records. [2025-10-03T22:46:18.966528] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-03T22:46:18.969543] [INFO ] [MAIN ] Derivative Progress: 1877/2073 symbols completed. UAA took 1.2s. Estimated remaining: 1m 19s. Rate: 148.0 symbols/min [2025-10-03T22:46:18.970882] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:18.988424] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-10-03T22:46:18.988560] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-03T22:46:18.991354] [INFO ] [MAIN ] Derivative Progress: 1878/2073 symbols completed. UA took 1.2s. Estimated remaining: 1m 19s. Rate: 148.1 symbols/min [2025-10-03T22:46:19.005508] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:19.030059] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-03T22:46:19.030443] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-10-03T22:46:19.217010] [DEBUG] [LOCAL ] UBS: Loaded 53142 existing records from primary storage. [2025-10-03T22:46:19.226062] [INFO ] [MAIN ] UBS: Loaded 53142 primary data records. [2025-10-03T22:46:19.501887] [DEBUG] [LOCAL ] UCB: Loaded 38420 existing records from primary storage. [2025-10-03T22:46:19.502671] [INFO ] [MAIN ] UCB: Loaded 38420 primary data records. [2025-10-03T22:46:20.045232] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:20.046963] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-10-03T22:46:20.048428] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-03T22:46:20.085503] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:20.089985] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53142 primary records. [2025-10-03T22:46:20.090580] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-10-03T22:46:20.091329] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-03T22:46:20.091825] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-03T22:46:20.095626] [INFO ] [MAIN ] Derivative Progress: 1879/2073 symbols completed. UBER took 1.2s. Estimated remaining: 1m 19s. Rate: 147.9 symbols/min [2025-10-03T22:46:20.109771] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:20.117721] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:20.124791] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38420 primary records. [2025-10-03T22:46:20.126016] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-03T22:46:20.146357] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-10-03T22:46:20.147263] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-03T22:46:20.150775] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-10-03T22:46:20.150593] [INFO ] [MAIN ] Derivative Progress: 1880/2073 symbols completed. UCB took 1.1s. Estimated remaining: 1m 18s. Rate: 148.0 symbols/min [2025-10-03T22:46:20.151047] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:20.150932] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-03T22:46:20.153899] [INFO ] [MAIN ] Derivative Progress: 1881/2073 symbols completed. UBS took 1.2s. Estimated remaining: 1m 18s. Rate: 148.1 symbols/min [2025-10-03T22:46:20.154109] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:20.165852] [DEBUG] [LOCAL ] UFI: Loaded 8258 existing records from primary storage. [2025-10-03T22:46:20.166063] [INFO ] [MAIN ] UFI: Loaded 8258 primary data records. [2025-10-03T22:46:20.389160] [DEBUG] [LOCAL ] UDR: Loaded 52605 existing records from primary storage. [2025-10-03T22:46:20.393577] [INFO ] [MAIN ] UDR: Loaded 52605 primary data records. [2025-10-03T22:46:20.577153] [DEBUG] [LOCAL ] UE: Loaded 43284 existing records from primary storage. [2025-10-03T22:46:20.594389] [INFO ] [MAIN ] UE: Loaded 43284 primary data records. [2025-10-03T22:46:21.236195] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:21.238209] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8258 primary records. [2025-10-03T22:46:21.238374] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-03T22:46:21.271372] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:21.273535] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52605 primary records. [2025-10-03T22:46:21.273903] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-03T22:46:21.277180] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-10-03T22:46:21.285551] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-03T22:46:21.293774] [INFO ] [MAIN ] Derivative Progress: 1882/2073 symbols completed. UFI took 1.1s. Estimated remaining: 1m 17s. Rate: 148.0 symbols/min [2025-10-03T22:46:21.294799] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:21.313937] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:21.316142] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43284 primary records. [2025-10-03T22:46:21.316978] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-03T22:46:21.318207] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-10-03T22:46:21.318860] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-03T22:46:21.321831] [INFO ] [MAIN ] Derivative Progress: 1883/2073 symbols completed. UDR took 1.2s. Estimated remaining: 1m 17s. Rate: 148.0 symbols/min [2025-10-03T22:46:21.322275] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:21.341329] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-10-03T22:46:21.341559] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-03T22:46:21.344337] [INFO ] [MAIN ] Derivative Progress: 1884/2073 symbols completed. UE took 1.2s. Estimated remaining: 1m 17s. Rate: 148.1 symbols/min [2025-10-03T22:46:21.344622] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:21.386871] [DEBUG] [LOCAL ] UHAL: Loaded 16799 existing records from primary storage. [2025-10-03T22:46:21.387072] [INFO ] [MAIN ] UHAL: Loaded 16799 primary data records. [2025-10-03T22:46:21.444318] [DEBUG] [LOCAL ] UGI: Loaded 51249 existing records from primary storage. [2025-10-03T22:46:21.483437] [INFO ] [MAIN ] UGI: Loaded 51249 primary data records. [2025-10-03T22:46:21.513691] [DEBUG] [LOCAL ] UGP: Loaded 43607 existing records from primary storage. [2025-10-03T22:46:21.546216] [INFO ] [MAIN ] UGP: Loaded 43607 primary data records. [2025-10-03T22:46:22.408320] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:22.409401] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 16799 primary records. [2025-10-03T22:46:22.409626] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-03T22:46:22.452836] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:22.459131] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:22.459937] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51249 primary records. [2025-10-03T22:46:22.461968] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43607 primary records. [2025-10-03T22:46:22.462747] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-03T22:46:22.462376] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-03T22:46:22.463330] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-10-03T22:46:22.473972] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-03T22:46:22.476213] [INFO ] [MAIN ] Derivative Progress: 1885/2073 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 16s. Rate: 148.0 symbols/min [2025-10-03T22:46:22.480179] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:22.499748] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-10-03T22:46:22.500686] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-03T22:46:22.504728] [INFO ] [MAIN ] Derivative Progress: 1886/2073 symbols completed. UGP took 1.2s. Estimated remaining: 1m 16s. Rate: 148.0 symbols/min [2025-10-03T22:46:22.505752] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:22.505949] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-10-03T22:46:22.506677] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-03T22:46:22.509484] [INFO ] [MAIN ] Derivative Progress: 1887/2073 symbols completed. UGI took 1.2s. Estimated remaining: 1m 15s. Rate: 148.1 symbols/min [2025-10-03T22:46:22.509882] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:22.528449] [DEBUG] [LOCAL ] UHT: Loaded 10056 existing records from primary storage. [2025-10-03T22:46:22.528708] [INFO ] [MAIN ] UHT: Loaded 10056 primary data records. [2025-10-03T22:46:22.605980] [DEBUG] [LOCAL ] UI: Loaded 13318 existing records from primary storage. [2025-10-03T22:46:22.635053] [INFO ] [MAIN ] UI: Loaded 13318 primary data records. [2025-10-03T22:46:22.699635] [DEBUG] [LOCAL ] UHS: Loaded 41412 existing records from primary storage. [2025-10-03T22:46:22.722289] [INFO ] [MAIN ] UHS: Loaded 41412 primary data records. [2025-10-03T22:46:23.591602] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:23.592729] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10056 primary records. [2025-10-03T22:46:23.593109] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-03T22:46:23.623063] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:23.625794] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 13318 primary records. [2025-10-03T22:46:23.626800] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-03T22:46:23.663533] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:23.662974] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-10-03T22:46:23.664790] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 41412 primary records. [2025-10-03T22:46:23.663996] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-03T22:46:23.665843] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-03T22:46:23.669172] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-10-03T22:46:23.668811] [INFO ] [MAIN ] Derivative Progress: 1888/2073 symbols completed. UHT took 1.2s. Estimated remaining: 1m 15s. Rate: 148.0 symbols/min [2025-10-03T22:46:23.670041] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-03T22:46:23.673190] [INFO ] [MAIN ] Derivative Progress: 1889/2073 symbols completed. UI took 1.2s. Estimated remaining: 1m 15s. Rate: 148.0 symbols/min [2025-10-03T22:46:23.689101] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-10-03T22:46:23.689228] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-03T22:46:23.691997] [INFO ] [MAIN ] Derivative Progress: 1890/2073 symbols completed. UHS took 1.2s. Estimated remaining: 1m 14s. Rate: 148.1 symbols/min [2025-10-03T22:46:23.692510] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:23.692691] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:23.692851] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:23.754705] [DEBUG] [LOCAL ] ULS: Loaded 39966 existing records from primary storage. [2025-10-03T22:46:23.753783] [DEBUG] [LOCAL ] UIS: Loaded 37532 existing records from primary storage. [2025-10-03T22:46:23.767437] [INFO ] [MAIN ] UIS: Loaded 37532 primary data records. [2025-10-03T22:46:23.767565] [INFO ] [MAIN ] ULS: Loaded 39966 primary data records. [2025-10-03T22:46:24.025992] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-10-03T22:46:24.079587] [INFO ] [MAIN ] UL: Loaded 53843 primary data records. [2025-10-03T22:46:24.825472] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:24.833698] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37532 primary records. [2025-10-03T22:46:24.833904] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-03T22:46:24.839851] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:24.851255] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39966 primary records. [2025-10-03T22:46:24.851528] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-03T22:46:24.881115] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-10-03T22:46:24.886929] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:24.886631] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-03T22:46:24.889876] [INFO ] [MAIN ] Derivative Progress: 1891/2073 symbols completed. ULS took 1.2s. Estimated remaining: 1m 14s. Rate: 148.0 symbols/min [2025-10-03T22:46:24.889985] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-10-03T22:46:24.890096] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-03T22:46:24.892402] [INFO ] [MAIN ] Derivative Progress: 1892/2073 symbols completed. UIS took 1.2s. Estimated remaining: 1m 13s. Rate: 148.0 symbols/min [2025-10-03T22:46:24.893353] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53843 primary records. [2025-10-03T22:46:24.890190] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:24.893496] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:24.894013] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-03T22:46:24.912800] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-10-03T22:46:24.912950] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-03T22:46:24.915741] [INFO ] [MAIN ] Derivative Progress: 1893/2073 symbols completed. UL took 1.2s. Estimated remaining: 1m 13s. Rate: 148.1 symbols/min [2025-10-03T22:46:24.916007] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:24.944906] [DEBUG] [LOCAL ] UNF: Loaded 12204 existing records from primary storage. [2025-10-03T22:46:24.945164] [INFO ] [MAIN ] UNF: Loaded 12204 primary data records. [2025-10-03T22:46:25.106381] [DEBUG] [LOCAL ] UMC: Loaded 53480 existing records from primary storage. [2025-10-03T22:46:25.143919] [INFO ] [MAIN ] UMC: Loaded 53480 primary data records. [2025-10-03T22:46:25.174552] [DEBUG] [LOCAL ] UMH: Loaded 34124 existing records from primary storage. [2025-10-03T22:46:25.300089] [INFO ] [MAIN ] UMH: Loaded 34124 primary data records. [2025-10-03T22:46:25.935984] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:25.937317] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12204 primary records. [2025-10-03T22:46:25.937728] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-03T22:46:25.960977] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-10-03T22:46:25.961298] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-03T22:46:25.963744] [INFO ] [MAIN ] Derivative Progress: 1894/2073 symbols completed. UNF took 1.0s. Estimated remaining: 1m 13s. Rate: 148.0 symbols/min [2025-10-03T22:46:25.963987] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:25.978177] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:25.979321] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53480 primary records. [2025-10-03T22:46:25.980257] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-03T22:46:26.011177] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:26.012787] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-10-03T22:46:26.013786] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34124 primary records. [2025-10-03T22:46:26.013999] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-03T22:46:26.013915] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-03T22:46:26.017286] [INFO ] [MAIN ] Derivative Progress: 1895/2073 symbols completed. UMC took 1.1s. Estimated remaining: 1m 12s. Rate: 148.1 symbols/min [2025-10-03T22:46:26.018082] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:26.041393] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-10-03T22:46:26.041470] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-03T22:46:26.054619] [INFO ] [MAIN ] Derivative Progress: 1896/2073 symbols completed. UMH took 1.2s. Estimated remaining: 1m 12s. Rate: 148.1 symbols/min [2025-10-03T22:46:26.054841] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:26.074362] [DEBUG] [LOCAL ] UNFI: Loaded 42709 existing records from primary storage. [2025-10-03T22:46:26.074635] [INFO ] [MAIN ] UNFI: Loaded 42709 primary data records. [2025-10-03T22:46:26.461835] [DEBUG] [LOCAL ] UNH: Loaded 54575 existing records from primary storage. [2025-10-03T22:46:26.463598] [DEBUG] [LOCAL ] UNM: Loaded 49114 existing records from primary storage. [2025-10-03T22:46:26.463813] [INFO ] [MAIN ] UNH: Loaded 54575 primary data records. [2025-10-03T22:46:26.463910] [INFO ] [MAIN ] UNM: Loaded 49114 primary data records. [2025-10-03T22:46:27.133719] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:27.136229] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42709 primary records. [2025-10-03T22:46:27.136477] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-03T22:46:27.154075] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-10-03T22:46:27.154316] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-03T22:46:27.157022] [INFO ] [MAIN ] Derivative Progress: 1897/2073 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 11s. Rate: 148.0 symbols/min [2025-10-03T22:46:27.157471] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:27.178682] [DEBUG] [LOCAL ] UNMA: Loaded 3553 existing records from primary storage. [2025-10-03T22:46:27.179075] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:27.179813] [INFO ] [MAIN ] UNMA: Loaded 3553 primary data records. [2025-10-03T22:46:27.214474] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 49114 primary records. [2025-10-03T22:46:27.229300] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-03T22:46:27.320631] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:27.322269] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54575 primary records. [2025-10-03T22:46:27.328319] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-03T22:46:27.550061] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-10-03T22:46:27.549423] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-10-03T22:46:27.550280] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-03T22:46:27.553288] [INFO ] [MAIN ] Derivative Progress: 1898/2073 symbols completed. UNM took 1.5s. Estimated remaining: 1m 11s. Rate: 148.0 symbols/min [2025-10-03T22:46:27.553694] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:27.550885] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-03T22:46:27.556839] [INFO ] [MAIN ] Derivative Progress: 1899/2073 symbols completed. UNH took 1.5s. Estimated remaining: 1m 11s. Rate: 148.1 symbols/min [2025-10-03T22:46:27.557280] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:27.583196] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:27.583954] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3553 primary records. [2025-10-03T22:46:27.584019] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-03T22:46:27.603048] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-10-03T22:46:27.603183] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-03T22:46:27.606094] [INFO ] [MAIN ] Derivative Progress: 1900/2073 symbols completed. UNMA took 0.4s. Estimated remaining: 1m 10s. Rate: 148.1 symbols/min [2025-10-03T22:46:27.606441] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:27.654567] [DEBUG] [LOCAL ] UP: Loaded 43915 existing records from primary storage. [2025-10-03T22:46:27.654878] [INFO ] [MAIN ] UP: Loaded 43915 primary data records. [2025-10-03T22:46:27.747508] [DEBUG] [LOCAL ] UNP: Loaded 54045 existing records from primary storage. [2025-10-03T22:46:27.774074] [INFO ] [MAIN ] UNP: Loaded 54045 primary data records. [2025-10-03T22:46:27.975084] [DEBUG] [LOCAL ] UPS: Loaded 54492 existing records from primary storage. [2025-10-03T22:46:28.009097] [INFO ] [MAIN ] UPS: Loaded 54492 primary data records. [2025-10-03T22:46:28.717366] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:28.718455] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 43915 primary records. [2025-10-03T22:46:28.719240] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-03T22:46:28.758557] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-10-03T22:46:28.759102] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-03T22:46:28.759000] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:28.760009] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54045 primary records. [2025-10-03T22:46:28.762126] [INFO ] [MAIN ] Derivative Progress: 1901/2073 symbols completed. UP took 1.2s. Estimated remaining: 1m 10s. Rate: 148.0 symbols/min [2025-10-03T22:46:28.762380] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-03T22:46:28.763537] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:28.795550] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:28.797592] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54492 primary records. [2025-10-03T22:46:28.798110] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-03T22:46:28.815435] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-10-03T22:46:28.818355] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-10-03T22:46:28.815621] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-03T22:46:28.818684] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-03T22:46:28.822055] [INFO ] [MAIN ] Derivative Progress: 1902/2073 symbols completed. UPS took 1.2s. Estimated remaining: 1m 9s. Rate: 148.1 symbols/min [2025-10-03T22:46:28.834508] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:28.834618] [INFO ] [MAIN ] Derivative Progress: 1903/2073 symbols completed. UNP took 1.3s. Estimated remaining: 1m 9s. Rate: 148.1 symbols/min [2025-10-03T22:46:28.851692] [DEBUG] [LOCAL ] URI: Loaded 36051 existing records from primary storage. [2025-10-03T22:46:28.851854] [INFO ] [MAIN ] URI: Loaded 36051 primary data records. [2025-10-03T22:46:29.205486] [DEBUG] [LOCAL ] USA: Loaded 36520 existing records from primary storage. [2025-10-03T22:46:29.205816] [INFO ] [MAIN ] USA: Loaded 36520 primary data records. [2025-10-03T22:46:29.536089] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:29.537332] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 36051 primary records. [2025-10-03T22:46:29.537608] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-03T22:46:29.557233] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-10-03T22:46:29.557415] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-03T22:46:29.559691] [INFO ] [MAIN ] Derivative Progress: 1904/2073 symbols completed. URI took 0.8s. Estimated remaining: 1m 8s. Rate: 148.1 symbols/min [2025-10-03T22:46:29.576369] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:29.577041] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36520 primary records. [2025-10-03T22:46:29.577163] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-03T22:46:29.592242] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-10-03T22:46:29.592305] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-03T22:46:29.595139] [INFO ] [MAIN ] Derivative Progress: 1905/2073 symbols completed. USA took 0.8s. Estimated remaining: 1m 8s. Rate: 148.1 symbols/min [2025-10-03T22:46:29.595592] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:29.595780] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:29.595872] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:29.638164] [DEBUG] [LOCAL ] USAC: Loaded 22441 existing records from primary storage. [2025-10-03T22:46:29.638322] [INFO ] [MAIN ] USAC: Loaded 22441 primary data records. [2025-10-03T22:46:29.789493] [DEBUG] [LOCAL ] USFD: Loaded 51948 existing records from primary storage. [2025-10-03T22:46:29.795391] [INFO ] [MAIN ] USFD: Loaded 51948 primary data records. [2025-10-03T22:46:30.104369] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-03T22:46:30.127805] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-10-03T22:46:30.690732] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:30.691747] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 22441 primary records. [2025-10-03T22:46:30.692093] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-03T22:46:30.727262] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:30.729181] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51948 primary records. [2025-10-03T22:46:30.729388] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-03T22:46:30.733153] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-10-03T22:46:30.733360] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-03T22:46:30.744511] [INFO ] [MAIN ] Derivative Progress: 1906/2073 symbols completed. USAC took 1.1s. Estimated remaining: 1m 8s. Rate: 148.0 symbols/min [2025-10-03T22:46:30.748866] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:30.765320] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:30.766738] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-10-03T22:46:30.766890] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-03T22:46:30.781601] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-10-03T22:46:30.782063] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-03T22:46:30.791360] [INFO ] [MAIN ] Derivative Progress: 1907/2073 symbols completed. USFD took 1.2s. Estimated remaining: 1m 7s. Rate: 148.1 symbols/min [2025-10-03T22:46:30.791809] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:30.802489] [DEBUG] [LOCAL ] USNA: Loaded 18037 existing records from primary storage. [2025-10-03T22:46:30.803363] [INFO ] [MAIN ] USNA: Loaded 18037 primary data records. [2025-10-03T22:46:30.808995] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-10-03T22:46:30.815808] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-03T22:46:30.818802] [INFO ] [MAIN ] Derivative Progress: 1908/2073 symbols completed. USB took 1.2s. Estimated remaining: 1m 7s. Rate: 148.1 symbols/min [2025-10-03T22:46:30.829068] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:30.969354] [DEBUG] [LOCAL ] USPH: Loaded 17051 existing records from primary storage. [2025-10-03T22:46:31.003554] [INFO ] [MAIN ] USPH: Loaded 17051 primary data records. [2025-10-03T22:46:31.248907] [DEBUG] [LOCAL ] UTF: Loaded 29987 existing records from primary storage. [2025-10-03T22:46:31.268020] [INFO ] [MAIN ] UTF: Loaded 29987 primary data records. [2025-10-03T22:46:31.839567] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:31.841120] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18037 primary records. [2025-10-03T22:46:31.841463] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-03T22:46:31.878108] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:31.879418] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 17051 primary records. [2025-10-03T22:46:31.879815] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-03T22:46:31.880321] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-10-03T22:46:31.881144] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-03T22:46:31.884962] [INFO ] [MAIN ] Derivative Progress: 1909/2073 symbols completed. USNA took 1.1s. Estimated remaining: 1m 6s. Rate: 148.0 symbols/min [2025-10-03T22:46:31.885717] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:31.904409] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-10-03T22:46:31.904609] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-03T22:46:31.907678] [INFO ] [MAIN ] Derivative Progress: 1910/2073 symbols completed. USPH took 1.1s. Estimated remaining: 1m 6s. Rate: 148.1 symbols/min [2025-10-03T22:46:31.907933] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:31.924517] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:31.925563] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 29987 primary records. [2025-10-03T22:46:31.925852] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-03T22:46:31.949535] [DEBUG] [LOCAL ] UTL: Loaded 11543 existing records from primary storage. [2025-10-03T22:46:31.950184] [INFO ] [MAIN ] UTL: Loaded 11543 primary data records. [2025-10-03T22:46:31.953408] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-10-03T22:46:31.965478] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-03T22:46:31.977951] [INFO ] [MAIN ] Derivative Progress: 1911/2073 symbols completed. UTF took 1.1s. Estimated remaining: 1m 6s. Rate: 148.2 symbols/min [2025-10-03T22:46:32.000382] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:32.093225] [DEBUG] [LOCAL ] UTI: Loaded 41039 existing records from primary storage. [2025-10-03T22:46:32.104395] [INFO ] [MAIN ] UTI: Loaded 41039 primary data records. [2025-10-03T22:46:32.623460] [DEBUG] [LOCAL ] UTZ: Loaded 45390 existing records from primary storage. [2025-10-03T22:46:32.623940] [INFO ] [MAIN ] UTZ: Loaded 45390 primary data records. [2025-10-03T22:46:32.990508] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:33.000304] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11543 primary records. [2025-10-03T22:46:33.000816] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-03T22:46:33.036965] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-10-03T22:46:33.038165] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-03T22:46:33.041084] [INFO ] [MAIN ] Derivative Progress: 1912/2073 symbols completed. UTL took 1.1s. Estimated remaining: 1m 5s. Rate: 148.0 symbols/min [2025-10-03T22:46:33.037755] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:33.041686] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:33.042678] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41039 primary records. [2025-10-03T22:46:33.043521] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-03T22:46:33.061988] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-10-03T22:46:33.062441] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-03T22:46:33.065685] [INFO ] [MAIN ] Derivative Progress: 1913/2073 symbols completed. UTI took 1.2s. Estimated remaining: 1m 5s. Rate: 148.1 symbols/min [2025-10-03T22:46:33.065890] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:33.090549] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:33.091923] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45390 primary records. [2025-10-03T22:46:33.098765] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-03T22:46:33.100066] [DEBUG] [LOCAL ] UVE: Loaded 22153 existing records from primary storage. [2025-10-03T22:46:33.100516] [INFO ] [MAIN ] UVE: Loaded 22153 primary data records. [2025-10-03T22:46:33.211421] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-10-03T22:46:33.234785] [DEBUG] [LOCAL ] UVV: Loaded 22830 existing records from primary storage. [2025-10-03T22:46:33.234969] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-03T22:46:33.235072] [INFO ] [MAIN ] UVV: Loaded 22830 primary data records. [2025-10-03T22:46:33.237886] [INFO ] [MAIN ] Derivative Progress: 1914/2073 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 4s. Rate: 148.1 symbols/min [2025-10-03T22:46:33.238142] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:33.811269] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:33.812546] [DEBUG] [LOCAL ] UWMC: Loaded 53552 existing records from primary storage. [2025-10-03T22:46:33.813020] [INFO ] [MAIN ] UWMC: Loaded 53552 primary data records. [2025-10-03T22:46:33.814061] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22153 primary records. [2025-10-03T22:46:33.825506] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-03T22:46:33.909632] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-10-03T22:46:33.946003] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-03T22:46:33.949205] [INFO ] [MAIN ] Derivative Progress: 1915/2073 symbols completed. UVE took 0.9s. Estimated remaining: 1m 4s. Rate: 148.1 symbols/min [2025-10-03T22:46:33.950301] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:34.164286] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:34.169261] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22830 primary records. [2025-10-03T22:46:34.169761] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-03T22:46:34.169613] [DEBUG] [LOCAL ] UZD: Loaded 6490 existing records from primary storage. [2025-10-03T22:46:34.170838] [INFO ] [MAIN ] UZD: Loaded 6490 primary data records. [2025-10-03T22:46:34.363599] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-10-03T22:46:34.364803] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-03T22:46:34.368526] [INFO ] [MAIN ] Derivative Progress: 1916/2073 symbols completed. UVV took 1.3s. Estimated remaining: 1m 4s. Rate: 148.1 symbols/min [2025-10-03T22:46:34.368836] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:34.537057] [DEBUG] [LOCAL ] UZE: Loaded 7503 existing records from primary storage. [2025-10-03T22:46:34.533836] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:34.538015] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53552 primary records. [2025-10-03T22:46:34.538098] [INFO ] [MAIN ] UZE: Loaded 7503 primary data records. [2025-10-03T22:46:34.538287] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-03T22:46:34.759005] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-10-03T22:46:34.759213] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-03T22:46:34.949280] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:34.952717] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6490 primary records. [2025-10-03T22:46:34.951840] [INFO ] [MAIN ] Derivative Progress: 1917/2073 symbols completed. UWMC took 1.7s. Estimated remaining: 1m 3s. Rate: 148.1 symbols/min [2025-10-03T22:46:34.953002] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:34.953114] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-03T22:46:34.972362] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-10-03T22:46:34.974787] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-03T22:46:34.977800] [INFO ] [MAIN ] Derivative Progress: 1918/2073 symbols completed. UZD took 1.0s. Estimated remaining: 1m 3s. Rate: 148.1 symbols/min [2025-10-03T22:46:34.982842] [DEBUG] [LOCAL ] UZF: Loaded 6524 existing records from primary storage. [2025-10-03T22:46:34.983111] [INFO ] [MAIN ] UZF: Loaded 6524 primary data records. [2025-10-03T22:46:35.306812] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:35.307619] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7503 primary records. [2025-10-03T22:46:35.307895] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-03T22:46:35.325257] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-10-03T22:46:35.325570] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-03T22:46:35.328909] [INFO ] [MAIN ] Derivative Progress: 1919/2073 symbols completed. UZE took 1.0s. Estimated remaining: 1m 2s. Rate: 148.1 symbols/min [2025-10-03T22:46:35.348954] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:35.349576] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6524 primary records. [2025-10-03T22:46:35.349661] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-03T22:46:35.364553] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-10-03T22:46:35.364621] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-03T22:46:35.366884] [INFO ] [MAIN ] Derivative Progress: 1920/2073 symbols completed. UZF took 0.4s. Estimated remaining: 1m 2s. Rate: 148.2 symbols/min [2025-10-03T22:46:35.367362] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:35.367500] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:35.367286] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:35.405441] [DEBUG] [LOCAL ] VAC: Loaded 34838 existing records from primary storage. [2025-10-03T22:46:35.420303] [INFO ] [MAIN ] VAC: Loaded 34838 primary data records. [2025-10-03T22:46:35.562916] [DEBUG] [LOCAL ] VAL: Loaded 51032 existing records from primary storage. [2025-10-03T22:46:35.583811] [INFO ] [MAIN ] VAL: Loaded 51032 primary data records. [2025-10-03T22:46:35.845858] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-10-03T22:46:35.879471] [INFO ] [MAIN ] V: Loaded 54535 primary data records. [2025-10-03T22:46:36.524169] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:36.525390] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 34838 primary records. [2025-10-03T22:46:36.526197] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-03T22:46:36.548208] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-10-03T22:46:36.548563] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-03T22:46:36.551320] [INFO ] [MAIN ] Derivative Progress: 1921/2073 symbols completed. VAC took 1.2s. Estimated remaining: 1m 2s. Rate: 148.1 symbols/min [2025-10-03T22:46:36.551965] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:36.573488] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:36.574416] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 51032 primary records. [2025-10-03T22:46:36.574725] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-03T22:46:36.607267] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:36.608803] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54535 primary records. [2025-10-03T22:46:36.609185] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-03T22:46:36.625173] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-10-03T22:46:36.639710] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-03T22:46:36.642636] [INFO ] [MAIN ] Derivative Progress: 1922/2073 symbols completed. VAL took 1.3s. Estimated remaining: 1m 1s. Rate: 148.1 symbols/min [2025-10-03T22:46:36.645236] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:36.646936] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-10-03T22:46:36.647625] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-03T22:46:36.650779] [INFO ] [MAIN ] Derivative Progress: 1923/2073 symbols completed. V took 1.3s. Estimated remaining: 1m 1s. Rate: 148.2 symbols/min [2025-10-03T22:46:36.651309] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:36.674866] [DEBUG] [LOCAL ] VATE: Loaded 5385 existing records from primary storage. [2025-10-03T22:46:36.678496] [INFO ] [MAIN ] VATE: Loaded 5385 primary data records. [2025-10-03T22:46:36.678376] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-03T22:46:36.683832] [INFO ] [MAIN ] VALE: Loaded 54473 primary data records. [2025-10-03T22:46:36.757799] [DEBUG] [LOCAL ] VBF: Loaded 7065 existing records from primary storage. [2025-10-03T22:46:36.757935] [INFO ] [MAIN ] VBF: Loaded 7065 primary data records. [2025-10-03T22:46:37.755391] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:37.773945] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54473 primary records. [2025-10-03T22:46:37.774714] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:37.776029] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-03T22:46:37.775935] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5385 primary records. [2025-10-03T22:46:37.775188] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:37.777807] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7065 primary records. [2025-10-03T22:46:37.778117] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-03T22:46:37.777014] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-03T22:46:37.821143] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-10-03T22:46:37.822839] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-03T22:46:37.824363] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-10-03T22:46:37.827265] [INFO ] [MAIN ] Derivative Progress: 1924/2073 symbols completed. VATE took 1.2s. Estimated remaining: 1m 0s. Rate: 148.0 symbols/min [2025-10-03T22:46:37.827845] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:37.828425] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-03T22:46:37.833131] [INFO ] [MAIN ] Derivative Progress: 1925/2073 symbols completed. VBF took 1.2s. Estimated remaining: 60.0s. Rate: 148.1 symbols/min [2025-10-03T22:46:37.833841] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:37.836591] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-10-03T22:46:37.836807] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-03T22:46:37.839211] [INFO ] [MAIN ] Derivative Progress: 1926/2073 symbols completed. VALE took 1.3s. Estimated remaining: 59.5s. Rate: 148.2 symbols/min [2025-10-03T22:46:37.839496] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:37.851898] [DEBUG] [LOCAL ] VCV: Loaded 13836 existing records from primary storage. [2025-10-03T22:46:37.852122] [INFO ] [MAIN ] VCV: Loaded 13836 primary data records. [2025-10-03T22:46:37.968919] [DEBUG] [LOCAL ] VEL: Loaded 12926 existing records from primary storage. [2025-10-03T22:46:37.990392] [INFO ] [MAIN ] VEL: Loaded 12926 primary data records. [2025-10-03T22:46:38.307705] [DEBUG] [LOCAL ] VEEV: Loaded 47751 existing records from primary storage. [2025-10-03T22:46:38.319308] [INFO ] [MAIN ] VEEV: Loaded 47751 primary data records. [2025-10-03T22:46:38.846033] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:38.847128] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13836 primary records. [2025-10-03T22:46:38.847500] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-03T22:46:38.879272] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:38.882596] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-10-03T22:46:38.881292] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 12926 primary records. [2025-10-03T22:46:38.882883] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-03T22:46:38.883088] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-03T22:46:38.886155] [INFO ] [MAIN ] Derivative Progress: 1927/2073 symbols completed. VCV took 1.1s. Estimated remaining: 59.2s. Rate: 148.1 symbols/min [2025-10-03T22:46:38.886363] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:38.905933] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-10-03T22:46:38.906165] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-03T22:46:38.909017] [INFO ] [MAIN ] Derivative Progress: 1928/2073 symbols completed. VEL took 1.1s. Estimated remaining: 58.7s. Rate: 148.1 symbols/min [2025-10-03T22:46:38.909389] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:38.925101] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:38.926025] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 47751 primary records. [2025-10-03T22:46:38.926238] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-03T22:46:38.946925] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-10-03T22:46:38.947147] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-03T22:46:38.950186] [INFO ] [MAIN ] Derivative Progress: 1929/2073 symbols completed. VEEV took 1.1s. Estimated remaining: 58.3s. Rate: 148.2 symbols/min [2025-10-03T22:46:38.950580] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:38.969423] [DEBUG] [LOCAL ] VGI: Loaded 5198 existing records from primary storage. [2025-10-03T22:46:38.969676] [INFO ] [MAIN ] VGI: Loaded 5198 primary data records. [2025-10-03T22:46:39.117396] [DEBUG] [LOCAL ] VET: Loaded 44583 existing records from primary storage. [2025-10-03T22:46:39.118837] [INFO ] [MAIN ] VET: Loaded 44583 primary data records. [2025-10-03T22:46:39.125305] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-10-03T22:46:39.183579] [INFO ] [MAIN ] VFC: Loaded 54390 primary data records. [2025-10-03T22:46:40.025220] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:40.027086] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5198 primary records. [2025-10-03T22:46:40.027317] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-03T22:46:40.062044] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-10-03T22:46:40.062393] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-03T22:46:40.064912] [INFO ] [MAIN ] Derivative Progress: 1930/2073 symbols completed. VGI took 1.1s. Estimated remaining: 57.9s. Rate: 148.1 symbols/min [2025-10-03T22:46:40.065454] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:40.062774] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:40.068893] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54390 primary records. [2025-10-03T22:46:40.069907] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-03T22:46:40.094141] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:40.098101] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44583 primary records. [2025-10-03T22:46:40.098477] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-03T22:46:40.123580] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-10-03T22:46:40.124582] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-03T22:46:40.124485] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-10-03T22:46:40.127877] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-03T22:46:40.127625] [INFO ] [MAIN ] Derivative Progress: 1931/2073 symbols completed. VET took 1.2s. Estimated remaining: 57.5s. Rate: 148.1 symbols/min [2025-10-03T22:46:40.138136] [DEBUG] [LOCAL ] VGM: Loaded 18537 existing records from primary storage. [2025-10-03T22:46:40.133690] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:40.138402] [INFO ] [MAIN ] VGM: Loaded 18537 primary data records. [2025-10-03T22:46:40.137515] [INFO ] [MAIN ] Derivative Progress: 1932/2073 symbols completed. VFC took 1.2s. Estimated remaining: 57.1s. Rate: 148.2 symbols/min [2025-10-03T22:46:40.150409] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:40.215829] [DEBUG] [LOCAL ] VHI: Loaded 2805 existing records from primary storage. [2025-10-03T22:46:40.249432] [INFO ] [MAIN ] VHI: Loaded 2805 primary data records. [2025-10-03T22:46:40.782993] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-10-03T22:46:40.785846] [INFO ] [MAIN ] VICI: Loaded 54427 primary data records. [2025-10-03T22:46:41.227130] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:41.228342] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18537 primary records. [2025-10-03T22:46:41.228618] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-03T22:46:41.247886] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-10-03T22:46:41.248499] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-03T22:46:41.251679] [INFO ] [MAIN ] Derivative Progress: 1933/2073 symbols completed. VGM took 1.2s. Estimated remaining: 56.7s. Rate: 148.1 symbols/min [2025-10-03T22:46:41.267693] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:46:41.268512] [INFO ] [MAIN ] VHI: Generated 1819 derivative records from 2805 primary records. [2025-10-03T22:46:41.268744] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-03T22:46:41.282932] [DEBUG] [LOCAL ] VHI: Derivative data saved (1819 records). [2025-10-03T22:46:41.283004] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-03T22:46:41.285637] [INFO ] [MAIN ] Derivative Progress: 1934/2073 symbols completed. VHI took 1.2s. Estimated remaining: 56.3s. Rate: 148.2 symbols/min [2025-10-03T22:46:41.301493] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:41.302070] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54427 primary records. [2025-10-03T22:46:41.302130] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-03T22:46:41.318409] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-10-03T22:46:41.318497] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-03T22:46:41.321300] [INFO ] [MAIN ] Derivative Progress: 1935/2073 symbols completed. VICI took 1.2s. Estimated remaining: 55.9s. Rate: 148.2 symbols/min [2025-10-03T22:46:41.321737] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:41.321894] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:41.321832] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:41.391265] [DEBUG] [LOCAL ] VIRT: Loaded 47345 existing records from primary storage. [2025-10-03T22:46:41.392029] [INFO ] [MAIN ] VIRT: Loaded 47345 primary data records. [2025-10-03T22:46:41.486383] [DEBUG] [LOCAL ] VIK: Loaded 53248 existing records from primary storage. [2025-10-03T22:46:41.505267] [INFO ] [MAIN ] VIK: Loaded 53248 primary data records. [2025-10-03T22:46:41.529372] [DEBUG] [LOCAL ] VIPS: Loaded 52064 existing records from primary storage. [2025-10-03T22:46:41.529624] [INFO ] [MAIN ] VIPS: Loaded 52064 primary data records. [2025-10-03T22:46:42.435697] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:42.436856] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47345 primary records. [2025-10-03T22:46:42.437172] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-03T22:46:42.476963] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:42.478521] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52064 primary records. [2025-10-03T22:46:42.487476] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-03T22:46:42.494321] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:46:42.497195] [INFO ] [MAIN ] VIK: Generated 1819 derivative records from 53248 primary records. [2025-10-03T22:46:42.511848] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-03T22:46:42.496287] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-10-03T22:46:42.513960] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-03T22:46:42.520146] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-10-03T22:46:42.520298] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-03T22:46:42.516930] [INFO ] [MAIN ] Derivative Progress: 1936/2073 symbols completed. VIRT took 1.2s. Estimated remaining: 55.5s. Rate: 148.1 symbols/min [2025-10-03T22:46:42.538039] [INFO ] [MAIN ] Derivative Progress: 1937/2073 symbols completed. VIPS took 1.2s. Estimated remaining: 55.1s. Rate: 148.2 symbols/min [2025-10-03T22:46:42.533965] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:42.538718] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:42.544209] [DEBUG] [LOCAL ] VIK: Derivative data saved (1819 records). [2025-10-03T22:46:42.544572] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-03T22:46:42.548009] [INFO ] [MAIN ] Derivative Progress: 1938/2073 symbols completed. VIK took 1.2s. Estimated remaining: 54.6s. Rate: 148.2 symbols/min [2025-10-03T22:46:42.548361] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:42.593173] [DEBUG] [LOCAL ] VKQ: Loaded 17986 existing records from primary storage. [2025-10-03T22:46:42.593542] [INFO ] [MAIN ] VKQ: Loaded 17986 primary data records. [2025-10-03T22:46:42.731213] [DEBUG] [LOCAL ] VIST: Loaded 46677 existing records from primary storage. [2025-10-03T22:46:42.732291] [DEBUG] [LOCAL ] VIV: Loaded 45605 existing records from primary storage. [2025-10-03T22:46:42.732634] [INFO ] [MAIN ] VIST: Loaded 46677 primary data records. [2025-10-03T22:46:42.733079] [INFO ] [MAIN ] VIV: Loaded 45605 primary data records. [2025-10-03T22:46:43.648011] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:43.649713] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17986 primary records. [2025-10-03T22:46:43.649826] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-03T22:46:43.672427] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-10-03T22:46:43.673381] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-03T22:46:43.675500] [INFO ] [MAIN ] Derivative Progress: 1939/2073 symbols completed. VKQ took 1.1s. Estimated remaining: 54.3s. Rate: 148.1 symbols/min [2025-10-03T22:46:43.675748] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:43.691905] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:43.693583] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46677 primary records. [2025-10-03T22:46:43.693857] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-03T22:46:43.716623] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:43.721267] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45605 primary records. [2025-10-03T22:46:43.721719] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-03T22:46:43.724866] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-10-03T22:46:43.725878] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-03T22:46:43.729745] [INFO ] [MAIN ] Derivative Progress: 1940/2073 symbols completed. VIST took 1.2s. Estimated remaining: 53.9s. Rate: 148.2 symbols/min [2025-10-03T22:46:43.748610] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:43.753171] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-10-03T22:46:43.753691] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-03T22:46:43.757053] [INFO ] [MAIN ] Derivative Progress: 1941/2073 symbols completed. VIV took 1.2s. Estimated remaining: 53.4s. Rate: 148.2 symbols/min [2025-10-03T22:46:43.757262] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:43.769035] [DEBUG] [LOCAL ] VLN: Loaded 29562 existing records from primary storage. [2025-10-03T22:46:43.769217] [INFO ] [MAIN ] VLN: Loaded 29562 primary data records. [2025-10-03T22:46:44.128379] [DEBUG] [LOCAL ] VLRS: Loaded 40965 existing records from primary storage. [2025-10-03T22:46:44.144415] [INFO ] [MAIN ] VLRS: Loaded 40965 primary data records. [2025-10-03T22:46:44.169802] [DEBUG] [LOCAL ] VLO: Loaded 53849 existing records from primary storage. [2025-10-03T22:46:44.193821] [INFO ] [MAIN ] VLO: Loaded 53849 primary data records. [2025-10-03T22:46:44.946289] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:44.972367] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 29562 primary records. [2025-10-03T22:46:44.973522] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-03T22:46:45.017674] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-10-03T22:46:45.018110] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-03T22:46:45.022071] [INFO ] [MAIN ] Derivative Progress: 1942/2073 symbols completed. VLN took 1.3s. Estimated remaining: 53.1s. Rate: 148.1 symbols/min [2025-10-03T22:46:45.025437] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:45.064324] [DEBUG] [LOCAL ] VLT: Loaded 4577 existing records from primary storage. [2025-10-03T22:46:45.059513] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:45.065312] [INFO ] [MAIN ] VLT: Loaded 4577 primary data records. [2025-10-03T22:46:45.088237] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 40965 primary records. [2025-10-03T22:46:45.105015] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-03T22:46:45.243492] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:45.257332] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53849 primary records. [2025-10-03T22:46:45.264373] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-03T22:46:45.281979] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-10-03T22:46:45.296588] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-03T22:46:45.300932] [INFO ] [MAIN ] Derivative Progress: 1943/2073 symbols completed. VLRS took 1.5s. Estimated remaining: 52.7s. Rate: 148.1 symbols/min [2025-10-03T22:46:45.331126] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:45.540503] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-10-03T22:46:45.541971] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-03T22:46:45.545778] [INFO ] [MAIN ] Derivative Progress: 1944/2073 symbols completed. VLO took 1.8s. Estimated remaining: 52.3s. Rate: 148.1 symbols/min [2025-10-03T22:46:45.546271] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:45.613820] [DEBUG] [LOCAL ] VLTO: Loaded 46686 existing records from primary storage. [2025-10-03T22:46:45.614265] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:45.614532] [INFO ] [MAIN ] VLTO: Loaded 46686 primary data records. [2025-10-03T22:46:45.620760] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4577 primary records. [2025-10-03T22:46:45.637762] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-03T22:46:45.782309] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-10-03T22:46:45.821008] [DEBUG] [LOCAL ] VMC: Loaded 43854 existing records from primary storage. [2025-10-03T22:46:45.821130] [INFO ] [MAIN ] VMC: Loaded 43854 primary data records. [2025-10-03T22:46:45.842738] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-03T22:46:45.857493] [INFO ] [MAIN ] Derivative Progress: 1945/2073 symbols completed. VLT took 0.8s. Estimated remaining: 51.8s. Rate: 148.1 symbols/min [2025-10-03T22:46:45.867595] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:46.187418] [DEBUG] [LOCAL ] VMI: Loaded 15568 existing records from primary storage. [2025-10-03T22:46:46.187805] [INFO ] [MAIN ] VMI: Loaded 15568 primary data records. [2025-10-03T22:46:46.638154] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:46.640763] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46686 primary records. [2025-10-03T22:46:46.641895] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-03T22:46:46.675838] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-10-03T22:46:46.676216] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-03T22:46:46.677062] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:46.680305] [INFO ] [MAIN ] Derivative Progress: 1946/2073 symbols completed. VLTO took 1.3s. Estimated remaining: 51.5s. Rate: 148.1 symbols/min [2025-10-03T22:46:46.681770] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 43854 primary records. [2025-10-03T22:46:46.681987] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:46.681895] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-03T22:46:46.700359] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-10-03T22:46:46.700796] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-03T22:46:46.703205] [INFO ] [MAIN ] Derivative Progress: 1947/2073 symbols completed. VMC took 1.2s. Estimated remaining: 51.0s. Rate: 148.1 symbols/min [2025-10-03T22:46:46.703889] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:46.731395] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:46.732268] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15568 primary records. [2025-10-03T22:46:46.732464] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-03T22:46:46.743308] [DEBUG] [LOCAL ] VNCE: Loaded 8345 existing records from primary storage. [2025-10-03T22:46:46.744630] [DEBUG] [LOCAL ] VMO: Loaded 21385 existing records from primary storage. [2025-10-03T22:46:46.744983] [INFO ] [MAIN ] VNCE: Loaded 8345 primary data records. [2025-10-03T22:46:46.755745] [INFO ] [MAIN ] VMO: Loaded 21385 primary data records. [2025-10-03T22:46:46.810800] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-10-03T22:46:46.823421] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-03T22:46:46.865156] [INFO ] [MAIN ] Derivative Progress: 1948/2073 symbols completed. VMI took 1.0s. Estimated remaining: 50.6s. Rate: 148.2 symbols/min [2025-10-03T22:46:47.433330] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:47.435824] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 8345 primary records. [2025-10-03T22:46:47.436130] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-03T22:46:47.460897] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:47.463215] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21385 primary records. [2025-10-03T22:46:47.465983] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-03T22:46:47.479516] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-10-03T22:46:47.483598] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-03T22:46:47.486728] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-10-03T22:46:47.489062] [INFO ] [MAIN ] Derivative Progress: 1949/2073 symbols completed. VNCE took 0.8s. Estimated remaining: 50.2s. Rate: 148.1 symbols/min [2025-10-03T22:46:47.489215] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-03T22:46:47.492045] [INFO ] [MAIN ] Derivative Progress: 1950/2073 symbols completed. VMO took 0.8s. Estimated remaining: 49.8s. Rate: 148.2 symbols/min [2025-10-03T22:46:47.492451] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:47.492589] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:47.492524] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:47.509120] [DEBUG] [LOCAL ] VOC: Loaded 9030 existing records from primary storage. [2025-10-03T22:46:47.509580] [INFO ] [MAIN ] VOC: Loaded 9030 primary data records. [2025-10-03T22:46:47.945278] [DEBUG] [LOCAL ] VNT: Loaded 44165 existing records from primary storage. [2025-10-03T22:46:47.947077] [INFO ] [MAIN ] VNT: Loaded 44165 primary data records. [2025-10-03T22:46:47.946307] [DEBUG] [LOCAL ] VNO: Loaded 49511 existing records from primary storage. [2025-10-03T22:46:47.952800] [INFO ] [MAIN ] VNO: Loaded 49511 primary data records. [2025-10-03T22:46:48.604300] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:48.605386] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9030 primary records. [2025-10-03T22:46:48.606033] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-03T22:46:48.628425] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-10-03T22:46:48.628956] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-03T22:46:48.633730] [INFO ] [MAIN ] Derivative Progress: 1951/2073 symbols completed. VOC took 1.1s. Estimated remaining: 49.4s. Rate: 148.1 symbols/min [2025-10-03T22:46:48.634620] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:48.658144] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:48.667300] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44165 primary records. [2025-10-03T22:46:48.668107] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-03T22:46:48.668028] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:48.669801] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49511 primary records. [2025-10-03T22:46:48.669952] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-03T22:46:48.694299] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-10-03T22:46:48.698779] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-03T22:46:48.701043] [INFO ] [MAIN ] Derivative Progress: 1952/2073 symbols completed. VNT took 1.2s. Estimated remaining: 49.0s. Rate: 148.1 symbols/min [2025-10-03T22:46:48.701293] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:48.706371] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-10-03T22:46:48.706539] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-03T22:46:48.709992] [INFO ] [MAIN ] Derivative Progress: 1953/2073 symbols completed. VNO took 1.2s. Estimated remaining: 48.6s. Rate: 148.2 symbols/min [2025-10-03T22:46:48.710339] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:48.730812] [DEBUG] [LOCAL ] VPV: Loaded 5487 existing records from primary storage. [2025-10-03T22:46:48.731130] [INFO ] [MAIN ] VPV: Loaded 5487 primary data records. [2025-10-03T22:46:48.837885] [DEBUG] [LOCAL ] VPG: Loaded 17266 existing records from primary storage. [2025-10-03T22:46:48.843206] [INFO ] [MAIN ] VPG: Loaded 17266 primary data records. [2025-10-03T22:46:48.884914] [DEBUG] [LOCAL ] VOYA: Loaded 43096 existing records from primary storage. [2025-10-03T22:46:48.936112] [INFO ] [MAIN ] VOYA: Loaded 43096 primary data records. [2025-10-03T22:46:49.765679] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:49.766947] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5487 primary records. [2025-10-03T22:46:49.767053] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-03T22:46:49.781197] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:49.790317] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17266 primary records. [2025-10-03T22:46:49.793324] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-03T22:46:49.798132] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-10-03T22:46:49.798435] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-03T22:46:49.800568] [INFO ] [MAIN ] Derivative Progress: 1954/2073 symbols completed. VPV took 1.1s. Estimated remaining: 48.2s. Rate: 148.1 symbols/min [2025-10-03T22:46:49.808802] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:49.817892] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-10-03T22:46:49.818089] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-03T22:46:49.821136] [INFO ] [MAIN ] Derivative Progress: 1955/2073 symbols completed. VPG took 1.1s. Estimated remaining: 47.8s. Rate: 148.2 symbols/min [2025-10-03T22:46:49.821349] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:49.839826] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:49.840605] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 43096 primary records. [2025-10-03T22:46:49.840819] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-03T22:46:49.883866] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-10-03T22:46:49.884181] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-03T22:46:49.887982] [INFO ] [MAIN ] Derivative Progress: 1956/2073 symbols completed. VOYA took 1.3s. Estimated remaining: 47.4s. Rate: 148.2 symbols/min [2025-10-03T22:46:49.888293] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:49.916485] [DEBUG] [LOCAL ] VRE: Loaded 35517 existing records from primary storage. [2025-10-03T22:46:49.916794] [INFO ] [MAIN ] VRE: Loaded 35517 primary data records. [2025-10-03T22:46:50.018345] [DEBUG] [LOCAL ] VRTS: Loaded 9386 existing records from primary storage. [2025-10-03T22:46:50.040117] [INFO ] [MAIN ] VRTS: Loaded 9386 primary data records. [2025-10-03T22:46:50.077220] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-03T22:46:50.100329] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-10-03T22:46:50.912374] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:50.914770] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35517 primary records. [2025-10-03T22:46:50.915156] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-03T22:46:50.934558] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-10-03T22:46:50.934846] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-03T22:46:50.937944] [INFO ] [MAIN ] Derivative Progress: 1957/2073 symbols completed. VRE took 1.1s. Estimated remaining: 47.0s. Rate: 148.1 symbols/min [2025-10-03T22:46:50.938952] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:50.954152] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:50.958674] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9386 primary records. [2025-10-03T22:46:50.958909] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-03T22:46:50.985678] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:50.986825] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-10-03T22:46:50.987500] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-03T22:46:51.010406] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-10-03T22:46:51.011736] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-10-03T22:46:51.011639] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-03T22:46:51.014795] [INFO ] [MAIN ] Derivative Progress: 1958/2073 symbols completed. VRTS took 1.1s. Estimated remaining: 46.6s. Rate: 148.2 symbols/min [2025-10-03T22:46:51.011959] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-03T22:46:51.015041] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:51.018123] [INFO ] [MAIN ] Derivative Progress: 1959/2073 symbols completed. VRT took 1.2s. Estimated remaining: 46.1s. Rate: 148.2 symbols/min [2025-10-03T22:46:51.018639] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:51.059939] [DEBUG] [LOCAL ] VSCO: Loaded 53540 existing records from primary storage. [2025-10-03T22:46:51.060319] [INFO ] [MAIN ] VSCO: Loaded 53540 primary data records. [2025-10-03T22:46:51.463288] [DEBUG] [LOCAL ] VSH: Loaded 49064 existing records from primary storage. [2025-10-03T22:46:51.468989] [INFO ] [MAIN ] VSH: Loaded 49064 primary data records. [2025-10-03T22:46:51.532479] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-10-03T22:46:51.567880] [INFO ] [MAIN ] VST: Loaded 54498 primary data records. [2025-10-03T22:46:52.300016] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:52.301572] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53540 primary records. [2025-10-03T22:46:52.301811] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-03T22:46:52.327162] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-10-03T22:46:52.340540] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-03T22:46:52.343273] [INFO ] [MAIN ] Derivative Progress: 1960/2073 symbols completed. VSCO took 1.4s. Estimated remaining: 45.8s. Rate: 148.1 symbols/min [2025-10-03T22:46:52.343777] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:52.344556] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:52.345914] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 49064 primary records. [2025-10-03T22:46:52.346140] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-03T22:46:52.366388] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-10-03T22:46:52.367524] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-03T22:46:52.371040] [INFO ] [MAIN ] Derivative Progress: 1961/2073 symbols completed. VSH took 1.4s. Estimated remaining: 45.4s. Rate: 148.1 symbols/min [2025-10-03T22:46:52.371429] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:52.385322] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:52.386210] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54498 primary records. [2025-10-03T22:46:52.386406] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-03T22:46:52.414814] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-10-03T22:46:52.415031] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-03T22:46:52.418489] [INFO ] [MAIN ] Derivative Progress: 1962/2073 symbols completed. VST took 1.4s. Estimated remaining: 44.9s. Rate: 148.2 symbols/min [2025-10-03T22:46:52.418923] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:52.436427] [DEBUG] [LOCAL ] VSTS: Loaded 49740 existing records from primary storage. [2025-10-03T22:46:52.436765] [INFO ] [MAIN ] VSTS: Loaded 49740 primary data records. [2025-10-03T22:46:52.595666] [DEBUG] [LOCAL ] VTEX: Loaded 43788 existing records from primary storage. [2025-10-03T22:46:52.646739] [INFO ] [MAIN ] VTEX: Loaded 43788 primary data records. [2025-10-03T22:46:52.910873] [DEBUG] [LOCAL ] VTLE: Loaded 49133 existing records from primary storage. [2025-10-03T22:46:52.919029] [INFO ] [MAIN ] VTLE: Loaded 49133 primary data records. [2025-10-03T22:46:53.493425] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:53.494885] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49740 primary records. [2025-10-03T22:46:53.495158] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-03T22:46:53.530631] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-10-03T22:46:53.531569] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-03T22:46:53.531218] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:53.536129] [INFO ] [MAIN ] Derivative Progress: 1963/2073 symbols completed. VSTS took 1.2s. Estimated remaining: 44.6s. Rate: 148.1 symbols/min [2025-10-03T22:46:53.532609] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43788 primary records. [2025-10-03T22:46:53.536565] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-03T22:46:53.553924] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-10-03T22:46:53.554344] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-03T22:46:53.556985] [INFO ] [MAIN ] Derivative Progress: 1964/2073 symbols completed. VTEX took 1.2s. Estimated remaining: 44.1s. Rate: 148.1 symbols/min [2025-10-03T22:46:53.570531] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:53.571145] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 49133 primary records. [2025-10-03T22:46:53.571207] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-03T22:46:53.586934] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-10-03T22:46:53.586994] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-03T22:46:53.589569] [INFO ] [MAIN ] Derivative Progress: 1965/2073 symbols completed. VTLE took 1.2s. Estimated remaining: 43.7s. Rate: 148.2 symbols/min [2025-10-03T22:46:53.590035] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:53.590129] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:53.590227] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:53.606385] [DEBUG] [LOCAL ] VTN: Loaded 7110 existing records from primary storage. [2025-10-03T22:46:53.612484] [INFO ] [MAIN ] VTN: Loaded 7110 primary data records. [2025-10-03T22:46:53.719930] [DEBUG] [LOCAL ] VTOL: Loaded 19778 existing records from primary storage. [2025-10-03T22:46:53.752012] [DEBUG] [LOCAL ] VTMX: Loaded 17716 existing records from primary storage. [2025-10-03T22:46:53.747923] [INFO ] [MAIN ] VTOL: Loaded 19778 primary data records. [2025-10-03T22:46:53.763822] [INFO ] [MAIN ] VTMX: Loaded 17716 primary data records. [2025-10-03T22:46:54.676949] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:54.678013] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7110 primary records. [2025-10-03T22:46:54.678378] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-03T22:46:54.710489] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-10-03T22:46:54.711594] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-03T22:46:54.714962] [INFO ] [MAIN ] Derivative Progress: 1966/2073 symbols completed. VTN took 1.1s. Estimated remaining: 43.4s. Rate: 148.1 symbols/min [2025-10-03T22:46:54.715721] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:54.715433] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:54.729101] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19778 primary records. [2025-10-03T22:46:54.730279] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:54.730340] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-03T22:46:54.731212] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17716 primary records. [2025-10-03T22:46:54.731397] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-03T22:46:54.763674] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-10-03T22:46:54.763868] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-03T22:46:54.767097] [INFO ] [MAIN ] Derivative Progress: 1967/2073 symbols completed. VTMX took 1.2s. Estimated remaining: 42.9s. Rate: 148.1 symbols/min [2025-10-03T22:46:54.764357] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-10-03T22:46:54.767529] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-03T22:46:54.767318] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:54.770782] [INFO ] [MAIN ] Derivative Progress: 1968/2073 symbols completed. VTOL took 1.2s. Estimated remaining: 42.5s. Rate: 148.2 symbols/min [2025-10-03T22:46:54.771089] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:54.839267] [DEBUG] [LOCAL ] VTS: Loaded 30893 existing records from primary storage. [2025-10-03T22:46:54.855227] [INFO ] [MAIN ] VTS: Loaded 30893 primary data records. [2025-10-03T22:46:54.855123] [DEBUG] [LOCAL ] VTR: Loaded 53582 existing records from primary storage. [2025-10-03T22:46:54.860621] [INFO ] [MAIN ] VTR: Loaded 53582 primary data records. [2025-10-03T22:46:54.854125] [DEBUG] [LOCAL ] VVR: Loaded 31896 existing records from primary storage. [2025-10-03T22:46:54.887469] [INFO ] [MAIN ] VVR: Loaded 31896 primary data records. [2025-10-03T22:46:55.829788] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:55.839305] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30893 primary records. [2025-10-03T22:46:55.846554] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-03T22:46:55.846473] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:55.848006] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 31896 primary records. [2025-10-03T22:46:55.848421] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-03T22:46:55.879421] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:55.892694] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-10-03T22:46:55.897072] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-10-03T22:46:55.897274] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-03T22:46:55.893691] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53582 primary records. [2025-10-03T22:46:55.897453] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-03T22:46:55.899609] [INFO ] [MAIN ] Derivative Progress: 1969/2073 symbols completed. VTS took 1.1s. Estimated remaining: 42.1s. Rate: 148.1 symbols/min [2025-10-03T22:46:55.900276] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:55.897195] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-03T22:46:55.903889] [INFO ] [MAIN ] Derivative Progress: 1970/2073 symbols completed. VVR took 1.1s. Estimated remaining: 41.7s. Rate: 148.2 symbols/min [2025-10-03T22:46:55.904299] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:55.922488] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-10-03T22:46:55.922594] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-03T22:46:55.925550] [INFO ] [MAIN ] Derivative Progress: 1971/2073 symbols completed. VTR took 1.2s. Estimated remaining: 41.3s. Rate: 148.2 symbols/min [2025-10-03T22:46:55.925946] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:55.955000] [DEBUG] [LOCAL ] VVX: Loaded 23447 existing records from primary storage. [2025-10-03T22:46:55.955368] [INFO ] [MAIN ] VVX: Loaded 23447 primary data records. [2025-10-03T22:46:56.348324] [DEBUG] [LOCAL ] VVV: Loaded 50880 existing records from primary storage. [2025-10-03T22:46:56.348637] [INFO ] [MAIN ] VVV: Loaded 50880 primary data records. [2025-10-03T22:46:56.430231] [DEBUG] [LOCAL ] VYX: Loaded 49397 existing records from primary storage. [2025-10-03T22:46:56.442255] [INFO ] [MAIN ] VYX: Loaded 49397 primary data records. [2025-10-03T22:46:57.049131] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:57.051185] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23447 primary records. [2025-10-03T22:46:57.051884] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-03T22:46:57.078264] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-10-03T22:46:57.078544] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-03T22:46:57.083135] [INFO ] [MAIN ] Derivative Progress: 1972/2073 symbols completed. VVX took 1.2s. Estimated remaining: 40.9s. Rate: 148.1 symbols/min [2025-10-03T22:46:57.084188] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:57.109825] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:57.111014] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 50880 primary records. [2025-10-03T22:46:57.111292] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-03T22:46:57.131876] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-10-03T22:46:57.132316] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-03T22:46:57.135583] [INFO ] [MAIN ] Derivative Progress: 1973/2073 symbols completed. VVV took 1.2s. Estimated remaining: 40.5s. Rate: 148.1 symbols/min [2025-10-03T22:46:57.144103] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:57.150949] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:57.151910] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49397 primary records. [2025-10-03T22:46:57.152083] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-03T22:46:57.185281] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-10-03T22:46:57.185449] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-03T22:46:57.188491] [INFO ] [MAIN ] Derivative Progress: 1974/2073 symbols completed. VYX took 1.3s. Estimated remaining: 40.1s. Rate: 148.2 symbols/min [2025-10-03T22:46:57.188976] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:57.210897] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-03T22:46:57.211115] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-10-03T22:46:57.429075] [DEBUG] [LOCAL ] W: Loaded 54229 existing records from primary storage. [2025-10-03T22:46:57.579961] [INFO ] [MAIN ] W: Loaded 54229 primary data records. [2025-10-03T22:46:57.689380] [DEBUG] [LOCAL ] WAB: Loaded 44708 existing records from primary storage. [2025-10-03T22:46:57.725982] [INFO ] [MAIN ] WAB: Loaded 44708 primary data records. [2025-10-03T22:46:58.397142] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:58.399054] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-10-03T22:46:58.399772] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-03T22:46:58.425244] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-10-03T22:46:58.425479] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-03T22:46:58.428082] [INFO ] [MAIN ] Derivative Progress: 1975/2073 symbols completed. VZ took 1.3s. Estimated remaining: 39.7s. Rate: 148.1 symbols/min [2025-10-03T22:46:58.428550] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:58.443066] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:58.444190] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54229 primary records. [2025-10-03T22:46:58.444844] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-03T22:46:58.463360] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-10-03T22:46:58.463675] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-03T22:46:58.466979] [INFO ] [MAIN ] Derivative Progress: 1976/2073 symbols completed. W took 1.3s. Estimated remaining: 39.3s. Rate: 148.1 symbols/min [2025-10-03T22:46:58.467169] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:58.486690] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:58.488056] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44708 primary records. [2025-10-03T22:46:58.488210] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-03T22:46:58.517575] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-10-03T22:46:58.517936] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-03T22:46:58.521220] [INFO ] [MAIN ] Derivative Progress: 1977/2073 symbols completed. WAB took 1.3s. Estimated remaining: 38.9s. Rate: 148.2 symbols/min [2025-10-03T22:46:58.521693] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:58.546244] [DEBUG] [LOCAL ] WAL: Loaded 45880 existing records from primary storage. [2025-10-03T22:46:58.547101] [INFO ] [MAIN ] WAL: Loaded 45880 primary data records. [2025-10-03T22:46:58.630370] [DEBUG] [LOCAL ] WAT: Loaded 35845 existing records from primary storage. [2025-10-03T22:46:58.638803] [INFO ] [MAIN ] WAT: Loaded 35845 primary data records. [2025-10-03T22:46:59.016618] [DEBUG] [LOCAL ] WBS: Loaded 49413 existing records from primary storage. [2025-10-03T22:46:59.022779] [INFO ] [MAIN ] WBS: Loaded 49413 primary data records. [2025-10-03T22:46:59.583450] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:59.588263] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 45880 primary records. [2025-10-03T22:46:59.589602] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-03T22:46:59.628749] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:59.632175] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-10-03T22:46:59.633261] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 35845 primary records. [2025-10-03T22:46:59.633608] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-03T22:46:59.636739] [INFO ] [MAIN ] Derivative Progress: 1978/2073 symbols completed. WAL took 1.2s. Estimated remaining: 38.5s. Rate: 148.1 symbols/min [2025-10-03T22:46:59.633888] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-03T22:46:59.674150] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:46:59.676308] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49413 primary records. [2025-10-03T22:46:59.676753] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-03T22:46:59.678157] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-10-03T22:46:59.678273] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-03T22:46:59.683118] [INFO ] [MAIN ] Derivative Progress: 1979/2073 symbols completed. WAT took 1.2s. Estimated remaining: 38.1s. Rate: 148.1 symbols/min [2025-10-03T22:46:59.698637] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-10-03T22:46:59.698739] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-03T22:46:59.701686] [INFO ] [MAIN ] Derivative Progress: 1980/2073 symbols completed. WBS took 1.2s. Estimated remaining: 37.7s. Rate: 148.2 symbols/min [2025-10-03T22:46:59.702448] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:59.702364] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:59.702221] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:46:59.723890] [DEBUG] [LOCAL ] WBX: Loaded 11679 existing records from primary storage. [2025-10-03T22:46:59.724087] [INFO ] [MAIN ] WBX: Loaded 11679 primary data records. [2025-10-03T22:47:00.097958] [DEBUG] [LOCAL ] WCC: Loaded 40042 existing records from primary storage. [2025-10-03T22:47:00.115326] [INFO ] [MAIN ] WCC: Loaded 40042 primary data records. [2025-10-03T22:47:00.187886] [DEBUG] [LOCAL ] WCN: Loaded 48606 existing records from primary storage. [2025-10-03T22:47:00.202567] [INFO ] [MAIN ] WCN: Loaded 48606 primary data records. [2025-10-03T22:47:00.830857] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:00.832001] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 11679 primary records. [2025-10-03T22:47:00.833300] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-03T22:47:00.853783] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-10-03T22:47:00.854226] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-03T22:47:00.858699] [INFO ] [MAIN ] Derivative Progress: 1981/2073 symbols completed. WBX took 1.2s. Estimated remaining: 37.3s. Rate: 148.1 symbols/min [2025-10-03T22:47:00.858961] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:00.878336] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:00.880426] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 40042 primary records. [2025-10-03T22:47:00.880513] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-03T22:47:00.913162] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-10-03T22:47:00.920308] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-03T22:47:00.911116] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:00.921238] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48606 primary records. [2025-10-03T22:47:00.923837] [INFO ] [MAIN ] Derivative Progress: 1982/2073 symbols completed. WCC took 1.2s. Estimated remaining: 36.9s. Rate: 148.1 symbols/min [2025-10-03T22:47:00.924254] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-03T22:47:00.925157] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:00.952093] [DEBUG] [LOCAL ] WD: Loaded 23496 existing records from primary storage. [2025-10-03T22:47:00.953905] [INFO ] [MAIN ] WD: Loaded 23496 primary data records. [2025-10-03T22:47:01.016931] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-10-03T22:47:01.045611] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-03T22:47:01.068351] [INFO ] [MAIN ] Derivative Progress: 1983/2073 symbols completed. WCN took 1.4s. Estimated remaining: 36.4s. Rate: 148.2 symbols/min [2025-10-03T22:47:01.076139] [DEBUG] [LOCAL ] WDH: Loaded 17937 existing records from primary storage. [2025-10-03T22:47:01.088249] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:01.088883] [INFO ] [MAIN ] WDH: Loaded 17937 primary data records. [2025-10-03T22:47:01.472578] [DEBUG] [LOCAL ] WDI: Loaded 21410 existing records from primary storage. [2025-10-03T22:47:01.501536] [INFO ] [MAIN ] WDI: Loaded 21410 primary data records. [2025-10-03T22:47:02.010298] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:02.012461] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23496 primary records. [2025-10-03T22:47:02.013957] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-03T22:47:02.029027] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:02.030595] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 17937 primary records. [2025-10-03T22:47:02.042523] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-03T22:47:02.061437] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-10-03T22:47:02.062882] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-03T22:47:02.065316] [INFO ] [MAIN ] Derivative Progress: 1984/2073 symbols completed. WD took 1.2s. Estimated remaining: 36.1s. Rate: 148.1 symbols/min [2025-10-03T22:47:02.065828] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:02.095691] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:02.095230] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-10-03T22:47:02.095875] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-03T22:47:02.100551] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21410 primary records. [2025-10-03T22:47:02.099165] [INFO ] [MAIN ] Derivative Progress: 1985/2073 symbols completed. WDH took 1.2s. Estimated remaining: 35.6s. Rate: 148.1 symbols/min [2025-10-03T22:47:02.100924] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-03T22:47:02.101988] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:02.120918] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-10-03T22:47:02.121070] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-03T22:47:02.124276] [INFO ] [MAIN ] Derivative Progress: 1986/2073 symbols completed. WDI took 1.0s. Estimated remaining: 35.2s. Rate: 148.2 symbols/min [2025-10-03T22:47:02.137056] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:02.146863] [DEBUG] [LOCAL ] WEA: Loaded 7325 existing records from primary storage. [2025-10-03T22:47:02.147050] [INFO ] [MAIN ] WEA: Loaded 7325 primary data records. [2025-10-03T22:47:02.269389] [DEBUG] [LOCAL ] WDS: Loaded 43883 existing records from primary storage. [2025-10-03T22:47:02.273144] [INFO ] [MAIN ] WDS: Loaded 43883 primary data records. [2025-10-03T22:47:02.493747] [DEBUG] [LOCAL ] WEAV: Loaded 42548 existing records from primary storage. [2025-10-03T22:47:02.494280] [INFO ] [MAIN ] WEAV: Loaded 42548 primary data records. [2025-10-03T22:47:03.267731] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:03.268194] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:03.269264] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 43883 primary records. [2025-10-03T22:47:03.270372] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7325 primary records. [2025-10-03T22:47:03.270620] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-03T22:47:03.271754] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-03T22:47:03.297185] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-10-03T22:47:03.297343] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-03T22:47:03.301626] [INFO ] [MAIN ] Derivative Progress: 1987/2073 symbols completed. WDS took 1.2s. Estimated remaining: 34.9s. Rate: 148.1 symbols/min [2025-10-03T22:47:03.307166] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:03.311058] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-10-03T22:47:03.311444] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-03T22:47:03.313786] [INFO ] [MAIN ] Derivative Progress: 1988/2073 symbols completed. WEA took 1.2s. Estimated remaining: 34.4s. Rate: 148.1 symbols/min [2025-10-03T22:47:03.313999] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:03.327886] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:03.328627] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42548 primary records. [2025-10-03T22:47:03.328765] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-03T22:47:03.344879] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-10-03T22:47:03.345084] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-03T22:47:03.348072] [INFO ] [MAIN ] Derivative Progress: 1989/2073 symbols completed. WEAV took 1.2s. Estimated remaining: 34.0s. Rate: 148.2 symbols/min [2025-10-03T22:47:03.348293] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:03.407063] [DEBUG] [LOCAL ] WEC: Loaded 52957 existing records from primary storage. [2025-10-03T22:47:03.407356] [INFO ] [MAIN ] WEC: Loaded 52957 primary data records. [2025-10-03T22:47:03.550848] [DEBUG] [LOCAL ] WELL: Loaded 53120 existing records from primary storage. [2025-10-03T22:47:03.568937] [DEBUG] [LOCAL ] WES: Loaded 48847 existing records from primary storage. [2025-10-03T22:47:03.574381] [INFO ] [MAIN ] WES: Loaded 48847 primary data records. [2025-10-03T22:47:03.574279] [INFO ] [MAIN ] WELL: Loaded 53120 primary data records. [2025-10-03T22:47:04.389548] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:04.391026] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52957 primary records. [2025-10-03T22:47:04.391231] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-03T22:47:04.431121] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-10-03T22:47:04.431302] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-03T22:47:04.430675] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:04.433681] [INFO ] [MAIN ] Derivative Progress: 1990/2073 symbols completed. WEC took 1.1s. Estimated remaining: 33.6s. Rate: 148.1 symbols/min [2025-10-03T22:47:04.442607] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:04.444135] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53120 primary records. [2025-10-03T22:47:04.450198] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-03T22:47:04.451617] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:04.452429] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 48847 primary records. [2025-10-03T22:47:04.452749] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-03T22:47:04.493478] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-10-03T22:47:04.494290] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-03T22:47:04.500391] [INFO ] [MAIN ] Derivative Progress: 1991/2073 symbols completed. WELL took 1.2s. Estimated remaining: 33.2s. Rate: 148.1 symbols/min [2025-10-03T22:47:04.500972] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:04.511170] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-10-03T22:47:04.511393] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-03T22:47:04.515334] [INFO ] [MAIN ] Derivative Progress: 1992/2073 symbols completed. WES took 1.2s. Estimated remaining: 32.8s. Rate: 148.2 symbols/min [2025-10-03T22:47:04.515942] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:04.533896] [DEBUG] [LOCAL ] WEX: Loaded 34924 existing records from primary storage. [2025-10-03T22:47:04.534126] [INFO ] [MAIN ] WEX: Loaded 34924 primary data records. [2025-10-03T22:47:04.593117] [DEBUG] [LOCAL ] WF: Loaded 10827 existing records from primary storage. [2025-10-03T22:47:04.623629] [INFO ] [MAIN ] WF: Loaded 10827 primary data records. [2025-10-03T22:47:05.252679] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-10-03T22:47:05.262283] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-10-03T22:47:05.672804] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:05.673184] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:05.674420] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 34924 primary records. [2025-10-03T22:47:05.675075] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 10827 primary records. [2025-10-03T22:47:05.675395] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-03T22:47:05.675360] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-03T22:47:05.705629] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-10-03T22:47:05.706324] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-03T22:47:05.709100] [INFO ] [MAIN ] Derivative Progress: 1993/2073 symbols completed. WEX took 1.3s. Estimated remaining: 32.4s. Rate: 148.1 symbols/min [2025-10-03T22:47:05.713411] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-10-03T22:47:05.713745] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-03T22:47:05.716414] [INFO ] [MAIN ] Derivative Progress: 1994/2073 symbols completed. WF took 1.2s. Estimated remaining: 32.0s. Rate: 148.1 symbols/min [2025-10-03T22:47:05.734162] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:05.734798] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-10-03T22:47:05.734861] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-03T22:47:05.750172] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-10-03T22:47:05.750239] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-03T22:47:05.753014] [INFO ] [MAIN ] Derivative Progress: 1995/2073 symbols completed. WFC took 1.2s. Estimated remaining: 31.6s. Rate: 148.2 symbols/min [2025-10-03T22:47:05.753465] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:05.753626] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:05.753558] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:05.784913] [DEBUG] [LOCAL ] WFG: Loaded 25021 existing records from primary storage. [2025-10-03T22:47:05.785082] [INFO ] [MAIN ] WFG: Loaded 25021 primary data records. [2025-10-03T22:47:05.959348] [DEBUG] [LOCAL ] WH: Loaded 46091 existing records from primary storage. [2025-10-03T22:47:05.994938] [DEBUG] [LOCAL ] WGO: Loaded 39397 existing records from primary storage. [2025-10-03T22:47:05.992173] [INFO ] [MAIN ] WH: Loaded 46091 primary data records. [2025-10-03T22:47:06.001089] [INFO ] [MAIN ] WGO: Loaded 39397 primary data records. [2025-10-03T22:47:06.824100] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:06.825735] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25021 primary records. [2025-10-03T22:47:06.825935] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-03T22:47:06.847438] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-10-03T22:47:06.848739] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-03T22:47:06.851230] [INFO ] [MAIN ] Derivative Progress: 1996/2073 symbols completed. WFG took 1.1s. Estimated remaining: 31.2s. Rate: 148.1 symbols/min [2025-10-03T22:47:06.851633] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:06.869954] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:06.871221] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 39397 primary records. [2025-10-03T22:47:06.871441] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-03T22:47:06.898413] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:06.900591] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 46091 primary records. [2025-10-03T22:47:06.901789] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-03T22:47:06.915750] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-10-03T22:47:06.918443] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-03T22:47:06.922131] [INFO ] [MAIN ] Derivative Progress: 1997/2073 symbols completed. WGO took 1.2s. Estimated remaining: 30.8s. Rate: 148.1 symbols/min [2025-10-03T22:47:06.922815] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:06.924719] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-10-03T22:47:06.924793] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-03T22:47:06.927681] [INFO ] [MAIN ] Derivative Progress: 1998/2073 symbols completed. WH took 1.2s. Estimated remaining: 30.4s. Rate: 148.2 symbols/min [2025-10-03T22:47:06.928033] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:06.943916] [DEBUG] [LOCAL ] WHG: Loaded 3327 existing records from primary storage. [2025-10-03T22:47:06.944235] [INFO ] [MAIN ] WHG: Loaded 3327 primary data records. [2025-10-03T22:47:07.068324] [DEBUG] [LOCAL ] WHD: Loaded 40900 existing records from primary storage. [2025-10-03T22:47:07.072305] [INFO ] [MAIN ] WHD: Loaded 40900 primary data records. [2025-10-03T22:47:07.599112] [DEBUG] [LOCAL ] WHR: Loaded 48838 existing records from primary storage. [2025-10-03T22:47:07.599386] [INFO ] [MAIN ] WHR: Loaded 48838 primary data records. [2025-10-03T22:47:07.937628] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:07.938689] [INFO ] [MAIN ] WHG: Generated 1820 derivative records from 3327 primary records. [2025-10-03T22:47:07.938986] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-03T22:47:07.970912] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:07.972211] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 40900 primary records. [2025-10-03T22:47:07.973133] [DEBUG] [LOCAL ] WHG: Derivative data saved (1820 records). [2025-10-03T22:47:07.973277] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-03T22:47:07.973368] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-03T22:47:07.977547] [INFO ] [MAIN ] Derivative Progress: 1999/2073 symbols completed. WHG took 1.1s. Estimated remaining: 30.0s. Rate: 148.1 symbols/min [2025-10-03T22:47:07.978520] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:08.004096] [DEBUG] [LOCAL ] WIA: Loaded 4897 existing records from primary storage. [2025-10-03T22:47:08.004978] [INFO ] [MAIN ] WIA: Loaded 4897 primary data records. [2025-10-03T22:47:08.083535] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-10-03T22:47:08.112588] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-03T22:47:08.123964] [INFO ] [MAIN ] Derivative Progress: 2000/2073 symbols completed. WHD took 1.3s. Estimated remaining: 29.6s. Rate: 148.1 symbols/min [2025-10-03T22:47:08.139993] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:08.145840] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:08.147045] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 48838 primary records. [2025-10-03T22:47:08.152421] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-03T22:47:08.227970] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-10-03T22:47:08.347453] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-03T22:47:08.350524] [INFO ] [MAIN ] Derivative Progress: 2001/2073 symbols completed. WHR took 1.4s. Estimated remaining: 29.2s. Rate: 148.2 symbols/min [2025-10-03T22:47:08.350948] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:08.357779] [DEBUG] [LOCAL ] WINN: Loaded 11777 existing records from primary storage. [2025-10-03T22:47:08.358196] [INFO ] [MAIN ] WINN: Loaded 11777 primary data records. [2025-10-03T22:47:08.752105] [DEBUG] [LOCAL ] WIT: Loaded 53128 existing records from primary storage. [2025-10-03T22:47:08.753068] [INFO ] [MAIN ] WIT: Loaded 53128 primary data records. [2025-10-03T22:47:08.778013] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:08.798337] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 4897 primary records. [2025-10-03T22:47:08.822232] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-03T22:47:09.140388] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-10-03T22:47:09.140832] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-03T22:47:09.143809] [INFO ] [MAIN ] Derivative Progress: 2002/2073 symbols completed. WIA took 1.2s. Estimated remaining: 28.8s. Rate: 148.1 symbols/min [2025-10-03T22:47:09.146233] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:09.163931] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:47:09.165186] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11777 primary records. [2025-10-03T22:47:09.165786] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-03T22:47:09.189963] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-10-03T22:47:09.190412] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-03T22:47:09.193625] [INFO ] [MAIN ] Derivative Progress: 2003/2073 symbols completed. WINN took 1.1s. Estimated remaining: 28.3s. Rate: 148.2 symbols/min [2025-10-03T22:47:09.193926] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:09.203752] [DEBUG] [LOCAL ] WIW: Loaded 20635 existing records from primary storage. [2025-10-03T22:47:09.204214] [INFO ] [MAIN ] WIW: Loaded 20635 primary data records. [2025-10-03T22:47:09.359072] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:09.388095] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53128 primary records. [2025-10-03T22:47:09.409817] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-03T22:47:09.433213] [DEBUG] [LOCAL ] WK: Loaded 37723 existing records from primary storage. [2025-10-03T22:47:09.564291] [INFO ] [MAIN ] WK: Loaded 37723 primary data records. [2025-10-03T22:47:09.634808] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-10-03T22:47:09.658326] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-03T22:47:09.684192] [INFO ] [MAIN ] Derivative Progress: 2004/2073 symbols completed. WIT took 1.3s. Estimated remaining: 27.9s. Rate: 148.1 symbols/min [2025-10-03T22:47:09.713683] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:09.983275] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:09.994458] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20635 primary records. [2025-10-03T22:47:09.995717] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-03T22:47:09.998530] [DEBUG] [LOCAL ] WKC: Loaded 35318 existing records from primary storage. [2025-10-03T22:47:09.998968] [INFO ] [MAIN ] WKC: Loaded 35318 primary data records. [2025-10-03T22:47:10.133881] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-10-03T22:47:10.134235] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-03T22:47:10.136929] [INFO ] [MAIN ] Derivative Progress: 2005/2073 symbols completed. WIW took 1.0s. Estimated remaining: 27.5s. Rate: 148.1 symbols/min [2025-10-03T22:47:10.142807] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:10.360821] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:10.362340] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37723 primary records. [2025-10-03T22:47:10.362728] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-03T22:47:10.392760] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-10-03T22:47:10.392834] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-03T22:47:10.395695] [INFO ] [MAIN ] Derivative Progress: 2006/2073 symbols completed. WK took 1.2s. Estimated remaining: 27.1s. Rate: 148.2 symbols/min [2025-10-03T22:47:10.395988] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:10.411688] [DEBUG] [LOCAL ] WLK: Loaded 46195 existing records from primary storage. [2025-10-03T22:47:10.412167] [INFO ] [MAIN ] WLK: Loaded 46195 primary data records. [2025-10-03T22:47:10.520498] [DEBUG] [LOCAL ] WLKP: Loaded 6948 existing records from primary storage. [2025-10-03T22:47:10.520898] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:10.535710] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35318 primary records. [2025-10-03T22:47:10.539705] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-03T22:47:10.534838] [INFO ] [MAIN ] WLKP: Loaded 6948 primary data records. [2025-10-03T22:47:10.670024] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-10-03T22:47:10.709755] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-03T22:47:10.725924] [INFO ] [MAIN ] Derivative Progress: 2007/2073 symbols completed. WKC took 1.0s. Estimated remaining: 26.7s. Rate: 148.2 symbols/min [2025-10-03T22:47:10.835308] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:11.150207] [DEBUG] [LOCAL ] WLY: Loaded 30031 existing records from primary storage. [2025-10-03T22:47:11.150665] [INFO ] [MAIN ] WLY: Loaded 30031 primary data records. [2025-10-03T22:47:11.334831] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:11.357253] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46195 primary records. [2025-10-03T22:47:11.357478] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-03T22:47:11.507624] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:11.508994] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 6948 primary records. [2025-10-03T22:47:11.509571] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-03T22:47:11.521598] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-10-03T22:47:11.521726] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-03T22:47:11.528577] [INFO ] [MAIN ] Derivative Progress: 2008/2073 symbols completed. WLK took 1.4s. Estimated remaining: 26.3s. Rate: 148.1 symbols/min [2025-10-03T22:47:11.533003] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-10-03T22:47:11.533338] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-03T22:47:11.535883] [INFO ] [MAIN ] Derivative Progress: 2009/2073 symbols completed. WLKP took 1.1s. Estimated remaining: 25.9s. Rate: 148.2 symbols/min [2025-10-03T22:47:11.554234] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:11.554906] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 30031 primary records. [2025-10-03T22:47:11.555018] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-03T22:47:11.571100] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-10-03T22:47:11.571170] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-03T22:47:11.574090] [INFO ] [MAIN ] Derivative Progress: 2010/2073 symbols completed. WLY took 0.7s. Estimated remaining: 25.5s. Rate: 148.2 symbols/min [2025-10-03T22:47:11.574671] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:11.574574] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:11.575231] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:11.593567] [DEBUG] [LOCAL ] WMK: Loaded 14684 existing records from primary storage. [2025-10-03T22:47:11.593846] [INFO ] [MAIN ] WMK: Loaded 14684 primary data records. [2025-10-03T22:47:11.840459] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-10-03T22:47:11.971882] [INFO ] [MAIN ] WMB: Loaded 54451 primary data records. [2025-10-03T22:47:12.016919] [DEBUG] [LOCAL ] WM: Loaded 51648 existing records from primary storage. [2025-10-03T22:47:12.062748] [INFO ] [MAIN ] WM: Loaded 51648 primary data records. [2025-10-03T22:47:12.648200] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:12.649950] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14684 primary records. [2025-10-03T22:47:12.650150] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-03T22:47:12.673715] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-10-03T22:47:12.674598] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-03T22:47:12.678363] [INFO ] [MAIN ] Derivative Progress: 2011/2073 symbols completed. WMK took 1.1s. Estimated remaining: 25.1s. Rate: 148.1 symbols/min [2025-10-03T22:47:12.678559] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:12.709940] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:12.711295] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51648 primary records. [2025-10-03T22:47:12.711432] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-03T22:47:12.710411] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:12.713063] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54451 primary records. [2025-10-03T22:47:12.720769] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-03T22:47:12.744042] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-10-03T22:47:12.744711] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-03T22:47:12.747871] [INFO ] [MAIN ] Derivative Progress: 2012/2073 symbols completed. WM took 1.2s. Estimated remaining: 24.7s. Rate: 148.2 symbols/min [2025-10-03T22:47:12.748325] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:12.762979] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-10-03T22:47:12.763154] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-03T22:47:12.765573] [INFO ] [MAIN ] Derivative Progress: 2013/2073 symbols completed. WMB took 1.2s. Estimated remaining: 24.3s. Rate: 148.3 symbols/min [2025-10-03T22:47:12.765845] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:12.780259] [DEBUG] [LOCAL ] WMS: Loaded 40088 existing records from primary storage. [2025-10-03T22:47:12.780605] [INFO ] [MAIN ] WMS: Loaded 40088 primary data records. [2025-10-03T22:47:13.188564] [DEBUG] [LOCAL ] WNC: Loaded 39805 existing records from primary storage. [2025-10-03T22:47:13.189302] [INFO ] [MAIN ] WNC: Loaded 39805 primary data records. [2025-10-03T22:47:13.189999] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-03T22:47:13.202116] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-10-03T22:47:13.958132] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:13.959022] [INFO ] [MAIN ] WMS: Generated 1820 derivative records from 40088 primary records. [2025-10-03T22:47:13.960123] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-03T22:47:13.980483] [DEBUG] [LOCAL ] WMS: Derivative data saved (1820 records). [2025-10-03T22:47:13.980782] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-03T22:47:13.984947] [INFO ] [MAIN ] Derivative Progress: 2014/2073 symbols completed. WMS took 1.3s. Estimated remaining: 23.9s. Rate: 148.1 symbols/min [2025-10-03T22:47:13.985418] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:14.005812] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:14.006634] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-10-03T22:47:14.006961] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-03T22:47:14.039471] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-10-03T22:47:14.040010] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-03T22:47:14.039819] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:14.040957] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 39805 primary records. [2025-10-03T22:47:14.043339] [INFO ] [MAIN ] Derivative Progress: 2015/2073 symbols completed. WMT took 1.3s. Estimated remaining: 23.5s. Rate: 148.2 symbols/min [2025-10-03T22:47:14.052602] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-03T22:47:14.052821] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:14.071520] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-10-03T22:47:14.082855] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-03T22:47:14.085912] [INFO ] [MAIN ] Derivative Progress: 2016/2073 symbols completed. WNC took 1.3s. Estimated remaining: 23.1s. Rate: 148.2 symbols/min [2025-10-03T22:47:14.086168] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:14.087424] [DEBUG] [LOCAL ] WNS: Loaded 40550 existing records from primary storage. [2025-10-03T22:47:14.087631] [INFO ] [MAIN ] WNS: Loaded 40550 primary data records. [2025-10-03T22:47:14.302703] [DEBUG] [LOCAL ] WOR: Loaded 25285 existing records from primary storage. [2025-10-03T22:47:14.420575] [INFO ] [MAIN ] WOR: Loaded 25285 primary data records. [2025-10-03T22:47:14.570690] [DEBUG] [LOCAL ] WOLF: Loaded 53962 existing records from primary storage. [2025-10-03T22:47:14.592161] [INFO ] [MAIN ] WOLF: Loaded 53962 primary data records. [2025-10-03T22:47:15.159135] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:15.161026] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40550 primary records. [2025-10-03T22:47:15.161287] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-03T22:47:15.179988] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-10-03T22:47:15.181232] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-03T22:47:15.183907] [INFO ] [MAIN ] Derivative Progress: 2017/2073 symbols completed. WNS took 1.2s. Estimated remaining: 22.7s. Rate: 148.1 symbols/min [2025-10-03T22:47:15.184583] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:15.204121] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:15.205344] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 25285 primary records. [2025-10-03T22:47:15.208416] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-03T22:47:15.235669] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:15.247040] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 53962 primary records. [2025-10-03T22:47:15.248387] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-03T22:47:15.248621] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-10-03T22:47:15.249235] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-03T22:47:15.251988] [INFO ] [MAIN ] Derivative Progress: 2018/2073 symbols completed. WOR took 1.2s. Estimated remaining: 22.3s. Rate: 148.2 symbols/min [2025-10-03T22:47:15.259718] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:15.276044] [DEBUG] [LOCAL ] WOW: Loaded 30989 existing records from primary storage. [2025-10-03T22:47:15.280129] [INFO ] [MAIN ] WOW: Loaded 30989 primary data records. [2025-10-03T22:47:15.280000] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-10-03T22:47:15.280525] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-03T22:47:15.284211] [INFO ] [MAIN ] Derivative Progress: 2019/2073 symbols completed. WOLF took 1.2s. Estimated remaining: 21.9s. Rate: 148.2 symbols/min [2025-10-03T22:47:15.296105] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:15.653389] [DEBUG] [LOCAL ] WPC: Loaded 49077 existing records from primary storage. [2025-10-03T22:47:15.655376] [INFO ] [MAIN ] WPC: Loaded 49077 primary data records. [2025-10-03T22:47:15.721989] [DEBUG] [LOCAL ] WPM: Loaded 53501 existing records from primary storage. [2025-10-03T22:47:15.752004] [INFO ] [MAIN ] WPM: Loaded 53501 primary data records. [2025-10-03T22:47:16.309229] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:16.310034] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 30989 primary records. [2025-10-03T22:47:16.310187] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-03T22:47:16.329038] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-10-03T22:47:16.329719] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-03T22:47:16.332177] [INFO ] [MAIN ] Derivative Progress: 2020/2073 symbols completed. WOW took 1.1s. Estimated remaining: 21.5s. Rate: 148.1 symbols/min [2025-10-03T22:47:16.332457] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:16.355166] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:16.355957] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 49077 primary records. [2025-10-03T22:47:16.356041] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-03T22:47:16.384064] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-10-03T22:47:16.384259] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-03T22:47:16.399030] [INFO ] [MAIN ] Derivative Progress: 2021/2073 symbols completed. WPC took 1.1s. Estimated remaining: 21.1s. Rate: 148.2 symbols/min [2025-10-03T22:47:16.399366] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:16.399667] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:16.409624] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53501 primary records. [2025-10-03T22:47:16.411054] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-03T22:47:16.412038] [DEBUG] [LOCAL ] WPP: Loaded 34410 existing records from primary storage. [2025-10-03T22:47:16.412339] [INFO ] [MAIN ] WPP: Loaded 34410 primary data records. [2025-10-03T22:47:16.527366] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-10-03T22:47:16.530834] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-03T22:47:16.533849] [INFO ] [MAIN ] Derivative Progress: 2022/2073 symbols completed. WPM took 1.2s. Estimated remaining: 20.6s. Rate: 148.2 symbols/min [2025-10-03T22:47:16.534054] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:16.764894] [DEBUG] [LOCAL ] WRB: Loaded 51321 existing records from primary storage. [2025-10-03T22:47:16.765603] [INFO ] [MAIN ] WRB: Loaded 51321 primary data records. [2025-10-03T22:47:17.109772] [DEBUG] [LOCAL ] WRBY: Loaded 51508 existing records from primary storage. [2025-10-03T22:47:17.110012] [INFO ] [MAIN ] WRBY: Loaded 51508 primary data records. [2025-10-03T22:47:17.208302] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:17.226497] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34410 primary records. [2025-10-03T22:47:17.232705] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-03T22:47:17.324410] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-10-03T22:47:17.342971] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-03T22:47:17.345788] [INFO ] [MAIN ] Derivative Progress: 2023/2073 symbols completed. WPP took 1.0s. Estimated remaining: 20.2s. Rate: 148.2 symbols/min [2025-10-03T22:47:17.551591] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:17.552854] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51321 primary records. [2025-10-03T22:47:17.552938] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-03T22:47:17.570321] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-10-03T22:47:17.570514] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-03T22:47:17.572917] [INFO ] [MAIN ] Derivative Progress: 2024/2073 symbols completed. WRB took 1.2s. Estimated remaining: 19.8s. Rate: 148.2 symbols/min [2025-10-03T22:47:17.593564] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:17.594334] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51508 primary records. [2025-10-03T22:47:17.594404] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-03T22:47:17.612095] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-10-03T22:47:17.612249] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-03T22:47:17.615296] [INFO ] [MAIN ] Derivative Progress: 2025/2073 symbols completed. WRBY took 1.1s. Estimated remaining: 19.4s. Rate: 148.3 symbols/min [2025-10-03T22:47:17.616172] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:17.616279] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:17.616473] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:17.648514] [DEBUG] [LOCAL ] WS: Loaded 24345 existing records from primary storage. [2025-10-03T22:47:17.655750] [INFO ] [MAIN ] WS: Loaded 24345 primary data records. [2025-10-03T22:47:17.693790] [DEBUG] [LOCAL ] WSO: Loaded 25075 existing records from primary storage. [2025-10-03T22:47:17.727029] [INFO ] [MAIN ] WSO: Loaded 25075 primary data records. [2025-10-03T22:47:18.100451] [DEBUG] [LOCAL ] WSM: Loaded 50270 existing records from primary storage. [2025-10-03T22:47:18.117087] [INFO ] [MAIN ] WSM: Loaded 50270 primary data records. [2025-10-03T22:47:18.642192] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:18.647194] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:18.648683] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 24345 primary records. [2025-10-03T22:47:18.648045] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25075 primary records. [2025-10-03T22:47:18.648993] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-03T22:47:18.648813] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-03T22:47:18.680450] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-10-03T22:47:18.695067] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-03T22:47:18.696170] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-10-03T22:47:18.698534] [INFO ] [MAIN ] Derivative Progress: 2026/2073 symbols completed. WSO took 1.1s. Estimated remaining: 19.0s. Rate: 148.1 symbols/min [2025-10-03T22:47:18.698801] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-03T22:47:18.701353] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:18.701950] [INFO ] [MAIN ] Derivative Progress: 2027/2073 symbols completed. WS took 1.1s. Estimated remaining: 18.6s. Rate: 148.2 symbols/min [2025-10-03T22:47:18.701796] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:18.703424] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:18.703158] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50270 primary records. [2025-10-03T22:47:18.703593] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-03T22:47:18.721071] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-10-03T22:47:18.722792] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-03T22:47:18.725596] [INFO ] [MAIN ] Derivative Progress: 2028/2073 symbols completed. WSM took 1.1s. Estimated remaining: 18.2s. Rate: 148.3 symbols/min [2025-10-03T22:47:18.725818] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:18.748569] [DEBUG] [LOCAL ] WSR: Loaded 23351 existing records from primary storage. [2025-10-03T22:47:18.756668] [INFO ] [MAIN ] WSR: Loaded 23351 primary data records. [2025-10-03T22:47:18.877908] [DEBUG] [LOCAL ] WST: Loaded 37749 existing records from primary storage. [2025-10-03T22:47:18.902895] [INFO ] [MAIN ] WST: Loaded 37749 primary data records. [2025-10-03T22:47:19.200905] [DEBUG] [LOCAL ] WT: Loaded 48451 existing records from primary storage. [2025-10-03T22:47:19.206770] [INFO ] [MAIN ] WT: Loaded 48451 primary data records. [2025-10-03T22:47:19.784182] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:19.785392] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23351 primary records. [2025-10-03T22:47:19.785692] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-03T22:47:19.806817] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-10-03T22:47:19.819307] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-03T22:47:19.821784] [INFO ] [MAIN ] Derivative Progress: 2029/2073 symbols completed. WSR took 1.1s. Estimated remaining: 17.8s. Rate: 148.1 symbols/min [2025-10-03T22:47:19.822239] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:19.823028] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:19.824063] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 37749 primary records. [2025-10-03T22:47:19.824379] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-03T22:47:19.844813] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-10-03T22:47:19.845063] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-03T22:47:19.847591] [INFO ] [MAIN ] Derivative Progress: 2030/2073 symbols completed. WST took 1.1s. Estimated remaining: 17.4s. Rate: 148.2 symbols/min [2025-10-03T22:47:19.848119] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:19.861548] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:19.862471] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48451 primary records. [2025-10-03T22:47:19.862684] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-03T22:47:19.881119] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-10-03T22:47:19.881261] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-03T22:47:19.884213] [INFO ] [MAIN ] Derivative Progress: 2031/2073 symbols completed. WT took 1.2s. Estimated remaining: 17.0s. Rate: 148.3 symbols/min [2025-10-03T22:47:19.884441] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:19.918970] [DEBUG] [LOCAL ] WTI: Loaded 44520 existing records from primary storage. [2025-10-03T22:47:19.919229] [INFO ] [MAIN ] WTI: Loaded 44520 primary data records. [2025-10-03T22:47:19.970266] [DEBUG] [LOCAL ] WTS: Loaded 18320 existing records from primary storage. [2025-10-03T22:47:19.988731] [INFO ] [MAIN ] WTS: Loaded 18320 primary data records. [2025-10-03T22:47:20.136671] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-10-03T22:47:20.164315] [INFO ] [MAIN ] WTRG: Loaded 51656 primary data records. [2025-10-03T22:47:20.915397] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:20.915697] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:20.917425] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 18320 primary records. [2025-10-03T22:47:20.917547] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-03T22:47:20.916684] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44520 primary records. [2025-10-03T22:47:20.917678] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-03T22:47:20.952674] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-10-03T22:47:20.952593] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-10-03T22:47:20.952840] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-03T22:47:20.956101] [INFO ] [MAIN ] Derivative Progress: 2032/2073 symbols completed. WTI took 1.1s. Estimated remaining: 16.6s. Rate: 148.2 symbols/min [2025-10-03T22:47:20.956461] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-03T22:47:20.967020] [INFO ] [MAIN ] Derivative Progress: 2033/2073 symbols completed. WTS took 1.1s. Estimated remaining: 16.2s. Rate: 148.2 symbols/min [2025-10-03T22:47:20.956594] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:20.972695] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:20.973015] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:20.974020] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51656 primary records. [2025-10-03T22:47:20.974508] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-03T22:47:20.993474] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-10-03T22:47:20.993542] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-03T22:47:20.996437] [INFO ] [MAIN ] Derivative Progress: 2034/2073 symbols completed. WTRG took 1.1s. Estimated remaining: 15.8s. Rate: 148.3 symbols/min [2025-10-03T22:47:20.996809] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:21.042975] [DEBUG] [LOCAL ] WTTR: Loaded 45598 existing records from primary storage. [2025-10-03T22:47:21.043209] [INFO ] [MAIN ] WTTR: Loaded 45598 primary data records. [2025-10-03T22:47:21.166337] [DEBUG] [LOCAL ] WU: Loaded 54233 existing records from primary storage. [2025-10-03T22:47:21.172289] [INFO ] [MAIN ] WU: Loaded 54233 primary data records. [2025-10-03T22:47:21.547567] [DEBUG] [LOCAL ] WWW: Loaded 49849 existing records from primary storage. [2025-10-03T22:47:21.579147] [INFO ] [MAIN ] WWW: Loaded 49849 primary data records. [2025-10-03T22:47:22.086791] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:22.088084] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45598 primary records. [2025-10-03T22:47:22.088408] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-03T22:47:22.111245] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-10-03T22:47:22.111924] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-03T22:47:22.114308] [INFO ] [MAIN ] Derivative Progress: 2035/2073 symbols completed. WTTR took 1.2s. Estimated remaining: 15.4s. Rate: 148.2 symbols/min [2025-10-03T22:47:22.114623] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:22.128400] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:22.130026] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54233 primary records. [2025-10-03T22:47:22.130106] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-03T22:47:22.149917] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-10-03T22:47:22.150092] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-03T22:47:22.152994] [INFO ] [MAIN ] Derivative Progress: 2036/2073 symbols completed. WU took 1.2s. Estimated remaining: 15.0s. Rate: 148.2 symbols/min [2025-10-03T22:47:22.165456] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:22.166776] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:22.167485] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49849 primary records. [2025-10-03T22:47:22.167587] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-03T22:47:22.203375] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-10-03T22:47:22.203525] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-03T22:47:22.206460] [INFO ] [MAIN ] Derivative Progress: 2037/2073 symbols completed. WWW took 1.2s. Estimated remaining: 14.6s. Rate: 148.3 symbols/min [2025-10-03T22:47:22.206804] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:22.231583] [DEBUG] [LOCAL ] XFLT: Loaded 30237 existing records from primary storage. [2025-10-03T22:47:22.231762] [INFO ] [MAIN ] XFLT: Loaded 30237 primary data records. [2025-10-03T22:47:22.357304] [DEBUG] [LOCAL ] WY: Loaded 53893 existing records from primary storage. [2025-10-03T22:47:22.374029] [INFO ] [MAIN ] WY: Loaded 53893 primary data records. [2025-10-03T22:47:22.725834] [DEBUG] [LOCAL ] XHR: Loaded 44335 existing records from primary storage. [2025-10-03T22:47:22.736567] [INFO ] [MAIN ] XHR: Loaded 44335 primary data records. [2025-10-03T22:47:23.304309] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:23.305993] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30237 primary records. [2025-10-03T22:47:23.306096] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-03T22:47:23.334916] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:23.336551] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53893 primary records. [2025-10-03T22:47:23.335740] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-10-03T22:47:23.336855] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-03T22:47:23.337096] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-03T22:47:23.340017] [INFO ] [MAIN ] Derivative Progress: 2038/2073 symbols completed. XFLT took 1.2s. Estimated remaining: 14.2s. Rate: 148.2 symbols/min [2025-10-03T22:47:23.370663] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:23.372268] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44335 primary records. [2025-10-03T22:47:23.372319] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-10-03T22:47:23.372428] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-03T22:47:23.374808] [INFO ] [MAIN ] Derivative Progress: 2039/2073 symbols completed. WY took 1.3s. Estimated remaining: 13.8s. Rate: 148.2 symbols/min [2025-10-03T22:47:23.374898] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-03T22:47:23.391745] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-10-03T22:47:23.391812] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-03T22:47:23.394630] [INFO ] [MAIN ] Derivative Progress: 2040/2073 symbols completed. XHR took 1.2s. Estimated remaining: 13.4s. Rate: 148.3 symbols/min [2025-10-03T22:47:23.395035] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:23.395105] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:23.395227] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:23.435878] [DEBUG] [LOCAL ] XPER: Loaded 30362 existing records from primary storage. [2025-10-03T22:47:23.436201] [INFO ] [MAIN ] XPER: Loaded 30362 primary data records. [2025-10-03T22:47:23.594683] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-03T22:47:23.608852] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-10-03T22:47:23.926122] [DEBUG] [LOCAL ] XPEV: Loaded 54416 existing records from primary storage. [2025-10-03T22:47:23.935436] [INFO ] [MAIN ] XPEV: Loaded 54416 primary data records. [2025-10-03T22:47:24.467931] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:24.468970] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30362 primary records. [2025-10-03T22:47:24.469078] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-03T22:47:24.487435] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-10-03T22:47:24.488473] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-03T22:47:24.491694] [INFO ] [MAIN ] Derivative Progress: 2041/2073 symbols completed. XPER took 1.1s. Estimated remaining: 13.0s. Rate: 148.2 symbols/min [2025-10-03T22:47:24.492413] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:24.506475] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:24.507389] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-10-03T22:47:24.507560] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-03T22:47:24.526995] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-10-03T22:47:24.540963] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:24.541065] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-03T22:47:24.542168] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54416 primary records. [2025-10-03T22:47:24.546480] [INFO ] [MAIN ] Derivative Progress: 2042/2073 symbols completed. XOM took 1.2s. Estimated remaining: 12.5s. Rate: 148.2 symbols/min [2025-10-03T22:47:24.546957] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-03T22:47:24.546833] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:24.576485] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-10-03T22:47:24.576698] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-03T22:47:24.579241] [INFO ] [MAIN ] Derivative Progress: 2043/2073 symbols completed. XPEV took 1.2s. Estimated remaining: 12.1s. Rate: 148.3 symbols/min [2025-10-03T22:47:24.579452] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:24.612672] [DEBUG] [LOCAL ] XPO: Loaded 48514 existing records from primary storage. [2025-10-03T22:47:24.613454] [INFO ] [MAIN ] XPO: Loaded 48514 primary data records. [2025-10-03T22:47:24.638320] [DEBUG] [LOCAL ] XPOF: Loaded 38557 existing records from primary storage. [2025-10-03T22:47:24.691430] [INFO ] [MAIN ] XPOF: Loaded 38557 primary data records. [2025-10-03T22:47:24.895184] [DEBUG] [LOCAL ] XPRO: Loaded 46504 existing records from primary storage. [2025-10-03T22:47:24.958708] [INFO ] [MAIN ] XPRO: Loaded 46504 primary data records. [2025-10-03T22:47:25.642559] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:25.644571] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48514 primary records. [2025-10-03T22:47:25.644768] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-03T22:47:25.658315] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:25.666546] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 38557 primary records. [2025-10-03T22:47:25.670329] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-03T22:47:25.687216] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-10-03T22:47:25.687526] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-03T22:47:25.690721] [INFO ] [MAIN ] Derivative Progress: 2044/2073 symbols completed. XPO took 1.2s. Estimated remaining: 11.7s. Rate: 148.2 symbols/min [2025-10-03T22:47:25.691148] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:25.699341] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-10-03T22:47:25.699729] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-03T22:47:25.714607] [INFO ] [MAIN ] Derivative Progress: 2045/2073 symbols completed. XPOF took 1.2s. Estimated remaining: 11.3s. Rate: 148.3 symbols/min [2025-10-03T22:47:25.715013] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:25.715377] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:25.716794] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46504 primary records. [2025-10-03T22:47:25.716877] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-03T22:47:25.751219] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-10-03T22:47:25.752572] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-03T22:47:25.755379] [INFO ] [MAIN ] Derivative Progress: 2046/2073 symbols completed. XPRO took 1.2s. Estimated remaining: 10.9s. Rate: 148.3 symbols/min [2025-10-03T22:47:25.756176] [DEBUG] [LOCAL ] XYF: Loaded 28838 existing records from primary storage. [2025-10-03T22:47:25.756426] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:25.756335] [INFO ] [MAIN ] XYF: Loaded 28838 primary data records. [2025-10-03T22:47:26.092532] [DEBUG] [LOCAL ] YALA: Loaded 37631 existing records from primary storage. [2025-10-03T22:47:26.093247] [INFO ] [MAIN ] YALA: Loaded 37631 primary data records. [2025-10-03T22:47:26.164558] [DEBUG] [LOCAL ] XYL: Loaded 48668 existing records from primary storage. [2025-10-03T22:47:26.196248] [INFO ] [MAIN ] XYL: Loaded 48668 primary data records. [2025-10-03T22:47:26.733956] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:26.736636] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28838 primary records. [2025-10-03T22:47:26.737262] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-03T22:47:26.772125] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:26.774083] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37631 primary records. [2025-10-03T22:47:26.774377] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-03T22:47:26.776515] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-10-03T22:47:26.777664] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-03T22:47:26.791946] [INFO ] [MAIN ] Derivative Progress: 2047/2073 symbols completed. XYF took 1.1s. Estimated remaining: 10.5s. Rate: 148.2 symbols/min [2025-10-03T22:47:26.793104] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:26.797836] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-10-03T22:47:26.798135] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-03T22:47:26.813759] [INFO ] [MAIN ] Derivative Progress: 2048/2073 symbols completed. YALA took 1.1s. Estimated remaining: 10.1s. Rate: 148.3 symbols/min [2025-10-03T22:47:26.815020] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:26.814896] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:26.816536] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48668 primary records. [2025-10-03T22:47:26.816627] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-03T22:47:26.836441] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-10-03T22:47:26.836630] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-03T22:47:26.839386] [INFO ] [MAIN ] Derivative Progress: 2049/2073 symbols completed. XYL took 1.1s. Estimated remaining: 9.7s. Rate: 148.3 symbols/min [2025-10-03T22:47:26.839688] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:26.892854] [DEBUG] [LOCAL ] YELP: Loaded 45980 existing records from primary storage. [2025-10-03T22:47:26.893366] [INFO ] [MAIN ] YELP: Loaded 45980 primary data records. [2025-10-03T22:47:26.998511] [DEBUG] [LOCAL ] YEXT: Loaded 43743 existing records from primary storage. [2025-10-03T22:47:27.014696] [INFO ] [MAIN ] YEXT: Loaded 43743 primary data records. [2025-10-03T22:47:27.056169] [DEBUG] [LOCAL ] YETI: Loaded 53220 existing records from primary storage. [2025-10-03T22:47:27.129118] [INFO ] [MAIN ] YETI: Loaded 53220 primary data records. [2025-10-03T22:47:27.929186] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:27.931544] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 45980 primary records. [2025-10-03T22:47:27.931783] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-03T22:47:27.964745] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-10-03T22:47:27.965289] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:27.966152] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43743 primary records. [2025-10-03T22:47:27.966326] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-03T22:47:27.967287] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-03T22:47:27.969714] [INFO ] [MAIN ] Derivative Progress: 2050/2073 symbols completed. YELP took 1.2s. Estimated remaining: 9.3s. Rate: 148.2 symbols/min [2025-10-03T22:47:27.969976] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:28.001755] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:28.003407] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53220 primary records. [2025-10-03T22:47:28.006310] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-10-03T22:47:28.006447] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-03T22:47:28.006099] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-03T22:47:28.009829] [INFO ] [MAIN ] Derivative Progress: 2051/2073 symbols completed. YEXT took 1.2s. Estimated remaining: 8.9s. Rate: 148.3 symbols/min [2025-10-03T22:47:28.011288] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:28.034988] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-10-03T22:47:28.035131] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-03T22:47:28.038180] [INFO ] [MAIN ] Derivative Progress: 2052/2073 symbols completed. YETI took 1.2s. Estimated remaining: 8.5s. Rate: 148.3 symbols/min [2025-10-03T22:47:28.038515] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:28.088723] [DEBUG] [LOCAL ] YMM: Loaded 53399 existing records from primary storage. [2025-10-03T22:47:28.088888] [INFO ] [MAIN ] YMM: Loaded 53399 primary data records. [2025-10-03T22:47:28.204337] [DEBUG] [LOCAL ] YOU: Loaded 50427 existing records from primary storage. [2025-10-03T22:47:28.222941] [INFO ] [MAIN ] YOU: Loaded 50427 primary data records. [2025-10-03T22:47:28.531555] [DEBUG] [LOCAL ] YPF: Loaded 51246 existing records from primary storage. [2025-10-03T22:47:28.552887] [INFO ] [MAIN ] YPF: Loaded 51246 primary data records. [2025-10-03T22:47:29.088025] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:29.089339] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53399 primary records. [2025-10-03T22:47:29.090420] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-03T22:47:29.123345] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-10-03T22:47:29.123592] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-03T22:47:29.122265] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:29.124460] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50427 primary records. [2025-10-03T22:47:29.126897] [INFO ] [MAIN ] Derivative Progress: 2053/2073 symbols completed. YMM took 1.2s. Estimated remaining: 8.1s. Rate: 148.2 symbols/min [2025-10-03T22:47:29.127178] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-03T22:47:29.158750] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:29.159990] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51246 primary records. [2025-10-03T22:47:29.160326] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-03T22:47:29.161149] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-10-03T22:47:29.161525] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-03T22:47:29.164342] [INFO ] [MAIN ] Derivative Progress: 2054/2073 symbols completed. YOU took 1.2s. Estimated remaining: 7.7s. Rate: 148.3 symbols/min [2025-10-03T22:47:29.180507] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-10-03T22:47:29.180582] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-03T22:47:29.183307] [INFO ] [MAIN ] Derivative Progress: 2055/2073 symbols completed. YPF took 1.1s. Estimated remaining: 7.3s. Rate: 148.4 symbols/min [2025-10-03T22:47:29.183724] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:29.184313] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:29.184245] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:29.205539] [DEBUG] [LOCAL ] YRD: Loaded 12794 existing records from primary storage. [2025-10-03T22:47:29.205899] [INFO ] [MAIN ] YRD: Loaded 12794 primary data records. [2025-10-03T22:47:29.339187] [DEBUG] [LOCAL ] YSG: Loaded 25886 existing records from primary storage. [2025-10-03T22:47:29.355034] [INFO ] [MAIN ] YSG: Loaded 25886 primary data records. [2025-10-03T22:47:29.717415] [DEBUG] [LOCAL ] YUM: Loaded 51935 existing records from primary storage. [2025-10-03T22:47:29.736385] [INFO ] [MAIN ] YUM: Loaded 51935 primary data records. [2025-10-03T22:47:30.221704] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:30.222859] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12794 primary records. [2025-10-03T22:47:30.222987] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-03T22:47:30.243521] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-10-03T22:47:30.243911] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-03T22:47:30.246458] [INFO ] [MAIN ] Derivative Progress: 2056/2073 symbols completed. YRD took 1.1s. Estimated remaining: 6.9s. Rate: 148.2 symbols/min [2025-10-03T22:47:30.246624] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:30.260918] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:30.261679] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25886 primary records. [2025-10-03T22:47:30.261891] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-03T22:47:30.293154] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:30.294481] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51935 primary records. [2025-10-03T22:47:30.294616] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-03T22:47:30.297132] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-10-03T22:47:30.297426] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-03T22:47:30.299985] [INFO ] [MAIN ] Derivative Progress: 2057/2073 symbols completed. YSG took 1.1s. Estimated remaining: 6.5s. Rate: 148.3 symbols/min [2025-10-03T22:47:30.311356] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:30.316957] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-10-03T22:47:30.317139] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-03T22:47:30.320470] [INFO ] [MAIN ] Derivative Progress: 2058/2073 symbols completed. YUM took 1.1s. Estimated remaining: 6.1s. Rate: 148.4 symbols/min [2025-10-03T22:47:30.320765] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:30.360928] [DEBUG] [LOCAL ] YUMC: Loaded 53407 existing records from primary storage. [2025-10-03T22:47:30.361226] [INFO ] [MAIN ] YUMC: Loaded 53407 primary data records. [2025-10-03T22:47:30.389220] [DEBUG] [LOCAL ] ZEPP: Loaded 17887 existing records from primary storage. [2025-10-03T22:47:30.426257] [INFO ] [MAIN ] ZEPP: Loaded 17887 primary data records. [2025-10-03T22:47:30.881232] [DEBUG] [LOCAL ] ZBH: Loaded 51739 existing records from primary storage. [2025-10-03T22:47:31.004686] [INFO ] [MAIN ] ZBH: Loaded 51739 primary data records. [2025-10-03T22:47:31.397630] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-03T22:47:31.401414] [INFO ] [MAIN ] ZEPP: Generated 1819 derivative records from 17887 primary records. [2025-10-03T22:47:31.401569] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-03T22:47:31.416056] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:31.425281] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53407 primary records. [2025-10-03T22:47:31.429583] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-03T22:47:31.446628] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1819 records). [2025-10-03T22:47:31.451328] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-10-03T22:47:31.451537] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-03T22:47:31.451414] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-03T22:47:31.453819] [INFO ] [MAIN ] Derivative Progress: 2059/2073 symbols completed. YUMC took 1.2s. Estimated remaining: 5.7s. Rate: 148.2 symbols/min [2025-10-03T22:47:31.457144] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:31.457294] [INFO ] [MAIN ] Derivative Progress: 2060/2073 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.3s. Rate: 148.3 symbols/min [2025-10-03T22:47:31.457756] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:31.479385] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:31.480144] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51739 primary records. [2025-10-03T22:47:31.480328] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-03T22:47:31.499098] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-10-03T22:47:31.499284] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-03T22:47:31.502171] [INFO ] [MAIN ] Derivative Progress: 2061/2073 symbols completed. ZBH took 1.2s. Estimated remaining: 4.9s. Rate: 148.4 symbols/min [2025-10-03T22:47:31.502458] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:31.542991] [DEBUG] [LOCAL ] ZGN: Loaded 41301 existing records from primary storage. [2025-10-03T22:47:31.543683] [INFO ] [MAIN ] ZGN: Loaded 41301 primary data records. [2025-10-03T22:47:31.654330] [DEBUG] [LOCAL ] ZETA: Loaded 54377 existing records from primary storage. [2025-10-03T22:47:31.679178] [INFO ] [MAIN ] ZETA: Loaded 54377 primary data records. [2025-10-03T22:47:31.691920] [DEBUG] [LOCAL ] ZH: Loaded 26692 existing records from primary storage. [2025-10-03T22:47:31.692054] [INFO ] [MAIN ] ZH: Loaded 26692 primary data records. [2025-10-03T22:47:32.519751] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:32.520881] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41301 primary records. [2025-10-03T22:47:32.521513] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-03T22:47:32.555624] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:32.555750] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-10-03T22:47:32.556432] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-03T22:47:32.559969] [INFO ] [MAIN ] Derivative Progress: 2062/2073 symbols completed. ZGN took 1.1s. Estimated remaining: 4.5s. Rate: 148.3 symbols/min [2025-10-03T22:47:32.557614] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54377 primary records. [2025-10-03T22:47:32.561685] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-03T22:47:32.561472] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:32.588341] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:32.589589] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 26692 primary records. [2025-10-03T22:47:32.589935] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-03T22:47:32.605669] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-10-03T22:47:32.606768] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-03T22:47:32.609681] [INFO ] [MAIN ] Derivative Progress: 2063/2073 symbols completed. ZETA took 1.2s. Estimated remaining: 4.0s. Rate: 148.3 symbols/min [2025-10-03T22:47:32.609907] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:32.614730] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-10-03T22:47:32.614940] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-03T22:47:32.618118] [INFO ] [MAIN ] Derivative Progress: 2064/2073 symbols completed. ZH took 1.1s. Estimated remaining: 3.6s. Rate: 148.4 symbols/min [2025-10-03T22:47:32.618407] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:32.695580] [DEBUG] [LOCAL ] ZIM: Loaded 54289 existing records from primary storage. [2025-10-03T22:47:32.696332] [INFO ] [MAIN ] ZIM: Loaded 54289 primary data records. [2025-10-03T22:47:32.720595] [DEBUG] [LOCAL ] ZK: Loaded 40134 existing records from primary storage. [2025-10-03T22:47:32.746172] [INFO ] [MAIN ] ZK: Loaded 40134 primary data records. [2025-10-03T22:47:32.775367] [DEBUG] [LOCAL ] ZIP: Loaded 44711 existing records from primary storage. [2025-10-03T22:47:32.787597] [INFO ] [MAIN ] ZIP: Loaded 44711 primary data records. [2025-10-03T22:47:33.713421] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:33.714309] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54289 primary records. [2025-10-03T22:47:33.714571] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-03T22:47:33.758271] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:33.758952] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:33.759687] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 40134 primary records. [2025-10-03T22:47:33.760536] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44711 primary records. [2025-10-03T22:47:33.760619] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-03T22:47:33.760674] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-03T22:47:33.765150] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-10-03T22:47:33.777457] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-03T22:47:33.793283] [INFO ] [MAIN ] Derivative Progress: 2065/2073 symbols completed. ZIM took 1.2s. Estimated remaining: 3.2s. Rate: 148.3 symbols/min [2025-10-03T22:47:33.795083] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:33.800584] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-10-03T22:47:33.803716] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-03T22:47:33.806918] [INFO ] [MAIN ] Derivative Progress: 2066/2073 symbols completed. ZK took 1.2s. Estimated remaining: 2.8s. Rate: 148.3 symbols/min [2025-10-03T22:47:33.807449] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:33.808337] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-10-03T22:47:33.808508] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-03T22:47:33.812784] [INFO ] [MAIN ] Derivative Progress: 2067/2073 symbols completed. ZIP took 1.2s. Estimated remaining: 2.4s. Rate: 148.4 symbols/min [2025-10-03T22:47:33.818041] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:33.818349] [DEBUG] [LOCAL ] ZKH: Loaded 7885 existing records from primary storage. [2025-10-03T22:47:33.818603] [INFO ] [MAIN ] ZKH: Loaded 7885 primary data records. [2025-10-03T22:47:33.984846] [DEBUG] [LOCAL ] ZTR: Loaded 16981 existing records from primary storage. [2025-10-03T22:47:33.996853] [INFO ] [MAIN ] ZTR: Loaded 16981 primary data records. [2025-10-03T22:47:34.365606] [DEBUG] [LOCAL ] ZTO: Loaded 50585 existing records from primary storage. [2025-10-03T22:47:34.369744] [INFO ] [MAIN ] ZTO: Loaded 50585 primary data records. [2025-10-03T22:47:34.837741] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:34.839568] [INFO ] [MAIN ] ZKH: Generated 1820 derivative records from 7885 primary records. [2025-10-03T22:47:34.840530] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-03T22:47:34.857909] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1820 records). [2025-10-03T22:47:34.858244] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-03T22:47:34.861100] [INFO ] [MAIN ] Derivative Progress: 2068/2073 symbols completed. ZKH took 1.1s. Estimated remaining: 2.0s. Rate: 148.3 symbols/min [2025-10-03T22:47:34.879719] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:34.880539] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16981 primary records. [2025-10-03T22:47:34.880671] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-03T22:47:34.911805] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:34.913151] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50585 primary records. [2025-10-03T22:47:34.913529] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-03T22:47:34.915160] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-10-03T22:47:34.915512] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-03T22:47:34.919261] [INFO ] [MAIN ] Derivative Progress: 2069/2073 symbols completed. ZTR took 1.1s. Estimated remaining: 1.6s. Rate: 148.3 symbols/min [2025-10-03T22:47:34.935581] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-10-03T22:47:34.935667] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-03T22:47:34.938242] [INFO ] [MAIN ] Derivative Progress: 2070/2073 symbols completed. ZTO took 1.1s. Estimated remaining: 1.2s. Rate: 148.4 symbols/min [2025-10-03T22:47:34.938680] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:34.938810] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:34.938607] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-03T22:47:35.028797] [DEBUG] [LOCAL ] ZVIA: Loaded 35928 existing records from primary storage. [2025-10-03T22:47:35.043998] [INFO ] [MAIN ] ZVIA: Loaded 35928 primary data records. [2025-10-03T22:47:35.050971] [DEBUG] [LOCAL ] ZTS: Loaded 53769 existing records from primary storage. [2025-10-03T22:47:35.088935] [INFO ] [MAIN ] ZTS: Loaded 53769 primary data records. [2025-10-03T22:47:35.101759] [DEBUG] [LOCAL ] ZWS: Loaded 42932 existing records from primary storage. [2025-10-03T22:47:35.107224] [INFO ] [MAIN ] ZWS: Loaded 42932 primary data records. [2025-10-03T22:47:36.058633] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:36.059793] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53769 primary records. [2025-10-03T22:47:36.060273] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-03T22:47:36.081412] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-10-03T22:47:36.101860] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:36.081882] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-03T22:47:36.107595] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 42932 primary records. [2025-10-03T22:47:36.107755] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-03T22:47:36.110459] [INFO ] [MAIN ] Derivative Progress: 2071/2073 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 148.3 symbols/min [2025-10-03T22:47:36.110679] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-03T22:47:36.111474] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35928 primary records. [2025-10-03T22:47:36.112163] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-03T22:47:36.142287] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-10-03T22:47:36.142608] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-03T22:47:36.145428] [INFO ] [MAIN ] Derivative Progress: 2072/2073 symbols completed. ZWS took 1.2s. Estimated remaining: 0.4s. Rate: 148.3 symbols/min [2025-10-03T22:47:36.146535] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-10-03T22:47:36.146602] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-03T22:47:36.148777] [INFO ] [MAIN ] Derivative Progress: 2073/2073 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.0s. Rate: 148.4 symbols/min [2025-10-03T22:47:36.149731] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 58s [2025-10-03T22:47:36.149915] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2073/2073 symbols) [2025-10-03T22:47:36.977068] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2073/2073 @ 100.00%)' [2025-10-03T22:47:36.977827] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-03T22:47:36.979303] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-03T22:47:36.979713] [INFO ] [STATE ] Last completion updated: 2025-10-03T22:47:36.979446